2024-02-19T18:38:01.227 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T18:38:01.227 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654 --verbose --name pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654/orig.config.yaml 2024-02-19T18:38:01.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:38:01.386 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654 branch: wip-batrick-testing-20240215.160715 description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7566654' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240215.160715 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f78a58c0ffd401d1493058a1022c35f011d65275 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f78a58c0ffd401d1493058a1022c35f011d65275 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: i64440 sha1: 1ce7ea8877c709fa862eac608550374bd96e166e owner: scheduled_pdonnell@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2975 sha1: f78a58c0ffd401d1493058a1022c35f011d65275 sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: i64440 suite_path: /home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 1ce7ea8877c709fa862eac608550374bd96e166e targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMyQ1DUzSu+1epuFRwlF2GjDRcc1OURWZl+Vc5PGCBdr2ZyYjwyH/K+BKh2p5gMac4mmqsymU+PQmpfX8zIM6TA= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfApKqs0C76XrvwplQnsZ6Z0p7tZbRFtt7m/NFr6OhqBAy7MNBNiZ8U+FE8dQNlIjU4TCEM0gyTC9raPop5R8k= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - full_sequential_finally: - sleep: duration: 3600 - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-19_18:28:45 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-19T18:38:01.386 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa; will attempt to use it 2024-02-19T18:38:01.387 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa/tasks 2024-02-19T18:38:01.388 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-19T18:38:01.390 INFO:teuthology.task.internal:Checking packages... 2024-02-19T18:38:01.426 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f78a58c0ffd401d1493058a1022c35f011d65275' 2024-02-19T18:38:01.427 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-19T18:38:01.427 INFO:teuthology.packaging:ref: None 2024-02-19T18:38:01.427 INFO:teuthology.packaging:tag: None 2024-02-19T18:38:01.427 INFO:teuthology.packaging:branch: wip-batrick-testing-20240215.160715 2024-02-19T18:38:01.427 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:38:01.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240215.160715 2024-02-19T18:38:01.681 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1450.gf78a58c0 2024-02-19T18:38:01.683 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-19T18:38:01.689 INFO:teuthology.task.internal:no buildpackages task found 2024-02-19T18:38:01.689 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-19T18:38:01.697 INFO:teuthology.task.internal:Saving configuration 2024-02-19T18:38:01.718 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-19T18:38:01.724 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T18:38:01.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 18:30:52.930817', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMyQ1DUzSu+1epuFRwlF2GjDRcc1OURWZl+Vc5PGCBdr2ZyYjwyH/K+BKh2p5gMac4mmqsymU+PQmpfX8zIM6TA='} 2024-02-19T18:38:01.763 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 18:30:52.929240', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfApKqs0C76XrvwplQnsZ6Z0p7tZbRFtt7m/NFr6OhqBAy7MNBNiZ8U+FE8dQNlIjU4TCEM0gyTC9raPop5R8k='} 2024-02-19T18:38:01.764 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-19T18:38:01.770 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-19T18:38:01.770 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-19T18:38:01.770 INFO:teuthology.run_tasks:Running task console_log... 2024-02-19T18:38:01.838 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2b4437f0d0>, signals=[15]) 2024-02-19T18:38:01.838 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-19T18:38:01.845 INFO:teuthology.task.internal:Opening connections... 2024-02-19T18:38:01.845 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T18:38:01.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:38:01.952 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T18:38:01.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:38:02.039 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-19T18:38:02.047 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-02-19T18:38:02.065 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-02-19T18:38:02.065 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-02-19T18:38:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-02-19T18:38:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-02-19T18:38:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-02-19T18:38:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:38:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-02-19T18:38:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:38:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:38:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-02-19T18:38:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:38:02.123 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:38:02.124 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:38:02.124 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:38:02.124 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:38:02.124 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:38:02.124 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-02-19T18:38:02.146 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-02-19T18:38:02.163 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-02-19T18:38:02.164 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-02-19T18:38:02.219 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-02-19T18:38:02.219 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:38:02.220 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:38:02.221 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-02-19T18:38:02.238 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-19T18:38:02.247 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-19T18:38:02.252 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-19T18:38:02.252 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-02-19T18:38:02.254 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-02-19T18:38:02.274 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-19T18:38:02.282 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-19T18:38:02.283 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-02-19T18:38:02.312 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-02-19T18:38:02.409 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-19T18:38:02.460 INFO:teuthology.run_tasks:Running task kernel... 2024-02-19T18:38:02.475 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-19T18:38:02.475 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-19T18:38:02.476 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-19T18:38:02.476 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-19T18:38:02.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T18:38:02.492 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-02-19T18:38:02.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T18:38:02.493 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-02-19T18:38:02.548 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-361.el9.x86_64 2024-02-19T18:38:02.548 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-361.el9.x86_64 2024-02-19T18:38:02.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-02-19T18:38:02.551 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-361.el9.x86_64 2024-02-19T18:38:02.551 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-361.el9.x86_64 2024-02-19T18:38:02.551 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-02-19T18:38:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-02-19T18:38:04.979 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 8.0 MB/s | 6.7 MB 00:00 2024-02-19T18:38:06.167 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2024-02-19T18:38:06.371 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-02-19T18:38:07.712 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 7.9 MB/s | 8.0 MB 00:01 2024-02-19T18:38:07.941 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.0 MB 00:01 2024-02-19T18:38:09.909 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-02-19T18:38:19.900 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 990 kB/s | 6.1 MB 00:06 2024-02-19T18:38:21.465 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 15 kB 00:00 2024-02-19T18:38:22.580 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2024-02-19T18:38:24.944 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:16 2024-02-19T18:38:27.720 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-02-19T18:38:30.085 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-19T18:38:30.085 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-19T18:38:30.177 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:38:30.189 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:38:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T18:38:30.189 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:38:30.189 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:38:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-19T18:38:30.189 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T18:38:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-19T18:38:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-19T18:38:30.189 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-19T18:38:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:38:30.190 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:38:30.190 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:38:30.190 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-02-19T18:38:30.190 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:38:30.190 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 100 M 2024-02-19T18:38:30.190 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 123 M 2024-02-19T18:38:30.191 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:38:30.629 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 14 MB/s | 6.1 MB 00:00 2024-02-19T18:38:31.188 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 21 MB/s | 21 MB 00:00 2024-02-19T18:38:32.113 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-core-5.14.0-421.el9.x86_6 23 MB/s | 33 MB 00:01 2024-02-19T18:38:32.721 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 15 MB/s | 39 MB 00:02 2024-02-19T18:38:32.724 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:38:32.725 INFO:teuthology.orchestra.run.smithi046.stdout:Total 39 MB/s | 100 MB 00:02 2024-02-19T18:38:32.725 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:38:32.810 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.1 MB 00:04 2024-02-19T18:38:33.149 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:38:33.149 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:38:34.208 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:38:34.209 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:38:34.403 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2024-02-19T18:38:36.098 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2024-02-19T18:38:36.864 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:38:37.545 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-19T18:38:37.679 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:38:40.555 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:38:40.730 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:38:40.871 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-02-19T18:38:43.102 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-19T18:38:43.103 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-19T18:38:43.193 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:38:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-02-19T18:38:43.206 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:38:43.207 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 100 M 2024-02-19T18:38:43.207 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 123 M 2024-02-19T18:38:43.207 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:38:44.038 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 7.3 MB/s | 6.1 MB 00:00 2024-02-19T18:38:45.489 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-modules-core-5.14.0-421.el9.x86_6 23 MB/s | 33 MB 00:01 2024-02-19T18:38:45.827 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:38:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:38:48.638 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-core-5.14.0-421.el9.x86_64.rpm 3.8 MB/s | 21 MB 00:05 2024-02-19T18:38:49.213 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 6.5 MB/s | 39 MB 00:06 2024-02-19T18:38:49.217 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:38:49.217 INFO:teuthology.orchestra.run.smithi142.stdout:Total 17 MB/s | 100 MB 00:06 2024-02-19T18:38:49.217 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:38:49.592 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:38:49.592 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:38:50.648 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:38:50.648 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:38:51.047 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:38:53.066 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:38:53.704 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-19T18:38:53.829 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:38:56.587 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:38:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:39:01.459 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:39:01.966 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:39:06.704 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:39:21.797 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:39:21.797 INFO:teuthology.orchestra.run.smithi046.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-19T18:39:21.797 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:39:21.871 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:39:22.279 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:39:22.279 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-19T18:39:22.279 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:39:22.279 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:39:22.747 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:39:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:39:22.748 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:39:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-19T18:39:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-19T18:39:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-19T18:39:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-19T18:39:22.748 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:39:22.748 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:39:23.263 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T18:39:23.406 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-19T18:39:23.407 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-19T18:39:23.407 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-19T18:39:23.407 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-19T18:39:23.407 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-19T18:39:23.407 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-19T18:39:23.407 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-02-19T18:39:23.407 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T18:39:23.520 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-19T18:39:23.520 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-19T18:39:23.520 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-02-19T18:39:23.563 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-02-19T18:39:23.564 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-02-19T18:39:23.564 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-02-19T18:39:23.564 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2024-02-19T18:39:23.564 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-02-19T18:39:23.564 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-19T18:39:23.564 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-02-19T18:39:23.564 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2024-02-19T18:39:23.564 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-02-19T18:39:23.564 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-19T18:39:23.564 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:39:23.565 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-02-19T18:39:23.566 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-19T18:39:23.566 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-421.el9.x86_64 2024-02-19T18:39:23.567 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-19T18:39:24.290 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-02-19T18:39:25.872 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31123]) leaked on vgs invocation. Parent PID 18069: grub2-probe 2024-02-19T18:39:25.872 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37359]) leaked on vgs invocation. Parent PID 18069: grub2-probe 2024-02-19T18:39:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31123]) leaked on vgs invocation. Parent PID 18069: grub2-probe 2024-02-19T18:39:25.900 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37359]) leaked on vgs invocation. Parent PID 18069: grub2-probe 2024-02-19T18:39:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31123]) leaked on vgs invocation. Parent PID 18117: grub2-probe 2024-02-19T18:39:26.087 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37359]) leaked on vgs invocation. Parent PID 18117: grub2-probe 2024-02-19T18:39:26.118 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31123]) leaked on vgs invocation. Parent PID 18117: grub2-probe 2024-02-19T18:39:26.118 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37359]) leaked on vgs invocation. Parent PID 18117: grub2-probe 2024-02-19T18:39:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31123]) leaked on vgs invocation. Parent PID 18165: grub2-probe 2024-02-19T18:39:26.246 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37359]) leaked on vgs invocation. Parent PID 18165: grub2-probe 2024-02-19T18:39:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31123]) leaked on vgs invocation. Parent PID 18165: grub2-probe 2024-02-19T18:39:26.277 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37359]) leaked on vgs invocation. Parent PID 18165: grub2-probe 2024-02-19T18:39:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31123]) leaked on vgs invocation. Parent PID 18213: grub2-probe 2024-02-19T18:39:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37359]) leaked on vgs invocation. Parent PID 18213: grub2-probe 2024-02-19T18:39:26.452 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31123]) leaked on vgs invocation. Parent PID 18213: grub2-probe 2024-02-19T18:39:26.452 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37359]) leaked on vgs invocation. Parent PID 18213: grub2-probe 2024-02-19T18:39:26.616 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31123]) leaked on vgs invocation. Parent PID 18261: grub2-probe 2024-02-19T18:39:26.616 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37359]) leaked on vgs invocation. Parent PID 18261: grub2-probe 2024-02-19T18:39:26.645 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31123]) leaked on vgs invocation. Parent PID 18261: grub2-probe 2024-02-19T18:39:26.645 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37359]) leaked on vgs invocation. Parent PID 18261: grub2-probe 2024-02-19T18:39:26.908 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-19T18:39:26.923 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-02-19T18:39:26.926 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-02-19T18:39:26.940 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.G35vftok3I 2024-02-19T18:39:26.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.G35vftok3I 2024-02-19T18:39:27.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.G35vftok3I 2024-02-19T18:39:27.157 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.G35vftok3I is 6KB 2024-02-19T18:39:27.177 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.G35vftok3I 2024-02-19T18:39:27.192 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-02-19T18:39:27.261 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-19T18:39:27.261 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-19T18:39:27.261 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-19T18:39:27.261 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-19T18:39:27.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-19T18:39:27.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-02-19T18:39:35.747 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:39:35.747 INFO:teuthology.orchestra.run.smithi142.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-19T18:39:35.747 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:39:35.816 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:39:36.218 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:39:36.218 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-19T18:39:36.218 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:39:36.218 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:39:36.626 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:39:36.627 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:39:36.627 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:39:36.627 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-19T18:39:36.627 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-19T18:39:36.627 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-19T18:39:36.627 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-19T18:39:36.627 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:39:36.627 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:39:37.132 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T18:39:37.298 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-19T18:39:37.298 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-19T18:39:37.298 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-19T18:39:37.298 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-19T18:39:37.298 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-19T18:39:37.299 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-19T18:39:37.299 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-02-19T18:39:37.299 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T18:39:37.407 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-19T18:39:37.407 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-19T18:39:37.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-02-19T18:39:37.441 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-02-19T18:39:37.441 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-02-19T18:39:37.441 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-02-19T18:39:37.441 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 68.el9 2024-02-19T18:39:37.441 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-02-19T18:39:37.441 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-19T18:39:37.441 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-02-19T18:39:37.441 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8264254 2024-02-19T18:39:37.441 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-19T18:39:37.442 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-19T18:39:37.443 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-19T18:39:37.443 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-02-19T18:39:37.443 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:39:37.443 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-02-19T18:39:37.444 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-19T18:39:37.444 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-421.el9.x86_64 2024-02-19T18:39:37.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-19T18:39:38.018 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-02-19T18:39:39.418 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-19T18:39:39.467 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-02-19T18:39:39.469 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-02-19T18:39:39.490 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.aiEWpKiqgf 2024-02-19T18:39:39.490 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aiEWpKiqgf 2024-02-19T18:39:39.559 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.aiEWpKiqgf 2024-02-19T18:39:39.700 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.aiEWpKiqgf is 6KB 2024-02-19T18:39:39.748 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.aiEWpKiqgf 2024-02-19T18:39:39.762 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-02-19T18:39:39.827 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-19T18:39:39.828 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-19T18:39:39.828 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-19T18:39:39.828 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-19T18:39:39.829 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-19T18:39:39.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-02-19T18:39:57.432 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-19T18:39:57.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T18:39:57.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:40:09.985 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-19T18:40:09.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T18:40:09.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:40:15.936 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-19T18:40:24.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T18:40:24.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:40:27.996 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-19T18:40:28.476 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-02-19T18:40:37.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T18:40:37.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:40:39.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T18:40:39.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:40:40.544 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-02-19T18:40:52.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T18:40:52.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:40:58.428 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-19T18:41:10.972 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-02-19T18:41:13.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T18:41:13.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:41:13.811 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-02-19T18:41:14.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T18:41:14.427 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-421.el9.x86_64"... 2024-02-19T18:41:14.428 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-02-19T18:41:14.442 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-421.el9.x86_64 2024-02-19T18:41:14.442 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-19T18:41:14.442 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-19T18:41:14.442 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-19T18:41:15.443 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-19T18:41:15.443 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-19T18:41:15.510 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-02-19T18:41:15.549 DEBUG:teuthology.parallel:result is None 2024-02-19T18:41:25.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T18:41:25.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:41:26.341 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-02-19T18:41:26.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T18:41:26.751 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-421.el9.x86_64"... 2024-02-19T18:41:26.751 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-02-19T18:41:26.766 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-421.el9.x86_64 2024-02-19T18:41:26.766 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-19T18:41:26.766 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-19T18:41:26.766 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-19T18:41:27.768 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-19T18:41:27.768 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-19T18:41:27.883 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-02-19T18:41:27.929 DEBUG:teuthology.parallel:result is None 2024-02-19T18:41:27.929 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-19T18:41:27.938 INFO:teuthology.task.internal:Creating test directory... 2024-02-19T18:41:27.938 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-19T18:41:27.942 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-19T18:41:27.958 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-19T18:41:27.968 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-19T18:41:27.977 INFO:teuthology.task.internal:Creating archive directory... 2024-02-19T18:41:27.978 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-19T18:41:28.001 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-19T18:41:28.052 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-19T18:41:28.063 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-19T18:41:28.063 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-19T18:41:28.086 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-19T18:41:28.123 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T18:41:28.128 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T18:41:28.137 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T18:41:28.140 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T18:41:28.141 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-19T18:41:28.149 INFO:teuthology.task.internal:Configuring sudo... 2024-02-19T18:41:28.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-19T18:41:28.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-19T18:41:28.210 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-19T18:41:28.220 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-19T18:41:28.220 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-19T18:41:28.254 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-19T18:41:28.268 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T18:41:28.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T18:41:28.410 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T18:41:28.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T18:41:28.539 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:41:28.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-19T18:41:28.609 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T18:41:28.666 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T18:41:28.726 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T18:41:28.778 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T18:41:28.835 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:41:28.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-19T18:41:28.887 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-02-19T18:41:28.889 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-02-19T18:41:28.945 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T18:41:28.999 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T18:41:29.364 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-19T18:41:29.373 INFO:teuthology.task.internal:Starting timer... 2024-02-19T18:41:29.373 INFO:teuthology.run_tasks:Running task pcp... 2024-02-19T18:41:29.386 INFO:teuthology.run_tasks:Running task selinux... 2024-02-19T18:41:29.403 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-19T18:41:29.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-02-19T18:41:29.475 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-02-19T18:41:29.481 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-02-19T18:41:29.538 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-02-19T18:41:29.540 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-19T18:41:29.540 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-02-19T18:41:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-02-19T18:41:29.571 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-02-19T18:41:29.597 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-02-19T18:41:29.597 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-02-19T18:41:29.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T18:41:29.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T18:41:29.641 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T18:41:29.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T18:41:29.668 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-19T18:41:29.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-02-19T18:41:29.723 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-02-19T18:41:29.757 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-19T18:41:29.767 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-19T18:41:29.789 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-19T18:41:29.792 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-19T18:47:24.218 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-02-19T18:47:24.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T18:47:24.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:47:24.316 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-02-19T18:47:24.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-19T18:47:24.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T18:47:24.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:47:24.483 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-02-19T18:47:24.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-02-19T18:47:24.576 INFO:teuthology.run_tasks:Running task clock... 2024-02-19T18:47:24.587 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-19T18:47:24.587 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-19T18:47:24.587 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T18:47:24.592 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-19T18:47:24.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T18:47:24.618 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-19T18:47:24.635 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-19T18:47:24.647 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-19T18:47:24.663 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-02-19T18:47:24.663 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-19T18:47:24.677 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-02-19T18:47:24.692 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-02-19T18:47:24.693 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-19T18:47:24.707 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-02-19T18:47:24.709 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-19T18:47:24.724 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-19T18:47:24.739 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-19T18:47:24.763 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-02-19T18:47:24.767 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T18:47:24.767 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-02-19T18:47:24.767 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:47:24.767 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:47:24.767 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:47:24.767 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:47:24.793 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-02-19T18:47:24.797 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T18:47:24.797 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-02-19T18:47:24.797 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:47:24.797 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:47:24.797 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:47:24.797 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:47:24.797 INFO:teuthology.run_tasks:Running task install... 2024-02-19T18:47:24.807 DEBUG:teuthology.task.install:project ceph 2024-02-19T18:47:24.807 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'}} 2024-02-19T18:47:24.807 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'} 2024-02-19T18:47:24.807 INFO:teuthology.task.install:Using flavor: default 2024-02-19T18:47:24.815 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-19T18:47:24.815 INFO:teuthology.task.install:extra packages: [] 2024-02-19T18:47:24.815 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-02-19T18:47:24.816 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:47:24.816 INFO:teuthology.packaging:ref: None 2024-02-19T18:47:24.816 INFO:teuthology.packaging:tag: v18.2.0 2024-02-19T18:47:24.816 INFO:teuthology.packaging:branch: None 2024-02-19T18:47:24.816 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:47:25.133 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v18.2.0^{} -> None 2024-02-19T18:47:25.134 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-19T18:47:26.861 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-19T18:47:26.862 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-19T18:47:26.864 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-02-19T18:47:26.865 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:47:26.865 INFO:teuthology.packaging:ref: None 2024-02-19T18:47:26.865 INFO:teuthology.packaging:tag: v18.2.0 2024-02-19T18:47:26.865 INFO:teuthology.packaging:branch: None 2024-02-19T18:47:26.865 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:47:26.865 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-19T18:47:26.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-19T18:47:27.013 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-02-19T18:47:27.014 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-02-19T18:47:27.050 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-19T18:47:27.050 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:47:27.050 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-19T18:47:27.083 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-19T18:47:27.084 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:47:27.084 INFO:teuthology.packaging:ref: None 2024-02-19T18:47:27.084 INFO:teuthology.packaging:tag: v18.2.0 2024-02-19T18:47:27.084 INFO:teuthology.packaging:branch: None 2024-02-19T18:47:27.084 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:47:27.084 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-19T18:47:27.144 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-02-19T18:47:27.145 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-02-19T18:47:27.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-19T18:47:27.172 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-19T18:47:27.172 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:47:27.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-19T18:47:27.204 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-19T18:47:27.205 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:47:27.205 INFO:teuthology.packaging:ref: None 2024-02-19T18:47:27.205 INFO:teuthology.packaging:tag: v18.2.0 2024-02-19T18:47:27.205 INFO:teuthology.packaging:branch: None 2024-02-19T18:47:27.205 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:47:27.205 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-19T18:47:27.241 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-19T18:47:27.279 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-19T18:47:27.309 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-02-19T18:47:27.311 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-02-19T18:47:27.361 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-19T18:47:27.430 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-02-19T18:47:27.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-02-19T18:47:27.553 INFO:teuthology.orchestra.run.smithi142.stdout:74 files removed 2024-02-19T18:47:27.580 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw 2024-02-19T18:47:27.676 INFO:teuthology.orchestra.run.smithi046.stdout:74 files removed 2024-02-19T18:47:27.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw 2024-02-19T18:47:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 549 kB/s | 76 kB 00:00 2024-02-19T18:47:28.178 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 508 kB/s | 76 kB 00:00 2024-02-19T18:47:28.273 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 50 kB/s | 9.3 kB 00:00 2024-02-19T18:47:28.370 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 65 kB/s | 9.3 kB 00:00 2024-02-19T18:47:28.440 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 17 kB/s | 2.2 kB 00:00 2024-02-19T18:47:28.529 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 18 kB/s | 2.2 kB 00:00 2024-02-19T18:47:28.982 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-02-19T18:47:29.159 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.7 MB 00:00 2024-02-19T18:47:30.448 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 6.6 MB/s | 2.0 MB 00:00 2024-02-19T18:47:30.601 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2024-02-19T18:47:32.016 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.0 MB 00:01 2024-02-19T18:47:32.791 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.0 MB 00:01 2024-02-19T18:47:34.692 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-02-19T18:47:40.093 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.1 MB 00:01 2024-02-19T18:47:42.543 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 15 kB 00:01 2024-02-19T18:47:58.397 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 775 kB/s | 19 MB 00:25 2024-02-19T18:47:58.768 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 1.3 MB/s | 20 MB 00:16 2024-02-19T18:48:03.630 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.1 MB 00:01 2024-02-19T18:48:03.634 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-02-19T18:48:05.307 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 15 kB 00:00 2024-02-19T18:48:06.193 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:48:06.208 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:48:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-19T18:48:06.208 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-02-19T18:48:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-02-19T18:48:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout:Install 28 Packages 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2024-02-19T18:48:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:06.212 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 53 M 2024-02-19T18:48:06.212 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:48:06.518 INFO:teuthology.orchestra.run.smithi142.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 22 MB/s | 5.2 MB 00:00 2024-02-19T18:48:06.544 INFO:teuthology.orchestra.run.smithi142.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 966 kB/s | 24 kB 00:00 2024-02-19T18:48:06.636 INFO:teuthology.orchestra.run.smithi142.stdout:(3/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 22 MB/s | 7.6 MB 00:00 2024-02-19T18:48:06.661 INFO:teuthology.orchestra.run.smithi142.stdout:(4/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 5.5 MB/s | 653 kB 00:00 2024-02-19T18:48:06.703 INFO:teuthology.orchestra.run.smithi142.stdout:(5/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 6.9 MB/s | 474 kB 00:00 2024-02-19T18:48:06.728 INFO:teuthology.orchestra.run.smithi142.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-02-19T18:48:06.762 INFO:teuthology.orchestra.run.smithi142.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 3.5 MB/s | 119 kB 00:00 2024-02-19T18:48:06.787 INFO:teuthology.orchestra.run.smithi142.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 6.2 MB/s | 155 kB 00:00 2024-02-19T18:48:06.812 INFO:teuthology.orchestra.run.smithi142.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-02-19T18:48:06.846 INFO:teuthology.orchestra.run.smithi142.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 8.7 MB/s | 297 kB 00:00 2024-02-19T18:48:06.863 INFO:teuthology.orchestra.run.smithi142.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 5.8 MB/s | 99 kB 00:00 2024-02-19T18:48:06.939 INFO:teuthology.orchestra.run.smithi142.stdout:(12/30): librgw2-18.2.0-0.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-02-19T18:48:07.188 INFO:teuthology.orchestra.run.smithi142.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 20 MB/s | 18 MB 00:00 2024-02-19T18:48:07.213 INFO:teuthology.orchestra.run.smithi142.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 302 kB/s | 106 kB 00:00 2024-02-19T18:48:07.239 INFO:teuthology.orchestra.run.smithi142.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 576 kB/s | 159 kB 00:00 2024-02-19T18:48:07.264 INFO:teuthology.orchestra.run.smithi142.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 589 kB/s | 44 kB 00:00 2024-02-19T18:48:07.314 INFO:teuthology.orchestra.run.smithi142.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-02-19T18:48:07.339 INFO:teuthology.orchestra.run.smithi142.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 282 kB 00:00 2024-02-19T18:48:07.365 INFO:teuthology.orchestra.run.smithi142.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 412 kB/s | 41 kB 00:00 2024-02-19T18:48:08.048 INFO:teuthology.orchestra.run.smithi142.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 151 kB/s | 111 kB 00:00 2024-02-19T18:48:08.432 INFO:teuthology.orchestra.run.smithi142.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 68 kB/s | 26 kB 00:00 2024-02-19T18:48:08.657 INFO:teuthology.orchestra.run.smithi142.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 216 kB/s | 49 kB 00:00 2024-02-19T18:48:08.966 INFO:teuthology.orchestra.run.smithi142.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 193 kB/s | 309 kB 00:01 2024-02-19T18:48:08.991 INFO:teuthology.orchestra.run.smithi142.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 202 kB/s | 67 kB 00:00 2024-02-19T18:48:09.749 INFO:teuthology.orchestra.run.smithi142.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 253 kB/s | 192 kB 00:00 2024-02-19T18:48:11.575 INFO:teuthology.orchestra.run.smithi142.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 321 kB/s | 838 kB 00:02 2024-02-19T18:48:11.649 INFO:teuthology.orchestra.run.smithi142.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 44 MB/s | 3.3 MB 00:00 2024-02-19T18:48:11.725 INFO:teuthology.orchestra.run.smithi142.stdout:(28/30): librbd1-18.2.0-0.el9.x86_64.rpm 40 MB/s | 3.0 MB 00:00 2024-02-19T18:48:14.450 INFO:teuthology.orchestra.run.smithi142.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 345 kB/s | 1.6 MB 00:04 2024-02-19T18:48:26.999 INFO:teuthology.orchestra.run.smithi142.stdout:(30/30): libarrow-9.0.0-10.el9.x86_64.rpm 230 kB/s | 4.4 MB 00:19 2024-02-19T18:48:27.004 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:48:27.004 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.5 MB/s | 53 MB 00:20 2024-02-19T18:48:27.005 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:48:27.039 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:48:27.040 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:48:27.474 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:48:27.475 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:48:28.861 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:48:28.949 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-02-19T18:48:28.978 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-02-19T18:48:29.029 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-02-19T18:48:29.338 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-02-19T18:48:29.386 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-19T18:48:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-19T18:48:29.549 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-02-19T18:48:29.579 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-19T18:48:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-19T18:48:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-02-19T18:48:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-02-19T18:48:29.787 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-19T18:48:29.814 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-19T18:48:29.896 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-19T18:48:30.003 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-02-19T18:48:30.041 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-02-19T18:48:30.094 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-02-19T18:48:30.119 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-02-19T18:48:30.138 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-02-19T18:48:30.199 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-02-19T18:48:30.231 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-02-19T18:48:30.536 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-02-19T18:48:30.570 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-19T18:48:30.652 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-19T18:48:30.683 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-02-19T18:48:30.722 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-02-19T18:48:31.114 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-02-19T18:48:31.139 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-19T18:48:31.193 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-19T18:48:31.260 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-02-19T18:48:31.291 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-02-19T18:48:33.359 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-19T18:48:33.389 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-19T18:48:33.943 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-19T18:48:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-19T18:48:34.066 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-19T18:48:34.066 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-19T18:48:34.066 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-19T18:48:34.067 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:34.102 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-19T18:48:43.081 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-19T18:48:43.081 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-02-19T18:48:43.082 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-02-19T18:48:43.082 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-02-19T18:48:43.082 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-02-19T18:48:43.082 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-02-19T18:48:43.082 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-02-19T18:48:43.082 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-02-19T18:48:43.082 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-19T18:48:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-19T18:48:43.853 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:48:43.854 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-19T18:48:43.854 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T18:48:43.854 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T18:48:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-19T18:48:43.923 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-19T18:48:43.923 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:48:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:48:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-02-19T18:48:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-02-19T18:48:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-02-19T18:48:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-02-19T18:48:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-02-19T18:48:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-02-19T18:48:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-02-19T18:48:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-02-19T18:48:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-02-19T18:48:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-19T18:48:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-02-19T18:48:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-02-19T18:48:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-02-19T18:48:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-02-19T18:48:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-02-19T18:48:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-02-19T18:48:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-02-19T18:48:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-02-19T18:48:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-02-19T18:48:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-02-19T18:48:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-02-19T18:48:45.813 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 517 kB/s | 20 MB 00:40 2024-02-19T18:48:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:48:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:46.044 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-02-19T18:48:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.044 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:48:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-19T18:48:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.044 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.045 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.045 INFO:teuthology.orchestra.run.smithi142.stdout: fmt-8.1.1-5.el9.x86_64 2024-02-19T18:48:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-19T18:48:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-19T18:48:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-19T18:48:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-19T18:48:46.047 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-19T18:48:46.048 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-02-19T18:48:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2024-02-19T18:48:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-19T18:48:46.049 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:46.049 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:48:46.429 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-test 2024-02-19T18:48:47.012 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:43 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:48:47.183 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:48:47.183 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:48:47.184 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:48:47.185 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2024-02-19T18:48:47.185 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:47.185 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 40 M 2024-02-19T18:48:47.186 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 167 M 2024-02-19T18:48:47.186 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:48:47.311 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.3 MB/s | 161 kB 00:00 2024-02-19T18:48:47.402 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2024-02-19T18:48:47.428 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 542 kB/s | 63 kB 00:00 2024-02-19T18:48:47.453 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-02-19T18:48:47.478 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-02-19T18:48:47.895 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): ceph-test-18.2.0-0.el9.x86_64.rpm 56 MB/s | 40 MB 00:00 2024-02-19T18:48:47.898 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:48:47.898 INFO:teuthology.orchestra.run.smithi142.stdout:Total 57 MB/s | 40 MB 00:00 2024-02-19T18:48:47.898 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:48:47.918 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:48:47.918 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:48:48.263 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:48:48.264 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:48:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:48:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-19T18:48:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-19T18:48:48.961 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-19T18:48:49.004 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-19T18:48:49.031 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-19T18:48:50.813 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-02-19T18:48:52.740 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-19T18:48:52.823 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-19T18:48:53.509 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:48:53.524 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:48:53.524 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T18:48:53.524 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:48:53.524 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:48:53.524 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-02-19T18:48:53.524 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-02-19T18:48:53.524 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-19T18:48:53.525 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-02-19T18:48:53.526 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout:Install 28 Packages 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 2 Packages 2024-02-19T18:48:53.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:48:53.528 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 53 M 2024-02-19T18:48:53.528 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:48:54.189 INFO:teuthology.orchestra.run.smithi046.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 27 MB/s | 5.2 MB 00:00 2024-02-19T18:48:54.214 INFO:teuthology.orchestra.run.smithi046.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 966 kB/s | 24 kB 00:00 2024-02-19T18:48:54.247 INFO:teuthology.orchestra.run.smithi046.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 19 MB/s | 653 kB 00:00 2024-02-19T18:48:54.281 INFO:teuthology.orchestra.run.smithi046.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-02-19T18:48:54.418 INFO:teuthology.orchestra.run.smithi046.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 18 MB/s | 7.6 MB 00:00 2024-02-19T18:48:54.448 INFO:teuthology.orchestra.run.smithi046.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.5 MB/s | 45 kB 00:00 2024-02-19T18:48:54.473 INFO:teuthology.orchestra.run.smithi046.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 4.7 MB/s | 119 kB 00:00 2024-02-19T18:48:54.499 INFO:teuthology.orchestra.run.smithi046.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 6.1 MB/s | 155 kB 00:00 2024-02-19T18:48:54.524 INFO:teuthology.orchestra.run.smithi046.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-02-19T18:48:54.591 INFO:teuthology.orchestra.run.smithi046.stdout:(10/30): librgw2-18.2.0-0.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-02-19T18:48:54.616 INFO:teuthology.orchestra.run.smithi046.stdout:(11/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-02-19T18:48:54.641 INFO:teuthology.orchestra.run.smithi046.stdout:(12/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 2.5 MB/s | 297 kB 00:00 2024-02-19T18:48:54.909 INFO:teuthology.orchestra.run.smithi046.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 20 MB/s | 18 MB 00:00 2024-02-19T18:48:54.984 INFO:teuthology.orchestra.run.smithi046.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 288 kB/s | 106 kB 00:00 2024-02-19T18:48:54.985 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-19T18:48:54.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/6 2024-02-19T18:48:54.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/6 2024-02-19T18:48:54.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-19T18:48:54.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-19T18:48:54.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-19T18:48:55.051 INFO:teuthology.orchestra.run.smithi046.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 315 kB/s | 44 kB 00:00 2024-02-19T18:48:55.101 INFO:teuthology.orchestra.run.smithi046.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 346 kB/s | 159 kB 00:00 2024-02-19T18:48:55.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-19T18:48:55.410 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:55.410 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:48:55.410 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:18.2.0-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-02-19T18:48:55.410 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:18.2.0-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-02-19T18:48:55.410 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-02-19T18:48:55.410 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:55.410 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:48:55.708 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph 2024-02-19T18:48:55.743 INFO:teuthology.orchestra.run.smithi046.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 871 kB/s | 661 kB 00:00 2024-02-19T18:48:55.910 INFO:teuthology.orchestra.run.smithi046.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 329 kB/s | 282 kB 00:00 2024-02-19T18:48:55.927 INFO:teuthology.orchestra.run.smithi046.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 50 kB/s | 41 kB 00:00 2024-02-19T18:48:56.290 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:53 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:48:56.458 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:48:56.460 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:48:56.460 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-19T18:48:56.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-19T18:48:56.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout:Install 33 Packages 2024-02-19T18:48:56.463 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:48:56.464 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 30 M 2024-02-19T18:48:56.464 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 109 M 2024-02-19T18:48:56.464 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:48:56.469 INFO:teuthology.orchestra.run.smithi046.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 153 kB/s | 111 kB 00:00 2024-02-19T18:48:56.627 INFO:teuthology.orchestra.run.smithi046.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 164 kB/s | 26 kB 00:00 2024-02-19T18:48:56.803 INFO:teuthology.orchestra.run.smithi046.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 278 kB/s | 49 kB 00:00 2024-02-19T18:48:56.930 INFO:teuthology.orchestra.run.smithi142.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 58 kB/s | 6.4 kB 00:00 2024-02-19T18:48:56.953 INFO:teuthology.orchestra.run.smithi046.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 296 kB/s | 309 kB 00:01 2024-02-19T18:48:56.980 INFO:teuthology.orchestra.run.smithi142.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 8.9 MB/s | 1.4 MB 00:00 2024-02-19T18:48:57.031 INFO:teuthology.orchestra.run.smithi142.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 9.9 MB/s | 2.1 MB 00:00 2024-02-19T18:48:57.056 INFO:teuthology.orchestra.run.smithi142.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.4 MB/s | 240 kB 00:00 2024-02-19T18:48:57.103 INFO:teuthology.orchestra.run.smithi046.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 224 kB/s | 67 kB 00:00 2024-02-19T18:48:57.140 INFO:teuthology.orchestra.run.smithi142.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-02-19T18:48:57.382 INFO:teuthology.orchestra.run.smithi142.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 44 MB/s | 18 MB 00:00 2024-02-19T18:48:57.462 INFO:teuthology.orchestra.run.smithi046.stdout:(25/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.6 MB/s | 838 kB 00:00 2024-02-19T18:48:57.487 INFO:teuthology.orchestra.run.smithi046.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 500 kB/s | 192 kB 00:00 2024-02-19T18:48:57.548 INFO:teuthology.orchestra.run.smithi142.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 293 kB/s | 144 kB 00:00 2024-02-19T18:48:57.554 INFO:teuthology.orchestra.run.smithi046.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 49 MB/s | 3.3 MB 00:00 2024-02-19T18:48:57.574 INFO:teuthology.orchestra.run.smithi142.stdout:(8/33): python3-markupsafe-1.1.1-12.el9.x86_64. 77 kB/s | 32 kB 00:00 2024-02-19T18:48:57.599 INFO:teuthology.orchestra.run.smithi142.stdout:(9/33): python3-pytz-2021.1-5.el9.noarch.rpm 247 kB/s | 47 kB 00:00 2024-02-19T18:48:57.621 INFO:teuthology.orchestra.run.smithi046.stdout:(28/30): librbd1-18.2.0-0.el9.x86_64.rpm 45 MB/s | 3.0 MB 00:00 2024-02-19T18:48:57.624 INFO:teuthology.orchestra.run.smithi142.stdout:(10/33): python3-toml-0.10.2-6.el9.noarch.rpm 511 kB/s | 39 kB 00:00 2024-02-19T18:48:57.699 INFO:teuthology.orchestra.run.smithi142.stdout:(11/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 241 kB 00:00 2024-02-19T18:48:57.754 INFO:teuthology.orchestra.run.smithi046.stdout:(29/30): libarrow-9.0.0-10.el9.x86_64.rpm 2.4 MB/s | 4.4 MB 00:01 2024-02-19T18:48:57.774 INFO:teuthology.orchestra.run.smithi142.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 686 kB/s | 103 kB 00:00 2024-02-19T18:48:57.804 INFO:teuthology.orchestra.run.smithi046.stdout:(30/30): thrift-0.15.0-2.el9.x86_64.rpm 4.6 MB/s | 1.6 MB 00:00 2024-02-19T18:48:57.808 INFO:teuthology.orchestra.run.smithi142.stdout:(13/33): python3-cryptography-36.0.1-4.el9.x86_ 5.5 MB/s | 1.1 MB 00:00 2024-02-19T18:48:57.812 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:48:57.812 INFO:teuthology.orchestra.run.smithi046.stdout:Total 12 MB/s | 53 MB 00:04 2024-02-19T18:48:57.812 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:48:57.833 INFO:teuthology.orchestra.run.smithi142.stdout:(14/33): python3-pycparser-2.20-6.el9.noarch.rp 929 kB/s | 124 kB 00:00 2024-02-19T18:48:57.852 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:48:57.852 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:48:57.858 INFO:teuthology.orchestra.run.smithi142.stdout:(15/33): python3-requests-2.25.1-8.el9.noarch.r 1.3 MB/s | 113 kB 00:00 2024-02-19T18:48:57.884 INFO:teuthology.orchestra.run.smithi142.stdout:(16/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-02-19T18:48:58.218 INFO:teuthology.orchestra.run.smithi142.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 113 kB/s | 43 kB 00:00 2024-02-19T18:48:58.268 INFO:teuthology.orchestra.run.smithi142.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 215 kB/s | 11 kB 00:00 2024-02-19T18:48:58.293 INFO:teuthology.orchestra.run.smithi142.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 396 kB/s | 172 kB 00:00 2024-02-19T18:48:58.312 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:48:58.312 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:48:58.335 INFO:teuthology.orchestra.run.smithi142.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 264 kB/s | 18 kB 00:00 2024-02-19T18:48:58.360 INFO:teuthology.orchestra.run.smithi142.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 347 kB/s | 23 kB 00:00 2024-02-19T18:48:58.419 INFO:teuthology.orchestra.run.smithi142.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 232 kB/s | 19 kB 00:00 2024-02-19T18:48:58.444 INFO:teuthology.orchestra.run.smithi142.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 235 kB/s | 20 kB 00:00 2024-02-19T18:48:58.486 INFO:teuthology.orchestra.run.smithi142.stdout:(24/33): python3-cherrypy-18.6.1-2.el9.noarch.r 596 kB/s | 358 kB 00:00 2024-02-19T18:48:58.511 INFO:teuthology.orchestra.run.smithi142.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 503 kB/s | 46 kB 00:00 2024-02-19T18:48:58.536 INFO:teuthology.orchestra.run.smithi142.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 856 kB/s | 79 kB 00:00 2024-02-19T18:48:58.570 INFO:teuthology.orchestra.run.smithi142.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 281 kB/s | 16 kB 00:00 2024-02-19T18:48:58.620 INFO:teuthology.orchestra.run.smithi142.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2024-02-19T18:48:58.646 INFO:teuthology.orchestra.run.smithi142.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2024-02-19T18:48:58.704 INFO:teuthology.orchestra.run.smithi142.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-02-19T18:48:58.788 INFO:teuthology.orchestra.run.smithi142.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 240 kB/s | 20 kB 00:00 2024-02-19T18:48:58.938 INFO:teuthology.orchestra.run.smithi142.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 723 kB/s | 230 kB 00:00 2024-02-19T18:48:58.963 INFO:teuthology.orchestra.run.smithi142.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.3 MB/s | 427 kB 00:00 2024-02-19T18:48:58.971 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:48:58.971 INFO:teuthology.orchestra.run.smithi142.stdout:Total 12 MB/s | 30 MB 00:02 2024-02-19T18:48:58.972 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:48:59.011 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:48:59.011 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:48:59.359 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:48:59.360 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:48:59.756 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:48:59.822 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-02-19T18:48:59.851 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-02-19T18:48:59.902 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-02-19T18:49:00.282 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-02-19T18:49:00.317 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-19T18:49:00.401 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-19T18:49:00.483 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-02-19T18:49:00.518 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-19T18:49:00.580 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-19T18:49:00.609 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-02-19T18:49:00.622 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:00.663 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-02-19T18:49:00.682 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-19T18:49:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-19T18:49:00.729 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-19T18:49:00.739 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-19T18:49:00.754 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-19T18:49:00.819 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-19T18:49:00.830 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-19T18:49:00.917 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-19T18:49:00.928 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-02-19T18:49:00.960 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-19T18:49:00.964 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-02-19T18:49:01.002 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-02-19T18:49:01.030 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-19T18:49:01.034 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-02-19T18:49:01.061 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-02-19T18:49:01.084 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-19T18:49:01.097 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-02-19T18:49:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-19T18:49:01.129 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-02-19T18:49:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-19T18:49:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-19T18:49:01.411 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-19T18:49:01.444 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-02-19T18:49:01.460 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-19T18:49:01.468 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-19T18:49:01.490 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-19T18:49:01.525 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-19T18:49:01.542 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-19T18:49:01.555 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-19T18:49:01.572 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-02-19T18:49:01.611 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-02-19T18:49:01.632 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-19T18:49:01.665 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-19T18:49:01.699 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-19T18:49:01.739 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-19T18:49:01.774 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-19T18:49:01.809 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-19T18:49:01.905 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-19T18:49:01.939 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-19T18:49:02.012 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-19T18:49:02.024 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-02-19T18:49:02.045 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-19T18:49:02.116 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-19T18:49:02.156 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-19T18:49:02.186 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-02-19T18:49:02.222 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-02-19T18:49:02.303 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-19T18:49:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-02-19T18:49:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-19T18:49:02.511 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-19T18:49:02.511 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:02.511 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-19T18:49:02.511 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T18:49:02.511 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T18:49:02.512 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:04.011 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-19T18:49:04.038 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-19T18:49:04.038 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:04.038 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-19T18:49:04.038 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T18:49:04.038 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T18:49:04.038 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:04.314 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-19T18:49:04.352 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-19T18:49:04.487 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-19T18:49:04.512 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-19T18:49:04.512 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:04.512 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-19T18:49:04.512 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T18:49:04.512 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T18:49:04.512 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:04.721 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-19T18:49:04.747 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-19T18:49:04.747 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:04.747 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-19T18:49:04.747 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T18:49:04.748 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T18:49:04.748 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:04.805 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-19T18:49:04.931 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-19T18:49:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-19T18:49:05.063 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-19T18:49:05.063 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-19T18:49:05.063 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-19T18:49:05.063 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:05.098 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-19T18:49:06.532 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-19T18:49:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-19T18:49:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-19T18:49:06.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-19T18:49:06.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-19T18:49:06.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-19T18:49:06.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-19T18:49:06.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-19T18:49:06.535 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-19T18:49:07.462 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-19T18:49:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-19T18:49:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:07.465 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:07.821 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-base 2024-02-19T18:49:08.412 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:05 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:08.524 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:08.575 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:08.576 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-02-19T18:49:08.576 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:08.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install cephadm 2024-02-19T18:49:09.213 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:06 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:09.377 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:09.378 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-02-19T18:49:09.378 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:09.378 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-02-19T18:49:09.378 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:09.378 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:09.378 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:09.379 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-02-19T18:49:09.379 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:09.379 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 209 k 2024-02-19T18:49:09.379 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 200 k 2024-02-19T18:49:09.379 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:09.455 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm-18.2.0-0.el9.noarch.rpm 2.7 MB/s | 209 kB 00:00 2024-02-19T18:49:09.455 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:09.456 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.6 MB/s | 209 kB 00:00 2024-02-19T18:49:09.456 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:09.461 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:09.461 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:09.464 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:09.464 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:09.545 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:10.006 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-19T18:49:10.093 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-19T18:49:10.447 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-19T18:49:10.756 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-19T18:49:10.756 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:10.756 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:10.756 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-02-19T18:49:10.756 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:10.756 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:10.959 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-immutable-object-cache 2024-02-19T18:49:11.549 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:08 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:11.719 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:11.719 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:11.720 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-02-19T18:49:11.720 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:11.720 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:11.720 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-02-19T18:49:11.720 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:11.720 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:11.720 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:11.720 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-02-19T18:49:11.720 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:11.721 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 142 k 2024-02-19T18:49:11.721 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 399 k 2024-02-19T18:49:11.721 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:11.794 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 1.9 MB/s | 142 kB 00:00 2024-02-19T18:49:11.795 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:11.795 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.9 MB/s | 142 kB 00:00 2024-02-19T18:49:11.795 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:11.802 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:11.802 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:11.853 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:11.853 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:11.993 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:12.053 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:12.077 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:12.077 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:12.077 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-19T18:49:12.077 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:13.089 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:13.089 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:13.089 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:13.089 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:13.089 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:13.089 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:13.365 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr 2024-02-19T18:49:13.968 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:10 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:14.083 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:14.134 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:14.135 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-02-19T18:49:14.135 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:14.200 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-dashboard 2024-02-19T18:49:14.781 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:11 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:14.930 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-19T18:49:14.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-02-19T18:49:14.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-02-19T18:49:14.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-02-19T18:49:14.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-02-19T18:49:14.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-02-19T18:49:14.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-02-19T18:49:14.930 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-02-19T18:49:14.930 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:14.947 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:14.948 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:14.948 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-19T18:49:14.948 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:14.948 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:14.948 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-02-19T18:49:14.948 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout:Install 7 Packages 2024-02-19T18:49:14.949 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:14.950 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 2.0 M 2024-02-19T18:49:14.950 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 8.1 M 2024-02-19T18:49:14.950 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:15.322 INFO:teuthology.orchestra.run.smithi142.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 207 kB/s | 23 kB 00:00 2024-02-19T18:49:15.347 INFO:teuthology.orchestra.run.smithi142.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 107 kB/s | 15 kB 00:00 2024-02-19T18:49:15.406 INFO:teuthology.orchestra.run.smithi142.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 8.7 MB/s | 1.7 MB 00:00 2024-02-19T18:49:15.473 INFO:teuthology.orchestra.run.smithi142.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 60 kB/s | 9.0 kB 00:00 2024-02-19T18:49:15.649 INFO:teuthology.orchestra.run.smithi142.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 127 kB/s | 31 kB 00:00 2024-02-19T18:49:15.682 INFO:teuthology.orchestra.run.smithi142.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 122 kB/s | 41 kB 00:00 2024-02-19T18:49:15.707 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-19T18:49:15.731 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-19T18:49:15.731 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:15.731 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-19T18:49:15.731 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T18:49:15.731 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T18:49:15.731 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:15.733 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-19T18:49:15.801 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-19T18:49:15.801 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:49:17.018 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:49:17.018 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-02-19T18:49:17.018 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-02-19T18:49:17.018 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-02-19T18:49:17.018 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-02-19T18:49:17.018 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-02-19T18:49:17.018 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-02-19T18:49:17.018 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-02-19T18:49:17.018 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-02-19T18:49:17.019 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-02-19T18:49:17.020 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-02-19T18:49:17.020 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-02-19T18:49:17.020 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-02-19T18:49:17.020 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-02-19T18:49:17.020 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-02-19T18:49:17.020 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-02-19T18:49:17.020 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-02-19T18:49:17.020 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-02-19T18:49:17.020 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-02-19T18:49:17.049 INFO:teuthology.orchestra.run.smithi142.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 120 kB/s | 188 kB 00:01 2024-02-19T18:49:17.051 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:17.051 INFO:teuthology.orchestra.run.smithi142.stdout:Total 971 kB/s | 2.0 MB 00:02 2024-02-19T18:49:17.052 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:17.061 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:17.061 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:17.137 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:17.137 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:17.441 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:17.509 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-19T18:49:17.542 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-19T18:49:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-19T18:49:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-19T18:49:17.666 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-02-19T18:49:17.896 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-02-19T18:49:17.927 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-19T18:49:18.145 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:49:18.145 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:18.145 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-02-19T18:49:18.145 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.145 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:49:18.145 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-19T18:49:18.145 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.145 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.145 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: fmt-8.1.1-5.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-19T18:49:18.146 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-3.el9.x86_64 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:18.147 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:49:18.474 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-19T18:49:18.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-02-19T18:49:18.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-02-19T18:49:18.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-02-19T18:49:18.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-19T18:49:18.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-19T18:49:18.474 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-19T18:49:18.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-test 2024-02-19T18:49:18.800 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-19T18:49:18.800 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:18.800 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:18.800 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-02-19T18:49:18.801 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-02-19T18:49:18.801 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-02-19T18:49:18.801 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-19T18:49:18.801 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-19T18:49:18.801 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-19T18:49:18.802 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-19T18:49:18.802 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:18.802 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:19.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-19T18:49:19.080 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:29 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:49:19.256 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-19T18:49:19.257 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-19T18:49:19.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:19.258 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:49:19.258 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:19.258 INFO:teuthology.orchestra.run.smithi046.stdout:Install 6 Packages 2024-02-19T18:49:19.258 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:19.258 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 40 M 2024-02-19T18:49:19.258 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 167 M 2024-02-19T18:49:19.259 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:49:19.387 INFO:teuthology.orchestra.run.smithi046.stdout:(1/6): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.2 MB/s | 161 kB 00:00 2024-02-19T18:49:19.589 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:16 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:19.759 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:19.760 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-19T18:49:19.761 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-19T18:49:19.762 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-19T18:49:19.762 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-19T18:49:19.762 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-19T18:49:19.762 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-19T18:49:19.762 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:19.762 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:19.762 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:19.762 INFO:teuthology.orchestra.run.smithi142.stdout:Install 12 Packages 2024-02-19T18:49:19.762 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:19.763 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 37 M 2024-02-19T18:49:19.763 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 209 M 2024-02-19T18:49:19.763 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:19.896 INFO:teuthology.orchestra.run.smithi046.stdout:(2/6): ceph-test-18.2.0-0.el9.x86_64.rpm 62 MB/s | 40 MB 00:00 2024-02-19T18:49:19.921 INFO:teuthology.orchestra.run.smithi046.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 453 kB/s | 300 kB 00:00 2024-02-19T18:49:19.946 INFO:teuthology.orchestra.run.smithi046.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 112 kB/s | 63 kB 00:00 2024-02-19T18:49:19.988 INFO:teuthology.orchestra.run.smithi046.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 2.0 MB/s | 186 kB 00:00 2024-02-19T18:49:20.047 INFO:teuthology.orchestra.run.smithi046.stdout:(6/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.1 MB/s | 217 kB 00:00 2024-02-19T18:49:20.050 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:20.050 INFO:teuthology.orchestra.run.smithi046.stdout:Total 51 MB/s | 40 MB 00:00 2024-02-19T18:49:20.050 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:49:20.072 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:49:20.072 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:49:20.130 INFO:teuthology.orchestra.run.smithi142.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 36 MB/s | 7.4 MB 00:00 2024-02-19T18:49:20.289 INFO:teuthology.orchestra.run.smithi142.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 87 kB/s | 32 kB 00:00 2024-02-19T18:49:20.314 INFO:teuthology.orchestra.run.smithi142.stdout:(3/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 94 kB/s | 17 kB 00:00 2024-02-19T18:49:20.381 INFO:teuthology.orchestra.run.smithi142.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 373 kB/s | 34 kB 00:00 2024-02-19T18:49:20.427 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:49:20.427 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:49:20.723 INFO:teuthology.orchestra.run.smithi142.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.8 MB/s | 3.0 MB 00:00 2024-02-19T18:49:20.956 INFO:teuthology.orchestra.run.smithi142.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 7.4 MB/s | 4.7 MB 00:00 2024-02-19T18:49:20.993 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:49:21.032 INFO:teuthology.orchestra.run.smithi142.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.3 MB/s | 4.8 MB 00:00 2024-02-19T18:49:21.057 INFO:teuthology.orchestra.run.smithi142.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 654 kB/s | 217 kB 00:00 2024-02-19T18:49:21.079 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-19T18:49:21.113 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-19T18:49:21.161 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-19T18:49:21.206 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-19T18:49:21.233 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-19T18:49:21.566 INFO:teuthology.orchestra.run.smithi142.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-02-19T18:49:21.599 INFO:teuthology.orchestra.run.smithi142.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 802 kB 00:00 2024-02-19T18:49:21.624 INFO:teuthology.orchestra.run.smithi142.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 344 kB/s | 194 kB 00:00 2024-02-19T18:49:21.816 INFO:teuthology.orchestra.run.smithi142.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 990 kB/s | 245 kB 00:00 2024-02-19T18:49:21.819 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:21.820 INFO:teuthology.orchestra.run.smithi142.stdout:Total 18 MB/s | 37 MB 00:02 2024-02-19T18:49:21.838 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:21.864 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:21.864 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:22.315 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:22.315 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:23.080 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-19T18:49:23.112 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-19T18:49:23.208 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-19T18:49:23.248 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-19T18:49:23.427 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-19T18:49:23.455 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-19T18:49:23.532 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-19T18:49:24.200 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-19T18:49:24.311 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-19T18:49:25.130 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-19T18:49:25.211 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-19T18:49:25.559 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-19T18:49:26.602 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-19T18:49:26.630 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-19T18:49:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-19T18:49:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/6 2024-02-19T18:49:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/6 2024-02-19T18:49:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-19T18:49:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-19T18:49:27.477 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-19T18:49:27.872 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-19T18:49:27.872 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:27.872 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:49:27.872 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:18.2.0-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-02-19T18:49:27.872 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:18.2.0-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-02-19T18:49:27.872 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-02-19T18:49:27.872 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:27.872 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:49:28.170 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph 2024-02-19T18:49:28.758 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:38 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:49:28.934 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:49:28.936 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:28.936 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T18:49:28.936 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:28.936 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:49:28.936 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-02-19T18:49:28.936 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-19T18:49:28.937 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-19T18:49:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout:Install 33 Packages 2024-02-19T18:49:28.939 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:28.940 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 30 M 2024-02-19T18:49:28.940 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 109 M 2024-02-19T18:49:28.940 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:49:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-19T18:49:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-02-19T18:49:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-19T18:49:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-19T18:49:29.419 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-19T18:49:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-19T18:49:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-19T18:49:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-19T18:49:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-19T18:49:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-19T18:49:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-19T18:49:29.420 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-19T18:49:29.540 INFO:teuthology.orchestra.run.smithi046.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 62 kB/s | 6.4 kB 00:00 2024-02-19T18:49:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 9.4 MB/s | 1.4 MB 00:00 2024-02-19T18:49:29.641 INFO:teuthology.orchestra.run.smithi046.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 10 MB/s | 2.1 MB 00:00 2024-02-19T18:49:29.666 INFO:teuthology.orchestra.run.smithi046.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.4 MB/s | 240 kB 00:00 2024-02-19T18:49:29.750 INFO:teuthology.orchestra.run.smithi046.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-02-19T18:49:29.857 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-19T18:49:29.857 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:29.857 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:29.857 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-02-19T18:49:29.857 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-19T18:49:29.857 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-19T18:49:29.857 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-19T18:49:29.858 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-19T18:49:29.858 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-19T18:49:29.858 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-19T18:49:29.858 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-19T18:49:29.858 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-19T18:49:29.858 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-19T18:49:29.858 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-19T18:49:29.858 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-19T18:49:29.858 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:29.858 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:30.033 INFO:teuthology.orchestra.run.smithi046.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 40 MB/s | 18 MB 00:00 2024-02-19T18:49:30.117 INFO:teuthology.orchestra.run.smithi046.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 92 kB/s | 32 kB 00:00 2024-02-19T18:49:30.159 INFO:teuthology.orchestra.run.smithi046.stdout:(8/33): python3-mako-1.1.4-6.el9.noarch.rpm 293 kB/s | 144 kB 00:00 2024-02-19T18:49:30.193 INFO:teuthology.orchestra.run.smithi046.stdout:(9/33): python3-pytz-2021.1-5.el9.noarch.rpm 301 kB/s | 47 kB 00:00 2024-02-19T18:49:30.235 INFO:teuthology.orchestra.run.smithi046.stdout:(10/33): python3-toml-0.10.2-6.el9.noarch.rpm 330 kB/s | 39 kB 00:00 2024-02-19T18:49:30.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-rook 2024-02-19T18:49:30.476 INFO:teuthology.orchestra.run.smithi046.stdout:(11/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 759 kB/s | 241 kB 00:00 2024-02-19T18:49:30.829 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:27 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:30.994 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:30.995 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:30.995 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-19T18:49:30.995 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-19T18:49:30.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-19T18:49:30.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-19T18:49:30.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-19T18:49:30.997 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:30.997 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:30.997 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:30.997 INFO:teuthology.orchestra.run.smithi142.stdout:Install 13 Packages 2024-02-19T18:49:30.997 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:30.997 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 2.0 M 2024-02-19T18:49:30.998 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 26 M 2024-02-19T18:49:30.998 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:31.335 INFO:teuthology.orchestra.run.smithi046.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 93 kB/s | 103 kB 00:01 2024-02-19T18:49:31.364 INFO:teuthology.orchestra.run.smithi142.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 445 kB/s | 47 kB 00:00 2024-02-19T18:49:31.464 INFO:teuthology.orchestra.run.smithi142.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 87 kB/s | 18 kB 00:00 2024-02-19T18:49:31.477 INFO:teuthology.orchestra.run.smithi046.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 124 kB/s | 124 kB 00:00 2024-02-19T18:49:31.527 INFO:teuthology.orchestra.run.smithi046.stdout:(14/33): python3-cryptography-36.0.1-4.el9.x86_ 878 kB/s | 1.1 MB 00:01 2024-02-19T18:49:31.548 INFO:teuthology.orchestra.run.smithi142.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 84 kB/s | 24 kB 00:00 2024-02-19T18:49:31.644 INFO:teuthology.orchestra.run.smithi046.stdout:(15/33): python3-requests-2.25.1-8.el9.noarch.r 366 kB/s | 113 kB 00:00 2024-02-19T18:49:31.744 INFO:teuthology.orchestra.run.smithi046.stdout:(16/33): python3-urllib3-1.26.5-5.el9.noarch.rp 701 kB/s | 187 kB 00:00 2024-02-19T18:49:31.765 INFO:teuthology.orchestra.run.smithi142.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 437 kB/s | 174 kB 00:00 2024-02-19T18:49:31.786 INFO:teuthology.orchestra.run.smithi046.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 168 kB/s | 43 kB 00:00 2024-02-19T18:49:31.870 INFO:teuthology.orchestra.run.smithi046.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 762 kB/s | 172 kB 00:00 2024-02-19T18:49:31.882 INFO:teuthology.orchestra.run.smithi142.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 317 kB/s | 132 kB 00:00 2024-02-19T18:49:31.895 INFO:teuthology.orchestra.run.smithi046.stdout:(19/33): python3-cherrypy-18.6.1-2.el9.noarch.r 2.3 MB/s | 358 kB 00:00 2024-02-19T18:49:31.920 INFO:teuthology.orchestra.run.smithi046.stdout:(20/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 80 kB/s | 11 kB 00:00 2024-02-19T18:49:31.946 INFO:teuthology.orchestra.run.smithi046.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 234 kB/s | 18 kB 00:00 2024-02-19T18:49:31.971 INFO:teuthology.orchestra.run.smithi046.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2024-02-19T18:49:31.999 INFO:teuthology.orchestra.run.smithi142.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 467 kB/s | 211 kB 00:00 2024-02-19T18:49:32.024 INFO:teuthology.orchestra.run.smithi142.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 165 kB/s | 43 kB 00:00 2024-02-19T18:49:32.208 INFO:teuthology.orchestra.run.smithi142.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 99 kB/s | 32 kB 00:00 2024-02-19T18:49:32.254 INFO:teuthology.orchestra.run.smithi046.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 58 kB/s | 19 kB 00:00 2024-02-19T18:49:32.305 INFO:teuthology.orchestra.run.smithi046.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 59 kB/s | 20 kB 00:00 2024-02-19T18:49:32.324 INFO:teuthology.orchestra.run.smithi142.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 46 kB/s | 15 kB 00:00 2024-02-19T18:49:32.330 INFO:teuthology.orchestra.run.smithi046.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 129 kB/s | 46 kB 00:00 2024-02-19T18:49:32.480 INFO:teuthology.orchestra.run.smithi046.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 349 kB/s | 79 kB 00:00 2024-02-19T18:49:32.622 INFO:teuthology.orchestra.run.smithi046.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 859 kB/s | 272 kB 00:00 2024-02-19T18:49:32.624 INFO:teuthology.orchestra.run.smithi142.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 197 kB/s | 59 kB 00:00 2024-02-19T18:49:32.647 INFO:teuthology.orchestra.run.smithi046.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 52 kB/s | 16 kB 00:00 2024-02-19T18:49:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 469 kB/s | 90 kB 00:00 2024-02-19T18:49:32.698 INFO:teuthology.orchestra.run.smithi046.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2024-02-19T18:49:32.717 INFO:teuthology.orchestra.run.smithi142.stdout:(11/13): python3-google-auth-2.27.0-1.el9.noarc 293 kB/s | 203 kB 00:00 2024-02-19T18:49:32.781 INFO:teuthology.orchestra.run.smithi046.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-02-19T18:49:32.885 INFO:teuthology.orchestra.run.smithi142.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 344 kB/s | 90 kB 00:00 2024-02-19T18:49:32.965 INFO:teuthology.orchestra.run.smithi046.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.4 MB/s | 427 kB 00:00 2024-02-19T18:49:32.967 INFO:teuthology.orchestra.run.smithi142.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.3 MB/s | 1.0 MB 00:00 2024-02-19T18:49:32.970 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:32.970 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.0 MB/s | 2.0 MB 00:01 2024-02-19T18:49:32.970 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:32.982 INFO:teuthology.orchestra.run.smithi046.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 70 kB/s | 20 kB 00:00 2024-02-19T18:49:32.986 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:32.986 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:32.988 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:32.988 INFO:teuthology.orchestra.run.smithi046.stdout:Total 7.3 MB/s | 30 MB 00:04 2024-02-19T18:49:32.989 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:49:33.031 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:49:33.031 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:49:33.092 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:33.092 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:33.408 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:49:33.408 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:49:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:33.798 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-19T18:49:33.860 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-19T18:49:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-19T18:49:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-19T18:49:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-19T18:49:34.089 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-19T18:49:34.198 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-19T18:49:34.245 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-19T18:49:34.677 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:49:34.734 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-19T18:49:34.767 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-19T18:49:34.800 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-19T18:49:34.896 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-19T18:49:34.972 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-19T18:49:35.019 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-19T18:49:35.027 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-19T18:49:35.076 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-19T18:49:35.102 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-19T18:49:35.109 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-19T18:49:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-19T18:49:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-19T18:49:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-19T18:49:35.202 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-19T18:49:35.260 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-19T18:49:35.322 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-19T18:49:35.518 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-19T18:49:35.573 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-19T18:49:35.611 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-19T18:49:35.646 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-19T18:49:35.676 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-19T18:49:35.754 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-19T18:49:35.786 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-19T18:49:35.820 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-19T18:49:35.852 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-19T18:49:35.887 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-19T18:49:35.910 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-19T18:49:35.910 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-02-19T18:49:35.910 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-19T18:49:35.911 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-19T18:49:35.911 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-19T18:49:35.911 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-19T18:49:35.911 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-19T18:49:35.911 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-19T18:49:35.911 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-19T18:49:35.911 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-19T18:49:35.911 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-19T18:49:35.911 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-19T18:49:35.911 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-19T18:49:35.921 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-19T18:49:36.013 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-19T18:49:36.052 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-19T18:49:36.127 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-19T18:49:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-19T18:49:36.279 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-19T18:49:36.279 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:36.279 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-19T18:49:36.280 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-19T18:49:36.281 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:36.281 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:36.390 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-19T18:49:36.542 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-cephadm 2024-02-19T18:49:36.556 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-02-19T18:49:36.682 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-19T18:49:36.706 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-19T18:49:36.707 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:36.707 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-19T18:49:36.707 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T18:49:36.707 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T18:49:36.707 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:37.129 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:34 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:37.300 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-19T18:49:37.302 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-19T18:49:37.303 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2024-02-19T18:49:37.303 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 6.8 M 2024-02-19T18:49:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 33 M 2024-02-19T18:49:37.304 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:37.552 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.6 MB/s | 127 kB 00:00 2024-02-19T18:49:37.785 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 724 kB/s | 227 kB 00:00 2024-02-19T18:49:37.885 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 1.9 MB/s | 548 kB 00:00 2024-02-19T18:49:37.952 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 784 kB/s | 51 kB 00:00 2024-02-19T18:49:37.977 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 301 kB/s | 58 kB 00:00 2024-02-19T18:49:38.086 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.4 MB/s | 5.8 MB 00:00 2024-02-19T18:49:38.088 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:38.088 INFO:teuthology.orchestra.run.smithi142.stdout:Total 8.6 MB/s | 6.8 MB 00:00 2024-02-19T18:49:38.088 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:38.097 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:38.097 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:38.187 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:38.188 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:38.301 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-19T18:49:38.328 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-19T18:49:38.329 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:38.329 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-19T18:49:38.329 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T18:49:38.329 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T18:49:38.329 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:38.652 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-19T18:49:38.704 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-19T18:49:38.801 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-19T18:49:38.825 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-19T18:49:38.825 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:38.825 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-19T18:49:38.825 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T18:49:38.825 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T18:49:38.825 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:39.035 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-19T18:49:39.058 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-19T18:49:39.058 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:39.058 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-19T18:49:39.058 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T18:49:39.059 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T18:49:39.059 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:39.137 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-19T18:49:39.212 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-19T18:49:39.289 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-19T18:49:39.348 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-19T18:49:39.375 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-19T18:49:40.160 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-19T18:49:40.160 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-02-19T18:49:40.160 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-19T18:49:40.160 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-19T18:49:40.161 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-19T18:49:40.161 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:40.480 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:40.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-fuse 2024-02-19T18:49:40.778 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-19T18:49:40.778 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-02-19T18:49:40.778 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-19T18:49:40.779 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-19T18:49:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-19T18:49:41.342 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:38 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:41.507 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:41.507 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:41.507 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-02-19T18:49:41.508 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:41.508 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:41.508 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-02-19T18:49:41.508 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-02-19T18:49:41.508 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-19T18:49:41.508 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:41.508 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:41.508 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:41.508 INFO:teuthology.orchestra.run.smithi142.stdout:Install 2 Packages 2024-02-19T18:49:41.508 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:41.509 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 913 k 2024-02-19T18:49:41.509 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 2.7 M 2024-02-19T18:49:41.509 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:41.612 INFO:teuthology.orchestra.run.smithi142.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 7.9 MB/s | 835 kB 00:00 2024-02-19T18:49:41.674 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-19T18:49:41.674 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:41.674 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:49:41.674 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:41.674 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-19T18:49:41.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-19T18:49:41.676 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-19T18:49:41.677 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-19T18:49:41.677 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-19T18:49:41.677 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-19T18:49:41.677 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-19T18:49:41.677 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:41.677 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:49:41.721 INFO:teuthology.orchestra.run.smithi142.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 371 kB/s | 79 kB 00:00 2024-02-19T18:49:41.722 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:41.722 INFO:teuthology.orchestra.run.smithi142.stdout:Total 4.2 MB/s | 913 kB 00:00 2024-02-19T18:49:41.722 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:41.742 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:41.742 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:41.823 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:41.823 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:42.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-base 2024-02-19T18:49:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:42.192 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-19T18:49:42.278 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-19T18:49:42.653 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:52 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:49:42.773 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:42.827 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:49:42.828 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-02-19T18:49:42.829 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:49:42.892 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install cephadm 2024-02-19T18:49:42.970 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-19T18:49:42.970 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-02-19T18:49:43.295 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-19T18:49:43.295 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:43.295 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:43.295 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-19T18:49:43.295 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:43.295 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:43.486 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:53 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:49:43.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados-devel 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 209 k 2024-02-19T18:49:43.660 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 200 k 2024-02-19T18:49:43.661 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:49:43.726 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.1 MB/s | 209 kB 00:00 2024-02-19T18:49:43.726 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:43.727 INFO:teuthology.orchestra.run.smithi046.stdout:Total 3.0 MB/s | 209 kB 00:00 2024-02-19T18:49:43.727 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:49:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:49:43.732 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:49:43.735 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:49:43.735 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:49:43.802 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:49:44.164 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:41 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:44.244 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-19T18:49:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-19T18:49:44.333 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:44.334 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:44.334 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-02-19T18:49:44.334 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:44.334 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:44.334 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-02-19T18:49:44.334 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:44.334 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:44.334 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:44.334 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-02-19T18:49:44.334 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:44.335 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 126 k 2024-02-19T18:49:44.335 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 456 k 2024-02-19T18:49:44.335 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:44.392 INFO:teuthology.orchestra.run.smithi142.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.2 MB/s | 126 kB 00:00 2024-02-19T18:49:44.393 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:44.393 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.1 MB/s | 126 kB 00:00 2024-02-19T18:49:44.393 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:44.398 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:44.398 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:44.453 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:44.454 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:44.594 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:44.698 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:44.833 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-19T18:49:45.170 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:45.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-19T18:49:45.189 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:45.189 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:49:45.189 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-02-19T18:49:45.189 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:45.189 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:49:45.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-immutable-object-cache 2024-02-19T18:49:45.463 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:45.463 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:45.463 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:45.463 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:45.463 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:45.463 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:45.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs2 2024-02-19T18:49:45.945 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:55 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:49:46.118 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:49:46.119 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:46.119 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-02-19T18:49:46.119 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:46.119 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:49:46.119 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-02-19T18:49:46.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:46.119 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:49:46.119 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:46.119 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-02-19T18:49:46.120 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:46.120 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 142 k 2024-02-19T18:49:46.120 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 399 k 2024-02-19T18:49:46.120 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:49:46.191 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.0 MB/s | 142 kB 00:00 2024-02-19T18:49:46.192 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:46.192 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.9 MB/s | 142 kB 00:00 2024-02-19T18:49:46.192 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:49:46.200 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:49:46.200 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:49:46.254 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:49:46.255 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:49:46.336 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:43 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:46.406 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:49:46.454 INFO:teuthology.orchestra.run.smithi142.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:46.507 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:46.508 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-02-19T18:49:46.508 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:46.534 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:46.559 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:46.559 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:46.559 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-19T18:49:46.559 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:46.573 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs-devel 2024-02-19T18:49:47.159 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:44 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:47.325 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:47.325 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:47.325 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-02-19T18:49:47.325 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:47.325 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:47.326 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-02-19T18:49:47.326 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:47.326 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:47.326 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:47.326 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-02-19T18:49:47.326 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:47.326 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 30 k 2024-02-19T18:49:47.327 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 137 k 2024-02-19T18:49:47.327 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:47.387 INFO:teuthology.orchestra.run.smithi142.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 506 kB/s | 30 kB 00:00 2024-02-19T18:49:47.387 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:47.387 INFO:teuthology.orchestra.run.smithi142.stdout:Total 496 kB/s | 30 kB 00:00 2024-02-19T18:49:47.388 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:47.391 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:47.391 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:47.417 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:47.417 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:47.512 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:47.527 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:49:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:47.527 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:49:47.627 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:47.763 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr 2024-02-19T18:49:48.046 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:48.335 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:48.335 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:48.335 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:48.335 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:48.335 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:48.335 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:48.359 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:58 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:49:48.478 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:48.511 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados2 2024-02-19T18:49:48.532 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:49:48.533 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-02-19T18:49:48.533 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:49:48.640 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-dashboard 2024-02-19T18:49:49.095 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:46 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:49.209 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:49.242 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:59 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:49:49.261 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:49.262 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-02-19T18:49:49.262 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:49.330 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librbd1 2024-02-19T18:49:49.416 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:49:49.417 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:49.417 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T18:49:49.417 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout:Install 7 Packages 2024-02-19T18:49:49.418 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:49.419 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.0 M 2024-02-19T18:49:49.419 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 8.1 M 2024-02-19T18:49:49.419 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:49:49.579 INFO:teuthology.orchestra.run.smithi046.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 205 kB/s | 23 kB 00:00 2024-02-19T18:49:49.604 INFO:teuthology.orchestra.run.smithi046.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 106 kB/s | 15 kB 00:00 2024-02-19T18:49:49.663 INFO:teuthology.orchestra.run.smithi046.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 8.6 MB/s | 1.7 MB 00:00 2024-02-19T18:49:49.846 INFO:teuthology.orchestra.run.smithi046.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 34 kB/s | 9.0 kB 00:00 2024-02-19T18:49:49.916 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:46 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:49.938 INFO:teuthology.orchestra.run.smithi046.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 112 kB/s | 31 kB 00:00 2024-02-19T18:49:49.964 INFO:teuthology.orchestra.run.smithi046.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 114 kB/s | 41 kB 00:00 2024-02-19T18:49:50.032 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:50.084 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:50.085 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-02-19T18:49:50.085 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:50.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rados 2024-02-19T18:49:50.180 INFO:teuthology.orchestra.run.smithi046.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 565 kB/s | 188 kB 00:00 2024-02-19T18:49:50.182 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:50.182 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.6 MB/s | 2.0 MB 00:00 2024-02-19T18:49:50.183 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:49:50.191 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:49:50.191 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:49:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:49:50.259 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:49:50.565 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:49:50.665 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-19T18:49:50.699 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-19T18:49:50.726 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:47 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:50.755 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-19T18:49:50.786 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-19T18:49:50.815 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-02-19T18:49:50.840 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:50.893 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:50.894 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-02-19T18:49:50.894 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:50.955 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rgw 2024-02-19T18:49:51.056 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-02-19T18:49:51.084 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-19T18:49:51.535 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:48 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:51.603 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-19T18:49:51.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-02-19T18:49:51.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-02-19T18:49:51.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-02-19T18:49:51.603 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-19T18:49:51.604 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-19T18:49:51.604 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-19T18:49:51.650 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:51.702 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:51.703 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-02-19T18:49:51.703 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:51.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-cephfs 2024-02-19T18:49:51.928 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-19T18:49:51.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:51.928 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:49:51.928 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-02-19T18:49:51.928 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-02-19T18:49:51.929 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-02-19T18:49:51.929 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-19T18:49:51.929 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-19T18:49:51.929 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-19T18:49:51.929 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-19T18:49:51.929 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:51.929 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:49:52.110 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-19T18:49:52.365 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:49 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:52.478 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:52.529 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:52.530 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-02-19T18:49:52.530 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:52.596 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rbd 2024-02-19T18:49:52.700 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:02 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:49:52.875 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:49:52.876 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:52.876 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T18:49:52.876 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:52.876 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:49:52.876 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-02-19T18:49:52.876 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:49:52.877 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:49:52.878 INFO:teuthology.orchestra.run.smithi046.stdout:Install 12 Packages 2024-02-19T18:49:52.878 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:49:52.878 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 37 M 2024-02-19T18:49:52.878 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 209 M 2024-02-19T18:49:52.878 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:49:53.180 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:50 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:53.295 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:49:53.347 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:53.348 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-02-19T18:49:53.349 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:53.362 INFO:teuthology.orchestra.run.smithi046.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 34 MB/s | 7.4 MB 00:00 2024-02-19T18:49:53.379 INFO:teuthology.orchestra.run.smithi046.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 134 kB/s | 32 kB 00:00 2024-02-19T18:49:53.413 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-fuse 2024-02-19T18:49:53.421 INFO:teuthology.orchestra.run.smithi046.stdout:(3/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 301 kB/s | 17 kB 00:00 2024-02-19T18:49:53.463 INFO:teuthology.orchestra.run.smithi046.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 407 kB/s | 34 kB 00:00 2024-02-19T18:49:53.771 INFO:teuthology.orchestra.run.smithi046.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.8 MB/s | 3.0 MB 00:00 2024-02-19T18:49:53.847 INFO:teuthology.orchestra.run.smithi046.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2024-02-19T18:49:53.922 INFO:teuthology.orchestra.run.smithi046.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 4.8 MB 00:00 2024-02-19T18:49:53.947 INFO:teuthology.orchestra.run.smithi046.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.2 MB/s | 217 kB 00:00 2024-02-19T18:49:53.997 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:50 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:54.163 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:54.164 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:54.164 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-02-19T18:49:54.164 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:54.165 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:54.165 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-02-19T18:49:54.165 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:54.165 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:54.165 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:54.165 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-02-19T18:49:54.165 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:54.165 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 86 k 2024-02-19T18:49:54.165 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 230 k 2024-02-19T18:49:54.165 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:54.240 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-02-19T18:49:54.240 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:54.241 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.1 MB/s | 86 kB 00:00 2024-02-19T18:49:54.241 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:54.247 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:54.248 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:54.302 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:54.303 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:54.356 INFO:teuthology.orchestra.run.smithi046.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-02-19T18:49:54.397 INFO:teuthology.orchestra.run.smithi046.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 802 kB 00:00 2024-02-19T18:49:54.423 INFO:teuthology.orchestra.run.smithi046.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 411 kB/s | 194 kB 00:00 2024-02-19T18:49:54.437 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:54.538 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:54.707 INFO:teuthology.orchestra.run.smithi046.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 704 kB/s | 245 kB 00:00 2024-02-19T18:49:54.709 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:54.709 INFO:teuthology.orchestra.run.smithi046.stdout:Total 20 MB/s | 37 MB 00:01 2024-02-19T18:49:54.725 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:49:54.751 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:49:54.751 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:49:54.942 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:55.210 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:49:55.210 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:49:55.237 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:55.237 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:55.237 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:55.237 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:55.237 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:55.237 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:55.508 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-mirror 2024-02-19T18:49:55.930 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:49:56.005 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-19T18:49:56.036 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-19T18:49:56.104 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:53 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:56.134 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-19T18:49:56.165 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-19T18:49:56.275 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:56.275 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:56.275 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-02-19T18:49:56.275 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:56.276 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:56.276 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-19T18:49:56.276 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:56.276 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:56.276 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:56.276 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-02-19T18:49:56.276 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:56.277 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 3.0 M 2024-02-19T18:49:56.277 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 12 M 2024-02-19T18:49:56.277 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:56.348 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-19T18:49:56.367 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 33 MB/s | 3.0 MB 00:00 2024-02-19T18:49:56.368 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:56.368 INFO:teuthology.orchestra.run.smithi142.stdout:Total 32 MB/s | 3.0 MB 00:00 2024-02-19T18:49:56.368 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:56.377 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:56.377 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:56.388 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-19T18:49:56.448 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:56.449 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:56.467 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-19T18:49:56.861 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:56.926 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:56.951 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-19T18:49:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T18:49:56.951 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T18:49:56.951 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:57.170 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-19T18:49:57.296 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-19T18:49:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:58.137 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:49:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-02-19T18:49:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:58.137 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:49:58.409 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-nbd 2024-02-19T18:49:58.599 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-19T18:49:59.008 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:55 ago on Mon 19 Feb 2024 06:48:03 PM UTC. 2024-02-19T18:49:59.175 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-02-19T18:49:59.175 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:59.175 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-02-19T18:49:59.175 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:59.175 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-02-19T18:49:59.175 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-02-19T18:49:59.175 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:59.176 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-02-19T18:49:59.176 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-02-19T18:49:59.176 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-02-19T18:49:59.176 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:49:59.176 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 169 k 2024-02-19T18:49:59.176 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 490 k 2024-02-19T18:49:59.176 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-02-19T18:49:59.246 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.4 MB/s | 169 kB 00:00 2024-02-19T18:49:59.246 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:59.247 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.3 MB/s | 169 kB 00:00 2024-02-19T18:49:59.247 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-02-19T18:49:59.254 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-02-19T18:49:59.254 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-02-19T18:49:59.309 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-02-19T18:49:59.310 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-02-19T18:49:59.464 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-02-19T18:49:59.570 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:49:59.668 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-19T18:49:59.704 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-19T18:49:59.998 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:00.326 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:00.326 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:50:00.326 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-02-19T18:50:00.326 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-02-19T18:50:00.326 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:50:00.326 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-02-19T18:50:00.585 DEBUG:teuthology.parallel:result is None 2024-02-19T18:50:02.137 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-19T18:50:02.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-02-19T18:50:02.137 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-19T18:50:02.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-19T18:50:02.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-19T18:50:02.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-19T18:50:02.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-19T18:50:02.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-19T18:50:02.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-19T18:50:02.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-19T18:50:02.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-19T18:50:02.138 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-19T18:50:02.582 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-19T18:50:02.583 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-19T18:50:02.584 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-19T18:50:02.584 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-19T18:50:02.584 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:02.584 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:03.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-rook 2024-02-19T18:50:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:13 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:03.784 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:03.785 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:03.785 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T18:50:03.785 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:03.785 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:50:03.785 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-02-19T18:50:03.785 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-19T18:50:03.786 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-19T18:50:03.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:03.787 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:50:03.787 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:03.787 INFO:teuthology.orchestra.run.smithi046.stdout:Install 13 Packages 2024-02-19T18:50:03.787 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:03.787 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.0 M 2024-02-19T18:50:03.787 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 26 M 2024-02-19T18:50:03.788 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:50:04.196 INFO:teuthology.orchestra.run.smithi046.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 762 kB/s | 47 kB 00:00 2024-02-19T18:50:04.330 INFO:teuthology.orchestra.run.smithi046.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 125 kB/s | 24 kB 00:00 2024-02-19T18:50:04.380 INFO:teuthology.orchestra.run.smithi046.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 73 kB/s | 18 kB 00:00 2024-02-19T18:50:04.497 INFO:teuthology.orchestra.run.smithi046.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 792 kB/s | 132 kB 00:00 2024-02-19T18:50:04.530 INFO:teuthology.orchestra.run.smithi046.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 612 kB/s | 174 kB 00:00 2024-02-19T18:50:04.572 INFO:teuthology.orchestra.run.smithi046.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 211 kB 00:00 2024-02-19T18:50:04.597 INFO:teuthology.orchestra.run.smithi046.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 427 kB/s | 43 kB 00:00 2024-02-19T18:50:04.790 INFO:teuthology.orchestra.run.smithi046.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 69 kB/s | 15 kB 00:00 2024-02-19T18:50:04.848 INFO:teuthology.orchestra.run.smithi046.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 101 kB/s | 32 kB 00:00 2024-02-19T18:50:04.982 INFO:teuthology.orchestra.run.smithi046.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 528 kB/s | 203 kB 00:00 2024-02-19T18:50:05.015 INFO:teuthology.orchestra.run.smithi046.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 354 kB/s | 59 kB 00:00 2024-02-19T18:50:05.074 INFO:teuthology.orchestra.run.smithi046.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 974 kB/s | 90 kB 00:00 2024-02-19T18:50:05.249 INFO:teuthology.orchestra.run.smithi046.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.2 MB/s | 1.0 MB 00:00 2024-02-19T18:50:05.253 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:05.253 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.4 MB/s | 2.0 MB 00:01 2024-02-19T18:50:05.253 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:50:05.269 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:50:05.269 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:50:05.383 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:50:05.383 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:50:05.914 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:50:06.084 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-19T18:50:06.143 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-19T18:50:06.198 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-19T18:50:06.235 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-19T18:50:06.276 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-19T18:50:06.372 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-19T18:50:06.481 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-19T18:50:06.528 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-19T18:50:07.284 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-19T18:50:07.333 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-19T18:50:07.367 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-19T18:50:07.413 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-19T18:50:07.437 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-19T18:50:08.209 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-19T18:50:08.209 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-02-19T18:50:08.209 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-19T18:50:08.209 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-19T18:50:08.209 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-19T18:50:08.209 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-19T18:50:08.209 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-19T18:50:08.209 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-19T18:50:08.210 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-19T18:50:08.210 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-19T18:50:08.210 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-19T18:50:08.210 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-19T18:50:08.210 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-19T18:50:08.584 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-19T18:50:08.584 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:08.584 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:50:08.584 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-02-19T18:50:08.584 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-19T18:50:08.584 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-19T18:50:08.584 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-19T18:50:08.584 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-19T18:50:08.585 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-19T18:50:08.585 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-19T18:50:08.585 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-19T18:50:08.585 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-19T18:50:08.585 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-19T18:50:08.585 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-19T18:50:08.585 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-19T18:50:08.585 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-19T18:50:08.585 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:08.585 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:08.831 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-cephadm 2024-02-19T18:50:09.433 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:19 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:09.608 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:09.609 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-02-19T18:50:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:50:09.609 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-02-19T18:50:09.609 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T18:50:09.609 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-19T18:50:09.609 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-19T18:50:09.609 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-19T18:50:09.609 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-19T18:50:09.610 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-19T18:50:09.610 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:50:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:Install 6 Packages 2024-02-19T18:50:09.610 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:09.610 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 6.8 M 2024-02-19T18:50:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 33 M 2024-02-19T18:50:09.611 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:50:10.068 INFO:teuthology.orchestra.run.smithi046.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.2 MB/s | 127 kB 00:00 2024-02-19T18:50:10.168 INFO:teuthology.orchestra.run.smithi046.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.1 MB/s | 227 kB 00:00 2024-02-19T18:50:10.460 INFO:teuthology.orchestra.run.smithi046.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 198 kB/s | 58 kB 00:00 2024-02-19T18:50:10.535 INFO:teuthology.orchestra.run.smithi046.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 682 kB/s | 51 kB 00:00 2024-02-19T18:50:10.644 INFO:teuthology.orchestra.run.smithi046.stdout:(5/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 953 kB/s | 548 kB 00:00 2024-02-19T18:50:11.219 INFO:teuthology.orchestra.run.smithi046.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 5.8 MB 00:01 2024-02-19T18:50:11.223 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:11.224 INFO:teuthology.orchestra.run.smithi046.stdout:Total 4.2 MB/s | 6.8 MB 00:01 2024-02-19T18:50:11.224 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:50:11.235 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:50:11.235 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:50:11.333 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:50:11.336 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:50:11.634 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:50:11.843 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-19T18:50:11.905 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-19T18:50:12.450 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-19T18:50:12.542 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-19T18:50:12.600 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-19T18:50:12.625 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-19T18:50:13.500 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-19T18:50:13.500 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-02-19T18:50:13.500 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-19T18:50:13.500 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-19T18:50:13.500 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-19T18:50:13.500 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-19T18:50:13.834 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-19T18:50:13.834 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:13.834 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:50:13.834 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-02-19T18:50:13.835 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-19T18:50:13.835 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-19T18:50:13.835 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-19T18:50:13.835 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-19T18:50:13.835 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-19T18:50:13.835 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:13.835 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:14.083 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-fuse 2024-02-19T18:50:14.678 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:24 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:14.851 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:14.852 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:14.852 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-02-19T18:50:14.852 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:14.852 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:50:14.852 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-02-19T18:50:14.852 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-02-19T18:50:14.852 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-19T18:50:14.852 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:14.853 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:50:14.853 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:14.853 INFO:teuthology.orchestra.run.smithi046.stdout:Install 2 Packages 2024-02-19T18:50:14.853 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:14.853 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 913 k 2024-02-19T18:50:14.853 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 2.7 M 2024-02-19T18:50:14.853 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:50:14.938 INFO:teuthology.orchestra.run.smithi046.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 9.6 MB/s | 835 kB 00:00 2024-02-19T18:50:15.097 INFO:teuthology.orchestra.run.smithi046.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 323 kB/s | 79 kB 00:00 2024-02-19T18:50:15.098 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:15.098 INFO:teuthology.orchestra.run.smithi046.stdout:Total 3.6 MB/s | 913 kB 00:00 2024-02-19T18:50:15.098 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:50:15.119 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:50:15.119 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:50:15.202 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:50:15.202 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:50:15.394 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:50:15.534 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-19T18:50:15.616 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-19T18:50:16.299 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-19T18:50:16.300 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-02-19T18:50:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-19T18:50:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:16.634 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:50:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-19T18:50:16.634 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:16.635 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:16.890 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados-devel 2024-02-19T18:50:17.493 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:27 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:17.669 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 126 k 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 456 k 2024-02-19T18:50:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:50:17.734 INFO:teuthology.orchestra.run.smithi046.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 126 kB 00:00 2024-02-19T18:50:17.735 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:17.735 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.9 MB/s | 126 kB 00:00 2024-02-19T18:50:17.735 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:50:17.741 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:50:17.741 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:50:17.798 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:50:17.798 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:50:17.959 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:50:18.076 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:18.509 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:18.832 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:18.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:18.832 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:50:18.832 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-02-19T18:50:18.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:18.832 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:19.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs2 2024-02-19T18:50:19.653 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:29 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:19.773 INFO:teuthology.orchestra.run.smithi046.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:50:19.829 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:19.830 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-02-19T18:50:19.830 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:19.896 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs-devel 2024-02-19T18:50:20.491 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:30 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:20.666 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:20.667 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-02-19T18:50:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:50:20.668 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-02-19T18:50:20.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:50:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-02-19T18:50:20.668 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 30 k 2024-02-19T18:50:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 137 k 2024-02-19T18:50:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:50:20.747 INFO:teuthology.orchestra.run.smithi046.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 387 kB/s | 30 kB 00:00 2024-02-19T18:50:20.747 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:20.747 INFO:teuthology.orchestra.run.smithi046.stdout:Total 380 kB/s | 30 kB 00:00 2024-02-19T18:50:20.747 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:50:20.751 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:50:20.751 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:50:20.777 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:50:20.777 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:50:20.872 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:50:20.988 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:21.343 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:21.631 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:21.631 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:21.632 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:50:21.632 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-02-19T18:50:21.632 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:21.632 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:21.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados2 2024-02-19T18:50:22.383 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:32 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:22.501 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:50:22.556 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:22.557 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-02-19T18:50:22.558 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:22.617 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librbd1 2024-02-19T18:50:23.208 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:33 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:23.326 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:50:23.382 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:23.383 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-02-19T18:50:23.383 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:23.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rados 2024-02-19T18:50:24.035 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:34 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:24.154 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:50:24.208 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:24.210 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-02-19T18:50:24.210 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:24.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rgw 2024-02-19T18:50:24.860 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:34 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:24.979 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:50:25.034 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:25.035 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-02-19T18:50:25.035 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:25.096 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-cephfs 2024-02-19T18:50:25.687 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:35 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:25.805 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:50:25.860 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:25.861 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-02-19T18:50:25.861 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:25.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rbd 2024-02-19T18:50:26.518 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:36 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:26.637 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-19T18:50:26.692 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:26.693 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-02-19T18:50:26.694 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:26.763 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-fuse 2024-02-19T18:50:27.358 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:37 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:27.533 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:27.534 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:27.534 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-02-19T18:50:27.534 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:27.534 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:50:27.534 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-02-19T18:50:27.534 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:27.535 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:50:27.535 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:27.535 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-02-19T18:50:27.535 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:27.535 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 86 k 2024-02-19T18:50:27.535 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 230 k 2024-02-19T18:50:27.535 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:50:27.608 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-02-19T18:50:27.608 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:27.609 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.1 MB/s | 86 kB 00:00 2024-02-19T18:50:27.609 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:50:27.616 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:50:27.616 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:50:27.674 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:50:27.675 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:50:27.818 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:50:27.917 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:28.341 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:28.681 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:28.681 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:28.681 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:50:28.681 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-02-19T18:50:28.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:28.682 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:28.901 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-mirror 2024-02-19T18:50:29.491 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:39 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:29.668 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:29.669 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 3.0 M 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 12 M 2024-02-19T18:50:29.670 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:50:29.795 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 24 MB/s | 3.0 MB 00:00 2024-02-19T18:50:29.796 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:29.796 INFO:teuthology.orchestra.run.smithi046.stdout:Total 24 MB/s | 3.0 MB 00:00 2024-02-19T18:50:29.796 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:50:29.805 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:50:29.805 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:50:29.880 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:50:29.880 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:50:30.312 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:50:30.370 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:30.394 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:50:30.394 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-19T18:50:30.394 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T18:50:30.394 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T18:50:30.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:31.555 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:31.555 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:31.555 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:50:31.556 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-02-19T18:50:31.556 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:31.556 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:31.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-nbd 2024-02-19T18:50:32.363 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:42 ago on Mon 19 Feb 2024 06:48:50 PM UTC. 2024-02-19T18:50:32.537 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-02-19T18:50:32.538 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:32.538 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-02-19T18:50:32.538 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-02-19T18:50:32.539 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-02-19T18:50:32.539 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-02-19T18:50:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-02-19T18:50:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-02-19T18:50:32.539 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 169 k 2024-02-19T18:50:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 490 k 2024-02-19T18:50:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-02-19T18:50:32.607 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.5 MB/s | 169 kB 00:00 2024-02-19T18:50:32.607 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:32.607 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.4 MB/s | 169 kB 00:00 2024-02-19T18:50:32.608 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-02-19T18:50:32.616 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-02-19T18:50:32.616 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-02-19T18:50:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-02-19T18:50:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-02-19T18:50:32.841 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-02-19T18:50:32.950 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:33.373 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:33.672 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-19T18:50:33.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:33.672 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-02-19T18:50:33.672 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-02-19T18:50:33.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:50:33.672 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-02-19T18:50:33.949 DEBUG:teuthology.parallel:result is None 2024-02-19T18:50:33.950 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:50:33.950 INFO:teuthology.packaging:ref: None 2024-02-19T18:50:33.950 INFO:teuthology.packaging:tag: v18.2.0 2024-02-19T18:50:33.950 INFO:teuthology.packaging:branch: None 2024-02-19T18:50:33.950 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:50:33.950 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-19T18:50:33.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-19T18:50:34.279 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-19T18:50:34.302 INFO:teuthology.orchestra.run.smithi046.stdout:18.2.0-0.el9 2024-02-19T18:50:34.302 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-02-19T18:50:34.302 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-02-19T18:50:34.304 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:50:34.304 INFO:teuthology.packaging:ref: None 2024-02-19T18:50:34.304 INFO:teuthology.packaging:tag: v18.2.0 2024-02-19T18:50:34.304 INFO:teuthology.packaging:branch: None 2024-02-19T18:50:34.304 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:50:34.304 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-19T18:50:34.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-19T18:50:34.581 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-19T18:50:34.606 INFO:teuthology.orchestra.run.smithi142.stdout:18.2.0-0.el9 2024-02-19T18:50:34.606 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-02-19T18:50:34.606 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-02-19T18:50:34.608 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-19T18:50:34.608 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:50:34.608 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-19T18:50:34.640 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:50:34.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-19T18:50:34.678 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-19T18:50:34.678 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:50:34.678 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-02-19T18:50:34.710 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-19T18:50:34.779 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:50:34.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-02-19T18:50:34.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-19T18:50:34.878 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-19T18:50:34.878 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:50:34.878 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-19T18:50:34.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-19T18:50:34.977 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:50:34.977 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-19T18:50:35.004 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-19T18:50:35.071 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-19T18:50:35.071 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:50:35.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-02-19T18:50:35.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-19T18:50:35.168 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:50:35.169 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-02-19T18:50:35.195 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-19T18:50:35.269 INFO:teuthology.run_tasks:Running task print... 2024-02-19T18:50:35.279 INFO:teuthology.task.print:**** done install task... 2024-02-19T18:50:35.279 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-19T18:50:35.373 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'} 2024-02-19T18:50:35.373 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-02-19T18:50:35.374 INFO:tasks.cephadm:Cluster fsid is c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:50:35.374 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-19T18:50:35.374 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-19T18:50:35.374 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi046': '172.21.15.46', 'mon.smithi142': '172.21.15.142'} 2024-02-19T18:50:35.374 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-19T18:50:35.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname $(hostname -s) 2024-02-19T18:50:35.405 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname $(hostname -s) 2024-02-19T18:50:35.432 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-02-19T18:50:35.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:50:35.573 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/76790/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1450-gf78a58c0', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1450.gf78a58c0'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-02-15 19:25:41.455235', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20240215.160715', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/76792/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1450-gf78a58c0', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1450.gf78a58c0'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-02-15 19:17:06.436952', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20240215.160715', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-02-19T18:50:36.038 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 bb2b5a32fc53d75aa463fb74c73b7d0b0ada6320 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-02-19T18:50:36.040 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/bb2b5a32fc53d75aa463fb74c73b7d0b0ada6320/centos/9/x86_64/flavors/default/cephadm 2024-02-19T18:50:36.040 DEBUG:teuthology.orchestra.run.smithi046:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/bb2b5a32fc53d75aa463fb74c73b7d0b0ada6320/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-19T18:50:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-r--r--. 1 ubuntu ubuntu 214738 Feb 19 18:50 /home/ubuntu/cephtest/cephadm 2024-02-19T18:50:36.415 DEBUG:teuthology.orchestra.run.smithi142:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/bb2b5a32fc53d75aa463fb74c73b7d0b0ada6320/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-19T18:50:37.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r--. 1 ubuntu ubuntu 214738 Feb 19 18:50 /home/ubuntu/cephtest/cephadm 2024-02-19T18:50:37.166 DEBUG:teuthology.orchestra.run.smithi046:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-19T18:50:37.184 DEBUG:teuthology.orchestra.run.smithi142:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-19T18:50:37.211 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-02-19T18:50:37.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-02-19T18:50:37.226 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-02-19T18:50:38.085 INFO:teuthology.orchestra.run.smithi142.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-02-19T18:50:38.086 INFO:teuthology.orchestra.run.smithi046.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-02-19T18:51:02.053 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-02-19T18:51:02.054 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-02-19T18:51:02.054 INFO:teuthology.orchestra.run.smithi142.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-02-19T18:51:02.054 INFO:teuthology.orchestra.run.smithi142.stdout: "repo_digests": [ 2024-02-19T18:51:02.054 INFO:teuthology.orchestra.run.smithi142.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-02-19T18:51:02.054 INFO:teuthology.orchestra.run.smithi142.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-02-19T18:51:02.054 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-02-19T18:51:02.054 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-02-19T18:51:25.843 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T18:51:25.843 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-02-19T18:51:25.843 INFO:teuthology.orchestra.run.smithi046.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-02-19T18:51:25.843 INFO:teuthology.orchestra.run.smithi046.stdout: "repo_digests": [ 2024-02-19T18:51:25.843 INFO:teuthology.orchestra.run.smithi046.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-02-19T18:51:25.843 INFO:teuthology.orchestra.run.smithi046.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-02-19T18:51:25.843 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-02-19T18:51:25.844 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T18:51:25.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph 2024-02-19T18:51:25.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph 2024-02-19T18:51:25.948 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /etc/ceph 2024-02-19T18:51:25.974 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /etc/ceph 2024-02-19T18:51:26.018 INFO:tasks.cephadm:Writing seed config... 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-19T18:51:26.020 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-19T18:51:26.021 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-19T18:51:26.022 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-19T18:51:26.023 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-19T18:51:26.023 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:51:26.023 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-19T18:51:26.038 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c412ec66-cf57-11ee-95bb-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-19T18:51:26.038 DEBUG:teuthology.orchestra.run.smithi046:mon.smithi046> sudo journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046.service 2024-02-19T18:51:26.080 INFO:tasks.cephadm:Bootstrapping... 2024-02-19T18:51:26.081 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid c412ec66-cf57-11ee-95bb-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.46 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-19T18:51:26.239 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:51:26.239 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', 'c412ec66-cf57-11ee-95bb-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.46', '--skip-admin-label'] 2024-02-19T18:51:26.264 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-19T18:51:26.264 INFO:teuthology.orchestra.run.smithi046.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-19T18:51:26.264 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying podman|docker is present... 2024-02-19T18:51:26.287 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-19T18:51:26.287 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying lvm2 is present... 2024-02-19T18:51:26.287 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying time synchronization is in place... 2024-02-19T18:51:26.295 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-19T18:51:26.295 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-19T18:51:26.300 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-19T18:51:26.300 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-02-19T18:51:26.306 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-02-19T18:51:26.312 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-02-19T18:51:26.312 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-02-19T18:51:26.312 INFO:teuthology.orchestra.run.smithi046.stdout:Repeating the final host check... 2024-02-19T18:51:26.336 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-19T18:51:26.336 INFO:teuthology.orchestra.run.smithi046.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-19T18:51:26.336 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl is present 2024-02-19T18:51:26.336 INFO:teuthology.orchestra.run.smithi046.stdout:lvcreate is present 2024-02-19T18:51:26.342 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-19T18:51:26.342 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-19T18:51:26.347 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-19T18:51:26.348 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-02-19T18:51:26.354 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-02-19T18:51:26.360 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-02-19T18:51:26.360 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-02-19T18:51:26.360 INFO:teuthology.orchestra.run.smithi046.stdout:Host looks OK 2024-02-19T18:51:26.360 INFO:teuthology.orchestra.run.smithi046.stdout:Cluster fsid: c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:51:26.360 INFO:teuthology.orchestra.run.smithi046.stdout:Acquiring lock 140317709220064 on /run/cephadm/c412ec66-cf57-11ee-95bb-87774f69a715.lock 2024-02-19T18:51:26.360 INFO:teuthology.orchestra.run.smithi046.stdout:Lock 140317709220064 acquired on /run/cephadm/c412ec66-cf57-11ee-95bb-87774f69a715.lock 2024-02-19T18:51:26.360 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 3300 ... 2024-02-19T18:51:26.361 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 6789 ... 2024-02-19T18:51:26.361 INFO:teuthology.orchestra.run.smithi046.stdout:Base mon IP(s) is [172.21.15.46:3300, 172.21.15.46:6789], mon addrv is [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-02-19T18:51:26.364 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.46 metric 100 2024-02-19T18:51:26.364 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.46 metric 100 2024-02-19T18:51:26.366 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-19T18:51:26.366 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-02-19T18:51:26.366 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-02-19T18:51:26.368 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-19T18:51:26.369 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-19T18:51:26.369 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-19T18:51:26.369 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-02-19T18:51:26.369 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-02-19T18:51:26.369 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-19T18:51:26.370 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-02-19T18:51:26.370 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-02-19T18:51:26.370 INFO:teuthology.orchestra.run.smithi046.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-19T18:51:26.370 INFO:teuthology.orchestra.run.smithi046.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-19T18:51:26.370 INFO:teuthology.orchestra.run.smithi046.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-02-19T18:51:27.771 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-02-19T18:51:27.771 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-02-19T18:51:27.771 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Getting image source signatures 2024-02-19T18:51:27.771 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-02-19T18:51:27.771 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-02-19T18:51:27.772 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-02-19T18:51:27.772 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-19T18:51:28.709 INFO:teuthology.orchestra.run.smithi046.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-02-19T18:51:28.710 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-02-19T18:51:28.710 INFO:teuthology.orchestra.run.smithi046.stdout:Extracting ceph user uid/gid from container image... 2024-02-19T18:51:29.658 INFO:teuthology.orchestra.run.smithi046.stdout:stat: stdout 167 167 2024-02-19T18:51:29.658 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial keys... 2024-02-19T18:51:30.622 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAyo9NlLJWRARAABXCfmN+s6Hf7PpgCE43yTg== 2024-02-19T18:51:31.519 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAyo9Nlzu2UNRAAuNVZ3fIHA5JA+Ymhv4sNEg== 2024-02-19T18:51:32.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAzo9Nlv23/MBAAteFl0vFTcynaHK/N25nI2w== 2024-02-19T18:51:32.442 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial monmap... 2024-02-19T18:51:39.347 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-19T18:51:39.347 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-02-19T18:51:39.347 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:51:39.347 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-19T18:51:39.347 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool for smithi046 [v2:172.21.15.46:3300,v1:172.21.15.46:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-19T18:51:39.347 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = pacific 2024-02-19T18:51:39.347 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: set fsid to c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:51:39.347 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-19T18:51:39.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:51:39.348 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mon... 2024-02-19T18:51:42.233 INFO:teuthology.orchestra.run.smithi046.stdout:create mon.smithi046 on 2024-02-19T18:51:42.446 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-19T18:51:42.586 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-19T18:51:42.862 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c412ec66-cf57-11ee-95bb-87774f69a715.target → /etc/systemd/system/ceph-c412ec66-cf57-11ee-95bb-87774f69a715.target. 2024-02-19T18:51:42.862 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c412ec66-cf57-11ee-95bb-87774f69a715.target → /etc/systemd/system/ceph-c412ec66-cf57-11ee-95bb-87774f69a715.target. 2024-02-19T18:51:43.087 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046 2024-02-19T18:51:43.087 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046.service: Unit ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046.service not loaded. 2024-02-19T18:51:43.241 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c412ec66-cf57-11ee-95bb-87774f69a715.target.wants/ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046.service → /etc/systemd/system/ceph-c412ec66-cf57-11ee-95bb-87774f69a715@.service. 2024-02-19T18:51:43.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:43 smithi046 podman[29260]: 2024-02-19 18:51:43.64843531 +0000 UTC m=+0.299690722 container start 0637eaaa0740c6f103b2451e24ff2032df47d2a67a49341d4fe92ca173adb924 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, ceph=True, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS) 2024-02-19T18:51:43.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:43 smithi046 ceph-mon[29279]: mkfs c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:51:43.756 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-19T18:51:43.756 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-02-19T18:51:43.763 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-19T18:51:43.763 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-02-19T18:51:43.763 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-02-19T18:51:43.763 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-02-19T18:51:43.764 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon to start... 2024-02-19T18:51:43.764 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon... 2024-02-19T18:51:43.979 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:43 smithi046 ceph-mon[29279]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-02-19T18:51:43.979 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:43 smithi046 bash[29260]: 0637eaaa0740c6f103b2451e24ff2032df47d2a67a49341d4fe92ca173adb924 2024-02-19T18:51:43.979 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:43 smithi046 systemd[1]: Started Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T18:51:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:44 smithi046 ceph-mon[29279]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-02-19T18:51:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:44 smithi046 ceph-mon[29279]: monmap e1: 1 mons at {smithi046=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0]} removed_ranks: {} 2024-02-19T18:51:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:44 smithi046 ceph-mon[29279]: fsmap 2024-02-19T18:51:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:44 smithi046 ceph-mon[29279]: osdmap e1: 0 total, 0 up, 0 in 2024-02-19T18:51:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:44 smithi046 ceph-mon[29279]: mgrmap e1: no daemons active 2024-02-19T18:51:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:44 smithi046 ceph-mon[29279]: from='client.? 172.21.15.46:0/3506631805' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-19T18:51:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout cluster: 2024-02-19T18:51:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout id: c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:51:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-19T18:51:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:51:45.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout services: 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi046 (age 0.55413s) 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout data: 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pgs: 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.181+0000 7f75408e7700 1 Processor -- start 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.181+0000 7f75408e7700 1 -- start start 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.182+0000 7f75408e7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:45.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.182+0000 7f75408e7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c105210 con 0x7f753c1048c0 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.182+0000 7f753a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.182+0000 7f753a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34026/0 (socket says 172.21.15.46:34026) 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.182+0000 7f753a59c700 1 -- 172.21.15.46:0/1805962978 learned_addr learned my addr 172.21.15.46:0/1805962978 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.182+0000 7f753a59c700 1 -- 172.21.15.46:0/1805962978 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c105350 con 0x7f753c1048c0 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f753a59c700 1 --2- 172.21.15.46:0/1805962978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c104cd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f752c00bb40 tx=0x7f752c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a969dbd2a418fd50 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f753959a700 1 -- 172.21.15.46:0/1805962978 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f752c00dc00 con 0x7f753c1048c0 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f753959a700 1 -- 172.21.15.46:0/1805962978 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c00dd60 con 0x7f753c1048c0 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f753959a700 1 -- 172.21.15.46:0/1805962978 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f752c0041a0 con 0x7f753c1048c0 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f75408e7700 1 -- 172.21.15.46:0/1805962978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 msgr2=0x7f753c104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f75408e7700 1 --2- 172.21.15.46:0/1805962978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c104cd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f752c00bb40 tx=0x7f752c00be50 comp rx=0 tx=0).stop 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f75408e7700 1 -- 172.21.15.46:0/1805962978 shutdown_connections 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f75408e7700 1 --2- 172.21.15.46:0/1805962978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c104cd0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f75408e7700 1 -- 172.21.15.46:0/1805962978 >> 172.21.15.46:0/1805962978 conn(0x7f753c0ffed0 msgr2=0x7f753c102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:45.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f75408e7700 1 -- 172.21.15.46:0/1805962978 shutdown_connections 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.183+0000 7f75408e7700 1 -- 172.21.15.46:0/1805962978 wait complete. 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.184+0000 7f75408e7700 1 Processor -- start 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.184+0000 7f75408e7700 1 -- start start 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.184+0000 7f75408e7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c19b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.184+0000 7f75408e7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c19b5b0 con 0x7f753c1048c0 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.184+0000 7f753a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c19b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.184+0000 7f753a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c19b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34036/0 (socket says 172.21.15.46:34036) 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.184+0000 7f753a59c700 1 -- 172.21.15.46:0/3506631805 learned_addr learned my addr 172.21.15.46:0/3506631805 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.185+0000 7f753a59c700 1 -- 172.21.15.46:0/3506631805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c00b7f0 con 0x7f753c1048c0 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.185+0000 7f753a59c700 1 --2- 172.21.15.46:0/3506631805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c19b070 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f752c00b340 tx=0x7f752c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.185+0000 7f752b7fe700 1 -- 172.21.15.46:0/3506631805 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f752c003c60 con 0x7f753c1048c0 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.185+0000 7f752b7fe700 1 -- 172.21.15.46:0/3506631805 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c003dc0 con 0x7f753c1048c0 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.185+0000 7f75408e7700 1 -- 172.21.15.46:0/3506631805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753c19b7b0 con 0x7f753c1048c0 2024-02-19T18:51:45.140 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.185+0000 7f752b7fe700 1 -- 172.21.15.46:0/3506631805 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f752c010600 con 0x7f753c1048c0 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.185+0000 7f75408e7700 1 -- 172.21.15.46:0/3506631805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c19bc50 con 0x7f753c1048c0 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.185+0000 7f752b7fe700 1 -- 172.21.15.46:0/3506631805 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f752c010ab0 con 0x7f753c1048c0 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.185+0000 7f752b7fe700 1 -- 172.21.15.46:0/3506631805 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f752c023440 con 0x7f753c1048c0 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.186+0000 7f75408e7700 1 -- 172.21.15.46:0/3506631805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753c194880 con 0x7f753c1048c0 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.188+0000 7f752b7fe700 1 -- 172.21.15.46:0/3506631805 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f752c02c440 con 0x7f753c1048c0 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.262+0000 7f75408e7700 1 -- 172.21.15.46:0/3506631805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f753c02cc30 con 0x7f753c1048c0 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.262+0000 7f752b7fe700 1 -- 172.21.15.46:0/3506631805 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+324 (secure 0 0 0) 0x7f752c02c5e0 con 0x7f753c1048c0 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.263+0000 7f75408e7700 1 -- 172.21.15.46:0/3506631805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 msgr2=0x7f753c19b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.263+0000 7f75408e7700 1 --2- 172.21.15.46:0/3506631805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c19b070 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f752c00b340 tx=0x7f752c004750 comp rx=0 tx=0).stop 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.263+0000 7f75408e7700 1 -- 172.21.15.46:0/3506631805 shutdown_connections 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.263+0000 7f75408e7700 1 --2- 172.21.15.46:0/3506631805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f753c1048c0 0x7f753c19b070 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.263+0000 7f75408e7700 1 -- 172.21.15.46:0/3506631805 >> 172.21.15.46:0/3506631805 conn(0x7f753c0ffed0 msgr2=0x7f753c102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.263+0000 7f75408e7700 1 -- 172.21.15.46:0/3506631805 shutdown_connections 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:44.263+0000 7f75408e7700 1 -- 172.21.15.46:0/3506631805 wait complete. 2024-02-19T18:51:45.141 INFO:teuthology.orchestra.run.smithi046.stdout:mon is available 2024-02-19T18:51:45.142 INFO:teuthology.orchestra.run.smithi046.stdout:Assimilating anything we can from ceph.conf... 2024-02-19T18:51:46.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:45 smithi046 ceph-mon[29279]: from='client.? 172.21.15.46:0/4277708977' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-19T18:51:46.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:45 smithi046 ceph-mon[29279]: from='client.? 172.21.15.46:0/4277708977' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-19T18:51:46.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:51:46.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-02-19T18:51:46.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:51:46.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-02-19T18:51:46.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-19T18:51:46.227 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-19T18:51:46.228 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.537+0000 7fdd1f151700 1 Processor -- start 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.537+0000 7fdd1f151700 1 -- start start 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.537+0000 7fdd1f151700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.537+0000 7fdd1f151700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18106310 con 0x7fdd181059c0 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.538+0000 7fdd1ceed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.538+0000 7fdd1ceed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34042/0 (socket says 172.21.15.46:34042) 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.538+0000 7fdd1ceed700 1 -- 172.21.15.46:0/637183942 learned_addr learned my addr 172.21.15.46:0/637183942 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.538+0000 7fdd1ceed700 1 -- 172.21.15.46:0/637183942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18106450 con 0x7fdd181059c0 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.538+0000 7fdd1ceed700 1 --2- 172.21.15.46:0/637183942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdd080098a0 tx=0x7fdd08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd412d898f28df8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.538+0000 7fdd177fe700 1 -- 172.21.15.46:0/637183942 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd08004180 con 0x7fdd181059c0 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.538+0000 7fdd177fe700 1 -- 172.21.15.46:0/637183942 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd080042e0 con 0x7fdd181059c0 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.538+0000 7fdd177fe700 1 -- 172.21.15.46:0/637183942 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd080036a0 con 0x7fdd181059c0 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.539+0000 7fdd1f151700 1 -- 172.21.15.46:0/637183942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 msgr2=0x7fdd18105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.539+0000 7fdd1f151700 1 --2- 172.21.15.46:0/637183942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdd080098a0 tx=0x7fdd08009bb0 comp rx=0 tx=0).stop 2024-02-19T18:51:46.229 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.539+0000 7fdd1f151700 1 -- 172.21.15.46:0/637183942 shutdown_connections 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.539+0000 7fdd1f151700 1 --2- 172.21.15.46:0/637183942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18105dd0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.539+0000 7fdd1f151700 1 -- 172.21.15.46:0/637183942 >> 172.21.15.46:0/637183942 conn(0x7fdd18100ff0 msgr2=0x7fdd18103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.539+0000 7fdd1f151700 1 -- 172.21.15.46:0/637183942 shutdown_connections 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.539+0000 7fdd1f151700 1 -- 172.21.15.46:0/637183942 wait complete. 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.540+0000 7fdd1f151700 1 Processor -- start 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.540+0000 7fdd1f151700 1 -- start start 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.540+0000 7fdd1f151700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.540+0000 7fdd1f151700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181993c0 con 0x7fdd181059c0 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.540+0000 7fdd1ceed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.540+0000 7fdd1ceed700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34052/0 (socket says 172.21.15.46:34052) 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.540+0000 7fdd1ceed700 1 -- 172.21.15.46:0/4277708977 learned_addr learned my addr 172.21.15.46:0/4277708977 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.540+0000 7fdd1ceed700 1 -- 172.21.15.46:0/4277708977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08009550 con 0x7fdd181059c0 2024-02-19T18:51:46.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.540+0000 7fdd1ceed700 1 --2- 172.21.15.46:0/4277708977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18198e80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdd181066f0 tx=0x7fdd08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.541+0000 7fdd15ffb700 1 -- 172.21.15.46:0/4277708977 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd08003ce0 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.541+0000 7fdd15ffb700 1 -- 172.21.15.46:0/4277708977 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd08020070 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.541+0000 7fdd1f151700 1 -- 172.21.15.46:0/4277708977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd181995c0 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.541+0000 7fdd15ffb700 1 -- 172.21.15.46:0/4277708977 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd08011630 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.541+0000 7fdd1f151700 1 -- 172.21.15.46:0/4277708977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd18199a60 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.541+0000 7fdd15ffb700 1 -- 172.21.15.46:0/4277708977 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdd08022030 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.541+0000 7fdd15ffb700 1 -- 172.21.15.46:0/4277708977 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdd08025d40 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.542+0000 7fdd1f151700 1 -- 172.21.15.46:0/4277708977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd18192650 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.544+0000 7fdd15ffb700 1 -- 172.21.15.46:0/4277708977 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fdd08025480 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.615+0000 7fdd1f151700 1 -- 172.21.15.46:0/4277708977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdd18062380 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.619+0000 7fdd15ffb700 1 -- 172.21.15.46:0/4277708977 <== mon.0 v2:172.21.15.46:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdd08011bd0 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.619+0000 7fdd15ffb700 1 -- 172.21.15.46:0/4277708977 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fdd08037590 con 0x7fdd181059c0 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.620+0000 7fdd1f151700 1 -- 172.21.15.46:0/4277708977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 msgr2=0x7fdd18198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:46.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.620+0000 7fdd1f151700 1 --2- 172.21.15.46:0/4277708977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18198e80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdd181066f0 tx=0x7fdd08004750 comp rx=0 tx=0).stop 2024-02-19T18:51:46.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.620+0000 7fdd1f151700 1 -- 172.21.15.46:0/4277708977 shutdown_connections 2024-02-19T18:51:46.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.620+0000 7fdd1f151700 1 --2- 172.21.15.46:0/4277708977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd181059c0 0x7fdd18198e80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:46.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.620+0000 7fdd1f151700 1 -- 172.21.15.46:0/4277708977 >> 172.21.15.46:0/4277708977 conn(0x7fdd18100ff0 msgr2=0x7fdd1818d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:46.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.620+0000 7fdd1f151700 1 -- 172.21.15.46:0/4277708977 shutdown_connections 2024-02-19T18:51:46.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:45.620+0000 7fdd1f151700 1 -- 172.21.15.46:0/4277708977 wait complete. 2024-02-19T18:51:46.232 INFO:teuthology.orchestra.run.smithi046.stdout:Generating new minimal ceph.conf... 2024-02-19T18:51:46.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:46 smithi046 ceph-mon[29279]: from='client.? 172.21.15.46:0/2423698092' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:51:48.240 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.632+0000 7f3fe692b700 1 Processor -- start 2024-02-19T18:51:48.240 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.632+0000 7f3fe692b700 1 -- start start 2024-02-19T18:51:48.240 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.632+0000 7f3fe692b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe00791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:48.240 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.633+0000 7f3fe692b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00796e0 con 0x7f3fe007aca0 2024-02-19T18:51:48.240 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.633+0000 7f3fdffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe00791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:48.240 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.633+0000 7f3fdffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe00791a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34056/0 (socket says 172.21.15.46:34056) 2024-02-19T18:51:48.240 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.633+0000 7f3fdffff700 1 -- 172.21.15.46:0/2160739199 learned_addr learned my addr 172.21.15.46:0/2160739199 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:48.240 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.633+0000 7f3fdffff700 1 -- 172.21.15.46:0/2160739199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0079820 con 0x7f3fe007aca0 2024-02-19T18:51:48.240 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.633+0000 7f3fdffff700 1 --2- 172.21.15.46:0/2160739199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe00791a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00098a0 tx=0x7f3fd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27920453286e722 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.633+0000 7f3fdeffd700 1 -- 172.21.15.46:0/2160739199 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fd0004180 con 0x7f3fe007aca0 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.633+0000 7f3fdeffd700 1 -- 172.21.15.46:0/2160739199 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3fd00042e0 con 0x7f3fe007aca0 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.633+0000 7f3fdeffd700 1 -- 172.21.15.46:0/2160739199 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fd0011a50 con 0x7f3fe007aca0 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.634+0000 7f3fe692b700 1 -- 172.21.15.46:0/2160739199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 msgr2=0x7f3fe00791a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.634+0000 7f3fe692b700 1 --2- 172.21.15.46:0/2160739199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe00791a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00098a0 tx=0x7f3fd0009bb0 comp rx=0 tx=0).stop 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.634+0000 7f3fe692b700 1 -- 172.21.15.46:0/2160739199 shutdown_connections 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.634+0000 7f3fe692b700 1 --2- 172.21.15.46:0/2160739199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe00791a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.634+0000 7f3fe692b700 1 -- 172.21.15.46:0/2160739199 >> 172.21.15.46:0/2160739199 conn(0x7f3fe0100fd0 msgr2=0x7f3fe0103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.634+0000 7f3fe692b700 1 -- 172.21.15.46:0/2160739199 shutdown_connections 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.634+0000 7f3fe692b700 1 -- 172.21.15.46:0/2160739199 wait complete. 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.634+0000 7f3fe692b700 1 Processor -- start 2024-02-19T18:51:48.241 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.634+0000 7f3fe692b700 1 -- start start 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fe692b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fe692b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe019bec0 con 0x7f3fe007aca0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fdffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fdffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe019b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34064/0 (socket says 172.21.15.46:34064) 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fdffff700 1 -- 172.21.15.46:0/2423698092 learned_addr learned my addr 172.21.15.46:0/2423698092 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fdffff700 1 -- 172.21.15.46:0/2423698092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0009550 con 0x7f3fe007aca0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fdffff700 1 --2- 172.21.15.46:0/2423698092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe019b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009520 tx=0x7f3fd00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fdd7fa700 1 -- 172.21.15.46:0/2423698092 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fd0003a00 con 0x7f3fe007aca0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fdd7fa700 1 -- 172.21.15.46:0/2423698092 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3fd0003b60 con 0x7f3fe007aca0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fe692b700 1 -- 172.21.15.46:0/2423698092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe019c0c0 con 0x7f3fe007aca0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fdd7fa700 1 -- 172.21.15.46:0/2423698092 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fd00196e0 con 0x7f3fe007aca0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.635+0000 7f3fe692b700 1 -- 172.21.15.46:0/2423698092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe019c560 con 0x7f3fe007aca0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.636+0000 7f3fdd7fa700 1 -- 172.21.15.46:0/2423698092 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3fd0019c50 con 0x7f3fe007aca0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.636+0000 7f3fdd7fa700 1 -- 172.21.15.46:0/2423698092 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3fd0024730 con 0x7f3fe007aca0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.636+0000 7f3fe692b700 1 -- 172.21.15.46:0/2423698092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe0062380 con 0x7f3fe007aca0 2024-02-19T18:51:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.639+0000 7f3fdd7fa700 1 -- 172.21.15.46:0/2423698092 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f3fd001ab30 con 0x7f3fe007aca0 2024-02-19T18:51:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.710+0000 7f3fe692b700 1 -- 172.21.15.46:0/2423698092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3fe019ef20 con 0x7f3fe007aca0 2024-02-19T18:51:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.711+0000 7f3fdd7fa700 1 -- 172.21.15.46:0/2423698092 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f3fd0024990 con 0x7f3fe007aca0 2024-02-19T18:51:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.711+0000 7f3fe692b700 1 -- 172.21.15.46:0/2423698092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 msgr2=0x7f3fe019b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.711+0000 7f3fe692b700 1 --2- 172.21.15.46:0/2423698092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe019b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009520 tx=0x7f3fd00047c0 comp rx=0 tx=0).stop 2024-02-19T18:51:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.712+0000 7f3fe692b700 1 -- 172.21.15.46:0/2423698092 shutdown_connections 2024-02-19T18:51:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.712+0000 7f3fe692b700 1 --2- 172.21.15.46:0/2423698092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fe007aca0 0x7f3fe019b980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.712+0000 7f3fe692b700 1 -- 172.21.15.46:0/2423698092 >> 172.21.15.46:0/2423698092 conn(0x7f3fe0100fd0 msgr2=0x7f3fe01026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.712+0000 7f3fe692b700 1 -- 172.21.15.46:0/2423698092 shutdown_connections 2024-02-19T18:51:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:46.712+0000 7f3fe692b700 1 -- 172.21.15.46:0/2423698092 wait complete. 2024-02-19T18:51:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:Restarting the monitor... 2024-02-19T18:51:48.510 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:48 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T18:51:48.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:48 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046[29275]: 2024-02-19T18:51:48.494+0000 7f89535b2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T18:51:48.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:48 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046[29275]: 2024-02-19T18:51:48.494+0000 7f89535b2700 -1 mon.smithi046@0(leader) e1 *** Got Signal Terminated *** 2024-02-19T18:51:48.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:48 smithi046 podman[29522]: 2024-02-19 18:51:48.730184373 +0000 UTC m=+0.341030159 container died 0637eaaa0740c6f103b2451e24ff2032df47d2a67a49341d4fe92ca173adb924 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=HEAD, io.buildah.version=1.29.1) 2024-02-19T18:51:49.252 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 podman[29522]: 2024-02-19 18:51:49.053009719 +0000 UTC m=+0.663855554 container cleanup 0637eaaa0740c6f103b2451e24ff2032df47d2a67a49341d4fe92ca173adb924 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux ) 2024-02-19T18:51:49.252 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 bash[29522]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046 2024-02-19T18:51:49.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 podman[29536]: 2024-02-19 18:51:49.237234107 +0000 UTC m=+0.508144575 container remove 0637eaaa0740c6f103b2451e24ff2032df47d2a67a49341d4fe92ca173adb924 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.29.1) 2024-02-19T18:51:49.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046.service: Deactivated successfully. 2024-02-19T18:51:49.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 systemd[1]: Stopped Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T18:51:49.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 systemd[1]: Starting Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T18:51:49.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 podman[29629]: 2024-02-19 18:51:49.602292559 +0000 UTC m=+0.017314854 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-02-19T18:51:49.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 podman[29629]: 2024-02-19 18:51:49.70490095 +0000 UTC m=+0.119923242 container create adb8243bd11cd1ee476ca98fae6e94f4cda69e8b6f8843985db2662054078170 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212) 2024-02-19T18:51:50.018 INFO:teuthology.orchestra.run.smithi046.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-19T18:51:50.131 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 podman[29629]: 2024-02-19 18:51:49.915751997 +0000 UTC m=+0.330774308 container init adb8243bd11cd1ee476ca98fae6e94f4cda69e8b6f8843985db2662054078170 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, RELEASE=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-02-19T18:51:50.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 podman[29629]: 2024-02-19 18:51:49.918857085 +0000 UTC m=+0.333879378 container start adb8243bd11cd1ee476ca98fae6e94f4cda69e8b6f8843985db2662054078170 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-19T18:51:50.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: set uid:gid to 167:167 (ceph:ceph) 2024-02-19T18:51:50.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-02-19T18:51:50.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: pidfile_write: ignore empty --pid-file 2024-02-19T18:51:50.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: load: jerasure load: lrc 2024-02-19T18:51:50.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: RocksDB version: 7.9.2 2024-02-19T18:51:50.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Git sha 0 2024-02-19T18:51:50.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Compile date 2023-08-03 19:21:13 2024-02-19T18:51:50.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: DB SUMMARY 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: DB Session ID: HFEP1ES40KQYQUCR0ERR 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: CURRENT file: CURRENT 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: IDENTITY file: IDENTITY 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi046/store.db dir, Total Num: 1, files: 000008.sst 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi046/store.db: 000009.log size: 97396 ; 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.error_if_exists: 0 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.create_if_missing: 0 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.paranoid_checks: 1 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-19T18:51:50.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.env: 0x56451e674720 2024-02-19T18:51:50.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.fs: PosixFileSystem 2024-02-19T18:51:50.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.info_log: 0x5645215dd2c0 2024-02-19T18:51:50.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_file_opening_threads: 16 2024-02-19T18:51:50.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.statistics: (nil) 2024-02-19T18:51:50.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.use_fsync: 0 2024-02-19T18:51:50.135 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_log_file_size: 0 2024-02-19T18:51:50.135 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T18:51:50.135 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T18:51:50.135 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.keep_log_file_num: 1000 2024-02-19T18:51:50.135 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.recycle_log_file_num: 0 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.allow_fallocate: 1 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.allow_mmap_reads: 0 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.allow_mmap_writes: 0 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.use_direct_reads: 0 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.create_missing_column_families: 0 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.db_log_dir: 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.wal_dir: 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T18:51:50.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.advise_random_on_open: 1 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.db_write_buffer_size: 0 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.write_buffer_manager: 0x56452084e3c0 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.rate_limiter: (nil) 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.wal_recovery_mode: 2 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.enable_thread_tracking: 0 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.enable_pipelined_write: 0 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.unordered_write: 0 2024-02-19T18:51:50.137 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.row_cache: None 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.wal_filter: None 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.allow_ingest_behind: 0 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.two_write_queues: 0 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.manual_wal_flush: 0 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.wal_compression: 0 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.atomic_flush: 0 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T18:51:50.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.log_readahead_size: 0 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.best_efforts_recovery: 0 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.allow_data_in_errors: 0 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.db_host_id: __hostname__ 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_background_jobs: 2 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_background_compactions: -1 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_subcompactions: 1 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T18:51:50.139 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_total_wal_size: 0 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_open_files: -1 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bytes_per_sync: 0 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_readahead_size: 0 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_background_flushes: -1 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Compression algorithms supported: 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: kZSTD supported: 0 2024-02-19T18:51:50.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: kXpressCompression supported: 0 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: kLZ4HCCompression supported: 1 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: kZlibCompression supported: 1 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: kSnappyCompression supported: 1 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: kLZ4Compression supported: 1 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: kBZip2Compression supported: 0 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000010 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.merge_operator: 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_filter: None 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_filter_factory: None 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.sst_partitioner_factory: None 2024-02-19T18:51:50.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5645215dd3c0) 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks: 1 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_top_level_index_and_filter: 1 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_type: 0 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_index_type: 0 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_shortening: 1 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: checksum: 4 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: no_block_cache: 0 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache: 0x5645208ef350 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_name: BinnedLRUCache 2024-02-19T18:51:50.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_options: 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: capacity : 536870912 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_shard_bits : 4 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: strict_capacity_limit : 0 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: high_pri_pool_ratio: 0.000 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_compressed: (nil) 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: persistent_cache: (nil) 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size: 4096 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size_deviation: 10 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_restart_interval: 16 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_block_restart_interval: 1 2024-02-19T18:51:50.143 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: metadata_block_size: 4096 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: partition_filters: 0 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: use_delta_encoding: 1 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: filter_policy: bloomfilter 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: whole_key_filtering: 1 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: verify_compression: 0 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: read_amp_bytes_per_bit: 0 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: format_version: 5 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_index_compression: 1 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_align: 0 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_auto_readahead_size: 262144 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: prepopulate_block_cache: 0 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: initial_auto_readahead_size: 8192 2024-02-19T18:51:50.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_file_reads_for_auto_readahead: 2 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.write_buffer_size: 33554432 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_write_buffer_number: 2 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compression: NoCompression 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bottommost_compression: Disabled 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.prefix_extractor: nullptr 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.num_levels: 7 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T18:51:50.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compression_opts.level: 32767 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compression_opts.strategy: 0 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compression_opts.enabled: false 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-19T18:51:50.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.target_file_size_base: 67108864 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T18:51:50.147 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.arena_block_size: 1048576 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.disable_auto_compactions: 0 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T18:51:50.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.table_properties_collectors: 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.inplace_update_support: 0 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.bloom_locality: 0 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.max_successive_merges: 0 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.paranoid_file_checks: 0 2024-02-19T18:51:50.149 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.force_consistency_checks: 1 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.report_bg_io_stats: 0 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.ttl: 2592000 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.enable_blob_files: false 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.min_blob_size: 0 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.blob_file_size: 268435456 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-19T18:51:50.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.blob_file_starting_level: 0 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 54d4c747-ce59-4d51-8e89-5318704cd6a8 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708368709947665, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708368709949224, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92746, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 310, "table_properties": {"data_size": 90763, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13356, "raw_average_key_size": 49, "raw_value_size": 83478, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 269, "num_filter_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708368709, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "54d4c747-ce59-4d51-8e89-5318704cd6a8", "db_session_id": "HFEP1ES40KQYQUCR0ERR", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708368709949305, "job": 1, "event": "recovery_finished"} 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi046/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56452098c000 2024-02-19T18:51:50.151 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: DB pointer 0x564520978000 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** DB Stats ** 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T18:51:50.152 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L0 2/0 92.45 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 108.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Sum 2/0 92.45 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 108.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 108.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 108.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-19T18:51:50.153 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative compaction: 0.00 GB write, 19.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval compaction: 0.00 GB write, 19.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache BinnedLRUCache@0x5645208ef350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-19T18:51:50.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: starting mon.smithi046 rank 0 at public addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] at bind addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi046 fsid c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: mon.smithi046@-1(???) e1 preinit fsid c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: mon.smithi046@-1(???).mds e1 new map 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: mon.smithi046@-1(???).mds e1 print_map 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: e1 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: legacy client fscid: -1 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: No filesystems configured 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: mon.smithi046@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: mon.smithi046@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-19T18:51:50.155 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta expand map: {default=false} 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta from 'false' to 'false' 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta expanded map: {default=false} 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta expand map: {default=info} 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta from 'info' to 'info' 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta expanded map: {default=info} 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta expand map: {default=daemon} 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta from 'daemon' to 'daemon' 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta expanded map: {default=daemon} 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta expand map: {default=debug} 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta from 'debug' to 'debug' 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 ceph-mon[29647]: expand_channel_meta expanded map: {default=debug} 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:49 smithi046 bash[29629]: adb8243bd11cd1ee476ca98fae6e94f4cda69e8b6f8843985db2662054078170 2024-02-19T18:51:50.156 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:50 smithi046 systemd[1]: Started Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T18:51:51.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.430+0000 7f256eb68700 1 Processor -- start 2024-02-19T18:51:51.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.430+0000 7f256eb68700 1 -- start start 2024-02-19T18:51:51.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.430+0000 7f256eb68700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568108910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:51.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.430+0000 7f256eb68700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680744d0 con 0x7f2568106530 2024-02-19T18:51:51.107 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.431+0000 7f256c904700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568108910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:51.108 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.431+0000 7f256c904700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568108910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34806/0 (socket says 172.21.15.46:34806) 2024-02-19T18:51:51.108 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.431+0000 7f256c904700 1 -- 172.21.15.46:0/3766548070 learned_addr learned my addr 172.21.15.46:0/3766548070 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:51.108 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.431+0000 7f256c904700 1 -- 172.21.15.46:0/3766548070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568074610 con 0x7f2568106530 2024-02-19T18:51:51.108 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.431+0000 7f256c904700 1 --2- 172.21.15.46:0/3766548070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568108910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2560009e80 tx=0x7f256000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e29113e9bb454ee server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:51.108 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.431+0000 7f25677fe700 1 -- 172.21.15.46:0/3766548070 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f256000e070 con 0x7f2568106530 2024-02-19T18:51:51.109 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.431+0000 7f25677fe700 1 -- 172.21.15.46:0/3766548070 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2560003e90 con 0x7f2568106530 2024-02-19T18:51:51.109 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.431+0000 7f25677fe700 1 -- 172.21.15.46:0/3766548070 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2560004380 con 0x7f2568106530 2024-02-19T18:51:51.109 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.432+0000 7f256eb68700 1 -- 172.21.15.46:0/3766548070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 msgr2=0x7f2568108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:51.109 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.432+0000 7f256eb68700 1 --2- 172.21.15.46:0/3766548070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568108910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2560009e80 tx=0x7f256000b330 comp rx=0 tx=0).stop 2024-02-19T18:51:51.109 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.432+0000 7f256eb68700 1 -- 172.21.15.46:0/3766548070 shutdown_connections 2024-02-19T18:51:51.109 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.432+0000 7f256eb68700 1 --2- 172.21.15.46:0/3766548070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568108910 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:51.110 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.432+0000 7f256eb68700 1 -- 172.21.15.46:0/3766548070 >> 172.21.15.46:0/3766548070 conn(0x7f25680fff10 msgr2=0x7f2568102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:51.110 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.432+0000 7f256eb68700 1 -- 172.21.15.46:0/3766548070 shutdown_connections 2024-02-19T18:51:51.110 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.432+0000 7f256eb68700 1 -- 172.21.15.46:0/3766548070 wait complete. 2024-02-19T18:51:51.110 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.433+0000 7f256eb68700 1 Processor -- start 2024-02-19T18:51:51.110 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.433+0000 7f256eb68700 1 -- start start 2024-02-19T18:51:51.110 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.433+0000 7f256eb68700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:51.111 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.433+0000 7f256eb68700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25681063d0 con 0x7f2568106530 2024-02-19T18:51:51.111 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.433+0000 7f256c904700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:51.111 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.433+0000 7f256c904700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568105e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34814/0 (socket says 172.21.15.46:34814) 2024-02-19T18:51:51.111 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.433+0000 7f256c904700 1 -- 172.21.15.46:0/3712171594 learned_addr learned my addr 172.21.15.46:0/3712171594 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:51.111 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.433+0000 7f256c904700 1 -- 172.21.15.46:0/3712171594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009b30 con 0x7f2568106530 2024-02-19T18:51:51.111 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.433+0000 7f256c904700 1 --2- 172.21.15.46:0/3712171594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568105e90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f25600072a0 tx=0x7f2560004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:51.112 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.434+0000 7f2565ffb700 1 -- 172.21.15.46:0/3712171594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f256000e040 con 0x7f2568106530 2024-02-19T18:51:51.112 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.434+0000 7f2565ffb700 1 -- 172.21.15.46:0/3712171594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2560003cb0 con 0x7f2568106530 2024-02-19T18:51:51.112 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.434+0000 7f256eb68700 1 -- 172.21.15.46:0/3712171594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25681044e0 con 0x7f2568106530 2024-02-19T18:51:51.112 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.434+0000 7f2565ffb700 1 -- 172.21.15.46:0/3712171594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f256001b7e0 con 0x7f2568106530 2024-02-19T18:51:51.112 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.434+0000 7f256eb68700 1 -- 172.21.15.46:0/3712171594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25681049e0 con 0x7f2568106530 2024-02-19T18:51:51.112 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.434+0000 7f2565ffb700 1 -- 172.21.15.46:0/3712171594 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2560019040 con 0x7f2568106530 2024-02-19T18:51:51.113 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.434+0000 7f2565ffb700 1 -- 172.21.15.46:0/3712171594 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f256001a6d0 con 0x7f2568106530 2024-02-19T18:51:51.113 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.435+0000 7f256eb68700 1 -- 172.21.15.46:0/3712171594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2568109a10 con 0x7f2568106530 2024-02-19T18:51:51.113 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.437+0000 7f2565ffb700 1 -- 172.21.15.46:0/3712171594 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f2560029060 con 0x7f2568106530 2024-02-19T18:51:51.113 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.508+0000 7f256eb68700 1 -- 172.21.15.46:0/3712171594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f256819f6d0 con 0x7f2568106530 2024-02-19T18:51:51.113 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.510+0000 7f2565ffb700 1 -- 172.21.15.46:0/3712171594 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f256001f070 con 0x7f2568106530 2024-02-19T18:51:51.113 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.511+0000 7f256eb68700 1 -- 172.21.15.46:0/3712171594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 msgr2=0x7f2568105e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:51.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.511+0000 7f256eb68700 1 --2- 172.21.15.46:0/3712171594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568105e90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f25600072a0 tx=0x7f2560004430 comp rx=0 tx=0).stop 2024-02-19T18:51:51.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.511+0000 7f256eb68700 1 -- 172.21.15.46:0/3712171594 shutdown_connections 2024-02-19T18:51:51.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.511+0000 7f256eb68700 1 --2- 172.21.15.46:0/3712171594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2568106530 0x7f2568105e90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:51.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.511+0000 7f256eb68700 1 -- 172.21.15.46:0/3712171594 >> 172.21.15.46:0/3712171594 conn(0x7f25680fff10 msgr2=0x7f2568100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:51.114 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.511+0000 7f256eb68700 1 -- 172.21.15.46:0/3712171594 shutdown_connections 2024-02-19T18:51:51.115 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:50.511+0000 7f256eb68700 1 -- 172.21.15.46:0/3712171594 wait complete. 2024-02-19T18:51:51.115 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-19T18:51:51.120 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-19T18:51:51.120 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mgr... 2024-02-19T18:51:51.121 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:9283 ... 2024-02-19T18:51:51.121 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:8765 ... 2024-02-19T18:51:51.121 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:8443 ... 2024-02-19T18:51:51.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:50 smithi046 ceph-mon[29647]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-02-19T18:51:51.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:50 smithi046 ceph-mon[29647]: monmap e1: 1 mons at {smithi046=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0]} removed_ranks: {} 2024-02-19T18:51:51.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:50 smithi046 ceph-mon[29647]: fsmap 2024-02-19T18:51:51.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:50 smithi046 ceph-mon[29647]: osdmap e1: 0 total, 0 up, 0 in 2024-02-19T18:51:51.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:50 smithi046 ceph-mon[29647]: mgrmap e1: no daemons active 2024-02-19T18:51:51.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:50 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3712171594' entity='client.admin' 2024-02-19T18:51:51.372 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mgr.smithi046.qtceex 2024-02-19T18:51:51.372 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mgr.smithi046.qtceex.service: Unit ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mgr.smithi046.qtceex.service not loaded. 2024-02-19T18:51:51.517 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c412ec66-cf57-11ee-95bb-87774f69a715.target.wants/ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mgr.smithi046.qtceex.service → /etc/systemd/system/ceph-c412ec66-cf57-11ee-95bb-87774f69a715@.service. 2024-02-19T18:51:52.096 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-19T18:51:52.097 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-02-19T18:51:52.103 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-19T18:51:52.103 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-02-19T18:51:52.103 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-02-19T18:51:52.103 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-02-19T18:51:52.111 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-19T18:51:52.111 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-02-19T18:51:52.118 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-19T18:51:52.118 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-02-19T18:51:52.118 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-02-19T18:51:52.118 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-02-19T18:51:52.118 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr to start... 2024-02-19T18:51:52.118 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr... 2024-02-19T18:51:52.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:52 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1490460233' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T18:51:53.428 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:51:53.428 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:51:53.428 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "c412ec66-cf57-11ee-95bb-87774f69a715", 2024-02-19T18:51:53.428 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:53.429 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-19T18:51:53.430 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-19T18:51:53.430 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:53.430 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-19T18:51:53.430 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:53.430 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-19T18:51:53.430 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-19T18:51:53.430 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-19T18:51:53.438 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-19T18:51:53.439 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-02-19T18:51:43.710862+0000", 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.538+0000 7f21378f7700 1 Processor -- start 2024-02-19T18:51:53.440 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.538+0000 7f21378f7700 1 -- start start 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.538+0000 7f21378f7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130108930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.538+0000 7f21378f7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21300744b0 con 0x7f2130106550 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.538+0000 7f2135693700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130108930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.538+0000 7f2135693700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130108930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34838/0 (socket says 172.21.15.46:34838) 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.538+0000 7f2135693700 1 -- 172.21.15.46:0/147388008 learned_addr learned my addr 172.21.15.46:0/147388008 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.539+0000 7f2135693700 1 -- 172.21.15.46:0/147388008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21300745f0 con 0x7f2130106550 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.539+0000 7f2135693700 1 --2- 172.21.15.46:0/147388008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130108930 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f212c0098a0 tx=0x7f212c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bd75f674245253 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.539+0000 7f2127fff700 1 -- 172.21.15.46:0/147388008 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f212c004180 con 0x7f2130106550 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.539+0000 7f2127fff700 1 -- 172.21.15.46:0/147388008 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f212c0042e0 con 0x7f2130106550 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.539+0000 7f2127fff700 1 -- 172.21.15.46:0/147388008 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f212c011a50 con 0x7f2130106550 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.540+0000 7f21378f7700 1 -- 172.21.15.46:0/147388008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 msgr2=0x7f2130108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.540+0000 7f21378f7700 1 --2- 172.21.15.46:0/147388008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130108930 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f212c0098a0 tx=0x7f212c009bb0 comp rx=0 tx=0).stop 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.540+0000 7f21378f7700 1 -- 172.21.15.46:0/147388008 shutdown_connections 2024-02-19T18:51:53.441 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.540+0000 7f21378f7700 1 --2- 172.21.15.46:0/147388008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130108930 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.540+0000 7f21378f7700 1 -- 172.21.15.46:0/147388008 >> 172.21.15.46:0/147388008 conn(0x7f21300fff10 msgr2=0x7f2130102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.540+0000 7f21378f7700 1 -- 172.21.15.46:0/147388008 shutdown_connections 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.540+0000 7f21378f7700 1 -- 172.21.15.46:0/147388008 wait complete. 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.540+0000 7f21378f7700 1 Processor -- start 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.540+0000 7f21378f7700 1 -- start start 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f21378f7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f21378f7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21301063f0 con 0x7f2130106550 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f2135693700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f2135693700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34846/0 (socket says 172.21.15.46:34846) 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f2135693700 1 -- 172.21.15.46:0/1490460233 learned_addr learned my addr 172.21.15.46:0/1490460233 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f2135693700 1 -- 172.21.15.46:0/1490460233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c009550 con 0x7f2130106550 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f2135693700 1 --2- 172.21.15.46:0/1490460233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130105eb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f212c003de0 tx=0x7f212c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f21267fc700 1 -- 172.21.15.46:0/1490460233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f212c003930 con 0x7f2130106550 2024-02-19T18:51:53.442 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f21267fc700 1 -- 172.21.15.46:0/1490460233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f212c003a90 con 0x7f2130106550 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f21378f7700 1 -- 172.21.15.46:0/1490460233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2130104500 con 0x7f2130106550 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f21267fc700 1 -- 172.21.15.46:0/1490460233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f212c0196c0 con 0x7f2130106550 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.541+0000 7f21378f7700 1 -- 172.21.15.46:0/1490460233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21301049a0 con 0x7f2130106550 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.542+0000 7f21267fc700 1 -- 172.21.15.46:0/1490460233 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f212c019c70 con 0x7f2130106550 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.542+0000 7f21267fc700 1 -- 172.21.15.46:0/1490460233 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f212c02c3a0 con 0x7f2130106550 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.542+0000 7f21378f7700 1 -- 172.21.15.46:0/1490460233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2130109a60 con 0x7f2130106550 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.545+0000 7f21267fc700 1 -- 172.21.15.46:0/1490460233 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f212c01abc0 con 0x7f2130106550 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.619+0000 7f21378f7700 1 -- 172.21.15.46:0/1490460233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2130109c80 con 0x7f2130106550 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.620+0000 7f21267fc700 1 -- 172.21.15.46:0/1490460233 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f212c01a430 con 0x7f2130106550 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.621+0000 7f21378f7700 1 -- 172.21.15.46:0/1490460233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 msgr2=0x7f2130105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.621+0000 7f21378f7700 1 --2- 172.21.15.46:0/1490460233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130105eb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f212c003de0 tx=0x7f212c011ab0 comp rx=0 tx=0).stop 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.621+0000 7f21378f7700 1 -- 172.21.15.46:0/1490460233 shutdown_connections 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.621+0000 7f21378f7700 1 --2- 172.21.15.46:0/1490460233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2130106550 0x7f2130105eb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:53.443 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.621+0000 7f21378f7700 1 -- 172.21.15.46:0/1490460233 >> 172.21.15.46:0/1490460233 conn(0x7f21300fff10 msgr2=0x7f2130101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:53.444 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.621+0000 7f21378f7700 1 -- 172.21.15.46:0/1490460233 shutdown_connections 2024-02-19T18:51:53.444 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:52.621+0000 7f21378f7700 1 -- 172.21.15.46:0/1490460233 wait complete. 2024-02-19T18:51:53.444 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (1/15)... 2024-02-19T18:51:56.044 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:55 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3184908766' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T18:51:56.559 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "c412ec66-cf57-11ee-95bb-87774f69a715", 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:51:56.560 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-19T18:51:56.561 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-19T18:51:56.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-19T18:51:56.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-19T18:51:56.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-19T18:51:56.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:56.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-19T18:51:56.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-19T18:51:56.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-19T18:51:56.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-19T18:51:56.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-19T18:51:56.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-19T18:51:56.570 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-02-19T18:51:43.710862+0000", 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.848+0000 7fb72f287700 1 Processor -- start 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.848+0000 7fb72f287700 1 -- start start 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.848+0000 7fb72f287700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb728106340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:56.571 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.848+0000 7fb72f287700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb728106880 con 0x7fb728105f30 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.849+0000 7fb72d023700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb728106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.849+0000 7fb72d023700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb728106340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34862/0 (socket says 172.21.15.46:34862) 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.849+0000 7fb72d023700 1 -- 172.21.15.46:0/3391866900 learned_addr learned my addr 172.21.15.46:0/3391866900 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.849+0000 7fb72d023700 1 -- 172.21.15.46:0/3391866900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7281069c0 con 0x7fb728105f30 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.849+0000 7fb72d023700 1 --2- 172.21.15.46:0/3391866900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb728106340 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb7240098a0 tx=0x7fb724009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26340218281b8d6c server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.849+0000 7fb71ffff700 1 -- 172.21.15.46:0/3391866900 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb724004180 con 0x7fb728105f30 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.849+0000 7fb71ffff700 1 -- 172.21.15.46:0/3391866900 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb7240042e0 con 0x7fb728105f30 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.849+0000 7fb71ffff700 1 -- 172.21.15.46:0/3391866900 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb724011a50 con 0x7fb728105f30 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.850+0000 7fb72f287700 1 -- 172.21.15.46:0/3391866900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 msgr2=0x7fb728106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.850+0000 7fb72f287700 1 --2- 172.21.15.46:0/3391866900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb728106340 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb7240098a0 tx=0x7fb724009bb0 comp rx=0 tx=0).stop 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.850+0000 7fb72f287700 1 -- 172.21.15.46:0/3391866900 shutdown_connections 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.850+0000 7fb72f287700 1 --2- 172.21.15.46:0/3391866900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb728106340 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.850+0000 7fb72f287700 1 -- 172.21.15.46:0/3391866900 >> 172.21.15.46:0/3391866900 conn(0x7fb7280ff670 msgr2=0x7fb728101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:56.572 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.850+0000 7fb72f287700 1 -- 172.21.15.46:0/3391866900 shutdown_connections 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.850+0000 7fb72f287700 1 -- 172.21.15.46:0/3391866900 wait complete. 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.851+0000 7fb72f287700 1 Processor -- start 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.851+0000 7fb72f287700 1 -- start start 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.851+0000 7fb72f287700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb72819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.851+0000 7fb72f287700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72819bea0 con 0x7fb728105f30 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.851+0000 7fb72d023700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb72819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.851+0000 7fb72d023700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb72819b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34870/0 (socket says 172.21.15.46:34870) 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.851+0000 7fb72d023700 1 -- 172.21.15.46:0/3184908766 learned_addr learned my addr 172.21.15.46:0/3184908766 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.851+0000 7fb72d023700 1 -- 172.21.15.46:0/3184908766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb724009550 con 0x7fb728105f30 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.852+0000 7fb72d023700 1 --2- 172.21.15.46:0/3184908766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb72819b960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb724003f80 tx=0x7fb724011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.852+0000 7fb71e7fc700 1 -- 172.21.15.46:0/3184908766 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb724003a80 con 0x7fb728105f30 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.852+0000 7fb72f287700 1 -- 172.21.15.46:0/3184908766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72819c0a0 con 0x7fb728105f30 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.852+0000 7fb72f287700 1 -- 172.21.15.46:0/3184908766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72819c540 con 0x7fb728105f30 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.852+0000 7fb71e7fc700 1 -- 172.21.15.46:0/3184908766 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb724003be0 con 0x7fb728105f30 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.852+0000 7fb71e7fc700 1 -- 172.21.15.46:0/3184908766 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb724019820 con 0x7fb728105f30 2024-02-19T18:51:56.573 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.852+0000 7fb71e7fc700 1 -- 172.21.15.46:0/3184908766 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb72402d440 con 0x7fb728105f30 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.852+0000 7fb71e7fc700 1 -- 172.21.15.46:0/3184908766 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb724024820 con 0x7fb728105f30 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.853+0000 7fb72f287700 1 -- 172.21.15.46:0/3184908766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70c005320 con 0x7fb728105f30 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.855+0000 7fb71e7fc700 1 -- 172.21.15.46:0/3184908766 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb72401acc0 con 0x7fb728105f30 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.930+0000 7fb72f287700 1 -- 172.21.15.46:0/3184908766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb70c005cc0 con 0x7fb728105f30 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.931+0000 7fb71e7fc700 1 -- 172.21.15.46:0/3184908766 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fb724024a80 con 0x7fb728105f30 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.932+0000 7fb72f287700 1 -- 172.21.15.46:0/3184908766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 msgr2=0x7fb72819b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.932+0000 7fb72f287700 1 --2- 172.21.15.46:0/3184908766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb72819b960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb724003f80 tx=0x7fb724011ab0 comp rx=0 tx=0).stop 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.932+0000 7fb72f287700 1 -- 172.21.15.46:0/3184908766 shutdown_connections 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.932+0000 7fb72f287700 1 --2- 172.21.15.46:0/3184908766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb728105f30 0x7fb72819b960 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.932+0000 7fb72f287700 1 -- 172.21.15.46:0/3184908766 >> 172.21.15.46:0/3184908766 conn(0x7fb7280ff670 msgr2=0x7fb728100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.932+0000 7fb72f287700 1 -- 172.21.15.46:0/3184908766 shutdown_connections 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:55.932+0000 7fb72f287700 1 -- 172.21.15.46:0/3184908766 wait complete. 2024-02-19T18:51:56.574 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (2/15)... 2024-02-19T18:51:59.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: Activating manager daemon smithi046.qtceex 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: mgrmap e2: smithi046.qtceex(active, starting, since 0.00311564s) 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: from='mgr.14100 172.21.15.46:0/3420486751' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: from='mgr.14100 172.21.15.46:0/3420486751' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: from='mgr.14100 172.21.15.46:0/3420486751' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: from='mgr.14100 172.21.15.46:0/3420486751' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: from='mgr.14100 172.21.15.46:0/3420486751' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi046.qtceex", "id": "smithi046.qtceex"}]: dispatch 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: Manager daemon smithi046.qtceex is now available 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: from='mgr.14100 172.21.15.46:0/3420486751' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/mirror_snapshot_schedule"}]: dispatch 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: from='mgr.14100 172.21.15.46:0/3420486751' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/trash_purge_schedule"}]: dispatch 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: from='mgr.14100 172.21.15.46:0/3420486751' entity='mgr.smithi046.qtceex' 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: from='mgr.14100 172.21.15.46:0/3420486751' entity='mgr.smithi046.qtceex' 2024-02-19T18:51:59.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:58 smithi046 ceph-mon[29647]: from='mgr.14100 172.21.15.46:0/3420486751' entity='mgr.smithi046.qtceex' 2024-02-19T18:51:59.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:51:59.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:51:59.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "c412ec66-cf57-11ee-95bb-87774f69a715", 2024-02-19T18:51:59.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-02-19T18:51:59.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-19T18:51:59.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-19T18:51:59.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-19T18:51:59.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:59.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-19T18:51:59.684 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-19T18:51:59.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:59.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-19T18:51:59.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-19T18:51:59.686 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-19T18:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-19T18:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-19T18:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-19T18:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-19T18:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-19T18:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-19T18:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-19T18:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-19T18:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-19T18:51:59.695 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-02-19T18:51:43.710862+0000", 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:51:59.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.941+0000 7f954bf43700 1 Processor -- start 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.941+0000 7f954bf43700 1 -- start start 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.941+0000 7f954bf43700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f9544105dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.941+0000 7f954bf43700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544106300 con 0x7f95441059b0 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.942+0000 7f9549cdf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f9544105dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.942+0000 7f9549cdf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f9544105dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49544/0 (socket says 172.21.15.46:49544) 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.942+0000 7f9549cdf700 1 -- 172.21.15.46:0/3455387742 learned_addr learned my addr 172.21.15.46:0/3455387742 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.942+0000 7f9549cdf700 1 -- 172.21.15.46:0/3455387742 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544106440 con 0x7f95441059b0 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.942+0000 7f9549cdf700 1 --2- 172.21.15.46:0/3455387742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f9544105dc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f95400098a0 tx=0x7f9540009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdd84ce4900288e server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.942+0000 7f9548cdd700 1 -- 172.21.15.46:0/3455387742 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9540004180 con 0x7f95441059b0 2024-02-19T18:51:59.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.942+0000 7f9548cdd700 1 -- 172.21.15.46:0/3455387742 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f95400042e0 con 0x7f95441059b0 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.942+0000 7f9548cdd700 1 -- 172.21.15.46:0/3455387742 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9540011a50 con 0x7f95441059b0 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.943+0000 7f954bf43700 1 -- 172.21.15.46:0/3455387742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 msgr2=0x7f9544105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.943+0000 7f954bf43700 1 --2- 172.21.15.46:0/3455387742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f9544105dc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f95400098a0 tx=0x7f9540009bb0 comp rx=0 tx=0).stop 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.943+0000 7f954bf43700 1 -- 172.21.15.46:0/3455387742 shutdown_connections 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.943+0000 7f954bf43700 1 --2- 172.21.15.46:0/3455387742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f9544105dc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.943+0000 7f954bf43700 1 -- 172.21.15.46:0/3455387742 >> 172.21.15.46:0/3455387742 conn(0x7f9544101020 msgr2=0x7f9544103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.943+0000 7f954bf43700 1 -- 172.21.15.46:0/3455387742 shutdown_connections 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.943+0000 7f954bf43700 1 -- 172.21.15.46:0/3455387742 wait complete. 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.944+0000 7f954bf43700 1 Processor -- start 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.944+0000 7f954bf43700 1 -- start start 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.944+0000 7f954bf43700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f95441996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.944+0000 7f954bf43700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544199bf0 con 0x7f95441059b0 2024-02-19T18:51:59.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.944+0000 7f9549cdf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f95441996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.944+0000 7f9549cdf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f95441996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49560/0 (socket says 172.21.15.46:49560) 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.944+0000 7f9549cdf700 1 -- 172.21.15.46:0/1270167233 learned_addr learned my addr 172.21.15.46:0/1270167233 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.944+0000 7f9549cdf700 1 -- 172.21.15.46:0/1270167233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540009550 con 0x7f95441059b0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.944+0000 7f9549cdf700 1 --2- 172.21.15.46:0/1270167233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f95441996b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9540000c00 tx=0x7f9540011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.944+0000 7f953affd700 1 -- 172.21.15.46:0/1270167233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9540003b90 con 0x7f95441059b0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.945+0000 7f953affd700 1 -- 172.21.15.46:0/1270167233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f95400248b0 con 0x7f95441059b0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.945+0000 7f954bf43700 1 -- 172.21.15.46:0/1270167233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9544199df0 con 0x7f95441059b0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.945+0000 7f953affd700 1 -- 172.21.15.46:0/1270167233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f954001a8e0 con 0x7f95441059b0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.945+0000 7f954bf43700 1 -- 172.21.15.46:0/1270167233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954419a290 con 0x7f95441059b0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.945+0000 7f953affd700 1 -- 172.21.15.46:0/1270167233 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 2) v1 ==== 44840+0+0 (secure 0 0 0) 0x7f954001ab50 con 0x7f95441059b0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.945+0000 7f954bf43700 1 -- 172.21.15.46:0/1270167233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9544062380 con 0x7f95441059b0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.946+0000 7f953affd700 1 -- 172.21.15.46:0/1270167233 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f954004be20 con 0x7f95441059b0 2024-02-19T18:51:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:58.948+0000 7f953affd700 1 -- 172.21.15.46:0/1270167233 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f954001ae00 con 0x7f95441059b0 2024-02-19T18:51:59.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:59.021+0000 7f954bf43700 1 -- 172.21.15.46:0/1270167233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9544107820 con 0x7f95441059b0 2024-02-19T18:51:59.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:59.021+0000 7f953affd700 1 -- 172.21.15.46:0/1270167233 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f95400186d0 con 0x7f95441059b0 2024-02-19T18:51:59.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:59.022+0000 7f954bf43700 1 -- 172.21.15.46:0/1270167233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 msgr2=0x7f95441996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:51:59.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:59.022+0000 7f954bf43700 1 --2- 172.21.15.46:0/1270167233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f95441996b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9540000c00 tx=0x7f9540011ab0 comp rx=0 tx=0).stop 2024-02-19T18:51:59.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:59.022+0000 7f954bf43700 1 -- 172.21.15.46:0/1270167233 shutdown_connections 2024-02-19T18:51:59.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:59.022+0000 7f954bf43700 1 --2- 172.21.15.46:0/1270167233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95441059b0 0x7f95441996b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:51:59.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:59.022+0000 7f954bf43700 1 -- 172.21.15.46:0/1270167233 >> 172.21.15.46:0/1270167233 conn(0x7f9544101020 msgr2=0x7f9544101d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:51:59.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:59.022+0000 7f954bf43700 1 -- 172.21.15.46:0/1270167233 shutdown_connections 2024-02-19T18:51:59.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:51:59.023+0000 7f954bf43700 1 -- 172.21.15.46:0/1270167233 wait complete. 2024-02-19T18:51:59.700 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (3/15)... 2024-02-19T18:52:00.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:59 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1270167233' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T18:52:00.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:51:59 smithi046 ceph-mon[29647]: mgrmap e3: smithi046.qtceex(active, since 1.00708s) 2024-02-19T18:52:02.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:01 smithi046 ceph-mon[29647]: mgrmap e4: smithi046.qtceex(active, since 2s) 2024-02-19T18:52:02.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:52:02.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "c412ec66-cf57-11ee-95bb-87774f69a715", 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:52:02.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-02-19T18:52:02.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-19T18:52:02.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:52:02.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-19T18:52:02.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-19T18:52:02.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:52:02.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-19T18:52:02.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:52:02.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-19T18:52:02.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-19T18:52:02.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-19T18:52:02.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-19T18:52:02.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-19T18:52:02.932 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-19T18:52:02.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:52:02.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-19T18:52:02.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-19T18:52:02.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-19T18:52:02.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-19T18:52:02.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-19T18:52:02.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-19T18:52:02.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-19T18:52:02.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-19T18:52:02.933 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-19T18:52:02.934 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-02-19T18:51:43.710862+0000", 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.113+0000 7fe179f57700 1 Processor -- start 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.113+0000 7fe179f57700 1 -- start start 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.114+0000 7fe179f57700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe174108910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:02.935 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.114+0000 7fe179f57700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740744d0 con 0x7fe174106530 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.114+0000 7fe1737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe174108910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.114+0000 7fe1737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe174108910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49564/0 (socket says 172.21.15.46:49564) 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.114+0000 7fe1737fe700 1 -- 172.21.15.46:0/28726985 learned_addr learned my addr 172.21.15.46:0/28726985 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.114+0000 7fe1737fe700 1 -- 172.21.15.46:0/28726985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174074610 con 0x7fe174106530 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.114+0000 7fe1737fe700 1 --2- 172.21.15.46:0/28726985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe174108910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe1640098a0 tx=0x7fe164009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dc4302bbf65268 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.114+0000 7fe1727fc700 1 -- 172.21.15.46:0/28726985 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe164004180 con 0x7fe174106530 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.114+0000 7fe1727fc700 1 -- 172.21.15.46:0/28726985 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe1640042e0 con 0x7fe174106530 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.114+0000 7fe1727fc700 1 -- 172.21.15.46:0/28726985 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe164011a50 con 0x7fe174106530 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.115+0000 7fe179f57700 1 -- 172.21.15.46:0/28726985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 msgr2=0x7fe174108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.115+0000 7fe179f57700 1 --2- 172.21.15.46:0/28726985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe174108910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe1640098a0 tx=0x7fe164009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.115+0000 7fe179f57700 1 -- 172.21.15.46:0/28726985 shutdown_connections 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.115+0000 7fe179f57700 1 --2- 172.21.15.46:0/28726985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe174108910 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:02.936 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.115+0000 7fe179f57700 1 -- 172.21.15.46:0/28726985 >> 172.21.15.46:0/28726985 conn(0x7fe1740fff10 msgr2=0x7fe174102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.115+0000 7fe179f57700 1 -- 172.21.15.46:0/28726985 shutdown_connections 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.115+0000 7fe179f57700 1 -- 172.21.15.46:0/28726985 wait complete. 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.116+0000 7fe179f57700 1 Processor -- start 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.116+0000 7fe179f57700 1 -- start start 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.116+0000 7fe179f57700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe1741996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.116+0000 7fe179f57700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe174199c10 con 0x7fe174106530 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.116+0000 7fe1737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe1741996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.116+0000 7fe1737fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe1741996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49576/0 (socket says 172.21.15.46:49576) 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.116+0000 7fe1737fe700 1 -- 172.21.15.46:0/4152691567 learned_addr learned my addr 172.21.15.46:0/4152691567 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.116+0000 7fe1737fe700 1 -- 172.21.15.46:0/4152691567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164009550 con 0x7fe174106530 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.117+0000 7fe1737fe700 1 --2- 172.21.15.46:0/4152691567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe1741996d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe164009520 tx=0x7fe164011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.117+0000 7fe170ff9700 1 -- 172.21.15.46:0/4152691567 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe164003a80 con 0x7fe174106530 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.117+0000 7fe170ff9700 1 -- 172.21.15.46:0/4152691567 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe164003be0 con 0x7fe174106530 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.117+0000 7fe179f57700 1 -- 172.21.15.46:0/4152691567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe174199e70 con 0x7fe174106530 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.117+0000 7fe170ff9700 1 -- 172.21.15.46:0/4152691567 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe164019750 con 0x7fe174106530 2024-02-19T18:52:02.937 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.117+0000 7fe179f57700 1 -- 172.21.15.46:0/4152691567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17419cc70 con 0x7fe174106530 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.118+0000 7fe170ff9700 1 -- 172.21.15.46:0/4152691567 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7fe1640199c0 con 0x7fe174106530 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.118+0000 7fe170ff9700 1 --2- 172.21.15.46:0/4152691567 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7fe15c0383a0 0x7fe15c03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.118+0000 7fe170ff9700 1 -- 172.21.15.46:0/4152691567 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe16404c460 con 0x7fe174106530 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.118+0000 7fe179f57700 1 -- 172.21.15.46:0/4152691567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe174062380 con 0x7fe174106530 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.118+0000 7fe172ffd700 1 --2- 172.21.15.46:0/4152691567 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7fe15c0383a0 0x7fe15c03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.119+0000 7fe172ffd700 1 --2- 172.21.15.46:0/4152691567 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7fe15c0383a0 0x7fe15c03a850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe168006fd0 tx=0x7fe168006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.123+0000 7fe170ff9700 1 -- 172.21.15.46:0/4152691567 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe16402d440 con 0x7fe174106530 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.402+0000 7fe179f57700 1 -- 172.21.15.46:0/4152691567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe17419ce00 con 0x7fe174106530 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.403+0000 7fe170ff9700 1 -- 172.21.15.46:0/4152691567 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fe164049020 con 0x7fe174106530 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.405+0000 7fe179f57700 1 -- 172.21.15.46:0/4152691567 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7fe15c0383a0 msgr2=0x7fe15c03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.405+0000 7fe179f57700 1 --2- 172.21.15.46:0/4152691567 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7fe15c0383a0 0x7fe15c03a850 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe168006fd0 tx=0x7fe168006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.405+0000 7fe179f57700 1 -- 172.21.15.46:0/4152691567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 msgr2=0x7fe1741996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.405+0000 7fe179f57700 1 --2- 172.21.15.46:0/4152691567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe1741996d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe164009520 tx=0x7fe164011ab0 comp rx=0 tx=0).stop 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.405+0000 7fe179f57700 1 -- 172.21.15.46:0/4152691567 shutdown_connections 2024-02-19T18:52:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.405+0000 7fe179f57700 1 --2- 172.21.15.46:0/4152691567 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7fe15c0383a0 0x7fe15c03a850 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:02.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.405+0000 7fe179f57700 1 --2- 172.21.15.46:0/4152691567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe174106530 0x7fe1741996d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:02.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.405+0000 7fe179f57700 1 -- 172.21.15.46:0/4152691567 >> 172.21.15.46:0/4152691567 conn(0x7fe1740fff10 msgr2=0x7fe174101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:02.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.405+0000 7fe179f57700 1 -- 172.21.15.46:0/4152691567 shutdown_connections 2024-02-19T18:52:02.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:02.405+0000 7fe179f57700 1 -- 172.21.15.46:0/4152691567 wait complete. 2024-02-19T18:52:02.939 INFO:teuthology.orchestra.run.smithi046.stdout:mgr is available 2024-02-19T18:52:03.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:02 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/4152691567' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T18:52:04.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:52:04.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-02-19T18:52:04.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:52:04.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-19T18:52:04.142 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.365+0000 7f1878249700 1 Processor -- start 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.366+0000 7f1878249700 1 -- start start 2024-02-19T18:52:04.143 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.366+0000 7f1878249700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.366+0000 7f1878249700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1870106320 con 0x7f18701059d0 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.366+0000 7f1875fe5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.366+0000 7f1875fe5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49578/0 (socket says 172.21.15.46:49578) 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.366+0000 7f1875fe5700 1 -- 172.21.15.46:0/2585799756 learned_addr learned my addr 172.21.15.46:0/2585799756 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.366+0000 7f1875fe5700 1 -- 172.21.15.46:0/2585799756 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870106460 con 0x7f18701059d0 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.367+0000 7f1875fe5700 1 --2- 172.21.15.46:0/2585799756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870105de0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1864009870 tx=0x7f1864009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ecc729a05f8c7a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.367+0000 7f1874fe3700 1 -- 172.21.15.46:0/2585799756 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1864005c30 con 0x7f18701059d0 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.367+0000 7f1874fe3700 1 -- 172.21.15.46:0/2585799756 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1864005d90 con 0x7f18701059d0 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.367+0000 7f1874fe3700 1 -- 172.21.15.46:0/2585799756 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1864006030 con 0x7f18701059d0 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.367+0000 7f1878249700 1 -- 172.21.15.46:0/2585799756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 msgr2=0x7f1870105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.367+0000 7f1878249700 1 --2- 172.21.15.46:0/2585799756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870105de0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1864009870 tx=0x7f1864009b80 comp rx=0 tx=0).stop 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.367+0000 7f1878249700 1 -- 172.21.15.46:0/2585799756 shutdown_connections 2024-02-19T18:52:04.144 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.367+0000 7f1878249700 1 --2- 172.21.15.46:0/2585799756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870105de0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.367+0000 7f1878249700 1 -- 172.21.15.46:0/2585799756 >> 172.21.15.46:0/2585799756 conn(0x7f1870101020 msgr2=0x7f1870103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.368+0000 7f1878249700 1 -- 172.21.15.46:0/2585799756 shutdown_connections 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.368+0000 7f1878249700 1 -- 172.21.15.46:0/2585799756 wait complete. 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.368+0000 7f1878249700 1 Processor -- start 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.368+0000 7f1878249700 1 -- start start 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.368+0000 7f1878249700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.368+0000 7f1878249700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1870199ba0 con 0x7f18701059d0 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.368+0000 7f1875fe5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.368+0000 7f1875fe5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49580/0 (socket says 172.21.15.46:49580) 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.368+0000 7f1875fe5700 1 -- 172.21.15.46:0/2690813465 learned_addr learned my addr 172.21.15.46:0/2690813465 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.369+0000 7f1875fe5700 1 -- 172.21.15.46:0/2690813465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864009500 con 0x7f18701059d0 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.369+0000 7f1875fe5700 1 --2- 172.21.15.46:0/2690813465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870199660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1864006160 tx=0x7f1864006190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.369+0000 7f1862ffd700 1 -- 172.21.15.46:0/2690813465 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1864004430 con 0x7f18701059d0 2024-02-19T18:52:04.145 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.369+0000 7f1878249700 1 -- 172.21.15.46:0/2690813465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1870199da0 con 0x7f18701059d0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.369+0000 7f1862ffd700 1 -- 172.21.15.46:0/2690813465 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1864006760 con 0x7f18701059d0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.369+0000 7f1862ffd700 1 -- 172.21.15.46:0/2690813465 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1864011d00 con 0x7f18701059d0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.369+0000 7f1878249700 1 -- 172.21.15.46:0/2690813465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187019a240 con 0x7f18701059d0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.370+0000 7f1862ffd700 1 -- 172.21.15.46:0/2690813465 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f1864018070 con 0x7f18701059d0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.370+0000 7f1862ffd700 1 --2- 172.21.15.46:0/2690813465 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f185c0383b0 0x7f185c03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.370+0000 7f1862ffd700 1 -- 172.21.15.46:0/2690813465 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f186404ba20 con 0x7f18701059d0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.370+0000 7f18757e4700 1 --2- 172.21.15.46:0/2690813465 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f185c0383b0 0x7f185c03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.370+0000 7f1878249700 1 -- 172.21.15.46:0/2690813465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1870062380 con 0x7f18701059d0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.370+0000 7f18757e4700 1 --2- 172.21.15.46:0/2690813465 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f185c0383b0 0x7f185c03a860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f186c006fd0 tx=0x7f186c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.375+0000 7f1862ffd700 1 -- 172.21.15.46:0/2690813465 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1864022760 con 0x7f18701059d0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.575+0000 7f1878249700 1 -- 172.21.15.46:0/2690813465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f187019e3b0 con 0x7f18701059d0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.575+0000 7f1862ffd700 1 -- 172.21.15.46:0/2690813465 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f186401a370 con 0x7f18701059d0 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.577+0000 7f1878249700 1 -- 172.21.15.46:0/2690813465 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f185c0383b0 msgr2=0x7f185c03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:04.146 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.577+0000 7f1878249700 1 --2- 172.21.15.46:0/2690813465 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f185c0383b0 0x7f185c03a860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f186c006fd0 tx=0x7f186c006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.577+0000 7f1878249700 1 -- 172.21.15.46:0/2690813465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 msgr2=0x7f1870199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.577+0000 7f1878249700 1 --2- 172.21.15.46:0/2690813465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870199660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1864006160 tx=0x7f1864006190 comp rx=0 tx=0).stop 2024-02-19T18:52:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.577+0000 7f1878249700 1 -- 172.21.15.46:0/2690813465 shutdown_connections 2024-02-19T18:52:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.577+0000 7f1878249700 1 --2- 172.21.15.46:0/2690813465 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f185c0383b0 0x7f185c03a860 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.577+0000 7f1878249700 1 --2- 172.21.15.46:0/2690813465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18701059d0 0x7f1870199660 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.577+0000 7f1878249700 1 -- 172.21.15.46:0/2690813465 >> 172.21.15.46:0/2690813465 conn(0x7f1870101020 msgr2=0x7f1870101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.578+0000 7f1878249700 1 -- 172.21.15.46:0/2690813465 shutdown_connections 2024-02-19T18:52:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:03.578+0000 7f1878249700 1 -- 172.21.15.46:0/2690813465 wait complete. 2024-02-19T18:52:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling cephadm module... 2024-02-19T18:52:04.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:03 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2690813465' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-19T18:52:05.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:04 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3326721037' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-19T18:52:05.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.524+0000 7f4ba8ef0700 1 Processor -- start 2024-02-19T18:52:05.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.524+0000 7f4ba8ef0700 1 -- start start 2024-02-19T18:52:05.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.525+0000 7f4ba8ef0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba407a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:05.696 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.525+0000 7f4ba8ef0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba407a810 con 0x7f4ba407bdd0 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.525+0000 7f4ba259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba407a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.525+0000 7f4ba259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba407a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49596/0 (socket says 172.21.15.46:49596) 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.525+0000 7f4ba259c700 1 -- 172.21.15.46:0/396946282 learned_addr learned my addr 172.21.15.46:0/396946282 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.525+0000 7f4ba259c700 1 -- 172.21.15.46:0/396946282 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba407a950 con 0x7f4ba407bdd0 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.525+0000 7f4ba259c700 1 --2- 172.21.15.46:0/396946282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba407a2d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009870 tx=0x7f4b94009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971cf5b9001f1906 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.525+0000 7f4ba159a700 1 -- 172.21.15.46:0/396946282 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b94005c30 con 0x7f4ba407bdd0 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.525+0000 7f4ba159a700 1 -- 172.21.15.46:0/396946282 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4b94005d90 con 0x7f4ba407bdd0 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.525+0000 7f4ba159a700 1 -- 172.21.15.46:0/396946282 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b94006030 con 0x7f4ba407bdd0 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.526+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/396946282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 msgr2=0x7f4ba407a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.526+0000 7f4ba8ef0700 1 --2- 172.21.15.46:0/396946282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba407a2d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009870 tx=0x7f4b94009b80 comp rx=0 tx=0).stop 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.526+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/396946282 shutdown_connections 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.526+0000 7f4ba8ef0700 1 --2- 172.21.15.46:0/396946282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba407a2d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.526+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/396946282 >> 172.21.15.46:0/396946282 conn(0x7f4ba4101020 msgr2=0x7f4ba4103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:05.697 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.526+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/396946282 shutdown_connections 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.526+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/396946282 wait complete. 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.527+0000 7f4ba8ef0700 1 Processor -- start 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.527+0000 7f4ba8ef0700 1 -- start start 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.527+0000 7f4ba8ef0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.527+0000 7f4ba8ef0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba419be50 con 0x7f4ba407bdd0 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.527+0000 7f4ba259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.527+0000 7f4ba259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49600/0 (socket says 172.21.15.46:49600) 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.527+0000 7f4ba259c700 1 -- 172.21.15.46:0/3326721037 learned_addr learned my addr 172.21.15.46:0/3326721037 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.527+0000 7f4ba259c700 1 -- 172.21.15.46:0/3326721037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b94009500 con 0x7f4ba407bdd0 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.528+0000 7f4ba259c700 1 --2- 172.21.15.46:0/3326721037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba419b910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4b940038f0 tx=0x7f4b940061e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.528+0000 7f4b937fe700 1 -- 172.21.15.46:0/3326721037 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b94004310 con 0x7f4ba407bdd0 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.528+0000 7f4b937fe700 1 -- 172.21.15.46:0/3326721037 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4b94004470 con 0x7f4ba407bdd0 2024-02-19T18:52:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.528+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/3326721037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba419c050 con 0x7f4ba407bdd0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.528+0000 7f4b937fe700 1 -- 172.21.15.46:0/3326721037 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b94011c90 con 0x7f4ba407bdd0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.528+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/3326721037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba419c4f0 con 0x7f4ba407bdd0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.529+0000 7f4b937fe700 1 -- 172.21.15.46:0/3326721037 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f4b94018070 con 0x7f4ba407bdd0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.529+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/3326721037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba410bca0 con 0x7f4ba407bdd0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.529+0000 7f4b937fe700 1 --2- 172.21.15.46:0/3326721037 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f4b8c0383b0 0x7f4b8c03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.529+0000 7f4b937fe700 1 -- 172.21.15.46:0/3326721037 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4b9404ba10 con 0x7f4ba407bdd0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.529+0000 7f4ba1d9b700 1 --2- 172.21.15.46:0/3326721037 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f4b8c0383b0 0x7f4b8c03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.529+0000 7f4ba1d9b700 1 --2- 172.21.15.46:0/3326721037 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f4b8c0383b0 0x7f4b8c03a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4b98006fd0 tx=0x7f4b98006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.534+0000 7f4b937fe700 1 -- 172.21.15.46:0/3326721037 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4b940062f0 con 0x7f4ba407bdd0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.789+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/3326721037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f4ba419f2d0 con 0x7f4ba407bdd0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.963+0000 7f4b937fe700 1 -- 172.21.15.46:0/3326721037 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f4b9400bd30 con 0x7f4ba407bdd0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.964+0000 7f4b937fe700 1 -- 172.21.15.46:0/3326721037 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f4b9404b430 con 0x7f4ba407bdd0 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.966+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/3326721037 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f4b8c0383b0 msgr2=0x7f4b8c03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:05.699 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.966+0000 7f4ba8ef0700 1 --2- 172.21.15.46:0/3326721037 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f4b8c0383b0 0x7f4b8c03a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4b98006fd0 tx=0x7f4b98006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:05.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.966+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/3326721037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 msgr2=0x7f4ba419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:05.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.966+0000 7f4ba8ef0700 1 --2- 172.21.15.46:0/3326721037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba419b910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4b940038f0 tx=0x7f4b940061e0 comp rx=0 tx=0).stop 2024-02-19T18:52:05.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.966+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/3326721037 shutdown_connections 2024-02-19T18:52:05.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.966+0000 7f4ba8ef0700 1 --2- 172.21.15.46:0/3326721037 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f4b8c0383b0 0x7f4b8c03a860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:05.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.966+0000 7f4ba8ef0700 1 --2- 172.21.15.46:0/3326721037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba407bdd0 0x7f4ba419b910 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:05.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.966+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/3326721037 >> 172.21.15.46:0/3326721037 conn(0x7f4ba4101020 msgr2=0x7f4ba41026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:05.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.966+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/3326721037 shutdown_connections 2024-02-19T18:52:05.700 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:04.966+0000 7f4ba8ef0700 1 -- 172.21.15.46:0/3326721037 wait complete. 2024-02-19T18:52:06.284 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:05 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3326721037' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-19T18:52:06.284 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:05 smithi046 ceph-mon[29647]: mgrmap e5: smithi046.qtceex(active, since 6s) 2024-02-19T18:52:06.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:52:06.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-19T18:52:06.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-19T18:52:06.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "smithi046.qtceex", 2024-02-19T18:52:06.920 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.086+0000 7f2126290700 1 Processor -- start 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.086+0000 7f2126290700 1 -- start start 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.086+0000 7f2126290700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f2120106350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.086+0000 7f2126290700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2120106890 con 0x7f2120105f40 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.086+0000 7f211ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f2120106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.086+0000 7f211ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f2120106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49618/0 (socket says 172.21.15.46:49618) 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.086+0000 7f211ffff700 1 -- 172.21.15.46:0/3898745938 learned_addr learned my addr 172.21.15.46:0/3898745938 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.086+0000 7f211ffff700 1 -- 172.21.15.46:0/3898745938 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21201069d0 con 0x7f2120105f40 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.087+0000 7f211ffff700 1 --2- 172.21.15.46:0/3898745938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f2120106350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f21100098a0 tx=0x7f2110009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ea6a8d724a983b server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.087+0000 7f211effd700 1 -- 172.21.15.46:0/3898745938 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2110004180 con 0x7f2120105f40 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.087+0000 7f211effd700 1 -- 172.21.15.46:0/3898745938 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f21100042e0 con 0x7f2120105f40 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.087+0000 7f211effd700 1 -- 172.21.15.46:0/3898745938 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2110011a50 con 0x7f2120105f40 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.088+0000 7f2126290700 1 -- 172.21.15.46:0/3898745938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 msgr2=0x7f2120106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:06.921 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.088+0000 7f2126290700 1 --2- 172.21.15.46:0/3898745938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f2120106350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f21100098a0 tx=0x7f2110009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.088+0000 7f2126290700 1 -- 172.21.15.46:0/3898745938 shutdown_connections 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.088+0000 7f2126290700 1 --2- 172.21.15.46:0/3898745938 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f2120106350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.088+0000 7f2126290700 1 -- 172.21.15.46:0/3898745938 >> 172.21.15.46:0/3898745938 conn(0x7f21200ff6a0 msgr2=0x7f2120101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.088+0000 7f2126290700 1 -- 172.21.15.46:0/3898745938 shutdown_connections 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.088+0000 7f2126290700 1 -- 172.21.15.46:0/3898745938 wait complete. 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.088+0000 7f2126290700 1 Processor -- start 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.088+0000 7f2126290700 1 -- start start 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.089+0000 7f2126290700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f212019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.089+0000 7f2126290700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212019be70 con 0x7f2120105f40 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.089+0000 7f211ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f212019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.089+0000 7f211ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f212019b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49634/0 (socket says 172.21.15.46:49634) 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.089+0000 7f211ffff700 1 -- 172.21.15.46:0/1179788624 learned_addr learned my addr 172.21.15.46:0/1179788624 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.089+0000 7f211ffff700 1 -- 172.21.15.46:0/1179788624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2110009550 con 0x7f2120105f40 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.089+0000 7f211ffff700 1 --2- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f212019b930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2110003de0 tx=0x7f2110011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.089+0000 7f211d7fa700 1 -- 172.21.15.46:0/1179788624 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2110003930 con 0x7f2120105f40 2024-02-19T18:52:06.922 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.090+0000 7f2126290700 1 -- 172.21.15.46:0/1179788624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212019c070 con 0x7f2120105f40 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.090+0000 7f211d7fa700 1 -- 172.21.15.46:0/1179788624 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2110003a90 con 0x7f2120105f40 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.090+0000 7f211d7fa700 1 -- 172.21.15.46:0/1179788624 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2110019730 con 0x7f2120105f40 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.090+0000 7f2126290700 1 -- 172.21.15.46:0/1179788624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212019c510 con 0x7f2120105f40 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.091+0000 7f211d7fa700 1 -- 172.21.15.46:0/1179788624 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f2110019a30 con 0x7f2120105f40 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.091+0000 7f2126290700 1 -- 172.21.15.46:0/1179788624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212010bc60 con 0x7f2120105f40 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.091+0000 7f211d7fa700 1 --2- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f21080383f0 0x7f210803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.091+0000 7f211f7fe700 1 -- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f21080383f0 msgr2=0x7f210803a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3840592341 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.091+0000 7f211d7fa700 1 -- 172.21.15.46:0/1179788624 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f211004c2e0 con 0x7f2120105f40 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.091+0000 7f211f7fe700 1 --2- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f21080383f0 0x7f210803a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.096+0000 7f211d7fa700 1 -- 172.21.15.46:0/1179788624 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f21100107f0 con 0x7f2120105f40 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.292+0000 7f211f7fe700 1 -- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f21080383f0 msgr2=0x7f210803a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3840592341 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.292+0000 7f211f7fe700 1 --2- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f21080383f0 0x7f210803a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.353+0000 7f2126290700 1 -- 172.21.15.46:0/1179788624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f212019f2f0 con 0x7f2120105f40 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.354+0000 7f211d7fa700 1 -- 172.21.15.46:0/1179788624 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f211002be20 con 0x7f2120105f40 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.356+0000 7f2126290700 1 -- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f21080383f0 msgr2=0x7f210803a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:52:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.356+0000 7f2126290700 1 --2- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f21080383f0 0x7f210803a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.356+0000 7f2126290700 1 -- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 msgr2=0x7f212019b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.356+0000 7f2126290700 1 --2- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f212019b930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2110003de0 tx=0x7f2110011ab0 comp rx=0 tx=0).stop 2024-02-19T18:52:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.356+0000 7f2126290700 1 -- 172.21.15.46:0/1179788624 shutdown_connections 2024-02-19T18:52:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.356+0000 7f2126290700 1 --2- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7f21080383f0 0x7f210803a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.356+0000 7f2126290700 1 --2- 172.21.15.46:0/1179788624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2120105f40 0x7f212019b930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.356+0000 7f2126290700 1 -- 172.21.15.46:0/1179788624 >> 172.21.15.46:0/1179788624 conn(0x7f21200ff6a0 msgr2=0x7f2120100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.356+0000 7f2126290700 1 -- 172.21.15.46:0/1179788624 shutdown_connections 2024-02-19T18:52:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:06.356+0000 7f2126290700 1 -- 172.21.15.46:0/1179788624 wait complete. 2024-02-19T18:52:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-02-19T18:52:06.924 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 5... 2024-02-19T18:52:07.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:06 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1179788624' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-19T18:52:12.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: Active manager daemon smithi046.qtceex restarted 2024-02-19T18:52:12.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: Activating manager daemon smithi046.qtceex 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: osdmap e2: 0 total, 0 up, 0 in 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: mgrmap e6: smithi046.qtceex(active, starting, since 0.00307944s) 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi046.qtceex", "id": "smithi046.qtceex"}]: dispatch 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: Manager daemon smithi046.qtceex is now available 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:52:12.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:11 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:52:13.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:12 smithi046 ceph-mon[29647]: Found migration_current of "None". Setting to last migration. 2024-02-19T18:52:13.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:12 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/mirror_snapshot_schedule"}]: dispatch 2024-02-19T18:52:13.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:12 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/trash_purge_schedule"}]: dispatch 2024-02-19T18:52:13.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:12 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:13.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:12 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:13.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:12 smithi046 ceph-mon[29647]: mgrmap e7: smithi046.qtceex(active, since 1.00482s) 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.359+0000 7efd11cc8700 1 Processor -- start 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.359+0000 7efd11cc8700 1 -- start start 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.359+0000 7efd11cc8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.359+0000 7efd11cc8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c105230 con 0x7efd0c1048e0 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.359+0000 7efd0b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.359+0000 7efd0b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49650/0 (socket says 172.21.15.46:49650) 2024-02-19T18:52:13.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.359+0000 7efd0b7fe700 1 -- 172.21.15.46:0/1381111315 learned_addr learned my addr 172.21.15.46:0/1381111315 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.359+0000 7efd0b7fe700 1 -- 172.21.15.46:0/1381111315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c105370 con 0x7efd0c1048e0 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.359+0000 7efd0b7fe700 1 --2- 172.21.15.46:0/1381111315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c104cf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0098a0 tx=0x7efcfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7737401bbd0d88 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.360+0000 7efd0a7fc700 1 -- 172.21.15.46:0/1381111315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcfc004180 con 0x7efd0c1048e0 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.360+0000 7efd0a7fc700 1 -- 172.21.15.46:0/1381111315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efcfc0042e0 con 0x7efd0c1048e0 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.360+0000 7efd0a7fc700 1 -- 172.21.15.46:0/1381111315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcfc011a50 con 0x7efd0c1048e0 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.360+0000 7efd11cc8700 1 -- 172.21.15.46:0/1381111315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 msgr2=0x7efd0c104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.360+0000 7efd11cc8700 1 --2- 172.21.15.46:0/1381111315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c104cf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0098a0 tx=0x7efcfc009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.360+0000 7efd11cc8700 1 -- 172.21.15.46:0/1381111315 shutdown_connections 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.360+0000 7efd11cc8700 1 --2- 172.21.15.46:0/1381111315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c104cf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.360+0000 7efd11cc8700 1 -- 172.21.15.46:0/1381111315 >> 172.21.15.46:0/1381111315 conn(0x7efd0c0fff10 msgr2=0x7efd0c102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.360+0000 7efd11cc8700 1 -- 172.21.15.46:0/1381111315 shutdown_connections 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.360+0000 7efd11cc8700 1 -- 172.21.15.46:0/1381111315 wait complete. 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.361+0000 7efd11cc8700 1 Processor -- start 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.361+0000 7efd11cc8700 1 -- start start 2024-02-19T18:52:13.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.361+0000 7efd11cc8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.361+0000 7efd11cc8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c19be80 con 0x7efd0c1048e0 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.361+0000 7efd0b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.362+0000 7efd0b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c19b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49656/0 (socket says 172.21.15.46:49656) 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.362+0000 7efd0b7fe700 1 -- 172.21.15.46:0/1244051275 learned_addr learned my addr 172.21.15.46:0/1244051275 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.362+0000 7efd0b7fe700 1 -- 172.21.15.46:0/1244051275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc009550 con 0x7efd0c1048e0 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.362+0000 7efd0b7fe700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c19b940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efcfc003de0 tx=0x7efcfc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.362+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcfc003930 con 0x7efd0c1048e0 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.362+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efcfc003a90 con 0x7efd0c1048e0 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.362+0000 7efd11cc8700 1 -- 172.21.15.46:0/1244051275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c19c080 con 0x7efd0c1048e0 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.362+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcfc019730 con 0x7efd0c1048e0 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.362+0000 7efd11cc8700 1 -- 172.21.15.46:0/1244051275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c19c520 con 0x7efd0c1048e0 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.363+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7efcfc0199e0 con 0x7efd0c1048e0 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.363+0000 7efd08ff9700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 0x7efcf803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:13.380 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.363+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 --> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7efcf803b000 con 0x7efcf8038440 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.363+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efcfc04cf90 con 0x7efd0c1048e0 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.363+0000 7efd0affd700 1 -- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 msgr2=0x7efcf803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3840592341 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.363+0000 7efd0affd700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 0x7efcf803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.564+0000 7efd0affd700 1 -- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 msgr2=0x7efcf803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3840592341 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.564+0000 7efd0affd700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 0x7efcf803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.965+0000 7efd0affd700 1 -- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 msgr2=0x7efcf803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3840592341 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:07.965+0000 7efd0affd700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 0x7efcf803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:08.766+0000 7efd0affd700 1 -- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 msgr2=0x7efcf803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3840592341 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:08.766+0000 7efd0affd700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 0x7efcf803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:10.367+0000 7efd0affd700 1 -- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 msgr2=0x7efcf803a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3840592341 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:10.367+0000 7efd0affd700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 0x7efcf803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:11.768+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7efcfc019ce0 con 0x7efd0c1048e0 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:11.768+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 msgr2=0x7efcf803a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:52:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:11.768+0000 7efd08ff9700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 0x7efcf803a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.769+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7efcfc04d900 con 0x7efd0c1048e0 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.769+0000 7efd08ff9700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7efcf803bd10 0x7efcf803e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.769+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7efcf803b000 con 0x7efcf803bd10 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.769+0000 7efd0affd700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7efcf803bd10 0x7efcf803e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.770+0000 7efd0affd700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7efcf803bd10 0x7efcf803e0f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efcf4003a10 tx=0x7efcf40092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.771+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7efcf803b000 con 0x7efcf803bd10 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.777+0000 7efd11cc8700 1 -- 172.21.15.46:0/1244051275 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7efd0c19cc80 con 0x7efcf803bd10 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.777+0000 7efd08ff9700 1 -- 172.21.15.46:0/1244051275 <== mgr.14120 v2:172.21.15.46:6800/1408120197 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7efd0c19cc80 con 0x7efcf803bd10 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 -- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7efcf803bd10 msgr2=0x7efcf803e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7efcf803bd10 0x7efcf803e0f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efcf4003a10 tx=0x7efcf40092b0 comp rx=0 tx=0).stop 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 -- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 msgr2=0x7efd0c19b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c19b940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efcfc003de0 tx=0x7efcfc011ab0 comp rx=0 tx=0).stop 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 -- 172.21.15.46:0/1244051275 shutdown_connections 2024-02-19T18:52:13.382 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7efcf803bd10 0x7efcf803e0f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:13.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c1048e0 0x7efd0c19b940 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:13.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 --2- 172.21.15.46:0/1244051275 >> [v2:172.21.15.46:6800/3840592341,v1:172.21.15.46:6801/3840592341] conn(0x7efcf8038440 0x7efcf803a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:13.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 -- 172.21.15.46:0/1244051275 >> 172.21.15.46:0/1244051275 conn(0x7efd0c0fff10 msgr2=0x7efd0c0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:13.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 -- 172.21.15.46:0/1244051275 shutdown_connections 2024-02-19T18:52:13.383 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:12.778+0000 7efd11cc8700 1 -- 172.21.15.46:0/1244051275 wait complete. 2024-02-19T18:52:13.383 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 5 is available 2024-02-19T18:52:13.383 INFO:teuthology.orchestra.run.smithi046.stdout:Setting orchestrator backend to cephadm... 2024-02-19T18:52:14.013 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:13 smithi046 ceph-mon[29647]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-19T18:52:14.013 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:13 smithi046 ceph-mon[29647]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-19T18:52:14.013 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:13 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.773+0000 7f75f7b87700 1 Processor -- start 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.773+0000 7f75f7b87700 1 -- start start 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.773+0000 7f75f7b87700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0074490 0x7f75f010a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.773+0000 7f75f7b87700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0106370 con 0x7f75f0074490 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.773+0000 7f75f5923700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0074490 0x7f75f010a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.774+0000 7f75f5923700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0074490 0x7f75f010a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44336/0 (socket says 172.21.15.46:44336) 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.774+0000 7f75f5923700 1 -- 172.21.15.46:0/3393723575 learned_addr learned my addr 172.21.15.46:0/3393723575 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.774+0000 7f75f5923700 1 -- 172.21.15.46:0/3393723575 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f010aec0 con 0x7f75f0074490 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.774+0000 7f75f5923700 1 --2- 172.21.15.46:0/3393723575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0074490 0x7f75f010a980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009e80 tx=0x7f75e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45b0a10587a7286 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.774+0000 7f75f4921700 1 -- 172.21.15.46:0/3393723575 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75e000e070 con 0x7f75f0074490 2024-02-19T18:52:14.541 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.774+0000 7f75f4921700 1 -- 172.21.15.46:0/3393723575 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f75e0003e90 con 0x7f75f0074490 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.774+0000 7f75f4921700 1 -- 172.21.15.46:0/3393723575 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75e0004380 con 0x7f75f0074490 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 -- 172.21.15.46:0/3393723575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0074490 msgr2=0x7f75f010a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 --2- 172.21.15.46:0/3393723575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0074490 0x7f75f010a980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009e80 tx=0x7f75e000b330 comp rx=0 tx=0).stop 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 -- 172.21.15.46:0/3393723575 shutdown_connections 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 --2- 172.21.15.46:0/3393723575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f0074490 0x7f75f010a980 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 -- 172.21.15.46:0/3393723575 >> 172.21.15.46:0/3393723575 conn(0x7f75f00fff10 msgr2=0x7f75f0102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 -- 172.21.15.46:0/3393723575 shutdown_connections 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 -- 172.21.15.46:0/3393723575 wait complete. 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 Processor -- start 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 -- start start 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f019b8b0 0x7f75f019bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.775+0000 7f75f7b87700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f019c200 con 0x7f75f019b8b0 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.776+0000 7f75f5923700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f019b8b0 0x7f75f019bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.776+0000 7f75f5923700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f019b8b0 0x7f75f019bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44342/0 (socket says 172.21.15.46:44342) 2024-02-19T18:52:14.542 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.776+0000 7f75f5923700 1 -- 172.21.15.46:0/609697323 learned_addr learned my addr 172.21.15.46:0/609697323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.776+0000 7f75f5923700 1 -- 172.21.15.46:0/609697323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e0009b30 con 0x7f75f019b8b0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.776+0000 7f75f5923700 1 --2- 172.21.15.46:0/609697323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f019b8b0 0x7f75f019bcc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009e50 tx=0x7f75e0004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.776+0000 7f75eeffd700 1 -- 172.21.15.46:0/609697323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75e000e040 con 0x7f75f019b8b0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.776+0000 7f75eeffd700 1 -- 172.21.15.46:0/609697323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f75e0003cf0 con 0x7f75f019b8b0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.776+0000 7f75f7b87700 1 -- 172.21.15.46:0/609697323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f019c400 con 0x7f75f019b8b0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.776+0000 7f75eeffd700 1 -- 172.21.15.46:0/609697323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75e001b770 con 0x7f75f019b8b0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.776+0000 7f75f7b87700 1 -- 172.21.15.46:0/609697323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f019f060 con 0x7f75f019b8b0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.777+0000 7f75eeffd700 1 -- 172.21.15.46:0/609697323 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7f75e0019040 con 0x7f75f019b8b0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.777+0000 7f75eeffd700 1 --2- 172.21.15.46:0/609697323 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f75d8038320 0x7f75d803a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.777+0000 7f75f7b87700 1 -- 172.21.15.46:0/609697323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f0062380 con 0x7f75f019b8b0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.777+0000 7f75eeffd700 1 -- 172.21.15.46:0/609697323 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f75e004ba20 con 0x7f75f019b8b0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.777+0000 7f75f5122700 1 --2- 172.21.15.46:0/609697323 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f75d8038320 0x7f75d803a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.778+0000 7f75f5122700 1 --2- 172.21.15.46:0/609697323 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f75d8038320 0x7f75d803a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f75e4006fd0 tx=0x7f75e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:14.543 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.782+0000 7f75eeffd700 1 -- 172.21.15.46:0/609697323 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f75e00239c0 con 0x7f75f019b8b0 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.820+0000 7f75eeffd700 1 -- 172.21.15.46:0/609697323 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f75e0019db0 con 0x7f75f019b8b0 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:13.997+0000 7f75f7b87700 1 -- 172.21.15.46:0/609697323 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f75f0101420 con 0x7f75d8038320 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.002+0000 7f75eeffd700 1 -- 172.21.15.46:0/609697323 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f75f0101420 con 0x7f75d8038320 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.004+0000 7f75f7b87700 1 -- 172.21.15.46:0/609697323 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f75d8038320 msgr2=0x7f75d803a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.004+0000 7f75f7b87700 1 --2- 172.21.15.46:0/609697323 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f75d8038320 0x7f75d803a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f75e4006fd0 tx=0x7f75e4006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.004+0000 7f75f7b87700 1 -- 172.21.15.46:0/609697323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f019b8b0 msgr2=0x7f75f019bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.004+0000 7f75f7b87700 1 --2- 172.21.15.46:0/609697323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f019b8b0 0x7f75f019bcc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009e50 tx=0x7f75e0004920 comp rx=0 tx=0).stop 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.004+0000 7f75f7b87700 1 -- 172.21.15.46:0/609697323 shutdown_connections 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.004+0000 7f75f7b87700 1 --2- 172.21.15.46:0/609697323 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f75d8038320 0x7f75d803a7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.004+0000 7f75f7b87700 1 --2- 172.21.15.46:0/609697323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75f019b8b0 0x7f75f019bcc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.004+0000 7f75f7b87700 1 -- 172.21.15.46:0/609697323 >> 172.21.15.46:0/609697323 conn(0x7f75f00fff10 msgr2=0x7f75f0100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.005+0000 7f75f7b87700 1 -- 172.21.15.46:0/609697323 shutdown_connections 2024-02-19T18:52:14.544 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.005+0000 7f75f7b87700 1 -- 172.21.15.46:0/609697323 wait complete. 2024-02-19T18:52:14.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:14 smithi046 ceph-mon[29647]: [19/Feb/2024:18:52:13] ENGINE Bus STARTING 2024-02-19T18:52:14.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:14 smithi046 ceph-mon[29647]: [19/Feb/2024:18:52:13] ENGINE Serving on http://172.21.15.46:8765 2024-02-19T18:52:14.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:14 smithi046 ceph-mon[29647]: [19/Feb/2024:18:52:13] ENGINE Serving on https://172.21.15.46:7150 2024-02-19T18:52:14.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:14 smithi046 ceph-mon[29647]: [19/Feb/2024:18:52:13] ENGINE Bus STARTED 2024-02-19T18:52:14.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:14 smithi046 ceph-mon[29647]: mgrmap e8: smithi046.qtceex(active, since 2s) 2024-02-19T18:52:14.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:14 smithi046 ceph-mon[29647]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:14.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:14 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:14.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:14 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:52:15.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-19T18:52:15.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.984+0000 7f9724656700 1 Processor -- start 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.985+0000 7f9724656700 1 -- start start 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.985+0000 7f9724656700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.985+0000 7f9724656700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c106320 con 0x7f971c1059d0 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.985+0000 7f97223f2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.985+0000 7f97223f2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44358/0 (socket says 172.21.15.46:44358) 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.985+0000 7f97223f2700 1 -- 172.21.15.46:0/3027171927 learned_addr learned my addr 172.21.15.46:0/3027171927 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.985+0000 7f97223f2700 1 -- 172.21.15.46:0/3027171927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c106460 con 0x7f971c1059d0 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.986+0000 7f97223f2700 1 --2- 172.21.15.46:0/3027171927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c105de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9714009870 tx=0x7f9714009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83986077836b5b92 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.986+0000 7f97213f0700 1 -- 172.21.15.46:0/3027171927 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9714005c30 con 0x7f971c1059d0 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.986+0000 7f97213f0700 1 -- 172.21.15.46:0/3027171927 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9714005d90 con 0x7f971c1059d0 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.986+0000 7f97213f0700 1 -- 172.21.15.46:0/3027171927 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9714006030 con 0x7f971c1059d0 2024-02-19T18:52:15.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.986+0000 7f9724656700 1 -- 172.21.15.46:0/3027171927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 msgr2=0x7f971c105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.986+0000 7f9724656700 1 --2- 172.21.15.46:0/3027171927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c105de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9714009870 tx=0x7f9714009b80 comp rx=0 tx=0).stop 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.986+0000 7f9724656700 1 -- 172.21.15.46:0/3027171927 shutdown_connections 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.986+0000 7f9724656700 1 --2- 172.21.15.46:0/3027171927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c105de0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.986+0000 7f9724656700 1 -- 172.21.15.46:0/3027171927 >> 172.21.15.46:0/3027171927 conn(0x7f971c101020 msgr2=0x7f971c103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.987+0000 7f9724656700 1 -- 172.21.15.46:0/3027171927 shutdown_connections 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.987+0000 7f9724656700 1 -- 172.21.15.46:0/3027171927 wait complete. 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.987+0000 7f9724656700 1 Processor -- start 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.987+0000 7f9724656700 1 -- start start 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.987+0000 7f9724656700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.987+0000 7f9724656700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c199ba0 con 0x7f971c1059d0 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.987+0000 7f97223f2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:15.741 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.987+0000 7f97223f2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44360/0 (socket says 172.21.15.46:44360) 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.987+0000 7f97223f2700 1 -- 172.21.15.46:0/815716436 learned_addr learned my addr 172.21.15.46:0/815716436 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.988+0000 7f97223f2700 1 -- 172.21.15.46:0/815716436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9714009500 con 0x7f971c1059d0 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.988+0000 7f97223f2700 1 --2- 172.21.15.46:0/815716436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c199660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9714006160 tx=0x7f9714006190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.988+0000 7f971b7fe700 1 -- 172.21.15.46:0/815716436 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9714004430 con 0x7f971c1059d0 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.988+0000 7f971b7fe700 1 -- 172.21.15.46:0/815716436 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9714006760 con 0x7f971c1059d0 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.988+0000 7f9724656700 1 -- 172.21.15.46:0/815716436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c199da0 con 0x7f971c1059d0 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.988+0000 7f971b7fe700 1 -- 172.21.15.46:0/815716436 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9714011d00 con 0x7f971c1059d0 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.988+0000 7f9724656700 1 -- 172.21.15.46:0/815716436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c19a240 con 0x7f971c1059d0 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.989+0000 7f971b7fe700 1 -- 172.21.15.46:0/815716436 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9714018070 con 0x7f971c1059d0 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.989+0000 7f9724656700 1 -- 172.21.15.46:0/815716436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c062380 con 0x7f971c1059d0 2024-02-19T18:52:15.742 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.989+0000 7f971b7fe700 1 --2- 172.21.15.46:0/815716436 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f97040383b0 0x7f970403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.989+0000 7f971b7fe700 1 -- 172.21.15.46:0/815716436 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f971404bc80 con 0x7f971c1059d0 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.990+0000 7f9721bf1700 1 --2- 172.21.15.46:0/815716436 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f97040383b0 0x7f970403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.990+0000 7f9721bf1700 1 --2- 172.21.15.46:0/815716436 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f97040383b0 0x7f970403a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9710006fd0 tx=0x7f9710006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:14.994+0000 7f971b7fe700 1 -- 172.21.15.46:0/815716436 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f971401b740 con 0x7f971c1059d0 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.194+0000 7f9724656700 1 -- 172.21.15.46:0/815716436 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f971c102440 con 0x7f97040383b0 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.195+0000 7f971b7fe700 1 -- 172.21.15.46:0/815716436 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f971c102440 con 0x7f97040383b0 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.197+0000 7f9724656700 1 -- 172.21.15.46:0/815716436 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f97040383b0 msgr2=0x7f970403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.197+0000 7f9724656700 1 --2- 172.21.15.46:0/815716436 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f97040383b0 0x7f970403a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9710006fd0 tx=0x7f9710006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.197+0000 7f9724656700 1 -- 172.21.15.46:0/815716436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 msgr2=0x7f971c199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.197+0000 7f9724656700 1 --2- 172.21.15.46:0/815716436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c199660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9714006160 tx=0x7f9714006190 comp rx=0 tx=0).stop 2024-02-19T18:52:15.743 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.197+0000 7f9724656700 1 -- 172.21.15.46:0/815716436 shutdown_connections 2024-02-19T18:52:15.744 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.197+0000 7f9724656700 1 --2- 172.21.15.46:0/815716436 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f97040383b0 0x7f970403a860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:15.744 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.197+0000 7f9724656700 1 --2- 172.21.15.46:0/815716436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f971c1059d0 0x7f971c199660 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:15.744 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.197+0000 7f9724656700 1 -- 172.21.15.46:0/815716436 >> 172.21.15.46:0/815716436 conn(0x7f971c101020 msgr2=0x7f971c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:15.744 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.197+0000 7f9724656700 1 -- 172.21.15.46:0/815716436 shutdown_connections 2024-02-19T18:52:15.744 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:15.197+0000 7f9724656700 1 -- 172.21.15.46:0/815716436 wait complete. 2024-02-19T18:52:15.744 INFO:teuthology.orchestra.run.smithi046.stdout:Generating ssh key... 2024-02-19T18:52:16.125 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:16 smithi046 ceph-mon[29647]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:17 smithi046 ceph-mon[29647]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:17.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:17 smithi046 ceph-mon[29647]: Generating ssh key... 2024-02-19T18:52:17.878 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.144+0000 7f5a77a64700 1 Processor -- start 2024-02-19T18:52:17.878 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.144+0000 7f5a77a64700 1 -- start start 2024-02-19T18:52:17.878 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.144+0000 7f5a77a64700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:17.878 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.144+0000 7f5a77a64700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70105230 con 0x7f5a701048e0 2024-02-19T18:52:17.878 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.144+0000 7f5a75800700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.144+0000 7f5a75800700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44364/0 (socket says 172.21.15.46:44364) 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.144+0000 7f5a75800700 1 -- 172.21.15.46:0/3916939593 learned_addr learned my addr 172.21.15.46:0/3916939593 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.145+0000 7f5a75800700 1 -- 172.21.15.46:0/3916939593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70105370 con 0x7f5a701048e0 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.145+0000 7f5a75800700 1 --2- 172.21.15.46:0/3916939593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70104cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0098a0 tx=0x7f5a6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba902918b2b678c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.145+0000 7f5a67fff700 1 -- 172.21.15.46:0/3916939593 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a6c004180 con 0x7f5a701048e0 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.145+0000 7f5a67fff700 1 -- 172.21.15.46:0/3916939593 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5a6c0042e0 con 0x7f5a701048e0 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.145+0000 7f5a67fff700 1 -- 172.21.15.46:0/3916939593 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a6c011a50 con 0x7f5a701048e0 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.146+0000 7f5a77a64700 1 -- 172.21.15.46:0/3916939593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 msgr2=0x7f5a70104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.146+0000 7f5a77a64700 1 --2- 172.21.15.46:0/3916939593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70104cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0098a0 tx=0x7f5a6c009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.146+0000 7f5a77a64700 1 -- 172.21.15.46:0/3916939593 shutdown_connections 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.146+0000 7f5a77a64700 1 --2- 172.21.15.46:0/3916939593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70104cf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.146+0000 7f5a77a64700 1 -- 172.21.15.46:0/3916939593 >> 172.21.15.46:0/3916939593 conn(0x7f5a700fff10 msgr2=0x7f5a70102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:17.879 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.146+0000 7f5a77a64700 1 -- 172.21.15.46:0/3916939593 shutdown_connections 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.146+0000 7f5a77a64700 1 -- 172.21.15.46:0/3916939593 wait complete. 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.146+0000 7f5a77a64700 1 Processor -- start 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.146+0000 7f5a77a64700 1 -- start start 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a77a64700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a77a64700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70199c90 con 0x7f5a701048e0 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a75800700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a75800700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44370/0 (socket says 172.21.15.46:44370) 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a75800700 1 -- 172.21.15.46:0/1976611272 learned_addr learned my addr 172.21.15.46:0/1976611272 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a75800700 1 -- 172.21.15.46:0/1976611272 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c009550 con 0x7f5a701048e0 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a75800700 1 --2- 172.21.15.46:0/1976611272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70199750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c003de0 tx=0x7f5a6c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a667fc700 1 -- 172.21.15.46:0/1976611272 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a6c003930 con 0x7f5a701048e0 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a667fc700 1 -- 172.21.15.46:0/1976611272 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5a6c003a90 con 0x7f5a701048e0 2024-02-19T18:52:17.880 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a77a64700 1 -- 172.21.15.46:0/1976611272 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a70199e90 con 0x7f5a701048e0 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a667fc700 1 -- 172.21.15.46:0/1976611272 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a6c019730 con 0x7f5a701048e0 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.147+0000 7f5a77a64700 1 -- 172.21.15.46:0/1976611272 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7019a330 con 0x7f5a701048e0 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.148+0000 7f5a667fc700 1 -- 172.21.15.46:0/1976611272 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f5a6c01a430 con 0x7f5a701048e0 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.149+0000 7f5a667fc700 1 --2- 172.21.15.46:0/1976611272 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f5a5c038440 0x7f5a5c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.149+0000 7f5a667fc700 1 -- 172.21.15.46:0/1976611272 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5a6c04c430 con 0x7f5a701048e0 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.149+0000 7f5a77a64700 1 -- 172.21.15.46:0/1976611272 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a70062380 con 0x7f5a701048e0 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.149+0000 7f5a74fff700 1 --2- 172.21.15.46:0/1976611272 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f5a5c038440 0x7f5a5c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.149+0000 7f5a74fff700 1 --2- 172.21.15.46:0/1976611272 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f5a5c038440 0x7f5a5c03a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5a60006fd0 tx=0x7f5a60006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.154+0000 7f5a667fc700 1 -- 172.21.15.46:0/1976611272 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5a6c01a730 con 0x7f5a701048e0 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:16.353+0000 7f5a77a64700 1 -- 172.21.15.46:0/1976611272 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a70102110 con 0x7f5a5c038440 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.297+0000 7f5a667fc700 1 -- 172.21.15.46:0/1976611272 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5a70102110 con 0x7f5a5c038440 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.299+0000 7f5a77a64700 1 -- 172.21.15.46:0/1976611272 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f5a5c038440 msgr2=0x7f5a5c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.299+0000 7f5a77a64700 1 --2- 172.21.15.46:0/1976611272 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f5a5c038440 0x7f5a5c03a8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5a60006fd0 tx=0x7f5a60006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:17.881 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.299+0000 7f5a77a64700 1 -- 172.21.15.46:0/1976611272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 msgr2=0x7f5a70199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:17.882 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.299+0000 7f5a77a64700 1 --2- 172.21.15.46:0/1976611272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70199750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c003de0 tx=0x7f5a6c011ab0 comp rx=0 tx=0).stop 2024-02-19T18:52:17.882 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.299+0000 7f5a77a64700 1 -- 172.21.15.46:0/1976611272 shutdown_connections 2024-02-19T18:52:17.882 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.299+0000 7f5a77a64700 1 --2- 172.21.15.46:0/1976611272 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f5a5c038440 0x7f5a5c03a8f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:17.882 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.299+0000 7f5a77a64700 1 --2- 172.21.15.46:0/1976611272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a701048e0 0x7f5a70199750 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:17.882 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.299+0000 7f5a77a64700 1 -- 172.21.15.46:0/1976611272 >> 172.21.15.46:0/1976611272 conn(0x7f5a700fff10 msgr2=0x7f5a70074050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:17.882 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.299+0000 7f5a77a64700 1 -- 172.21.15.46:0/1976611272 shutdown_connections 2024-02-19T18:52:17.882 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:17.299+0000 7f5a77a64700 1 -- 172.21.15.46:0/1976611272 wait complete. 2024-02-19T18:52:18.472 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:18 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:18.472 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:18 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:19.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDngxJ+Pt0PgrICWORjlMNZUZ3lB+5VhmPXAqnuq2OIRdwahK1+iNBdnhYNRCw37IJxyMtPisxJ4vgnvCBihg+qHOl46Wt6i49Hzf5a9dLKvlAYf5ulxQoIwztT+7HbU/IuBNLXajZgoYNZf7kqRfIVWpvrimVo2rtra1RytzL5C3fwvmveAedA1a8QkMBGpl3jxiu/MNZ+EQw2VSS6sT+feV6rHZqiyIR3McSCIt5HqnmfU1vunPG0mrfVxDet2Qod7q2MT4Y1zFNh2k42FHa0nUaO/BSWIOdOvhGu5JmF15/yMK5hHC7PuGOLOSkpp3l+TVboL1aBhBq5a150Ix2AKmqbIkN71zMzP5Hp4ayVDGolWuqKIp4Veciz9Y7EOhquUvf0dqNd7HHFrnzcM2JpzS3GJ5xp3EIvXQwDljEC4Kk4XWIA5sVkOPbkL0KUNVMaIdye/0SfyDP9LBYepHFySFbXSWFVJDmRzbzIB7FQN/AT5wuZe2FiDgn/VRpVVHU= ceph-c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:52:19.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.248+0000 7ff6dc2fc700 1 Processor -- start 2024-02-19T18:52:19.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.248+0000 7ff6dc2fc700 1 -- start start 2024-02-19T18:52:19.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.249+0000 7ff6dc2fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d41040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:19.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.249+0000 7ff6dc2fc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4104600 con 0x7ff6d4103cb0 2024-02-19T18:52:19.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.249+0000 7ff6da098700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d41040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:19.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.249+0000 7ff6da098700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d41040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50326/0 (socket says 172.21.15.46:50326) 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.249+0000 7ff6da098700 1 -- 172.21.15.46:0/639126109 learned_addr learned my addr 172.21.15.46:0/639126109 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.249+0000 7ff6da098700 1 -- 172.21.15.46:0/639126109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d4104740 con 0x7ff6d4103cb0 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.249+0000 7ff6da098700 1 --2- 172.21.15.46:0/639126109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d41040c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00098a0 tx=0x7ff6d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76419a85c13bf93 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.249+0000 7ff6d9096700 1 -- 172.21.15.46:0/639126109 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6d0004180 con 0x7ff6d4103cb0 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.250+0000 7ff6d9096700 1 -- 172.21.15.46:0/639126109 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff6d00042e0 con 0x7ff6d4103cb0 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.250+0000 7ff6d9096700 1 -- 172.21.15.46:0/639126109 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6d0011a50 con 0x7ff6d4103cb0 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.250+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/639126109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 msgr2=0x7ff6d41040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.250+0000 7ff6dc2fc700 1 --2- 172.21.15.46:0/639126109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d41040c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00098a0 tx=0x7ff6d0009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.250+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/639126109 shutdown_connections 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.250+0000 7ff6dc2fc700 1 --2- 172.21.15.46:0/639126109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d41040c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.250+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/639126109 >> 172.21.15.46:0/639126109 conn(0x7ff6d40ff670 msgr2=0x7ff6d4101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.250+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/639126109 shutdown_connections 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.250+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/639126109 wait complete. 2024-02-19T18:52:19.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.251+0000 7ff6dc2fc700 1 Processor -- start 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.251+0000 7ff6dc2fc700 1 -- start start 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.251+0000 7ff6dc2fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d4199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.251+0000 7ff6dc2fc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4199c90 con 0x7ff6d4103cb0 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.251+0000 7ff6da098700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d4199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.251+0000 7ff6da098700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d4199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50336/0 (socket says 172.21.15.46:50336) 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.251+0000 7ff6da098700 1 -- 172.21.15.46:0/1629075962 learned_addr learned my addr 172.21.15.46:0/1629075962 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.251+0000 7ff6da098700 1 -- 172.21.15.46:0/1629075962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d0009550 con 0x7ff6d4103cb0 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.252+0000 7ff6da098700 1 --2- 172.21.15.46:0/1629075962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d4199750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0003de0 tx=0x7ff6d0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.252+0000 7ff6cb7fe700 1 -- 172.21.15.46:0/1629075962 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6d0003930 con 0x7ff6d4103cb0 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.252+0000 7ff6cb7fe700 1 -- 172.21.15.46:0/1629075962 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff6d0003a90 con 0x7ff6d4103cb0 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.252+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/1629075962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d4199e90 con 0x7ff6d4103cb0 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.252+0000 7ff6cb7fe700 1 -- 172.21.15.46:0/1629075962 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6d00196c0 con 0x7ff6d4103cb0 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.252+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/1629075962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d419a330 con 0x7ff6d4103cb0 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.253+0000 7ff6cb7fe700 1 -- 172.21.15.46:0/1629075962 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff6d0019930 con 0x7ff6d4103cb0 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.253+0000 7ff6cb7fe700 1 --2- 172.21.15.46:0/1629075962 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7ff6c0038440 0x7ff6c003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:19.054 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.253+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/1629075962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d4107870 con 0x7ff6d4103cb0 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.253+0000 7ff6cb7fe700 1 -- 172.21.15.46:0/1629075962 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff6d004c3e0 con 0x7ff6d4103cb0 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.253+0000 7ff6d9897700 1 --2- 172.21.15.46:0/1629075962 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7ff6c0038440 0x7ff6c003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.253+0000 7ff6d9897700 1 --2- 172.21.15.46:0/1629075962 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7ff6c0038440 0x7ff6c003a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4006fd0 tx=0x7ff6c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.258+0000 7ff6cb7fe700 1 -- 172.21.15.46:0/1629075962 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff6d0019c30 con 0x7ff6d4103cb0 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.456+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/1629075962 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6d41019c0 con 0x7ff6c0038440 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.457+0000 7ff6cb7fe700 1 -- 172.21.15.46:0/1629075962 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7ff6d41019c0 con 0x7ff6c0038440 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.459+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/1629075962 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7ff6c0038440 msgr2=0x7ff6c003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.459+0000 7ff6dc2fc700 1 --2- 172.21.15.46:0/1629075962 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7ff6c0038440 0x7ff6c003a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4006fd0 tx=0x7ff6c4006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.459+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/1629075962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 msgr2=0x7ff6d4199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.459+0000 7ff6dc2fc700 1 --2- 172.21.15.46:0/1629075962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d4199750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0003de0 tx=0x7ff6d0011ab0 comp rx=0 tx=0).stop 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.459+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/1629075962 shutdown_connections 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.459+0000 7ff6dc2fc700 1 --2- 172.21.15.46:0/1629075962 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7ff6c0038440 0x7ff6c003a8f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.459+0000 7ff6dc2fc700 1 --2- 172.21.15.46:0/1629075962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff6d4103cb0 0x7ff6d4199750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.459+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/1629075962 >> 172.21.15.46:0/1629075962 conn(0x7ff6d40ff670 msgr2=0x7ff6d4100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.459+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/1629075962 shutdown_connections 2024-02-19T18:52:19.055 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:18.459+0000 7ff6dc2fc700 1 -- 172.21.15.46:0/1629075962 wait complete. 2024-02-19T18:52:19.056 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-19T18:52:19.056 INFO:teuthology.orchestra.run.smithi046.stdout:Adding key to root@localhost authorized_keys... 2024-02-19T18:52:19.056 INFO:teuthology.orchestra.run.smithi046.stdout:Adding host smithi046... 2024-02-19T18:52:19.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:19 smithi046 ceph-mon[29647]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:21.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:20 smithi046 ceph-mon[29647]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi046", "addr": "172.21.15.46", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:22.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:21 smithi046 ceph-mon[29647]: Deploying cephadm binary to smithi046 2024-02-19T18:52:22.944 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Added host 'smithi046' with addr '172.21.15.46' 2024-02-19T18:52:22.944 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.494+0000 7f043d7f9700 1 Processor -- start 2024-02-19T18:52:22.944 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.494+0000 7f043d7f9700 1 -- start start 2024-02-19T18:52:22.944 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.494+0000 7f043d7f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f0438106340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.494+0000 7f043d7f9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0438106880 con 0x7f0438105f30 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.494+0000 7f0436ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f0438106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.494+0000 7f0436ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f0438106340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50350/0 (socket says 172.21.15.46:50350) 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.494+0000 7f0436ffd700 1 -- 172.21.15.46:0/3795282671 learned_addr learned my addr 172.21.15.46:0/3795282671 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.495+0000 7f0436ffd700 1 -- 172.21.15.46:0/3795282671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04381069c0 con 0x7f0438105f30 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.495+0000 7f0436ffd700 1 --2- 172.21.15.46:0/3795282671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f0438106340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0428009e80 tx=0x7f042800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f76c1d89d8b343 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.495+0000 7f0435ffb700 1 -- 172.21.15.46:0/3795282671 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f042800e070 con 0x7f0438105f30 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.495+0000 7f0435ffb700 1 -- 172.21.15.46:0/3795282671 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0428003e90 con 0x7f0438105f30 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.495+0000 7f0435ffb700 1 -- 172.21.15.46:0/3795282671 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0428004380 con 0x7f0438105f30 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.496+0000 7f043d7f9700 1 -- 172.21.15.46:0/3795282671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 msgr2=0x7f0438106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:22.945 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.496+0000 7f043d7f9700 1 --2- 172.21.15.46:0/3795282671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f0438106340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0428009e80 tx=0x7f042800b330 comp rx=0 tx=0).stop 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.496+0000 7f043d7f9700 1 -- 172.21.15.46:0/3795282671 shutdown_connections 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.496+0000 7f043d7f9700 1 --2- 172.21.15.46:0/3795282671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f0438106340 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.496+0000 7f043d7f9700 1 -- 172.21.15.46:0/3795282671 >> 172.21.15.46:0/3795282671 conn(0x7f04380ff670 msgr2=0x7f0438101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.496+0000 7f043d7f9700 1 -- 172.21.15.46:0/3795282671 shutdown_connections 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.496+0000 7f043d7f9700 1 -- 172.21.15.46:0/3795282671 wait complete. 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.496+0000 7f043d7f9700 1 Processor -- start 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.497+0000 7f043d7f9700 1 -- start start 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.497+0000 7f043d7f9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f043819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.497+0000 7f043d7f9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043819be60 con 0x7f0438105f30 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.497+0000 7f0436ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f043819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.497+0000 7f0436ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f043819b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50354/0 (socket says 172.21.15.46:50354) 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.497+0000 7f0436ffd700 1 -- 172.21.15.46:0/649985174 learned_addr learned my addr 172.21.15.46:0/649985174 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:22.946 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.497+0000 7f0436ffd700 1 -- 172.21.15.46:0/649985174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0428009b30 con 0x7f0438105f30 2024-02-19T18:52:22.947 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.497+0000 7f0436ffd700 1 --2- 172.21.15.46:0/649985174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f043819b920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f042800d010 tx=0x7f0428004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:22.947 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.497+0000 7f042ffff700 1 -- 172.21.15.46:0/649985174 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f042800e040 con 0x7f0438105f30 2024-02-19T18:52:22.947 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.498+0000 7f043d7f9700 1 -- 172.21.15.46:0/649985174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043819c060 con 0x7f0438105f30 2024-02-19T18:52:22.947 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.498+0000 7f042ffff700 1 -- 172.21.15.46:0/649985174 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0428003c30 con 0x7f0438105f30 2024-02-19T18:52:22.947 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.498+0000 7f042ffff700 1 -- 172.21.15.46:0/649985174 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f042801b790 con 0x7f0438105f30 2024-02-19T18:52:22.947 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.498+0000 7f043d7f9700 1 -- 172.21.15.46:0/649985174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043819c560 con 0x7f0438105f30 2024-02-19T18:52:22.947 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.498+0000 7f042ffff700 1 -- 172.21.15.46:0/649985174 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f0428019040 con 0x7f0438105f30 2024-02-19T18:52:22.947 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.498+0000 7f043d7f9700 1 -- 172.21.15.46:0/649985174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043810bc80 con 0x7f0438105f30 2024-02-19T18:52:22.947 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.499+0000 7f042ffff700 1 --2- 172.21.15.46:0/649985174 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f0424038400 0x7f042403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:22.947 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.499+0000 7f042ffff700 1 -- 172.21.15.46:0/649985174 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f042804bf30 con 0x7f0438105f30 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.499+0000 7f04367fc700 1 --2- 172.21.15.46:0/649985174 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f0424038400 0x7f042403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.499+0000 7f04367fc700 1 --2- 172.21.15.46:0/649985174 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f0424038400 0x7f042403a8b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0420006fd0 tx=0x7f0420006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.503+0000 7f042ffff700 1 -- 172.21.15.46:0/649985174 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0428023b60 con 0x7f0438105f30 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:19.708+0000 7f043d7f9700 1 -- 172.21.15.46:0/649985174 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi046", "addr": "172.21.15.46", "target": ["mon-mgr", ""]}) v1 -- 0x7f0438101980 con 0x7f0424038400 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.355+0000 7f042ffff700 1 -- 172.21.15.46:0/649985174 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f0438101980 con 0x7f0424038400 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.358+0000 7f043d7f9700 1 -- 172.21.15.46:0/649985174 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f0424038400 msgr2=0x7f042403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.358+0000 7f043d7f9700 1 --2- 172.21.15.46:0/649985174 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f0424038400 0x7f042403a8b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0420006fd0 tx=0x7f0420006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.358+0000 7f043d7f9700 1 -- 172.21.15.46:0/649985174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 msgr2=0x7f043819b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.358+0000 7f043d7f9700 1 --2- 172.21.15.46:0/649985174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f043819b920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f042800d010 tx=0x7f0428004430 comp rx=0 tx=0).stop 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.358+0000 7f043d7f9700 1 -- 172.21.15.46:0/649985174 shutdown_connections 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.358+0000 7f043d7f9700 1 --2- 172.21.15.46:0/649985174 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f0424038400 0x7f042403a8b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:22.948 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.358+0000 7f043d7f9700 1 --2- 172.21.15.46:0/649985174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0438105f30 0x7f043819b920 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:22.949 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.358+0000 7f043d7f9700 1 -- 172.21.15.46:0/649985174 >> 172.21.15.46:0/649985174 conn(0x7f04380ff670 msgr2=0x7f0438100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:22.949 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.358+0000 7f043d7f9700 1 -- 172.21.15.46:0/649985174 shutdown_connections 2024-02-19T18:52:22.949 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:22.358+0000 7f043d7f9700 1 -- 172.21.15.46:0/649985174 wait complete. 2024-02-19T18:52:22.949 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying mon service with default placement... 2024-02-19T18:52:23.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:23 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:23.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:23 smithi046 ceph-mon[29647]: Added host smithi046 2024-02-19T18:52:23.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:23 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:52:24.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:24 smithi046 ceph-mon[29647]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:24.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:24 smithi046 ceph-mon[29647]: Saving service mon spec with placement count:5 2024-02-19T18:52:24.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:24 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:24.997 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-19T18:52:24.997 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.301+0000 7fd4b433c700 1 Processor -- start 2024-02-19T18:52:24.997 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.301+0000 7fd4b433c700 1 -- start start 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.301+0000 7fd4b433c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac07a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.301+0000 7fd4b433c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac07a810 con 0x7fd4ac07bdd0 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.301+0000 7fd4b20d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac07a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.301+0000 7fd4b20d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac07a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50358/0 (socket says 172.21.15.46:50358) 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.301+0000 7fd4b20d8700 1 -- 172.21.15.46:0/664579993 learned_addr learned my addr 172.21.15.46:0/664579993 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.301+0000 7fd4b20d8700 1 -- 172.21.15.46:0/664579993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac07a950 con 0x7fd4ac07bdd0 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.302+0000 7fd4b20d8700 1 --2- 172.21.15.46:0/664579993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac07a2d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009870 tx=0x7fd4a8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d8e16464084afb server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.302+0000 7fd4b10d6700 1 -- 172.21.15.46:0/664579993 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4a8005c30 con 0x7fd4ac07bdd0 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.302+0000 7fd4b10d6700 1 -- 172.21.15.46:0/664579993 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd4a8005d90 con 0x7fd4ac07bdd0 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.302+0000 7fd4b10d6700 1 -- 172.21.15.46:0/664579993 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4a8006030 con 0x7fd4ac07bdd0 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.302+0000 7fd4b433c700 1 -- 172.21.15.46:0/664579993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 msgr2=0x7fd4ac07a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:24.998 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.302+0000 7fd4b433c700 1 --2- 172.21.15.46:0/664579993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac07a2d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009870 tx=0x7fd4a8009b80 comp rx=0 tx=0).stop 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b433c700 1 -- 172.21.15.46:0/664579993 shutdown_connections 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b433c700 1 --2- 172.21.15.46:0/664579993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac07a2d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b433c700 1 -- 172.21.15.46:0/664579993 >> 172.21.15.46:0/664579993 conn(0x7fd4ac101020 msgr2=0x7fd4ac103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b433c700 1 -- 172.21.15.46:0/664579993 shutdown_connections 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b433c700 1 -- 172.21.15.46:0/664579993 wait complete. 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b433c700 1 Processor -- start 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b433c700 1 -- start start 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b433c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b433c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac19be00 con 0x7fd4ac07bdd0 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b20d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b20d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac19b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50366/0 (socket says 172.21.15.46:50366) 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.303+0000 7fd4b20d8700 1 -- 172.21.15.46:0/4106565851 learned_addr learned my addr 172.21.15.46:0/4106565851 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.304+0000 7fd4b20d8700 1 -- 172.21.15.46:0/4106565851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a8009500 con 0x7fd4ac07bdd0 2024-02-19T18:52:24.999 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.304+0000 7fd4b20d8700 1 --2- 172.21.15.46:0/4106565851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac19b8c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80038f0 tx=0x7fd4a80061e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.304+0000 7fd4a37fe700 1 -- 172.21.15.46:0/4106565851 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4a8004310 con 0x7fd4ac07bdd0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.304+0000 7fd4a37fe700 1 -- 172.21.15.46:0/4106565851 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd4a8004470 con 0x7fd4ac07bdd0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.304+0000 7fd4b433c700 1 -- 172.21.15.46:0/4106565851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac19c000 con 0x7fd4ac07bdd0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.304+0000 7fd4a37fe700 1 -- 172.21.15.46:0/4106565851 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4a8011c90 con 0x7fd4ac07bdd0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.304+0000 7fd4b433c700 1 -- 172.21.15.46:0/4106565851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac19c4a0 con 0x7fd4ac07bdd0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.305+0000 7fd4a37fe700 1 -- 172.21.15.46:0/4106565851 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fd4a8018070 con 0x7fd4ac07bdd0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.305+0000 7fd4b433c700 1 -- 172.21.15.46:0/4106565851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac10bca0 con 0x7fd4ac07bdd0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.305+0000 7fd4a37fe700 1 --2- 172.21.15.46:0/4106565851 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fd4980383b0 0x7fd49803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.305+0000 7fd4a37fe700 1 -- 172.21.15.46:0/4106565851 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd4a804b940 con 0x7fd4ac07bdd0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.305+0000 7fd4b18d7700 1 --2- 172.21.15.46:0/4106565851 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fd4980383b0 0x7fd49803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.306+0000 7fd4b18d7700 1 --2- 172.21.15.46:0/4106565851 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fd4980383b0 0x7fd49803a860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd49c006fd0 tx=0x7fd49c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:25.000 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.310+0000 7fd4a37fe700 1 -- 172.21.15.46:0/4106565851 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd4a80186a0 con 0x7fd4ac07bdd0 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.530+0000 7fd4b433c700 1 -- 172.21.15.46:0/4106565851 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4ac102500 con 0x7fd4980383b0 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.535+0000 7fd4a37fe700 1 -- 172.21.15.46:0/4106565851 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd4ac102500 con 0x7fd4980383b0 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.537+0000 7fd4b433c700 1 -- 172.21.15.46:0/4106565851 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fd4980383b0 msgr2=0x7fd49803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.537+0000 7fd4b433c700 1 --2- 172.21.15.46:0/4106565851 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fd4980383b0 0x7fd49803a860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd49c006fd0 tx=0x7fd49c006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.537+0000 7fd4b433c700 1 -- 172.21.15.46:0/4106565851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 msgr2=0x7fd4ac19b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.537+0000 7fd4b433c700 1 --2- 172.21.15.46:0/4106565851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac19b8c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80038f0 tx=0x7fd4a80061e0 comp rx=0 tx=0).stop 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.537+0000 7fd4b433c700 1 -- 172.21.15.46:0/4106565851 shutdown_connections 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.537+0000 7fd4b433c700 1 --2- 172.21.15.46:0/4106565851 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fd4980383b0 0x7fd49803a860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.537+0000 7fd4b433c700 1 --2- 172.21.15.46:0/4106565851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4ac07bdd0 0x7fd4ac19b8c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.537+0000 7fd4b433c700 1 -- 172.21.15.46:0/4106565851 >> 172.21.15.46:0/4106565851 conn(0x7fd4ac101020 msgr2=0x7fd4ac101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.537+0000 7fd4b433c700 1 -- 172.21.15.46:0/4106565851 shutdown_connections 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:23.537+0000 7fd4b433c700 1 -- 172.21.15.46:0/4106565851 wait complete. 2024-02-19T18:52:25.001 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying mgr service with default placement... 2024-02-19T18:52:25.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:25 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:25.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:25 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:26.477 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-19T18:52:26.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.421+0000 7f7911013700 1 Processor -- start 2024-02-19T18:52:26.482 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.421+0000 7f7911013700 1 -- start start 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.421+0000 7f7911013700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c108930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.421+0000 7f7911013700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0744b0 con 0x7f790c106550 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.422+0000 7f790ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c108930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.422+0000 7f790ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c108930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50372/0 (socket says 172.21.15.46:50372) 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.422+0000 7f790ad9d700 1 -- 172.21.15.46:0/3721601707 learned_addr learned my addr 172.21.15.46:0/3721601707 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.422+0000 7f790ad9d700 1 -- 172.21.15.46:0/3721601707 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0745f0 con 0x7f790c106550 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.422+0000 7f790ad9d700 1 --2- 172.21.15.46:0/3721601707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c108930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098a0 tx=0x7f78fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7092adbd9cf457 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.423+0000 7f7909d9b700 1 -- 172.21.15.46:0/3721601707 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78fc004180 con 0x7f790c106550 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.423+0000 7f7909d9b700 1 -- 172.21.15.46:0/3721601707 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f78fc0042e0 con 0x7f790c106550 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.423+0000 7f7909d9b700 1 -- 172.21.15.46:0/3721601707 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78fc011af0 con 0x7f790c106550 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.423+0000 7f7911013700 1 -- 172.21.15.46:0/3721601707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 msgr2=0x7f790c108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.423+0000 7f7911013700 1 --2- 172.21.15.46:0/3721601707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c108930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0098a0 tx=0x7f78fc009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.423+0000 7f7911013700 1 -- 172.21.15.46:0/3721601707 shutdown_connections 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.423+0000 7f7911013700 1 --2- 172.21.15.46:0/3721601707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c108930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.423+0000 7f7911013700 1 -- 172.21.15.46:0/3721601707 >> 172.21.15.46:0/3721601707 conn(0x7f790c0fff10 msgr2=0x7f790c102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.423+0000 7f7911013700 1 -- 172.21.15.46:0/3721601707 shutdown_connections 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.423+0000 7f7911013700 1 -- 172.21.15.46:0/3721601707 wait complete. 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.424+0000 7f7911013700 1 Processor -- start 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.424+0000 7f7911013700 1 -- start start 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.424+0000 7f7911013700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.424+0000 7f7911013700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c199ca0 con 0x7f790c106550 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.425+0000 7f790ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.425+0000 7f790ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50376/0 (socket says 172.21.15.46:50376) 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.425+0000 7f790ad9d700 1 -- 172.21.15.46:0/1310144112 learned_addr learned my addr 172.21.15.46:0/1310144112 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.425+0000 7f790ad9d700 1 -- 172.21.15.46:0/1310144112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc009550 con 0x7f790c106550 2024-02-19T18:52:26.484 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.425+0000 7f790ad9d700 1 --2- 172.21.15.46:0/1310144112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c199760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f78fc011670 tx=0x7f78fc011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.425+0000 7f78f3fff700 1 -- 172.21.15.46:0/1310144112 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78fc0039f0 con 0x7f790c106550 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.425+0000 7f7911013700 1 -- 172.21.15.46:0/1310144112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c199de0 con 0x7f790c106550 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.425+0000 7f78f3fff700 1 -- 172.21.15.46:0/1310144112 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f78fc003b50 con 0x7f790c106550 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.425+0000 7f78f3fff700 1 -- 172.21.15.46:0/1310144112 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78fc0247c0 con 0x7f790c106550 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.425+0000 7f7911013700 1 -- 172.21.15.46:0/1310144112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c19a280 con 0x7f790c106550 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.426+0000 7f78f3fff700 1 -- 172.21.15.46:0/1310144112 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f78fc02d3f0 con 0x7f790c106550 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.426+0000 7f78f3fff700 1 --2- 172.21.15.46:0/1310144112 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f78f40383f0 0x7f78f403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.426+0000 7f78f3fff700 1 -- 172.21.15.46:0/1310144112 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f78fc04d400 con 0x7f790c106550 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.426+0000 7f7911013700 1 -- 172.21.15.46:0/1310144112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c0623f0 con 0x7f790c106550 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.426+0000 7f790a59c700 1 --2- 172.21.15.46:0/1310144112 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f78f40383f0 0x7f78f403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.427+0000 7f790a59c700 1 --2- 172.21.15.46:0/1310144112 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f78f40383f0 0x7f78f403a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7900006fd0 tx=0x7f7900006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:26.485 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.432+0000 7f78f3fff700 1 -- 172.21.15.46:0/1310144112 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f790c0623f0 con 0x7f790c106550 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.655+0000 7f7911013700 1 -- 172.21.15.46:0/1310144112 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f790c0623f0 con 0x7f78f40383f0 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.659+0000 7f78f3fff700 1 -- 172.21.15.46:0/1310144112 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f790c0623f0 con 0x7f78f40383f0 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.661+0000 7f7911013700 1 -- 172.21.15.46:0/1310144112 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f78f40383f0 msgr2=0x7f78f403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.661+0000 7f7911013700 1 --2- 172.21.15.46:0/1310144112 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f78f40383f0 0x7f78f403a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7900006fd0 tx=0x7f7900006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.661+0000 7f7911013700 1 -- 172.21.15.46:0/1310144112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 msgr2=0x7f790c199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.661+0000 7f7911013700 1 --2- 172.21.15.46:0/1310144112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c199760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f78fc011670 tx=0x7f78fc011b50 comp rx=0 tx=0).stop 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.662+0000 7f7911013700 1 -- 172.21.15.46:0/1310144112 shutdown_connections 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.662+0000 7f7911013700 1 --2- 172.21.15.46:0/1310144112 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f78f40383f0 0x7f78f403a8a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.662+0000 7f7911013700 1 --2- 172.21.15.46:0/1310144112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f790c106550 0x7f790c199760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.662+0000 7f7911013700 1 -- 172.21.15.46:0/1310144112 >> 172.21.15.46:0/1310144112 conn(0x7f790c0fff10 msgr2=0x7f790c101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.662+0000 7f7911013700 1 -- 172.21.15.46:0/1310144112 shutdown_connections 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:25.662+0000 7f7911013700 1 -- 172.21.15.46:0/1310144112 wait complete. 2024-02-19T18:52:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying crash service with default placement... 2024-02-19T18:52:26.792 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:26 smithi046 ceph-mon[29647]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:26.792 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:26 smithi046 ceph-mon[29647]: Saving service mgr spec with placement count:2 2024-02-19T18:52:26.792 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:26 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:27.747 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-19T18:52:27.747 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.879+0000 7f6be07e2700 1 Processor -- start 2024-02-19T18:52:27.747 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.880+0000 7f6be07e2700 1 -- start start 2024-02-19T18:52:27.747 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.880+0000 7f6be07e2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8074490 0x7f6bd8108580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:27.747 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.880+0000 7f6be07e2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8108ac0 con 0x7f6bd8074490 2024-02-19T18:52:27.747 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.880+0000 7f6bde57e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8074490 0x7f6bd8108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:27.747 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.880+0000 7f6bde57e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8074490 0x7f6bd8108580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50386/0 (socket says 172.21.15.46:50386) 2024-02-19T18:52:27.747 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.880+0000 7f6bde57e700 1 -- 172.21.15.46:0/1954625773 learned_addr learned my addr 172.21.15.46:0/1954625773 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:27.747 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.880+0000 7f6bde57e700 1 -- 172.21.15.46:0/1954625773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd8108c00 con 0x7f6bd8074490 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.880+0000 7f6bde57e700 1 --2- 172.21.15.46:0/1954625773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8074490 0x7f6bd8108580 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40098a0 tx=0x7f6bd4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ae54c183c5466a server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.881+0000 7f6bdd57c700 1 -- 172.21.15.46:0/1954625773 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd4004180 con 0x7f6bd8074490 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.881+0000 7f6bdd57c700 1 -- 172.21.15.46:0/1954625773 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6bd40042e0 con 0x7f6bd8074490 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.881+0000 7f6bdd57c700 1 -- 172.21.15.46:0/1954625773 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd4011af0 con 0x7f6bd8074490 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.881+0000 7f6be07e2700 1 -- 172.21.15.46:0/1954625773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8074490 msgr2=0x7f6bd8108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.881+0000 7f6be07e2700 1 --2- 172.21.15.46:0/1954625773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8074490 0x7f6bd8108580 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40098a0 tx=0x7f6bd4009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.882+0000 7f6be07e2700 1 -- 172.21.15.46:0/1954625773 shutdown_connections 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.882+0000 7f6be07e2700 1 --2- 172.21.15.46:0/1954625773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8074490 0x7f6bd8108580 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.882+0000 7f6be07e2700 1 -- 172.21.15.46:0/1954625773 >> 172.21.15.46:0/1954625773 conn(0x7f6bd80fff10 msgr2=0x7f6bd8102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.882+0000 7f6be07e2700 1 -- 172.21.15.46:0/1954625773 shutdown_connections 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.882+0000 7f6be07e2700 1 -- 172.21.15.46:0/1954625773 wait complete. 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.882+0000 7f6be07e2700 1 Processor -- start 2024-02-19T18:52:27.748 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.882+0000 7f6be07e2700 1 -- start start 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.882+0000 7f6be07e2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8105e90 0x7f6bd8104520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.882+0000 7f6be07e2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd81062a0 con 0x7f6bd8105e90 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.883+0000 7f6bde57e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8105e90 0x7f6bd8104520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.883+0000 7f6bde57e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8105e90 0x7f6bd8104520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50398/0 (socket says 172.21.15.46:50398) 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.883+0000 7f6bde57e700 1 -- 172.21.15.46:0/3102574737 learned_addr learned my addr 172.21.15.46:0/3102574737 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.883+0000 7f6bde57e700 1 -- 172.21.15.46:0/3102574737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4009550 con 0x7f6bd8105e90 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.883+0000 7f6bde57e700 1 --2- 172.21.15.46:0/3102574737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8105e90 0x7f6bd8104520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4011670 tx=0x7f6bd4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.883+0000 7f6bcf7fe700 1 -- 172.21.15.46:0/3102574737 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd40039f0 con 0x7f6bd8105e90 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.883+0000 7f6be07e2700 1 -- 172.21.15.46:0/3102574737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd8104a60 con 0x7f6bd8105e90 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.883+0000 7f6bcf7fe700 1 -- 172.21.15.46:0/3102574737 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6bd4003b50 con 0x7f6bd8105e90 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.883+0000 7f6bcf7fe700 1 -- 172.21.15.46:0/3102574737 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bd40247c0 con 0x7f6bd8105e90 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.883+0000 7f6be07e2700 1 -- 172.21.15.46:0/3102574737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd8104f00 con 0x7f6bd8105e90 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.884+0000 7f6bcf7fe700 1 -- 172.21.15.46:0/3102574737 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6bd401a430 con 0x7f6bd8105e90 2024-02-19T18:52:27.749 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.884+0000 7f6be07e2700 1 -- 172.21.15.46:0/3102574737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc005320 con 0x7f6bd8105e90 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.885+0000 7f6bcf7fe700 1 --2- 172.21.15.46:0/3102574737 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f6bc4038440 0x7f6bc403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.885+0000 7f6bcf7fe700 1 -- 172.21.15.46:0/3102574737 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6bd404c360 con 0x7f6bd8105e90 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.885+0000 7f6bddd7d700 1 --2- 172.21.15.46:0/3102574737 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f6bc4038440 0x7f6bc403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.885+0000 7f6bddd7d700 1 --2- 172.21.15.46:0/3102574737 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f6bc4038440 0x7f6bc403a8f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8006fd0 tx=0x7f6bc8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:26.889+0000 7f6bcf7fe700 1 -- 172.21.15.46:0/3102574737 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6bd4018b40 con 0x7f6bd8105e90 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.106+0000 7f6be07e2700 1 -- 172.21.15.46:0/3102574737 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bbc000bf0 con 0x7f6bc4038440 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.110+0000 7f6bcf7fe700 1 -- 172.21.15.46:0/3102574737 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f6bbc000bf0 con 0x7f6bc4038440 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.112+0000 7f6be07e2700 1 -- 172.21.15.46:0/3102574737 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f6bc4038440 msgr2=0x7f6bc403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.112+0000 7f6be07e2700 1 --2- 172.21.15.46:0/3102574737 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f6bc4038440 0x7f6bc403a8f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8006fd0 tx=0x7f6bc8006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.112+0000 7f6be07e2700 1 -- 172.21.15.46:0/3102574737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8105e90 msgr2=0x7f6bd8104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.112+0000 7f6be07e2700 1 --2- 172.21.15.46:0/3102574737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8105e90 0x7f6bd8104520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4011670 tx=0x7f6bd4011b50 comp rx=0 tx=0).stop 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.112+0000 7f6be07e2700 1 -- 172.21.15.46:0/3102574737 shutdown_connections 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.113+0000 7f6be07e2700 1 --2- 172.21.15.46:0/3102574737 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f6bc4038440 0x7f6bc403a8f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:27.750 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.113+0000 7f6be07e2700 1 --2- 172.21.15.46:0/3102574737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bd8105e90 0x7f6bd8104520 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:27.751 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.113+0000 7f6be07e2700 1 -- 172.21.15.46:0/3102574737 >> 172.21.15.46:0/3102574737 conn(0x7f6bd80fff10 msgr2=0x7f6bd81015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:27.751 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.113+0000 7f6be07e2700 1 -- 172.21.15.46:0/3102574737 shutdown_connections 2024-02-19T18:52:27.751 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:27.113+0000 7f6be07e2700 1 -- 172.21.15.46:0/3102574737 wait complete. 2024-02-19T18:52:27.751 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying ceph-exporter service with default placement... 2024-02-19T18:52:28.408 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:28 smithi046 ceph-mon[29647]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:28.408 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:28 smithi046 ceph-mon[29647]: Saving service crash spec with placement * 2024-02-19T18:52:28.408 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:28 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:28.408 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:28 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:29.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-02-19T18:52:29.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.153+0000 7fbdc2c6e700 1 Processor -- start 2024-02-19T18:52:29.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.153+0000 7fbdc2c6e700 1 -- start start 2024-02-19T18:52:29.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.153+0000 7fbdc2c6e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc10a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.153+0000 7fbdc2c6e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc106380 con 0x7fbdbc079cb0 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.154+0000 7fbdc0a0a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc10a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.154+0000 7fbdc0a0a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc10a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52354/0 (socket says 172.21.15.46:52354) 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.154+0000 7fbdc0a0a700 1 -- 172.21.15.46:0/527724804 learned_addr learned my addr 172.21.15.46:0/527724804 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.154+0000 7fbdc0a0a700 1 -- 172.21.15.46:0/527724804 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc10aed0 con 0x7fbdbc079cb0 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.154+0000 7fbdc0a0a700 1 --2- 172.21.15.46:0/527724804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc10a990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00098a0 tx=0x7fbdb0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2539ac2f485d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.154+0000 7fbdbb7fe700 1 -- 172.21.15.46:0/527724804 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdb0004180 con 0x7fbdbc079cb0 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.154+0000 7fbdbb7fe700 1 -- 172.21.15.46:0/527724804 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbdb00042e0 con 0x7fbdbc079cb0 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.154+0000 7fbdbb7fe700 1 -- 172.21.15.46:0/527724804 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdb0011af0 con 0x7fbdbc079cb0 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.155+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/527724804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 msgr2=0x7fbdbc10a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:29.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.155+0000 7fbdc2c6e700 1 --2- 172.21.15.46:0/527724804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc10a990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00098a0 tx=0x7fbdb0009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.155+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/527724804 shutdown_connections 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.155+0000 7fbdc2c6e700 1 --2- 172.21.15.46:0/527724804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc10a990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.155+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/527724804 >> 172.21.15.46:0/527724804 conn(0x7fbdbc0fff00 msgr2=0x7fbdbc102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.155+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/527724804 shutdown_connections 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.155+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/527724804 wait complete. 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdc2c6e700 1 Processor -- start 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdc2c6e700 1 -- start start 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdc2c6e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdc2c6e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc19bee0 con 0x7fbdbc079cb0 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdc0a0a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdc0a0a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc19b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52362/0 (socket says 172.21.15.46:52362) 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdc0a0a700 1 -- 172.21.15.46:0/1455010 learned_addr learned my addr 172.21.15.46:0/1455010 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:29.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdc0a0a700 1 -- 172.21.15.46:0/1455010 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb0009550 con 0x7fbdbc079cb0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdc0a0a700 1 --2- 172.21.15.46:0/1455010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc19b9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0011670 tx=0x7fbdb0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdb9ffb700 1 -- 172.21.15.46:0/1455010 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdb0003b10 con 0x7fbdbc079cb0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/1455010 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc19c0e0 con 0x7fbdbc079cb0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdb9ffb700 1 -- 172.21.15.46:0/1455010 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbdb00248e0 con 0x7fbdbc079cb0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.156+0000 7fbdb9ffb700 1 -- 172.21.15.46:0/1455010 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdb001a910 con 0x7fbdbc079cb0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.157+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/1455010 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc19c580 con 0x7fbdbc079cb0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.157+0000 7fbdb9ffb700 1 -- 172.21.15.46:0/1455010 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fbdb001ab80 con 0x7fbdbc079cb0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.158+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/1455010 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc10bcc0 con 0x7fbdbc079cb0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.158+0000 7fbdb9ffb700 1 --2- 172.21.15.46:0/1455010 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fbdac0383b0 0x7fbdac03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.158+0000 7fbdb9ffb700 1 -- 172.21.15.46:0/1455010 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbdb004c890 con 0x7fbdbc079cb0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.158+0000 7fbdbbfff700 1 --2- 172.21.15.46:0/1455010 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fbdac0383b0 0x7fbdac03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.158+0000 7fbdbbfff700 1 --2- 172.21.15.46:0/1455010 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fbdac0383b0 0x7fbdac03a860 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbda8006fd0 tx=0x7fbda8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.163+0000 7fbdb9ffb700 1 -- 172.21.15.46:0/1455010 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbdb001ae30 con 0x7fbdbc079cb0 2024-02-19T18:52:29.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.391+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/1455010 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdbc102250 con 0x7fbdac0383b0 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.396+0000 7fbdb9ffb700 1 -- 172.21.15.46:0/1455010 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fbdbc102250 con 0x7fbdac0383b0 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.398+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/1455010 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fbdac0383b0 msgr2=0x7fbdac03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.398+0000 7fbdc2c6e700 1 --2- 172.21.15.46:0/1455010 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fbdac0383b0 0x7fbdac03a860 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbda8006fd0 tx=0x7fbda8006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.398+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/1455010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 msgr2=0x7fbdbc19b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.398+0000 7fbdc2c6e700 1 --2- 172.21.15.46:0/1455010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc19b9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0011670 tx=0x7fbdb0011b50 comp rx=0 tx=0).stop 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.398+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/1455010 shutdown_connections 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.398+0000 7fbdc2c6e700 1 --2- 172.21.15.46:0/1455010 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fbdac0383b0 0x7fbdac03a860 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.398+0000 7fbdc2c6e700 1 --2- 172.21.15.46:0/1455010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdbc079cb0 0x7fbdbc19b9a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.398+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/1455010 >> 172.21.15.46:0/1455010 conn(0x7fbdbc0fff00 msgr2=0x7fbdbc101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.398+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/1455010 shutdown_connections 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:28.399+0000 7fbdc2c6e700 1 -- 172.21.15.46:0/1455010 wait complete. 2024-02-19T18:52:29.007 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying prometheus service with default placement... 2024-02-19T18:52:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:29 smithi046 ceph-mon[29647]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:29 smithi046 ceph-mon[29647]: Saving service ceph-exporter spec with placement * 2024-02-19T18:52:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:29 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:29 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.409+0000 7f9e7e9d6700 1 Processor -- start 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.409+0000 7f9e7e9d6700 1 -- start start 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.409+0000 7f9e7e9d6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.409+0000 7f9e7e9d6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e78104600 con 0x7f9e78103cb0 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.409+0000 7f9e77fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.409+0000 7f9e77fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52374/0 (socket says 172.21.15.46:52374) 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.409+0000 7f9e77fff700 1 -- 172.21.15.46:0/1167221693 learned_addr learned my addr 172.21.15.46:0/1167221693 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.410+0000 7f9e77fff700 1 -- 172.21.15.46:0/1167221693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e78104740 con 0x7f9e78103cb0 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.410+0000 7f9e77fff700 1 --2- 172.21.15.46:0/1167221693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781040c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9e680098a0 tx=0x7f9e68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6397f26d0afb88e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.410+0000 7f9e76ffd700 1 -- 172.21.15.46:0/1167221693 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e68004180 con 0x7f9e78103cb0 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.410+0000 7f9e76ffd700 1 -- 172.21.15.46:0/1167221693 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9e680042e0 con 0x7f9e78103cb0 2024-02-19T18:52:30.639 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.410+0000 7f9e76ffd700 1 -- 172.21.15.46:0/1167221693 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e68011af0 con 0x7f9e78103cb0 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.411+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1167221693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 msgr2=0x7f9e781040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.411+0000 7f9e7e9d6700 1 --2- 172.21.15.46:0/1167221693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781040c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9e680098a0 tx=0x7f9e68009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.411+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1167221693 shutdown_connections 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.411+0000 7f9e7e9d6700 1 --2- 172.21.15.46:0/1167221693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781040c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.411+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1167221693 >> 172.21.15.46:0/1167221693 conn(0x7f9e780ff670 msgr2=0x7f9e78101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.411+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1167221693 shutdown_connections 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.411+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1167221693 wait complete. 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.412+0000 7f9e7e9d6700 1 Processor -- start 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.412+0000 7f9e7e9d6700 1 -- start start 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.412+0000 7f9e7e9d6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.412+0000 7f9e7e9d6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e78199cf0 con 0x7f9e78103cb0 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.412+0000 7f9e77fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.412+0000 7f9e77fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52378/0 (socket says 172.21.15.46:52378) 2024-02-19T18:52:30.640 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.412+0000 7f9e77fff700 1 -- 172.21.15.46:0/1790620510 learned_addr learned my addr 172.21.15.46:0/1790620510 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.413+0000 7f9e77fff700 1 -- 172.21.15.46:0/1790620510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68009550 con 0x7f9e78103cb0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.413+0000 7f9e77fff700 1 --2- 172.21.15.46:0/1790620510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781997b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9e68011670 tx=0x7f9e68011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.413+0000 7f9e757fa700 1 -- 172.21.15.46:0/1790620510 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e680039f0 con 0x7f9e78103cb0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.413+0000 7f9e757fa700 1 -- 172.21.15.46:0/1790620510 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9e68003b50 con 0x7f9e78103cb0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.413+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1790620510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e78199ef0 con 0x7f9e78103cb0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.413+0000 7f9e757fa700 1 -- 172.21.15.46:0/1790620510 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e680247c0 con 0x7f9e78103cb0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.413+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1790620510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7819a390 con 0x7f9e78103cb0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.414+0000 7f9e757fa700 1 -- 172.21.15.46:0/1790620510 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9e6802d3f0 con 0x7f9e78103cb0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.414+0000 7f9e757fa700 1 --2- 172.21.15.46:0/1790620510 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f9e64038440 0x7f9e6403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.414+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1790620510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e78062380 con 0x7f9e78103cb0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.414+0000 7f9e757fa700 1 -- 172.21.15.46:0/1790620510 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9e6804d380 con 0x7f9e78103cb0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.415+0000 7f9e777fe700 1 --2- 172.21.15.46:0/1790620510 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f9e64038440 0x7f9e6403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.415+0000 7f9e777fe700 1 --2- 172.21.15.46:0/1790620510 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f9e64038440 0x7f9e6403a8f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9e60006fd0 tx=0x7f9e60006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.419+0000 7f9e757fa700 1 -- 172.21.15.46:0/1790620510 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9e6802d6f0 con 0x7f9e78103cb0 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.636+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1790620510 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e7819d1d0 con 0x7f9e64038440 2024-02-19T18:52:30.641 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.641+0000 7f9e757fa700 1 -- 172.21.15.46:0/1790620510 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f9e7819d1d0 con 0x7f9e64038440 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.643+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1790620510 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f9e64038440 msgr2=0x7f9e6403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.643+0000 7f9e7e9d6700 1 --2- 172.21.15.46:0/1790620510 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f9e64038440 0x7f9e6403a8f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9e60006fd0 tx=0x7f9e60006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.643+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1790620510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 msgr2=0x7f9e781997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.643+0000 7f9e7e9d6700 1 --2- 172.21.15.46:0/1790620510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781997b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9e68011670 tx=0x7f9e68011b50 comp rx=0 tx=0).stop 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.643+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1790620510 shutdown_connections 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.643+0000 7f9e7e9d6700 1 --2- 172.21.15.46:0/1790620510 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f9e64038440 0x7f9e6403a8f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.643+0000 7f9e7e9d6700 1 --2- 172.21.15.46:0/1790620510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e78103cb0 0x7f9e781997b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.643+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1790620510 >> 172.21.15.46:0/1790620510 conn(0x7f9e780ff670 msgr2=0x7f9e78100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.643+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1790620510 shutdown_connections 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:29.643+0000 7f9e7e9d6700 1 -- 172.21.15.46:0/1790620510 wait complete. 2024-02-19T18:52:30.642 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying grafana service with default placement... 2024-02-19T18:52:30.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:30 smithi046 ceph-mon[29647]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:30.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:30 smithi046 ceph-mon[29647]: Saving service prometheus spec with placement count:1 2024-02-19T18:52:30.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:30 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:32.264 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-19T18:52:32.264 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.458+0000 7fa406f4f700 1 Processor -- start 2024-02-19T18:52:32.264 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.458+0000 7fa406f4f700 1 -- start start 2024-02-19T18:52:32.264 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.458+0000 7fa406f4f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:32.264 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.458+0000 7fa406f4f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa400106320 con 0x7fa4001059d0 2024-02-19T18:52:32.264 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.458+0000 7fa404ceb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:32.264 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.458+0000 7fa404ceb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52382/0 (socket says 172.21.15.46:52382) 2024-02-19T18:52:32.264 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.458+0000 7fa404ceb700 1 -- 172.21.15.46:0/2469735860 learned_addr learned my addr 172.21.15.46:0/2469735860 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.459+0000 7fa404ceb700 1 -- 172.21.15.46:0/2469735860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400106460 con 0x7fa4001059d0 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.459+0000 7fa404ceb700 1 --2- 172.21.15.46:0/2469735860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400105de0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4009870 tx=0x7fa3f4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cd0cbc08cb9e4b server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.459+0000 7fa3ff7fe700 1 -- 172.21.15.46:0/2469735860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3f4005c30 con 0x7fa4001059d0 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.459+0000 7fa3ff7fe700 1 -- 172.21.15.46:0/2469735860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3f40044e0 con 0x7fa4001059d0 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.459+0000 7fa3ff7fe700 1 -- 172.21.15.46:0/2469735860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3f4006030 con 0x7fa4001059d0 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.460+0000 7fa406f4f700 1 -- 172.21.15.46:0/2469735860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 msgr2=0x7fa400105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.460+0000 7fa406f4f700 1 --2- 172.21.15.46:0/2469735860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400105de0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4009870 tx=0x7fa3f4009b80 comp rx=0 tx=0).stop 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.460+0000 7fa406f4f700 1 -- 172.21.15.46:0/2469735860 shutdown_connections 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.460+0000 7fa406f4f700 1 --2- 172.21.15.46:0/2469735860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400105de0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.460+0000 7fa406f4f700 1 -- 172.21.15.46:0/2469735860 >> 172.21.15.46:0/2469735860 conn(0x7fa400101020 msgr2=0x7fa400103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.460+0000 7fa406f4f700 1 -- 172.21.15.46:0/2469735860 shutdown_connections 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.460+0000 7fa406f4f700 1 -- 172.21.15.46:0/2469735860 wait complete. 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.460+0000 7fa406f4f700 1 Processor -- start 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.460+0000 7fa406f4f700 1 -- start start 2024-02-19T18:52:32.265 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa406f4f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa406f4f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa400199c50 con 0x7fa4001059d0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa404ceb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa404ceb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52392/0 (socket says 172.21.15.46:52392) 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa404ceb700 1 -- 172.21.15.46:0/1451428907 learned_addr learned my addr 172.21.15.46:0/1451428907 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa404ceb700 1 -- 172.21.15.46:0/1451428907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f4009500 con 0x7fa4001059d0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa404ceb700 1 --2- 172.21.15.46:0/1451428907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400199710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4004840 tx=0x7fa3f40042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa3fdffb700 1 -- 172.21.15.46:0/1451428907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3f4005e40 con 0x7fa4001059d0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa3fdffb700 1 -- 172.21.15.46:0/1451428907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3f4005fa0 con 0x7fa4001059d0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa3fdffb700 1 -- 172.21.15.46:0/1451428907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3f4011c80 con 0x7fa4001059d0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.461+0000 7fa406f4f700 1 -- 172.21.15.46:0/1451428907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa400199e50 con 0x7fa4001059d0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.462+0000 7fa406f4f700 1 -- 172.21.15.46:0/1451428907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40019a2f0 con 0x7fa4001059d0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.462+0000 7fa3fdffb700 1 -- 172.21.15.46:0/1451428907 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fa3f4018070 con 0x7fa4001059d0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.463+0000 7fa406f4f700 1 -- 172.21.15.46:0/1451428907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa400062380 con 0x7fa4001059d0 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.463+0000 7fa3fdffb700 1 --2- 172.21.15.46:0/1451428907 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fa3f0038450 0x7fa3f003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:32.266 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.463+0000 7fa3fdffb700 1 -- 172.21.15.46:0/1451428907 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa3f404ba70 con 0x7fa4001059d0 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.463+0000 7fa3fffff700 1 --2- 172.21.15.46:0/1451428907 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fa3f0038450 0x7fa3f003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.463+0000 7fa3fffff700 1 --2- 172.21.15.46:0/1451428907 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fa3f0038450 0x7fa3f003a900 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec006fd0 tx=0x7fa3ec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.468+0000 7fa3fdffb700 1 -- 172.21.15.46:0/1451428907 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa3f402cd20 con 0x7fa4001059d0 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.677+0000 7fa406f4f700 1 -- 172.21.15.46:0/1451428907 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fa400109e70 con 0x7fa3f0038450 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.682+0000 7fa3fdffb700 1 -- 172.21.15.46:0/1451428907 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fa400109e70 con 0x7fa3f0038450 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.684+0000 7fa406f4f700 1 -- 172.21.15.46:0/1451428907 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fa3f0038450 msgr2=0x7fa3f003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.684+0000 7fa406f4f700 1 --2- 172.21.15.46:0/1451428907 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fa3f0038450 0x7fa3f003a900 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec006fd0 tx=0x7fa3ec006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.684+0000 7fa406f4f700 1 -- 172.21.15.46:0/1451428907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 msgr2=0x7fa400199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.684+0000 7fa406f4f700 1 --2- 172.21.15.46:0/1451428907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400199710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4004840 tx=0x7fa3f40042e0 comp rx=0 tx=0).stop 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.684+0000 7fa406f4f700 1 -- 172.21.15.46:0/1451428907 shutdown_connections 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.684+0000 7fa406f4f700 1 --2- 172.21.15.46:0/1451428907 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fa3f0038450 0x7fa3f003a900 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.684+0000 7fa406f4f700 1 --2- 172.21.15.46:0/1451428907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4001059d0 0x7fa400199710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.684+0000 7fa406f4f700 1 -- 172.21.15.46:0/1451428907 >> 172.21.15.46:0/1451428907 conn(0x7fa400101020 msgr2=0x7fa4001026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:32.267 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.684+0000 7fa406f4f700 1 -- 172.21.15.46:0/1451428907 shutdown_connections 2024-02-19T18:52:32.268 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:31.684+0000 7fa406f4f700 1 -- 172.21.15.46:0/1451428907 wait complete. 2024-02-19T18:52:32.268 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying node-exporter service with default placement... 2024-02-19T18:52:33.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:32 smithi046 ceph-mon[29647]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:33.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:32 smithi046 ceph-mon[29647]: Saving service grafana spec with placement count:1 2024-02-19T18:52:33.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:32 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:33.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:32 smithi046 ceph-mon[29647]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:52:33.520 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-19T18:52:33.520 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.627+0000 7fe4a2472700 1 Processor -- start 2024-02-19T18:52:33.520 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.627+0000 7fe4a2472700 1 -- start start 2024-02-19T18:52:33.520 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.627+0000 7fe4a2472700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:33.520 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.627+0000 7fe4a2472700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c106310 con 0x7fe49c1059c0 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.628+0000 7fe49bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.628+0000 7fe49bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52404/0 (socket says 172.21.15.46:52404) 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.628+0000 7fe49bfff700 1 -- 172.21.15.46:0/1182510423 learned_addr learned my addr 172.21.15.46:0/1182510423 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.628+0000 7fe49bfff700 1 -- 172.21.15.46:0/1182510423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c106450 con 0x7fe49c1059c0 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.628+0000 7fe49bfff700 1 --2- 172.21.15.46:0/1182510423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c105dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4840098a0 tx=0x7fe484009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e91934314780db server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.628+0000 7fe49affd700 1 -- 172.21.15.46:0/1182510423 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe484004180 con 0x7fe49c1059c0 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.628+0000 7fe49affd700 1 -- 172.21.15.46:0/1182510423 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe4840042e0 con 0x7fe49c1059c0 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.628+0000 7fe49affd700 1 -- 172.21.15.46:0/1182510423 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe484011af0 con 0x7fe49c1059c0 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.629+0000 7fe4a2472700 1 -- 172.21.15.46:0/1182510423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 msgr2=0x7fe49c105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.629+0000 7fe4a2472700 1 --2- 172.21.15.46:0/1182510423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c105dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4840098a0 tx=0x7fe484009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.629+0000 7fe4a2472700 1 -- 172.21.15.46:0/1182510423 shutdown_connections 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.629+0000 7fe4a2472700 1 --2- 172.21.15.46:0/1182510423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c105dd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.629+0000 7fe4a2472700 1 -- 172.21.15.46:0/1182510423 >> 172.21.15.46:0/1182510423 conn(0x7fe49c100ff0 msgr2=0x7fe49c103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.629+0000 7fe4a2472700 1 -- 172.21.15.46:0/1182510423 shutdown_connections 2024-02-19T18:52:33.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.629+0000 7fe4a2472700 1 -- 172.21.15.46:0/1182510423 wait complete. 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.630+0000 7fe4a2472700 1 Processor -- start 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.630+0000 7fe4a2472700 1 -- start start 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.630+0000 7fe4a2472700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.630+0000 7fe4a2472700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c199cb0 con 0x7fe49c1059c0 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.630+0000 7fe49bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.630+0000 7fe49bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52412/0 (socket says 172.21.15.46:52412) 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.630+0000 7fe49bfff700 1 -- 172.21.15.46:0/1414524693 learned_addr learned my addr 172.21.15.46:0/1414524693 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.630+0000 7fe49bfff700 1 -- 172.21.15.46:0/1414524693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484009550 con 0x7fe49c1059c0 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.631+0000 7fe49bfff700 1 --2- 172.21.15.46:0/1414524693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c199770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe484011670 tx=0x7fe484011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.631+0000 7fe4997fa700 1 -- 172.21.15.46:0/1414524693 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe484003a40 con 0x7fe49c1059c0 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.631+0000 7fe4997fa700 1 -- 172.21.15.46:0/1414524693 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe484003ba0 con 0x7fe49c1059c0 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.631+0000 7fe4a2472700 1 -- 172.21.15.46:0/1414524693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c199eb0 con 0x7fe49c1059c0 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.631+0000 7fe4997fa700 1 -- 172.21.15.46:0/1414524693 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe484024790 con 0x7fe49c1059c0 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.631+0000 7fe4a2472700 1 -- 172.21.15.46:0/1414524693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c19a350 con 0x7fe49c1059c0 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.632+0000 7fe4997fa700 1 -- 172.21.15.46:0/1414524693 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fe48401a430 con 0x7fe49c1059c0 2024-02-19T18:52:33.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.632+0000 7fe4a2472700 1 -- 172.21.15.46:0/1414524693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c062380 con 0x7fe49c1059c0 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.632+0000 7fe4997fa700 1 --2- 172.21.15.46:0/1414524693 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fe4880383f0 0x7fe48803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.632+0000 7fe4997fa700 1 -- 172.21.15.46:0/1414524693 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe48404c560 con 0x7fe49c1059c0 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.632+0000 7fe49b7fe700 1 --2- 172.21.15.46:0/1414524693 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fe4880383f0 0x7fe48803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.632+0000 7fe49b7fe700 1 --2- 172.21.15.46:0/1414524693 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fe4880383f0 0x7fe48803a8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe48c006fd0 tx=0x7fe48c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.637+0000 7fe4997fa700 1 -- 172.21.15.46:0/1414524693 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe484010380 con 0x7fe49c1059c0 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.849+0000 7fe4a2472700 1 -- 172.21.15.46:0/1414524693 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fe49c103330 con 0x7fe4880383f0 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.853+0000 7fe4997fa700 1 -- 172.21.15.46:0/1414524693 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fe49c103330 con 0x7fe4880383f0 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.855+0000 7fe4a2472700 1 -- 172.21.15.46:0/1414524693 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fe4880383f0 msgr2=0x7fe48803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.855+0000 7fe4a2472700 1 --2- 172.21.15.46:0/1414524693 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fe4880383f0 0x7fe48803a8a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe48c006fd0 tx=0x7fe48c006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.855+0000 7fe4a2472700 1 -- 172.21.15.46:0/1414524693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 msgr2=0x7fe49c199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.855+0000 7fe4a2472700 1 --2- 172.21.15.46:0/1414524693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c199770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe484011670 tx=0x7fe484011b50 comp rx=0 tx=0).stop 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.856+0000 7fe4a2472700 1 -- 172.21.15.46:0/1414524693 shutdown_connections 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.856+0000 7fe4a2472700 1 --2- 172.21.15.46:0/1414524693 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fe4880383f0 0x7fe48803a8a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.856+0000 7fe4a2472700 1 --2- 172.21.15.46:0/1414524693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe49c1059c0 0x7fe49c199770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:33.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.856+0000 7fe4a2472700 1 -- 172.21.15.46:0/1414524693 >> 172.21.15.46:0/1414524693 conn(0x7fe49c100ff0 msgr2=0x7fe49c102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:33.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.856+0000 7fe4a2472700 1 -- 172.21.15.46:0/1414524693 shutdown_connections 2024-02-19T18:52:33.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:32.856+0000 7fe4a2472700 1 -- 172.21.15.46:0/1414524693 wait complete. 2024-02-19T18:52:33.524 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying alertmanager service with default placement... 2024-02-19T18:52:34.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:33 smithi046 ceph-mon[29647]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:34.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:33 smithi046 ceph-mon[29647]: Saving service node-exporter spec with placement * 2024-02-19T18:52:34.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:33 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:34.667 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.904+0000 7f3565e85700 1 Processor -- start 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.904+0000 7f3565e85700 1 -- start start 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.904+0000 7f3565e85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.904+0000 7f3565e85700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560105210 con 0x7f35601048c0 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.904+0000 7f355f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.904+0000 7f355f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52426/0 (socket says 172.21.15.46:52426) 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.904+0000 7f355f7fe700 1 -- 172.21.15.46:0/1904603988 learned_addr learned my addr 172.21.15.46:0/1904603988 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.905+0000 7f355f7fe700 1 -- 172.21.15.46:0/1904603988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3560105350 con 0x7f35601048c0 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.905+0000 7f355f7fe700 1 --2- 172.21.15.46:0/1904603988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560104cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35500098a0 tx=0x7f3550009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630ae964369750be server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.905+0000 7f355e7fc700 1 -- 172.21.15.46:0/1904603988 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3550004180 con 0x7f35601048c0 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.905+0000 7f355e7fc700 1 -- 172.21.15.46:0/1904603988 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35500042e0 con 0x7f35601048c0 2024-02-19T18:52:34.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.905+0000 7f355e7fc700 1 -- 172.21.15.46:0/1904603988 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3550011af0 con 0x7f35601048c0 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.906+0000 7f3565e85700 1 -- 172.21.15.46:0/1904603988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 msgr2=0x7f3560104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.906+0000 7f3565e85700 1 --2- 172.21.15.46:0/1904603988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560104cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35500098a0 tx=0x7f3550009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.906+0000 7f3565e85700 1 -- 172.21.15.46:0/1904603988 shutdown_connections 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.906+0000 7f3565e85700 1 --2- 172.21.15.46:0/1904603988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560104cd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.906+0000 7f3565e85700 1 -- 172.21.15.46:0/1904603988 >> 172.21.15.46:0/1904603988 conn(0x7f35600ffed0 msgr2=0x7f3560102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.906+0000 7f3565e85700 1 -- 172.21.15.46:0/1904603988 shutdown_connections 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.906+0000 7f3565e85700 1 -- 172.21.15.46:0/1904603988 wait complete. 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.906+0000 7f3565e85700 1 Processor -- start 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.906+0000 7f3565e85700 1 -- start start 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f3565e85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f3565e85700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560199c70 con 0x7f35601048c0 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f355f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f355f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52442/0 (socket says 172.21.15.46:52442) 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f355f7fe700 1 -- 172.21.15.46:0/1064023512 learned_addr learned my addr 172.21.15.46:0/1064023512 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:34.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f355f7fe700 1 -- 172.21.15.46:0/1064023512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550009550 con 0x7f35601048c0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f355f7fe700 1 --2- 172.21.15.46:0/1064023512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560199730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3550011670 tx=0x7f3550011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f355cff9700 1 -- 172.21.15.46:0/1064023512 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3550003a40 con 0x7f35601048c0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f3565e85700 1 -- 172.21.15.46:0/1064023512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3560199e70 con 0x7f35601048c0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f355cff9700 1 -- 172.21.15.46:0/1064023512 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3550003ba0 con 0x7f35601048c0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f355cff9700 1 -- 172.21.15.46:0/1064023512 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3550024820 con 0x7f35601048c0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.907+0000 7f3565e85700 1 -- 172.21.15.46:0/1064023512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356019a310 con 0x7f35601048c0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.908+0000 7f355cff9700 1 -- 172.21.15.46:0/1064023512 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f3550024ae0 con 0x7f35601048c0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.908+0000 7f3565e85700 1 -- 172.21.15.46:0/1064023512 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3560062380 con 0x7f35601048c0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.908+0000 7f355cff9700 1 --2- 172.21.15.46:0/1064023512 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f35480383b0 0x7f354803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.908+0000 7f355cff9700 1 -- 172.21.15.46:0/1064023512 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f355004c590 con 0x7f35601048c0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.909+0000 7f355effd700 1 --2- 172.21.15.46:0/1064023512 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f35480383b0 0x7f354803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.909+0000 7f355effd700 1 --2- 172.21.15.46:0/1064023512 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f35480383b0 0x7f354803a860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3554006fd0 tx=0x7f3554006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:34.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:33.913+0000 7f355cff9700 1 -- 172.21.15.46:0/1064023512 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3550024d90 con 0x7f35601048c0 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.125+0000 7f3565e85700 1 -- 172.21.15.46:0/1064023512 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f356019d150 con 0x7f35480383b0 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.129+0000 7f355cff9700 1 -- 172.21.15.46:0/1064023512 <== mgr.14120 v2:172.21.15.46:6800/1408120197 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f356019d150 con 0x7f35480383b0 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.131+0000 7f3565e85700 1 -- 172.21.15.46:0/1064023512 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f35480383b0 msgr2=0x7f354803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.131+0000 7f3565e85700 1 --2- 172.21.15.46:0/1064023512 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f35480383b0 0x7f354803a860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3554006fd0 tx=0x7f3554006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.131+0000 7f3565e85700 1 -- 172.21.15.46:0/1064023512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 msgr2=0x7f3560199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.131+0000 7f3565e85700 1 --2- 172.21.15.46:0/1064023512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560199730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3550011670 tx=0x7f3550011aa0 comp rx=0 tx=0).stop 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.131+0000 7f3565e85700 1 -- 172.21.15.46:0/1064023512 shutdown_connections 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.131+0000 7f3565e85700 1 --2- 172.21.15.46:0/1064023512 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f35480383b0 0x7f354803a860 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.131+0000 7f3565e85700 1 --2- 172.21.15.46:0/1064023512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35601048c0 0x7f3560199730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.131+0000 7f3565e85700 1 -- 172.21.15.46:0/1064023512 >> 172.21.15.46:0/1064023512 conn(0x7f35600ffed0 msgr2=0x7f3560079850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.131+0000 7f3565e85700 1 -- 172.21.15.46:0/1064023512 shutdown_connections 2024-02-19T18:52:34.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:34.131+0000 7f3565e85700 1 -- 172.21.15.46:0/1064023512 wait complete. 2024-02-19T18:52:35.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:34 smithi046 ceph-mon[29647]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:52:35.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:34 smithi046 ceph-mon[29647]: from='mgr.14120 172.21.15.46:0/182083111' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.070+0000 7f7c03ebb700 1 Processor -- start 2024-02-19T18:52:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.070+0000 7f7c03ebb700 1 -- start start 2024-02-19T18:52:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.071+0000 7f7c03ebb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.071+0000 7f7c03ebb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc106320 con 0x7f7bfc1059d0 2024-02-19T18:52:35.841 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.071+0000 7f7c01c57700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.071+0000 7f7c01c57700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52456/0 (socket says 172.21.15.46:52456) 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.071+0000 7f7c01c57700 1 -- 172.21.15.46:0/3918398942 learned_addr learned my addr 172.21.15.46:0/3918398942 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.071+0000 7f7c01c57700 1 -- 172.21.15.46:0/3918398942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc106460 con 0x7f7bfc1059d0 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.071+0000 7f7c01c57700 1 --2- 172.21.15.46:0/3918398942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc105de0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009870 tx=0x7f7bf8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61af545c74db2309 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.071+0000 7f7c00c55700 1 -- 172.21.15.46:0/3918398942 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bf8005c30 con 0x7f7bfc1059d0 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.071+0000 7f7c00c55700 1 -- 172.21.15.46:0/3918398942 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7bf80044e0 con 0x7f7bfc1059d0 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.071+0000 7f7c00c55700 1 -- 172.21.15.46:0/3918398942 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bf8006030 con 0x7f7bfc1059d0 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.072+0000 7f7c03ebb700 1 -- 172.21.15.46:0/3918398942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 msgr2=0x7f7bfc105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.072+0000 7f7c03ebb700 1 --2- 172.21.15.46:0/3918398942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc105de0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009870 tx=0x7f7bf8009b80 comp rx=0 tx=0).stop 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.072+0000 7f7c03ebb700 1 -- 172.21.15.46:0/3918398942 shutdown_connections 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.072+0000 7f7c03ebb700 1 --2- 172.21.15.46:0/3918398942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc105de0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.072+0000 7f7c03ebb700 1 -- 172.21.15.46:0/3918398942 >> 172.21.15.46:0/3918398942 conn(0x7f7bfc101020 msgr2=0x7f7bfc103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.072+0000 7f7c03ebb700 1 -- 172.21.15.46:0/3918398942 shutdown_connections 2024-02-19T18:52:35.842 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.072+0000 7f7c03ebb700 1 -- 172.21.15.46:0/3918398942 wait complete. 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7c03ebb700 1 Processor -- start 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7c03ebb700 1 -- start start 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7c03ebb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7c03ebb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc199c10 con 0x7f7bfc1059d0 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7c01c57700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7c01c57700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc1996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52464/0 (socket says 172.21.15.46:52464) 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7c01c57700 1 -- 172.21.15.46:0/29516604 learned_addr learned my addr 172.21.15.46:0/29516604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7c01c57700 1 -- 172.21.15.46:0/29516604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8009500 con 0x7f7bfc1059d0 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7c01c57700 1 --2- 172.21.15.46:0/29516604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc1996d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80046b0 tx=0x7f7bf80042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7bf2ffd700 1 -- 172.21.15.46:0/29516604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bf8005e40 con 0x7f7bfc1059d0 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7bf2ffd700 1 -- 172.21.15.46:0/29516604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7bf8006840 con 0x7f7bfc1059d0 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7c03ebb700 1 -- 172.21.15.46:0/29516604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bfc199e10 con 0x7f7bfc1059d0 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.073+0000 7f7bf2ffd700 1 -- 172.21.15.46:0/29516604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bf8011bc0 con 0x7f7bfc1059d0 2024-02-19T18:52:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.074+0000 7f7c03ebb700 1 -- 172.21.15.46:0/29516604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bfc19a2b0 con 0x7f7bfc1059d0 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.074+0000 7f7bf2ffd700 1 -- 172.21.15.46:0/29516604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f7bf8018070 con 0x7f7bfc1059d0 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.074+0000 7f7c03ebb700 1 -- 172.21.15.46:0/29516604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bfc062380 con 0x7f7bfc1059d0 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.074+0000 7f7bf2ffd700 1 --2- 172.21.15.46:0/29516604 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f7be8038400 0x7f7be803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.074+0000 7f7bf2ffd700 1 -- 172.21.15.46:0/29516604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7bf804bdc0 con 0x7f7bfc1059d0 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.075+0000 7f7c01456700 1 --2- 172.21.15.46:0/29516604 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f7be8038400 0x7f7be803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.075+0000 7f7c01456700 1 --2- 172.21.15.46:0/29516604 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f7be8038400 0x7f7be803a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7bec006fd0 tx=0x7f7bec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.079+0000 7f7bf2ffd700 1 -- 172.21.15.46:0/29516604 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7bf800bd70 con 0x7f7bfc1059d0 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.280+0000 7f7c03ebb700 1 -- 172.21.15.46:0/29516604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f7bfc19d0f0 con 0x7f7bfc1059d0 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.283+0000 7f7bf2ffd700 1 -- 172.21.15.46:0/29516604 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7bf801f070 con 0x7f7bfc1059d0 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.285+0000 7f7c03ebb700 1 -- 172.21.15.46:0/29516604 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f7be8038400 msgr2=0x7f7be803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.285+0000 7f7c03ebb700 1 --2- 172.21.15.46:0/29516604 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f7be8038400 0x7f7be803a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7bec006fd0 tx=0x7f7bec006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.285+0000 7f7c03ebb700 1 -- 172.21.15.46:0/29516604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 msgr2=0x7f7bfc1996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.285+0000 7f7c03ebb700 1 --2- 172.21.15.46:0/29516604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc1996d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80046b0 tx=0x7f7bf80042e0 comp rx=0 tx=0).stop 2024-02-19T18:52:35.844 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.285+0000 7f7c03ebb700 1 -- 172.21.15.46:0/29516604 shutdown_connections 2024-02-19T18:52:35.845 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.285+0000 7f7c03ebb700 1 --2- 172.21.15.46:0/29516604 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f7be8038400 0x7f7be803a8b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:35.845 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.285+0000 7f7c03ebb700 1 --2- 172.21.15.46:0/29516604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bfc1059d0 0x7f7bfc1996d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:35.845 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.285+0000 7f7c03ebb700 1 -- 172.21.15.46:0/29516604 >> 172.21.15.46:0/29516604 conn(0x7f7bfc101020 msgr2=0x7f7bfc101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:35.845 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.286+0000 7f7c03ebb700 1 -- 172.21.15.46:0/29516604 shutdown_connections 2024-02-19T18:52:35.845 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:35.286+0000 7f7c03ebb700 1 -- 172.21.15.46:0/29516604 wait complete. 2024-02-19T18:52:36.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:35 smithi046 ceph-mon[29647]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:36.276 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:35 smithi046 ceph-mon[29647]: Saving service alertmanager spec with placement count:1 2024-02-19T18:52:36.277 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:35 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/29516604' entity='client.admin' 2024-02-19T18:52:37.038 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.260+0000 7fc7085be700 1 Processor -- start 2024-02-19T18:52:37.038 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.260+0000 7fc7085be700 1 -- start start 2024-02-19T18:52:37.038 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.260+0000 7fc7085be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700107490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:37.038 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.260+0000 7fc7085be700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7001079d0 con 0x7fc700107080 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.260+0000 7fc70635a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.261+0000 7fc70635a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52470/0 (socket says 172.21.15.46:52470) 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.261+0000 7fc70635a700 1 -- 172.21.15.46:0/2100898176 learned_addr learned my addr 172.21.15.46:0/2100898176 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.261+0000 7fc70635a700 1 -- 172.21.15.46:0/2100898176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700107b10 con 0x7fc700107080 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.261+0000 7fc70635a700 1 --2- 172.21.15.46:0/2100898176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700107490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80098a0 tx=0x7fc6f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a91c45a25c72ae server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.261+0000 7fc705358700 1 -- 172.21.15.46:0/2100898176 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6f8004180 con 0x7fc700107080 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.261+0000 7fc705358700 1 -- 172.21.15.46:0/2100898176 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc6f80042e0 con 0x7fc700107080 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.261+0000 7fc705358700 1 -- 172.21.15.46:0/2100898176 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6f8011af0 con 0x7fc700107080 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.262+0000 7fc7085be700 1 -- 172.21.15.46:0/2100898176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 msgr2=0x7fc700107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.262+0000 7fc7085be700 1 --2- 172.21.15.46:0/2100898176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700107490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80098a0 tx=0x7fc6f8009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.262+0000 7fc7085be700 1 -- 172.21.15.46:0/2100898176 shutdown_connections 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.262+0000 7fc7085be700 1 --2- 172.21.15.46:0/2100898176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700107490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.262+0000 7fc7085be700 1 -- 172.21.15.46:0/2100898176 >> 172.21.15.46:0/2100898176 conn(0x7fc7000ff670 msgr2=0x7fc700101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:37.039 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.262+0000 7fc7085be700 1 -- 172.21.15.46:0/2100898176 shutdown_connections 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.262+0000 7fc7085be700 1 -- 172.21.15.46:0/2100898176 wait complete. 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.262+0000 7fc7085be700 1 Processor -- start 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.262+0000 7fc7085be700 1 -- start start 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc7085be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700106780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc7085be700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc700106cc0 con 0x7fc700107080 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc70635a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc70635a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52480/0 (socket says 172.21.15.46:52480) 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc70635a700 1 -- 172.21.15.46:0/3477601532 learned_addr learned my addr 172.21.15.46:0/3477601532 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc70635a700 1 -- 172.21.15.46:0/3477601532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f8009550 con 0x7fc700107080 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc70635a700 1 --2- 172.21.15.46:0/3477601532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700106780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8011670 tx=0x7fc6f8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc6ff7fe700 1 -- 172.21.15.46:0/3477601532 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6f8003a40 con 0x7fc700107080 2024-02-19T18:52:37.040 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc6ff7fe700 1 -- 172.21.15.46:0/3477601532 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc6f8003ba0 con 0x7fc700107080 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc7085be700 1 -- 172.21.15.46:0/3477601532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc700104dd0 con 0x7fc700107080 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc6ff7fe700 1 -- 172.21.15.46:0/3477601532 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6f8024820 con 0x7fc700107080 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.263+0000 7fc7085be700 1 -- 172.21.15.46:0/3477601532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc700105270 con 0x7fc700107080 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.264+0000 7fc6ff7fe700 1 -- 172.21.15.46:0/3477601532 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fc6f801a430 con 0x7fc700107080 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.264+0000 7fc7085be700 1 -- 172.21.15.46:0/3477601532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc700104580 con 0x7fc700107080 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.264+0000 7fc6ff7fe700 1 --2- 172.21.15.46:0/3477601532 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc6e80383b0 0x7fc6e803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.264+0000 7fc6ff7fe700 1 -- 172.21.15.46:0/3477601532 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc6f804c300 con 0x7fc700107080 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.264+0000 7fc705b59700 1 --2- 172.21.15.46:0/3477601532 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc6e80383b0 0x7fc6e803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.265+0000 7fc705b59700 1 --2- 172.21.15.46:0/3477601532 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc6e80383b0 0x7fc6e803a860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4006fd0 tx=0x7fc6f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.269+0000 7fc6ff7fe700 1 -- 172.21.15.46:0/3477601532 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc6f801ac70 con 0x7fc700107080 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.468+0000 7fc7085be700 1 -- 172.21.15.46:0/3477601532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fc700105b10 con 0x7fc700107080 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.471+0000 7fc6ff7fe700 1 -- 172.21.15.46:0/3477601532 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc6f8018350 con 0x7fc700107080 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.473+0000 7fc7085be700 1 -- 172.21.15.46:0/3477601532 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc6e80383b0 msgr2=0x7fc6e803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.473+0000 7fc7085be700 1 --2- 172.21.15.46:0/3477601532 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc6e80383b0 0x7fc6e803a860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4006fd0 tx=0x7fc6f4006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.473+0000 7fc7085be700 1 -- 172.21.15.46:0/3477601532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 msgr2=0x7fc700106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.473+0000 7fc7085be700 1 --2- 172.21.15.46:0/3477601532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700106780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8011670 tx=0x7fc6f8011aa0 comp rx=0 tx=0).stop 2024-02-19T18:52:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.474+0000 7fc7085be700 1 -- 172.21.15.46:0/3477601532 shutdown_connections 2024-02-19T18:52:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.474+0000 7fc7085be700 1 --2- 172.21.15.46:0/3477601532 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc6e80383b0 0x7fc6e803a860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.474+0000 7fc7085be700 1 --2- 172.21.15.46:0/3477601532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc700107080 0x7fc700106780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.474+0000 7fc7085be700 1 -- 172.21.15.46:0/3477601532 >> 172.21.15.46:0/3477601532 conn(0x7fc7000ff670 msgr2=0x7fc700100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.474+0000 7fc7085be700 1 -- 172.21.15.46:0/3477601532 shutdown_connections 2024-02-19T18:52:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:36.474+0000 7fc7085be700 1 -- 172.21.15.46:0/3477601532 wait complete. 2024-02-19T18:52:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling the dashboard module... 2024-02-19T18:52:37.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:36 smithi046 ceph-mon[29647]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:52:37.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:36 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3477601532' entity='client.admin' 2024-02-19T18:52:37.986 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:37 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2325099836' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-19T18:52:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.457+0000 7f44e1db8700 1 Processor -- start 2024-02-19T18:52:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.457+0000 7f44e1db8700 1 -- start start 2024-02-19T18:52:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.457+0000 7f44e1db8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.457+0000 7f44e1db8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc106320 con 0x7f44dc1059d0 2024-02-19T18:52:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.457+0000 7f44db7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.457+0000 7f44db7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52494/0 (socket says 172.21.15.46:52494) 2024-02-19T18:52:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.457+0000 7f44db7fe700 1 -- 172.21.15.46:0/2344856720 learned_addr learned my addr 172.21.15.46:0/2344856720 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.457+0000 7f44db7fe700 1 -- 172.21.15.46:0/2344856720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc106460 con 0x7f44dc1059d0 2024-02-19T18:52:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.457+0000 7f44db7fe700 1 --2- 172.21.15.46:0/2344856720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc105de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009870 tx=0x7f44cc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7441d06148de308 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:38.604 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.458+0000 7f44da7fc700 1 -- 172.21.15.46:0/2344856720 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44cc005c30 con 0x7f44dc1059d0 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.458+0000 7f44da7fc700 1 -- 172.21.15.46:0/2344856720 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44cc0044e0 con 0x7f44dc1059d0 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.458+0000 7f44da7fc700 1 -- 172.21.15.46:0/2344856720 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44cc006030 con 0x7f44dc1059d0 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.458+0000 7f44e1db8700 1 -- 172.21.15.46:0/2344856720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 msgr2=0x7f44dc105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.458+0000 7f44e1db8700 1 --2- 172.21.15.46:0/2344856720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc105de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009870 tx=0x7f44cc009b80 comp rx=0 tx=0).stop 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.458+0000 7f44e1db8700 1 -- 172.21.15.46:0/2344856720 shutdown_connections 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.458+0000 7f44e1db8700 1 --2- 172.21.15.46:0/2344856720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc105de0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.458+0000 7f44e1db8700 1 -- 172.21.15.46:0/2344856720 >> 172.21.15.46:0/2344856720 conn(0x7f44dc101020 msgr2=0x7f44dc103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.458+0000 7f44e1db8700 1 -- 172.21.15.46:0/2344856720 shutdown_connections 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.458+0000 7f44e1db8700 1 -- 172.21.15.46:0/2344856720 wait complete. 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.459+0000 7f44e1db8700 1 Processor -- start 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.459+0000 7f44e1db8700 1 -- start start 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.459+0000 7f44e1db8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc07bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.459+0000 7f44e1db8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc07c160 con 0x7f44dc1059d0 2024-02-19T18:52:38.605 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.459+0000 7f44db7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc07bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.459+0000 7f44db7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc07bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52510/0 (socket says 172.21.15.46:52510) 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.459+0000 7f44db7fe700 1 -- 172.21.15.46:0/2325099836 learned_addr learned my addr 172.21.15.46:0/2325099836 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.459+0000 7f44db7fe700 1 -- 172.21.15.46:0/2325099836 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc009500 con 0x7f44dc1059d0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.460+0000 7f44db7fe700 1 --2- 172.21.15.46:0/2325099836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc07bc20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0046b0 tx=0x7f44cc0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.460+0000 7f44d8ff9700 1 -- 172.21.15.46:0/2325099836 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44cc005e40 con 0x7f44dc1059d0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.460+0000 7f44d8ff9700 1 -- 172.21.15.46:0/2325099836 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44cc006840 con 0x7f44dc1059d0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.460+0000 7f44e1db8700 1 -- 172.21.15.46:0/2325099836 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44dc07a270 con 0x7f44dc1059d0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.460+0000 7f44d8ff9700 1 -- 172.21.15.46:0/2325099836 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44cc011bc0 con 0x7f44dc1059d0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.460+0000 7f44e1db8700 1 -- 172.21.15.46:0/2325099836 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44dc07a710 con 0x7f44dc1059d0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.461+0000 7f44d8ff9700 1 -- 172.21.15.46:0/2325099836 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f44cc018070 con 0x7f44dc1059d0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.461+0000 7f44e1db8700 1 -- 172.21.15.46:0/2325099836 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44dc062380 con 0x7f44dc1059d0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.461+0000 7f44d8ff9700 1 --2- 172.21.15.46:0/2325099836 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f44c4038400 0x7f44c403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.461+0000 7f44d8ff9700 1 -- 172.21.15.46:0/2325099836 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f44cc04bb60 con 0x7f44dc1059d0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.461+0000 7f44daffd700 1 --2- 172.21.15.46:0/2325099836 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f44c4038400 0x7f44c403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:38.606 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.461+0000 7f44daffd700 1 --2- 172.21.15.46:0/2325099836 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f44c4038400 0x7f44c403a8b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f44d0006fd0 tx=0x7f44d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.466+0000 7f44d8ff9700 1 -- 172.21.15.46:0/2325099836 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f44cc005fa0 con 0x7f44dc1059d0 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.718+0000 7f44e1db8700 1 -- 172.21.15.46:0/2325099836 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f44dc109e60 con 0x7f44dc1059d0 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.968+0000 7f44d8ff9700 1 -- 172.21.15.46:0/2325099836 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f44cc02c350 con 0x7f44dc1059d0 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.970+0000 7f44d8ff9700 1 -- 172.21.15.46:0/2325099836 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f44cc011420 con 0x7f44dc1059d0 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.972+0000 7f44e1db8700 1 -- 172.21.15.46:0/2325099836 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f44c4038400 msgr2=0x7f44c403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.972+0000 7f44e1db8700 1 --2- 172.21.15.46:0/2325099836 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f44c4038400 0x7f44c403a8b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f44d0006fd0 tx=0x7f44d0006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.972+0000 7f44e1db8700 1 -- 172.21.15.46:0/2325099836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 msgr2=0x7f44dc07bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.972+0000 7f44e1db8700 1 --2- 172.21.15.46:0/2325099836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc07bc20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0046b0 tx=0x7f44cc0042e0 comp rx=0 tx=0).stop 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.972+0000 7f44e1db8700 1 -- 172.21.15.46:0/2325099836 shutdown_connections 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.972+0000 7f44e1db8700 1 --2- 172.21.15.46:0/2325099836 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f44c4038400 0x7f44c403a8b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.972+0000 7f44e1db8700 1 --2- 172.21.15.46:0/2325099836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44dc1059d0 0x7f44dc07bc20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.972+0000 7f44e1db8700 1 -- 172.21.15.46:0/2325099836 >> 172.21.15.46:0/2325099836 conn(0x7f44dc101020 msgr2=0x7f44dc101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.972+0000 7f44e1db8700 1 -- 172.21.15.46:0/2325099836 shutdown_connections 2024-02-19T18:52:38.607 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:37.972+0000 7f44e1db8700 1 -- 172.21.15.46:0/2325099836 wait complete. 2024-02-19T18:52:39.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:38 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2325099836' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-19T18:52:39.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:38 smithi046 ceph-mon[29647]: mgrmap e9: smithi046.qtceex(active, since 26s) 2024-02-19T18:52:39.869 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:52:39.869 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-19T18:52:39.869 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-19T18:52:39.869 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "smithi046.qtceex", 2024-02-19T18:52:39.869 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.983+0000 7f4ef40b1700 1 Processor -- start 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.983+0000 7f4ef40b1700 1 -- start start 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.983+0000 7f4ef40b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.983+0000 7f4ef40b1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec105230 con 0x7f4eec1048e0 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.984+0000 7f4ef1e4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.984+0000 7f4ef1e4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45650/0 (socket says 172.21.15.46:45650) 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.984+0000 7f4ef1e4d700 1 -- 172.21.15.46:0/3045640713 learned_addr learned my addr 172.21.15.46:0/3045640713 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.984+0000 7f4ef1e4d700 1 -- 172.21.15.46:0/3045640713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec105370 con 0x7f4eec1048e0 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.984+0000 7f4ef1e4d700 1 --2- 172.21.15.46:0/3045640713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec104cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00098a0 tx=0x7f4ee0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23c5a34e79df656 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.984+0000 7f4ef0e4b700 1 -- 172.21.15.46:0/3045640713 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee0004180 con 0x7f4eec1048e0 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.984+0000 7f4ef0e4b700 1 -- 172.21.15.46:0/3045640713 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ee00042e0 con 0x7f4eec1048e0 2024-02-19T18:52:39.870 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.984+0000 7f4ef0e4b700 1 -- 172.21.15.46:0/3045640713 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee0011af0 con 0x7f4eec1048e0 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.985+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3045640713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 msgr2=0x7f4eec104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.985+0000 7f4ef40b1700 1 --2- 172.21.15.46:0/3045640713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec104cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00098a0 tx=0x7f4ee0009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.985+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3045640713 shutdown_connections 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.985+0000 7f4ef40b1700 1 --2- 172.21.15.46:0/3045640713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec104cf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.985+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3045640713 >> 172.21.15.46:0/3045640713 conn(0x7f4eec0fff10 msgr2=0x7f4eec102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.985+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3045640713 shutdown_connections 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.985+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3045640713 wait complete. 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.986+0000 7f4ef40b1700 1 Processor -- start 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.986+0000 7f4ef40b1700 1 -- start start 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.986+0000 7f4ef40b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.986+0000 7f4ef40b1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec199cb0 con 0x7f4eec1048e0 2024-02-19T18:52:39.871 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.986+0000 7f4ef1e4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.986+0000 7f4ef1e4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45656/0 (socket says 172.21.15.46:45656) 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.986+0000 7f4ef1e4d700 1 -- 172.21.15.46:0/3757033100 learned_addr learned my addr 172.21.15.46:0/3757033100 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.986+0000 7f4ef1e4d700 1 -- 172.21.15.46:0/3757033100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0009550 con 0x7f4eec1048e0 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.987+0000 7f4ef1e4d700 1 --2- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec199770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0011670 tx=0x7f4ee0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.987+0000 7f4edeffd700 1 -- 172.21.15.46:0/3757033100 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee0003a40 con 0x7f4eec1048e0 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.987+0000 7f4edeffd700 1 -- 172.21.15.46:0/3757033100 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ee0003ba0 con 0x7f4eec1048e0 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.987+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3757033100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec199eb0 con 0x7f4eec1048e0 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.987+0000 7f4edeffd700 1 -- 172.21.15.46:0/3757033100 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee0024820 con 0x7f4eec1048e0 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.987+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3757033100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec19a350 con 0x7f4eec1048e0 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.988+0000 7f4edeffd700 1 -- 172.21.15.46:0/3757033100 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f4ee0024a90 con 0x7f4eec1048e0 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.988+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3757033100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec193480 con 0x7f4eec1048e0 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.988+0000 7f4edeffd700 1 --2- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f4ed8038450 0x7f4ed803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.988+0000 7f4ef164c700 1 -- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f4ed8038450 msgr2=0x7f4ed803a900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/1408120197 2024-02-19T18:52:39.872 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.988+0000 7f4edeffd700 1 -- 172.21.15.46:0/3757033100 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4ee004c450 con 0x7f4eec1048e0 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.988+0000 7f4ef164c700 1 --2- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f4ed8038450 0x7f4ed803a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:38.993+0000 7f4edeffd700 1 -- 172.21.15.46:0/3757033100 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4ee0022310 con 0x7f4eec1048e0 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.189+0000 7f4ef164c700 1 -- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f4ed8038450 msgr2=0x7f4ed803a900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/1408120197 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.189+0000 7f4ef164c700 1 --2- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f4ed8038450 0x7f4ed803a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.251+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3757033100 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f4eec02d050 con 0x7f4eec1048e0 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.252+0000 7f4edeffd700 1 -- 172.21.15.46:0/3757033100 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f4ee0018b00 con 0x7f4eec1048e0 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.254+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f4ed8038450 msgr2=0x7f4ed803a900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.254+0000 7f4ef40b1700 1 --2- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f4ed8038450 0x7f4ed803a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.254+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 msgr2=0x7f4eec199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.254+0000 7f4ef40b1700 1 --2- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec199770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0011670 tx=0x7f4ee0011aa0 comp rx=0 tx=0).stop 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.254+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3757033100 shutdown_connections 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.254+0000 7f4ef40b1700 1 --2- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7f4ed8038450 0x7f4ed803a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.254+0000 7f4ef40b1700 1 --2- 172.21.15.46:0/3757033100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4eec1048e0 0x7f4eec199770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:39.874 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.254+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3757033100 >> 172.21.15.46:0/3757033100 conn(0x7f4eec0fff10 msgr2=0x7f4eec100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:39.874 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.254+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3757033100 shutdown_connections 2024-02-19T18:52:39.874 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:39.254+0000 7f4ef40b1700 1 -- 172.21.15.46:0/3757033100 wait complete. 2024-02-19T18:52:39.874 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-02-19T18:52:39.874 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 9... 2024-02-19T18:52:40.115 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:39 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3757033100' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: Active manager daemon smithi046.qtceex restarted 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: Activating manager daemon smithi046.qtceex 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: osdmap e3: 0 total, 0 up, 0 in 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: mgrmap e10: smithi046.qtceex(active, starting, since 0.0031404s) 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi046.qtceex", "id": "smithi046.qtceex"}]: dispatch 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: Manager daemon smithi046.qtceex is now available 2024-02-19T18:52:45.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:52:45.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:44 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:52:46.038 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:45 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/mirror_snapshot_schedule"}]: dispatch 2024-02-19T18:52:46.038 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:45 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/trash_purge_schedule"}]: dispatch 2024-02-19T18:52:46.038 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:45 smithi046 ceph-mon[29647]: mgrmap e11: smithi046.qtceex(active, since 1.00564s) 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.323+0000 7fc55ea4d700 1 Processor -- start 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.323+0000 7fc55ea4d700 1 -- start start 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.323+0000 7fc55ea4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558108900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.323+0000 7fc55ea4d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc558079cf0 con 0x7fc558106520 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.323+0000 7fc557fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558108900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.324+0000 7fc557fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558108900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45670/0 (socket says 172.21.15.46:45670) 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.324+0000 7fc557fff700 1 -- 172.21.15.46:0/3336823482 learned_addr learned my addr 172.21.15.46:0/3336823482 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:46.758 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.324+0000 7fc557fff700 1 -- 172.21.15.46:0/3336823482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc558079e30 con 0x7fc558106520 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.324+0000 7fc557fff700 1 --2- 172.21.15.46:0/3336823482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558108900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc5480098a0 tx=0x7fc548009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e773f2fd3cdf73ae server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.324+0000 7fc556ffd700 1 -- 172.21.15.46:0/3336823482 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc548004180 con 0x7fc558106520 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.324+0000 7fc556ffd700 1 -- 172.21.15.46:0/3336823482 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc5480042e0 con 0x7fc558106520 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.324+0000 7fc556ffd700 1 -- 172.21.15.46:0/3336823482 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc548011af0 con 0x7fc558106520 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.325+0000 7fc55ea4d700 1 -- 172.21.15.46:0/3336823482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 msgr2=0x7fc558108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.325+0000 7fc55ea4d700 1 --2- 172.21.15.46:0/3336823482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558108900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc5480098a0 tx=0x7fc548009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.325+0000 7fc55ea4d700 1 -- 172.21.15.46:0/3336823482 shutdown_connections 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.325+0000 7fc55ea4d700 1 --2- 172.21.15.46:0/3336823482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558108900 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.325+0000 7fc55ea4d700 1 -- 172.21.15.46:0/3336823482 >> 172.21.15.46:0/3336823482 conn(0x7fc5580ffee0 msgr2=0x7fc558102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.325+0000 7fc55ea4d700 1 -- 172.21.15.46:0/3336823482 shutdown_connections 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.325+0000 7fc55ea4d700 1 -- 172.21.15.46:0/3336823482 wait complete. 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.325+0000 7fc55ea4d700 1 Processor -- start 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.326+0000 7fc55ea4d700 1 -- start start 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.326+0000 7fc55ea4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.326+0000 7fc55ea4d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc558199cb0 con 0x7fc558106520 2024-02-19T18:52:46.759 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.326+0000 7fc557fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.326+0000 7fc557fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45676/0 (socket says 172.21.15.46:45676) 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.326+0000 7fc557fff700 1 -- 172.21.15.46:0/4107930314 learned_addr learned my addr 172.21.15.46:0/4107930314 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.326+0000 7fc557fff700 1 -- 172.21.15.46:0/4107930314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548009550 con 0x7fc558106520 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.326+0000 7fc557fff700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558199770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc548011670 tx=0x7fc548011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.327+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5480039c0 con 0x7fc558106520 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.327+0000 7fc55ea4d700 1 -- 172.21.15.46:0/4107930314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc558199eb0 con 0x7fc558106520 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.327+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc548003b20 con 0x7fc558106520 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.327+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5480247f0 con 0x7fc558106520 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.327+0000 7fc55ea4d700 1 -- 172.21.15.46:0/4107930314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55819a350 con 0x7fc558106520 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.328+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fc548024ab0 con 0x7fc558106520 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.328+0000 7fc5557fa700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 0x7fc54003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.328+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 --> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc54003afc0 con 0x7fc540038400 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.328+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc54804c530 con 0x7fc558106520 2024-02-19T18:52:46.760 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.328+0000 7fc5577fe700 1 -- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 msgr2=0x7fc54003a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/1408120197 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.328+0000 7fc5577fe700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 0x7fc54003a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.529+0000 7fc5577fe700 1 -- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 msgr2=0x7fc54003a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/1408120197 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.529+0000 7fc5577fe700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 0x7fc54003a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.930+0000 7fc5577fe700 1 -- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 msgr2=0x7fc54003a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/1408120197 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:40.930+0000 7fc5577fe700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 0x7fc54003a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:41.731+0000 7fc5577fe700 1 -- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 msgr2=0x7fc54003a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/1408120197 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:41.731+0000 7fc5577fe700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 0x7fc54003a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:43.332+0000 7fc5577fe700 1 -- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 msgr2=0x7fc54003a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/1408120197 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:43.332+0000 7fc5577fe700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 0x7fc54003a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:44.819+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7fc54801ac70 con 0x7fc558106520 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:44.820+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 msgr2=0x7fc54003a8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:44.820+0000 7fc5557fa700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 0x7fc54003a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.821+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7fc54801bd40 con 0x7fc558106520 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.821+0000 7fc5557fa700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc54003beb0 0x7fc54003e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:46.761 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.821+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 --> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc54003afc0 con 0x7fc54003beb0 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.821+0000 7fc5577fe700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc54003beb0 0x7fc54003e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.823+0000 7fc5577fe700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc54003beb0 0x7fc54003e290 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc54c003a10 tx=0x7fc54c0092b0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.824+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 <== mgr.14164 v2:172.21.15.46:6800/3727775990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fc54003afc0 con 0x7fc54003beb0 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.830+0000 7fc55ea4d700 1 -- 172.21.15.46:0/4107930314 --> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fc55819aab0 con 0x7fc54003beb0 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.830+0000 7fc5557fa700 1 -- 172.21.15.46:0/4107930314 <== mgr.14164 v2:172.21.15.46:6800/3727775990 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fc55819aab0 con 0x7fc54003beb0 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 -- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc54003beb0 msgr2=0x7fc54003e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc54003beb0 0x7fc54003e290 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc54c003a10 tx=0x7fc54c0092b0 comp rx=0 tx=0).stop 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 -- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 msgr2=0x7fc558199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558199770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc548011670 tx=0x7fc548011aa0 comp rx=0 tx=0).stop 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 -- 172.21.15.46:0/4107930314 shutdown_connections 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc54003beb0 0x7fc54003e290 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc558106520 0x7fc558199770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 --2- 172.21.15.46:0/4107930314 >> [v2:172.21.15.46:6800/1408120197,v1:172.21.15.46:6801/1408120197] conn(0x7fc540038400 0x7fc54003a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:46.762 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 -- 172.21.15.46:0/4107930314 >> 172.21.15.46:0/4107930314 conn(0x7fc5580ffee0 msgr2=0x7fc558101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:46.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 -- 172.21.15.46:0/4107930314 shutdown_connections 2024-02-19T18:52:46.763 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:45.831+0000 7fc55ea4d700 1 -- 172.21.15.46:0/4107930314 wait complete. 2024-02-19T18:52:46.763 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 9 is available 2024-02-19T18:52:46.763 INFO:teuthology.orchestra.run.smithi046.stdout:Generating a dashboard self-signed certificate... 2024-02-19T18:52:47.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:46 smithi046 ceph-mon[29647]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-19T18:52:47.023 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:46 smithi046 ceph-mon[29647]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-19T18:52:48.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-19T18:52:48.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.107+0000 7fa906d29700 1 Processor -- start 2024-02-19T18:52:48.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.107+0000 7fa906d29700 1 -- start start 2024-02-19T18:52:48.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.107+0000 7fa906d29700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa900106360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:48.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.107+0000 7fa906d29700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001068a0 con 0x7fa900105f50 2024-02-19T18:52:48.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.108+0000 7fa904ac5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa900106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:48.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.108+0000 7fa904ac5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa900106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45726/0 (socket says 172.21.15.46:45726) 2024-02-19T18:52:48.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.108+0000 7fa904ac5700 1 -- 172.21.15.46:0/3737126518 learned_addr learned my addr 172.21.15.46:0/3737126518 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:48.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.108+0000 7fa904ac5700 1 -- 172.21.15.46:0/3737126518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9001069e0 con 0x7fa900105f50 2024-02-19T18:52:48.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.108+0000 7fa904ac5700 1 --2- 172.21.15.46:0/3737126518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa900106360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40098a0 tx=0x7fa8f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d704aeea0cdfbaaf server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.108+0000 7fa8ff7fe700 1 -- 172.21.15.46:0/3737126518 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f4004180 con 0x7fa900105f50 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.108+0000 7fa8ff7fe700 1 -- 172.21.15.46:0/3737126518 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8f40042e0 con 0x7fa900105f50 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.108+0000 7fa8ff7fe700 1 -- 172.21.15.46:0/3737126518 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f4011af0 con 0x7fa900105f50 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.109+0000 7fa906d29700 1 -- 172.21.15.46:0/3737126518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 msgr2=0x7fa900106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.109+0000 7fa906d29700 1 --2- 172.21.15.46:0/3737126518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa900106360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40098a0 tx=0x7fa8f4009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.109+0000 7fa906d29700 1 -- 172.21.15.46:0/3737126518 shutdown_connections 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.109+0000 7fa906d29700 1 --2- 172.21.15.46:0/3737126518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa900106360 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.109+0000 7fa906d29700 1 -- 172.21.15.46:0/3737126518 >> 172.21.15.46:0/3737126518 conn(0x7fa9000ff670 msgr2=0x7fa900101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.109+0000 7fa906d29700 1 -- 172.21.15.46:0/3737126518 shutdown_connections 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.109+0000 7fa906d29700 1 -- 172.21.15.46:0/3737126518 wait complete. 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.109+0000 7fa906d29700 1 Processor -- start 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa906d29700 1 -- start start 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa906d29700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa90019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa906d29700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90019be80 con 0x7fa900105f50 2024-02-19T18:52:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa904ac5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa90019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa904ac5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa90019b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45738/0 (socket says 172.21.15.46:45738) 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa904ac5700 1 -- 172.21.15.46:0/822299001 learned_addr learned my addr 172.21.15.46:0/822299001 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa904ac5700 1 -- 172.21.15.46:0/822299001 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f4009550 con 0x7fa900105f50 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa904ac5700 1 --2- 172.21.15.46:0/822299001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa90019b940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4011670 tx=0x7fa8f4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa8fdffb700 1 -- 172.21.15.46:0/822299001 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f4003a40 con 0x7fa900105f50 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa8fdffb700 1 -- 172.21.15.46:0/822299001 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8f4003ba0 con 0x7fa900105f50 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa906d29700 1 -- 172.21.15.46:0/822299001 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90019c080 con 0x7fa900105f50 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.110+0000 7fa8fdffb700 1 -- 172.21.15.46:0/822299001 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f4024790 con 0x7fa900105f50 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.111+0000 7fa906d29700 1 -- 172.21.15.46:0/822299001 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90019c520 con 0x7fa900105f50 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.111+0000 7fa8fdffb700 1 -- 172.21.15.46:0/822299001 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fa8f402d3f0 con 0x7fa900105f50 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.112+0000 7fa906d29700 1 -- 172.21.15.46:0/822299001 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90010bca0 con 0x7fa900105f50 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.112+0000 7fa8fdffb700 1 --2- 172.21.15.46:0/822299001 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa8f0038440 0x7fa8f003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.112+0000 7fa8fdffb700 1 -- 172.21.15.46:0/822299001 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa8f404c650 con 0x7fa900105f50 2024-02-19T18:52:48.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.112+0000 7fa8fffff700 1 --2- 172.21.15.46:0/822299001 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa8f0038440 0x7fa8f003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.112+0000 7fa8fffff700 1 --2- 172.21.15.46:0/822299001 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa8f0038440 0x7fa8f003a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec006fd0 tx=0x7fa8ec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.117+0000 7fa8fdffb700 1 -- 172.21.15.46:0/822299001 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa8f4010380 con 0x7fa900105f50 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.328+0000 7fa906d29700 1 -- 172.21.15.46:0/822299001 --> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fa900101990 con 0x7fa8f0038440 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.389+0000 7fa8fdffb700 1 -- 172.21.15.46:0/822299001 <== mgr.14164 v2:172.21.15.46:6800/3727775990 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fa900101990 con 0x7fa8f0038440 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.392+0000 7fa906d29700 1 -- 172.21.15.46:0/822299001 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa8f0038440 msgr2=0x7fa8f003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.392+0000 7fa906d29700 1 --2- 172.21.15.46:0/822299001 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa8f0038440 0x7fa8f003a8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec006fd0 tx=0x7fa8ec006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.392+0000 7fa906d29700 1 -- 172.21.15.46:0/822299001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 msgr2=0x7fa90019b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.392+0000 7fa906d29700 1 --2- 172.21.15.46:0/822299001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa90019b940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4011670 tx=0x7fa8f4011b50 comp rx=0 tx=0).stop 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.392+0000 7fa906d29700 1 -- 172.21.15.46:0/822299001 shutdown_connections 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.392+0000 7fa906d29700 1 --2- 172.21.15.46:0/822299001 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa8f0038440 0x7fa8f003a8f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.392+0000 7fa906d29700 1 --2- 172.21.15.46:0/822299001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa900105f50 0x7fa90019b940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.392+0000 7fa906d29700 1 -- 172.21.15.46:0/822299001 >> 172.21.15.46:0/822299001 conn(0x7fa9000ff670 msgr2=0x7fa900100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:48.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.392+0000 7fa906d29700 1 -- 172.21.15.46:0/822299001 shutdown_connections 2024-02-19T18:52:48.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:47.392+0000 7fa906d29700 1 -- 172.21.15.46:0/822299001 wait complete. 2024-02-19T18:52:48.005 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial admin user... 2024-02-19T18:52:48.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:47 smithi046 ceph-mon[29647]: [19/Feb/2024:18:52:46] ENGINE Bus STARTING 2024-02-19T18:52:48.121 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:47 smithi046 ceph-mon[29647]: [19/Feb/2024:18:52:46] ENGINE Serving on https://172.21.15.46:7150 2024-02-19T18:52:48.121 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:47 smithi046 ceph-mon[29647]: [19/Feb/2024:18:52:46] ENGINE Serving on http://172.21.15.46:8765 2024-02-19T18:52:48.121 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:47 smithi046 ceph-mon[29647]: [19/Feb/2024:18:52:46] ENGINE Bus STARTED 2024-02-19T18:52:48.121 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:47 smithi046 ceph-mon[29647]: mgrmap e12: smithi046.qtceex(active, since 2s) 2024-02-19T18:52:48.121 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:47 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:48.121 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:47 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:48.121 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:47 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:48.940 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:48 smithi046 ceph-mon[29647]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:48.940 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:48 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:49.643 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$iYWdkVajfW73G1jl2yRNM.TibGndD4iAg/gsHG8YaqA6yQ5.YnGUC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708368768, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-19T18:52:49.644 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.433+0000 7f5818c05700 1 Processor -- start 2024-02-19T18:52:49.644 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.433+0000 7f5818c05700 1 -- start start 2024-02-19T18:52:49.644 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.433+0000 7f5818c05700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814108930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:49.644 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.433+0000 7f5818c05700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58140744b0 con 0x7f5814106550 2024-02-19T18:52:49.644 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.434+0000 7f581259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814108930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:49.644 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.434+0000 7f581259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814108930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55548/0 (socket says 172.21.15.46:55548) 2024-02-19T18:52:49.644 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.434+0000 7f581259c700 1 -- 172.21.15.46:0/1183554719 learned_addr learned my addr 172.21.15.46:0/1183554719 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:49.644 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.434+0000 7f581259c700 1 -- 172.21.15.46:0/1183554719 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58140745f0 con 0x7f5814106550 2024-02-19T18:52:49.644 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.434+0000 7f581259c700 1 --2- 172.21.15.46:0/1183554719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814108930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f58040098a0 tx=0x7f5804009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df4949b70bf39e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:49.644 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.434+0000 7f581159a700 1 -- 172.21.15.46:0/1183554719 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5804004180 con 0x7f5814106550 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.434+0000 7f581159a700 1 -- 172.21.15.46:0/1183554719 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58040042e0 con 0x7f5814106550 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.434+0000 7f581159a700 1 -- 172.21.15.46:0/1183554719 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5804011af0 con 0x7f5814106550 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.435+0000 7f5818c05700 1 -- 172.21.15.46:0/1183554719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 msgr2=0x7f5814108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.435+0000 7f5818c05700 1 --2- 172.21.15.46:0/1183554719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814108930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f58040098a0 tx=0x7f5804009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.435+0000 7f5818c05700 1 -- 172.21.15.46:0/1183554719 shutdown_connections 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.435+0000 7f5818c05700 1 --2- 172.21.15.46:0/1183554719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814108930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.435+0000 7f5818c05700 1 -- 172.21.15.46:0/1183554719 >> 172.21.15.46:0/1183554719 conn(0x7f58140fff10 msgr2=0x7f5814102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.435+0000 7f5818c05700 1 -- 172.21.15.46:0/1183554719 shutdown_connections 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.435+0000 7f5818c05700 1 -- 172.21.15.46:0/1183554719 wait complete. 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.436+0000 7f5818c05700 1 Processor -- start 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.436+0000 7f5818c05700 1 -- start start 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.436+0000 7f5818c05700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:49.645 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.436+0000 7f5818c05700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5814199ca0 con 0x7f5814106550 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.436+0000 7f581259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.436+0000 7f581259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55558/0 (socket says 172.21.15.46:55558) 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.436+0000 7f581259c700 1 -- 172.21.15.46:0/3164936647 learned_addr learned my addr 172.21.15.46:0/3164936647 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.436+0000 7f581259c700 1 -- 172.21.15.46:0/3164936647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804009550 con 0x7f5814106550 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.436+0000 7f581259c700 1 --2- 172.21.15.46:0/3164936647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814199760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5804011670 tx=0x7f5804011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.437+0000 7f58037fe700 1 -- 172.21.15.46:0/3164936647 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58040039f0 con 0x7f5814106550 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.437+0000 7f58037fe700 1 -- 172.21.15.46:0/3164936647 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5804003b50 con 0x7f5814106550 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.437+0000 7f5818c05700 1 -- 172.21.15.46:0/3164936647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5814199ea0 con 0x7f5814106550 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.437+0000 7f58037fe700 1 -- 172.21.15.46:0/3164936647 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58040247c0 con 0x7f5814106550 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.437+0000 7f5818c05700 1 -- 172.21.15.46:0/3164936647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581419a340 con 0x7f5814106550 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.438+0000 7f58037fe700 1 -- 172.21.15.46:0/3164936647 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f580401a430 con 0x7f5814106550 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.438+0000 7f5818c05700 1 -- 172.21.15.46:0/3164936647 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5814109ad0 con 0x7f5814106550 2024-02-19T18:52:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.438+0000 7f58037fe700 1 --2- 172.21.15.46:0/3164936647 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f57fc038490 0x7f57fc03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:49.647 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.438+0000 7f58037fe700 1 -- 172.21.15.46:0/3164936647 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f580404c4b0 con 0x7f5814106550 2024-02-19T18:52:49.647 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.438+0000 7f5811d9b700 1 --2- 172.21.15.46:0/3164936647 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f57fc038490 0x7f57fc03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:49.647 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.438+0000 7f5811d9b700 1 --2- 172.21.15.46:0/3164936647 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f57fc038490 0x7f57fc03a940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5808006fd0 tx=0x7f5808006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:49.647 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.443+0000 7f58037fe700 1 -- 172.21.15.46:0/3164936647 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f580400b5d0 con 0x7f5814106550 2024-02-19T18:52:49.647 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.662+0000 7f5818c05700 1 -- 172.21.15.46:0/3164936647 --> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f58140621a0 con 0x7f57fc038490 2024-02-19T18:52:49.647 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.910+0000 7f58037fe700 1 -- 172.21.15.46:0/3164936647 <== mgr.14164 v2:172.21.15.46:6800/3727775990 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f58140621a0 con 0x7f57fc038490 2024-02-19T18:52:49.647 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.912+0000 7f5818c05700 1 -- 172.21.15.46:0/3164936647 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f57fc038490 msgr2=0x7f57fc03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:49.647 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.912+0000 7f5818c05700 1 --2- 172.21.15.46:0/3164936647 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f57fc038490 0x7f57fc03a940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5808006fd0 tx=0x7f5808006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:49.647 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.912+0000 7f5818c05700 1 -- 172.21.15.46:0/3164936647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 msgr2=0x7f5814199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:49.647 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.912+0000 7f5818c05700 1 --2- 172.21.15.46:0/3164936647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814199760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5804011670 tx=0x7f5804011b50 comp rx=0 tx=0).stop 2024-02-19T18:52:49.648 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.912+0000 7f5818c05700 1 -- 172.21.15.46:0/3164936647 shutdown_connections 2024-02-19T18:52:49.648 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.912+0000 7f5818c05700 1 --2- 172.21.15.46:0/3164936647 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f57fc038490 0x7f57fc03a940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:49.648 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.912+0000 7f5818c05700 1 --2- 172.21.15.46:0/3164936647 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5814106550 0x7f5814199760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:49.648 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.912+0000 7f5818c05700 1 -- 172.21.15.46:0/3164936647 >> 172.21.15.46:0/3164936647 conn(0x7f58140fff10 msgr2=0x7f5814101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:49.648 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.912+0000 7f5818c05700 1 -- 172.21.15.46:0/3164936647 shutdown_connections 2024-02-19T18:52:49.648 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:48.912+0000 7f5818c05700 1 -- 172.21.15.46:0/3164936647 wait complete. 2024-02-19T18:52:49.648 INFO:teuthology.orchestra.run.smithi046.stdout:Fetching dashboard port number... 2024-02-19T18:52:50.180 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:49 smithi046 ceph-mon[29647]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:52:50.181 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:49 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:51.578 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 8443 2024-02-19T18:52:51.578 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.824+0000 7fe376025700 1 Processor -- start 2024-02-19T18:52:51.578 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.824+0000 7fe376025700 1 -- start start 2024-02-19T18:52:51.578 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.824+0000 7fe376025700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe370105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.824+0000 7fe376025700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe370106320 con 0x7fe3701059d0 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.824+0000 7fe36f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe370105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.824+0000 7fe36f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe370105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55560/0 (socket says 172.21.15.46:55560) 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.824+0000 7fe36f7fe700 1 -- 172.21.15.46:0/906089056 learned_addr learned my addr 172.21.15.46:0/906089056 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.824+0000 7fe36f7fe700 1 -- 172.21.15.46:0/906089056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe370106460 con 0x7fe3701059d0 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.825+0000 7fe36f7fe700 1 --2- 172.21.15.46:0/906089056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe370105de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe360009870 tx=0x7fe360009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaffcb855319a6a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.825+0000 7fe36e7fc700 1 -- 172.21.15.46:0/906089056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe360005c30 con 0x7fe3701059d0 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.825+0000 7fe36e7fc700 1 -- 172.21.15.46:0/906089056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe3600044e0 con 0x7fe3701059d0 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.825+0000 7fe36e7fc700 1 -- 172.21.15.46:0/906089056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe360006030 con 0x7fe3701059d0 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.825+0000 7fe376025700 1 -- 172.21.15.46:0/906089056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 msgr2=0x7fe370105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.825+0000 7fe376025700 1 --2- 172.21.15.46:0/906089056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe370105de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe360009870 tx=0x7fe360009b80 comp rx=0 tx=0).stop 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.825+0000 7fe376025700 1 -- 172.21.15.46:0/906089056 shutdown_connections 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.825+0000 7fe376025700 1 --2- 172.21.15.46:0/906089056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe370105de0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:51.579 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.825+0000 7fe376025700 1 -- 172.21.15.46:0/906089056 >> 172.21.15.46:0/906089056 conn(0x7fe370101020 msgr2=0x7fe370103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.826+0000 7fe376025700 1 -- 172.21.15.46:0/906089056 shutdown_connections 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.826+0000 7fe376025700 1 -- 172.21.15.46:0/906089056 wait complete. 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.826+0000 7fe376025700 1 Processor -- start 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.826+0000 7fe376025700 1 -- start start 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe376025700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe37007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe376025700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37007c160 con 0x7fe3701059d0 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe36f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe37007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe36f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe37007bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55562/0 (socket says 172.21.15.46:55562) 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe36f7fe700 1 -- 172.21.15.46:0/1684947800 learned_addr learned my addr 172.21.15.46:0/1684947800 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe36f7fe700 1 -- 172.21.15.46:0/1684947800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe360009500 con 0x7fe3701059d0 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe36f7fe700 1 --2- 172.21.15.46:0/1684947800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe37007bc20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3600046b0 tx=0x7fe3600042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe36cff9700 1 -- 172.21.15.46:0/1684947800 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe360005e40 con 0x7fe3701059d0 2024-02-19T18:52:51.580 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe376025700 1 -- 172.21.15.46:0/1684947800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37007a270 con 0x7fe3701059d0 2024-02-19T18:52:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe36cff9700 1 -- 172.21.15.46:0/1684947800 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe360006840 con 0x7fe3701059d0 2024-02-19T18:52:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe36cff9700 1 -- 172.21.15.46:0/1684947800 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe360011bc0 con 0x7fe3701059d0 2024-02-19T18:52:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.827+0000 7fe376025700 1 -- 172.21.15.46:0/1684947800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37007a710 con 0x7fe3701059d0 2024-02-19T18:52:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.828+0000 7fe36cff9700 1 -- 172.21.15.46:0/1684947800 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fe360018070 con 0x7fe3701059d0 2024-02-19T18:52:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.828+0000 7fe376025700 1 -- 172.21.15.46:0/1684947800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe370062380 con 0x7fe3701059d0 2024-02-19T18:52:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.828+0000 7fe36cff9700 1 --2- 172.21.15.46:0/1684947800 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fe358038400 0x7fe35803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.828+0000 7fe36cff9700 1 -- 172.21.15.46:0/1684947800 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe36004bd10 con 0x7fe3701059d0 2024-02-19T18:52:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.828+0000 7fe36effd700 1 --2- 172.21.15.46:0/1684947800 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fe358038400 0x7fe35803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.829+0000 7fe36effd700 1 --2- 172.21.15.46:0/1684947800 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fe358038400 0x7fe35803a8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe364006fd0 tx=0x7fe364006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:51.581 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.834+0000 7fe36cff9700 1 -- 172.21.15.46:0/1684947800 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe36000bd70 con 0x7fe3701059d0 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:50.965+0000 7fe36cff9700 1 -- 172.21.15.46:0/1684947800 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fe360052080 con 0x7fe3701059d0 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.034+0000 7fe376025700 1 -- 172.21.15.46:0/1684947800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fe3701078d0 con 0x7fe3701059d0 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.034+0000 7fe36cff9700 1 -- 172.21.15.46:0/1684947800 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fe36001f070 con 0x7fe3701059d0 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.037+0000 7fe376025700 1 -- 172.21.15.46:0/1684947800 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fe358038400 msgr2=0x7fe35803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.037+0000 7fe376025700 1 --2- 172.21.15.46:0/1684947800 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fe358038400 0x7fe35803a8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe364006fd0 tx=0x7fe364006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.037+0000 7fe376025700 1 -- 172.21.15.46:0/1684947800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 msgr2=0x7fe37007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.037+0000 7fe376025700 1 --2- 172.21.15.46:0/1684947800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe37007bc20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3600046b0 tx=0x7fe3600042e0 comp rx=0 tx=0).stop 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.037+0000 7fe376025700 1 -- 172.21.15.46:0/1684947800 shutdown_connections 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.037+0000 7fe376025700 1 --2- 172.21.15.46:0/1684947800 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fe358038400 0x7fe35803a8b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.037+0000 7fe376025700 1 --2- 172.21.15.46:0/1684947800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3701059d0 0x7fe37007bc20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.037+0000 7fe376025700 1 -- 172.21.15.46:0/1684947800 >> 172.21.15.46:0/1684947800 conn(0x7fe370101020 msgr2=0x7fe370101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.038+0000 7fe376025700 1 -- 172.21.15.46:0/1684947800 shutdown_connections 2024-02-19T18:52:51.582 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:51.038+0000 7fe376025700 1 -- 172.21.15.46:0/1684947800 wait complete. 2024-02-19T18:52:51.584 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-19T18:52:51.584 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-02-19T18:52:51.591 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-19T18:52:51.592 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-02-19T18:52:51.592 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-02-19T18:52:51.592 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-19T18:52:51.593 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph Dashboard is now available at: 2024-02-19T18:52:51.593 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:52:51.594 INFO:teuthology.orchestra.run.smithi046.stdout: URL: https://smithi046.front.sepia.ceph.com:8443/ 2024-02-19T18:52:51.594 INFO:teuthology.orchestra.run.smithi046.stdout: User: admin 2024-02-19T18:52:51.594 INFO:teuthology.orchestra.run.smithi046.stdout: Password: gqztkmsjnt 2024-02-19T18:52:51.594 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:52:51.594 INFO:teuthology.orchestra.run.smithi046.stdout:Saving cluster configuration to /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config directory 2024-02-19T18:52:51.594 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling autotune for osd_memory_target 2024-02-19T18:52:52.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:51 smithi046 ceph-mon[29647]: mgrmap e13: smithi046.qtceex(active, since 6s) 2024-02-19T18:52:52.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:51 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1684947800' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-19T18:52:52.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.059+0000 7fd1d2f60700 1 Processor -- start 2024-02-19T18:52:52.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.059+0000 7fd1d2f60700 1 -- start start 2024-02-19T18:52:52.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.059+0000 7fd1d2f60700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc108910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:52.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.059+0000 7fd1d2f60700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc079cf0 con 0x7fd1cc106530 2024-02-19T18:52:52.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.059+0000 7fd1d0cfc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc108910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:52.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.059+0000 7fd1d0cfc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc108910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55578/0 (socket says 172.21.15.46:55578) 2024-02-19T18:52:52.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.059+0000 7fd1d0cfc700 1 -- 172.21.15.46:0/3731869638 learned_addr learned my addr 172.21.15.46:0/3731869638 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:52.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.059+0000 7fd1d0cfc700 1 -- 172.21.15.46:0/3731869638 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc079e30 con 0x7fd1cc106530 2024-02-19T18:52:52.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.060+0000 7fd1d0cfc700 1 --2- 172.21.15.46:0/3731869638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc108910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00098a0 tx=0x7fd1c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb4024b4937668c server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.060+0000 7fd1cb7fe700 1 -- 172.21.15.46:0/3731869638 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1c0004180 con 0x7fd1cc106530 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.060+0000 7fd1cb7fe700 1 -- 172.21.15.46:0/3731869638 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd1c00042e0 con 0x7fd1cc106530 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.060+0000 7fd1cb7fe700 1 -- 172.21.15.46:0/3731869638 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1c0011af0 con 0x7fd1cc106530 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.060+0000 7fd1d2f60700 1 -- 172.21.15.46:0/3731869638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 msgr2=0x7fd1cc108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.060+0000 7fd1d2f60700 1 --2- 172.21.15.46:0/3731869638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc108910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00098a0 tx=0x7fd1c0009bb0 comp rx=0 tx=0).stop 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.060+0000 7fd1d2f60700 1 -- 172.21.15.46:0/3731869638 shutdown_connections 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.060+0000 7fd1d2f60700 1 --2- 172.21.15.46:0/3731869638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc108910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.060+0000 7fd1d2f60700 1 -- 172.21.15.46:0/3731869638 >> 172.21.15.46:0/3731869638 conn(0x7fd1cc0ffed0 msgr2=0x7fd1cc102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.061+0000 7fd1d2f60700 1 -- 172.21.15.46:0/3731869638 shutdown_connections 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.061+0000 7fd1d2f60700 1 -- 172.21.15.46:0/3731869638 wait complete. 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.061+0000 7fd1d2f60700 1 Processor -- start 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.061+0000 7fd1d2f60700 1 -- start start 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.061+0000 7fd1d2f60700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.061+0000 7fd1d2f60700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc199ca0 con 0x7fd1cc106530 2024-02-19T18:52:52.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.062+0000 7fd1d0cfc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.062+0000 7fd1d0cfc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55588/0 (socket says 172.21.15.46:55588) 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.062+0000 7fd1d0cfc700 1 -- 172.21.15.46:0/356502553 learned_addr learned my addr 172.21.15.46:0/356502553 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.062+0000 7fd1d0cfc700 1 -- 172.21.15.46:0/356502553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c0009550 con 0x7fd1cc106530 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.062+0000 7fd1d0cfc700 1 --2- 172.21.15.46:0/356502553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc199760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0011670 tx=0x7fd1c0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.062+0000 7fd1c9ffb700 1 -- 172.21.15.46:0/356502553 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1c00039c0 con 0x7fd1cc106530 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.062+0000 7fd1c9ffb700 1 -- 172.21.15.46:0/356502553 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd1c0003b20 con 0x7fd1cc106530 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.062+0000 7fd1d2f60700 1 -- 172.21.15.46:0/356502553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc199ea0 con 0x7fd1cc106530 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.062+0000 7fd1c9ffb700 1 -- 172.21.15.46:0/356502553 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1c00247f0 con 0x7fd1cc106530 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.062+0000 7fd1d2f60700 1 -- 172.21.15.46:0/356502553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc19a340 con 0x7fd1cc106530 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.063+0000 7fd1c9ffb700 1 -- 172.21.15.46:0/356502553 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd1c0024a60 con 0x7fd1cc106530 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.063+0000 7fd1d2f60700 1 -- 172.21.15.46:0/356502553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc109ab0 con 0x7fd1cc106530 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.063+0000 7fd1c9ffb700 1 --2- 172.21.15.46:0/356502553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd1bc0384f0 0x7fd1bc03a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.063+0000 7fd1c9ffb700 1 -- 172.21.15.46:0/356502553 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd1c004c640 con 0x7fd1cc106530 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.064+0000 7fd1cbfff700 1 --2- 172.21.15.46:0/356502553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd1bc0384f0 0x7fd1bc03a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:52.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.064+0000 7fd1cbfff700 1 --2- 172.21.15.46:0/356502553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd1bc0384f0 0x7fd1bc03a9a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8006fd0 tx=0x7fd1b8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.068+0000 7fd1c9ffb700 1 -- 172.21.15.46:0/356502553 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd1c0022720 con 0x7fd1cc106530 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.267+0000 7fd1d2f60700 1 -- 172.21.15.46:0/356502553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fd1cc19d120 con 0x7fd1cc106530 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.267+0000 7fd1c9ffb700 1 -- 172.21.15.46:0/356502553 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fd1c002c350 con 0x7fd1cc106530 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.270+0000 7fd1d2f60700 1 -- 172.21.15.46:0/356502553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd1bc0384f0 msgr2=0x7fd1bc03a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.270+0000 7fd1d2f60700 1 --2- 172.21.15.46:0/356502553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd1bc0384f0 0x7fd1bc03a9a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8006fd0 tx=0x7fd1b8006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.270+0000 7fd1d2f60700 1 -- 172.21.15.46:0/356502553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 msgr2=0x7fd1cc199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.270+0000 7fd1d2f60700 1 --2- 172.21.15.46:0/356502553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc199760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0011670 tx=0x7fd1c0011aa0 comp rx=0 tx=0).stop 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.270+0000 7fd1d2f60700 1 -- 172.21.15.46:0/356502553 shutdown_connections 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.270+0000 7fd1d2f60700 1 --2- 172.21.15.46:0/356502553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd1bc0384f0 0x7fd1bc03a9a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.270+0000 7fd1d2f60700 1 --2- 172.21.15.46:0/356502553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1cc106530 0x7fd1cc199760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.270+0000 7fd1d2f60700 1 -- 172.21.15.46:0/356502553 >> 172.21.15.46:0/356502553 conn(0x7fd1cc0ffed0 msgr2=0x7fd1cc1015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.270+0000 7fd1d2f60700 1 -- 172.21.15.46:0/356502553 shutdown_connections 2024-02-19T18:52:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:52.270+0000 7fd1d2f60700 1 -- 172.21.15.46:0/356502553 wait complete. 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.277+0000 7fcffd891700 1 Processor -- start 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.277+0000 7fcffd891700 1 -- start start 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.277+0000 7fcffd891700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.277+0000 7fcffd891700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8105230 con 0x7fcff81048e0 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.277+0000 7fcff6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.278+0000 7fcff6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55604/0 (socket says 172.21.15.46:55604) 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.278+0000 7fcff6ffd700 1 -- 172.21.15.46:0/2734435260 learned_addr learned my addr 172.21.15.46:0/2734435260 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.278+0000 7fcff6ffd700 1 -- 172.21.15.46:0/2734435260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8105370 con 0x7fcff81048e0 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.278+0000 7fcff6ffd700 1 --2- 172.21.15.46:0/2734435260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8104cf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009e80 tx=0x7fcfe800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffad8437b2e66a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.278+0000 7fcff5ffb700 1 -- 172.21.15.46:0/2734435260 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfe800e070 con 0x7fcff81048e0 2024-02-19T18:52:54.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.278+0000 7fcff5ffb700 1 -- 172.21.15.46:0/2734435260 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcfe800b8c0 con 0x7fcff81048e0 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.278+0000 7fcff5ffb700 1 -- 172.21.15.46:0/2734435260 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfe80044d0 con 0x7fcff81048e0 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.279+0000 7fcffd891700 1 -- 172.21.15.46:0/2734435260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 msgr2=0x7fcff8104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.279+0000 7fcffd891700 1 --2- 172.21.15.46:0/2734435260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8104cf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009e80 tx=0x7fcfe800b330 comp rx=0 tx=0).stop 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.279+0000 7fcffd891700 1 -- 172.21.15.46:0/2734435260 shutdown_connections 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.279+0000 7fcffd891700 1 --2- 172.21.15.46:0/2734435260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8104cf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.279+0000 7fcffd891700 1 -- 172.21.15.46:0/2734435260 >> 172.21.15.46:0/2734435260 conn(0x7fcff80fff10 msgr2=0x7fcff8102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.279+0000 7fcffd891700 1 -- 172.21.15.46:0/2734435260 shutdown_connections 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.279+0000 7fcffd891700 1 -- 172.21.15.46:0/2734435260 wait complete. 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.279+0000 7fcffd891700 1 Processor -- start 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.279+0000 7fcffd891700 1 -- start start 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcffd891700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:54.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcffd891700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8199c70 con 0x7fcff81048e0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcff6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcff6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55620/0 (socket says 172.21.15.46:55620) 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcff6ffd700 1 -- 172.21.15.46:0/2357306192 learned_addr learned my addr 172.21.15.46:0/2357306192 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcff6ffd700 1 -- 172.21.15.46:0/2357306192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe8009b30 con 0x7fcff81048e0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcff6ffd700 1 --2- 172.21.15.46:0/2357306192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8199730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009e50 tx=0x7fcfe80049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcffc88f700 1 -- 172.21.15.46:0/2357306192 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfe800e040 con 0x7fcff81048e0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcffc88f700 1 -- 172.21.15.46:0/2357306192 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcfe800bcc0 con 0x7fcff81048e0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcffd891700 1 -- 172.21.15.46:0/2357306192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff8199e70 con 0x7fcff81048e0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcffc88f700 1 -- 172.21.15.46:0/2357306192 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfe8012670 con 0x7fcff81048e0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.280+0000 7fcffd891700 1 -- 172.21.15.46:0/2357306192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff819a370 con 0x7fcff81048e0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.281+0000 7fcffc88f700 1 -- 172.21.15.46:0/2357306192 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fcfe8019040 con 0x7fcff81048e0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.281+0000 7fcffc88f700 1 --2- 172.21.15.46:0/2357306192 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fcfe40384a0 0x7fcfe403a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.281+0000 7fcffc88f700 1 -- 172.21.15.46:0/2357306192 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcfe804c170 con 0x7fcff81048e0 2024-02-19T18:52:54.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.282+0000 7fcff67fc700 1 --2- 172.21.15.46:0/2357306192 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fcfe40384a0 0x7fcfe403a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.282+0000 7fcffd891700 1 -- 172.21.15.46:0/2357306192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff8062380 con 0x7fcff81048e0 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.282+0000 7fcff67fc700 1 --2- 172.21.15.46:0/2357306192 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fcfe40384a0 0x7fcfe403a950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0006fd0 tx=0x7fcfe0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.286+0000 7fcffc88f700 1 -- 172.21.15.46:0/2357306192 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcfe801f080 con 0x7fcff81048e0 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.595+0000 7fcffd891700 1 -- 172.21.15.46:0/2357306192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fcff819d310 con 0x7fcff81048e0 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.597+0000 7fcffc88f700 1 -- 172.21.15.46:0/2357306192 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7fcfe804a0c0 con 0x7fcff81048e0 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.599+0000 7fcffd891700 1 -- 172.21.15.46:0/2357306192 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fcfe40384a0 msgr2=0x7fcfe403a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.600+0000 7fcffd891700 1 --2- 172.21.15.46:0/2357306192 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fcfe40384a0 0x7fcfe403a950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0006fd0 tx=0x7fcfe0006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.600+0000 7fcffd891700 1 -- 172.21.15.46:0/2357306192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 msgr2=0x7fcff8199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.600+0000 7fcffd891700 1 --2- 172.21.15.46:0/2357306192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8199730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009e50 tx=0x7fcfe80049f0 comp rx=0 tx=0).stop 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.600+0000 7fcffd891700 1 -- 172.21.15.46:0/2357306192 shutdown_connections 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.600+0000 7fcffd891700 1 --2- 172.21.15.46:0/2357306192 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fcfe40384a0 0x7fcfe403a950 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.600+0000 7fcffd891700 1 --2- 172.21.15.46:0/2357306192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcff81048e0 0x7fcff8199730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:54.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.600+0000 7fcffd891700 1 -- 172.21.15.46:0/2357306192 >> 172.21.15.46:0/2357306192 conn(0x7fcff80fff10 msgr2=0x7fcff80740d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.600+0000 7fcffd891700 1 -- 172.21.15.46:0/2357306192 shutdown_connections 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-02-19T18:52:53.600+0000 7fcffd891700 1 -- 172.21.15.46:0/2357306192 wait complete. 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout:Or, if you are only running a single cluster on this host: 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:52:54.089 INFO:teuthology.orchestra.run.smithi046.stdout: ceph telemetry on 2024-02-19T18:52:54.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:52:54.090 INFO:teuthology.orchestra.run.smithi046.stdout:For more information see: 2024-02-19T18:52:54.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:52:54.090 INFO:teuthology.orchestra.run.smithi046.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-02-19T18:52:54.090 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:52:54.090 INFO:teuthology.orchestra.run.smithi046.stdout:Bootstrap complete. 2024-02-19T18:52:54.118 INFO:tasks.cephadm:Fetching config... 2024-02-19T18:52:54.119 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:52:54.119 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-19T18:52:54.134 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-19T18:52:54.134 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:52:54.134 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-19T18:52:54.189 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-19T18:52:54.189 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:52:54.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/keyring of=/dev/stdout 2024-02-19T18:52:54.257 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-19T18:52:54.257 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:52:54.257 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-19T18:52:54.311 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-19T18:52:54.312 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDngxJ+Pt0PgrICWORjlMNZUZ3lB+5VhmPXAqnuq2OIRdwahK1+iNBdnhYNRCw37IJxyMtPisxJ4vgnvCBihg+qHOl46Wt6i49Hzf5a9dLKvlAYf5ulxQoIwztT+7HbU/IuBNLXajZgoYNZf7kqRfIVWpvrimVo2rtra1RytzL5C3fwvmveAedA1a8QkMBGpl3jxiu/MNZ+EQw2VSS6sT+feV6rHZqiyIR3McSCIt5HqnmfU1vunPG0mrfVxDet2Qod7q2MT4Y1zFNh2k42FHa0nUaO/BSWIOdOvhGu5JmF15/yMK5hHC7PuGOLOSkpp3l+TVboL1aBhBq5a150Ix2AKmqbIkN71zMzP5Hp4ayVDGolWuqKIp4Veciz9Y7EOhquUvf0dqNd7HHFrnzcM2JpzS3GJ5xp3EIvXQwDljEC4Kk4XWIA5sVkOPbkL0KUNVMaIdye/0SfyDP9LBYepHFySFbXSWFVJDmRzbzIB7FQN/AT5wuZe2FiDgn/VRpVVHU= ceph-c412ec66-cf57-11ee-95bb-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-19T18:52:54.404 INFO:teuthology.orchestra.run.smithi046.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDngxJ+Pt0PgrICWORjlMNZUZ3lB+5VhmPXAqnuq2OIRdwahK1+iNBdnhYNRCw37IJxyMtPisxJ4vgnvCBihg+qHOl46Wt6i49Hzf5a9dLKvlAYf5ulxQoIwztT+7HbU/IuBNLXajZgoYNZf7kqRfIVWpvrimVo2rtra1RytzL5C3fwvmveAedA1a8QkMBGpl3jxiu/MNZ+EQw2VSS6sT+feV6rHZqiyIR3McSCIt5HqnmfU1vunPG0mrfVxDet2Qod7q2MT4Y1zFNh2k42FHa0nUaO/BSWIOdOvhGu5JmF15/yMK5hHC7PuGOLOSkpp3l+TVboL1aBhBq5a150Ix2AKmqbIkN71zMzP5Hp4ayVDGolWuqKIp4Veciz9Y7EOhquUvf0dqNd7HHFrnzcM2JpzS3GJ5xp3EIvXQwDljEC4Kk4XWIA5sVkOPbkL0KUNVMaIdye/0SfyDP9LBYepHFySFbXSWFVJDmRzbzIB7FQN/AT5wuZe2FiDgn/VRpVVHU= ceph-c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:52:54.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDngxJ+Pt0PgrICWORjlMNZUZ3lB+5VhmPXAqnuq2OIRdwahK1+iNBdnhYNRCw37IJxyMtPisxJ4vgnvCBihg+qHOl46Wt6i49Hzf5a9dLKvlAYf5ulxQoIwztT+7HbU/IuBNLXajZgoYNZf7kqRfIVWpvrimVo2rtra1RytzL5C3fwvmveAedA1a8QkMBGpl3jxiu/MNZ+EQw2VSS6sT+feV6rHZqiyIR3McSCIt5HqnmfU1vunPG0mrfVxDet2Qod7q2MT4Y1zFNh2k42FHa0nUaO/BSWIOdOvhGu5JmF15/yMK5hHC7PuGOLOSkpp3l+TVboL1aBhBq5a150Ix2AKmqbIkN71zMzP5Hp4ayVDGolWuqKIp4Veciz9Y7EOhquUvf0dqNd7HHFrnzcM2JpzS3GJ5xp3EIvXQwDljEC4Kk4XWIA5sVkOPbkL0KUNVMaIdye/0SfyDP9LBYepHFySFbXSWFVJDmRzbzIB7FQN/AT5wuZe2FiDgn/VRpVVHU= ceph-c412ec66-cf57-11ee-95bb-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-19T18:52:54.466 INFO:teuthology.orchestra.run.smithi142.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDngxJ+Pt0PgrICWORjlMNZUZ3lB+5VhmPXAqnuq2OIRdwahK1+iNBdnhYNRCw37IJxyMtPisxJ4vgnvCBihg+qHOl46Wt6i49Hzf5a9dLKvlAYf5ulxQoIwztT+7HbU/IuBNLXajZgoYNZf7kqRfIVWpvrimVo2rtra1RytzL5C3fwvmveAedA1a8QkMBGpl3jxiu/MNZ+EQw2VSS6sT+feV6rHZqiyIR3McSCIt5HqnmfU1vunPG0mrfVxDet2Qod7q2MT4Y1zFNh2k42FHa0nUaO/BSWIOdOvhGu5JmF15/yMK5hHC7PuGOLOSkpp3l+TVboL1aBhBq5a150Ix2AKmqbIkN71zMzP5Hp4ayVDGolWuqKIp4Veciz9Y7EOhquUvf0dqNd7HHFrnzcM2JpzS3GJ5xp3EIvXQwDljEC4Kk4XWIA5sVkOPbkL0KUNVMaIdye/0SfyDP9LBYepHFySFbXSWFVJDmRzbzIB7FQN/AT5wuZe2FiDgn/VRpVVHU= ceph-c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:52:54.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-19T18:52:54.683 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:52:54.804 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:54 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2357306192' entity='client.admin' 2024-02-19T18:52:57.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.294+0000 7f1afd504700 1 -- 172.21.15.46:0/4034725847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1af80fed30 msgr2=0x7f1af80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.294+0000 7f1afd504700 1 --2- 172.21.15.46:0/4034725847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1af80fed30 0x7f1af80ff140 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800b0a0 tx=0x7f1ae800b3b0 comp rx=0 tx=0).stop 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.294+0000 7f1afd504700 1 -- 172.21.15.46:0/4034725847 shutdown_connections 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.294+0000 7f1afd504700 1 --2- 172.21.15.46:0/4034725847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1af80fed30 0x7f1af80ff140 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.294+0000 7f1afd504700 1 -- 172.21.15.46:0/4034725847 >> 172.21.15.46:0/4034725847 conn(0x7f1af80fa2c0 msgr2=0x7f1af80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.294+0000 7f1afd504700 1 -- 172.21.15.46:0/4034725847 shutdown_connections 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.294+0000 7f1afd504700 1 -- 172.21.15.46:0/4034725847 wait complete. 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.294+0000 7f1afd504700 1 Processor -- start 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1afd504700 1 -- start start 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1afd504700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1af80fed30 0x7f1af8194fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1afd504700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af8195510 con 0x7f1af80fed30 2024-02-19T18:52:57.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1af6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1af80fed30 0x7f1af8194fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:57.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1af6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1af80fed30 0x7f1af8194fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55630/0 (socket says 172.21.15.46:55630) 2024-02-19T18:52:57.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1af6ffd700 1 -- 172.21.15.46:0/600017229 learned_addr learned my addr 172.21.15.46:0/600017229 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:52:57.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1af6ffd700 1 -- 172.21.15.46:0/600017229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae8009d00 con 0x7f1af80fed30 2024-02-19T18:52:57.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1af6ffd700 1 --2- 172.21.15.46:0/600017229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1af80fed30 0x7f1af8194fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009fd0 tx=0x7f1ae800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:57.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1aeffff700 1 -- 172.21.15.46:0/600017229 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ae800e040 con 0x7f1af80fed30 2024-02-19T18:52:57.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1afd504700 1 -- 172.21.15.46:0/600017229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af8195710 con 0x7f1af80fed30 2024-02-19T18:52:57.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1aeffff700 1 -- 172.21.15.46:0/600017229 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ae800bdc0 con 0x7f1af80fed30 2024-02-19T18:52:57.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.295+0000 7f1aeffff700 1 -- 172.21.15.46:0/600017229 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ae801da40 con 0x7f1af80fed30 2024-02-19T18:52:57.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.296+0000 7f1afd504700 1 -- 172.21.15.46:0/600017229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af8195b30 con 0x7f1af80fed30 2024-02-19T18:52:57.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.296+0000 7f1aeffff700 1 -- 172.21.15.46:0/600017229 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f1ae801dc80 con 0x7f1af80fed30 2024-02-19T18:52:57.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.296+0000 7f1afd504700 1 -- 172.21.15.46:0/600017229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af818ea20 con 0x7f1af80fed30 2024-02-19T18:52:57.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.296+0000 7f1aeffff700 1 --2- 172.21.15.46:0/600017229 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1ae40384e0 0x7f1ae403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:52:57.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.297+0000 7f1aeffff700 1 -- 172.21.15.46:0/600017229 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1ae804cab0 con 0x7f1af80fed30 2024-02-19T18:52:57.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.297+0000 7f1af67fc700 1 --2- 172.21.15.46:0/600017229 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1ae40384e0 0x7f1ae403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:52:57.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.297+0000 7f1af67fc700 1 --2- 172.21.15.46:0/600017229 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1ae40384e0 0x7f1ae403a990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0006fd0 tx=0x7f1ae0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:52:57.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.301+0000 7f1aeffff700 1 -- 172.21.15.46:0/600017229 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1ae8025770 con 0x7f1af80fed30 2024-02-19T18:52:57.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.503+0000 7f1afd504700 1 -- 172.21.15.46:0/600017229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f1af8062380 con 0x7f1af80fed30 2024-02-19T18:52:57.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.506+0000 7f1aeffff700 1 -- 172.21.15.46:0/600017229 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1ae8026820 con 0x7f1af80fed30 2024-02-19T18:52:57.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.508+0000 7f1afd504700 1 -- 172.21.15.46:0/600017229 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1ae40384e0 msgr2=0x7f1ae403a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:57.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.508+0000 7f1afd504700 1 --2- 172.21.15.46:0/600017229 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1ae40384e0 0x7f1ae403a990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0006fd0 tx=0x7f1ae0006e40 comp rx=0 tx=0).stop 2024-02-19T18:52:57.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.508+0000 7f1afd504700 1 -- 172.21.15.46:0/600017229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1af80fed30 msgr2=0x7f1af8194fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:52:57.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.508+0000 7f1afd504700 1 --2- 172.21.15.46:0/600017229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1af80fed30 0x7f1af8194fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009fd0 tx=0x7f1ae800bb10 comp rx=0 tx=0).stop 2024-02-19T18:52:57.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.508+0000 7f1afd504700 1 -- 172.21.15.46:0/600017229 shutdown_connections 2024-02-19T18:52:57.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.508+0000 7f1afd504700 1 --2- 172.21.15.46:0/600017229 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1ae40384e0 0x7f1ae403a990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:57.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.508+0000 7f1afd504700 1 --2- 172.21.15.46:0/600017229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1af80fed30 0x7f1af8194fd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:52:57.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.508+0000 7f1afd504700 1 -- 172.21.15.46:0/600017229 >> 172.21.15.46:0/600017229 conn(0x7f1af80fa2c0 msgr2=0x7f1af8069070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:52:57.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.508+0000 7f1afd504700 1 -- 172.21.15.46:0/600017229 shutdown_connections 2024-02-19T18:52:57.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:52:57.508+0000 7f1afd504700 1 -- 172.21.15.46:0/600017229 wait complete. 2024-02-19T18:52:58.427 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-19T18:52:58.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-19T18:52:58.705 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:58 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/600017229' entity='client.admin' 2024-02-19T18:52:58.705 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:58 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:58.705 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:58 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:58.705 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:58 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:52:58.705 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:58 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:52:58.705 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:58 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:52:58.705 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:58 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T18:52:58.705 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:58 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:52:58.705 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:52:58 smithi046 ceph-mon[29647]: Deploying daemon ceph-exporter.smithi046 on smithi046 2024-02-19T18:52:59.512 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:53:01.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.467+0000 7f50f943b700 1 -- 172.21.15.46:0/1276851408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50f40ffe30 msgr2=0x7f50f4100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.467+0000 7f50f943b700 1 --2- 172.21.15.46:0/1276851408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50f40ffe30 0x7f50f4100240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009910 tx=0x7f50dc009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.467+0000 7f50f943b700 1 -- 172.21.15.46:0/1276851408 shutdown_connections 2024-02-19T18:53:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.467+0000 7f50f943b700 1 --2- 172.21.15.46:0/1276851408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50f40ffe30 0x7f50f4100240 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.467+0000 7f50f943b700 1 -- 172.21.15.46:0/1276851408 >> 172.21.15.46:0/1276851408 conn(0x7f50f40fb3c0 msgr2=0x7f50f40fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.467+0000 7f50f943b700 1 -- 172.21.15.46:0/1276851408 shutdown_connections 2024-02-19T18:53:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.467+0000 7f50f943b700 1 -- 172.21.15.46:0/1276851408 wait complete. 2024-02-19T18:53:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.468+0000 7f50f943b700 1 Processor -- start 2024-02-19T18:53:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.468+0000 7f50f943b700 1 -- start start 2024-02-19T18:53:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.468+0000 7f50f943b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50f40ffe30 0x7f50f4194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.468+0000 7f50f943b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f41954c0 con 0x7f50f40ffe30 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.468+0000 7f50f2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50f40ffe30 0x7f50f4194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.468+0000 7f50f2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50f40ffe30 0x7f50f4194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49678/0 (socket says 172.21.15.46:49678) 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.468+0000 7f50f2ffd700 1 -- 172.21.15.46:0/3636186553 learned_addr learned my addr 172.21.15.46:0/3636186553 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.468+0000 7f50f2ffd700 1 -- 172.21.15.46:0/3636186553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0095f0 con 0x7f50f40ffe30 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.468+0000 7f50f2ffd700 1 --2- 172.21.15.46:0/3636186553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50f40ffe30 0x7f50f4194f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f50dc005b40 tx=0x7f50dc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.469+0000 7f50ebfff700 1 -- 172.21.15.46:0/3636186553 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50dc01d070 con 0x7f50f40ffe30 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.469+0000 7f50ebfff700 1 -- 172.21.15.46:0/3636186553 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f50dc00be10 con 0x7f50f40ffe30 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.469+0000 7f50f943b700 1 -- 172.21.15.46:0/3636186553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f41956c0 con 0x7f50f40ffe30 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.469+0000 7f50ebfff700 1 -- 172.21.15.46:0/3636186553 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50dc00f460 con 0x7f50f40ffe30 2024-02-19T18:53:01.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.469+0000 7f50f943b700 1 -- 172.21.15.46:0/3636186553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f4195b60 con 0x7f50f40ffe30 2024-02-19T18:53:01.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.470+0000 7f50ebfff700 1 -- 172.21.15.46:0/3636186553 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f50dc00f5c0 con 0x7f50f40ffe30 2024-02-19T18:53:01.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.470+0000 7f50ebfff700 1 --2- 172.21.15.46:0/3636186553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f50e00384e0 0x7f50e003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:01.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.470+0000 7f50f943b700 1 -- 172.21.15.46:0/3636186553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f418ea90 con 0x7f50f40ffe30 2024-02-19T18:53:01.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.470+0000 7f50ebfff700 1 -- 172.21.15.46:0/3636186553 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f50dc04c250 con 0x7f50f40ffe30 2024-02-19T18:53:01.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.470+0000 7f50f27fc700 1 --2- 172.21.15.46:0/3636186553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f50e00384e0 0x7f50e003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:01.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.470+0000 7f50f27fc700 1 --2- 172.21.15.46:0/3636186553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f50e00384e0 0x7f50e003a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f50e4006fd0 tx=0x7f50e4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:01.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.475+0000 7f50ebfff700 1 -- 172.21.15.46:0/3636186553 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f50dc027030 con 0x7f50f40ffe30 2024-02-19T18:53:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.701+0000 7f50f943b700 1 -- 172.21.15.46:0/3636186553 --> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f50f4061190 con 0x7f50e00384e0 2024-02-19T18:53:01.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.705+0000 7f50ebfff700 1 -- 172.21.15.46:0/3636186553 <== mgr.14164 v2:172.21.15.46:6800/3727775990 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f50f4061190 con 0x7f50e00384e0 2024-02-19T18:53:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.707+0000 7f50f943b700 1 -- 172.21.15.46:0/3636186553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f50e00384e0 msgr2=0x7f50e003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.707+0000 7f50f943b700 1 --2- 172.21.15.46:0/3636186553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f50e00384e0 0x7f50e003a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f50e4006fd0 tx=0x7f50e4006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.707+0000 7f50f943b700 1 -- 172.21.15.46:0/3636186553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50f40ffe30 msgr2=0x7f50f4194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.707+0000 7f50f943b700 1 --2- 172.21.15.46:0/3636186553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50f40ffe30 0x7f50f4194f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f50dc005b40 tx=0x7f50dc004740 comp rx=0 tx=0).stop 2024-02-19T18:53:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.707+0000 7f50f943b700 1 -- 172.21.15.46:0/3636186553 shutdown_connections 2024-02-19T18:53:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.707+0000 7f50f943b700 1 --2- 172.21.15.46:0/3636186553 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f50e00384e0 0x7f50e003a990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.707+0000 7f50f943b700 1 --2- 172.21.15.46:0/3636186553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50f40ffe30 0x7f50f4194f80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.707+0000 7f50f943b700 1 -- 172.21.15.46:0/3636186553 >> 172.21.15.46:0/3636186553 conn(0x7f50f40fb3c0 msgr2=0x7f50f40fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.707+0000 7f50f943b700 1 -- 172.21.15.46:0/3636186553 shutdown_connections 2024-02-19T18:53:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:01.707+0000 7f50f943b700 1 -- 172.21.15.46:0/3636186553 wait complete. 2024-02-19T18:53:02.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:02 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:02.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:02 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:02.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:02 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:02.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:02 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:02.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:02 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:53:02.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:02 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-19T18:53:02.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:02 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:53:02.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:02 smithi046 ceph-mon[29647]: Deploying daemon crash.smithi046 on smithi046 2024-02-19T18:53:02.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:02 smithi046 ceph-mon[29647]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:53:02.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:02 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:02.882 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi142 2024-02-19T18:53:02.882 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:53:02.882 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/etc/ceph/ceph.conf 2024-02-19T18:53:02.900 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:53:02.901 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T18:53:02.959 INFO:tasks.cephadm:Adding host smithi142 to orchestrator... 2024-02-19T18:53:02.959 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph orch host add smithi142 2024-02-19T18:53:03.356 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:53:04.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.838+0000 7f0345309700 1 -- 172.21.15.46:0/2592770529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0340100920 msgr2=0x7f0340102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.838+0000 7f0345309700 1 --2- 172.21.15.46:0/2592770529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0340100920 0x7f0340102d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0338009910 tx=0x7f0338009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.838+0000 7f0345309700 1 -- 172.21.15.46:0/2592770529 shutdown_connections 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.838+0000 7f0345309700 1 --2- 172.21.15.46:0/2592770529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0340100920 0x7f0340102d00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.838+0000 7f0345309700 1 -- 172.21.15.46:0/2592770529 >> 172.21.15.46:0/2592770529 conn(0x7f03400fa2c0 msgr2=0x7f03400fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.838+0000 7f0345309700 1 -- 172.21.15.46:0/2592770529 shutdown_connections 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.838+0000 7f0345309700 1 -- 172.21.15.46:0/2592770529 wait complete. 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.838+0000 7f0345309700 1 Processor -- start 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.838+0000 7f0345309700 1 -- start start 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f0345309700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0340100920 0x7f0340100280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f0345309700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03401007c0 con 0x7f0340100920 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f033effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0340100920 0x7f0340100280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:04.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f033effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0340100920 0x7f0340100280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49694/0 (socket says 172.21.15.46:49694) 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f033effd700 1 -- 172.21.15.46:0/2978084208 learned_addr learned my addr 172.21.15.46:0/2978084208 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f033effd700 1 -- 172.21.15.46:0/2978084208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380095f0 con 0x7f0340100920 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f033effd700 1 --2- 172.21.15.46:0/2978084208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0340100920 0x7f0340100280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f03380092e0 tx=0x7f0338009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f0337fff700 1 -- 172.21.15.46:0/2978084208 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f033801d070 con 0x7f0340100920 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f0337fff700 1 -- 172.21.15.46:0/2978084208 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f033800be10 con 0x7f0340100920 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f0345309700 1 -- 172.21.15.46:0/2978084208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03400fe8d0 con 0x7f0340100920 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f0337fff700 1 -- 172.21.15.46:0/2978084208 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f033800f460 con 0x7f0340100920 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.839+0000 7f0345309700 1 -- 172.21.15.46:0/2978084208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03400fed70 con 0x7f0340100920 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.840+0000 7f0337fff700 1 -- 172.21.15.46:0/2978084208 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f033800f6d0 con 0x7f0340100920 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.840+0000 7f0337fff700 1 --2- 172.21.15.46:0/2978084208 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f032c038490 0x7f032c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.840+0000 7f0337fff700 1 -- 172.21.15.46:0/2978084208 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f033804c4a0 con 0x7f0340100920 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.840+0000 7f0345309700 1 -- 172.21.15.46:0/2978084208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0340062380 con 0x7f0340100920 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.840+0000 7f033e7fc700 1 --2- 172.21.15.46:0/2978084208 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f032c038490 0x7f032c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:04.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.841+0000 7f033e7fc700 1 --2- 172.21.15.46:0/2978084208 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f032c038490 0x7f032c03a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0328006fd0 tx=0x7f0328006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:04.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:04.845+0000 7f0337fff700 1 -- 172.21.15.46:0/2978084208 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0338027030 con 0x7f0340100920 2024-02-19T18:53:05.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:05.054+0000 7f0345309700 1 -- 172.21.15.46:0/2978084208 --> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}) v1 -- 0x7f03400fefb0 con 0x7f032c038490 2024-02-19T18:53:06.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:05 smithi046 ceph-mon[29647]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:06.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:06.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:06.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:06.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:06.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:07.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:06 smithi046 ceph-mon[29647]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:53:07.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:06 smithi046 ceph-mon[29647]: Deploying daemon node-exporter.smithi046 on smithi046 2024-02-19T18:53:07.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:06 smithi046 ceph-mon[29647]: Deploying cephadm binary to smithi142 2024-02-19T18:53:07.671 INFO:teuthology.orchestra.run.smithi046.stdout:Added host 'smithi142' with addr '172.21.15.142' 2024-02-19T18:53:07.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.653+0000 7f0337fff700 1 -- 172.21.15.46:0/2978084208 <== mgr.14164 v2:172.21.15.46:6800/3727775990 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f03400fefb0 con 0x7f032c038490 2024-02-19T18:53:07.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.655+0000 7f0345309700 1 -- 172.21.15.46:0/2978084208 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f032c038490 msgr2=0x7f032c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:07.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.655+0000 7f0345309700 1 --2- 172.21.15.46:0/2978084208 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f032c038490 0x7f032c03a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0328006fd0 tx=0x7f0328006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:07.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.655+0000 7f0345309700 1 -- 172.21.15.46:0/2978084208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0340100920 msgr2=0x7f0340100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:07.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.655+0000 7f0345309700 1 --2- 172.21.15.46:0/2978084208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0340100920 0x7f0340100280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f03380092e0 tx=0x7f0338009e60 comp rx=0 tx=0).stop 2024-02-19T18:53:07.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.655+0000 7f0345309700 1 -- 172.21.15.46:0/2978084208 shutdown_connections 2024-02-19T18:53:07.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.655+0000 7f0345309700 1 --2- 172.21.15.46:0/2978084208 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f032c038490 0x7f032c03a940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:07.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.655+0000 7f0345309700 1 --2- 172.21.15.46:0/2978084208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0340100920 0x7f0340100280 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:07.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.656+0000 7f0345309700 1 -- 172.21.15.46:0/2978084208 >> 172.21.15.46:0/2978084208 conn(0x7f03400fa2c0 msgr2=0x7f03400faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:07.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.656+0000 7f0345309700 1 -- 172.21.15.46:0/2978084208 shutdown_connections 2024-02-19T18:53:07.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:07.656+0000 7f0345309700 1 -- 172.21.15.46:0/2978084208 wait complete. 2024-02-19T18:53:08.025 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:07 smithi046 ceph-mon[29647]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:08.025 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:07 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:08.349 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph orch host ls --format=json 2024-02-19T18:53:08.555 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:53:09.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:08 smithi046 ceph-mon[29647]: Added host smithi142 2024-02-19T18:53:10.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:09 smithi046 ceph-mon[29647]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:10.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:09 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.415+0000 7f9f345c5700 1 -- 172.21.15.46:0/940013471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c0ffe20 msgr2=0x7f9f2c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.415+0000 7f9f345c5700 1 --2- 172.21.15.46:0/940013471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c0ffe20 0x7f9f2c100230 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009910 tx=0x7f9f28009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.415+0000 7f9f345c5700 1 -- 172.21.15.46:0/940013471 shutdown_connections 2024-02-19T18:53:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.415+0000 7f9f345c5700 1 --2- 172.21.15.46:0/940013471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c0ffe20 0x7f9f2c100230 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.415+0000 7f9f345c5700 1 -- 172.21.15.46:0/940013471 >> 172.21.15.46:0/940013471 conn(0x7f9f2c0fb3d0 msgr2=0x7f9f2c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.415+0000 7f9f345c5700 1 -- 172.21.15.46:0/940013471 shutdown_connections 2024-02-19T18:53:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.415+0000 7f9f345c5700 1 -- 172.21.15.46:0/940013471 wait complete. 2024-02-19T18:53:10.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.416+0000 7f9f345c5700 1 Processor -- start 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.416+0000 7f9f345c5700 1 -- start start 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.416+0000 7f9f345c5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c0ffe20 0x7f9f2c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.416+0000 7f9f345c5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c075030 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.416+0000 7f9f32361700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c0ffe20 0x7f9f2c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.416+0000 7f9f32361700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c0ffe20 0x7f9f2c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41900/0 (socket says 172.21.15.46:41900) 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.416+0000 7f9f32361700 1 -- 172.21.15.46:0/4009397501 learned_addr learned my addr 172.21.15.46:0/4009397501 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.416+0000 7f9f32361700 1 -- 172.21.15.46:0/4009397501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f280095f0 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.416+0000 7f9f32361700 1 --2- 172.21.15.46:0/4009397501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c0ffe20 0x7f9f2c074af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9f28005b40 tx=0x7f9f28004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.417+0000 7f9f237fe700 1 -- 172.21.15.46:0/4009397501 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2801d070 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.417+0000 7f9f237fe700 1 -- 172.21.15.46:0/4009397501 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9f2800be10 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.417+0000 7f9f345c5700 1 -- 172.21.15.46:0/4009397501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c073140 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.417+0000 7f9f237fe700 1 -- 172.21.15.46:0/4009397501 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2800f460 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.417+0000 7f9f345c5700 1 -- 172.21.15.46:0/4009397501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c0735e0 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.417+0000 7f9f237fe700 1 -- 172.21.15.46:0/4009397501 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f9f2800b960 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.418+0000 7f9f345c5700 1 -- 172.21.15.46:0/4009397501 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c062380 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.418+0000 7f9f237fe700 1 --2- 172.21.15.46:0/4009397501 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f9f180384e0 0x7f9f1803a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:10.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.418+0000 7f9f237fe700 1 -- 172.21.15.46:0/4009397501 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9f2804c220 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.418+0000 7f9f31b60700 1 --2- 172.21.15.46:0/4009397501 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f9f180384e0 0x7f9f1803a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:10.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.418+0000 7f9f31b60700 1 --2- 172.21.15.46:0/4009397501 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f9f180384e0 0x7f9f1803a990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c006fd0 tx=0x7f9f1c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:10.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.423+0000 7f9f237fe700 1 -- 172.21.15.46:0/4009397501 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9f2800f5c0 con 0x7f9f2c0ffe20 2024-02-19T18:53:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.632+0000 7f9f345c5700 1 -- 172.21.15.46:0/4009397501 --> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f2c1008b0 con 0x7f9f180384e0 2024-02-19T18:53:10.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.633+0000 7f9f237fe700 1 -- 172.21.15.46:0/4009397501 <== mgr.14164 v2:172.21.15.46:6800/3727775990 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f9f2c1008b0 con 0x7f9f180384e0 2024-02-19T18:53:10.650 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:53:10.650 INFO:teuthology.orchestra.run.smithi046.stdout:[{"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.142", "hostname": "smithi142", "labels": [], "status": ""}] 2024-02-19T18:53:10.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.635+0000 7f9f345c5700 1 -- 172.21.15.46:0/4009397501 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f9f180384e0 msgr2=0x7f9f1803a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.635+0000 7f9f345c5700 1 --2- 172.21.15.46:0/4009397501 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f9f180384e0 0x7f9f1803a990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c006fd0 tx=0x7f9f1c006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.635+0000 7f9f345c5700 1 -- 172.21.15.46:0/4009397501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c0ffe20 msgr2=0x7f9f2c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.635+0000 7f9f345c5700 1 --2- 172.21.15.46:0/4009397501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c0ffe20 0x7f9f2c074af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9f28005b40 tx=0x7f9f28004740 comp rx=0 tx=0).stop 2024-02-19T18:53:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.635+0000 7f9f345c5700 1 -- 172.21.15.46:0/4009397501 shutdown_connections 2024-02-19T18:53:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.635+0000 7f9f345c5700 1 --2- 172.21.15.46:0/4009397501 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f9f180384e0 0x7f9f1803a990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.635+0000 7f9f345c5700 1 --2- 172.21.15.46:0/4009397501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c0ffe20 0x7f9f2c074af0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.635+0000 7f9f345c5700 1 -- 172.21.15.46:0/4009397501 >> 172.21.15.46:0/4009397501 conn(0x7f9f2c0fb3d0 msgr2=0x7f9f2c0fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.635+0000 7f9f345c5700 1 -- 172.21.15.46:0/4009397501 shutdown_connections 2024-02-19T18:53:10.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:10.635+0000 7f9f345c5700 1 -- 172.21.15.46:0/4009397501 wait complete. 2024-02-19T18:53:11.253 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-19T18:53:11.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd crush tunables default 2024-02-19T18:53:11.456 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:53:12.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:11 smithi046 ceph-mon[29647]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T18:53:12.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:11 smithi046 ceph-mon[29647]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.892+0000 7f497a784700 1 -- 172.21.15.46:0/211162257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49740fed20 msgr2=0x7f49740ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.892+0000 7f497a784700 1 --2- 172.21.15.46:0/211162257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49740fed20 0x7f49740ff130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4964009910 tx=0x7f4964009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.892+0000 7f497a784700 1 -- 172.21.15.46:0/211162257 shutdown_connections 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.892+0000 7f497a784700 1 --2- 172.21.15.46:0/211162257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49740fed20 0x7f49740ff130 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.892+0000 7f497a784700 1 -- 172.21.15.46:0/211162257 >> 172.21.15.46:0/211162257 conn(0x7f49740fa2b0 msgr2=0x7f49740fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.893+0000 7f497a784700 1 -- 172.21.15.46:0/211162257 shutdown_connections 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.893+0000 7f497a784700 1 -- 172.21.15.46:0/211162257 wait complete. 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.893+0000 7f497a784700 1 Processor -- start 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.893+0000 7f497a784700 1 -- start start 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.893+0000 7f497a784700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49740fed20 0x7f49740fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.893+0000 7f497a784700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49740fc7a0 con 0x7f49740fed20 2024-02-19T18:53:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.894+0000 7f4973fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49740fed20 0x7f49740fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.894+0000 7f4973fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49740fed20 0x7f49740fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41922/0 (socket says 172.21.15.46:41922) 2024-02-19T18:53:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.894+0000 7f4973fff700 1 -- 172.21.15.46:0/3248505729 learned_addr learned my addr 172.21.15.46:0/3248505729 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:53:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.894+0000 7f4973fff700 1 -- 172.21.15.46:0/3248505729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49640095f0 con 0x7f49740fed20 2024-02-19T18:53:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.894+0000 7f4973fff700 1 --2- 172.21.15.46:0/3248505729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49740fed20 0x7f49740fc260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4964005b40 tx=0x7f4964004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.894+0000 7f49717fa700 1 -- 172.21.15.46:0/3248505729 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f496401d070 con 0x7f49740fed20 2024-02-19T18:53:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.894+0000 7f49717fa700 1 -- 172.21.15.46:0/3248505729 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f496400be10 con 0x7f49740fed20 2024-02-19T18:53:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.894+0000 7f497a784700 1 -- 172.21.15.46:0/3248505729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49740fa8b0 con 0x7f49740fed20 2024-02-19T18:53:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.894+0000 7f49717fa700 1 -- 172.21.15.46:0/3248505729 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f496400f460 con 0x7f49740fed20 2024-02-19T18:53:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.894+0000 7f497a784700 1 -- 172.21.15.46:0/3248505729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49740fad50 con 0x7f49740fed20 2024-02-19T18:53:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.895+0000 7f49717fa700 1 -- 172.21.15.46:0/3248505729 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f496400f6d0 con 0x7f49740fed20 2024-02-19T18:53:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.896+0000 7f497a784700 1 -- 172.21.15.46:0/3248505729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4974062380 con 0x7f49740fed20 2024-02-19T18:53:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.896+0000 7f49717fa700 1 --2- 172.21.15.46:0/3248505729 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f495c038490 0x7f495c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.896+0000 7f49717fa700 1 -- 172.21.15.46:0/3248505729 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f496404c430 con 0x7f49740fed20 2024-02-19T18:53:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.896+0000 7f49737fe700 1 --2- 172.21.15.46:0/3248505729 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f495c038490 0x7f495c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.896+0000 7f49737fe700 1 --2- 172.21.15.46:0/3248505729 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f495c038490 0x7f495c03a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4968006fd0 tx=0x7f4968006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:13.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:13.901+0000 7f49717fa700 1 -- 172.21.15.46:0/3248505729 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f496402c440 con 0x7f49740fed20 2024-02-19T18:53:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.120+0000 7f497a784700 1 -- 172.21.15.46:0/3248505729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f497418e3f0 con 0x7f49740fed20 2024-02-19T18:53:14.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:13 smithi046 ceph-mon[29647]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:14.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:13 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:14.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:13 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:14.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:13 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:14.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:13 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.974+0000 7f49717fa700 1 -- 172.21.15.46:0/3248505729 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4964027070 con 0x7f49740fed20 2024-02-19T18:53:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.976+0000 7f497a784700 1 -- 172.21.15.46:0/3248505729 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f495c038490 msgr2=0x7f495c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.976+0000 7f497a784700 1 --2- 172.21.15.46:0/3248505729 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f495c038490 0x7f495c03a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4968006fd0 tx=0x7f4968006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.977+0000 7f497a784700 1 -- 172.21.15.46:0/3248505729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49740fed20 msgr2=0x7f49740fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:14.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.977+0000 7f497a784700 1 --2- 172.21.15.46:0/3248505729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49740fed20 0x7f49740fc260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4964005b40 tx=0x7f4964004740 comp rx=0 tx=0).stop 2024-02-19T18:53:14.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.977+0000 7f497a784700 1 -- 172.21.15.46:0/3248505729 shutdown_connections 2024-02-19T18:53:14.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.977+0000 7f497a784700 1 --2- 172.21.15.46:0/3248505729 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f495c038490 0x7f495c03a940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:14.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.977+0000 7f497a784700 1 --2- 172.21.15.46:0/3248505729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49740fed20 0x7f49740fc260 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:14.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.977+0000 7f497a784700 1 -- 172.21.15.46:0/3248505729 >> 172.21.15.46:0/3248505729 conn(0x7f49740fa2b0 msgr2=0x7f49740687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:14.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.977+0000 7f497a784700 1 -- 172.21.15.46:0/3248505729 shutdown_connections 2024-02-19T18:53:14.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:53:14.977+0000 7f497a784700 1 -- 172.21.15.46:0/3248505729 wait complete. 2024-02-19T18:53:14.994 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-02-19T18:53:15.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:14 smithi046 ceph-mon[29647]: Deploying daemon alertmanager.smithi046 on smithi046 2024-02-19T18:53:15.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:14 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3248505729' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-19T18:53:15.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:14 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:15.960 INFO:tasks.cephadm:Adding mon.smithi046 on smithi046 2024-02-19T18:53:15.961 INFO:tasks.cephadm:Adding mon.smithi142 on smithi142 2024-02-19T18:53:15.961 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph orch apply mon '2;smithi046:172.21.15.46=smithi046;smithi142:172.21.15.142=smithi142' 2024-02-19T18:53:16.162 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:16.184 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:15 smithi046 ceph-mon[29647]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:16.184 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:15 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3248505729' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-19T18:53:16.184 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:15 smithi046 ceph-mon[29647]: osdmap e4: 0 total, 0 up, 0 in 2024-02-19T18:53:16.209 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.800+0000 7f45e811a700 1 -- 172.21.15.142:0/4092894672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e00fed30 msgr2=0x7f45e00ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.800+0000 7f45e811a700 1 --2- 172.21.15.142:0/4092894672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e00fed30 0x7f45e00ff140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009910 tx=0x7f45dc009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.800+0000 7f45e811a700 1 -- 172.21.15.142:0/4092894672 shutdown_connections 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.800+0000 7f45e811a700 1 --2- 172.21.15.142:0/4092894672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e00fed30 0x7f45e00ff140 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.800+0000 7f45e811a700 1 -- 172.21.15.142:0/4092894672 >> 172.21.15.142:0/4092894672 conn(0x7f45e00fa2c0 msgr2=0x7f45e00fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.800+0000 7f45e811a700 1 -- 172.21.15.142:0/4092894672 shutdown_connections 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.800+0000 7f45e811a700 1 -- 172.21.15.142:0/4092894672 wait complete. 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.801+0000 7f45e811a700 1 Processor -- start 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.801+0000 7f45e811a700 1 -- start start 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.801+0000 7f45e811a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e00fed30 0x7f45e0069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:17.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.801+0000 7f45e811a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0197d00 con 0x7f45e00fed30 2024-02-19T18:53:17.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.801+0000 7f45e5eb6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e00fed30 0x7f45e0069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:17.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.801+0000 7f45e5eb6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e00fed30 0x7f45e0069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:56788/0 (socket says 172.21.15.142:56788) 2024-02-19T18:53:17.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.801+0000 7f45e5eb6700 1 -- 172.21.15.142:0/2699837242 learned_addr learned my addr 172.21.15.142:0/2699837242 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:17.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.802+0000 7f45e5eb6700 1 -- 172.21.15.142:0/2699837242 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0095f0 con 0x7f45e00fed30 2024-02-19T18:53:17.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.802+0000 7f45e5eb6700 1 --2- 172.21.15.142:0/2699837242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e00fed30 0x7f45e0069360 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f45dc005b40 tx=0x7f45dc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:17.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.802+0000 7f45d6ffd700 1 -- 172.21.15.142:0/2699837242 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f45dc01d070 con 0x7f45e00fed30 2024-02-19T18:53:17.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.802+0000 7f45d6ffd700 1 -- 172.21.15.142:0/2699837242 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f45dc00be10 con 0x7f45e00fed30 2024-02-19T18:53:17.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.802+0000 7f45d6ffd700 1 -- 172.21.15.142:0/2699837242 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f45dc00f460 con 0x7f45e00fed30 2024-02-19T18:53:17.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.802+0000 7f45e811a700 1 -- 172.21.15.142:0/2699837242 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e0197e40 con 0x7f45e00fed30 2024-02-19T18:53:17.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.802+0000 7f45e811a700 1 -- 172.21.15.142:0/2699837242 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e01982e0 con 0x7f45e00fed30 2024-02-19T18:53:17.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.803+0000 7f45d6ffd700 1 -- 172.21.15.142:0/2699837242 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f45dc0227e0 con 0x7f45e00fed30 2024-02-19T18:53:17.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.803+0000 7f45e811a700 1 -- 172.21.15.142:0/2699837242 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e018da10 con 0x7f45e00fed30 2024-02-19T18:53:17.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.803+0000 7f45d6ffd700 1 --2- 172.21.15.142:0/2699837242 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f45cc038490 0x7f45cc03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:17.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.803+0000 7f45d6ffd700 1 -- 172.21.15.142:0/2699837242 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f45dc04c4b0 con 0x7f45e00fed30 2024-02-19T18:53:17.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.803+0000 7f45e56b5700 1 --2- 172.21.15.142:0/2699837242 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f45cc038490 0x7f45cc03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:17.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.804+0000 7f45e56b5700 1 --2- 172.21.15.142:0/2699837242 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f45cc038490 0x7f45cc03a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f45d0006fd0 tx=0x7f45d0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:17.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:17.808+0000 7f45d6ffd700 1 -- 172.21.15.142:0/2699837242 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f45dc02bba0 con 0x7f45e00fed30 2024-02-19T18:53:18.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.005+0000 7f45e811a700 1 -- 172.21.15.142:0/2699837242 --> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi046:172.21.15.46=smithi046;smithi142:172.21.15.142=smithi142", "target": ["mon-mgr", ""]}) v1 -- 0x7f45e0061300 con 0x7f45cc038490 2024-02-19T18:53:18.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.011+0000 7f45d6ffd700 1 -- 172.21.15.142:0/2699837242 <== mgr.14164 v2:172.21.15.46:6800/3727775990 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f45e0061300 con 0x7f45cc038490 2024-02-19T18:53:18.026 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled mon update... 2024-02-19T18:53:18.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.013+0000 7f45e811a700 1 -- 172.21.15.142:0/2699837242 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f45cc038490 msgr2=0x7f45cc03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:18.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.013+0000 7f45e811a700 1 --2- 172.21.15.142:0/2699837242 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f45cc038490 0x7f45cc03a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f45d0006fd0 tx=0x7f45d0006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:18.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.013+0000 7f45e811a700 1 -- 172.21.15.142:0/2699837242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e00fed30 msgr2=0x7f45e0069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:18.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.013+0000 7f45e811a700 1 --2- 172.21.15.142:0/2699837242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e00fed30 0x7f45e0069360 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f45dc005b40 tx=0x7f45dc004740 comp rx=0 tx=0).stop 2024-02-19T18:53:18.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.013+0000 7f45e811a700 1 -- 172.21.15.142:0/2699837242 shutdown_connections 2024-02-19T18:53:18.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.013+0000 7f45e811a700 1 --2- 172.21.15.142:0/2699837242 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f45cc038490 0x7f45cc03a940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:18.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.013+0000 7f45e811a700 1 --2- 172.21.15.142:0/2699837242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45e00fed30 0x7f45e0069360 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:18.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.013+0000 7f45e811a700 1 -- 172.21.15.142:0/2699837242 >> 172.21.15.142:0/2699837242 conn(0x7f45e00fa2c0 msgr2=0x7f45e00faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:18.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.013+0000 7f45e811a700 1 -- 172.21.15.142:0/2699837242 shutdown_connections 2024-02-19T18:53:18.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:18.013+0000 7f45e811a700 1 -- 172.21.15.142:0/2699837242 wait complete. 2024-02-19T18:53:18.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:17 smithi046 ceph-mon[29647]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:18.595 DEBUG:teuthology.orchestra.run.smithi142:mon.smithi142> sudo journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi142.service 2024-02-19T18:53:18.597 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:18.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:18.823 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:18.868 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:19.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:19 smithi046 ceph-mon[29647]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi046:172.21.15.46=smithi046;smithi142:172.21.15.142=smithi142", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:53:19.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:19 smithi046 ceph-mon[29647]: Saving service mon spec with placement smithi046:172.21.15.46=smithi046;smithi142:172.21.15.142=smithi142;count:2 2024-02-19T18:53:19.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:19 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:20.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:20 smithi046 ceph-mon[29647]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:20.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 -- 172.21.15.142:0/244559601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d1c0ffe20 msgr2=0x7f1d1c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:20.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 --2- 172.21.15.142:0/244559601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d1c0ffe20 0x7f1d1c100230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009910 tx=0x7f1d10009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:20.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 -- 172.21.15.142:0/244559601 shutdown_connections 2024-02-19T18:53:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 --2- 172.21.15.142:0/244559601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d1c0ffe20 0x7f1d1c100230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 -- 172.21.15.142:0/244559601 >> 172.21.15.142:0/244559601 conn(0x7f1d1c0fb3d0 msgr2=0x7f1d1c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 -- 172.21.15.142:0/244559601 shutdown_connections 2024-02-19T18:53:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 -- 172.21.15.142:0/244559601 wait complete. 2024-02-19T18:53:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 Processor -- start 2024-02-19T18:53:20.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 -- start start 2024-02-19T18:53:20.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d1c0ffe20 0x7f1d1c197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:20.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.382+0000 7f1d22f7b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c197690 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.383+0000 7f1d20d17700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d1c0ffe20 0x7f1d1c197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:20.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.383+0000 7f1d20d17700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d1c0ffe20 0x7f1d1c197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:56812/0 (socket says 172.21.15.142:56812) 2024-02-19T18:53:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.383+0000 7f1d20d17700 1 -- 172.21.15.142:0/3166733387 learned_addr learned my addr 172.21.15.142:0/3166733387 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.383+0000 7f1d20d17700 1 -- 172.21.15.142:0/3166733387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d100095f0 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.383+0000 7f1d20d17700 1 --2- 172.21.15.142:0/3166733387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d1c0ffe20 0x7f1d1c197150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d10005b40 tx=0x7f1d10004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.383+0000 7f1d19ffb700 1 -- 172.21.15.142:0/3166733387 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d1001d070 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.383+0000 7f1d22f7b700 1 -- 172.21.15.142:0/3166733387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c197890 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.383+0000 7f1d19ffb700 1 -- 172.21.15.142:0/3166733387 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d1000be10 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.383+0000 7f1d19ffb700 1 -- 172.21.15.142:0/3166733387 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d1000f460 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.383+0000 7f1d22f7b700 1 -- 172.21.15.142:0/3166733387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c197d30 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.384+0000 7f1d19ffb700 1 -- 172.21.15.142:0/3166733387 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f1d1000b960 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.384+0000 7f1d22f7b700 1 -- 172.21.15.142:0/3166733387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c190e80 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.384+0000 7f1d19ffb700 1 --2- 172.21.15.142:0/3166733387 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1d0c038490 0x7f1d0c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.384+0000 7f1d19ffb700 1 -- 172.21.15.142:0/3166733387 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1d1004c380 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.385+0000 7f1d1bfff700 1 --2- 172.21.15.142:0/3166733387 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1d0c038490 0x7f1d0c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.385+0000 7f1d1bfff700 1 --2- 172.21.15.142:0/3166733387 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1d0c038490 0x7f1d0c03a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1d08006fd0 tx=0x7f1d08006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:20.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.389+0000 7f1d19ffb700 1 -- 172.21.15.142:0/3166733387 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1d1002bba0 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.653+0000 7f1d22f7b700 1 -- 172.21.15.142:0/3166733387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1d1c1008b0 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.654+0000 7f1d19ffb700 1 -- 172.21.15.142:0/3166733387 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f1d1c1008b0 con 0x7f1d1c0ffe20 2024-02-19T18:53:20.671 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:20.671 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.656+0000 7f1d22f7b700 1 -- 172.21.15.142:0/3166733387 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1d0c038490 msgr2=0x7f1d0c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.656+0000 7f1d22f7b700 1 --2- 172.21.15.142:0/3166733387 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1d0c038490 0x7f1d0c03a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1d08006fd0 tx=0x7f1d08006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.656+0000 7f1d22f7b700 1 -- 172.21.15.142:0/3166733387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d1c0ffe20 msgr2=0x7f1d1c197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.656+0000 7f1d22f7b700 1 --2- 172.21.15.142:0/3166733387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d1c0ffe20 0x7f1d1c197150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d10005b40 tx=0x7f1d10004740 comp rx=0 tx=0).stop 2024-02-19T18:53:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.656+0000 7f1d22f7b700 1 -- 172.21.15.142:0/3166733387 shutdown_connections 2024-02-19T18:53:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.656+0000 7f1d22f7b700 1 --2- 172.21.15.142:0/3166733387 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1d0c038490 0x7f1d0c03a940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.656+0000 7f1d22f7b700 1 --2- 172.21.15.142:0/3166733387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d1c0ffe20 0x7f1d1c197150 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:20.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.656+0000 7f1d22f7b700 1 -- 172.21.15.142:0/3166733387 >> 172.21.15.142:0/3166733387 conn(0x7f1d1c0fb3d0 msgr2=0x7f1d1c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:20.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.657+0000 7f1d22f7b700 1 -- 172.21.15.142:0/3166733387 shutdown_connections 2024-02-19T18:53:20.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:20.657+0000 7f1d22f7b700 1 -- 172.21.15.142:0/3166733387 wait complete. 2024-02-19T18:53:20.674 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:21.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:21 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/3166733387' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:22.213 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:22.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:22.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:22 smithi046 ceph-mon[29647]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:22.414 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:22.460 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:23.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.926+0000 7fd44472d700 1 -- 172.21.15.142:0/1277984283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd43c0fed20 msgr2=0x7fd43c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:23.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.926+0000 7fd44472d700 1 --2- 172.21.15.142:0/1277984283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd43c0fed20 0x7fd43c0ff130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009910 tx=0x7fd42c009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:23.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.927+0000 7fd44472d700 1 -- 172.21.15.142:0/1277984283 shutdown_connections 2024-02-19T18:53:23.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.927+0000 7fd44472d700 1 --2- 172.21.15.142:0/1277984283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd43c0fed20 0x7fd43c0ff130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:23.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.927+0000 7fd44472d700 1 -- 172.21.15.142:0/1277984283 >> 172.21.15.142:0/1277984283 conn(0x7fd43c0fa2b0 msgr2=0x7fd43c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:23.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.927+0000 7fd44472d700 1 -- 172.21.15.142:0/1277984283 shutdown_connections 2024-02-19T18:53:23.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.927+0000 7fd44472d700 1 -- 172.21.15.142:0/1277984283 wait complete. 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.927+0000 7fd44472d700 1 Processor -- start 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.927+0000 7fd44472d700 1 -- start start 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.927+0000 7fd44472d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd43c0fed20 0x7fd43c193ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.927+0000 7fd44472d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c194420 con 0x7fd43c0fed20 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.928+0000 7fd4424c9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd43c0fed20 0x7fd43c193ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.928+0000 7fd4424c9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd43c0fed20 0x7fd43c193ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:56826/0 (socket says 172.21.15.142:56826) 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.928+0000 7fd4424c9700 1 -- 172.21.15.142:0/1532183273 learned_addr learned my addr 172.21.15.142:0/1532183273 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.928+0000 7fd4424c9700 1 -- 172.21.15.142:0/1532183273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c0095f0 con 0x7fd43c0fed20 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.928+0000 7fd4424c9700 1 --2- 172.21.15.142:0/1532183273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd43c0fed20 0x7fd43c193ee0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd42c005b40 tx=0x7fd42c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.928+0000 7fd4337fe700 1 -- 172.21.15.142:0/1532183273 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd42c01d070 con 0x7fd43c0fed20 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.928+0000 7fd44472d700 1 -- 172.21.15.142:0/1532183273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43c194620 con 0x7fd43c0fed20 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.928+0000 7fd4337fe700 1 -- 172.21.15.142:0/1532183273 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd42c00be10 con 0x7fd43c0fed20 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.928+0000 7fd4337fe700 1 -- 172.21.15.142:0/1532183273 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd42c00f460 con 0x7fd43c0fed20 2024-02-19T18:53:23.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.928+0000 7fd44472d700 1 -- 172.21.15.142:0/1532183273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c194ac0 con 0x7fd43c0fed20 2024-02-19T18:53:23.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.929+0000 7fd44472d700 1 -- 172.21.15.142:0/1532183273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c18da00 con 0x7fd43c0fed20 2024-02-19T18:53:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.929+0000 7fd4337fe700 1 -- 172.21.15.142:0/1532183273 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd42c0227e0 con 0x7fd43c0fed20 2024-02-19T18:53:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.929+0000 7fd4337fe700 1 --2- 172.21.15.142:0/1532183273 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd428038490 0x7fd42803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.929+0000 7fd4337fe700 1 -- 172.21.15.142:0/1532183273 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd42c04c4a0 con 0x7fd43c0fed20 2024-02-19T18:53:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.930+0000 7fd441cc8700 1 --2- 172.21.15.142:0/1532183273 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd428038490 0x7fd42803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:23.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.930+0000 7fd441cc8700 1 --2- 172.21.15.142:0/1532183273 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd428038490 0x7fd42803a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd438006fd0 tx=0x7fd438006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:23.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:23.935+0000 7fd4337fe700 1 -- 172.21.15.142:0/1532183273 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd42c02bba0 con 0x7fd43c0fed20 2024-02-19T18:53:24.150 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:24 smithi046 ceph-mon[29647]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:24.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.200+0000 7fd44472d700 1 -- 172.21.15.142:0/1532183273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd43c02cc30 con 0x7fd43c0fed20 2024-02-19T18:53:24.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.201+0000 7fd4337fe700 1 -- 172.21.15.142:0/1532183273 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd42c027030 con 0x7fd43c0fed20 2024-02-19T18:53:24.217 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:24.218 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:24.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.203+0000 7fd44472d700 1 -- 172.21.15.142:0/1532183273 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd428038490 msgr2=0x7fd42803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:24.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.203+0000 7fd44472d700 1 --2- 172.21.15.142:0/1532183273 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd428038490 0x7fd42803a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd438006fd0 tx=0x7fd438006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:24.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.203+0000 7fd44472d700 1 -- 172.21.15.142:0/1532183273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd43c0fed20 msgr2=0x7fd43c193ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:24.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.203+0000 7fd44472d700 1 --2- 172.21.15.142:0/1532183273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd43c0fed20 0x7fd43c193ee0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd42c005b40 tx=0x7fd42c004740 comp rx=0 tx=0).stop 2024-02-19T18:53:24.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.203+0000 7fd44472d700 1 -- 172.21.15.142:0/1532183273 shutdown_connections 2024-02-19T18:53:24.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.203+0000 7fd44472d700 1 --2- 172.21.15.142:0/1532183273 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fd428038490 0x7fd42803a940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:24.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.203+0000 7fd44472d700 1 --2- 172.21.15.142:0/1532183273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd43c0fed20 0x7fd43c193ee0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:24.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.203+0000 7fd44472d700 1 -- 172.21.15.142:0/1532183273 >> 172.21.15.142:0/1532183273 conn(0x7fd43c0fa2b0 msgr2=0x7fd43c0faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:24.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.203+0000 7fd44472d700 1 -- 172.21.15.142:0/1532183273 shutdown_connections 2024-02-19T18:53:24.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:24.203+0000 7fd44472d700 1 -- 172.21.15.142:0/1532183273 wait complete. 2024-02-19T18:53:24.221 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:25.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:25 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1532183273' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:25.953 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:25.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:26.145 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:26.192 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:26.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:26 smithi046 ceph-mon[29647]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:26.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:26 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:26.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:26 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:26.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:26 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:26.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:26 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:26.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:26 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:26.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:26 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:26.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:26 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T18:53:26.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:26 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:27.207 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:27 smithi046 ceph-mon[29647]: Regenerating cephadm self-signed grafana TLS certificates 2024-02-19T18:53:27.207 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:27 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T18:53:27.208 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:27 smithi046 ceph-mon[29647]: Deploying daemon grafana.smithi046 on smithi046 2024-02-19T18:53:27.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.653+0000 7fa82e011700 1 -- 172.21.15.142:0/822642611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa828074d80 msgr2=0x7fa8280731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:27.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.653+0000 7fa82e011700 1 --2- 172.21.15.142:0/822642611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa828074d80 0x7fa8280731e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009910 tx=0x7fa81c009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.654+0000 7fa82e011700 1 -- 172.21.15.142:0/822642611 shutdown_connections 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.654+0000 7fa82e011700 1 --2- 172.21.15.142:0/822642611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa828074d80 0x7fa8280731e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.654+0000 7fa82e011700 1 -- 172.21.15.142:0/822642611 >> 172.21.15.142:0/822642611 conn(0x7fa8280fb3d0 msgr2=0x7fa8280fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.654+0000 7fa82e011700 1 -- 172.21.15.142:0/822642611 shutdown_connections 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.654+0000 7fa82e011700 1 -- 172.21.15.142:0/822642611 wait complete. 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.654+0000 7fa82e011700 1 Processor -- start 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.654+0000 7fa82e011700 1 -- start start 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa82e011700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa828074d80 0x7fa828197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa82e011700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa828197690 con 0x7fa828074d80 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa8277fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa828074d80 0x7fa828197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa8277fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa828074d80 0x7fa828197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:54548/0 (socket says 172.21.15.142:54548) 2024-02-19T18:53:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa8277fe700 1 -- 172.21.15.142:0/1197316358 learned_addr learned my addr 172.21.15.142:0/1197316358 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:27.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa8277fe700 1 -- 172.21.15.142:0/1197316358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0095f0 con 0x7fa828074d80 2024-02-19T18:53:27.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa8277fe700 1 --2- 172.21.15.142:0/1197316358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa828074d80 0x7fa828197150 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa81c005b40 tx=0x7fa81c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa824ff9700 1 -- 172.21.15.142:0/1197316358 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa81c01d070 con 0x7fa828074d80 2024-02-19T18:53:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa824ff9700 1 -- 172.21.15.142:0/1197316358 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa81c00be10 con 0x7fa828074d80 2024-02-19T18:53:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa82e011700 1 -- 172.21.15.142:0/1197316358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa828197890 con 0x7fa828074d80 2024-02-19T18:53:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.655+0000 7fa824ff9700 1 -- 172.21.15.142:0/1197316358 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa81c00f460 con 0x7fa828074d80 2024-02-19T18:53:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.656+0000 7fa82e011700 1 -- 172.21.15.142:0/1197316358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa828197d30 con 0x7fa828074d80 2024-02-19T18:53:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.656+0000 7fa824ff9700 1 -- 172.21.15.142:0/1197316358 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fa81c00b960 con 0x7fa828074d80 2024-02-19T18:53:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.656+0000 7fa82e011700 1 -- 172.21.15.142:0/1197316358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa828190d00 con 0x7fa828074d80 2024-02-19T18:53:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.657+0000 7fa824ff9700 1 --2- 172.21.15.142:0/1197316358 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa810038490 0x7fa81003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.657+0000 7fa824ff9700 1 -- 172.21.15.142:0/1197316358 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa81c04c4c0 con 0x7fa828074d80 2024-02-19T18:53:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.657+0000 7fa826ffd700 1 --2- 172.21.15.142:0/1197316358 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa810038490 0x7fa81003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:27.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.657+0000 7fa826ffd700 1 --2- 172.21.15.142:0/1197316358 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa810038490 0x7fa81003a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa818006fd0 tx=0x7fa818006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:27.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.662+0000 7fa824ff9700 1 -- 172.21.15.142:0/1197316358 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa81c02a360 con 0x7fa828074d80 2024-02-19T18:53:27.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.922+0000 7fa82e011700 1 -- 172.21.15.142:0/1197316358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa82802cc30 con 0x7fa828074d80 2024-02-19T18:53:27.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.923+0000 7fa824ff9700 1 -- 172.21.15.142:0/1197316358 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa81c027030 con 0x7fa828074d80 2024-02-19T18:53:27.939 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:27.940 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:27.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.925+0000 7fa82e011700 1 -- 172.21.15.142:0/1197316358 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa810038490 msgr2=0x7fa81003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:27.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.925+0000 7fa82e011700 1 --2- 172.21.15.142:0/1197316358 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa810038490 0x7fa81003a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa818006fd0 tx=0x7fa818006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:27.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.925+0000 7fa82e011700 1 -- 172.21.15.142:0/1197316358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa828074d80 msgr2=0x7fa828197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:27.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.925+0000 7fa82e011700 1 --2- 172.21.15.142:0/1197316358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa828074d80 0x7fa828197150 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa81c005b40 tx=0x7fa81c004740 comp rx=0 tx=0).stop 2024-02-19T18:53:27.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.925+0000 7fa82e011700 1 -- 172.21.15.142:0/1197316358 shutdown_connections 2024-02-19T18:53:27.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.925+0000 7fa82e011700 1 --2- 172.21.15.142:0/1197316358 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fa810038490 0x7fa81003a940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:27.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.925+0000 7fa82e011700 1 --2- 172.21.15.142:0/1197316358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa828074d80 0x7fa828197150 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:27.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.925+0000 7fa82e011700 1 -- 172.21.15.142:0/1197316358 >> 172.21.15.142:0/1197316358 conn(0x7fa8280fb3d0 msgr2=0x7fa8280fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:27.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.925+0000 7fa82e011700 1 -- 172.21.15.142:0/1197316358 shutdown_connections 2024-02-19T18:53:27.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:27.925+0000 7fa82e011700 1 -- 172.21.15.142:0/1197316358 wait complete. 2024-02-19T18:53:27.943 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:28.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:28 smithi046 ceph-mon[29647]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:28.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:28 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1197316358' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:29.463 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:29.464 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:29.665 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:29.711 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:30.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:30 smithi046 ceph-mon[29647]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:30.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:30 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:53:31.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.174+0000 7fb0a13b1700 1 -- 172.21.15.142:0/2574093630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb09c0fed30 msgr2=0x7fb09c0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.174+0000 7fb0a13b1700 1 --2- 172.21.15.142:0/2574093630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb09c0fed30 0x7fb09c0ff140 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb090009910 tx=0x7fb090009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.174+0000 7fb0a13b1700 1 -- 172.21.15.142:0/2574093630 shutdown_connections 2024-02-19T18:53:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.174+0000 7fb0a13b1700 1 --2- 172.21.15.142:0/2574093630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb09c0fed30 0x7fb09c0ff140 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.174+0000 7fb0a13b1700 1 -- 172.21.15.142:0/2574093630 >> 172.21.15.142:0/2574093630 conn(0x7fb09c0fa2c0 msgr2=0x7fb09c0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.174+0000 7fb0a13b1700 1 -- 172.21.15.142:0/2574093630 shutdown_connections 2024-02-19T18:53:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.174+0000 7fb0a13b1700 1 -- 172.21.15.142:0/2574093630 wait complete. 2024-02-19T18:53:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.174+0000 7fb0a13b1700 1 Processor -- start 2024-02-19T18:53:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.175+0000 7fb0a13b1700 1 -- start start 2024-02-19T18:53:31.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.175+0000 7fb0a13b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb09c0fed30 0x7fb09c194fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:31.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.175+0000 7fb0a13b1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c195510 con 0x7fb09c0fed30 2024-02-19T18:53:31.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.175+0000 7fb09affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb09c0fed30 0x7fb09c194fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:31.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.175+0000 7fb09affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb09c0fed30 0x7fb09c194fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:54562/0 (socket says 172.21.15.142:54562) 2024-02-19T18:53:31.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.175+0000 7fb09affd700 1 -- 172.21.15.142:0/215348441 learned_addr learned my addr 172.21.15.142:0/215348441 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:31.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.176+0000 7fb09affd700 1 -- 172.21.15.142:0/215348441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0900095f0 con 0x7fb09c0fed30 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.176+0000 7fb09affd700 1 --2- 172.21.15.142:0/215348441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb09c0fed30 0x7fb09c194fd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb090005b40 tx=0x7fb090004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.176+0000 7fb083fff700 1 -- 172.21.15.142:0/215348441 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb09001d070 con 0x7fb09c0fed30 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.176+0000 7fb0a13b1700 1 -- 172.21.15.142:0/215348441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c195710 con 0x7fb09c0fed30 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.176+0000 7fb083fff700 1 -- 172.21.15.142:0/215348441 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb09000be10 con 0x7fb09c0fed30 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.176+0000 7fb083fff700 1 -- 172.21.15.142:0/215348441 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb09000f460 con 0x7fb09c0fed30 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.176+0000 7fb0a13b1700 1 -- 172.21.15.142:0/215348441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c195bb0 con 0x7fb09c0fed30 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.177+0000 7fb083fff700 1 -- 172.21.15.142:0/215348441 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fb09000b960 con 0x7fb09c0fed30 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.177+0000 7fb0a13b1700 1 -- 172.21.15.142:0/215348441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09c18ea20 con 0x7fb09c0fed30 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.177+0000 7fb083fff700 1 --2- 172.21.15.142:0/215348441 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb084038490 0x7fb08403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.177+0000 7fb083fff700 1 -- 172.21.15.142:0/215348441 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb09004c4b0 con 0x7fb09c0fed30 2024-02-19T18:53:31.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.177+0000 7fb09a7fc700 1 --2- 172.21.15.142:0/215348441 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb084038490 0x7fb08403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:31.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.178+0000 7fb09a7fc700 1 --2- 172.21.15.142:0/215348441 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb084038490 0x7fb08403a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb08c006fd0 tx=0x7fb08c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:31.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.182+0000 7fb083fff700 1 -- 172.21.15.142:0/215348441 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb09002a360 con 0x7fb09c0fed30 2024-02-19T18:53:31.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.449+0000 7fb0a13b1700 1 -- 172.21.15.142:0/215348441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb09c02cc30 con 0x7fb09c0fed30 2024-02-19T18:53:31.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.450+0000 7fb083fff700 1 -- 172.21.15.142:0/215348441 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb090027030 con 0x7fb09c0fed30 2024-02-19T18:53:31.466 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:31.466 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:31.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.452+0000 7fb0a13b1700 1 -- 172.21.15.142:0/215348441 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb084038490 msgr2=0x7fb08403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:31.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.452+0000 7fb0a13b1700 1 --2- 172.21.15.142:0/215348441 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb084038490 0x7fb08403a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb08c006fd0 tx=0x7fb08c006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:31.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.452+0000 7fb0a13b1700 1 -- 172.21.15.142:0/215348441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb09c0fed30 msgr2=0x7fb09c194fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:31.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.452+0000 7fb0a13b1700 1 --2- 172.21.15.142:0/215348441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb09c0fed30 0x7fb09c194fd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb090005b40 tx=0x7fb090004740 comp rx=0 tx=0).stop 2024-02-19T18:53:31.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.452+0000 7fb0a13b1700 1 -- 172.21.15.142:0/215348441 shutdown_connections 2024-02-19T18:53:31.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.452+0000 7fb0a13b1700 1 --2- 172.21.15.142:0/215348441 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb084038490 0x7fb08403a940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:31.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.452+0000 7fb0a13b1700 1 --2- 172.21.15.142:0/215348441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb09c0fed30 0x7fb09c194fd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:31.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.452+0000 7fb0a13b1700 1 -- 172.21.15.142:0/215348441 >> 172.21.15.142:0/215348441 conn(0x7fb09c0fa2c0 msgr2=0x7fb09c069070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:31.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.452+0000 7fb0a13b1700 1 -- 172.21.15.142:0/215348441 shutdown_connections 2024-02-19T18:53:31.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:31.452+0000 7fb0a13b1700 1 -- 172.21.15.142:0/215348441 wait complete. 2024-02-19T18:53:31.469 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:32.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:32 smithi046 ceph-mon[29647]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:32.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:32 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/215348441' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:33.034 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:33.034 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:33.235 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:33.281 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:34.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:34 smithi046 ceph-mon[29647]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:34.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.760+0000 7f155d37f700 1 -- 172.21.15.142:0/2583744997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15580fed20 msgr2=0x7f15580ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:34.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.760+0000 7f155d37f700 1 --2- 172.21.15.142:0/2583744997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15580fed20 0x7f15580ff130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1548009910 tx=0x7f1548009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:34.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.760+0000 7f155d37f700 1 -- 172.21.15.142:0/2583744997 shutdown_connections 2024-02-19T18:53:34.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.760+0000 7f155d37f700 1 --2- 172.21.15.142:0/2583744997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15580fed20 0x7f15580ff130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:34.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.760+0000 7f155d37f700 1 -- 172.21.15.142:0/2583744997 >> 172.21.15.142:0/2583744997 conn(0x7f15580fa2b0 msgr2=0x7f15580fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:34.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.760+0000 7f155d37f700 1 -- 172.21.15.142:0/2583744997 shutdown_connections 2024-02-19T18:53:34.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.760+0000 7f155d37f700 1 -- 172.21.15.142:0/2583744997 wait complete. 2024-02-19T18:53:34.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.760+0000 7f155d37f700 1 Processor -- start 2024-02-19T18:53:34.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.761+0000 7f155d37f700 1 -- start start 2024-02-19T18:53:34.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.761+0000 7f155d37f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15580fed20 0x7f1558194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:34.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.761+0000 7f155d37f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15581954f0 con 0x7f15580fed20 2024-02-19T18:53:34.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.761+0000 7f1556ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15580fed20 0x7f1558194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:34.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.761+0000 7f1556ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15580fed20 0x7f1558194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:51824/0 (socket says 172.21.15.142:51824) 2024-02-19T18:53:34.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.761+0000 7f1556ffd700 1 -- 172.21.15.142:0/2498960110 learned_addr learned my addr 172.21.15.142:0/2498960110 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:34.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.761+0000 7f1556ffd700 1 -- 172.21.15.142:0/2498960110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15480095f0 con 0x7f15580fed20 2024-02-19T18:53:34.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.762+0000 7f1556ffd700 1 --2- 172.21.15.142:0/2498960110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15580fed20 0x7f1558194fb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1548005b40 tx=0x7f1548004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:34.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.762+0000 7f153ffff700 1 -- 172.21.15.142:0/2498960110 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f154801d070 con 0x7f15580fed20 2024-02-19T18:53:34.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.762+0000 7f155d37f700 1 -- 172.21.15.142:0/2498960110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15581956f0 con 0x7f15580fed20 2024-02-19T18:53:34.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.762+0000 7f153ffff700 1 -- 172.21.15.142:0/2498960110 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f154800be10 con 0x7f15580fed20 2024-02-19T18:53:34.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.762+0000 7f153ffff700 1 -- 172.21.15.142:0/2498960110 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f154800f460 con 0x7f15580fed20 2024-02-19T18:53:34.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.762+0000 7f155d37f700 1 -- 172.21.15.142:0/2498960110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1558195b90 con 0x7f15580fed20 2024-02-19T18:53:34.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.763+0000 7f155d37f700 1 -- 172.21.15.142:0/2498960110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155818ea10 con 0x7f15580fed20 2024-02-19T18:53:34.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.763+0000 7f153ffff700 1 -- 172.21.15.142:0/2498960110 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f154800b960 con 0x7f15580fed20 2024-02-19T18:53:34.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.763+0000 7f153ffff700 1 --2- 172.21.15.142:0/2498960110 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1540038490 0x7f154003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:34.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.763+0000 7f153ffff700 1 -- 172.21.15.142:0/2498960110 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f154804c480 con 0x7f15580fed20 2024-02-19T18:53:34.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.763+0000 7f15567fc700 1 --2- 172.21.15.142:0/2498960110 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1540038490 0x7f154003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:34.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.764+0000 7f15567fc700 1 --2- 172.21.15.142:0/2498960110 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1540038490 0x7f154003a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f154c006fd0 tx=0x7f154c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:34.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:34.768+0000 7f153ffff700 1 -- 172.21.15.142:0/2498960110 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f154802a360 con 0x7f15580fed20 2024-02-19T18:53:35.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.037+0000 7f155d37f700 1 -- 172.21.15.142:0/2498960110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f155802cc30 con 0x7f15580fed20 2024-02-19T18:53:35.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.038+0000 7f153ffff700 1 -- 172.21.15.142:0/2498960110 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f1548027030 con 0x7f15580fed20 2024-02-19T18:53:35.054 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:35.055 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:35.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.040+0000 7f155d37f700 1 -- 172.21.15.142:0/2498960110 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1540038490 msgr2=0x7f154003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:35.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.040+0000 7f155d37f700 1 --2- 172.21.15.142:0/2498960110 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1540038490 0x7f154003a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f154c006fd0 tx=0x7f154c006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:35.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.040+0000 7f155d37f700 1 -- 172.21.15.142:0/2498960110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15580fed20 msgr2=0x7f1558194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:35.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.040+0000 7f155d37f700 1 --2- 172.21.15.142:0/2498960110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15580fed20 0x7f1558194fb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1548005b40 tx=0x7f1548004740 comp rx=0 tx=0).stop 2024-02-19T18:53:35.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.040+0000 7f155d37f700 1 -- 172.21.15.142:0/2498960110 shutdown_connections 2024-02-19T18:53:35.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.040+0000 7f155d37f700 1 --2- 172.21.15.142:0/2498960110 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f1540038490 0x7f154003a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:35.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.040+0000 7f155d37f700 1 --2- 172.21.15.142:0/2498960110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15580fed20 0x7f1558194fb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:35.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.040+0000 7f155d37f700 1 -- 172.21.15.142:0/2498960110 >> 172.21.15.142:0/2498960110 conn(0x7f15580fa2b0 msgr2=0x7f15580690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:35.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.040+0000 7f155d37f700 1 -- 172.21.15.142:0/2498960110 shutdown_connections 2024-02-19T18:53:35.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:35.040+0000 7f155d37f700 1 -- 172.21.15.142:0/2498960110 wait complete. 2024-02-19T18:53:35.057 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:36.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:36 smithi046 ceph-mon[29647]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:36.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:36 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/2498960110' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:36.622 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:36.622 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:36.826 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:36.872 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:38.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:38 smithi046 ceph-mon[29647]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:38.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.345+0000 7fde03a05700 1 -- 172.21.15.142:0/3875825372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddfc0fed20 msgr2=0x7fddfc0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.345+0000 7fde03a05700 1 --2- 172.21.15.142:0/3875825372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddfc0fed20 0x7fddfc0ff130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009910 tx=0x7fddf8009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.345+0000 7fde03a05700 1 -- 172.21.15.142:0/3875825372 shutdown_connections 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.345+0000 7fde03a05700 1 --2- 172.21.15.142:0/3875825372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddfc0fed20 0x7fddfc0ff130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.345+0000 7fde03a05700 1 -- 172.21.15.142:0/3875825372 >> 172.21.15.142:0/3875825372 conn(0x7fddfc0fa2b0 msgr2=0x7fddfc0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.345+0000 7fde03a05700 1 -- 172.21.15.142:0/3875825372 shutdown_connections 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.345+0000 7fde03a05700 1 -- 172.21.15.142:0/3875825372 wait complete. 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.346+0000 7fde03a05700 1 Processor -- start 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.346+0000 7fde03a05700 1 -- start start 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.346+0000 7fde03a05700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddfc0fed20 0x7fddfc192d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.346+0000 7fde03a05700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc1932d0 con 0x7fddfc0fed20 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.346+0000 7fde017a1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddfc0fed20 0x7fddfc192d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.346+0000 7fde017a1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddfc0fed20 0x7fddfc192d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:51844/0 (socket says 172.21.15.142:51844) 2024-02-19T18:53:38.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.346+0000 7fde017a1700 1 -- 172.21.15.142:0/1438998665 learned_addr learned my addr 172.21.15.142:0/1438998665 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:38.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.346+0000 7fde017a1700 1 -- 172.21.15.142:0/1438998665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80095f0 con 0x7fddfc0fed20 2024-02-19T18:53:38.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.346+0000 7fde017a1700 1 --2- 172.21.15.142:0/1438998665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddfc0fed20 0x7fddfc192d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddf8005950 tx=0x7fddf8009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:38.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.347+0000 7fddf27fc700 1 -- 172.21.15.142:0/1438998665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddf801d070 con 0x7fddfc0fed20 2024-02-19T18:53:38.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.347+0000 7fddf27fc700 1 -- 172.21.15.142:0/1438998665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fddf800be10 con 0x7fddfc0fed20 2024-02-19T18:53:38.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.347+0000 7fde03a05700 1 -- 172.21.15.142:0/1438998665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc1934d0 con 0x7fddfc0fed20 2024-02-19T18:53:38.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.347+0000 7fddf27fc700 1 -- 172.21.15.142:0/1438998665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddf800f460 con 0x7fddfc0fed20 2024-02-19T18:53:38.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.347+0000 7fde03a05700 1 -- 172.21.15.142:0/1438998665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc193970 con 0x7fddfc0fed20 2024-02-19T18:53:38.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.347+0000 7fddf27fc700 1 -- 172.21.15.142:0/1438998665 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fddf800b960 con 0x7fddfc0fed20 2024-02-19T18:53:38.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.347+0000 7fde03a05700 1 -- 172.21.15.142:0/1438998665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc18c900 con 0x7fddfc0fed20 2024-02-19T18:53:38.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.348+0000 7fddf27fc700 1 --2- 172.21.15.142:0/1438998665 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fdde803a6e0 0x7fdde803cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:38.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.348+0000 7fddf27fc700 1 -- 172.21.15.142:0/1438998665 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fddf804c4c0 con 0x7fddfc0fed20 2024-02-19T18:53:38.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.348+0000 7fde00fa0700 1 --2- 172.21.15.142:0/1438998665 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fdde803a6e0 0x7fdde803cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:38.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.348+0000 7fde00fa0700 1 --2- 172.21.15.142:0/1438998665 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fdde803a6e0 0x7fdde803cb90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fddec006fd0 tx=0x7fddec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:38.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.353+0000 7fddf27fc700 1 -- 172.21.15.142:0/1438998665 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fddf802a360 con 0x7fddfc0fed20 2024-02-19T18:53:38.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.617+0000 7fde03a05700 1 -- 172.21.15.142:0/1438998665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fddfc02cc30 con 0x7fddfc0fed20 2024-02-19T18:53:38.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.617+0000 7fddf27fc700 1 -- 172.21.15.142:0/1438998665 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fddf8027030 con 0x7fddfc0fed20 2024-02-19T18:53:38.634 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:38.634 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:38.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.619+0000 7fde03a05700 1 -- 172.21.15.142:0/1438998665 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fdde803a6e0 msgr2=0x7fdde803cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:38.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.619+0000 7fde03a05700 1 --2- 172.21.15.142:0/1438998665 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fdde803a6e0 0x7fdde803cb90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fddec006fd0 tx=0x7fddec006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:38.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.619+0000 7fde03a05700 1 -- 172.21.15.142:0/1438998665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddfc0fed20 msgr2=0x7fddfc192d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:38.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.619+0000 7fde03a05700 1 --2- 172.21.15.142:0/1438998665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddfc0fed20 0x7fddfc192d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddf8005950 tx=0x7fddf8009e60 comp rx=0 tx=0).stop 2024-02-19T18:53:38.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.619+0000 7fde03a05700 1 -- 172.21.15.142:0/1438998665 shutdown_connections 2024-02-19T18:53:38.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.619+0000 7fde03a05700 1 --2- 172.21.15.142:0/1438998665 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fdde803a6e0 0x7fdde803cb90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:38.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.619+0000 7fde03a05700 1 --2- 172.21.15.142:0/1438998665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddfc0fed20 0x7fddfc192d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:38.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.619+0000 7fde03a05700 1 -- 172.21.15.142:0/1438998665 >> 172.21.15.142:0/1438998665 conn(0x7fddfc0fa2b0 msgr2=0x7fddfc0faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:38.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.619+0000 7fde03a05700 1 -- 172.21.15.142:0/1438998665 shutdown_connections 2024-02-19T18:53:38.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:38.619+0000 7fde03a05700 1 -- 172.21.15.142:0/1438998665 wait complete. 2024-02-19T18:53:38.637 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:39.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:39 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1438998665' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:40.250 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:40.250 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:40.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:40 smithi046 ceph-mon[29647]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:40.452 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:40.498 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.006+0000 7efc30bc9700 1 -- 172.21.15.142:0/2498430602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2c0ffe20 msgr2=0x7efc2c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.006+0000 7efc30bc9700 1 --2- 172.21.15.142:0/2498430602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2c0ffe20 0x7efc2c100230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efc24009910 tx=0x7efc24009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:42.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.007+0000 7efc30bc9700 1 -- 172.21.15.142:0/2498430602 shutdown_connections 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.007+0000 7efc30bc9700 1 --2- 172.21.15.142:0/2498430602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2c0ffe20 0x7efc2c100230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.007+0000 7efc30bc9700 1 -- 172.21.15.142:0/2498430602 >> 172.21.15.142:0/2498430602 conn(0x7efc2c0fb3d0 msgr2=0x7efc2c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.007+0000 7efc30bc9700 1 -- 172.21.15.142:0/2498430602 shutdown_connections 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.007+0000 7efc30bc9700 1 -- 172.21.15.142:0/2498430602 wait complete. 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.007+0000 7efc30bc9700 1 Processor -- start 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.007+0000 7efc30bc9700 1 -- start start 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.007+0000 7efc30bc9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2c0ffe20 0x7efc2c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.007+0000 7efc30bc9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c075030 con 0x7efc2c0ffe20 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.008+0000 7efc2a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2c0ffe20 0x7efc2c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.008+0000 7efc2a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2c0ffe20 0x7efc2c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:51864/0 (socket says 172.21.15.142:51864) 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.008+0000 7efc2a59c700 1 -- 172.21.15.142:0/1062854485 learned_addr learned my addr 172.21.15.142:0/1062854485 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:42.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.008+0000 7efc2a59c700 1 -- 172.21.15.142:0/1062854485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc240095f0 con 0x7efc2c0ffe20 2024-02-19T18:53:42.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.008+0000 7efc2a59c700 1 --2- 172.21.15.142:0/1062854485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2c0ffe20 0x7efc2c074af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efc24005b40 tx=0x7efc24004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:42.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.008+0000 7efc1b7fe700 1 -- 172.21.15.142:0/1062854485 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc2401d070 con 0x7efc2c0ffe20 2024-02-19T18:53:42.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.008+0000 7efc1b7fe700 1 -- 172.21.15.142:0/1062854485 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efc2400be10 con 0x7efc2c0ffe20 2024-02-19T18:53:42.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.008+0000 7efc30bc9700 1 -- 172.21.15.142:0/1062854485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c073140 con 0x7efc2c0ffe20 2024-02-19T18:53:42.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.008+0000 7efc1b7fe700 1 -- 172.21.15.142:0/1062854485 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc2400f460 con 0x7efc2c0ffe20 2024-02-19T18:53:42.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.008+0000 7efc30bc9700 1 -- 172.21.15.142:0/1062854485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c0735e0 con 0x7efc2c0ffe20 2024-02-19T18:53:42.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.009+0000 7efc1b7fe700 1 -- 172.21.15.142:0/1062854485 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7efc2400b960 con 0x7efc2c0ffe20 2024-02-19T18:53:42.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.009+0000 7efc30bc9700 1 -- 172.21.15.142:0/1062854485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c062380 con 0x7efc2c0ffe20 2024-02-19T18:53:42.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.009+0000 7efc1b7fe700 1 --2- 172.21.15.142:0/1062854485 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7efc14038490 0x7efc1403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:42.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.009+0000 7efc1b7fe700 1 -- 172.21.15.142:0/1062854485 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efc2404c360 con 0x7efc2c0ffe20 2024-02-19T18:53:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.010+0000 7efc29d9b700 1 --2- 172.21.15.142:0/1062854485 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7efc14038490 0x7efc1403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:42.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.010+0000 7efc29d9b700 1 --2- 172.21.15.142:0/1062854485 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7efc14038490 0x7efc1403a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efc2000ad30 tx=0x7efc200093f0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:42.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.014+0000 7efc1b7fe700 1 -- 172.21.15.142:0/1062854485 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efc2402bba0 con 0x7efc2c0ffe20 2024-02-19T18:53:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.280+0000 7efc30bc9700 1 -- 172.21.15.142:0/1062854485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efc2c18e460 con 0x7efc2c0ffe20 2024-02-19T18:53:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.281+0000 7efc1b7fe700 1 -- 172.21.15.142:0/1062854485 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7efc24027070 con 0x7efc2c0ffe20 2024-02-19T18:53:42.298 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:42.298 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:42.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.283+0000 7efc30bc9700 1 -- 172.21.15.142:0/1062854485 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7efc14038490 msgr2=0x7efc1403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:42.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.283+0000 7efc30bc9700 1 --2- 172.21.15.142:0/1062854485 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7efc14038490 0x7efc1403a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efc2000ad30 tx=0x7efc200093f0 comp rx=0 tx=0).stop 2024-02-19T18:53:42.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.283+0000 7efc30bc9700 1 -- 172.21.15.142:0/1062854485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2c0ffe20 msgr2=0x7efc2c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:42.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.283+0000 7efc30bc9700 1 --2- 172.21.15.142:0/1062854485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2c0ffe20 0x7efc2c074af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efc24005b40 tx=0x7efc24004740 comp rx=0 tx=0).stop 2024-02-19T18:53:42.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.283+0000 7efc30bc9700 1 -- 172.21.15.142:0/1062854485 shutdown_connections 2024-02-19T18:53:42.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.283+0000 7efc30bc9700 1 --2- 172.21.15.142:0/1062854485 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7efc14038490 0x7efc1403a940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:42.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.283+0000 7efc30bc9700 1 --2- 172.21.15.142:0/1062854485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc2c0ffe20 0x7efc2c074af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:42.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.283+0000 7efc30bc9700 1 -- 172.21.15.142:0/1062854485 >> 172.21.15.142:0/1062854485 conn(0x7efc2c0fb3d0 msgr2=0x7efc2c0fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:42.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.283+0000 7efc30bc9700 1 -- 172.21.15.142:0/1062854485 shutdown_connections 2024-02-19T18:53:42.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:42.283+0000 7efc30bc9700 1 -- 172.21.15.142:0/1062854485 wait complete. 2024-02-19T18:53:42.301 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:42.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:42 smithi046 ceph-mon[29647]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:43.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:43 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1062854485' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:43.861 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:43.862 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:44.063 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:44.111 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:44.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:44 smithi046 ceph-mon[29647]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.557+0000 7fb430e93700 1 -- 172.21.15.142:0/1273744742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c100300 msgr2=0x7fb42c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.557+0000 7fb430e93700 1 --2- 172.21.15.142:0/1273744742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c100300 0x7fb42c100710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb424009910 tx=0x7fb424009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.557+0000 7fb430e93700 1 -- 172.21.15.142:0/1273744742 shutdown_connections 2024-02-19T18:53:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.557+0000 7fb430e93700 1 --2- 172.21.15.142:0/1273744742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c100300 0x7fb42c100710 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.557+0000 7fb430e93700 1 -- 172.21.15.142:0/1273744742 >> 172.21.15.142:0/1273744742 conn(0x7fb42c0f9a50 msgr2=0x7fb42c0fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.557+0000 7fb430e93700 1 -- 172.21.15.142:0/1273744742 shutdown_connections 2024-02-19T18:53:45.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.557+0000 7fb430e93700 1 -- 172.21.15.142:0/1273744742 wait complete. 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.558+0000 7fb430e93700 1 Processor -- start 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.558+0000 7fb430e93700 1 -- start start 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.558+0000 7fb430e93700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c100300 0x7fb42c193eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.558+0000 7fb430e93700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c1943f0 con 0x7fb42c100300 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.558+0000 7fb42a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c100300 0x7fb42c193eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.558+0000 7fb42a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c100300 0x7fb42c193eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:54656/0 (socket says 172.21.15.142:54656) 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.559+0000 7fb42a59c700 1 -- 172.21.15.142:0/1850016207 learned_addr learned my addr 172.21.15.142:0/1850016207 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.559+0000 7fb42a59c700 1 -- 172.21.15.142:0/1850016207 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240095f0 con 0x7fb42c100300 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.559+0000 7fb42a59c700 1 --2- 172.21.15.142:0/1850016207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c100300 0x7fb42c193eb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb424005b40 tx=0x7fb424004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.559+0000 7fb41b7fe700 1 -- 172.21.15.142:0/1850016207 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb42401f070 con 0x7fb42c100300 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.559+0000 7fb430e93700 1 -- 172.21.15.142:0/1850016207 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c1945f0 con 0x7fb42c100300 2024-02-19T18:53:45.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.559+0000 7fb41b7fe700 1 -- 172.21.15.142:0/1850016207 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb42400be10 con 0x7fb42c100300 2024-02-19T18:53:45.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.559+0000 7fb41b7fe700 1 -- 172.21.15.142:0/1850016207 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb424024620 con 0x7fb42c100300 2024-02-19T18:53:45.578 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.559+0000 7fb430e93700 1 -- 172.21.15.142:0/1850016207 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c194a90 con 0x7fb42c100300 2024-02-19T18:53:45.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.560+0000 7fb41b7fe700 1 -- 172.21.15.142:0/1850016207 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fb4240199c0 con 0x7fb42c100300 2024-02-19T18:53:45.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.560+0000 7fb430e93700 1 -- 172.21.15.142:0/1850016207 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42c104b50 con 0x7fb42c100300 2024-02-19T18:53:45.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.560+0000 7fb41b7fe700 1 --2- 172.21.15.142:0/1850016207 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb414038490 0x7fb41403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:45.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.560+0000 7fb41b7fe700 1 -- 172.21.15.142:0/1850016207 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb42404e630 con 0x7fb42c100300 2024-02-19T18:53:45.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.560+0000 7fb429d9b700 1 --2- 172.21.15.142:0/1850016207 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb414038490 0x7fb41403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:45.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.561+0000 7fb429d9b700 1 --2- 172.21.15.142:0/1850016207 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb414038490 0x7fb41403a940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb42000ad30 tx=0x7fb4200093f0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:45.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.567+0000 7fb41b7fe700 1 -- 172.21.15.142:0/1850016207 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb42402c540 con 0x7fb42c100300 2024-02-19T18:53:45.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.832+0000 7fb430e93700 1 -- 172.21.15.142:0/1850016207 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb42c104d40 con 0x7fb42c100300 2024-02-19T18:53:45.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.833+0000 7fb41b7fe700 1 -- 172.21.15.142:0/1850016207 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb424029020 con 0x7fb42c100300 2024-02-19T18:53:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:45.850 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:45.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.835+0000 7fb430e93700 1 -- 172.21.15.142:0/1850016207 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb414038490 msgr2=0x7fb41403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:45.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.835+0000 7fb430e93700 1 --2- 172.21.15.142:0/1850016207 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb414038490 0x7fb41403a940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb42000ad30 tx=0x7fb4200093f0 comp rx=0 tx=0).stop 2024-02-19T18:53:45.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.835+0000 7fb430e93700 1 -- 172.21.15.142:0/1850016207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c100300 msgr2=0x7fb42c193eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:45.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.835+0000 7fb430e93700 1 --2- 172.21.15.142:0/1850016207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c100300 0x7fb42c193eb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb424005b40 tx=0x7fb424004740 comp rx=0 tx=0).stop 2024-02-19T18:53:45.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.835+0000 7fb430e93700 1 -- 172.21.15.142:0/1850016207 shutdown_connections 2024-02-19T18:53:45.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.835+0000 7fb430e93700 1 --2- 172.21.15.142:0/1850016207 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fb414038490 0x7fb41403a940 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:45.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.835+0000 7fb430e93700 1 --2- 172.21.15.142:0/1850016207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c100300 0x7fb42c193eb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:45.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.835+0000 7fb430e93700 1 -- 172.21.15.142:0/1850016207 >> 172.21.15.142:0/1850016207 conn(0x7fb42c0f9a50 msgr2=0x7fb42c0fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:45.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.835+0000 7fb430e93700 1 -- 172.21.15.142:0/1850016207 shutdown_connections 2024-02-19T18:53:45.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:45.835+0000 7fb430e93700 1 -- 172.21.15.142:0/1850016207 wait complete. 2024-02-19T18:53:45.852 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:46.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:46 smithi046 ceph-mon[29647]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:46.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:46 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1850016207' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:47.373 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:47.374 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:47.578 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:47.624 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:48.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:48 smithi046 ceph-mon[29647]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:49.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.073+0000 7f7a0531b700 1 -- 172.21.15.142:0/3512921748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a000fed30 msgr2=0x7f7a000ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:49.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.073+0000 7f7a0531b700 1 --2- 172.21.15.142:0/3512921748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a000fed30 0x7f7a000ff140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009910 tx=0x7f79f4009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:49.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.073+0000 7f7a0531b700 1 -- 172.21.15.142:0/3512921748 shutdown_connections 2024-02-19T18:53:49.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.073+0000 7f7a0531b700 1 --2- 172.21.15.142:0/3512921748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a000fed30 0x7f7a000ff140 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:49.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.073+0000 7f7a0531b700 1 -- 172.21.15.142:0/3512921748 >> 172.21.15.142:0/3512921748 conn(0x7f7a000fa2c0 msgr2=0x7f7a000fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:49.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.074+0000 7f7a0531b700 1 -- 172.21.15.142:0/3512921748 shutdown_connections 2024-02-19T18:53:49.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.074+0000 7f7a0531b700 1 -- 172.21.15.142:0/3512921748 wait complete. 2024-02-19T18:53:49.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.074+0000 7f7a0531b700 1 Processor -- start 2024-02-19T18:53:49.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.074+0000 7f7a0531b700 1 -- start start 2024-02-19T18:53:49.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.075+0000 7f7a0531b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a000fed30 0x7f7a00069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:49.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.075+0000 7f7a0531b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a00197d00 con 0x7f7a000fed30 2024-02-19T18:53:49.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.075+0000 7f79feffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a000fed30 0x7f7a00069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:49.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.075+0000 7f79feffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a000fed30 0x7f7a00069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:54676/0 (socket says 172.21.15.142:54676) 2024-02-19T18:53:49.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.075+0000 7f79feffd700 1 -- 172.21.15.142:0/4244852233 learned_addr learned my addr 172.21.15.142:0/4244852233 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:49.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.075+0000 7f79feffd700 1 -- 172.21.15.142:0/4244852233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40095f0 con 0x7f7a000fed30 2024-02-19T18:53:49.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.075+0000 7f79feffd700 1 --2- 172.21.15.142:0/4244852233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a000fed30 0x7f7a00069360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f79f4005b40 tx=0x7f79f4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:49.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.075+0000 7f79e7fff700 1 -- 172.21.15.142:0/4244852233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79f401d070 con 0x7f7a000fed30 2024-02-19T18:53:49.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.076+0000 7f7a0531b700 1 -- 172.21.15.142:0/4244852233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a00197e40 con 0x7f7a000fed30 2024-02-19T18:53:49.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.076+0000 7f79e7fff700 1 -- 172.21.15.142:0/4244852233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79f400be10 con 0x7f7a000fed30 2024-02-19T18:53:49.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.076+0000 7f79e7fff700 1 -- 172.21.15.142:0/4244852233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79f400f460 con 0x7f7a000fed30 2024-02-19T18:53:49.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.076+0000 7f7a0531b700 1 -- 172.21.15.142:0/4244852233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a001982e0 con 0x7f7a000fed30 2024-02-19T18:53:49.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.077+0000 7f7a0531b700 1 -- 172.21.15.142:0/4244852233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0018da10 con 0x7f7a000fed30 2024-02-19T18:53:49.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.077+0000 7f79e7fff700 1 -- 172.21.15.142:0/4244852233 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f79f40227e0 con 0x7f7a000fed30 2024-02-19T18:53:49.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.077+0000 7f79e7fff700 1 --2- 172.21.15.142:0/4244852233 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f79e8038490 0x7f79e803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:49.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.077+0000 7f79e7fff700 1 -- 172.21.15.142:0/4244852233 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f79f404c3e0 con 0x7f7a000fed30 2024-02-19T18:53:49.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.077+0000 7f79fe7fc700 1 --2- 172.21.15.142:0/4244852233 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f79e8038490 0x7f79e803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:49.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.077+0000 7f79fe7fc700 1 --2- 172.21.15.142:0/4244852233 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f79e8038490 0x7f79e803a940 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f79f0006fd0 tx=0x7f79f0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:49.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.082+0000 7f79e7fff700 1 -- 172.21.15.142:0/4244852233 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f79f402bba0 con 0x7f7a000fed30 2024-02-19T18:53:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.345+0000 7f7a0531b700 1 -- 172.21.15.142:0/4244852233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7a0002cc30 con 0x7f7a000fed30 2024-02-19T18:53:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.346+0000 7f79e7fff700 1 -- 172.21.15.142:0/4244852233 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f79f4027030 con 0x7f7a000fed30 2024-02-19T18:53:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:49.362 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:49.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.348+0000 7f7a0531b700 1 -- 172.21.15.142:0/4244852233 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f79e8038490 msgr2=0x7f79e803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.348+0000 7f7a0531b700 1 --2- 172.21.15.142:0/4244852233 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f79e8038490 0x7f79e803a940 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f79f0006fd0 tx=0x7f79f0006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.348+0000 7f7a0531b700 1 -- 172.21.15.142:0/4244852233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a000fed30 msgr2=0x7f7a00069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.348+0000 7f7a0531b700 1 --2- 172.21.15.142:0/4244852233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a000fed30 0x7f7a00069360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f79f4005b40 tx=0x7f79f4004740 comp rx=0 tx=0).stop 2024-02-19T18:53:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.348+0000 7f7a0531b700 1 -- 172.21.15.142:0/4244852233 shutdown_connections 2024-02-19T18:53:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.348+0000 7f7a0531b700 1 --2- 172.21.15.142:0/4244852233 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f79e8038490 0x7f79e803a940 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.348+0000 7f7a0531b700 1 --2- 172.21.15.142:0/4244852233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a000fed30 0x7f7a00069360 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.348+0000 7f7a0531b700 1 -- 172.21.15.142:0/4244852233 >> 172.21.15.142:0/4244852233 conn(0x7f7a000fa2c0 msgr2=0x7f7a000faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.348+0000 7f7a0531b700 1 -- 172.21.15.142:0/4244852233 shutdown_connections 2024-02-19T18:53:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:49.348+0000 7f7a0531b700 1 -- 172.21.15.142:0/4244852233 wait complete. 2024-02-19T18:53:49.365 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:50.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:50 smithi046 ceph-mon[29647]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:50.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:50 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/4244852233' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:50.920 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:50.920 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:51.118 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:51.164 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:52.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:52 smithi046 ceph-mon[29647]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:52.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.506+0000 7f728f659700 1 -- 172.21.15.142:0/2692116707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72880ffe20 msgr2=0x7f7288100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:52.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.506+0000 7f728f659700 1 --2- 172.21.15.142:0/2692116707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72880ffe20 0x7f7288100230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7284009910 tx=0x7f7284009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:52.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.506+0000 7f728f659700 1 -- 172.21.15.142:0/2692116707 shutdown_connections 2024-02-19T18:53:52.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.506+0000 7f728f659700 1 --2- 172.21.15.142:0/2692116707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72880ffe20 0x7f7288100230 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.506+0000 7f728f659700 1 -- 172.21.15.142:0/2692116707 >> 172.21.15.142:0/2692116707 conn(0x7f72880fb3d0 msgr2=0x7f72880fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.506+0000 7f728f659700 1 -- 172.21.15.142:0/2692116707 shutdown_connections 2024-02-19T18:53:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.506+0000 7f728f659700 1 -- 172.21.15.142:0/2692116707 wait complete. 2024-02-19T18:53:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.507+0000 7f728f659700 1 Processor -- start 2024-02-19T18:53:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.507+0000 7f728f659700 1 -- start start 2024-02-19T18:53:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.507+0000 7f728f659700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72880ffe20 0x7f7288197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:52.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.507+0000 7f728f659700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7288197690 con 0x7f72880ffe20 2024-02-19T18:53:52.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.507+0000 7f728d3f5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72880ffe20 0x7f7288197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:52.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.507+0000 7f728d3f5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72880ffe20 0x7f7288197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:54692/0 (socket says 172.21.15.142:54692) 2024-02-19T18:53:52.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.508+0000 7f728d3f5700 1 -- 172.21.15.142:0/1392572835 learned_addr learned my addr 172.21.15.142:0/1392572835 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:52.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.508+0000 7f728d3f5700 1 -- 172.21.15.142:0/1392572835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72840095f0 con 0x7f72880ffe20 2024-02-19T18:53:52.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.508+0000 7f728d3f5700 1 --2- 172.21.15.142:0/1392572835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72880ffe20 0x7f7288197150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7284005b40 tx=0x7f7284004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:52.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.508+0000 7f727e7fc700 1 -- 172.21.15.142:0/1392572835 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f728401d070 con 0x7f72880ffe20 2024-02-19T18:53:52.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.508+0000 7f728f659700 1 -- 172.21.15.142:0/1392572835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7288197890 con 0x7f72880ffe20 2024-02-19T18:53:52.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.508+0000 7f727e7fc700 1 -- 172.21.15.142:0/1392572835 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f728400be10 con 0x7f72880ffe20 2024-02-19T18:53:52.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.508+0000 7f727e7fc700 1 -- 172.21.15.142:0/1392572835 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f728400f460 con 0x7f72880ffe20 2024-02-19T18:53:52.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.508+0000 7f728f659700 1 -- 172.21.15.142:0/1392572835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7288197d30 con 0x7f72880ffe20 2024-02-19T18:53:52.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.509+0000 7f728f659700 1 -- 172.21.15.142:0/1392572835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7288190e80 con 0x7f72880ffe20 2024-02-19T18:53:52.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.509+0000 7f727e7fc700 1 -- 172.21.15.142:0/1392572835 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f72840227e0 con 0x7f72880ffe20 2024-02-19T18:53:52.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.509+0000 7f727e7fc700 1 --2- 172.21.15.142:0/1392572835 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f7274038490 0x7f727403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:52.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.509+0000 7f727e7fc700 1 -- 172.21.15.142:0/1392572835 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f728404c360 con 0x7f72880ffe20 2024-02-19T18:53:52.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.510+0000 7f728cbf4700 1 --2- 172.21.15.142:0/1392572835 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f7274038490 0x7f727403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:52.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.510+0000 7f728cbf4700 1 --2- 172.21.15.142:0/1392572835 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f7274038490 0x7f727403a940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7278006fd0 tx=0x7f7278006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:52.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.515+0000 7f727e7fc700 1 -- 172.21.15.142:0/1392572835 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f728402b590 con 0x7f72880ffe20 2024-02-19T18:53:52.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.781+0000 7f728f659700 1 -- 172.21.15.142:0/1392572835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f728802cc30 con 0x7f72880ffe20 2024-02-19T18:53:52.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.782+0000 7f727e7fc700 1 -- 172.21.15.142:0/1392572835 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f7284027070 con 0x7f72880ffe20 2024-02-19T18:53:52.798 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:52.799 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:52.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.784+0000 7f728f659700 1 -- 172.21.15.142:0/1392572835 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f7274038490 msgr2=0x7f727403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:52.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.784+0000 7f728f659700 1 --2- 172.21.15.142:0/1392572835 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f7274038490 0x7f727403a940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7278006fd0 tx=0x7f7278006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:52.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.784+0000 7f728f659700 1 -- 172.21.15.142:0/1392572835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72880ffe20 msgr2=0x7f7288197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:52.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.784+0000 7f728f659700 1 --2- 172.21.15.142:0/1392572835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72880ffe20 0x7f7288197150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7284005b40 tx=0x7f7284004740 comp rx=0 tx=0).stop 2024-02-19T18:53:52.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.784+0000 7f728f659700 1 -- 172.21.15.142:0/1392572835 shutdown_connections 2024-02-19T18:53:52.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.784+0000 7f728f659700 1 --2- 172.21.15.142:0/1392572835 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f7274038490 0x7f727403a940 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:52.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.784+0000 7f728f659700 1 --2- 172.21.15.142:0/1392572835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72880ffe20 0x7f7288197150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:52.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.784+0000 7f728f659700 1 -- 172.21.15.142:0/1392572835 >> 172.21.15.142:0/1392572835 conn(0x7f72880fb3d0 msgr2=0x7f72880fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:52.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.784+0000 7f728f659700 1 -- 172.21.15.142:0/1392572835 shutdown_connections 2024-02-19T18:53:52.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:52.784+0000 7f728f659700 1 -- 172.21.15.142:0/1392572835 wait complete. 2024-02-19T18:53:52.801 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:53.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:53 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1392572835' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:54.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:54 smithi046 ceph-mon[29647]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:54.372 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:54.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:54.572 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:54.617 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:56.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.267+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1559676516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d540ffe20 msgr2=0x7f3d54100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.267+0000 7f3d5b6d7700 1 --2- 172.21.15.142:0/1559676516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d540ffe20 0x7f3d54100230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009910 tx=0x7f3d50009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.267+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1559676516 shutdown_connections 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.267+0000 7f3d5b6d7700 1 --2- 172.21.15.142:0/1559676516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d540ffe20 0x7f3d54100230 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.267+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1559676516 >> 172.21.15.142:0/1559676516 conn(0x7f3d540fb3d0 msgr2=0x7f3d540fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.267+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1559676516 shutdown_connections 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.267+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1559676516 wait complete. 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.268+0000 7f3d5b6d7700 1 Processor -- start 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.268+0000 7f3d5b6d7700 1 -- start start 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.268+0000 7f3d5b6d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d540ffe20 0x7f3d54194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.268+0000 7f3d5b6d7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d541954a0 con 0x7f3d540ffe20 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.268+0000 7f3d59473700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d540ffe20 0x7f3d54194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.268+0000 7f3d59473700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d540ffe20 0x7f3d54194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:58386/0 (socket says 172.21.15.142:58386) 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.268+0000 7f3d59473700 1 -- 172.21.15.142:0/1891925058 learned_addr learned my addr 172.21.15.142:0/1891925058 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:56.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.268+0000 7f3d59473700 1 -- 172.21.15.142:0/1891925058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500095f0 con 0x7f3d540ffe20 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.269+0000 7f3d59473700 1 --2- 172.21.15.142:0/1891925058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d540ffe20 0x7f3d54194f60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3d50005b40 tx=0x7f3d50004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.269+0000 7f3d4a7fc700 1 -- 172.21.15.142:0/1891925058 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d5001d070 con 0x7f3d540ffe20 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.269+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1891925058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d541956a0 con 0x7f3d540ffe20 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.269+0000 7f3d4a7fc700 1 -- 172.21.15.142:0/1891925058 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3d5000be10 con 0x7f3d540ffe20 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.269+0000 7f3d4a7fc700 1 -- 172.21.15.142:0/1891925058 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d5000f460 con 0x7f3d540ffe20 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.269+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1891925058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d54195b40 con 0x7f3d540ffe20 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.270+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1891925058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5418ea80 con 0x7f3d540ffe20 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.270+0000 7f3d4a7fc700 1 -- 172.21.15.142:0/1891925058 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f3d500227e0 con 0x7f3d540ffe20 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.270+0000 7f3d4a7fc700 1 --2- 172.21.15.142:0/1891925058 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f3d40038490 0x7f3d4003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.270+0000 7f3d4a7fc700 1 -- 172.21.15.142:0/1891925058 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3d5004c2a0 con 0x7f3d540ffe20 2024-02-19T18:53:56.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.270+0000 7f3d58c72700 1 --2- 172.21.15.142:0/1891925058 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f3d40038490 0x7f3d4003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:56.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.271+0000 7f3d58c72700 1 --2- 172.21.15.142:0/1891925058 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f3d40038490 0x7f3d4003a940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3d44006fd0 tx=0x7f3d44006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:56.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.275+0000 7f3d4a7fc700 1 -- 172.21.15.142:0/1891925058 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3d5002b590 con 0x7f3d540ffe20 2024-02-19T18:53:56.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:55 smithi046 ceph-mon[29647]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:56.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.546+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1891925058 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3d5402cc30 con 0x7f3d540ffe20 2024-02-19T18:53:56.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.547+0000 7f3d4a7fc700 1 -- 172.21.15.142:0/1891925058 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f3d50027070 con 0x7f3d540ffe20 2024-02-19T18:53:56.563 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:53:56.563 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:53:56.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.549+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1891925058 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f3d40038490 msgr2=0x7f3d4003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:56.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.549+0000 7f3d5b6d7700 1 --2- 172.21.15.142:0/1891925058 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f3d40038490 0x7f3d4003a940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3d44006fd0 tx=0x7f3d44006e40 comp rx=0 tx=0).stop 2024-02-19T18:53:56.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.549+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1891925058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d540ffe20 msgr2=0x7f3d54194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.549+0000 7f3d5b6d7700 1 --2- 172.21.15.142:0/1891925058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d540ffe20 0x7f3d54194f60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3d50005b40 tx=0x7f3d50004740 comp rx=0 tx=0).stop 2024-02-19T18:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.549+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1891925058 shutdown_connections 2024-02-19T18:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.549+0000 7f3d5b6d7700 1 --2- 172.21.15.142:0/1891925058 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f3d40038490 0x7f3d4003a940 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.549+0000 7f3d5b6d7700 1 --2- 172.21.15.142:0/1891925058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d540ffe20 0x7f3d54194f60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.549+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1891925058 >> 172.21.15.142:0/1891925058 conn(0x7f3d540fb3d0 msgr2=0x7f3d540fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.549+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1891925058 shutdown_connections 2024-02-19T18:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:56.549+0000 7f3d5b6d7700 1 -- 172.21.15.142:0/1891925058 wait complete. 2024-02-19T18:53:56.566 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:53:57.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:56 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1891925058' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:53:58.092 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:53:58.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:53:58.296 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:58.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:57 smithi046 ceph-mon[29647]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:53:58.343 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:53:59.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.797+0000 7f29fce77700 1 -- 172.21.15.142:0/3256904542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f80feca0 msgr2=0x7f29f80ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:53:59.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.797+0000 7f29fce77700 1 --2- 172.21.15.142:0/3256904542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f80feca0 0x7f29f80ff0b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009910 tx=0x7f29e8009c20 comp rx=0 tx=0).stop 2024-02-19T18:53:59.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.798+0000 7f29fce77700 1 -- 172.21.15.142:0/3256904542 shutdown_connections 2024-02-19T18:53:59.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.798+0000 7f29fce77700 1 --2- 172.21.15.142:0/3256904542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f80feca0 0x7f29f80ff0b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:53:59.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.798+0000 7f29fce77700 1 -- 172.21.15.142:0/3256904542 >> 172.21.15.142:0/3256904542 conn(0x7f29f80fa270 msgr2=0x7f29f80fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:53:59.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.798+0000 7f29fce77700 1 -- 172.21.15.142:0/3256904542 shutdown_connections 2024-02-19T18:53:59.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.798+0000 7f29fce77700 1 -- 172.21.15.142:0/3256904542 wait complete. 2024-02-19T18:53:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.798+0000 7f29fce77700 1 Processor -- start 2024-02-19T18:53:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.798+0000 7f29fce77700 1 -- start start 2024-02-19T18:53:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29fce77700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f80feca0 0x7f29f8194f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29fce77700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8195470 con 0x7f29f80feca0 2024-02-19T18:53:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29f659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f80feca0 0x7f29f8194f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29f659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f80feca0 0x7f29f8194f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:58412/0 (socket says 172.21.15.142:58412) 2024-02-19T18:53:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29f659c700 1 -- 172.21.15.142:0/3279507914 learned_addr learned my addr 172.21.15.142:0/3279507914 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:53:59.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29f659c700 1 -- 172.21.15.142:0/3279507914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e80095f0 con 0x7f29f80feca0 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29f659c700 1 --2- 172.21.15.142:0/3279507914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f80feca0 0x7f29f8194f30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f29e8005b40 tx=0x7f29e8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29e77fe700 1 -- 172.21.15.142:0/3279507914 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29e801d070 con 0x7f29f80feca0 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29e77fe700 1 -- 172.21.15.142:0/3279507914 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29e800be10 con 0x7f29f80feca0 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29e77fe700 1 -- 172.21.15.142:0/3279507914 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29e800f460 con 0x7f29f80feca0 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29fce77700 1 -- 172.21.15.142:0/3279507914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f8195670 con 0x7f29f80feca0 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.799+0000 7f29fce77700 1 -- 172.21.15.142:0/3279507914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f8195b10 con 0x7f29f80feca0 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.800+0000 7f29fce77700 1 -- 172.21.15.142:0/3279507914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f818e990 con 0x7f29f80feca0 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.800+0000 7f29e77fe700 1 -- 172.21.15.142:0/3279507914 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f29e80227e0 con 0x7f29f80feca0 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.800+0000 7f29e77fe700 1 --2- 172.21.15.142:0/3279507914 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f29e00384a0 0x7f29e003a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.801+0000 7f29e77fe700 1 -- 172.21.15.142:0/3279507914 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f29e804c470 con 0x7f29f80feca0 2024-02-19T18:53:59.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.801+0000 7f29f5d9b700 1 --2- 172.21.15.142:0/3279507914 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f29e00384a0 0x7f29e003a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:53:59.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.801+0000 7f29f5d9b700 1 --2- 172.21.15.142:0/3279507914 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f29e00384a0 0x7f29e003a950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f29ec006fd0 tx=0x7f29ec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:53:59.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:53:59.806+0000 7f29e77fe700 1 -- 172.21.15.142:0/3279507914 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f29e802bba0 con 0x7f29f80feca0 2024-02-19T18:54:00.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.070+0000 7f29fce77700 1 -- 172.21.15.142:0/3279507914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f29f802cc30 con 0x7f29f80feca0 2024-02-19T18:54:00.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.071+0000 7f29e77fe700 1 -- 172.21.15.142:0/3279507914 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f29e8027030 con 0x7f29f80feca0 2024-02-19T18:54:00.087 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:00.087 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:00.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.072+0000 7f29fce77700 1 -- 172.21.15.142:0/3279507914 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f29e00384a0 msgr2=0x7f29e003a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:00.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.072+0000 7f29fce77700 1 --2- 172.21.15.142:0/3279507914 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f29e00384a0 0x7f29e003a950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f29ec006fd0 tx=0x7f29ec006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:00.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.072+0000 7f29fce77700 1 -- 172.21.15.142:0/3279507914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f80feca0 msgr2=0x7f29f8194f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:00.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.072+0000 7f29fce77700 1 --2- 172.21.15.142:0/3279507914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f80feca0 0x7f29f8194f30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f29e8005b40 tx=0x7f29e8004740 comp rx=0 tx=0).stop 2024-02-19T18:54:00.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.072+0000 7f29fce77700 1 -- 172.21.15.142:0/3279507914 shutdown_connections 2024-02-19T18:54:00.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.072+0000 7f29fce77700 1 --2- 172.21.15.142:0/3279507914 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f29e00384a0 0x7f29e003a950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:00.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.073+0000 7f29fce77700 1 --2- 172.21.15.142:0/3279507914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f80feca0 0x7f29f8194f30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:00.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.073+0000 7f29fce77700 1 -- 172.21.15.142:0/3279507914 >> 172.21.15.142:0/3279507914 conn(0x7f29f80fa270 msgr2=0x7f29f8069070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:00.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.073+0000 7f29fce77700 1 -- 172.21.15.142:0/3279507914 shutdown_connections 2024-02-19T18:54:00.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:00.073+0000 7f29fce77700 1 -- 172.21.15.142:0/3279507914 wait complete. 2024-02-19T18:54:00.090 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:00.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:53:59 smithi046 ceph-mon[29647]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:01.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:00 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/3279507914' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:01.703 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:01.703 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:01.905 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:01.952 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:02.274 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:01 smithi046 ceph-mon[29647]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:03.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.413+0000 7f5c392ca700 1 -- 172.21.15.142:0/1029872429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c340ffe30 msgr2=0x7f5c34100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:03.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.413+0000 7f5c392ca700 1 --2- 172.21.15.142:0/1029872429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c340ffe30 0x7f5c34100240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009910 tx=0x7f5c24009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:03.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.413+0000 7f5c392ca700 1 -- 172.21.15.142:0/1029872429 shutdown_connections 2024-02-19T18:54:03.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.413+0000 7f5c392ca700 1 --2- 172.21.15.142:0/1029872429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c340ffe30 0x7f5c34100240 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:03.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.413+0000 7f5c392ca700 1 -- 172.21.15.142:0/1029872429 >> 172.21.15.142:0/1029872429 conn(0x7f5c340fb3c0 msgr2=0x7f5c340fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.414+0000 7f5c392ca700 1 -- 172.21.15.142:0/1029872429 shutdown_connections 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.414+0000 7f5c392ca700 1 -- 172.21.15.142:0/1029872429 wait complete. 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.414+0000 7f5c392ca700 1 Processor -- start 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.414+0000 7f5c392ca700 1 -- start start 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.414+0000 7f5c392ca700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c340ffe30 0x7f5c34074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.414+0000 7f5c392ca700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34075030 con 0x7f5c340ffe30 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.414+0000 7f5c32ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c340ffe30 0x7f5c34074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.414+0000 7f5c32ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c340ffe30 0x7f5c34074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:58434/0 (socket says 172.21.15.142:58434) 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.414+0000 7f5c32ffd700 1 -- 172.21.15.142:0/478175763 learned_addr learned my addr 172.21.15.142:0/478175763 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.415+0000 7f5c32ffd700 1 -- 172.21.15.142:0/478175763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c240095f0 con 0x7f5c340ffe30 2024-02-19T18:54:03.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.415+0000 7f5c32ffd700 1 --2- 172.21.15.142:0/478175763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c340ffe30 0x7f5c34074af0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c240092e0 tx=0x7f5c24009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:03.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.415+0000 7f5c30ff9700 1 -- 172.21.15.142:0/478175763 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c2401d070 con 0x7f5c340ffe30 2024-02-19T18:54:03.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.415+0000 7f5c30ff9700 1 -- 172.21.15.142:0/478175763 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c2400be10 con 0x7f5c340ffe30 2024-02-19T18:54:03.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.415+0000 7f5c392ca700 1 -- 172.21.15.142:0/478175763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c34073140 con 0x7f5c340ffe30 2024-02-19T18:54:03.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.415+0000 7f5c30ff9700 1 -- 172.21.15.142:0/478175763 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c2400f460 con 0x7f5c340ffe30 2024-02-19T18:54:03.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.415+0000 7f5c392ca700 1 -- 172.21.15.142:0/478175763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c340735e0 con 0x7f5c340ffe30 2024-02-19T18:54:03.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.416+0000 7f5c30ff9700 1 -- 172.21.15.142:0/478175763 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f5c2400f6d0 con 0x7f5c340ffe30 2024-02-19T18:54:03.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.416+0000 7f5c392ca700 1 -- 172.21.15.142:0/478175763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c34062380 con 0x7f5c340ffe30 2024-02-19T18:54:03.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.416+0000 7f5c30ff9700 1 --2- 172.21.15.142:0/478175763 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f5c20038490 0x7f5c2003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:03.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.416+0000 7f5c30ff9700 1 -- 172.21.15.142:0/478175763 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5c2404c570 con 0x7f5c340ffe30 2024-02-19T18:54:03.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.416+0000 7f5c2bfff700 1 --2- 172.21.15.142:0/478175763 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f5c20038490 0x7f5c2003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:03.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.417+0000 7f5c2bfff700 1 --2- 172.21.15.142:0/478175763 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f5c20038490 0x7f5c2003a940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c006fd0 tx=0x7f5c1c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:03.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.422+0000 7f5c30ff9700 1 -- 172.21.15.142:0/478175763 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5c24020960 con 0x7f5c340ffe30 2024-02-19T18:54:03.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.685+0000 7f5c392ca700 1 -- 172.21.15.142:0/478175763 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5c3418e470 con 0x7f5c340ffe30 2024-02-19T18:54:03.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.686+0000 7f5c30ff9700 1 -- 172.21.15.142:0/478175763 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f5c24027020 con 0x7f5c340ffe30 2024-02-19T18:54:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:03.703 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:03.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.688+0000 7f5c392ca700 1 -- 172.21.15.142:0/478175763 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f5c20038490 msgr2=0x7f5c2003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:03.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.688+0000 7f5c392ca700 1 --2- 172.21.15.142:0/478175763 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f5c20038490 0x7f5c2003a940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c006fd0 tx=0x7f5c1c006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:03.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.688+0000 7f5c392ca700 1 -- 172.21.15.142:0/478175763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c340ffe30 msgr2=0x7f5c34074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:03.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.688+0000 7f5c392ca700 1 --2- 172.21.15.142:0/478175763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c340ffe30 0x7f5c34074af0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c240092e0 tx=0x7f5c24009e60 comp rx=0 tx=0).stop 2024-02-19T18:54:03.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.688+0000 7f5c392ca700 1 -- 172.21.15.142:0/478175763 shutdown_connections 2024-02-19T18:54:03.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.688+0000 7f5c392ca700 1 --2- 172.21.15.142:0/478175763 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f5c20038490 0x7f5c2003a940 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:03.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.688+0000 7f5c392ca700 1 --2- 172.21.15.142:0/478175763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c340ffe30 0x7f5c34074af0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:03.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.688+0000 7f5c392ca700 1 -- 172.21.15.142:0/478175763 >> 172.21.15.142:0/478175763 conn(0x7f5c340fb3c0 msgr2=0x7f5c340fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:03.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.688+0000 7f5c392ca700 1 -- 172.21.15.142:0/478175763 shutdown_connections 2024-02-19T18:54:03.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:03.688+0000 7f5c392ca700 1 -- 172.21.15.142:0/478175763 wait complete. 2024-02-19T18:54:03.706 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:04.270 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:03 smithi046 ceph-mon[29647]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:04.270 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:03 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/478175763' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:05.267 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:05.267 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:05.469 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:05.516 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:06.251 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:05 smithi046 ceph-mon[29647]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:06.251 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:06.251 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:06.251 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:06.252 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:06.252 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:06.252 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:05 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:06.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.901+0000 7fc03af98700 1 -- 172.21.15.142:0/238560953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0340fed20 msgr2=0x7fc0340ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:06.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.901+0000 7fc03af98700 1 --2- 172.21.15.142:0/238560953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0340fed20 0x7fc0340ff130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc028009910 tx=0x7fc028009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:06.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.901+0000 7fc03af98700 1 -- 172.21.15.142:0/238560953 shutdown_connections 2024-02-19T18:54:06.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.901+0000 7fc03af98700 1 --2- 172.21.15.142:0/238560953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0340fed20 0x7fc0340ff130 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:06.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.901+0000 7fc03af98700 1 -- 172.21.15.142:0/238560953 >> 172.21.15.142:0/238560953 conn(0x7fc0340fa2b0 msgr2=0x7fc0340fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.901+0000 7fc03af98700 1 -- 172.21.15.142:0/238560953 shutdown_connections 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.901+0000 7fc03af98700 1 -- 172.21.15.142:0/238560953 wait complete. 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.901+0000 7fc03af98700 1 Processor -- start 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.902+0000 7fc03af98700 1 -- start start 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.902+0000 7fc03af98700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0340fed20 0x7fc034069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.902+0000 7fc03af98700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc034197cf0 con 0x7fc0340fed20 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.902+0000 7fc038d34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0340fed20 0x7fc034069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.902+0000 7fc038d34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0340fed20 0x7fc034069380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:42732/0 (socket says 172.21.15.142:42732) 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.902+0000 7fc038d34700 1 -- 172.21.15.142:0/2049281980 learned_addr learned my addr 172.21.15.142:0/2049281980 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.902+0000 7fc038d34700 1 -- 172.21.15.142:0/2049281980 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0280095f0 con 0x7fc0340fed20 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.902+0000 7fc038d34700 1 --2- 172.21.15.142:0/2049281980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0340fed20 0x7fc034069380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc028005950 tx=0x7fc028009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.902+0000 7fc031ffb700 1 -- 172.21.15.142:0/2049281980 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc02801d070 con 0x7fc0340fed20 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.902+0000 7fc03af98700 1 -- 172.21.15.142:0/2049281980 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc034197e30 con 0x7fc0340fed20 2024-02-19T18:54:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.903+0000 7fc031ffb700 1 -- 172.21.15.142:0/2049281980 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc02800be10 con 0x7fc0340fed20 2024-02-19T18:54:06.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.903+0000 7fc031ffb700 1 -- 172.21.15.142:0/2049281980 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc02800f460 con 0x7fc0340fed20 2024-02-19T18:54:06.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.903+0000 7fc03af98700 1 -- 172.21.15.142:0/2049281980 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc034198270 con 0x7fc0340fed20 2024-02-19T18:54:06.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.903+0000 7fc031ffb700 1 -- 172.21.15.142:0/2049281980 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fc02800b960 con 0x7fc0340fed20 2024-02-19T18:54:06.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.904+0000 7fc03af98700 1 -- 172.21.15.142:0/2049281980 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03418da00 con 0x7fc0340fed20 2024-02-19T18:54:06.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.904+0000 7fc031ffb700 1 --2- 172.21.15.142:0/2049281980 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc024038490 0x7fc02403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:06.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.904+0000 7fc031ffb700 1 -- 172.21.15.142:0/2049281980 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc02804c4f0 con 0x7fc0340fed20 2024-02-19T18:54:06.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.904+0000 7fc033fff700 1 --2- 172.21.15.142:0/2049281980 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc024038490 0x7fc02403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:06.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.904+0000 7fc033fff700 1 --2- 172.21.15.142:0/2049281980 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc024038490 0x7fc02403a940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc020006fd0 tx=0x7fc020006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:06.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:06.909+0000 7fc031ffb700 1 -- 172.21.15.142:0/2049281980 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc02802bba0 con 0x7fc0340fed20 2024-02-19T18:54:07.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:06 smithi046 ceph-mon[29647]: Deploying daemon prometheus.smithi046 on smithi046 2024-02-19T18:54:07.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.173+0000 7fc03af98700 1 -- 172.21.15.142:0/2049281980 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc03402cc30 con 0x7fc0340fed20 2024-02-19T18:54:07.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.174+0000 7fc031ffb700 1 -- 172.21.15.142:0/2049281980 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc028027030 con 0x7fc0340fed20 2024-02-19T18:54:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:07.191 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:07.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.177+0000 7fc03af98700 1 -- 172.21.15.142:0/2049281980 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc024038490 msgr2=0x7fc02403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:07.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.177+0000 7fc03af98700 1 --2- 172.21.15.142:0/2049281980 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc024038490 0x7fc02403a940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc020006fd0 tx=0x7fc020006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.177+0000 7fc03af98700 1 -- 172.21.15.142:0/2049281980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0340fed20 msgr2=0x7fc034069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.177+0000 7fc03af98700 1 --2- 172.21.15.142:0/2049281980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0340fed20 0x7fc034069380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc028005950 tx=0x7fc028009e60 comp rx=0 tx=0).stop 2024-02-19T18:54:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.177+0000 7fc03af98700 1 -- 172.21.15.142:0/2049281980 shutdown_connections 2024-02-19T18:54:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.177+0000 7fc03af98700 1 --2- 172.21.15.142:0/2049281980 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc024038490 0x7fc02403a940 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.177+0000 7fc03af98700 1 --2- 172.21.15.142:0/2049281980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0340fed20 0x7fc034069380 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.177+0000 7fc03af98700 1 -- 172.21.15.142:0/2049281980 >> 172.21.15.142:0/2049281980 conn(0x7fc0340fa2b0 msgr2=0x7fc0340faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.177+0000 7fc03af98700 1 -- 172.21.15.142:0/2049281980 shutdown_connections 2024-02-19T18:54:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:07.177+0000 7fc03af98700 1 -- 172.21.15.142:0/2049281980 wait complete. 2024-02-19T18:54:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:08.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:07 smithi046 ceph-mon[29647]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:08.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:07 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/2049281980' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:08.744 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:08.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:08.947 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:08.993 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:10.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:09 smithi046 ceph-mon[29647]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:10.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:09 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:10.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.415+0000 7f829de0a700 1 -- 172.21.15.142:0/970179625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82980fed20 msgr2=0x7f82980ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:10.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.415+0000 7f829de0a700 1 --2- 172.21.15.142:0/970179625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82980fed20 0x7f82980ff130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8288009910 tx=0x7f8288009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:10.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.415+0000 7f829de0a700 1 -- 172.21.15.142:0/970179625 shutdown_connections 2024-02-19T18:54:10.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.415+0000 7f829de0a700 1 --2- 172.21.15.142:0/970179625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82980fed20 0x7f82980ff130 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:10.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.415+0000 7f829de0a700 1 -- 172.21.15.142:0/970179625 >> 172.21.15.142:0/970179625 conn(0x7f82980fa2b0 msgr2=0x7f82980fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:10.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.415+0000 7f829de0a700 1 -- 172.21.15.142:0/970179625 shutdown_connections 2024-02-19T18:54:10.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.415+0000 7f829de0a700 1 -- 172.21.15.142:0/970179625 wait complete. 2024-02-19T18:54:10.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.415+0000 7f829de0a700 1 Processor -- start 2024-02-19T18:54:10.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.416+0000 7f829de0a700 1 -- start start 2024-02-19T18:54:10.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.416+0000 7f829de0a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82980fed20 0x7f82980693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:10.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.416+0000 7f829de0a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8298197cd0 con 0x7f82980fed20 2024-02-19T18:54:10.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.416+0000 7f82977fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82980fed20 0x7f82980693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:10.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.416+0000 7f82977fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82980fed20 0x7f82980693a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:42742/0 (socket says 172.21.15.142:42742) 2024-02-19T18:54:10.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.416+0000 7f82977fe700 1 -- 172.21.15.142:0/1291817895 learned_addr learned my addr 172.21.15.142:0/1291817895 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:10.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.416+0000 7f82977fe700 1 -- 172.21.15.142:0/1291817895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82880095f0 con 0x7f82980fed20 2024-02-19T18:54:10.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.416+0000 7f82977fe700 1 --2- 172.21.15.142:0/1291817895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82980fed20 0x7f82980693a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8288005b40 tx=0x7f8288004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:10.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.417+0000 7f8294ff9700 1 -- 172.21.15.142:0/1291817895 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f828801d070 con 0x7f82980fed20 2024-02-19T18:54:10.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.417+0000 7f829de0a700 1 -- 172.21.15.142:0/1291817895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8298197e10 con 0x7f82980fed20 2024-02-19T18:54:10.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.417+0000 7f8294ff9700 1 -- 172.21.15.142:0/1291817895 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f828800be10 con 0x7f82980fed20 2024-02-19T18:54:10.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.417+0000 7f8294ff9700 1 -- 172.21.15.142:0/1291817895 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f828800f460 con 0x7f82980fed20 2024-02-19T18:54:10.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.417+0000 7f829de0a700 1 -- 172.21.15.142:0/1291817895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82981982b0 con 0x7f82980fed20 2024-02-19T18:54:10.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.417+0000 7f829de0a700 1 -- 172.21.15.142:0/1291817895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829818da00 con 0x7f82980fed20 2024-02-19T18:54:10.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.418+0000 7f8294ff9700 1 -- 172.21.15.142:0/1291817895 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f82880227e0 con 0x7f82980fed20 2024-02-19T18:54:10.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.418+0000 7f8294ff9700 1 --2- 172.21.15.142:0/1291817895 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f82800384e0 0x7f828003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:10.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.418+0000 7f8294ff9700 1 -- 172.21.15.142:0/1291817895 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f828804c4a0 con 0x7f82980fed20 2024-02-19T18:54:10.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.418+0000 7f8296ffd700 1 --2- 172.21.15.142:0/1291817895 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f82800384e0 0x7f828003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:10.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.419+0000 7f8296ffd700 1 --2- 172.21.15.142:0/1291817895 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f82800384e0 0x7f828003a990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f828c006fd0 tx=0x7f828c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:10.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.423+0000 7f8294ff9700 1 -- 172.21.15.142:0/1291817895 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f828802ba00 con 0x7f82980fed20 2024-02-19T18:54:10.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.689+0000 7f829de0a700 1 -- 172.21.15.142:0/1291817895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f829802cc30 con 0x7f82980fed20 2024-02-19T18:54:10.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.690+0000 7f8294ff9700 1 -- 172.21.15.142:0/1291817895 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8288027020 con 0x7f82980fed20 2024-02-19T18:54:10.705 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:10.706 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:10.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.692+0000 7f829de0a700 1 -- 172.21.15.142:0/1291817895 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f82800384e0 msgr2=0x7f828003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:10.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.692+0000 7f829de0a700 1 --2- 172.21.15.142:0/1291817895 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f82800384e0 0x7f828003a990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f828c006fd0 tx=0x7f828c006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:10.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.692+0000 7f829de0a700 1 -- 172.21.15.142:0/1291817895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82980fed20 msgr2=0x7f82980693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:10.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.692+0000 7f829de0a700 1 --2- 172.21.15.142:0/1291817895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82980fed20 0x7f82980693a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8288005b40 tx=0x7f8288004740 comp rx=0 tx=0).stop 2024-02-19T18:54:10.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.692+0000 7f829de0a700 1 -- 172.21.15.142:0/1291817895 shutdown_connections 2024-02-19T18:54:10.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.692+0000 7f829de0a700 1 --2- 172.21.15.142:0/1291817895 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f82800384e0 0x7f828003a990 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:10.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.692+0000 7f829de0a700 1 --2- 172.21.15.142:0/1291817895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82980fed20 0x7f82980693a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:10.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.692+0000 7f829de0a700 1 -- 172.21.15.142:0/1291817895 >> 172.21.15.142:0/1291817895 conn(0x7f82980fa2b0 msgr2=0x7f82980faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:10.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.692+0000 7f829de0a700 1 -- 172.21.15.142:0/1291817895 shutdown_connections 2024-02-19T18:54:10.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:10.692+0000 7f829de0a700 1 -- 172.21.15.142:0/1291817895 wait complete. 2024-02-19T18:54:10.709 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:11.258 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:10 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1291817895' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:12.263 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:12.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:12.326 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:11 smithi046 ceph-mon[29647]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:12.467 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:12.513 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:13.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.965+0000 7f4623023700 1 -- 172.21.15.142:0/888483509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461c0fed20 msgr2=0x7f461c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:13.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.965+0000 7f4623023700 1 --2- 172.21.15.142:0/888483509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461c0fed20 0x7f461c0ff130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4610009910 tx=0x7f4610009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:13.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.965+0000 7f4623023700 1 -- 172.21.15.142:0/888483509 shutdown_connections 2024-02-19T18:54:13.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.965+0000 7f4623023700 1 --2- 172.21.15.142:0/888483509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461c0fed20 0x7f461c0ff130 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:13.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.965+0000 7f4623023700 1 -- 172.21.15.142:0/888483509 >> 172.21.15.142:0/888483509 conn(0x7f461c0fa2b0 msgr2=0x7f461c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:13.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.965+0000 7f4623023700 1 -- 172.21.15.142:0/888483509 shutdown_connections 2024-02-19T18:54:13.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.966+0000 7f4623023700 1 -- 172.21.15.142:0/888483509 wait complete. 2024-02-19T18:54:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.966+0000 7f4623023700 1 Processor -- start 2024-02-19T18:54:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.966+0000 7f4623023700 1 -- start start 2024-02-19T18:54:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.966+0000 7f4623023700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461c0fed20 0x7f461c0fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.966+0000 7f4623023700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0fc7a0 con 0x7f461c0fed20 2024-02-19T18:54:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.966+0000 7f4620dbf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461c0fed20 0x7f461c0fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.966+0000 7f4620dbf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461c0fed20 0x7f461c0fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:42770/0 (socket says 172.21.15.142:42770) 2024-02-19T18:54:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.966+0000 7f4620dbf700 1 -- 172.21.15.142:0/1131435014 learned_addr learned my addr 172.21.15.142:0/1131435014 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:13.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.967+0000 7f4620dbf700 1 -- 172.21.15.142:0/1131435014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100095f0 con 0x7f461c0fed20 2024-02-19T18:54:13.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.967+0000 7f4620dbf700 1 --2- 172.21.15.142:0/1131435014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461c0fed20 0x7f461c0fc260 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4610005b40 tx=0x7f4610004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.967+0000 7f4619ffb700 1 -- 172.21.15.142:0/1131435014 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f461001d070 con 0x7f461c0fed20 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.967+0000 7f4623023700 1 -- 172.21.15.142:0/1131435014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c0fa8b0 con 0x7f461c0fed20 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.967+0000 7f4619ffb700 1 -- 172.21.15.142:0/1131435014 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f461000be10 con 0x7f461c0fed20 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.967+0000 7f4619ffb700 1 -- 172.21.15.142:0/1131435014 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f461000f460 con 0x7f461c0fed20 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.967+0000 7f4623023700 1 -- 172.21.15.142:0/1131435014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c0fad50 con 0x7f461c0fed20 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.968+0000 7f4619ffb700 1 -- 172.21.15.142:0/1131435014 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f461000b960 con 0x7f461c0fed20 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.968+0000 7f4623023700 1 -- 172.21.15.142:0/1131435014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c062380 con 0x7f461c0fed20 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.968+0000 7f4619ffb700 1 --2- 172.21.15.142:0/1131435014 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f460c038490 0x7f460c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.968+0000 7f4619ffb700 1 -- 172.21.15.142:0/1131435014 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f461004c470 con 0x7f461c0fed20 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.968+0000 7f461bfff700 1 --2- 172.21.15.142:0/1131435014 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f460c038490 0x7f460c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:13.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.969+0000 7f461bfff700 1 --2- 172.21.15.142:0/1131435014 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f460c038490 0x7f460c03a940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4608006fd0 tx=0x7f4608006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:13.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:13.973+0000 7f4619ffb700 1 -- 172.21.15.142:0/1131435014 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f461002a360 con 0x7f461c0fed20 2024-02-19T18:54:14.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.238+0000 7f4623023700 1 -- 172.21.15.142:0/1131435014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f461c18e3f0 con 0x7f461c0fed20 2024-02-19T18:54:14.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.239+0000 7f4619ffb700 1 -- 172.21.15.142:0/1131435014 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f4610027070 con 0x7f461c0fed20 2024-02-19T18:54:14.255 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:14.255 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:14.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.241+0000 7f4623023700 1 -- 172.21.15.142:0/1131435014 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f460c038490 msgr2=0x7f460c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:14.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.241+0000 7f4623023700 1 --2- 172.21.15.142:0/1131435014 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f460c038490 0x7f460c03a940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4608006fd0 tx=0x7f4608006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:14.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.241+0000 7f4623023700 1 -- 172.21.15.142:0/1131435014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461c0fed20 msgr2=0x7f461c0fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:14.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.241+0000 7f4623023700 1 --2- 172.21.15.142:0/1131435014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461c0fed20 0x7f461c0fc260 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4610005b40 tx=0x7f4610004740 comp rx=0 tx=0).stop 2024-02-19T18:54:14.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.241+0000 7f4623023700 1 -- 172.21.15.142:0/1131435014 shutdown_connections 2024-02-19T18:54:14.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.241+0000 7f4623023700 1 --2- 172.21.15.142:0/1131435014 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f460c038490 0x7f460c03a940 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:14.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.241+0000 7f4623023700 1 --2- 172.21.15.142:0/1131435014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461c0fed20 0x7f461c0fc260 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:14.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.241+0000 7f4623023700 1 -- 172.21.15.142:0/1131435014 >> 172.21.15.142:0/1131435014 conn(0x7f461c0fa2b0 msgr2=0x7f461c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:14.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.241+0000 7f4623023700 1 -- 172.21.15.142:0/1131435014 shutdown_connections 2024-02-19T18:54:14.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:14.241+0000 7f4623023700 1 -- 172.21.15.142:0/1131435014 wait complete. 2024-02-19T18:54:14.258 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:14.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:13 smithi046 ceph-mon[29647]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:15.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:14 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1131435014' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:15.843 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:15.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:16.044 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:16.090 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:16.264 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:15 smithi046 ceph-mon[29647]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:17.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.577+0000 7f8f33550700 1 -- 172.21.15.142:0/2830939851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ffe70 msgr2=0x7f8f2c100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:17.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.577+0000 7f8f33550700 1 --2- 172.21.15.142:0/2830939851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ffe70 0x7f8f2c100280 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009910 tx=0x7f8f28009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:17.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.578+0000 7f8f33550700 1 -- 172.21.15.142:0/2830939851 shutdown_connections 2024-02-19T18:54:17.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.578+0000 7f8f33550700 1 --2- 172.21.15.142:0/2830939851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ffe70 0x7f8f2c100280 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:17.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.578+0000 7f8f33550700 1 -- 172.21.15.142:0/2830939851 >> 172.21.15.142:0/2830939851 conn(0x7f8f2c0fb470 msgr2=0x7f8f2c0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:17.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.578+0000 7f8f33550700 1 -- 172.21.15.142:0/2830939851 shutdown_connections 2024-02-19T18:54:17.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.578+0000 7f8f33550700 1 -- 172.21.15.142:0/2830939851 wait complete. 2024-02-19T18:54:17.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.578+0000 7f8f33550700 1 Processor -- start 2024-02-19T18:54:17.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.578+0000 7f8f33550700 1 -- start start 2024-02-19T18:54:17.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.578+0000 7f8f33550700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ffe70 0x7f8f2c194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:17.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.578+0000 7f8f33550700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c1954e0 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.578+0000 7f8f312ec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ffe70 0x7f8f2c194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:17.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.579+0000 7f8f312ec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ffe70 0x7f8f2c194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:57132/0 (socket says 172.21.15.142:57132) 2024-02-19T18:54:17.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.579+0000 7f8f312ec700 1 -- 172.21.15.142:0/4215077461 learned_addr learned my addr 172.21.15.142:0/4215077461 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:17.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.579+0000 7f8f312ec700 1 -- 172.21.15.142:0/4215077461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f280095f0 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.579+0000 7f8f312ec700 1 --2- 172.21.15.142:0/4215077461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ffe70 0x7f8f2c194fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8f28005b40 tx=0x7f8f28004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:17.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.579+0000 7f8f227fc700 1 -- 172.21.15.142:0/4215077461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f2801d070 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.579+0000 7f8f33550700 1 -- 172.21.15.142:0/4215077461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c1956e0 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.579+0000 7f8f227fc700 1 -- 172.21.15.142:0/4215077461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f2800be10 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.579+0000 7f8f227fc700 1 -- 172.21.15.142:0/4215077461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f2800f460 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.579+0000 7f8f33550700 1 -- 172.21.15.142:0/4215077461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c195b80 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.580+0000 7f8f227fc700 1 -- 172.21.15.142:0/4215077461 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f8f2800b960 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.580+0000 7f8f33550700 1 -- 172.21.15.142:0/4215077461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c18ea70 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.580+0000 7f8f227fc700 1 --2- 172.21.15.142:0/4215077461 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f8f18038490 0x7f8f1803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:17.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.580+0000 7f8f227fc700 1 -- 172.21.15.142:0/4215077461 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8f2804c4b0 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.580+0000 7f8f30aeb700 1 --2- 172.21.15.142:0/4215077461 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f8f18038490 0x7f8f1803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:17.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.581+0000 7f8f30aeb700 1 --2- 172.21.15.142:0/4215077461 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f8f18038490 0x7f8f1803a940 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c006fd0 tx=0x7f8f1c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:17.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.585+0000 7f8f227fc700 1 -- 172.21.15.142:0/4215077461 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8f2802a360 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.847+0000 7f8f33550700 1 -- 172.21.15.142:0/4215077461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8f2c02cc30 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.848+0000 7f8f227fc700 1 -- 172.21.15.142:0/4215077461 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8f28027030 con 0x7f8f2c0ffe70 2024-02-19T18:54:17.865 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:17.865 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:17.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.851+0000 7f8f33550700 1 -- 172.21.15.142:0/4215077461 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f8f18038490 msgr2=0x7f8f1803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:17.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.851+0000 7f8f33550700 1 --2- 172.21.15.142:0/4215077461 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f8f18038490 0x7f8f1803a940 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c006fd0 tx=0x7f8f1c006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:17.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.851+0000 7f8f33550700 1 -- 172.21.15.142:0/4215077461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ffe70 msgr2=0x7f8f2c194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:17.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.851+0000 7f8f33550700 1 --2- 172.21.15.142:0/4215077461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ffe70 0x7f8f2c194fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8f28005b40 tx=0x7f8f28004740 comp rx=0 tx=0).stop 2024-02-19T18:54:17.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.851+0000 7f8f33550700 1 -- 172.21.15.142:0/4215077461 shutdown_connections 2024-02-19T18:54:17.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.851+0000 7f8f33550700 1 --2- 172.21.15.142:0/4215077461 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f8f18038490 0x7f8f1803a940 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:17.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.851+0000 7f8f33550700 1 --2- 172.21.15.142:0/4215077461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ffe70 0x7f8f2c194fa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:17.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.851+0000 7f8f33550700 1 -- 172.21.15.142:0/4215077461 >> 172.21.15.142:0/4215077461 conn(0x7f8f2c0fb470 msgr2=0x7f8f2c0fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:17.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.851+0000 7f8f33550700 1 -- 172.21.15.142:0/4215077461 shutdown_connections 2024-02-19T18:54:17.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:17.851+0000 7f8f33550700 1 -- 172.21.15.142:0/4215077461 wait complete. 2024-02-19T18:54:17.869 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:18.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:17 smithi046 ceph-mon[29647]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:18.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:17 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/4215077461' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:19.455 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:19.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:19.659 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:19.705 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:20.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:19 smithi046 ceph-mon[29647]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:21.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.166+0000 7f4fb707c700 1 -- 172.21.15.142:0/4056086801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fb00ffe20 msgr2=0x7f4fb0100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:21.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.166+0000 7f4fb707c700 1 --2- 172.21.15.142:0/4056086801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fb00ffe20 0x7f4fb0100230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009910 tx=0x7f4fa4009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:21.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.166+0000 7f4fb707c700 1 -- 172.21.15.142:0/4056086801 shutdown_connections 2024-02-19T18:54:21.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.166+0000 7f4fb707c700 1 --2- 172.21.15.142:0/4056086801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fb00ffe20 0x7f4fb0100230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:21.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.166+0000 7f4fb707c700 1 -- 172.21.15.142:0/4056086801 >> 172.21.15.142:0/4056086801 conn(0x7f4fb00fb3d0 msgr2=0x7f4fb00fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:21.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.166+0000 7f4fb707c700 1 -- 172.21.15.142:0/4056086801 shutdown_connections 2024-02-19T18:54:21.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.166+0000 7f4fb707c700 1 -- 172.21.15.142:0/4056086801 wait complete. 2024-02-19T18:54:21.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.167+0000 7f4fb707c700 1 Processor -- start 2024-02-19T18:54:21.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.167+0000 7f4fb707c700 1 -- start start 2024-02-19T18:54:21.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.167+0000 7f4fb707c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fb00ffe20 0x7f4fb0194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:21.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.167+0000 7f4fb707c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb01954d0 con 0x7f4fb00ffe20 2024-02-19T18:54:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.167+0000 7f4fb4e18700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fb00ffe20 0x7f4fb0194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.167+0000 7f4fb4e18700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fb00ffe20 0x7f4fb0194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:57162/0 (socket says 172.21.15.142:57162) 2024-02-19T18:54:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.167+0000 7f4fb4e18700 1 -- 172.21.15.142:0/600277784 learned_addr learned my addr 172.21.15.142:0/600277784 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.168+0000 7f4fb4e18700 1 -- 172.21.15.142:0/600277784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40095f0 con 0x7f4fb00ffe20 2024-02-19T18:54:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.168+0000 7f4fb4e18700 1 --2- 172.21.15.142:0/600277784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fb00ffe20 0x7f4fb0194f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40092e0 tx=0x7f4fa4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.168+0000 7f4fadffb700 1 -- 172.21.15.142:0/600277784 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fa401d070 con 0x7f4fb00ffe20 2024-02-19T18:54:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.168+0000 7f4fadffb700 1 -- 172.21.15.142:0/600277784 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4fa400be10 con 0x7f4fb00ffe20 2024-02-19T18:54:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.168+0000 7f4fb707c700 1 -- 172.21.15.142:0/600277784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb01956d0 con 0x7f4fb00ffe20 2024-02-19T18:54:21.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.168+0000 7f4fadffb700 1 -- 172.21.15.142:0/600277784 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fa400f460 con 0x7f4fb00ffe20 2024-02-19T18:54:21.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.168+0000 7f4fb707c700 1 -- 172.21.15.142:0/600277784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb0195b70 con 0x7f4fb00ffe20 2024-02-19T18:54:21.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.169+0000 7f4fb707c700 1 -- 172.21.15.142:0/600277784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb018ea80 con 0x7f4fb00ffe20 2024-02-19T18:54:21.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.169+0000 7f4fadffb700 1 -- 172.21.15.142:0/600277784 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f4fa4022470 con 0x7f4fb00ffe20 2024-02-19T18:54:21.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.169+0000 7f4fadffb700 1 --2- 172.21.15.142:0/600277784 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f4fa0038490 0x7f4fa003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:21.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.170+0000 7f4fadffb700 1 -- 172.21.15.142:0/600277784 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4fa404c3b0 con 0x7f4fb00ffe20 2024-02-19T18:54:21.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.170+0000 7f4faffff700 1 --2- 172.21.15.142:0/600277784 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f4fa0038490 0x7f4fa003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:21.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.170+0000 7f4faffff700 1 --2- 172.21.15.142:0/600277784 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f4fa0038490 0x7f4fa003a940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c006fd0 tx=0x7f4f9c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:21.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.175+0000 7f4fadffb700 1 -- 172.21.15.142:0/600277784 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4fa400b960 con 0x7f4fb00ffe20 2024-02-19T18:54:21.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.447+0000 7f4fb707c700 1 -- 172.21.15.142:0/600277784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4fb002cc30 con 0x7f4fb00ffe20 2024-02-19T18:54:21.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.448+0000 7f4fadffb700 1 -- 172.21.15.142:0/600277784 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f4fa4027070 con 0x7f4fb00ffe20 2024-02-19T18:54:21.464 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:21.464 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:21.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.450+0000 7f4fb707c700 1 -- 172.21.15.142:0/600277784 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f4fa0038490 msgr2=0x7f4fa003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:21.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.450+0000 7f4fb707c700 1 --2- 172.21.15.142:0/600277784 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f4fa0038490 0x7f4fa003a940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c006fd0 tx=0x7f4f9c006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.450+0000 7f4fb707c700 1 -- 172.21.15.142:0/600277784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fb00ffe20 msgr2=0x7f4fb0194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.450+0000 7f4fb707c700 1 --2- 172.21.15.142:0/600277784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fb00ffe20 0x7f4fb0194f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40092e0 tx=0x7f4fa4009e60 comp rx=0 tx=0).stop 2024-02-19T18:54:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.450+0000 7f4fb707c700 1 -- 172.21.15.142:0/600277784 shutdown_connections 2024-02-19T18:54:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.450+0000 7f4fb707c700 1 --2- 172.21.15.142:0/600277784 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f4fa0038490 0x7f4fa003a940 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.450+0000 7f4fb707c700 1 --2- 172.21.15.142:0/600277784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fb00ffe20 0x7f4fb0194f90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.450+0000 7f4fb707c700 1 -- 172.21.15.142:0/600277784 >> 172.21.15.142:0/600277784 conn(0x7f4fb00fb3d0 msgr2=0x7f4fb00fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.450+0000 7f4fb707c700 1 -- 172.21.15.142:0/600277784 shutdown_connections 2024-02-19T18:54:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:21.450+0000 7f4fb707c700 1 -- 172.21.15.142:0/600277784 wait complete. 2024-02-19T18:54:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:22.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:21 smithi046 ceph-mon[29647]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:22.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:21 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/600277784' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:23.041 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:23.041 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:23.243 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:23.288 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:24.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:23 smithi046 ceph-mon[29647]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:24.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.751+0000 7fc1dd66d700 1 -- 172.21.15.142:0/3610113835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d81008b0 msgr2=0x7fc1d8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:24.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.751+0000 7fc1dd66d700 1 --2- 172.21.15.142:0/3610113835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d81008b0 0x7fc1d8102c90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000b0a0 tx=0x7fc1d000b3b0 comp rx=0 tx=0).stop 2024-02-19T18:54:24.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.751+0000 7fc1dd66d700 1 -- 172.21.15.142:0/3610113835 shutdown_connections 2024-02-19T18:54:24.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.751+0000 7fc1dd66d700 1 --2- 172.21.15.142:0/3610113835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d81008b0 0x7fc1d8102c90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:24.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.751+0000 7fc1dd66d700 1 -- 172.21.15.142:0/3610113835 >> 172.21.15.142:0/3610113835 conn(0x7fc1d80fa2b0 msgr2=0x7fc1d80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:24.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.751+0000 7fc1dd66d700 1 -- 172.21.15.142:0/3610113835 shutdown_connections 2024-02-19T18:54:24.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.751+0000 7fc1dd66d700 1 -- 172.21.15.142:0/3610113835 wait complete. 2024-02-19T18:54:24.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.752+0000 7fc1dd66d700 1 Processor -- start 2024-02-19T18:54:24.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.752+0000 7fc1dd66d700 1 -- start start 2024-02-19T18:54:24.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.752+0000 7fc1dd66d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d81008b0 0x7fc1d8194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:24.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.752+0000 7fc1dd66d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8195490 con 0x7fc1d81008b0 2024-02-19T18:54:24.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.753+0000 7fc1d6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d81008b0 0x7fc1d8194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:24.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.753+0000 7fc1d6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d81008b0 0x7fc1d8194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:55214/0 (socket says 172.21.15.142:55214) 2024-02-19T18:54:24.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.753+0000 7fc1d6ffd700 1 -- 172.21.15.142:0/2186353086 learned_addr learned my addr 172.21.15.142:0/2186353086 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:24.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.753+0000 7fc1d6ffd700 1 -- 172.21.15.142:0/2186353086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0009d00 con 0x7fc1d81008b0 2024-02-19T18:54:24.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.753+0000 7fc1d6ffd700 1 --2- 172.21.15.142:0/2186353086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d81008b0 0x7fc1d8194f50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009fd0 tx=0x7fc1d000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:24.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.753+0000 7fc1cffff700 1 -- 172.21.15.142:0/2186353086 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1d000e040 con 0x7fc1d81008b0 2024-02-19T18:54:24.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.753+0000 7fc1dd66d700 1 -- 172.21.15.142:0/2186353086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d8195690 con 0x7fc1d81008b0 2024-02-19T18:54:24.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.753+0000 7fc1cffff700 1 -- 172.21.15.142:0/2186353086 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc1d000bdc0 con 0x7fc1d81008b0 2024-02-19T18:54:24.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.753+0000 7fc1cffff700 1 -- 172.21.15.142:0/2186353086 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1d001da40 con 0x7fc1d81008b0 2024-02-19T18:54:24.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.753+0000 7fc1dd66d700 1 -- 172.21.15.142:0/2186353086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d8195ab0 con 0x7fc1d81008b0 2024-02-19T18:54:24.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.754+0000 7fc1dd66d700 1 -- 172.21.15.142:0/2186353086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d818eb00 con 0x7fc1d81008b0 2024-02-19T18:54:24.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.754+0000 7fc1cffff700 1 -- 172.21.15.142:0/2186353086 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fc1d001d480 con 0x7fc1d81008b0 2024-02-19T18:54:24.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.755+0000 7fc1cffff700 1 --2- 172.21.15.142:0/2186353086 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc1c40384e0 0x7fc1c403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:24.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.755+0000 7fc1cffff700 1 -- 172.21.15.142:0/2186353086 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc1d004c8f0 con 0x7fc1d81008b0 2024-02-19T18:54:24.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.755+0000 7fc1d67fc700 1 --2- 172.21.15.142:0/2186353086 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc1c40384e0 0x7fc1c403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:24.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.755+0000 7fc1d67fc700 1 --2- 172.21.15.142:0/2186353086 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc1c40384e0 0x7fc1c403a990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0006fd0 tx=0x7fc1c0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:24.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:24.760+0000 7fc1cffff700 1 -- 172.21.15.142:0/2186353086 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc1d001c9b0 con 0x7fc1d81008b0 2024-02-19T18:54:25.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.026+0000 7fc1dd66d700 1 -- 172.21.15.142:0/2186353086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc1d8062380 con 0x7fc1d81008b0 2024-02-19T18:54:25.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.026+0000 7fc1cffff700 1 -- 172.21.15.142:0/2186353086 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc1d001c3e0 con 0x7fc1d81008b0 2024-02-19T18:54:25.043 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:25.043 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:25.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.028+0000 7fc1dd66d700 1 -- 172.21.15.142:0/2186353086 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc1c40384e0 msgr2=0x7fc1c403a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:25.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.028+0000 7fc1dd66d700 1 --2- 172.21.15.142:0/2186353086 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc1c40384e0 0x7fc1c403a990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0006fd0 tx=0x7fc1c0006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:25.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.028+0000 7fc1dd66d700 1 -- 172.21.15.142:0/2186353086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d81008b0 msgr2=0x7fc1d8194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:25.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.028+0000 7fc1dd66d700 1 --2- 172.21.15.142:0/2186353086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d81008b0 0x7fc1d8194f50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009fd0 tx=0x7fc1d000bb10 comp rx=0 tx=0).stop 2024-02-19T18:54:25.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.028+0000 7fc1dd66d700 1 -- 172.21.15.142:0/2186353086 shutdown_connections 2024-02-19T18:54:25.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.028+0000 7fc1dd66d700 1 --2- 172.21.15.142:0/2186353086 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7fc1c40384e0 0x7fc1c403a990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:25.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.028+0000 7fc1dd66d700 1 --2- 172.21.15.142:0/2186353086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1d81008b0 0x7fc1d8194f50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:25.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.028+0000 7fc1dd66d700 1 -- 172.21.15.142:0/2186353086 >> 172.21.15.142:0/2186353086 conn(0x7fc1d80fa2b0 msgr2=0x7fc1d80faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:25.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.028+0000 7fc1dd66d700 1 -- 172.21.15.142:0/2186353086 shutdown_connections 2024-02-19T18:54:25.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:25.028+0000 7fc1dd66d700 1 -- 172.21.15.142:0/2186353086 wait complete. 2024-02-19T18:54:25.046 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:25.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:25 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:25.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:25 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:25.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:25 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:25.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:25 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-19T18:54:25.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:25 smithi046 ceph-mon[29647]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:25.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:25 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:25.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:25 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/2186353086' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:26.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:26 smithi046 ceph-mon[29647]: from='mgr.14164 172.21.15.46:0/1908917614' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-19T18:54:26.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:26 smithi046 ceph-mon[29647]: mgrmap e14: smithi046.qtceex(active, since 100s) 2024-02-19T18:54:26.587 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:26.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:26.781 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:26.828 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.289+0000 7f1058d12700 1 -- 172.21.15.142:0/1615938673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10540ffe20 msgr2=0x7f1054100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.289+0000 7f1058d12700 1 --2- 172.21.15.142:0/1615938673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10540ffe20 0x7f1054100230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f104c00b0a0 tx=0x7f104c00b3b0 comp rx=0 tx=0).stop 2024-02-19T18:54:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.289+0000 7f1058d12700 1 -- 172.21.15.142:0/1615938673 shutdown_connections 2024-02-19T18:54:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.289+0000 7f1058d12700 1 --2- 172.21.15.142:0/1615938673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10540ffe20 0x7f1054100230 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:28.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.289+0000 7f1058d12700 1 -- 172.21.15.142:0/1615938673 >> 172.21.15.142:0/1615938673 conn(0x7f10540fb3d0 msgr2=0x7f10540fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.289+0000 7f1058d12700 1 -- 172.21.15.142:0/1615938673 shutdown_connections 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.289+0000 7f1058d12700 1 -- 172.21.15.142:0/1615938673 wait complete. 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.289+0000 7f1058d12700 1 Processor -- start 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.290+0000 7f1058d12700 1 -- start start 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.290+0000 7f1058d12700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10540ffe20 0x7f1054074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.290+0000 7f1058d12700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054075030 con 0x7f10540ffe20 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.290+0000 7f105259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10540ffe20 0x7f1054074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.290+0000 7f105259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10540ffe20 0x7f1054074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:55234/0 (socket says 172.21.15.142:55234) 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.290+0000 7f105259c700 1 -- 172.21.15.142:0/4040603943 learned_addr learned my addr 172.21.15.142:0/4040603943 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.290+0000 7f105259c700 1 -- 172.21.15.142:0/4040603943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c009d00 con 0x7f10540ffe20 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.290+0000 7f105259c700 1 --2- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10540ffe20 0x7f1054074af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f104c015040 tx=0x7f104c00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.290+0000 7f104b7fe700 1 -- 172.21.15.142:0/4040603943 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f104c00e040 con 0x7f10540ffe20 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.290+0000 7f1058d12700 1 -- 172.21.15.142:0/4040603943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1054073140 con 0x7f10540ffe20 2024-02-19T18:54:28.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.291+0000 7f104b7fe700 1 -- 172.21.15.142:0/4040603943 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f104c01d930 con 0x7f10540ffe20 2024-02-19T18:54:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.291+0000 7f104b7fe700 1 -- 172.21.15.142:0/4040603943 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f104c0129d0 con 0x7f10540ffe20 2024-02-19T18:54:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.291+0000 7f1058d12700 1 -- 172.21.15.142:0/4040603943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1054073560 con 0x7f10540ffe20 2024-02-19T18:54:28.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.291+0000 7f104b7fe700 1 -- 172.21.15.142:0/4040603943 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f104c012c90 con 0x7f10540ffe20 2024-02-19T18:54:28.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.291+0000 7f1058d12700 1 -- 172.21.15.142:0/4040603943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1054073f70 con 0x7f10540ffe20 2024-02-19T18:54:28.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.292+0000 7f104b7fe700 1 --2- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f10400384e0 0x7f104003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:28.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.292+0000 7f104b7fe700 1 -- 172.21.15.142:0/4040603943 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f104c04c760 con 0x7f10540ffe20 2024-02-19T18:54:28.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.292+0000 7f1051d9b700 1 -- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f10400384e0 msgr2=0x7f104003a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3727775990 2024-02-19T18:54:28.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.292+0000 7f1051d9b700 1 --2- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f10400384e0 0x7f104003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:54:28.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.300+0000 7f104b7fe700 1 -- 172.21.15.142:0/4040603943 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f104c01d480 con 0x7f10540ffe20 2024-02-19T18:54:28.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.493+0000 7f1051d9b700 1 -- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f10400384e0 msgr2=0x7f104003a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3727775990 2024-02-19T18:54:28.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.493+0000 7f1051d9b700 1 --2- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f10400384e0 0x7f104003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:54:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.568+0000 7f1058d12700 1 -- 172.21.15.142:0/4040603943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f10541008b0 con 0x7f10540ffe20 2024-02-19T18:54:28.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.569+0000 7f104b7fe700 1 -- 172.21.15.142:0/4040603943 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f10541008b0 con 0x7f10540ffe20 2024-02-19T18:54:28.586 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:28.586 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.571+0000 7f1058d12700 1 -- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f10400384e0 msgr2=0x7f104003a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:54:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.571+0000 7f1058d12700 1 --2- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f10400384e0 0x7f104003a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.571+0000 7f1058d12700 1 -- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10540ffe20 msgr2=0x7f1054074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.571+0000 7f1058d12700 1 --2- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10540ffe20 0x7f1054074af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f104c015040 tx=0x7f104c00bb10 comp rx=0 tx=0).stop 2024-02-19T18:54:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.571+0000 7f1058d12700 1 -- 172.21.15.142:0/4040603943 shutdown_connections 2024-02-19T18:54:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.571+0000 7f1058d12700 1 --2- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f10400384e0 0x7f104003a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:28.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.571+0000 7f1058d12700 1 --2- 172.21.15.142:0/4040603943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10540ffe20 0x7f1054074af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.571+0000 7f1058d12700 1 -- 172.21.15.142:0/4040603943 >> 172.21.15.142:0/4040603943 conn(0x7f10540fb3d0 msgr2=0x7f10540fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.571+0000 7f1058d12700 1 -- 172.21.15.142:0/4040603943 shutdown_connections 2024-02-19T18:54:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:28.571+0000 7f1058d12700 1 -- 172.21.15.142:0/4040603943 wait complete. 2024-02-19T18:54:28.589 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:29.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:28 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/4040603943' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:30.165 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:30.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:30.367 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:30.412 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:31.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.784+0000 7f130d2ba700 1 -- 172.21.15.142:0/1148418178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13080ffe30 msgr2=0x7f1308100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:31.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.784+0000 7f130d2ba700 1 --2- 172.21.15.142:0/1148418178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13080ffe30 0x7f1308100240 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009910 tx=0x7f12f8009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:31.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.784+0000 7f130d2ba700 1 -- 172.21.15.142:0/1148418178 shutdown_connections 2024-02-19T18:54:31.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.784+0000 7f130d2ba700 1 --2- 172.21.15.142:0/1148418178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13080ffe30 0x7f1308100240 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:31.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.784+0000 7f130d2ba700 1 -- 172.21.15.142:0/1148418178 >> 172.21.15.142:0/1148418178 conn(0x7f13080fb3c0 msgr2=0x7f13080fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:31.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.784+0000 7f130d2ba700 1 -- 172.21.15.142:0/1148418178 shutdown_connections 2024-02-19T18:54:31.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.784+0000 7f130d2ba700 1 -- 172.21.15.142:0/1148418178 wait complete. 2024-02-19T18:54:31.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.785+0000 7f130d2ba700 1 Processor -- start 2024-02-19T18:54:31.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.785+0000 7f130d2ba700 1 -- start start 2024-02-19T18:54:31.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.785+0000 7f130d2ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13080ffe30 0x7f1308194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:31.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.785+0000 7f130d2ba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13081954c0 con 0x7f13080ffe30 2024-02-19T18:54:31.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.785+0000 7f1306ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13080ffe30 0x7f1308194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:31.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.785+0000 7f1306ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13080ffe30 0x7f1308194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:55258/0 (socket says 172.21.15.142:55258) 2024-02-19T18:54:31.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.785+0000 7f1306ffd700 1 -- 172.21.15.142:0/2438482830 learned_addr learned my addr 172.21.15.142:0/2438482830 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:31.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.786+0000 7f1306ffd700 1 -- 172.21.15.142:0/2438482830 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80095f0 con 0x7f13080ffe30 2024-02-19T18:54:31.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.786+0000 7f1306ffd700 1 --2- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13080ffe30 0x7f1308194f80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f12f80092e0 tx=0x7f12f8009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:31.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.786+0000 7f1304ff9700 1 -- 172.21.15.142:0/2438482830 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12f801d070 con 0x7f13080ffe30 2024-02-19T18:54:31.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.786+0000 7f130d2ba700 1 -- 172.21.15.142:0/2438482830 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13081956c0 con 0x7f13080ffe30 2024-02-19T18:54:31.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.786+0000 7f1304ff9700 1 -- 172.21.15.142:0/2438482830 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f12f800be10 con 0x7f13080ffe30 2024-02-19T18:54:31.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.786+0000 7f1304ff9700 1 -- 172.21.15.142:0/2438482830 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12f800f460 con 0x7f13080ffe30 2024-02-19T18:54:31.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.786+0000 7f130d2ba700 1 -- 172.21.15.142:0/2438482830 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1308195b60 con 0x7f13080ffe30 2024-02-19T18:54:31.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.787+0000 7f1304ff9700 1 -- 172.21.15.142:0/2438482830 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f12f800b960 con 0x7f13080ffe30 2024-02-19T18:54:31.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.787+0000 7f130d2ba700 1 -- 172.21.15.142:0/2438482830 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130818ea90 con 0x7f13080ffe30 2024-02-19T18:54:31.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.787+0000 7f1304ff9700 1 --2- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f12f4038530 0x7f12f403a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:31.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.787+0000 7f1304ff9700 1 -- 172.21.15.142:0/2438482830 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f12f804c300 con 0x7f13080ffe30 2024-02-19T18:54:31.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.787+0000 7f12fe7fc700 1 -- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f12f4038530 msgr2=0x7f12f403a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3727775990 2024-02-19T18:54:31.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.787+0000 7f12fe7fc700 1 --2- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f12f4038530 0x7f12f403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:54:31.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.792+0000 7f1304ff9700 1 -- 172.21.15.142:0/2438482830 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f12f8022790 con 0x7f13080ffe30 2024-02-19T18:54:32.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.988+0000 7f12fe7fc700 1 -- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f12f4038530 msgr2=0x7f12f403a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/3727775990 2024-02-19T18:54:32.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:31.988+0000 7f12fe7fc700 1 --2- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f12f4038530 0x7f12f403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:54:32.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.057+0000 7f130d2ba700 1 -- 172.21.15.142:0/2438482830 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f130802cc30 con 0x7f13080ffe30 2024-02-19T18:54:32.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.057+0000 7f1304ff9700 1 -- 172.21.15.142:0/2438482830 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f12f8027070 con 0x7f13080ffe30 2024-02-19T18:54:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:32.074 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:32.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.060+0000 7f130d2ba700 1 -- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f12f4038530 msgr2=0x7f12f403a9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:54:32.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.060+0000 7f130d2ba700 1 --2- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f12f4038530 0x7f12f403a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:32.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.060+0000 7f130d2ba700 1 -- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13080ffe30 msgr2=0x7f1308194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:32.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.060+0000 7f130d2ba700 1 --2- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13080ffe30 0x7f1308194f80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f12f80092e0 tx=0x7f12f8009e60 comp rx=0 tx=0).stop 2024-02-19T18:54:32.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.060+0000 7f130d2ba700 1 -- 172.21.15.142:0/2438482830 shutdown_connections 2024-02-19T18:54:32.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.060+0000 7f130d2ba700 1 --2- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:6800/3727775990,v1:172.21.15.46:6801/3727775990] conn(0x7f12f4038530 0x7f12f403a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:32.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.060+0000 7f130d2ba700 1 --2- 172.21.15.142:0/2438482830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13080ffe30 0x7f1308194f80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:32.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.060+0000 7f130d2ba700 1 -- 172.21.15.142:0/2438482830 >> 172.21.15.142:0/2438482830 conn(0x7f13080fb3c0 msgr2=0x7f13080fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:32.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.060+0000 7f130d2ba700 1 -- 172.21.15.142:0/2438482830 shutdown_connections 2024-02-19T18:54:32.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:32.060+0000 7f130d2ba700 1 -- 172.21.15.142:0/2438482830 wait complete. 2024-02-19T18:54:32.077 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:32.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:32 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/2438482830' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:33.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: Active manager daemon smithi046.qtceex restarted 2024-02-19T18:54:33.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: Activating manager daemon smithi046.qtceex 2024-02-19T18:54:33.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: osdmap e5: 0 total, 0 up, 0 in 2024-02-19T18:54:33.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: mgrmap e15: smithi046.qtceex(active, starting, since 0.00443751s) 2024-02-19T18:54:33.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi046.qtceex", "id": "smithi046.qtceex"}]: dispatch 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: Manager daemon smithi046.qtceex is now available 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/mirror_snapshot_schedule"}]: dispatch 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/trash_purge_schedule"}]: dispatch 2024-02-19T18:54:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:33.675 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:33.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:33.869 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:33.917 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:34.518 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:34 smithi046 ceph-mon[29647]: [19/Feb/2024:18:54:33] ENGINE Bus STARTING 2024-02-19T18:54:34.518 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:34 smithi046 ceph-mon[29647]: mgrmap e16: smithi046.qtceex(active, since 1.00855s) 2024-02-19T18:54:34.518 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:34 smithi046 ceph-mon[29647]: [19/Feb/2024:18:54:33] ENGINE Serving on http://172.21.15.46:8765 2024-02-19T18:54:34.518 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:34 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:34.518 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:34 smithi046 ceph-mon[29647]: [19/Feb/2024:18:54:33] ENGINE Serving on https://172.21.15.46:7150 2024-02-19T18:54:34.518 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:34 smithi046 ceph-mon[29647]: [19/Feb/2024:18:54:33] ENGINE Bus STARTED 2024-02-19T18:54:34.519 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:34 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:35.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.408+0000 7f93ba2f0700 1 -- 172.21.15.142:0/1925997334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93b41008b0 msgr2=0x7f93b4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:35.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.408+0000 7f93ba2f0700 1 --2- 172.21.15.142:0/1925997334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93b41008b0 0x7f93b4102c90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009910 tx=0x7f93a4009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:35.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.408+0000 7f93ba2f0700 1 -- 172.21.15.142:0/1925997334 shutdown_connections 2024-02-19T18:54:35.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.408+0000 7f93ba2f0700 1 --2- 172.21.15.142:0/1925997334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93b41008b0 0x7f93b4102c90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:35.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.408+0000 7f93ba2f0700 1 -- 172.21.15.142:0/1925997334 >> 172.21.15.142:0/1925997334 conn(0x7f93b40fa2b0 msgr2=0x7f93b40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:35.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.408+0000 7f93ba2f0700 1 -- 172.21.15.142:0/1925997334 shutdown_connections 2024-02-19T18:54:35.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.408+0000 7f93ba2f0700 1 -- 172.21.15.142:0/1925997334 wait complete. 2024-02-19T18:54:35.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.409+0000 7f93ba2f0700 1 Processor -- start 2024-02-19T18:54:35.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.409+0000 7f93ba2f0700 1 -- start start 2024-02-19T18:54:35.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.409+0000 7f93ba2f0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93b41008b0 0x7f93b4194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:35.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.409+0000 7f93ba2f0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4195490 con 0x7f93b41008b0 2024-02-19T18:54:35.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.409+0000 7f93b3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93b41008b0 0x7f93b4194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:35.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.409+0000 7f93b3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93b41008b0 0x7f93b4194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:49156/0 (socket says 172.21.15.142:49156) 2024-02-19T18:54:35.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.409+0000 7f93b3fff700 1 -- 172.21.15.142:0/3275708248 learned_addr learned my addr 172.21.15.142:0/3275708248 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:35.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.410+0000 7f93b3fff700 1 -- 172.21.15.142:0/3275708248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a40095f0 con 0x7f93b41008b0 2024-02-19T18:54:35.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.410+0000 7f93b3fff700 1 --2- 172.21.15.142:0/3275708248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93b41008b0 0x7f93b4194f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f93a40092e0 tx=0x7f93a4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:35.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.410+0000 7f93b17fa700 1 -- 172.21.15.142:0/3275708248 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93a401d070 con 0x7f93b41008b0 2024-02-19T18:54:35.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.410+0000 7f93ba2f0700 1 -- 172.21.15.142:0/3275708248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b4195690 con 0x7f93b41008b0 2024-02-19T18:54:35.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.410+0000 7f93b17fa700 1 -- 172.21.15.142:0/3275708248 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f93a400be10 con 0x7f93b41008b0 2024-02-19T18:54:35.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.410+0000 7f93b17fa700 1 -- 172.21.15.142:0/3275708248 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f93a400f460 con 0x7f93b41008b0 2024-02-19T18:54:35.428 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.410+0000 7f93ba2f0700 1 -- 172.21.15.142:0/3275708248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b4195b30 con 0x7f93b41008b0 2024-02-19T18:54:35.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.411+0000 7f93b17fa700 1 -- 172.21.15.142:0/3275708248 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f93a400b960 con 0x7f93b41008b0 2024-02-19T18:54:35.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.411+0000 7f93ba2f0700 1 -- 172.21.15.142:0/3275708248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b418eb00 con 0x7f93b41008b0 2024-02-19T18:54:35.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.411+0000 7f93b17fa700 1 --2- 172.21.15.142:0/3275708248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f939c038580 0x7f939c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:35.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.411+0000 7f93b17fa700 1 -- 172.21.15.142:0/3275708248 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f93a404c780 con 0x7f93b41008b0 2024-02-19T18:54:35.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.411+0000 7f93b37fe700 1 --2- 172.21.15.142:0/3275708248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f939c038580 0x7f939c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:35.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.412+0000 7f93b37fe700 1 --2- 172.21.15.142:0/3275708248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f939c038580 0x7f939c03aa30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f93a8006fd0 tx=0x7f93a8006e40 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:35.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.418+0000 7f93b17fa700 1 -- 172.21.15.142:0/3275708248 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f93a4005c00 con 0x7f93b41008b0 2024-02-19T18:54:35.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.698+0000 7f93ba2f0700 1 -- 172.21.15.142:0/3275708248 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f93b402cc30 con 0x7f93b41008b0 2024-02-19T18:54:35.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.698+0000 7f93b17fa700 1 -- 172.21.15.142:0/3275708248 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f93a4027070 con 0x7f93b41008b0 2024-02-19T18:54:35.715 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:35.715 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:35.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.700+0000 7f93ba2f0700 1 -- 172.21.15.142:0/3275708248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f939c038580 msgr2=0x7f939c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.700+0000 7f93ba2f0700 1 --2- 172.21.15.142:0/3275708248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f939c038580 0x7f939c03aa30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f93a8006fd0 tx=0x7f93a8006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.701+0000 7f93ba2f0700 1 -- 172.21.15.142:0/3275708248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93b41008b0 msgr2=0x7f93b4194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.701+0000 7f93ba2f0700 1 --2- 172.21.15.142:0/3275708248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93b41008b0 0x7f93b4194f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f93a40092e0 tx=0x7f93a4009e60 comp rx=0 tx=0).stop 2024-02-19T18:54:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.701+0000 7f93ba2f0700 1 -- 172.21.15.142:0/3275708248 shutdown_connections 2024-02-19T18:54:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.701+0000 7f93ba2f0700 1 --2- 172.21.15.142:0/3275708248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f939c038580 0x7f939c03aa30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.701+0000 7f93ba2f0700 1 --2- 172.21.15.142:0/3275708248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93b41008b0 0x7f93b4194f50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.701+0000 7f93ba2f0700 1 -- 172.21.15.142:0/3275708248 >> 172.21.15.142:0/3275708248 conn(0x7f93b40fa2b0 msgr2=0x7f93b40faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.701+0000 7f93ba2f0700 1 -- 172.21.15.142:0/3275708248 shutdown_connections 2024-02-19T18:54:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:35.701+0000 7f93ba2f0700 1 -- 172.21.15.142:0/3275708248 wait complete. 2024-02-19T18:54:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:36.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:36 smithi046 ceph-mon[29647]: mgrmap e17: smithi046.qtceex(active, since 3s) 2024-02-19T18:54:36.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:36 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/3275708248' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:36.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:36 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:36.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:36 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:38.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:37 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:38.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:37 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:38.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:37 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:54:38.098 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:38.098 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:38.524 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:38.571 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:54:39.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: Updating smithi046:/etc/ceph/ceph.conf 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: Updating smithi142:/etc/ceph/ceph.conf 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:54:39.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T18:54:39.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:39 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:54:40.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.214+0000 7f90fd11c700 1 -- 172.21.15.142:0/3752908264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f80ff030 msgr2=0x7f90f80ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:40.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.214+0000 7f90fd11c700 1 --2- 172.21.15.142:0/3752908264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f80ff030 0x7f90f80ff400 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009910 tx=0x7f90ec009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:40.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.214+0000 7f90fd11c700 1 -- 172.21.15.142:0/3752908264 shutdown_connections 2024-02-19T18:54:40.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.214+0000 7f90fd11c700 1 --2- 172.21.15.142:0/3752908264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f80ff030 0x7f90f80ff400 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:40.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.214+0000 7f90fd11c700 1 -- 172.21.15.142:0/3752908264 >> 172.21.15.142:0/3752908264 conn(0x7f90f80fa8f0 msgr2=0x7f90f80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:40.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.214+0000 7f90fd11c700 1 -- 172.21.15.142:0/3752908264 shutdown_connections 2024-02-19T18:54:40.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.214+0000 7f90fd11c700 1 -- 172.21.15.142:0/3752908264 wait complete. 2024-02-19T18:54:40.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.215+0000 7f90fd11c700 1 Processor -- start 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.215+0000 7f90fd11c700 1 -- start start 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.215+0000 7f90fd11c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f80ff030 0x7f90f81961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.215+0000 7f90fd11c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f81966e0 con 0x7f90f80ff030 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.216+0000 7f90f6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f80ff030 0x7f90f81961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.216+0000 7f90f6d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f80ff030 0x7f90f81961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:49180/0 (socket says 172.21.15.142:49180) 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.216+0000 7f90f6d9d700 1 -- 172.21.15.142:0/1548994669 learned_addr learned my addr 172.21.15.142:0/1548994669 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.216+0000 7f90f6d9d700 1 -- 172.21.15.142:0/1548994669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0095f0 con 0x7f90f80ff030 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.216+0000 7f90f6d9d700 1 --2- 172.21.15.142:0/1548994669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f80ff030 0x7f90f81961a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f90ec005b40 tx=0x7f90ec004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.216+0000 7f90dffff700 1 -- 172.21.15.142:0/1548994669 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90ec01d070 con 0x7f90f80ff030 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.216+0000 7f90fd11c700 1 -- 172.21.15.142:0/1548994669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f81968e0 con 0x7f90f80ff030 2024-02-19T18:54:40.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.216+0000 7f90dffff700 1 -- 172.21.15.142:0/1548994669 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f90ec0044d0 con 0x7f90f80ff030 2024-02-19T18:54:40.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.216+0000 7f90dffff700 1 -- 172.21.15.142:0/1548994669 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90ec003930 con 0x7f90f80ff030 2024-02-19T18:54:40.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.216+0000 7f90fd11c700 1 -- 172.21.15.142:0/1548994669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f8196ca0 con 0x7f90f80ff030 2024-02-19T18:54:40.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.217+0000 7f90dffff700 1 -- 172.21.15.142:0/1548994669 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f90ec003bf0 con 0x7f90f80ff030 2024-02-19T18:54:40.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.217+0000 7f90fd11c700 1 -- 172.21.15.142:0/1548994669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f81072b0 con 0x7f90f80ff030 2024-02-19T18:54:40.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.217+0000 7f90dffff700 1 --2- 172.21.15.142:0/1548994669 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f90e0038580 0x7f90e003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:40.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.218+0000 7f90dffff700 1 -- 172.21.15.142:0/1548994669 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f90ec04c4c0 con 0x7f90f80ff030 2024-02-19T18:54:40.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.218+0000 7f90f659c700 1 --2- 172.21.15.142:0/1548994669 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f90e0038580 0x7f90e003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:40.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.218+0000 7f90f659c700 1 --2- 172.21.15.142:0/1548994669 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f90e0038580 0x7f90e003aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f90e8006fd0 tx=0x7f90e8006e40 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:40.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.223+0000 7f90dffff700 1 -- 172.21.15.142:0/1548994669 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f90ec02a540 con 0x7f90f80ff030 2024-02-19T18:54:40.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.505+0000 7f90fd11c700 1 -- 172.21.15.142:0/1548994669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f90f8068e30 con 0x7f90f80ff030 2024-02-19T18:54:40.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.506+0000 7f90dffff700 1 -- 172.21.15.142:0/1548994669 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f90ec02a360 con 0x7f90f80ff030 2024-02-19T18:54:40.523 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:40.523 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.508+0000 7f90fd11c700 1 -- 172.21.15.142:0/1548994669 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f90e0038580 msgr2=0x7f90e003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.508+0000 7f90fd11c700 1 --2- 172.21.15.142:0/1548994669 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f90e0038580 0x7f90e003aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f90e8006fd0 tx=0x7f90e8006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.508+0000 7f90fd11c700 1 -- 172.21.15.142:0/1548994669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f80ff030 msgr2=0x7f90f81961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.508+0000 7f90fd11c700 1 --2- 172.21.15.142:0/1548994669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f80ff030 0x7f90f81961a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f90ec005b40 tx=0x7f90ec004c80 comp rx=0 tx=0).stop 2024-02-19T18:54:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.508+0000 7f90fd11c700 1 -- 172.21.15.142:0/1548994669 shutdown_connections 2024-02-19T18:54:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.508+0000 7f90fd11c700 1 --2- 172.21.15.142:0/1548994669 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f90e0038580 0x7f90e003aa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.508+0000 7f90fd11c700 1 --2- 172.21.15.142:0/1548994669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90f80ff030 0x7f90f81961a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.508+0000 7f90fd11c700 1 -- 172.21.15.142:0/1548994669 >> 172.21.15.142:0/1548994669 conn(0x7f90f80fa8f0 msgr2=0x7f90f8103210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.508+0000 7f90fd11c700 1 -- 172.21.15.142:0/1548994669 shutdown_connections 2024-02-19T18:54:40.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:40.508+0000 7f90fd11c700 1 -- 172.21.15.142:0/1548994669 wait complete. 2024-02-19T18:54:40.526 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:41.300 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:40 smithi046 ceph-mon[29647]: Deploying daemon ceph-exporter.smithi142 on smithi142 2024-02-19T18:54:41.300 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:40 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1548994669' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:42.990 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:42.990 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:43.986 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:54:44.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:44.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:44.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:44.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:44.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:54:44.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-19T18:54:44.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:54:44.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:43 smithi046 ceph-mon[29647]: Deploying daemon crash.smithi142 on smithi142 2024-02-19T18:54:46.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.002+0000 7fe73b7e9700 1 -- 172.21.15.142:0/2761092574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7340ffda0 msgr2=0x7fe734100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:46.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.002+0000 7fe73b7e9700 1 --2- 172.21.15.142:0/2761092574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7340ffda0 0x7fe734100170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe730009910 tx=0x7fe730009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:46.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.002+0000 7fe73b7e9700 1 -- 172.21.15.142:0/2761092574 shutdown_connections 2024-02-19T18:54:46.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.002+0000 7fe73b7e9700 1 --2- 172.21.15.142:0/2761092574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7340ffda0 0x7fe734100170 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:46.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.002+0000 7fe73b7e9700 1 -- 172.21.15.142:0/2761092574 >> 172.21.15.142:0/2761092574 conn(0x7fe734075750 msgr2=0x7fe734075b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:46.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.002+0000 7fe73b7e9700 1 -- 172.21.15.142:0/2761092574 shutdown_connections 2024-02-19T18:54:46.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.002+0000 7fe73b7e9700 1 -- 172.21.15.142:0/2761092574 wait complete. 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.003+0000 7fe73b7e9700 1 Processor -- start 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.003+0000 7fe73b7e9700 1 -- start start 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.003+0000 7fe73b7e9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7340ffda0 0x7fe7341942a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.003+0000 7fe73b7e9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7341947e0 con 0x7fe7340ffda0 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.003+0000 7fe739585700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7340ffda0 0x7fe7341942a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.003+0000 7fe739585700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7340ffda0 0x7fe7341942a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:36342/0 (socket says 172.21.15.142:36342) 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.003+0000 7fe739585700 1 -- 172.21.15.142:0/1499687420 learned_addr learned my addr 172.21.15.142:0/1499687420 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.004+0000 7fe739585700 1 -- 172.21.15.142:0/1499687420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7300095f0 con 0x7fe7340ffda0 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.004+0000 7fe739585700 1 --2- 172.21.15.142:0/1499687420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7340ffda0 0x7fe7341942a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe730005b40 tx=0x7fe730004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.004+0000 7fe72a7fc700 1 -- 172.21.15.142:0/1499687420 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe73001d070 con 0x7fe7340ffda0 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.004+0000 7fe73b7e9700 1 -- 172.21.15.142:0/1499687420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7341949e0 con 0x7fe7340ffda0 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.004+0000 7fe72a7fc700 1 -- 172.21.15.142:0/1499687420 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe7300044d0 con 0x7fe7340ffda0 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.004+0000 7fe72a7fc700 1 -- 172.21.15.142:0/1499687420 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe730003950 con 0x7fe7340ffda0 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.004+0000 7fe73b7e9700 1 -- 172.21.15.142:0/1499687420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe734194da0 con 0x7fe7340ffda0 2024-02-19T18:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.005+0000 7fe73b7e9700 1 -- 172.21.15.142:0/1499687420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe734062380 con 0x7fe7340ffda0 2024-02-19T18:54:46.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.005+0000 7fe72a7fc700 1 -- 172.21.15.142:0/1499687420 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fe730003c10 con 0x7fe7340ffda0 2024-02-19T18:54:46.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.005+0000 7fe72a7fc700 1 --2- 172.21.15.142:0/1499687420 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe720038580 0x7fe72003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:46.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.005+0000 7fe72a7fc700 1 -- 172.21.15.142:0/1499687420 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe73004c2e0 con 0x7fe7340ffda0 2024-02-19T18:54:46.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.006+0000 7fe738d84700 1 --2- 172.21.15.142:0/1499687420 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe720038580 0x7fe72003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:46.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.006+0000 7fe738d84700 1 --2- 172.21.15.142:0/1499687420 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe720038580 0x7fe72003aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe724006fd0 tx=0x7fe724006e40 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:46.027 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.011+0000 7fe72a7fc700 1 -- 172.21.15.142:0/1499687420 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe73002a540 con 0x7fe7340ffda0 2024-02-19T18:54:46.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.309+0000 7fe73b7e9700 1 -- 172.21.15.142:0/1499687420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe734103e20 con 0x7fe7340ffda0 2024-02-19T18:54:46.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.310+0000 7fe72a7fc700 1 -- 172.21.15.142:0/1499687420 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe73002a360 con 0x7fe7340ffda0 2024-02-19T18:54:46.327 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:46.328 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.312+0000 7fe73b7e9700 1 -- 172.21.15.142:0/1499687420 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe720038580 msgr2=0x7fe72003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.312+0000 7fe73b7e9700 1 --2- 172.21.15.142:0/1499687420 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe720038580 0x7fe72003aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe724006fd0 tx=0x7fe724006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.312+0000 7fe73b7e9700 1 -- 172.21.15.142:0/1499687420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7340ffda0 msgr2=0x7fe7341942a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.312+0000 7fe73b7e9700 1 --2- 172.21.15.142:0/1499687420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7340ffda0 0x7fe7341942a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe730005b40 tx=0x7fe730004c80 comp rx=0 tx=0).stop 2024-02-19T18:54:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.312+0000 7fe73b7e9700 1 -- 172.21.15.142:0/1499687420 shutdown_connections 2024-02-19T18:54:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.312+0000 7fe73b7e9700 1 --2- 172.21.15.142:0/1499687420 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe720038580 0x7fe72003aa30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:46.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.312+0000 7fe73b7e9700 1 --2- 172.21.15.142:0/1499687420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7340ffda0 0x7fe7341942a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.312+0000 7fe73b7e9700 1 -- 172.21.15.142:0/1499687420 >> 172.21.15.142:0/1499687420 conn(0x7fe734075750 msgr2=0x7fe7340fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.312+0000 7fe73b7e9700 1 -- 172.21.15.142:0/1499687420 shutdown_connections 2024-02-19T18:54:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:46.312+0000 7fe73b7e9700 1 -- 172.21.15.142:0/1499687420 wait complete. 2024-02-19T18:54:46.330 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:47.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:47.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:47.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:47.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:47.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:46 smithi046 ceph-mon[29647]: Deploying daemon node-exporter.smithi142 on smithi142 2024-02-19T18:54:47.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:46 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1499687420' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:47.906 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:47.906 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:48.111 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:54:48.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:48.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:54:49.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.918+0000 7f5ddd540700 1 -- 172.21.15.142:0/1878952802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dd8101090 msgr2=0x7f5dd8101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:49.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.918+0000 7f5ddd540700 1 --2- 172.21.15.142:0/1878952802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dd8101090 0x7f5dd8101460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8009910 tx=0x7f5dc8009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.918+0000 7f5ddd540700 1 -- 172.21.15.142:0/1878952802 shutdown_connections 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.918+0000 7f5ddd540700 1 --2- 172.21.15.142:0/1878952802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dd8101090 0x7f5dd8101460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.918+0000 7f5ddd540700 1 -- 172.21.15.142:0/1878952802 >> 172.21.15.142:0/1878952802 conn(0x7f5dd80fa890 msgr2=0x7f5dd80fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.918+0000 7f5ddd540700 1 -- 172.21.15.142:0/1878952802 shutdown_connections 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.918+0000 7f5ddd540700 1 -- 172.21.15.142:0/1878952802 wait complete. 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.919+0000 7f5ddd540700 1 Processor -- start 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.919+0000 7f5ddd540700 1 -- start start 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.919+0000 7f5ddd540700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dd8101090 0x7f5dd8197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.919+0000 7f5ddd540700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd8197ad0 con 0x7f5dd8101090 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.919+0000 7f5dd6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dd8101090 0x7f5dd8197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.919+0000 7f5dd6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dd8101090 0x7f5dd8197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:36362/0 (socket says 172.21.15.142:36362) 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.919+0000 7f5dd6ffd700 1 -- 172.21.15.142:0/1789411858 learned_addr learned my addr 172.21.15.142:0/1789411858 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:49.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.920+0000 7f5dd6ffd700 1 -- 172.21.15.142:0/1789411858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc80095f0 con 0x7f5dd8101090 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.920+0000 7f5dd6ffd700 1 --2- 172.21.15.142:0/1789411858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dd8101090 0x7f5dd8197590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8005b40 tx=0x7f5dc8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.920+0000 7f5dbffff700 1 -- 172.21.15.142:0/1789411858 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5dc801d070 con 0x7f5dd8101090 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.920+0000 7f5dbffff700 1 -- 172.21.15.142:0/1789411858 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5dc80044d0 con 0x7f5dd8101090 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.920+0000 7f5ddd540700 1 -- 172.21.15.142:0/1789411858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd8197cd0 con 0x7f5dd8101090 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.920+0000 7f5dbffff700 1 -- 172.21.15.142:0/1789411858 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5dc8003930 con 0x7f5dd8101090 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.920+0000 7f5ddd540700 1 -- 172.21.15.142:0/1789411858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd8198090 con 0x7f5dd8101090 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.921+0000 7f5dbffff700 1 -- 172.21.15.142:0/1789411858 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f5dc8003bf0 con 0x7f5dd8101090 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.921+0000 7f5ddd540700 1 -- 172.21.15.142:0/1789411858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd8062380 con 0x7f5dd8101090 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.921+0000 7f5dbffff700 1 --2- 172.21.15.142:0/1789411858 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5dc0038580 0x7f5dc003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.921+0000 7f5dbffff700 1 -- 172.21.15.142:0/1789411858 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f5dc804c420 con 0x7f5dd8101090 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.922+0000 7f5dd67fc700 1 --2- 172.21.15.142:0/1789411858 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5dc0038580 0x7f5dc003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.922+0000 7f5dd67fc700 1 --2- 172.21.15.142:0/1789411858 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5dc0038580 0x7f5dc003aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc006fd0 tx=0x7f5dcc006e40 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:49.926+0000 7f5dbffff700 1 -- 172.21.15.142:0/1789411858 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5dc802a540 con 0x7f5dd8101090 2024-02-19T18:54:50.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.196+0000 7f5ddd540700 1 -- 172.21.15.142:0/1789411858 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5dd819c080 con 0x7f5dd8101090 2024-02-19T18:54:50.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.197+0000 7f5dbffff700 1 -- 172.21.15.142:0/1789411858 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f5dc802a360 con 0x7f5dd8101090 2024-02-19T18:54:50.213 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:50.213 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:50.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.198+0000 7f5ddd540700 1 -- 172.21.15.142:0/1789411858 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5dc0038580 msgr2=0x7f5dc003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.199+0000 7f5ddd540700 1 --2- 172.21.15.142:0/1789411858 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5dc0038580 0x7f5dc003aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc006fd0 tx=0x7f5dcc006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.199+0000 7f5ddd540700 1 -- 172.21.15.142:0/1789411858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dd8101090 msgr2=0x7f5dd8197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.199+0000 7f5ddd540700 1 --2- 172.21.15.142:0/1789411858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dd8101090 0x7f5dd8197590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8005b40 tx=0x7f5dc8004c80 comp rx=0 tx=0).stop 2024-02-19T18:54:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.199+0000 7f5ddd540700 1 -- 172.21.15.142:0/1789411858 shutdown_connections 2024-02-19T18:54:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.199+0000 7f5ddd540700 1 --2- 172.21.15.142:0/1789411858 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5dc0038580 0x7f5dc003aa30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.199+0000 7f5ddd540700 1 --2- 172.21.15.142:0/1789411858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5dd8101090 0x7f5dd8197590 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.199+0000 7f5ddd540700 1 -- 172.21.15.142:0/1789411858 >> 172.21.15.142:0/1789411858 conn(0x7f5dd80fa890 msgr2=0x7f5dd8106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.199+0000 7f5ddd540700 1 -- 172.21.15.142:0/1789411858 shutdown_connections 2024-02-19T18:54:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:50.199+0000 7f5ddd540700 1 -- 172.21.15.142:0/1789411858 wait complete. 2024-02-19T18:54:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:51.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:50 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1789411858' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:52.681 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:52.682 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:53.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:53.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:53.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:53.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:53.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:53.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.fwekwv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:54:53.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.fwekwv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-19T18:54:53.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:54:53.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:54:53.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: Deploying daemon mgr.smithi142.fwekwv on smithi142 2024-02-19T18:54:53.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:53.647 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:54:55.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.387+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/3808024985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b4100ec0 msgr2=0x7fc1b4101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:55.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.387+0000 7fc1bb3fb700 1 --2- 172.21.15.142:0/3808024985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b4100ec0 0x7fc1b4101290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009910 tx=0x7fc1b0009c20 comp rx=0 tx=0).stop 2024-02-19T18:54:55.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.387+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/3808024985 shutdown_connections 2024-02-19T18:54:55.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.387+0000 7fc1bb3fb700 1 --2- 172.21.15.142:0/3808024985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b4100ec0 0x7fc1b4101290 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:55.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.387+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/3808024985 >> 172.21.15.142:0/3808024985 conn(0x7fc1b40fa850 msgr2=0x7fc1b40fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:55.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.387+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/3808024985 shutdown_connections 2024-02-19T18:54:55.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.387+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/3808024985 wait complete. 2024-02-19T18:54:55.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.388+0000 7fc1bb3fb700 1 Processor -- start 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.388+0000 7fc1bb3fb700 1 -- start start 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.388+0000 7fc1bb3fb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b4100ec0 0x7fc1b4195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.388+0000 7fc1bb3fb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4195890 con 0x7fc1b4100ec0 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.388+0000 7fc1b9197700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b4100ec0 0x7fc1b4195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.388+0000 7fc1b9197700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b4100ec0 0x7fc1b4195350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:56622/0 (socket says 172.21.15.142:56622) 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.388+0000 7fc1b9197700 1 -- 172.21.15.142:0/1493017141 learned_addr learned my addr 172.21.15.142:0/1493017141 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.389+0000 7fc1b9197700 1 -- 172.21.15.142:0/1493017141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00095f0 con 0x7fc1b4100ec0 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.389+0000 7fc1b9197700 1 --2- 172.21.15.142:0/1493017141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b4100ec0 0x7fc1b4195350 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0005b40 tx=0x7fc1b0004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.389+0000 7fc1aa7fc700 1 -- 172.21.15.142:0/1493017141 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1b001d070 con 0x7fc1b4100ec0 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.389+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/1493017141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b4195a90 con 0x7fc1b4100ec0 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.389+0000 7fc1aa7fc700 1 -- 172.21.15.142:0/1493017141 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc1b00044d0 con 0x7fc1b4100ec0 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.389+0000 7fc1aa7fc700 1 -- 172.21.15.142:0/1493017141 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1b0003930 con 0x7fc1b4100ec0 2024-02-19T18:54:55.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.389+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/1493017141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b4195e50 con 0x7fc1b4100ec0 2024-02-19T18:54:55.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.390+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/1493017141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b4062380 con 0x7fc1b4100ec0 2024-02-19T18:54:55.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.390+0000 7fc1aa7fc700 1 -- 172.21.15.142:0/1493017141 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fc1b0003bf0 con 0x7fc1b4100ec0 2024-02-19T18:54:55.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.390+0000 7fc1aa7fc700 1 --2- 172.21.15.142:0/1493017141 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc1a0038580 0x7fc1a003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:55.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.390+0000 7fc1aa7fc700 1 -- 172.21.15.142:0/1493017141 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc1b004c470 con 0x7fc1b4100ec0 2024-02-19T18:54:55.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.391+0000 7fc1b8996700 1 --2- 172.21.15.142:0/1493017141 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc1a0038580 0x7fc1a003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:55.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.391+0000 7fc1b8996700 1 --2- 172.21.15.142:0/1493017141 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc1a0038580 0x7fc1a003aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4006fd0 tx=0x7fc1a4006e40 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:55.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.395+0000 7fc1aa7fc700 1 -- 172.21.15.142:0/1493017141 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc1b002a950 con 0x7fc1b4100ec0 2024-02-19T18:54:55.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:55 smithi046 ceph-mon[29647]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:55.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.685+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/1493017141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc1b41070c0 con 0x7fc1b4100ec0 2024-02-19T18:54:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.686+0000 7fc1aa7fc700 1 -- 172.21.15.142:0/1493017141 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc1b002a360 con 0x7fc1b4100ec0 2024-02-19T18:54:55.703 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:54:55.703 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:54:55.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.689+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/1493017141 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc1a0038580 msgr2=0x7fc1a003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:55.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.689+0000 7fc1bb3fb700 1 --2- 172.21.15.142:0/1493017141 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc1a0038580 0x7fc1a003aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4006fd0 tx=0x7fc1a4006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:55.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.689+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/1493017141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b4100ec0 msgr2=0x7fc1b4195350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:55.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.689+0000 7fc1bb3fb700 1 --2- 172.21.15.142:0/1493017141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b4100ec0 0x7fc1b4195350 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0005b40 tx=0x7fc1b0004c80 comp rx=0 tx=0).stop 2024-02-19T18:54:55.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.689+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/1493017141 shutdown_connections 2024-02-19T18:54:55.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.689+0000 7fc1bb3fb700 1 --2- 172.21.15.142:0/1493017141 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc1a0038580 0x7fc1a003aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:55.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.689+0000 7fc1bb3fb700 1 --2- 172.21.15.142:0/1493017141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1b4100ec0 0x7fc1b4195350 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:55.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.689+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/1493017141 >> 172.21.15.142:0/1493017141 conn(0x7fc1b40fa850 msgr2=0x7fc1b41046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:55.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.689+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/1493017141 shutdown_connections 2024-02-19T18:54:55.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:54:55.689+0000 7fc1bb3fb700 1 -- 172.21.15.142:0/1493017141 wait complete. 2024-02-19T18:54:55.707 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:54:57.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:57.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:57.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:57.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:57.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:54:57.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:54:57.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:56 smithi046 ceph-mon[29647]: Deploying daemon mon.smithi142 on smithi142 2024-02-19T18:54:57.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:56 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1493017141' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:54:57.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:56 smithi046 ceph-mon[29647]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:54:57.313 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:54:57.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:54:58.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:58 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:54:58.825 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi142/config 2024-02-19T18:54:59.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:54:59 smithi046 ceph-mon[29647]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:00.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.428+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2338536210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d80ff000 msgr2=0x7fd1d80ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:00.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.428+0000 7fd1dd7d7700 1 --2- 172.21.15.142:0/2338536210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d80ff000 0x7fd1d80ff3d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009910 tx=0x7fd1c8009c20 comp rx=0 tx=0).stop 2024-02-19T18:55:00.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.428+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2338536210 shutdown_connections 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.428+0000 7fd1dd7d7700 1 --2- 172.21.15.142:0/2338536210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d80ff000 0x7fd1d80ff3d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.428+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2338536210 >> 172.21.15.142:0/2338536210 conn(0x7fd1d80745b0 msgr2=0x7fd1d80749b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.428+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2338536210 shutdown_connections 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.428+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2338536210 wait complete. 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.429+0000 7fd1dd7d7700 1 Processor -- start 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.429+0000 7fd1dd7d7700 1 -- start start 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.429+0000 7fd1dd7d7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d80ff000 0x7fd1d8195460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.429+0000 7fd1dd7d7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d81959a0 con 0x7fd1d80ff000 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.430+0000 7fd1d6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d80ff000 0x7fd1d8195460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.430+0000 7fd1d6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d80ff000 0x7fd1d8195460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.142:56634/0 (socket says 172.21.15.142:56634) 2024-02-19T18:55:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.430+0000 7fd1d6ffd700 1 -- 172.21.15.142:0/2908848249 learned_addr learned my addr 172.21.15.142:0/2908848249 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.430+0000 7fd1d6ffd700 1 -- 172.21.15.142:0/2908848249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80095f0 con 0x7fd1d80ff000 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.430+0000 7fd1d6ffd700 1 --2- 172.21.15.142:0/2908848249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d80ff000 0x7fd1d8195460 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8005b40 tx=0x7fd1c8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.430+0000 7fd1bffff700 1 -- 172.21.15.142:0/2908848249 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1c801d070 con 0x7fd1d80ff000 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.430+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2908848249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d8195ba0 con 0x7fd1d80ff000 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.430+0000 7fd1bffff700 1 -- 172.21.15.142:0/2908848249 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd1c80044d0 con 0x7fd1d80ff000 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.430+0000 7fd1bffff700 1 -- 172.21.15.142:0/2908848249 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1c8003930 con 0x7fd1d80ff000 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.430+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2908848249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d8195f60 con 0x7fd1d80ff000 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.431+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2908848249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d8062380 con 0x7fd1d80ff000 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.431+0000 7fd1bffff700 1 -- 172.21.15.142:0/2908848249 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fd1c8003bf0 con 0x7fd1d80ff000 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.432+0000 7fd1bffff700 1 --2- 172.21.15.142:0/2908848249 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd1c0038580 0x7fd1c003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.432+0000 7fd1bffff700 1 -- 172.21.15.142:0/2908848249 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd1c804c440 con 0x7fd1d80ff000 2024-02-19T18:55:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.432+0000 7fd1d67fc700 1 --2- 172.21.15.142:0/2908848249 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd1c0038580 0x7fd1c003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.432+0000 7fd1d67fc700 1 --2- 172.21.15.142:0/2908848249 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd1c0038580 0x7fd1c003aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc006fd0 tx=0x7fd1cc006e40 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:00.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.437+0000 7fd1bffff700 1 -- 172.21.15.142:0/2908848249 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd1c802a950 con 0x7fd1d80ff000 2024-02-19T18:55:00.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.717+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2908848249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd1d81075a0 con 0x7fd1d80ff000 2024-02-19T18:55:00.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.718+0000 7fd1bffff700 1 -- 172.21.15.142:0/2908848249 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd1c802a360 con 0x7fd1d80ff000 2024-02-19T18:55:00.735 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:55:00.735 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:51:32.751009Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:55:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.721+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2908848249 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd1c0038580 msgr2=0x7fd1c003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.721+0000 7fd1dd7d7700 1 --2- 172.21.15.142:0/2908848249 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd1c0038580 0x7fd1c003aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc006fd0 tx=0x7fd1cc006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.721+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2908848249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d80ff000 msgr2=0x7fd1d8195460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.721+0000 7fd1dd7d7700 1 --2- 172.21.15.142:0/2908848249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d80ff000 0x7fd1d8195460 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8005b40 tx=0x7fd1c8004c80 comp rx=0 tx=0).stop 2024-02-19T18:55:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.721+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2908848249 shutdown_connections 2024-02-19T18:55:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.721+0000 7fd1dd7d7700 1 --2- 172.21.15.142:0/2908848249 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd1c0038580 0x7fd1c003aa30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.721+0000 7fd1dd7d7700 1 --2- 172.21.15.142:0/2908848249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1d80ff000 0x7fd1d8195460 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:00.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.721+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2908848249 >> 172.21.15.142:0/2908848249 conn(0x7fd1d80745b0 msgr2=0x7fd1d8104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:00.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.721+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2908848249 shutdown_connections 2024-02-19T18:55:00.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:00.721+0000 7fd1dd7d7700 1 -- 172.21.15.142:0/2908848249 wait complete. 2024-02-19T18:55:00.739 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-02-19T18:55:02.685 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:55:02.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:55:02.887 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi142/config 2024-02-19T18:55:06.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:06.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: mon.smithi046 calling monitor election 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/3570808882' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/crt"}]: dispatch 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: mon.smithi142 calling monitor election 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:55:06.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: mon.smithi046 is new leader, mons smithi046,smithi142 in quorum (ranks 0,1) 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: monmap e2: 2 mons at {smithi046=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: fsmap 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: osdmap e5: 0 total, 0 up, 0 in 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: mgrmap e17: smithi046.qtceex(active, since 33s) 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: Standby manager daemon smithi142.fwekwv started 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: overall HEALTH_OK 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/3570808882' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/3570808882' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/key"}]: dispatch 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/3570808882' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:06.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:07.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:06 smithi046 ceph-mon[29647]: mgrmap e18: smithi046.qtceex(active, since 33s), standbys: smithi142.fwekwv 2024-02-19T18:55:07.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:06 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi142.fwekwv", "id": "smithi142.fwekwv"}]: dispatch 2024-02-19T18:55:07.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:06 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:07.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:06 smithi046 ceph-mon[29647]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:07.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:06 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:55:07.383 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:06 smithi142 ceph-mon[37169]: mgrmap e18: smithi046.qtceex(active, since 33s), standbys: smithi142.fwekwv 2024-02-19T18:55:07.383 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:06 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi142.fwekwv", "id": "smithi142.fwekwv"}]: dispatch 2024-02-19T18:55:07.383 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:06 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:07.383 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:06 smithi142 ceph-mon[37169]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:07.383 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:06 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:55:07.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.465+0000 7fbb7755b700 1 -- 172.21.15.142:0/1262670966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb5c0035c0 msgr2=0x7fbb5c005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:07.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.465+0000 7fbb7755b700 1 --2- 172.21.15.142:0/1262670966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb5c0035c0 0x7fbb5c005a40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbb700ffea0 tx=0x7fbb6800feb0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.465+0000 7fbb7755b700 1 -- 172.21.15.142:0/1262670966 shutdown_connections 2024-02-19T18:55:07.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.465+0000 7fbb7755b700 1 --2- 172.21.15.142:0/1262670966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb5c0035c0 0x7fbb5c005a40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.465+0000 7fbb7755b700 1 -- 172.21.15.142:0/1262670966 >> 172.21.15.142:0/1262670966 conn(0x7fbb700fba50 msgr2=0x7fbb700fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:07.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.465+0000 7fbb7755b700 1 -- 172.21.15.142:0/1262670966 shutdown_connections 2024-02-19T18:55:07.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.465+0000 7fbb7755b700 1 -- 172.21.15.142:0/1262670966 wait complete. 2024-02-19T18:55:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.466+0000 7fbb7755b700 1 Processor -- start 2024-02-19T18:55:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.466+0000 7fbb7755b700 1 -- start start 2024-02-19T18:55:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.466+0000 7fbb7755b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb5c0035c0 0x7fbb70073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb7755b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb70073590 0x7fbb70073a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb7755b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb701a17d0 con 0x7fbb70073590 2024-02-19T18:55:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb7755b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb701a1910 con 0x7fbb5c0035c0 2024-02-19T18:55:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb752f7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb5c0035c0 0x7fbb70073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb752f7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb5c0035c0 0x7fbb70073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60226/0 (socket says 172.21.15.142:60226) 2024-02-19T18:55:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb752f7700 1 -- 172.21.15.142:0/2123222843 learned_addr learned my addr 172.21.15.142:0/2123222843 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:55:07.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb752f7700 1 -- 172.21.15.142:0/2123222843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb5c0035c0 msgr2=0x7fbb70073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb74af6700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb70073590 0x7fbb70073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb752f7700 1 -- 172.21.15.142:0/2123222843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb5c0035c0 msgr2=0x7fbb70073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb752f7700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb5c0035c0 0x7fbb70073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb752f7700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb5c0035c0 0x7fbb70073050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb74af6700 1 -- 172.21.15.142:0/2123222843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb5c0035c0 msgr2=0x7fbb70073050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb74af6700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb5c0035c0 0x7fbb70073050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb74af6700 1 -- 172.21.15.142:0/2123222843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6800f900 con 0x7fbb70073590 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb74af6700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb70073590 0x7fbb70073a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000b500 tx=0x7fbb6000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.467+0000 7fbb667fc700 1 -- 172.21.15.142:0/2123222843 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb60011800 con 0x7fbb70073590 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.468+0000 7fbb7755b700 1 -- 172.21.15.142:0/2123222843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb701a1a50 con 0x7fbb70073590 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.468+0000 7fbb667fc700 1 -- 172.21.15.142:0/2123222843 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb60011e10 con 0x7fbb70073590 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.468+0000 7fbb667fc700 1 -- 172.21.15.142:0/2123222843 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb6000f2e0 con 0x7fbb70073590 2024-02-19T18:55:07.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.468+0000 7fbb7755b700 1 -- 172.21.15.142:0/2123222843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb701a1fa0 con 0x7fbb70073590 2024-02-19T18:55:07.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.468+0000 7fbb7755b700 1 -- 172.21.15.142:0/2123222843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb70062380 con 0x7fbb70073590 2024-02-19T18:55:07.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.469+0000 7fbb667fc700 1 -- 172.21.15.142:0/2123222843 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fbb60010380 con 0x7fbb70073590 2024-02-19T18:55:07.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.469+0000 7fbb667fc700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb5406c700 0x7fbb5406ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:07.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.470+0000 7fbb667fc700 1 -- 172.21.15.142:0/2123222843 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fbb60089d20 con 0x7fbb70073590 2024-02-19T18:55:07.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.470+0000 7fbb752f7700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb5406c700 0x7fbb5406ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:07.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.470+0000 7fbb752f7700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb5406c700 0x7fbb5406ebb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb68001eb0 tx=0x7fbb68005960 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:07.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.475+0000 7fbb667fc700 1 -- 172.21.15.142:0/2123222843 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbb600554e0 con 0x7fbb70073590 2024-02-19T18:55:07.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.749+0000 7fbb7755b700 1 -- 172.21.15.142:0/2123222843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbb70074580 con 0x7fbb70073590 2024-02-19T18:55:07.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.749+0000 7fbb667fc700 1 -- 172.21.15.142:0/2123222843 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7fbb600894e0 con 0x7fbb70073590 2024-02-19T18:55:07.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-02-19T18:55:07.766 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":2,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","modified":"2024-02-19T18:55:00.885496Z","created":"2024-02-19T18:51:32.751009Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-19T18:55:07.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.751+0000 7fbb7755b700 1 -- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb5406c700 msgr2=0x7fbb5406ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.751+0000 7fbb7755b700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb5406c700 0x7fbb5406ebb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb68001eb0 tx=0x7fbb68005960 comp rx=0 tx=0).stop 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.751+0000 7fbb7755b700 1 -- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb70073590 msgr2=0x7fbb70073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.751+0000 7fbb7755b700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb70073590 0x7fbb70073a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000b500 tx=0x7fbb6000b8c0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.751+0000 7fbb7755b700 1 -- 172.21.15.142:0/2123222843 shutdown_connections 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.751+0000 7fbb7755b700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb5406c700 0x7fbb5406ebb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.751+0000 7fbb7755b700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb5c0035c0 0x7fbb70073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.751+0000 7fbb7755b700 1 --2- 172.21.15.142:0/2123222843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb70073590 0x7fbb70073a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.751+0000 7fbb7755b700 1 -- 172.21.15.142:0/2123222843 >> 172.21.15.142:0/2123222843 conn(0x7fbb700fba50 msgr2=0x7fbb7018d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.752+0000 7fbb7755b700 1 -- 172.21.15.142:0/2123222843 shutdown_connections 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:55:07.752+0000 7fbb7755b700 1 -- 172.21.15.142:0/2123222843 wait complete. 2024-02-19T18:55:07.769 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 2 2024-02-19T18:55:08.417 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-19T18:55:08.418 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph config generate-minimal-conf 2024-02-19T18:55:08.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:08 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:08.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:08 smithi142 ceph-mon[37169]: from='client.? 172.21.15.142:0/2123222843' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:55:08.447 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:08 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:08.447 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:08 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/2123222843' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:55:08.648 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:55:09.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:09.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T18:55:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:09.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:09.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:55:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:55:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T18:55:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:10.251 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:10 smithi046 ceph-mon[29647]: Updating smithi046:/etc/ceph/ceph.conf 2024-02-19T18:55:10.251 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:10 smithi046 ceph-mon[29647]: Updating smithi142:/etc/ceph/ceph.conf 2024-02-19T18:55:10.251 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:10 smithi046 ceph-mon[29647]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:55:10.251 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:10 smithi046 ceph-mon[29647]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:55:10.251 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:10 smithi046 ceph-mon[29647]: Reconfiguring mon.smithi046 (unknown last config time)... 2024-02-19T18:55:10.251 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:10 smithi046 ceph-mon[29647]: Reconfiguring daemon mon.smithi046 on smithi046 2024-02-19T18:55:10.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.340+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/778806464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e4100090 msgr2=0x7fb9e4100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:10.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.340+0000 7fb9e8e5f700 1 --2- 172.21.15.46:0/778806464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e4100090 0x7fb9e4100460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009910 tx=0x7fb9d4009c20 comp rx=0 tx=0).stop 2024-02-19T18:55:10.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.341+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/778806464 shutdown_connections 2024-02-19T18:55:10.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.341+0000 7fb9e8e5f700 1 --2- 172.21.15.46:0/778806464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e4100090 0x7fb9e4100460 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:10.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.341+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/778806464 >> 172.21.15.46:0/778806464 conn(0x7fb9e40fb970 msgr2=0x7fb9e40fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:10.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.341+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/778806464 shutdown_connections 2024-02-19T18:55:10.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.341+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/778806464 wait complete. 2024-02-19T18:55:10.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.341+0000 7fb9e8e5f700 1 Processor -- start 2024-02-19T18:55:10.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.341+0000 7fb9e8e5f700 1 -- start start 2024-02-19T18:55:10.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e8e5f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e4100090 0x7fb9e41976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e8e5f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e4197c30 0x7fb9e419aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e8e5f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4198240 con 0x7fb9e4197c30 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e8e5f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4198380 con 0x7fb9e4100090 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e1d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e4197c30 0x7fb9e419aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e1d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e4197c30 0x7fb9e419aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51136/0 (socket says 172.21.15.46:51136) 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e1d9b700 1 -- 172.21.15.46:0/2915953471 learned_addr learned my addr 172.21.15.46:0/2915953471 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e259c700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e4100090 0x7fb9e41976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e1d9b700 1 -- 172.21.15.46:0/2915953471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e4100090 msgr2=0x7fb9e41976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e1d9b700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e4100090 0x7fb9e41976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e1d9b700 1 -- 172.21.15.46:0/2915953471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40095f0 con 0x7fb9e4197c30 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e259c700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e4100090 0x7fb9e41976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T18:55:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e1d9b700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e4197c30 0x7fb9e419aff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800b700 tx=0x7fb9d800bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:10.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9d37fe700 1 -- 172.21.15.46:0/2915953471 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9d8011800 con 0x7fb9e4197c30 2024-02-19T18:55:10.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/2915953471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e419b5f0 con 0x7fb9e4197c30 2024-02-19T18:55:10.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9d37fe700 1 -- 172.21.15.46:0/2915953471 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb9d8011e10 con 0x7fb9e4197c30 2024-02-19T18:55:10.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9d37fe700 1 -- 172.21.15.46:0/2915953471 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9d800f2e0 con 0x7fb9e4197c30 2024-02-19T18:55:10.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.342+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/2915953471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e419bb40 con 0x7fb9e4197c30 2024-02-19T18:55:10.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.344+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/2915953471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e4062380 con 0x7fb9e4197c30 2024-02-19T18:55:10.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.344+0000 7fb9d37fe700 1 -- 172.21.15.46:0/2915953471 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fb9d8010380 con 0x7fb9e4197c30 2024-02-19T18:55:10.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.344+0000 7fb9d37fe700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb9cc06c760 0x7fb9cc06ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:10.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.344+0000 7fb9d37fe700 1 -- 172.21.15.46:0/2915953471 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb9d808a4a0 con 0x7fb9e4197c30 2024-02-19T18:55:10.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.344+0000 7fb9e259c700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb9cc06c760 0x7fb9cc06ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:10.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.345+0000 7fb9e259c700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb9cc06c760 0x7fb9cc06ec10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4006010 tx=0x7fb9d400b540 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:10.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.349+0000 7fb9d37fe700 1 -- 172.21.15.46:0/2915953471 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb9d8055c60 con 0x7fb9e4197c30 2024-02-19T18:55:10.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.550+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/2915953471 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb9e41a2370 con 0x7fb9e4197c30 2024-02-19T18:55:10.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.550+0000 7fb9d37fe700 1 -- 172.21.15.46:0/2915953471 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7fb9d8015100 con 0x7fb9e4197c30 2024-02-19T18:55:10.567 INFO:teuthology.orchestra.run.smithi046.stdout:# minimal ceph.conf for c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:55:10.567 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-02-19T18:55:10.567 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T18:55:10.567 INFO:teuthology.orchestra.run.smithi046.stdout: mon_host = [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-02-19T18:55:10.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/2915953471 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb9cc06c760 msgr2=0x7fb9cc06ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:10.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb9cc06c760 0x7fb9cc06ec10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4006010 tx=0x7fb9d400b540 comp rx=0 tx=0).stop 2024-02-19T18:55:10.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/2915953471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e4197c30 msgr2=0x7fb9e419aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:10.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e4197c30 0x7fb9e419aff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800b700 tx=0x7fb9d800bac0 comp rx=0 tx=0).stop 2024-02-19T18:55:10.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/2915953471 shutdown_connections 2024-02-19T18:55:10.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb9cc06c760 0x7fb9cc06ec10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:10.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e4100090 0x7fb9e41976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:10.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 --2- 172.21.15.46:0/2915953471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9e4197c30 0x7fb9e419aff0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:10.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/2915953471 >> 172.21.15.46:0/2915953471 conn(0x7fb9e40fb970 msgr2=0x7fb9e41039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:10.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/2915953471 shutdown_connections 2024-02-19T18:55:10.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:10.552+0000 7fb9e8e5f700 1 -- 172.21.15.46:0/2915953471 wait complete. 2024-02-19T18:55:10.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:10 smithi142 ceph-mon[37169]: Updating smithi046:/etc/ceph/ceph.conf 2024-02-19T18:55:10.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:10 smithi142 ceph-mon[37169]: Updating smithi142:/etc/ceph/ceph.conf 2024-02-19T18:55:10.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:10 smithi142 ceph-mon[37169]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:55:10.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:10 smithi142 ceph-mon[37169]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:55:10.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:10 smithi142 ceph-mon[37169]: Reconfiguring mon.smithi046 (unknown last config time)... 2024-02-19T18:55:10.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:10 smithi142 ceph-mon[37169]: Reconfiguring daemon mon.smithi046 on smithi046 2024-02-19T18:55:11.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:11 smithi046 ceph-mon[29647]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:11.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:11 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2915953471' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:11.621 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-19T18:55:11.622 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:55:11.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.conf 2024-02-19T18:55:11.694 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:55:11.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T18:55:11.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:11 smithi142 ceph-mon[37169]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:11.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:11 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2915953471' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:11.762 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:55:11.762 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.conf 2024-02-19T18:55:11.796 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:55:11.797 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T18:55:11.867 INFO:tasks.cephadm:Deploying OSDs... 2024-02-19T18:55:11.867 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:55:11.867 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-02-19T18:55:11.882 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-19T18:55:11.882 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-02-19T18:55:11.937 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-19T18:55:11.937 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:55:11.937 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 814 Links: 1 2024-02-19T18:55:11.937 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:55:11.937 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:55:11.937 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-02-19 18:54:23.635919824 +0000 2024-02-19T18:55:11.937 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-02-19 18:46:59.638985923 +0000 2024-02-19T18:55:11.937 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-02-19 18:46:59.638985923 +0000 2024-02-19T18:55:11.938 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-02-19 18:46:59.638985923 +0000 2024-02-19T18:55:11.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-19T18:55:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-02-19T18:55:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-02-19T18:55:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.017e-05 s, 5.7 MB/s 2024-02-19T18:55:12.005 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-19T18:55:12.059 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-02-19T18:55:12.114 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-19T18:55:12.114 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:55:12.114 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 830 Links: 1 2024-02-19T18:55:12.114 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:55:12.114 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:55:12.115 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-02-19 18:54:23.635919824 +0000 2024-02-19T18:55:12.115 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-02-19 18:46:59.983982225 +0000 2024-02-19T18:55:12.115 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-02-19 18:46:59.983982225 +0000 2024-02-19T18:55:12.115 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-02-19 18:46:59.983982225 +0000 2024-02-19T18:55:12.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-19T18:55:12.181 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-02-19T18:55:12.181 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-02-19T18:55:12.181 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.9499e-05 s, 5.1 MB/s 2024-02-19T18:55:12.182 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-19T18:55:12.238 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-02-19T18:55:12.293 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-19T18:55:12.293 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:55:12.293 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 851 Links: 1 2024-02-19T18:55:12.293 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:55:12.293 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:55:12.294 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-02-19 18:54:23.635919824 +0000 2024-02-19T18:55:12.294 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-02-19 18:47:00.326978549 +0000 2024-02-19T18:55:12.294 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-02-19 18:47:00.326978549 +0000 2024-02-19T18:55:12.294 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-02-19 18:47:00.326978549 +0000 2024-02-19T18:55:12.294 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-19T18:55:12.359 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-02-19T18:55:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-02-19T18:55:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.2194e-05 s, 5.6 MB/s 2024-02-19T18:55:12.361 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-19T18:55:12.416 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-02-19T18:55:12.470 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-19T18:55:12.470 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:55:12.471 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-02-19T18:55:12.471 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:55:12.471 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:55:12.471 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-02-19 18:54:23.636919813 +0000 2024-02-19T18:55:12.471 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-02-19 18:47:00.674974819 +0000 2024-02-19T18:55:12.471 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-02-19 18:47:00.674974819 +0000 2024-02-19T18:55:12.471 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-02-19 18:47:00.674974819 +0000 2024-02-19T18:55:12.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-19T18:55:12.535 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-02-19T18:55:12.536 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-02-19T18:55:12.536 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.7841e-05 s, 5.2 MB/s 2024-02-19T18:55:12.537 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-19T18:55:12.593 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:55:12.593 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-02-19T18:55:12.612 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-19T18:55:12.612 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-02-19T18:55:12.670 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-19T18:55:12.670 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:55:12.670 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-02-19T18:55:12.670 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:55:12.670 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:55:12.670 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-19 18:54:59.023136572 +0000 2024-02-19T18:55:12.670 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-19 18:46:52.522444894 +0000 2024-02-19T18:55:12.670 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-19 18:46:52.522444894 +0000 2024-02-19T18:55:12.670 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-19 18:46:52.522444894 +0000 2024-02-19T18:55:12.670 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-19T18:55:12.738 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-19T18:55:12.738 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-19T18:55:12.738 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000231088 s, 2.2 MB/s 2024-02-19T18:55:12.739 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-19T18:55:12.797 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-02-19T18:55:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-19T18:55:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:55:12.853 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-02-19T18:55:12.853 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:55:12.853 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:55:12.853 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-19 18:54:59.023136572 +0000 2024-02-19T18:55:12.853 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-19 18:46:52.903437888 +0000 2024-02-19T18:55:12.853 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-19 18:46:52.903437888 +0000 2024-02-19T18:55:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-19 18:46:52.903437888 +0000 2024-02-19T18:55:12.853 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-19T18:55:12.921 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-19T18:55:12.922 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-19T18:55:12.922 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000222982 s, 2.3 MB/s 2024-02-19T18:55:12.923 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-19T18:55:12.980 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-02-19T18:55:13.035 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-19T18:55:13.035 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:55:13.036 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-02-19T18:55:13.036 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:55:13.036 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:55:13.036 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-19 18:54:59.024136553 +0000 2024-02-19T18:55:13.036 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-19 18:46:53.316430293 +0000 2024-02-19T18:55:13.036 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-19 18:46:53.316430293 +0000 2024-02-19T18:55:13.036 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-19 18:46:53.316430293 +0000 2024-02-19T18:55:13.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-19T18:55:13.102 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-19T18:55:13.102 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-19T18:55:13.102 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000237419 s, 2.2 MB/s 2024-02-19T18:55:13.103 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-19T18:55:13.159 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-02-19T18:55:13.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:13 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:13.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:13 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:13.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:13 smithi142 ceph-mon[37169]: Reconfiguring mgr.smithi046.qtceex (unknown last config time)... 2024-02-19T18:55:13.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:13 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.qtceex", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:55:13.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:13 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:55:13.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:13 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:13.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:13 smithi142 ceph-mon[37169]: Reconfiguring daemon mgr.smithi046.qtceex on smithi046 2024-02-19T18:55:13.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:13 smithi142 ceph-mon[37169]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-19T18:55:13.212 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:55:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-02-19T18:55:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:55:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:55:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-02-19 18:54:59.024136553 +0000 2024-02-19T18:55:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-19 18:46:53.655424059 +0000 2024-02-19T18:55:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-19 18:46:53.655424059 +0000 2024-02-19T18:55:13.213 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-19 18:46:53.655424059 +0000 2024-02-19T18:55:13.213 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-19T18:55:13.278 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-02-19T18:55:13.278 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-02-19T18:55:13.278 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000210839 s, 2.4 MB/s 2024-02-19T18:55:13.280 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-19T18:55:13.335 INFO:tasks.cephadm:Deploying osd.0 on smithi046 with /dev/vg_nvme/lv_4... 2024-02-19T18:55:13.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-19T18:55:13.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:13 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:13.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:13 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:13.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:13 smithi046 ceph-mon[29647]: Reconfiguring mgr.smithi046.qtceex (unknown last config time)... 2024-02-19T18:55:13.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:13 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.qtceex", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:55:13.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:13 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:55:13.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:13 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:13.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:13 smithi046 ceph-mon[29647]: Reconfiguring daemon mgr.smithi046.qtceex on smithi046 2024-02-19T18:55:13.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:13 smithi046 ceph-mon[29647]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:55:14.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:14 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:14.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:14 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:14.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:14 smithi046 ceph-mon[29647]: Reconfiguring ceph-exporter.smithi046 (monmap changed)... 2024-02-19T18:55:14.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:14 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:55:14.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:14 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:14.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:14 smithi046 ceph-mon[29647]: Reconfiguring daemon ceph-exporter.smithi046 on smithi046 2024-02-19T18:55:14.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:14 smithi046 ceph-mon[29647]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:14.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:14 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:14.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:14 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:14.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:14 smithi142 ceph-mon[37169]: Reconfiguring ceph-exporter.smithi046 (monmap changed)... 2024-02-19T18:55:14.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:14 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:55:14.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:14 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:14.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:14 smithi142 ceph-mon[37169]: Reconfiguring daemon ceph-exporter.smithi046 on smithi046 2024-02-19T18:55:14.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:14 smithi142 ceph-mon[37169]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:15.364 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-19T18:55:15.365 INFO:teuthology.orchestra.run.smithi046.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-19T18:55:15.365 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10+0 records in 2024-02-19T18:55:15.365 INFO:teuthology.orchestra.run.smithi046.stderr:10+0 records out 2024-02-19T18:55:15.365 INFO:teuthology.orchestra.run.smithi046.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00848799 s, 1.2 GB/s 2024-02-19T18:55:15.365 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping successful for: 2024-02-19T18:55:16.851 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi046:vg_nvme/lv_4 2024-02-19T18:55:17.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:17 smithi142 ceph-mon[37169]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:17.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:17.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:17.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:55:17.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:17.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:55:17.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:17 smithi046 ceph-mon[29647]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:17.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:17.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:17.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:55:17.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:17.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:55:17.902 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:55:18.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:18 smithi046 ceph-mon[29647]: Reconfiguring crash.smithi046 (monmap changed)... 2024-02-19T18:55:18.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:18 smithi046 ceph-mon[29647]: Reconfiguring daemon crash.smithi046 on smithi046 2024-02-19T18:55:18.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:18 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:18.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:18 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:18 smithi142 ceph-mon[37169]: Reconfiguring crash.smithi046 (monmap changed)... 2024-02-19T18:55:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:18 smithi142 ceph-mon[37169]: Reconfiguring daemon crash.smithi046 on smithi046 2024-02-19T18:55:18.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:18 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:18.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:18 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:19.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:19 smithi046 ceph-mon[29647]: Reconfiguring alertmanager.smithi046 (dependencies changed)... 2024-02-19T18:55:19.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:19 smithi046 ceph-mon[29647]: Reconfiguring daemon alertmanager.smithi046 on smithi046 2024-02-19T18:55:19.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:19 smithi046 ceph-mon[29647]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:19.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:19 smithi142 ceph-mon[37169]: Reconfiguring alertmanager.smithi046 (dependencies changed)... 2024-02-19T18:55:19.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:19 smithi142 ceph-mon[37169]: Reconfiguring daemon alertmanager.smithi046 on smithi046 2024-02-19T18:55:19.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:19 smithi142 ceph-mon[37169]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:20.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.225+0000 7f249333e700 1 -- 172.21.15.46:0/991591545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f248c101440 msgr2=0x7f248c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:20.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.225+0000 7f249333e700 1 --2- 172.21.15.46:0/991591545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f248c101440 0x7f248c101890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f247c009910 tx=0x7f247c009c20 comp rx=0 tx=0).stop 2024-02-19T18:55:20.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.225+0000 7f249333e700 1 -- 172.21.15.46:0/991591545 shutdown_connections 2024-02-19T18:55:20.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.225+0000 7f249333e700 1 --2- 172.21.15.46:0/991591545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f248c101440 0x7f248c101890 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:20.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.225+0000 7f249333e700 1 --2- 172.21.15.46:0/991591545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f248c100240 0x7f248c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.226+0000 7f249333e700 1 -- 172.21.15.46:0/991591545 >> 172.21.15.46:0/991591545 conn(0x7f248c0fb7f0 msgr2=0x7f248c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.226+0000 7f249333e700 1 -- 172.21.15.46:0/991591545 shutdown_connections 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.226+0000 7f249333e700 1 -- 172.21.15.46:0/991591545 wait complete. 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.226+0000 7f249333e700 1 Processor -- start 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.226+0000 7f249333e700 1 -- start start 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.226+0000 7f249333e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f248c100240 0x7f248c195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.226+0000 7f249333e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f248c101440 0x7f248c196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.226+0000 7f249333e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1966b0 con 0x7f248c100240 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.226+0000 7f249333e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1967f0 con 0x7f248c101440 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24910da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f248c100240 0x7f248c195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24910da700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f248c100240 0x7f248c195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49862/0 (socket says 172.21.15.46:49862) 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24910da700 1 -- 172.21.15.46:0/2721122226 learned_addr learned my addr 172.21.15.46:0/2721122226 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:55:20.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24908d9700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f248c101440 0x7f248c196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:20.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24910da700 1 -- 172.21.15.46:0/2721122226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f248c101440 msgr2=0x7f248c196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:20.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24910da700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f248c101440 0x7f248c196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:20.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24910da700 1 -- 172.21.15.46:0/2721122226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0095f0 con 0x7f248c100240 2024-02-19T18:55:20.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24910da700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f248c100240 0x7f248c195b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f248800b480 tx=0x7f248800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:20.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24827fc700 1 -- 172.21.15.46:0/2721122226 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24880118c0 con 0x7f248c100240 2024-02-19T18:55:20.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24827fc700 1 -- 172.21.15.46:0/2721122226 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2488010380 con 0x7f248c100240 2024-02-19T18:55:20.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f249333e700 1 -- 172.21.15.46:0/2721122226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c19b2a0 con 0x7f248c100240 2024-02-19T18:55:20.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f24827fc700 1 -- 172.21.15.46:0/2721122226 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248800f4f0 con 0x7f248c100240 2024-02-19T18:55:20.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.227+0000 7f249333e700 1 -- 172.21.15.46:0/2721122226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248c19b7f0 con 0x7f248c100240 2024-02-19T18:55:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.228+0000 7f249333e700 1 -- 172.21.15.46:0/2721122226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248c108e30 con 0x7f248c100240 2024-02-19T18:55:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.229+0000 7f24827fc700 1 -- 172.21.15.46:0/2721122226 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f24880104f0 con 0x7f248c100240 2024-02-19T18:55:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.229+0000 7f24827fc700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f247806c600 0x7f247806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.229+0000 7f24908d9700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f247806c600 0x7f247806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.229+0000 7f24827fc700 1 -- 172.21.15.46:0/2721122226 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f248808a3c0 con 0x7f248c100240 2024-02-19T18:55:20.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.230+0000 7f24908d9700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f247806c600 0x7f247806eab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f247c00b5c0 tx=0x7f247c005960 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:20.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.234+0000 7f24827fc700 1 -- 172.21.15.46:0/2721122226 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2488059610 con 0x7f248c100240 2024-02-19T18:55:20.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:20.443+0000 7f249333e700 1 -- 172.21.15.46:0/2721122226 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f248c19be90 con 0x7f247806c600 2024-02-19T18:55:21.188 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:20 smithi046 ceph-mon[29647]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:21.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:55:21.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:55:21.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:21.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:20 smithi142 ceph-mon[37169]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:21.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:55:21.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:55:21.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:22.295 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:21 smithi046 ceph-mon[29647]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:22.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:21 smithi142 ceph-mon[37169]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:23.168 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:22 smithi046 ceph-mon[29647]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:23.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:22 smithi142 ceph-mon[37169]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:25.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:25 smithi046 ceph-mon[29647]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:25.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:25.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:25.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:25 smithi142 ceph-mon[37169]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:25.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:25.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:26.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:26 smithi142 ceph-mon[37169]: Reconfiguring grafana.smithi046 (dependencies changed)... 2024-02-19T18:55:26.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:26 smithi142 ceph-mon[37169]: Reconfiguring daemon grafana.smithi046 on smithi046 2024-02-19T18:55:26.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:26 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/3151109528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1ea35c0-be56-4830-9abc-c67aa3feed47"}]: dispatch 2024-02-19T18:55:26.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:26 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/3151109528' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1ea35c0-be56-4830-9abc-c67aa3feed47"}]': finished 2024-02-19T18:55:26.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:26 smithi142 ceph-mon[37169]: osdmap e6: 1 total, 0 up, 1 in 2024-02-19T18:55:26.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:26 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:26.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:26 smithi046 ceph-mon[29647]: Reconfiguring grafana.smithi046 (dependencies changed)... 2024-02-19T18:55:26.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:26 smithi046 ceph-mon[29647]: Reconfiguring daemon grafana.smithi046 on smithi046 2024-02-19T18:55:26.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:26 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3151109528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1ea35c0-be56-4830-9abc-c67aa3feed47"}]: dispatch 2024-02-19T18:55:26.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:26 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3151109528' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1ea35c0-be56-4830-9abc-c67aa3feed47"}]': finished 2024-02-19T18:55:26.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:26 smithi046 ceph-mon[29647]: osdmap e6: 1 total, 0 up, 1 in 2024-02-19T18:55:26.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:26 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:27.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:27 smithi142 ceph-mon[37169]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:27.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:27 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/3021650069' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:55:27.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:27 smithi046 ceph-mon[29647]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:27.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:27 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3021650069' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:55:29.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:29 smithi142 ceph-mon[37169]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:29.481 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:29 smithi046 ceph-mon[29647]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:31.226 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:30 smithi046 ceph-mon[29647]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:31.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:30 smithi142 ceph-mon[37169]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:32.577 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:32 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:55:32.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:32 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:55:33.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:33 smithi046 ceph-mon[29647]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:33.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:33 smithi142 ceph-mon[37169]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:35.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:35 smithi046 ceph-mon[29647]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:35 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:35 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:35.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:35 smithi142 ceph-mon[37169]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:35.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:35 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:35.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:35 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:36.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:36 smithi046 ceph-mon[29647]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-02-19T18:55:36.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:36 smithi046 ceph-mon[29647]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-02-19T18:55:36.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:36 smithi142 ceph-mon[37169]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-02-19T18:55:36.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:36 smithi142 ceph-mon[37169]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-02-19T18:55:37.248 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:37 smithi142 ceph-mon[37169]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:37.248 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:37 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T18:55:37.435 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:37 smithi046 ceph-mon[29647]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:37.435 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:37 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T18:55:37.435 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:37 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:37.435 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:37 smithi046 ceph-mon[29647]: Deploying daemon osd.0 on smithi046 2024-02-19T18:55:37.519 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:37 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:37.519 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:37 smithi142 ceph-mon[37169]: Deploying daemon osd.0 on smithi046 2024-02-19T18:55:39.504 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:39 smithi046 ceph-mon[29647]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:39.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:39 smithi142 ceph-mon[37169]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:41.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:41 smithi142 ceph-mon[37169]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:41.219 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:41 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:41.219 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:41 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:41.219 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:41 smithi142 ceph-mon[37169]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-02-19T18:55:41.219 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:41 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:55:41.219 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:41 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:41.219 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:41 smithi142 ceph-mon[37169]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-02-19T18:55:41.298 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:41 smithi046 ceph-mon[29647]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:41.298 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:41 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:41.298 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:41 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:41.298 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:41 smithi046 ceph-mon[29647]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-02-19T18:55:41.298 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:41 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:55:41.298 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:41 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:41.298 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:41 smithi046 ceph-mon[29647]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-02-19T18:55:42.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:42 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:42.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:42 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:42.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:42 smithi046 ceph-mon[29647]: Reconfiguring crash.smithi142 (monmap changed)... 2024-02-19T18:55:42.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:42 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:55:42.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:42 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:42.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:42 smithi046 ceph-mon[29647]: Reconfiguring daemon crash.smithi142 on smithi142 2024-02-19T18:55:42.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:42 smithi046 ceph-mon[29647]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:42.916 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:42 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:42.916 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:42 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:42.916 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:42 smithi142 ceph-mon[37169]: Reconfiguring crash.smithi142 (monmap changed)... 2024-02-19T18:55:42.916 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:42 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:55:42.916 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:42 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:42.916 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:42 smithi142 ceph-mon[37169]: Reconfiguring daemon crash.smithi142 on smithi142 2024-02-19T18:55:42.916 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:42 smithi142 ceph-mon[37169]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:44.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:44.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:44.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:43 smithi046 ceph-mon[29647]: Reconfiguring mgr.smithi142.fwekwv (monmap changed)... 2024-02-19T18:55:44.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.fwekwv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:55:44.269 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:55:44.269 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:44.269 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:43 smithi046 ceph-mon[29647]: Reconfiguring daemon mgr.smithi142.fwekwv on smithi142 2024-02-19T18:55:44.279 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:43 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:44.279 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:43 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:44.279 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:43 smithi142 ceph-mon[37169]: Reconfiguring mgr.smithi142.fwekwv (monmap changed)... 2024-02-19T18:55:44.279 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:43 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.fwekwv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:55:44.279 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:43 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:55:44.279 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:43 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:44.279 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:43 smithi142 ceph-mon[37169]: Reconfiguring daemon mgr.smithi142.fwekwv on smithi142 2024-02-19T18:55:45.426 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:45 smithi142 ceph-mon[37169]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:45.426 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:45 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:45.426 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:45 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:45.426 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:45 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:55:45.426 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:45 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T18:55:45.426 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:45 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:45.426 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:45 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:45.426 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:45 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:45.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:45 smithi046 ceph-mon[29647]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:45.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:45 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:45.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:45 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:45.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:45 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:55:45.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:45 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T18:55:45.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:45 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:45.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:45 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:45.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:45 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: Reconfiguring mon.smithi142 (monmap changed)... 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: Reconfiguring daemon mon.smithi142 on smithi142 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T18:55:46.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T18:55:46.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:46 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:46.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: Reconfiguring mon.smithi142 (monmap changed)... 2024-02-19T18:55:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: Reconfiguring daemon mon.smithi142 on smithi142 2024-02-19T18:55:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T18:55:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T18:55:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T18:55:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T18:55:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T18:55:46.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T18:55:46.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:46.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:46 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:47 smithi142 ceph-mon[37169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T18:55:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:47 smithi142 ceph-mon[37169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T18:55:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:47 smithi142 ceph-mon[37169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T18:55:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:47 smithi142 ceph-mon[37169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T18:55:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:47 smithi142 ceph-mon[37169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T18:55:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:47 smithi142 ceph-mon[37169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T18:55:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:47 smithi142 ceph-mon[37169]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:47 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:55:47.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:47 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T18:55:47.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:47 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T18:55:47.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:47 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T18:55:47.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:47 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T18:55:47.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:47 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T18:55:47.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:47 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T18:55:47.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:47 smithi046 ceph-mon[29647]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:47.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:47 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:55:48.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.230+0000 7f24827fc700 1 -- 172.21.15.46:0/2721122226 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f248c19be90 con 0x7f247806c600 2024-02-19T18:55:48.248 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 0 on host 'smithi046' 2024-02-19T18:55:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 -- 172.21.15.46:0/2721122226 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f247806c600 msgr2=0x7f247806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f247806c600 0x7f247806eab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f247c00b5c0 tx=0x7f247c005960 comp rx=0 tx=0).stop 2024-02-19T18:55:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 -- 172.21.15.46:0/2721122226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f248c100240 msgr2=0x7f248c195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f248c100240 0x7f248c195b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f248800b480 tx=0x7f248800b840 comp rx=0 tx=0).stop 2024-02-19T18:55:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 -- 172.21.15.46:0/2721122226 shutdown_connections 2024-02-19T18:55:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f247806c600 0x7f247806eab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:48.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f248c100240 0x7f248c195b50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:48.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 --2- 172.21.15.46:0/2721122226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f248c101440 0x7f248c196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:48.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 -- 172.21.15.46:0/2721122226 >> 172.21.15.46:0/2721122226 conn(0x7f248c0fb7f0 msgr2=0x7f248c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:48.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 -- 172.21.15.46:0/2721122226 shutdown_connections 2024-02-19T18:55:48.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:48.233+0000 7f249333e700 1 -- 172.21.15.46:0/2721122226 wait complete. 2024-02-19T18:55:48.778 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:48.778 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:48.778 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:48 smithi046 ceph-mon[29647]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:48.778 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:48.778 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:48.799 DEBUG:teuthology.orchestra.run.smithi046:osd.0> sudo journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.0.service 2024-02-19T18:55:48.801 INFO:tasks.cephadm:Deploying osd.1 on smithi046 with /dev/vg_nvme/lv_3... 2024-02-19T18:55:48.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-19T18:55:48.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:48 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:48.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:48 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:48.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:48 smithi142 ceph-mon[37169]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:48.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:48 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:48.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:48 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:49.078 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:55:48 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[44579]: 2024-02-19T18:55:48.870+0000 7f0412ef4640 -1 osd.0 0 log_to_monitors true 2024-02-19T18:55:49.697 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:55:49.921 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:49 smithi046 ceph-mon[29647]: from='osd.0 [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T18:55:49.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:49 smithi142 ceph-mon[37169]: from='osd.0 [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T18:55:50.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:50 smithi142 ceph-mon[37169]: from='osd.0 [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T18:55:50.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:50 smithi142 ceph-mon[37169]: osdmap e7: 1 total, 0 up, 1 in 2024-02-19T18:55:50.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:50 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:50.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:50 smithi142 ceph-mon[37169]: from='osd.0 [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T18:55:50.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:50 smithi142 ceph-mon[37169]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:51.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:50 smithi046 ceph-mon[29647]: from='osd.0 [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T18:55:51.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:50 smithi046 ceph-mon[29647]: osdmap e7: 1 total, 0 up, 1 in 2024-02-19T18:55:51.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:50 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:51.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:50 smithi046 ceph-mon[29647]: from='osd.0 [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T18:55:51.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:50 smithi046 ceph-mon[29647]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:51.078 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:55:50 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[44579]: 2024-02-19T18:55:50.644+0000 7f0407d6a700 -1 osd.0 0 waiting for initial osdmap 2024-02-19T18:55:51.078 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:55:50 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[44579]: 2024-02-19T18:55:50.649+0000 7f0402b5d700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T18:55:51.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:51 smithi046 ceph-mon[29647]: from='osd.0 [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-02-19T18:55:51.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:51 smithi046 ceph-mon[29647]: osdmap e8: 1 total, 0 up, 1 in 2024-02-19T18:55:51.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:51 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:51.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:51 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:51.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:51 smithi142 ceph-mon[37169]: from='osd.0 [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-02-19T18:55:51.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:51 smithi142 ceph-mon[37169]: osdmap e8: 1 total, 0 up, 1 in 2024-02-19T18:55:51.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:51 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:51.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:51 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-19T18:55:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-19T18:55:52.373 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10+0 records in 2024-02-19T18:55:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:10+0 records out 2024-02-19T18:55:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00936914 s, 1.1 GB/s 2024-02-19T18:55:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping successful for: 2024-02-19T18:55:52.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:52 smithi046 ceph-mon[29647]: purged_snaps scrub starts 2024-02-19T18:55:52.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:52 smithi046 ceph-mon[29647]: purged_snaps scrub ok 2024-02-19T18:55:52.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:52.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:52 smithi046 ceph-mon[29647]: osd.0 [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861] boot 2024-02-19T18:55:52.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:52 smithi046 ceph-mon[29647]: osdmap e9: 1 total, 1 up, 1 in 2024-02-19T18:55:52.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:52.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:52 smithi046 ceph-mon[29647]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:52.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:52 smithi142 ceph-mon[37169]: purged_snaps scrub starts 2024-02-19T18:55:52.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:52 smithi142 ceph-mon[37169]: purged_snaps scrub ok 2024-02-19T18:55:52.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:52.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:52 smithi142 ceph-mon[37169]: osd.0 [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861] boot 2024-02-19T18:55:52.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:52 smithi142 ceph-mon[37169]: osdmap e9: 1 total, 1 up, 1 in 2024-02-19T18:55:52.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:55:52.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:52 smithi142 ceph-mon[37169]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:53.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi046:vg_nvme/lv_3 2024-02-19T18:55:53.815 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:55:53.943 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:53 smithi046 ceph-mon[29647]: osdmap e10: 1 total, 1 up, 1 in 2024-02-19T18:55:53.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:53 smithi142 ceph-mon[37169]: osdmap e10: 1 total, 1 up, 1 in 2024-02-19T18:55:55.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:54 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:55.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:54 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:55.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:54 smithi046 ceph-mon[29647]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:55:55.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:54 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:55.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:54 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:55.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:54 smithi142 ceph-mon[37169]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:55:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.359+0000 7fe30c174700 1 -- 172.21.15.46:0/3154471035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe304101440 msgr2=0x7fe304101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.359+0000 7fe30c174700 1 --2- 172.21.15.46:0/3154471035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe304101440 0x7fe304101890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009910 tx=0x7fe2f4009c20 comp rx=0 tx=0).stop 2024-02-19T18:55:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.360+0000 7fe30c174700 1 -- 172.21.15.46:0/3154471035 shutdown_connections 2024-02-19T18:55:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.360+0000 7fe30c174700 1 --2- 172.21.15.46:0/3154471035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe304101440 0x7fe304101890 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.360+0000 7fe30c174700 1 --2- 172.21.15.46:0/3154471035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe304100240 0x7fe304100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.360+0000 7fe30c174700 1 -- 172.21.15.46:0/3154471035 >> 172.21.15.46:0/3154471035 conn(0x7fe3040fb7f0 msgr2=0x7fe3040fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:55.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.360+0000 7fe30c174700 1 -- 172.21.15.46:0/3154471035 shutdown_connections 2024-02-19T18:55:55.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.360+0000 7fe30c174700 1 -- 172.21.15.46:0/3154471035 wait complete. 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.360+0000 7fe30c174700 1 Processor -- start 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.360+0000 7fe30c174700 1 -- start start 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30c174700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe304100240 0x7fe304195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30c174700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe304101440 0x7fe304195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30c174700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe304196610 con 0x7fe304101440 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30c174700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe304196750 con 0x7fe304100240 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30970f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe304101440 0x7fe304195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30970f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe304101440 0x7fe304195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47298/0 (socket says 172.21.15.46:47298) 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30970f700 1 -- 172.21.15.46:0/954376935 learned_addr learned my addr 172.21.15.46:0/954376935 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe309f10700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe304100240 0x7fe304195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:55.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30970f700 1 -- 172.21.15.46:0/954376935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe304100240 msgr2=0x7fe304195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30970f700 1 --2- 172.21.15.46:0/954376935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe304100240 0x7fe304195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30970f700 1 -- 172.21.15.46:0/954376935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40095f0 con 0x7fe304101440 2024-02-19T18:55:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.361+0000 7fe30970f700 1 --2- 172.21.15.46:0/954376935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe304101440 0x7fe304195ff0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4006010 tx=0x7fe2f400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.362+0000 7fe2faffd700 1 -- 172.21.15.46:0/954376935 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2f401d070 con 0x7fe304101440 2024-02-19T18:55:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.362+0000 7fe30c174700 1 -- 172.21.15.46:0/954376935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30419b1a0 con 0x7fe304101440 2024-02-19T18:55:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.362+0000 7fe2faffd700 1 -- 172.21.15.46:0/954376935 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe2f400f460 con 0x7fe304101440 2024-02-19T18:55:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.362+0000 7fe2faffd700 1 -- 172.21.15.46:0/954376935 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2f4021640 con 0x7fe304101440 2024-02-19T18:55:55.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.362+0000 7fe30c174700 1 -- 172.21.15.46:0/954376935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30419b690 con 0x7fe304101440 2024-02-19T18:55:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.363+0000 7fe30c174700 1 -- 172.21.15.46:0/954376935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe304108d90 con 0x7fe304101440 2024-02-19T18:55:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.363+0000 7fe2faffd700 1 -- 172.21.15.46:0/954376935 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fe2f400fab0 con 0x7fe304101440 2024-02-19T18:55:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.363+0000 7fe2faffd700 1 --2- 172.21.15.46:0/954376935 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe2f006c600 0x7fe2f006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.364+0000 7fe2faffd700 1 -- 172.21.15.46:0/954376935 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fe2f408bc50 con 0x7fe304101440 2024-02-19T18:55:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.364+0000 7fe309f10700 1 --2- 172.21.15.46:0/954376935 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe2f006c600 0x7fe2f006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:55.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.364+0000 7fe309f10700 1 --2- 172.21.15.46:0/954376935 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe2f006c600 0x7fe2f006eab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe3041012a0 tx=0x7fe30000b410 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:55.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.369+0000 7fe2faffd700 1 -- 172.21.15.46:0/954376935 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe2f4091020 con 0x7fe304101440 2024-02-19T18:55:55.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:55:55.585+0000 7fe30c174700 1 -- 172.21.15.46:0/954376935 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe304105d90 con 0x7fe2f006c600 2024-02-19T18:55:56.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:55 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:55:56.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:55 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:55:56.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:55 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:56.402 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:55 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:55:56.402 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:55 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:55:56.402 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:55 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:57.275 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:57 smithi046 ceph-mon[29647]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:57.275 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:57 smithi046 ceph-mon[29647]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:55:57.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:57 smithi142 ceph-mon[37169]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:57.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:57 smithi142 ceph-mon[37169]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:55:59.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:55:59.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: Detected new or changed devices on smithi046 2024-02-19T18:55:59.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:59.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:59.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:55:59.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: Adjusting osd_memory_target on smithi046 to 11845M 2024-02-19T18:55:59.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:59.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:59.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:55:59.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:59.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:55:59 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:59.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:55:59.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: Detected new or changed devices on smithi046 2024-02-19T18:55:59.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:59.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:59.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:55:59.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: Adjusting osd_memory_target on smithi046 to 11845M 2024-02-19T18:55:59.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:59.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:59.455 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:55:59.456 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:55:59.456 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:55:59 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:00.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:00 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2282090988' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dcb0202-8fa1-4a72-939d-dd8a5ced3a42"}]: dispatch 2024-02-19T18:56:00.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:00 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2282090988' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0dcb0202-8fa1-4a72-939d-dd8a5ced3a42"}]': finished 2024-02-19T18:56:00.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:00 smithi046 ceph-mon[29647]: osdmap e11: 2 total, 1 up, 2 in 2024-02-19T18:56:00.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:00 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:00.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:00 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2282090988' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dcb0202-8fa1-4a72-939d-dd8a5ced3a42"}]: dispatch 2024-02-19T18:56:00.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:00 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2282090988' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0dcb0202-8fa1-4a72-939d-dd8a5ced3a42"}]': finished 2024-02-19T18:56:00.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:00 smithi142 ceph-mon[37169]: osdmap e11: 2 total, 1 up, 2 in 2024-02-19T18:56:00.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:00 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:01.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:01 smithi046 ceph-mon[29647]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:01.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:01 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:01.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:01 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:01.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:01 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1345252326' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:56:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:01 smithi142 ceph-mon[37169]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:01 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:01 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:01 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1345252326' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:56:02.489 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:02 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:56:02.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:02 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:56:03.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:03 smithi046 ceph-mon[29647]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:03.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:03 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:03.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:03 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:03.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:03 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:03.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:03 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:56:03.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:03 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:03.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:03 smithi142 ceph-mon[37169]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:03.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:03 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:03.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:03 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:03.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:03 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:03.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:03 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:56:03.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:03 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:05.505 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:05 smithi046 ceph-mon[29647]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:05.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:05 smithi142 ceph-mon[37169]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:07.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:07 smithi046 ceph-mon[29647]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:07.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:07 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T18:56:07.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:07 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:07.623 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:07 smithi142 ceph-mon[37169]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:07.623 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:07 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T18:56:07.623 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:07 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:08.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:08 smithi046 ceph-mon[29647]: Deploying daemon osd.1 on smithi046 2024-02-19T18:56:08.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:08 smithi142 ceph-mon[37169]: Deploying daemon osd.1 on smithi046 2024-02-19T18:56:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:09 smithi046 ceph-mon[29647]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:09.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:09 smithi142 ceph-mon[37169]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:11.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:11 smithi046 ceph-mon[29647]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:11.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:11 smithi142 ceph-mon[37169]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:13.537 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:13 smithi046 ceph-mon[29647]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:13.537 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:13 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:13.537 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:13 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:13.537 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:13 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:13.664 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:13 smithi142 ceph-mon[37169]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:13.664 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:13 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:13.664 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:13 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:13.664 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:13 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:15.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:15 smithi046 ceph-mon[29647]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:15.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:15.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:15.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:15 smithi142 ceph-mon[37169]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:15.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:15.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:15.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.848+0000 7fe2faffd700 1 -- 172.21.15.46:0/954376935 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe304105d90 con 0x7fe2f006c600 2024-02-19T18:56:15.866 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 1 on host 'smithi046' 2024-02-19T18:56:15.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 -- 172.21.15.46:0/954376935 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe2f006c600 msgr2=0x7fe2f006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:15.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 --2- 172.21.15.46:0/954376935 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe2f006c600 0x7fe2f006eab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe3041012a0 tx=0x7fe30000b410 comp rx=0 tx=0).stop 2024-02-19T18:56:15.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 -- 172.21.15.46:0/954376935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe304101440 msgr2=0x7fe304195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:15.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 --2- 172.21.15.46:0/954376935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe304101440 0x7fe304195ff0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4006010 tx=0x7fe2f400bd70 comp rx=0 tx=0).stop 2024-02-19T18:56:15.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 -- 172.21.15.46:0/954376935 shutdown_connections 2024-02-19T18:56:15.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 --2- 172.21.15.46:0/954376935 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe2f006c600 0x7fe2f006eab0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:15.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 --2- 172.21.15.46:0/954376935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe304100240 0x7fe304195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:15.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 --2- 172.21.15.46:0/954376935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe304101440 0x7fe304195ff0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:15.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 -- 172.21.15.46:0/954376935 >> 172.21.15.46:0/954376935 conn(0x7fe3040fb7f0 msgr2=0x7fe304104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:15.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 -- 172.21.15.46:0/954376935 shutdown_connections 2024-02-19T18:56:15.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:15.850+0000 7fe30c174700 1 -- 172.21.15.46:0/954376935 wait complete. 2024-02-19T18:56:16.733 DEBUG:teuthology.orchestra.run.smithi046:osd.1> sudo journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.1.service 2024-02-19T18:56:16.735 INFO:tasks.cephadm:Deploying osd.2 on smithi046 with /dev/vg_nvme/lv_2... 2024-02-19T18:56:16.736 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-19T18:56:16.972 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:16 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:16.972 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:16 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:16.972 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:16 smithi046 ceph-mon[29647]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:16.973 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:16 smithi046 ceph-mon[29647]: from='osd.1 [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T18:56:16.973 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:16 smithi046 ceph-mon[29647]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T18:56:17.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:16 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:17.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:16 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:17.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:16 smithi142 ceph-mon[37169]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:17.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:16 smithi142 ceph-mon[37169]: from='osd.1 [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T18:56:17.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:16 smithi142 ceph-mon[37169]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T18:56:17.826 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:56:17.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:17 smithi142 ceph-mon[37169]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T18:56:17.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:17 smithi142 ceph-mon[37169]: osdmap e12: 2 total, 1 up, 2 in 2024-02-19T18:56:17.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:17.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:17 smithi142 ceph-mon[37169]: from='osd.1 [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T18:56:17.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:17 smithi142 ceph-mon[37169]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T18:56:17.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:56:17.984 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:17 smithi046 ceph-mon[29647]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T18:56:17.984 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:17 smithi046 ceph-mon[29647]: osdmap e12: 2 total, 1 up, 2 in 2024-02-19T18:56:17.984 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:17.985 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:17 smithi046 ceph-mon[29647]: from='osd.1 [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T18:56:17.985 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:17 smithi046 ceph-mon[29647]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T18:56:17.985 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:56:17.985 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 18:56:17 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[50200]: 2024-02-19T18:56:17.822+0000 7fdcd0119700 -1 osd.1 0 waiting for initial osdmap 2024-02-19T18:56:17.985 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 18:56:17 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[50200]: 2024-02-19T18:56:17.829+0000 7fdccc70f700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T18:56:19.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:18 smithi046 ceph-mon[29647]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-02-19T18:56:19.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:18 smithi046 ceph-mon[29647]: osdmap e13: 2 total, 1 up, 2 in 2024-02-19T18:56:19.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:18 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:19.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:18 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:19.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:18 smithi046 ceph-mon[29647]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:19.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:18 smithi142 ceph-mon[37169]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-02-19T18:56:19.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:18 smithi142 ceph-mon[37169]: osdmap e13: 2 total, 1 up, 2 in 2024-02-19T18:56:19.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:18 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:19.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:18 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:19.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:18 smithi142 ceph-mon[37169]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:56:20.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:19 smithi046 ceph-mon[29647]: purged_snaps scrub starts 2024-02-19T18:56:20.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:19 smithi046 ceph-mon[29647]: purged_snaps scrub ok 2024-02-19T18:56:20.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:19 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:20.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:19 smithi046 ceph-mon[29647]: osd.1 [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762] boot 2024-02-19T18:56:20.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:19 smithi046 ceph-mon[29647]: osdmap e14: 2 total, 2 up, 2 in 2024-02-19T18:56:20.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:19 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:20.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:19 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:20.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:19 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:20.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:19 smithi142 ceph-mon[37169]: purged_snaps scrub starts 2024-02-19T18:56:20.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:19 smithi142 ceph-mon[37169]: purged_snaps scrub ok 2024-02-19T18:56:20.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:19 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:20.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:19 smithi142 ceph-mon[37169]: osd.1 [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762] boot 2024-02-19T18:56:20.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:19 smithi142 ceph-mon[37169]: osdmap e14: 2 total, 2 up, 2 in 2024-02-19T18:56:20.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:19 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:56:20.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:19 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:20.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:19 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:20.600 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-19T18:56:20.600 INFO:teuthology.orchestra.run.smithi046.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-19T18:56:20.600 INFO:teuthology.orchestra.run.smithi046.stderr: stderr: 10+0 records in 2024-02-19T18:56:20.600 INFO:teuthology.orchestra.run.smithi046.stderr:10+0 records out 2024-02-19T18:56:20.600 INFO:teuthology.orchestra.run.smithi046.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0103548 s, 1.0 GB/s 2024-02-19T18:56:20.600 INFO:teuthology.orchestra.run.smithi046.stderr:--> Zapping successful for: 2024-02-19T18:56:21.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:20 smithi142 ceph-mon[37169]: osdmap e15: 2 total, 2 up, 2 in 2024-02-19T18:56:21.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:20 smithi142 ceph-mon[37169]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:21.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:20 smithi046 ceph-mon[29647]: osdmap e15: 2 total, 2 up, 2 in 2024-02-19T18:56:21.248 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:20 smithi046 ceph-mon[29647]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:21.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi046:vg_nvme/lv_2 2024-02-19T18:56:21.715 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:56:23.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:23 smithi046 ceph-mon[29647]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:23.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:23 smithi142 ceph-mon[37169]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.721+0000 7fa46ebf4700 1 -- 172.21.15.46:0/1453728606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa468103310 msgr2=0x7fa468105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.721+0000 7fa46ebf4700 1 --2- 172.21.15.46:0/1453728606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa468103310 0x7fa468105790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa454009910 tx=0x7fa454009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.721+0000 7fa46ebf4700 1 -- 172.21.15.46:0/1453728606 shutdown_connections 2024-02-19T18:56:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.721+0000 7fa46ebf4700 1 --2- 172.21.15.46:0/1453728606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa468103310 0x7fa468105790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.721+0000 7fa46ebf4700 1 --2- 172.21.15.46:0/1453728606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa468069270 0x7fa468102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:24.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.721+0000 7fa46ebf4700 1 -- 172.21.15.46:0/1453728606 >> 172.21.15.46:0/1453728606 conn(0x7fa4680fa780 msgr2=0x7fa4680fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.721+0000 7fa46ebf4700 1 -- 172.21.15.46:0/1453728606 shutdown_connections 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.721+0000 7fa46ebf4700 1 -- 172.21.15.46:0/1453728606 wait complete. 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.722+0000 7fa46ebf4700 1 Processor -- start 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.722+0000 7fa46ebf4700 1 -- start start 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.722+0000 7fa46ebf4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa468103310 0x7fa468100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.722+0000 7fa46ebf4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4680fed70 0x7fa4680ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.722+0000 7fa46ebf4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680ff720 con 0x7fa468103310 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.722+0000 7fa46ebf4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680ff890 con 0x7fa4680fed70 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.722+0000 7fa46c990700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa468103310 0x7fa468100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.722+0000 7fa46c990700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa468103310 0x7fa468100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50824/0 (socket says 172.21.15.46:50824) 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.722+0000 7fa46c990700 1 -- 172.21.15.46:0/401868456 learned_addr learned my addr 172.21.15.46:0/401868456 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:56:24.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.722+0000 7fa467fff700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4680fed70 0x7fa4680ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.723+0000 7fa46c990700 1 -- 172.21.15.46:0/401868456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4680fed70 msgr2=0x7fa4680ff1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.723+0000 7fa46c990700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4680fed70 0x7fa4680ff1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.723+0000 7fa46c990700 1 -- 172.21.15.46:0/401868456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540095f0 con 0x7fa468103310 2024-02-19T18:56:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.723+0000 7fa46c990700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa468103310 0x7fa468100720 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00d8d0 tx=0x7fa45c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.723+0000 7fa465ffb700 1 -- 172.21.15.46:0/401868456 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa45c0041f0 con 0x7fa468103310 2024-02-19T18:56:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.723+0000 7fa46ebf4700 1 -- 172.21.15.46:0/401868456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4680ffb70 con 0x7fa468103310 2024-02-19T18:56:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.723+0000 7fa465ffb700 1 -- 172.21.15.46:0/401868456 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa45c007620 con 0x7fa468103310 2024-02-19T18:56:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.724+0000 7fa465ffb700 1 -- 172.21.15.46:0/401868456 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa45c005630 con 0x7fa468103310 2024-02-19T18:56:24.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.724+0000 7fa46ebf4700 1 -- 172.21.15.46:0/401868456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46819dd00 con 0x7fa468103310 2024-02-19T18:56:24.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.724+0000 7fa46ebf4700 1 -- 172.21.15.46:0/401868456 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46818fbf0 con 0x7fa468103310 2024-02-19T18:56:24.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.725+0000 7fa465ffb700 1 -- 172.21.15.46:0/401868456 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fa45c004750 con 0x7fa468103310 2024-02-19T18:56:24.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.725+0000 7fa465ffb700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa45806c600 0x7fa45806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:24.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.726+0000 7fa467fff700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa45806c600 0x7fa45806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:24.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.726+0000 7fa465ffb700 1 -- 172.21.15.46:0/401868456 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7fa45c08aa90 con 0x7fa468103310 2024-02-19T18:56:24.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.726+0000 7fa467fff700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa45806c600 0x7fa45806eab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa45400b5c0 tx=0x7fa454005ee0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:24.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.730+0000 7fa465ffb700 1 -- 172.21.15.46:0/401868456 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa45c059830 con 0x7fa468103310 2024-02-19T18:56:24.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:24.953+0000 7fa46ebf4700 1 -- 172.21.15.46:0/401868456 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa46802cee0 con 0x7fa45806c600 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: Detected new or changed devices on smithi046 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: Adjusting osd_memory_target on smithi046 to 5922M 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:25.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:56:25.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:56:25.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:25.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:25.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: Detected new or changed devices on smithi046 2024-02-19T18:56:25.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:25.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:25.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:56:25.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:56:25.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: Adjusting osd_memory_target on smithi046 to 5922M 2024-02-19T18:56:25.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:25.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:25.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:56:25.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:25.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:25.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:56:25.618 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:56:25.618 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:26.548 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:26 smithi046 ceph-mon[29647]: from='client.14310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:56:26.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:26 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:26.549 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:26 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:26.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:26 smithi142 ceph-mon[37169]: from='client.14310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:56:26.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:26 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:26.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:26 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:27.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:27 smithi046 ceph-mon[29647]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:27.649 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:27 smithi142 ceph-mon[37169]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:29.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:29 smithi046 ceph-mon[29647]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:29.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:29 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1617053582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5ae09b3-9419-4fc7-8cd5-4a2553bca213"}]: dispatch 2024-02-19T18:56:29.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:29 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1617053582' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5ae09b3-9419-4fc7-8cd5-4a2553bca213"}]': finished 2024-02-19T18:56:29.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:29 smithi046 ceph-mon[29647]: osdmap e16: 3 total, 2 up, 3 in 2024-02-19T18:56:29.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:29 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:29.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:29 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/27537603' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:56:29.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:29 smithi142 ceph-mon[37169]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:29.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:29 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1617053582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5ae09b3-9419-4fc7-8cd5-4a2553bca213"}]: dispatch 2024-02-19T18:56:29.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:29 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1617053582' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5ae09b3-9419-4fc7-8cd5-4a2553bca213"}]': finished 2024-02-19T18:56:29.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:29 smithi142 ceph-mon[37169]: osdmap e16: 3 total, 2 up, 3 in 2024-02-19T18:56:29.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:29 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:29.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:29 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/27537603' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:56:31.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:31 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:31.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:31 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:31.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:31 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:31.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:31 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:56:31.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:31 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:31.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:31 smithi142 ceph-mon[37169]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:31.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:31 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:31.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:31 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:31.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:31 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:31.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:31 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:56:31.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:31 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:31.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:31 smithi046 ceph-mon[29647]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:32.470 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:32 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:56:32.655 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:32 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:56:33.528 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:33 smithi046 ceph-mon[29647]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:33.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:33 smithi142 ceph-mon[37169]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:35.435 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:35 smithi046 ceph-mon[29647]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:35.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:35 smithi142 ceph-mon[37169]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:36.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:36 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T18:56:36.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:36 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:36.497 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:36 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T18:56:36.497 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:36 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:37.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:37 smithi046 ceph-mon[29647]: Deploying daemon osd.2 on smithi046 2024-02-19T18:56:37.571 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:37 smithi046 ceph-mon[29647]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:37.661 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:37 smithi142 ceph-mon[37169]: Deploying daemon osd.2 on smithi046 2024-02-19T18:56:37.661 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:37 smithi142 ceph-mon[37169]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:39.533 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:39 smithi046 ceph-mon[29647]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:39.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:39 smithi142 ceph-mon[37169]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:41.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:41 smithi046 ceph-mon[29647]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:41.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:41 smithi142 ceph-mon[37169]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:42.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:42 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:42.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:42 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:42.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:42 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:42 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:42.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:42 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:42.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:42 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:43.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:43 smithi046 ceph-mon[29647]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:43.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:43 smithi142 ceph-mon[37169]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:44.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.715+0000 7fa465ffb700 1 -- 172.21.15.46:0/401868456 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa46802cee0 con 0x7fa45806c600 2024-02-19T18:56:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 2 on host 'smithi046' 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 -- 172.21.15.46:0/401868456 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa45806c600 msgr2=0x7fa45806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa45806c600 0x7fa45806eab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa45400b5c0 tx=0x7fa454005ee0 comp rx=0 tx=0).stop 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 -- 172.21.15.46:0/401868456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa468103310 msgr2=0x7fa468100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa468103310 0x7fa468100720 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00d8d0 tx=0x7fa45c00dbe0 comp rx=0 tx=0).stop 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 -- 172.21.15.46:0/401868456 shutdown_connections 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa45806c600 0x7fa45806eab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa468103310 0x7fa468100720 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 --2- 172.21.15.46:0/401868456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4680fed70 0x7fa4680ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 -- 172.21.15.46:0/401868456 >> 172.21.15.46:0/401868456 conn(0x7fa4680fa780 msgr2=0x7fa4680fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 -- 172.21.15.46:0/401868456 shutdown_connections 2024-02-19T18:56:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:56:44.717+0000 7fa46ebf4700 1 -- 172.21.15.46:0/401868456 wait complete. 2024-02-19T18:56:45.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:45 smithi046 ceph-mon[29647]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:45.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:45 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:45.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:45 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:45.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:45 smithi046 ceph-mon[29647]: from='osd.2 [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T18:56:45.452 DEBUG:teuthology.orchestra.run.smithi046:osd.2> sudo journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.2.service 2024-02-19T18:56:45.455 INFO:tasks.cephadm:Deploying osd.3 on smithi142 with /dev/vg_nvme/lv_4... 2024-02-19T18:56:45.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-19T18:56:45.485 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:45 smithi142 ceph-mon[37169]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:45.485 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:45 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:45.485 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:45 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:45.485 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:45 smithi142 ceph-mon[37169]: from='osd.2 [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T18:56:45.667 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi142/config 2024-02-19T18:56:47.193 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:47 smithi046 ceph-mon[29647]: from='osd.2 [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T18:56:47.193 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:47 smithi046 ceph-mon[29647]: osdmap e17: 3 total, 2 up, 3 in 2024-02-19T18:56:47.194 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:47 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:47.194 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:47 smithi046 ceph-mon[29647]: from='osd.2 [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T18:56:47.194 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:47 smithi046 ceph-mon[29647]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:47.194 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 18:56:47 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[55708]: 2024-02-19T18:56:47.016+0000 7f0eb1856700 -1 osd.2 0 waiting for initial osdmap 2024-02-19T18:56:47.194 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 18:56:47 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[55708]: 2024-02-19T18:56:47.024+0000 7f0eac649700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T18:56:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:47 smithi142 ceph-mon[37169]: from='osd.2 [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T18:56:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:47 smithi142 ceph-mon[37169]: osdmap e17: 3 total, 2 up, 3 in 2024-02-19T18:56:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:47 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:47 smithi142 ceph-mon[37169]: from='osd.2 [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T18:56:47.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:47 smithi142 ceph-mon[37169]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-19T18:56:47.470 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-19T18:56:47.470 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2024-02-19T18:56:47.470 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2024-02-19T18:56:47.470 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0124768 s, 840 MB/s 2024-02-19T18:56:47.470 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2024-02-19T18:56:48.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi142:vg_nvme/lv_4 2024-02-19T18:56:48.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:48 smithi046 ceph-mon[29647]: from='osd.2 [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-02-19T18:56:48.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:48 smithi046 ceph-mon[29647]: osdmap e18: 3 total, 2 up, 3 in 2024-02-19T18:56:48.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:48.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:48.293 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:56:48.326 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi142/config 2024-02-19T18:56:48.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:48 smithi142 ceph-mon[37169]: from='osd.2 [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-02-19T18:56:48.510 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:48 smithi142 ceph-mon[37169]: osdmap e18: 3 total, 2 up, 3 in 2024-02-19T18:56:48.510 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:48 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:48.510 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:48 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:48.510 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:48 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:56:49.289 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:49 smithi046 ceph-mon[29647]: purged_snaps scrub starts 2024-02-19T18:56:49.289 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:49 smithi046 ceph-mon[29647]: purged_snaps scrub ok 2024-02-19T18:56:49.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:49 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:49.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:49 smithi046 ceph-mon[29647]: osd.2 [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723] boot 2024-02-19T18:56:49.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:49 smithi046 ceph-mon[29647]: osdmap e19: 3 total, 3 up, 3 in 2024-02-19T18:56:49.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:49 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:49.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:49 smithi046 ceph-mon[29647]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:49.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:49 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-19T18:56:49.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:49 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:49.290 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:49 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:49.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:49 smithi142 ceph-mon[37169]: purged_snaps scrub starts 2024-02-19T18:56:49.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:49 smithi142 ceph-mon[37169]: purged_snaps scrub ok 2024-02-19T18:56:49.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:49 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:49.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:49 smithi142 ceph-mon[37169]: osd.2 [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723] boot 2024-02-19T18:56:49.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:49 smithi142 ceph-mon[37169]: osdmap e19: 3 total, 3 up, 3 in 2024-02-19T18:56:49.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:49 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:56:49.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:49 smithi142 ceph-mon[37169]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:56:49.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:49 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-19T18:56:49.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:49 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:49.348 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:49 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.834+0000 7f45c0881700 1 -- 172.21.15.142:0/1208013961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc100240 msgr2=0x7f45bc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.834+0000 7f45c0881700 1 --2- 172.21.15.142:0/1208013961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc100240 0x7f45bc100650 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009910 tx=0x7f45b0009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.834+0000 7f45c0881700 1 -- 172.21.15.142:0/1208013961 shutdown_connections 2024-02-19T18:56:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.834+0000 7f45c0881700 1 --2- 172.21.15.142:0/1208013961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc101440 0x7f45bc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.834+0000 7f45c0881700 1 --2- 172.21.15.142:0/1208013961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc100240 0x7f45bc100650 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.834+0000 7f45c0881700 1 -- 172.21.15.142:0/1208013961 >> 172.21.15.142:0/1208013961 conn(0x7f45bc0fb7f0 msgr2=0x7f45bc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.834+0000 7f45c0881700 1 -- 172.21.15.142:0/1208013961 shutdown_connections 2024-02-19T18:56:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.835+0000 7f45c0881700 1 -- 172.21.15.142:0/1208013961 wait complete. 2024-02-19T18:56:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.835+0000 7f45c0881700 1 Processor -- start 2024-02-19T18:56:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.835+0000 7f45c0881700 1 -- start start 2024-02-19T18:56:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.835+0000 7f45c0881700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc100240 0x7f45bc195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.835+0000 7f45c0881700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc101440 0x7f45bc196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.835+0000 7f45c0881700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc196640 con 0x7f45bc101440 2024-02-19T18:56:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.835+0000 7f45c0881700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc196780 con 0x7f45bc100240 2024-02-19T18:56:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.835+0000 7f45ba59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc100240 0x7f45bc195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45ba59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc100240 0x7f45bc195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44628/0 (socket says 172.21.15.142:44628) 2024-02-19T18:56:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45ba59c700 1 -- 172.21.15.142:0/1420453248 learned_addr learned my addr 172.21.15.142:0/1420453248 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45b9d9b700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc101440 0x7f45bc196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45ba59c700 1 -- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc101440 msgr2=0x7f45bc196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45ba59c700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc101440 0x7f45bc196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45ba59c700 1 -- 172.21.15.142:0/1420453248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b00095f0 con 0x7f45bc100240 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45b9d9b700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc101440 0x7f45bc196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45ba59c700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc100240 0x7f45bc195ae0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f45b000bda0 tx=0x7f45b000be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45ab7fe700 1 -- 172.21.15.142:0/1420453248 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45b001d070 con 0x7f45bc100240 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45ab7fe700 1 -- 172.21.15.142:0/1420453248 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f45b000f460 con 0x7f45bc100240 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45c0881700 1 -- 172.21.15.142:0/1420453248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc19b1d0 con 0x7f45bc100240 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45ab7fe700 1 -- 172.21.15.142:0/1420453248 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45b0021640 con 0x7f45bc100240 2024-02-19T18:56:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.836+0000 7f45c0881700 1 -- 172.21.15.142:0/1420453248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc19b6c0 con 0x7f45bc100240 2024-02-19T18:56:49.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.837+0000 7f45c0881700 1 -- 172.21.15.142:0/1420453248 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc108d90 con 0x7f45bc100240 2024-02-19T18:56:49.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.838+0000 7f45ab7fe700 1 -- 172.21.15.142:0/1420453248 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f45b000f5d0 con 0x7f45bc100240 2024-02-19T18:56:49.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.838+0000 7f45ab7fe700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f45a406c600 0x7f45a406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:49.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.838+0000 7f45ab7fe700 1 -- 172.21.15.142:0/1420453248 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3221+0+0 (secure 0 0 0) 0x7f45b008c210 con 0x7f45bc100240 2024-02-19T18:56:49.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.839+0000 7f45b9d9b700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f45a406c600 0x7f45a406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:49.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.839+0000 7f45b9d9b700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f45a406c600 0x7f45a406eab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00bc10 tx=0x7f45ac00b5f0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:49.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:49.843+0000 7f45ab7fe700 1 -- 172.21.15.142:0/1420453248 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f45b005ad20 con 0x7f45bc100240 2024-02-19T18:56:50.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:50.042+0000 7f45c0881700 1 -- 172.21.15.142:0/1420453248 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f45bc19bd00 con 0x7f45a406c600 2024-02-19T18:56:50.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:50 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-19T18:56:50.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:50 smithi046 ceph-mon[29647]: osdmap e20: 3 total, 3 up, 3 in 2024-02-19T18:56:50.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:50 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T18:56:50.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:50 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-19T18:56:50.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:50 smithi142 ceph-mon[37169]: osdmap e20: 3 total, 3 up, 3 in 2024-02-19T18:56:50.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:50 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T18:56:51.188 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:51 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-19T18:56:51.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:51 smithi046 ceph-mon[29647]: osdmap e21: 3 total, 3 up, 3 in 2024-02-19T18:56:51.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:51 smithi046 ceph-mon[29647]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:56:51.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:51 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:56:51.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:51 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:56:51.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:51 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:51.189 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:51 smithi046 ceph-mon[29647]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:56:51.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:51 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-19T18:56:51.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:51 smithi142 ceph-mon[37169]: osdmap e21: 3 total, 3 up, 3 in 2024-02-19T18:56:51.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:51 smithi142 ceph-mon[37169]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:56:51.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:51 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:56:51.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:51 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:56:51.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:51 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:51.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:51 smithi142 ceph-mon[37169]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:56:51.455 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58003]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-19T18:56:51.455 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58003]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:56:51.455 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58003]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:56:51.455 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58003]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:56:51.719 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58006]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-19T18:56:51.719 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58006]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:56:51.719 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58006]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:56:51.720 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58006]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:56:52.015 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58041]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-19T18:56:52.015 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58041]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:56:52.015 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58041]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:56:52.015 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58041]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:56:52.282 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58112]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-19T18:56:52.282 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58112]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:56:52.282 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 18:56:51 smithi046 sudo[58112]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:56:52.282 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58112]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:56:52.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: osdmap e22: 3 total, 3 up, 3 in 2024-02-19T18:56:52.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:52.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:52.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:52.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:56:52.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:56:52.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:56:52.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:52.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:52.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:56:52.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:52.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:52.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: osdmap e22: 3 total, 3 up, 3 in 2024-02-19T18:56:52.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:52.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:52.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:52.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:56:52.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:56:52.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:56:52.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:52.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:52.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:56:52.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:52.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:52.544 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58200]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-19T18:56:52.544 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58200]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:56:52.544 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58200]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:56:52.544 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58200]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:56:52.804 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58217]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-19T18:56:52.805 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58217]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:56:52.805 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58217]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:56:52.805 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58217]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:56:53.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58223]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-19T18:56:53.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58223]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:56:53.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58223]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:56:53.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:52 smithi046 sudo[58223]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:56:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:53 smithi046 sudo[58323]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-19T18:56:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:53 smithi046 sudo[58323]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:56:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:53 smithi046 sudo[58323]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:56:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:53 smithi046 sudo[58323]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:56:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:53 smithi046 ceph-mon[29647]: Detected new or changed devices on smithi046 2024-02-19T18:56:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:53 smithi046 ceph-mon[29647]: Adjusting osd_memory_target on smithi046 to 3948M 2024-02-19T18:56:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:53 smithi046 ceph-mon[29647]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:56:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:53 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/781207078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8"}]: dispatch 2024-02-19T18:56:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:53 smithi046 ceph-mon[29647]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8"}]: dispatch 2024-02-19T18:56:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:53 smithi046 ceph-mon[29647]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-19T18:56:53.334 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 ceph-mon[37169]: Detected new or changed devices on smithi046 2024-02-19T18:56:53.335 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 ceph-mon[37169]: Adjusting osd_memory_target on smithi046 to 3948M 2024-02-19T18:56:53.335 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 ceph-mon[37169]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:56:53.335 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 ceph-mon[37169]: from='client.? 172.21.15.142:0/781207078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8"}]: dispatch 2024-02-19T18:56:53.335 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 ceph-mon[37169]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8"}]: dispatch 2024-02-19T18:56:53.335 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 ceph-mon[37169]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-19T18:56:53.589 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 sudo[41140]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-19T18:56:53.589 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 sudo[41140]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:56:53.589 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 sudo[41140]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:56:53.589 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 sudo[41140]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:56:53.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 sudo[41161]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-19T18:56:53.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 sudo[41161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:56:53.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 sudo[41161]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:56:53.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:53 smithi142 sudo[41161]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:56:54.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:56:54.107+0000 7f45ab7fe700 1 -- 172.21.15.142:0/1420453248 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f45b0057660 con 0x7f45bc100240 2024-02-19T18:56:54.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-19T18:56:54.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T18:56:54.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8"}]': finished 2024-02-19T18:56:54.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: osdmap e23: 4 total, 3 up, 4 in 2024-02-19T18:56:54.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:56:54.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:56:54.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-19T18:56:54.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T18:56:54.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:56:54.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-19T18:56:54.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:54.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:54 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/4219114857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:56:54.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-19T18:56:54.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T18:56:54.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8"}]': finished 2024-02-19T18:56:54.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: osdmap e23: 4 total, 3 up, 4 in 2024-02-19T18:56:54.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:56:54.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:56:54.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-19T18:56:54.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T18:56:54.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T18:56:54.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-19T18:56:54.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:54.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:54 smithi142 ceph-mon[37169]: from='client.? 172.21.15.142:0/4219114857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:56:55.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:55 smithi142 ceph-mon[37169]: mgrmap e19: smithi046.qtceex(active, since 2m), standbys: smithi142.fwekwv 2024-02-19T18:56:55.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:55 smithi142 ceph-mon[37169]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:56:55.517 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:55 smithi046 ceph-mon[29647]: mgrmap e19: smithi046.qtceex(active, since 2m), standbys: smithi142.fwekwv 2024-02-19T18:56:55.517 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:55 smithi046 ceph-mon[29647]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:56:57.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:57.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:57.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:56 smithi046 ceph-mon[29647]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:56:57.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:57.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:56:57.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:56 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:57.422 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:56 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:57.422 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:56 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:57.423 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:56 smithi142 ceph-mon[37169]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:56:57.423 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:56 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:56:57.423 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:56 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:56:57.423 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:56 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:56:59.397 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:56:59 smithi142 ceph-mon[37169]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:56:59.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:56:59 smithi046 ceph-mon[29647]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:01.170 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:01 smithi142 ceph-mon[37169]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:01.170 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:01 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T18:57:01.170 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:01 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:01.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:01 smithi046 ceph-mon[29647]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:01.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:01 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T18:57:01.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:01 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:02.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:02 smithi046 ceph-mon[29647]: Deploying daemon osd.3 on smithi142 2024-02-19T18:57:02.418 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:02 smithi142 ceph-mon[37169]: Deploying daemon osd.3 on smithi142 2024-02-19T18:57:03.228 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:03 smithi142 ceph-mon[37169]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:03.228 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:03 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:03.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:03 smithi046 ceph-mon[29647]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:03.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:03 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:05.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:05 smithi046 ceph-mon[29647]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:05.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:05 smithi142 ceph-mon[37169]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:06.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:06 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:06.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:06 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:06.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:06 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:06.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:06 smithi046 ceph-mon[29647]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:06.861 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:06 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:06.861 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:06 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:06.861 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:06 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:06.861 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:06 smithi142 ceph-mon[37169]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:08.574 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 3 on host 'smithi142' 2024-02-19T18:57:08.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.555+0000 7f45ab7fe700 1 -- 172.21.15.142:0/1420453248 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f45bc19bd00 con 0x7f45a406c600 2024-02-19T18:57:08.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.558+0000 7f45c0881700 1 -- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f45a406c600 msgr2=0x7f45a406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:08.576 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.558+0000 7f45c0881700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f45a406c600 0x7f45a406eab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00bc10 tx=0x7f45ac00b5f0 comp rx=0 tx=0).stop 2024-02-19T18:57:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.559+0000 7f45c0881700 1 -- 172.21.15.142:0/1420453248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc100240 msgr2=0x7f45bc195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.559+0000 7f45c0881700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc100240 0x7f45bc195ae0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f45b000bda0 tx=0x7f45b000be80 comp rx=0 tx=0).stop 2024-02-19T18:57:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.559+0000 7f45c0881700 1 -- 172.21.15.142:0/1420453248 shutdown_connections 2024-02-19T18:57:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.559+0000 7f45c0881700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f45a406c600 0x7f45a406eab0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.559+0000 7f45c0881700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45bc100240 0x7f45bc195ae0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.559+0000 7f45c0881700 1 --2- 172.21.15.142:0/1420453248 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc101440 0x7f45bc196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.559+0000 7f45c0881700 1 -- 172.21.15.142:0/1420453248 >> 172.21.15.142:0/1420453248 conn(0x7f45bc0fb7f0 msgr2=0x7f45bc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.559+0000 7f45c0881700 1 -- 172.21.15.142:0/1420453248 shutdown_connections 2024-02-19T18:57:08.577 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:08.559+0000 7f45c0881700 1 -- 172.21.15.142:0/1420453248 wait complete. 2024-02-19T18:57:09.314 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:09 smithi142 ceph-mon[37169]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:09.314 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:09.314 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:09 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:09 smithi046 ceph-mon[29647]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:09.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:09 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:09.681 DEBUG:teuthology.orchestra.run.smithi142:osd.3> sudo journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.3.service 2024-02-19T18:57:09.683 INFO:tasks.cephadm:Deploying osd.4 on smithi142 with /dev/vg_nvme/lv_3... 2024-02-19T18:57:09.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-19T18:57:09.933 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi142/config 2024-02-19T18:57:10.380 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:10 smithi142 ceph-mon[37169]: from='osd.3 [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T18:57:10.380 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:10 smithi142 ceph-mon[37169]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T18:57:10.380 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:10 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:10.380 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:10 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:10.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:10 smithi046 ceph-mon[29647]: from='osd.3 [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T18:57:10.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:10 smithi046 ceph-mon[29647]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T18:57:10.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:10 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:10.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:10 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:11.363 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:11 smithi142 ceph-mon[37169]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:11.363 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:11 smithi142 ceph-mon[37169]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T18:57:11.363 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:11 smithi142 ceph-mon[37169]: osdmap e24: 4 total, 3 up, 4 in 2024-02-19T18:57:11.363 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:11 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:57:11.363 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:11 smithi142 ceph-mon[37169]: from='osd.3 [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:57:11.363 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:11 smithi142 ceph-mon[37169]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:57:11.364 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 18:57:11 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[43200]: 2024-02-19T18:57:11.205+0000 7f14f5b19700 -1 osd.3 0 waiting for initial osdmap 2024-02-19T18:57:11.364 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 18:57:11 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[43200]: 2024-02-19T18:57:11.211+0000 7f14ef90a700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T18:57:11.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:11 smithi046 ceph-mon[29647]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:11.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:11 smithi046 ceph-mon[29647]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T18:57:11.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:11 smithi046 ceph-mon[29647]: osdmap e24: 4 total, 3 up, 4 in 2024-02-19T18:57:11.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:11 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:57:11.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:11 smithi046 ceph-mon[29647]: from='osd.3 [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:57:11.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:11 smithi046 ceph-mon[29647]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:57:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-19T18:57:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-19T18:57:11.954 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2024-02-19T18:57:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2024-02-19T18:57:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127789 s, 821 MB/s 2024-02-19T18:57:11.954 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2024-02-19T18:57:12.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:12 smithi046 ceph-mon[29647]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-02-19T18:57:12.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:12 smithi046 ceph-mon[29647]: osdmap e25: 4 total, 3 up, 4 in 2024-02-19T18:57:12.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:12 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:57:12.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:12 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:57:12.603 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:12 smithi142 ceph-mon[37169]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-02-19T18:57:12.603 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:12 smithi142 ceph-mon[37169]: osdmap e25: 4 total, 3 up, 4 in 2024-02-19T18:57:12.603 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:12 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:57:12.603 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:12 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:57:12.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi142:vg_nvme/lv_3 2024-02-19T18:57:13.413 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:13 smithi142 ceph-mon[37169]: purged_snaps scrub starts 2024-02-19T18:57:13.413 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:13 smithi142 ceph-mon[37169]: purged_snaps scrub ok 2024-02-19T18:57:13.413 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:13 smithi142 ceph-mon[37169]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:13.413 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:13 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:57:13.413 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:13 smithi142 ceph-mon[37169]: osd.3 [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248] boot 2024-02-19T18:57:13.413 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:13 smithi142 ceph-mon[37169]: osdmap e26: 4 total, 4 up, 4 in 2024-02-19T18:57:13.413 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:13 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:57:13.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:13 smithi046 ceph-mon[29647]: purged_snaps scrub starts 2024-02-19T18:57:13.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:13 smithi046 ceph-mon[29647]: purged_snaps scrub ok 2024-02-19T18:57:13.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:13 smithi046 ceph-mon[29647]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:57:13.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:13 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:57:13.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:13 smithi046 ceph-mon[29647]: osd.3 [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248] boot 2024-02-19T18:57:13.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:13 smithi046 ceph-mon[29647]: osdmap e26: 4 total, 4 up, 4 in 2024-02-19T18:57:13.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:13 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:57:13.712 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi142/config 2024-02-19T18:57:14.412 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:14 smithi142 ceph-mon[37169]: osdmap e27: 4 total, 4 up, 4 in 2024-02-19T18:57:14.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:14 smithi046 ceph-mon[29647]: osdmap e27: 4 total, 4 up, 4 in 2024-02-19T18:57:15.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:15.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: osdmap e28: 4 total, 4 up, 4 in 2024-02-19T18:57:15.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:15.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:15.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:57:15.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:15.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:15.512 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:15.512 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:15.512 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: osdmap e29: 4 total, 4 up, 4 in 2024-02-19T18:57:15.512 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:15.512 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:15.512 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:15.512 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:15 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:15.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:15.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: osdmap e28: 4 total, 4 up, 4 in 2024-02-19T18:57:15.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:15.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:15.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:57:15.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:15.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:15.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:15.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:15.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: osdmap e29: 4 total, 4 up, 4 in 2024-02-19T18:57:15.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:15.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:15.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:15.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:15 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.816+0000 7fdc36645700 1 -- 172.21.15.142:0/2482638045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc300ff130 msgr2=0x7fdc300ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.816+0000 7fdc36645700 1 --2- 172.21.15.142:0/2482638045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc300ff130 0x7fdc300ff540 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009910 tx=0x7fdc20009c20 comp rx=0 tx=0).stop 2024-02-19T18:57:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.816+0000 7fdc36645700 1 -- 172.21.15.142:0/2482638045 shutdown_connections 2024-02-19T18:57:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.816+0000 7fdc36645700 1 --2- 172.21.15.142:0/2482638045 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc301003d0 0x7fdc30100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.816+0000 7fdc36645700 1 --2- 172.21.15.142:0/2482638045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc300ff130 0x7fdc300ff540 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.816+0000 7fdc36645700 1 -- 172.21.15.142:0/2482638045 >> 172.21.15.142:0/2482638045 conn(0x7fdc300fa780 msgr2=0x7fdc300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.816+0000 7fdc36645700 1 -- 172.21.15.142:0/2482638045 shutdown_connections 2024-02-19T18:57:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.816+0000 7fdc36645700 1 -- 172.21.15.142:0/2482638045 wait complete. 2024-02-19T18:57:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc36645700 1 Processor -- start 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc36645700 1 -- start start 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc36645700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc300ff130 0x7fdc30108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc36645700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc301003d0 0x7fdc30106cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc36645700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30107210 con 0x7fdc301003d0 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc36645700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30107350 con 0x7fdc300ff130 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc2ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc300ff130 0x7fdc30108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc2ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc300ff130 0x7fdc30108680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60102/0 (socket says 172.21.15.142:60102) 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc2ffff700 1 -- 172.21.15.142:0/4048808316 learned_addr learned my addr 172.21.15.142:0/4048808316 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc2ffff700 1 -- 172.21.15.142:0/4048808316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc301003d0 msgr2=0x7fdc30106cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc27fff700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc301003d0 0x7fdc30106cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc2ffff700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc301003d0 0x7fdc30106cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc2ffff700 1 -- 172.21.15.142:0/4048808316 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc200095f0 con 0x7fdc300ff130 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.817+0000 7fdc2ffff700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc300ff130 0x7fdc30108680 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000bd70 tx=0x7fdc2000be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.818+0000 7fdc2dffb700 1 -- 172.21.15.142:0/4048808316 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc2001d070 con 0x7fdc300ff130 2024-02-19T18:57:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.818+0000 7fdc36645700 1 -- 172.21.15.142:0/4048808316 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc301075d0 con 0x7fdc300ff130 2024-02-19T18:57:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.818+0000 7fdc2dffb700 1 -- 172.21.15.142:0/4048808316 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc20022470 con 0x7fdc300ff130 2024-02-19T18:57:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.818+0000 7fdc2dffb700 1 -- 172.21.15.142:0/4048808316 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc2000f670 con 0x7fdc300ff130 2024-02-19T18:57:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.818+0000 7fdc36645700 1 -- 172.21.15.142:0/4048808316 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc30107ac0 con 0x7fdc300ff130 2024-02-19T18:57:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.819+0000 7fdc36645700 1 -- 172.21.15.142:0/4048808316 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc30108ca0 con 0x7fdc300ff130 2024-02-19T18:57:15.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.819+0000 7fdc2dffb700 1 -- 172.21.15.142:0/4048808316 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fdc20022a50 con 0x7fdc300ff130 2024-02-19T18:57:15.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.819+0000 7fdc2dffb700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fdc1c06c680 0x7fdc1c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:15.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.819+0000 7fdc2dffb700 1 -- 172.21.15.142:0/4048808316 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3774+0+0 (secure 0 0 0) 0x7fdc2008c830 con 0x7fdc300ff130 2024-02-19T18:57:15.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.820+0000 7fdc27fff700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fdc1c06c680 0x7fdc1c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:15.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.820+0000 7fdc27fff700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fdc1c06c680 0x7fdc1c06eb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc18005950 tx=0x7fdc18005cf0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:15.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:15.824+0000 7fdc2dffb700 1 -- 172.21.15.142:0/4048808316 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdc2005b0f0 con 0x7fdc300ff130 2024-02-19T18:57:16.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:16.022+0000 7fdc36645700 1 -- 172.21.15.142:0/4048808316 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc3019df40 con 0x7fdc1c06c680 2024-02-19T18:57:16.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:16 smithi142 ceph-mon[37169]: Detected new or changed devices on smithi142 2024-02-19T18:57:16.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:16 smithi142 ceph-mon[37169]: Adjusting osd_memory_target on smithi142 to 14912M 2024-02-19T18:57:16.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:16 smithi142 ceph-mon[37169]: osdmap e30: 4 total, 4 up, 4 in 2024-02-19T18:57:16.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:16 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:57:16.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:16 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:57:16.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:16 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:16.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:16 smithi046 ceph-mon[29647]: Detected new or changed devices on smithi142 2024-02-19T18:57:16.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:16 smithi046 ceph-mon[29647]: Adjusting osd_memory_target on smithi142 to 14912M 2024-02-19T18:57:16.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:16 smithi046 ceph-mon[29647]: osdmap e30: 4 total, 4 up, 4 in 2024-02-19T18:57:16.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:16 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:57:16.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:16 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:57:16.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:16 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:17.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:17 smithi046 ceph-mon[29647]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:57:17.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:17 smithi046 ceph-mon[29647]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-02-19T18:57:17.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:17.609 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:17 smithi142 ceph-mon[37169]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:57:17.609 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:17 smithi142 ceph-mon[37169]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-02-19T18:57:17.609 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:19.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:19 smithi046 ceph-mon[29647]: pgmap v101: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-02-19T18:57:19.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:19 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/4030209083' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a0ce92a-f9ac-4f83-877f-93eff87a9f8e"}]: dispatch 2024-02-19T18:57:19.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:19 smithi046 ceph-mon[29647]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a0ce92a-f9ac-4f83-877f-93eff87a9f8e"}]: dispatch 2024-02-19T18:57:19.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:19 smithi046 ceph-mon[29647]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a0ce92a-f9ac-4f83-877f-93eff87a9f8e"}]': finished 2024-02-19T18:57:19.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:19 smithi046 ceph-mon[29647]: osdmap e31: 5 total, 4 up, 5 in 2024-02-19T18:57:19.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:19 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:57:19.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:19 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/4094632391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:57:19.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:19 smithi142 ceph-mon[37169]: pgmap v101: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-02-19T18:57:19.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:19 smithi142 ceph-mon[37169]: from='client.? 172.21.15.142:0/4030209083' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a0ce92a-f9ac-4f83-877f-93eff87a9f8e"}]: dispatch 2024-02-19T18:57:19.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:19 smithi142 ceph-mon[37169]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a0ce92a-f9ac-4f83-877f-93eff87a9f8e"}]: dispatch 2024-02-19T18:57:19.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:19 smithi142 ceph-mon[37169]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a0ce92a-f9ac-4f83-877f-93eff87a9f8e"}]': finished 2024-02-19T18:57:19.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:19 smithi142 ceph-mon[37169]: osdmap e31: 5 total, 4 up, 5 in 2024-02-19T18:57:19.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:19 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:57:19.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:19 smithi142 ceph-mon[37169]: from='client.? 172.21.15.142:0/4094632391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:57:21.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:21 smithi046 ceph-mon[29647]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-02-19T18:57:21.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:21 smithi142 ceph-mon[37169]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-02-19T18:57:23.477 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:23 smithi142 ceph-mon[37169]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:23.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:23 smithi046 ceph-mon[29647]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:25.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:25 smithi142 ceph-mon[37169]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:25 smithi046 ceph-mon[29647]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:26.549 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:26 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T18:57:26.549 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:26 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:26.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:26 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T18:57:26.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:26 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:27.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:27 smithi142 ceph-mon[37169]: Deploying daemon osd.4 on smithi142 2024-02-19T18:57:27.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:27 smithi142 ceph-mon[37169]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:27.479 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:27 smithi046 ceph-mon[29647]: Deploying daemon osd.4 on smithi142 2024-02-19T18:57:27.479 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:27 smithi046 ceph-mon[29647]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:29.312 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:29 smithi142 ceph-mon[37169]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:29.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:29 smithi046 ceph-mon[29647]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:31.298 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:31 smithi142 ceph-mon[37169]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:31.298 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:31 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:31.298 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:31 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:31.298 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:31 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:31.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:31 smithi046 ceph-mon[29647]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:31.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:31 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:31.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:31 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:31.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:31 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:32.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:32 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:32.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:32 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:33.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:33 smithi142 ceph-mon[37169]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:33.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:33 smithi046 ceph-mon[29647]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:34.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.781+0000 7fdc2dffb700 1 -- 172.21.15.142:0/4048808316 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdc3019df40 con 0x7fdc1c06c680 2024-02-19T18:57:34.799 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 4 on host 'smithi142' 2024-02-19T18:57:34.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 -- 172.21.15.142:0/4048808316 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fdc1c06c680 msgr2=0x7fdc1c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:34.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fdc1c06c680 0x7fdc1c06eb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc18005950 tx=0x7fdc18005cf0 comp rx=0 tx=0).stop 2024-02-19T18:57:34.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 -- 172.21.15.142:0/4048808316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc300ff130 msgr2=0x7fdc30108680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:34.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc300ff130 0x7fdc30108680 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000bd70 tx=0x7fdc2000be50 comp rx=0 tx=0).stop 2024-02-19T18:57:34.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 -- 172.21.15.142:0/4048808316 shutdown_connections 2024-02-19T18:57:34.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fdc1c06c680 0x7fdc1c06eb30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:34.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc300ff130 0x7fdc30108680 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:34.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 --2- 172.21.15.142:0/4048808316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc301003d0 0x7fdc30106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:34.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 -- 172.21.15.142:0/4048808316 >> 172.21.15.142:0/4048808316 conn(0x7fdc300fa780 msgr2=0x7fdc30103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:34.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 -- 172.21.15.142:0/4048808316 shutdown_connections 2024-02-19T18:57:34.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:34.784+0000 7fdc36645700 1 -- 172.21.15.142:0/4048808316 wait complete. 2024-02-19T18:57:35.407 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:35 smithi142 ceph-mon[37169]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:35.407 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:35 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:35.407 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:35 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:35.407 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:35 smithi142 ceph-mon[37169]: from='osd.4 [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T18:57:35.407 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:35 smithi142 ceph-mon[37169]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T18:57:35.407 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:35 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:35.408 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:35 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:35.430 DEBUG:teuthology.orchestra.run.smithi142:osd.4> sudo journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.4.service 2024-02-19T18:57:35.432 INFO:tasks.cephadm:Deploying osd.5 on smithi142 with /dev/vg_nvme/lv_2... 2024-02-19T18:57:35.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-19T18:57:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:35 smithi046 ceph-mon[29647]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:35 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:35 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:35 smithi046 ceph-mon[29647]: from='osd.4 [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T18:57:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:35 smithi046 ceph-mon[29647]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T18:57:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:35 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:35 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:36.127 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi142/config 2024-02-19T18:57:36.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:36 smithi142 ceph-mon[37169]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T18:57:36.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:36 smithi142 ceph-mon[37169]: osdmap e32: 5 total, 4 up, 5 in 2024-02-19T18:57:36.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:36 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:57:36.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:36 smithi142 ceph-mon[37169]: from='osd.4 [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:57:36.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:36 smithi142 ceph-mon[37169]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:57:36.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:36 smithi142 ceph-mon[37169]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:36.949 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 18:57:36 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[47837]: 2024-02-19T18:57:36.754+0000 7f5e26041700 -1 osd.4 0 waiting for initial osdmap 2024-02-19T18:57:36.949 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 18:57:36 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[47837]: 2024-02-19T18:57:36.761+0000 7f5e1ee30700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T18:57:37.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:36 smithi046 ceph-mon[29647]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T18:57:37.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:36 smithi046 ceph-mon[29647]: osdmap e32: 5 total, 4 up, 5 in 2024-02-19T18:57:37.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:36 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:57:37.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:36 smithi046 ceph-mon[29647]: from='osd.4 [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:57:37.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:36 smithi046 ceph-mon[29647]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:57:37.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:36 smithi046 ceph-mon[29647]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:57:37.894 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:37 smithi142 ceph-mon[37169]: purged_snaps scrub starts 2024-02-19T18:57:37.894 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:37 smithi142 ceph-mon[37169]: purged_snaps scrub ok 2024-02-19T18:57:37.894 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:37 smithi142 ceph-mon[37169]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-02-19T18:57:37.894 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:37 smithi142 ceph-mon[37169]: osdmap e33: 5 total, 4 up, 5 in 2024-02-19T18:57:37.894 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:37 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:57:37.894 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:37 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:57:38.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:37 smithi046 ceph-mon[29647]: purged_snaps scrub starts 2024-02-19T18:57:38.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:37 smithi046 ceph-mon[29647]: purged_snaps scrub ok 2024-02-19T18:57:38.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:37 smithi046 ceph-mon[29647]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-02-19T18:57:38.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:37 smithi046 ceph-mon[29647]: osdmap e33: 5 total, 4 up, 5 in 2024-02-19T18:57:38.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:37 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:57:38.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:37 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:57:38.749 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-19T18:57:38.750 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-19T18:57:38.750 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2024-02-19T18:57:38.750 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2024-02-19T18:57:38.750 INFO:teuthology.orchestra.run.smithi142.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123966 s, 846 MB/s 2024-02-19T18:57:38.750 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2024-02-19T18:57:39.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:38 smithi046 ceph-mon[29647]: osd.4 [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445] boot 2024-02-19T18:57:39.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:38 smithi046 ceph-mon[29647]: osdmap e34: 5 total, 5 up, 5 in 2024-02-19T18:57:39.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:38 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:57:39.078 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:38 smithi046 ceph-mon[29647]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:39.146 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:38 smithi142 ceph-mon[37169]: osd.4 [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445] boot 2024-02-19T18:57:39.146 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:38 smithi142 ceph-mon[37169]: osdmap e34: 5 total, 5 up, 5 in 2024-02-19T18:57:39.146 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:38 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:57:39.146 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:38 smithi142 ceph-mon[37169]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:39.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi142:vg_nvme/lv_2 2024-02-19T18:57:39.961 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi142/config 2024-02-19T18:57:40.077 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:39 smithi046 ceph-mon[29647]: osdmap e35: 5 total, 5 up, 5 in 2024-02-19T18:57:40.083 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:39 smithi142 ceph-mon[37169]: osdmap e35: 5 total, 5 up, 5 in 2024-02-19T18:57:41.178 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: Detected new or changed devices on smithi142 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: Adjusting osd_memory_target on smithi142 to 7456M 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:41.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:40 smithi142 ceph-mon[37169]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:41.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: Detected new or changed devices on smithi142 2024-02-19T18:57:41.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:41.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:41.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:57:41.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:57:41.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: Adjusting osd_memory_target on smithi142 to 7456M 2024-02-19T18:57:41.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:41.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:41.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:41.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:41.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:41.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:41.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:41.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:41.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:40 smithi046 ceph-mon[29647]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:41.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.491+0000 7f87c1345700 1 -- 172.21.15.142:0/1881840083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87bc0ff130 msgr2=0x7f87bc0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:41.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.491+0000 7f87c1345700 1 --2- 172.21.15.142:0/1881840083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87bc0ff130 0x7f87bc0ff540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009910 tx=0x7f87b0009c20 comp rx=0 tx=0).stop 2024-02-19T18:57:41.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.491+0000 7f87c1345700 1 -- 172.21.15.142:0/1881840083 shutdown_connections 2024-02-19T18:57:41.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.491+0000 7f87c1345700 1 --2- 172.21.15.142:0/1881840083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87bc1003d0 0x7f87bc100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:41.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.491+0000 7f87c1345700 1 --2- 172.21.15.142:0/1881840083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87bc0ff130 0x7f87bc0ff540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:41.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.491+0000 7f87c1345700 1 -- 172.21.15.142:0/1881840083 >> 172.21.15.142:0/1881840083 conn(0x7f87bc0fa780 msgr2=0x7f87bc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:41.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.491+0000 7f87c1345700 1 -- 172.21.15.142:0/1881840083 shutdown_connections 2024-02-19T18:57:41.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.491+0000 7f87c1345700 1 -- 172.21.15.142:0/1881840083 wait complete. 2024-02-19T18:57:41.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87c1345700 1 Processor -- start 2024-02-19T18:57:41.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87c1345700 1 -- start start 2024-02-19T18:57:41.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87c1345700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87bc0ff130 0x7f87bc103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:41.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87c1345700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87bc1003d0 0x7f87bc1017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:41.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87c1345700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc101cf0 con 0x7f87bc0ff130 2024-02-19T18:57:41.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87c1345700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc101e30 con 0x7f87bc1003d0 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87ba7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87bc1003d0 0x7f87bc1017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87ba7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87bc1003d0 0x7f87bc1017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51312/0 (socket says 172.21.15.142:51312) 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87ba7fc700 1 -- 172.21.15.142:0/2272832638 learned_addr learned my addr 172.21.15.142:0/2272832638 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87baffd700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87bc0ff130 0x7f87bc103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87ba7fc700 1 -- 172.21.15.142:0/2272832638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87bc0ff130 msgr2=0x7f87bc103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87ba7fc700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87bc0ff130 0x7f87bc103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.492+0000 7f87ba7fc700 1 -- 172.21.15.142:0/2272832638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b00095f0 con 0x7f87bc1003d0 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.493+0000 7f87ba7fc700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87bc1003d0 0x7f87bc1017b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f87ac00c8a0 tx=0x7f87ac00cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.493+0000 7f87a3fff700 1 -- 172.21.15.142:0/2272832638 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87ac00cea0 con 0x7f87bc1003d0 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.493+0000 7f87c1345700 1 -- 172.21.15.142:0/2272832638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87bc102110 con 0x7f87bc1003d0 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.493+0000 7f87a3fff700 1 -- 172.21.15.142:0/2272832638 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f87ac004830 con 0x7f87bc1003d0 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.493+0000 7f87a3fff700 1 -- 172.21.15.142:0/2272832638 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87ac0055b0 con 0x7f87bc1003d0 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.493+0000 7f87c1345700 1 -- 172.21.15.142:0/2272832638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87bc19db00 con 0x7f87bc1003d0 2024-02-19T18:57:41.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.494+0000 7f87c1345700 1 -- 172.21.15.142:0/2272832638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87bc107c10 con 0x7f87bc1003d0 2024-02-19T18:57:41.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.494+0000 7f87a3fff700 1 -- 172.21.15.142:0/2272832638 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f87ac007ad0 con 0x7f87bc1003d0 2024-02-19T18:57:41.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.494+0000 7f87a3fff700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f87a406c680 0x7f87a406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:41.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.495+0000 7f87a3fff700 1 -- 172.21.15.142:0/2272832638 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f87ac08b0f0 con 0x7f87bc1003d0 2024-02-19T18:57:41.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.495+0000 7f87baffd700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f87a406c680 0x7f87a406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:41.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.495+0000 7f87baffd700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f87a406c680 0x7f87a406eb30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87b000b5c0 tx=0x7f87b0005960 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:41.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.499+0000 7f87a3fff700 1 -- 172.21.15.142:0/2272832638 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f87ac059750 con 0x7f87bc1003d0 2024-02-19T18:57:41.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:57:41.696+0000 7f87c1345700 1 -- 172.21.15.142:0/2272832638 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f87bc068c50 con 0x7f87a406c680 2024-02-19T18:57:42.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:42 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:57:42.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:42 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:57:42.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:42 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:42.366 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:42 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:57:42.366 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:42 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:57:42.366 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:42 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:43.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:43 smithi142 ceph-mon[37169]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:57:43.103 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:43 smithi142 ceph-mon[37169]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:43.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:43 smithi046 ceph-mon[29647]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:57:43.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:43 smithi046 ceph-mon[29647]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:44.570 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:44 smithi142 ceph-mon[37169]: from='client.? 172.21.15.142:0/2895683817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0eed1f5c-a999-43d8-95ae-1671ac54640b"}]: dispatch 2024-02-19T18:57:44.570 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:44 smithi142 ceph-mon[37169]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0eed1f5c-a999-43d8-95ae-1671ac54640b"}]: dispatch 2024-02-19T18:57:44.570 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:44 smithi142 ceph-mon[37169]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0eed1f5c-a999-43d8-95ae-1671ac54640b"}]': finished 2024-02-19T18:57:44.570 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:44 smithi142 ceph-mon[37169]: osdmap e36: 6 total, 5 up, 6 in 2024-02-19T18:57:44.570 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:44 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T18:57:44.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:44 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/2895683817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0eed1f5c-a999-43d8-95ae-1671ac54640b"}]: dispatch 2024-02-19T18:57:44.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:44 smithi046 ceph-mon[29647]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0eed1f5c-a999-43d8-95ae-1671ac54640b"}]: dispatch 2024-02-19T18:57:44.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:44 smithi046 ceph-mon[29647]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0eed1f5c-a999-43d8-95ae-1671ac54640b"}]': finished 2024-02-19T18:57:44.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:44 smithi046 ceph-mon[29647]: osdmap e36: 6 total, 5 up, 6 in 2024-02-19T18:57:44.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:44 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T18:57:45.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:45 smithi046 ceph-mon[29647]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:45.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:45 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/3068550126' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:57:45.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:45 smithi142 ceph-mon[37169]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:45.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:45 smithi142 ceph-mon[37169]: from='client.? 172.21.15.142:0/3068550126' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:57:47.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:47 smithi046 ceph-mon[29647]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:47.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:47 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:47.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:47 smithi142 ceph-mon[37169]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:47.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:47 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:49.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:49 smithi142 ceph-mon[37169]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:49.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:49 smithi046 ceph-mon[29647]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:51.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:51 smithi046 ceph-mon[29647]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:51.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:51 smithi142 ceph-mon[37169]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:52.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T18:57:52.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:52 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:52.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T18:57:52.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:52 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:53.145 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:53 smithi142 ceph-mon[37169]: Deploying daemon osd.5 on smithi142 2024-02-19T18:57:53.145 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:53 smithi142 ceph-mon[37169]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:53 smithi046 ceph-mon[29647]: Deploying daemon osd.5 on smithi142 2024-02-19T18:57:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:53 smithi046 ceph-mon[29647]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:55.466 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:55 smithi142 ceph-mon[37169]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:55.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:55 smithi046 ceph-mon[29647]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:57.374 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:57 smithi142 ceph-mon[37169]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:57.374 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:57 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:57.374 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:57 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:57.374 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:57 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:57.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:57 smithi046 ceph-mon[29647]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:57.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:57 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:57.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:57 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:57:57.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:57 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:59.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:57:59 smithi142 ceph-mon[37169]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:57:59.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:57:59 smithi046 ceph-mon[29647]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:58:00.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.361+0000 7f87a3fff700 1 -- 172.21.15.142:0/2272832638 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f87bc068c50 con 0x7f87a406c680 2024-02-19T18:58:00.379 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 5 on host 'smithi142' 2024-02-19T18:58:00.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.363+0000 7f87c1345700 1 -- 172.21.15.142:0/2272832638 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f87a406c680 msgr2=0x7f87a406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:00.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.363+0000 7f87c1345700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f87a406c680 0x7f87a406eb30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87b000b5c0 tx=0x7f87b0005960 comp rx=0 tx=0).stop 2024-02-19T18:58:00.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.364+0000 7f87c1345700 1 -- 172.21.15.142:0/2272832638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87bc1003d0 msgr2=0x7f87bc1017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:00.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.364+0000 7f87c1345700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87bc1003d0 0x7f87bc1017b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f87ac00c8a0 tx=0x7f87ac00cc60 comp rx=0 tx=0).stop 2024-02-19T18:58:00.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.364+0000 7f87c1345700 1 -- 172.21.15.142:0/2272832638 shutdown_connections 2024-02-19T18:58:00.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.364+0000 7f87c1345700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f87a406c680 0x7f87a406eb30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:00.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.364+0000 7f87c1345700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87bc0ff130 0x7f87bc103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:00.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.364+0000 7f87c1345700 1 --2- 172.21.15.142:0/2272832638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87bc1003d0 0x7f87bc1017b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:00.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.364+0000 7f87c1345700 1 -- 172.21.15.142:0/2272832638 >> 172.21.15.142:0/2272832638 conn(0x7f87bc0fa780 msgr2=0x7f87bc068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:00.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.364+0000 7f87c1345700 1 -- 172.21.15.142:0/2272832638 shutdown_connections 2024-02-19T18:58:00.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:00.364+0000 7f87c1345700 1 -- 172.21.15.142:0/2272832638 wait complete. 2024-02-19T18:58:01.214 DEBUG:teuthology.orchestra.run.smithi142:osd.5> sudo journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.5.service 2024-02-19T18:58:01.219 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-19T18:58:01.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd stat -f json 2024-02-19T18:58:01.446 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:01.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:01 smithi142 ceph-mon[37169]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:58:01.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:01 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:01.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:01 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:01.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:01 smithi142 ceph-mon[37169]: from='osd.5 [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T18:58:01.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:01 smithi142 ceph-mon[37169]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T18:58:01.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:01 smithi046 ceph-mon[29647]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:58:01.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:01 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:01.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:01 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:01.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:01 smithi046 ceph-mon[29647]: from='osd.5 [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T18:58:01.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:01 smithi046 ceph-mon[29647]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T18:58:02.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:02 smithi046 ceph-mon[29647]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T18:58:02.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:02 smithi046 ceph-mon[29647]: osdmap e37: 6 total, 5 up, 6 in 2024-02-19T18:58:02.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:02 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T18:58:02.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:02 smithi046 ceph-mon[29647]: from='osd.5 [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:58:02.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:02 smithi046 ceph-mon[29647]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:58:02.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:02 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:02.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:02 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:02.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:02 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:02.596 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:02 smithi142 ceph-mon[37169]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T18:58:02.596 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:02 smithi142 ceph-mon[37169]: osdmap e37: 6 total, 5 up, 6 in 2024-02-19T18:58:02.596 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:02 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T18:58:02.596 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:02 smithi142 ceph-mon[37169]: from='osd.5 [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:58:02.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:02 smithi142 ceph-mon[37169]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T18:58:02.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:02 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:02.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:02 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:02.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:02 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:02.597 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 18:58:02 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[52488]: 2024-02-19T18:58:02.326+0000 7f046cf0a700 -1 osd.5 0 waiting for initial osdmap 2024-02-19T18:58:02.597 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 18:58:02 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[52488]: 2024-02-19T18:58:02.334+0000 7f04654f8700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T18:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.186+0000 7f4f1499a700 1 -- 172.21.15.46:0/2098537293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10100250 msgr2=0x7f4f10100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.186+0000 7f4f1499a700 1 --2- 172.21.15.46:0/2098537293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10100250 0x7f4f10100660 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009910 tx=0x7f4f00009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.187+0000 7f4f1499a700 1 -- 172.21.15.46:0/2098537293 shutdown_connections 2024-02-19T18:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.187+0000 7f4f1499a700 1 --2- 172.21.15.46:0/2098537293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f10101450 0x7f4f101018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.187+0000 7f4f1499a700 1 --2- 172.21.15.46:0/2098537293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10100250 0x7f4f10100660 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.187+0000 7f4f1499a700 1 -- 172.21.15.46:0/2098537293 >> 172.21.15.46:0/2098537293 conn(0x7f4f100fb7e0 msgr2=0x7f4f100fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.187+0000 7f4f1499a700 1 -- 172.21.15.46:0/2098537293 shutdown_connections 2024-02-19T18:58:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.187+0000 7f4f1499a700 1 -- 172.21.15.46:0/2098537293 wait complete. 2024-02-19T18:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.187+0000 7f4f1499a700 1 Processor -- start 2024-02-19T18:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.187+0000 7f4f1499a700 1 -- start start 2024-02-19T18:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f1499a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10100250 0x7f4f10074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f1499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f10101450 0x7f4f10073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f1499a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f10073680 con 0x7f4f10100250 2024-02-19T18:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f1499a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f100737c0 con 0x7f4f10101450 2024-02-19T18:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f0e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10100250 0x7f4f10074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f0e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10100250 0x7f4f10074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43806/0 (socket says 172.21.15.46:43806) 2024-02-19T18:58:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f0e59c700 1 -- 172.21.15.46:0/2466904408 learned_addr learned my addr 172.21.15.46:0/2466904408 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f0dd9b700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f10101450 0x7f4f10073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f0e59c700 1 -- 172.21.15.46:0/2466904408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f10101450 msgr2=0x7f4f10073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f0e59c700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f10101450 0x7f4f10073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f0e59c700 1 -- 172.21.15.46:0/2466904408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f000095f0 con 0x7f4f10100250 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f0dd9b700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f10101450 0x7f4f10073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f0e59c700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10100250 0x7f4f10074af0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4f00000c00 tx=0x7f4f0000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.188+0000 7f4f077fe700 1 -- 172.21.15.46:0/2466904408 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0001d070 con 0x7f4f10100250 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.189+0000 7f4f1499a700 1 -- 172.21.15.46:0/2466904408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f10073a40 con 0x7f4f10100250 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.189+0000 7f4f077fe700 1 -- 172.21.15.46:0/2466904408 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4f00005dc0 con 0x7f4f10100250 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.189+0000 7f4f077fe700 1 -- 172.21.15.46:0/2466904408 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f00022470 con 0x7f4f10100250 2024-02-19T18:58:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.189+0000 7f4f1499a700 1 -- 172.21.15.46:0/2466904408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f10073f30 con 0x7f4f10100250 2024-02-19T18:58:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.190+0000 7f4f1499a700 1 -- 172.21.15.46:0/2466904408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f10108dc0 con 0x7f4f10100250 2024-02-19T18:58:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.190+0000 7f4f077fe700 1 -- 172.21.15.46:0/2466904408 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4f00003810 con 0x7f4f10100250 2024-02-19T18:58:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.191+0000 7f4f077fe700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4efc06c680 0x7f4efc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.191+0000 7f4f077fe700 1 -- 172.21.15.46:0/2466904408 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4358+0+0 (secure 0 0 0) 0x7f4f0008c910 con 0x7f4f10100250 2024-02-19T18:58:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.191+0000 7f4f0dd9b700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4efc06c680 0x7f4efc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.191+0000 7f4f0dd9b700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4efc06c680 0x7f4efc06eb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8011490 tx=0x7f4ef8009260 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:03.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.196+0000 7f4f077fe700 1 -- 172.21.15.46:0/2466904408 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4f0005aed0 con 0x7f4f10100250 2024-02-19T18:58:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.399+0000 7f4f1499a700 1 -- 172.21.15.46:0/2466904408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4f1019df60 con 0x7f4f10100250 2024-02-19T18:58:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.399+0000 7f4f077fe700 1 -- 172.21.15.46:0/2466904408 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4f0005aa60 con 0x7f4f10100250 2024-02-19T18:58:03.417 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:58:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.401+0000 7f4f1499a700 1 -- 172.21.15.46:0/2466904408 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4efc06c680 msgr2=0x7f4efc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.401+0000 7f4f1499a700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4efc06c680 0x7f4efc06eb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8011490 tx=0x7f4ef8009260 comp rx=0 tx=0).stop 2024-02-19T18:58:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.401+0000 7f4f1499a700 1 -- 172.21.15.46:0/2466904408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10100250 msgr2=0x7f4f10074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.401+0000 7f4f1499a700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10100250 0x7f4f10074af0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4f00000c00 tx=0x7f4f0000f690 comp rx=0 tx=0).stop 2024-02-19T18:58:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.402+0000 7f4f1499a700 1 -- 172.21.15.46:0/2466904408 shutdown_connections 2024-02-19T18:58:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.402+0000 7f4f1499a700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4efc06c680 0x7f4efc06eb30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.402+0000 7f4f1499a700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10100250 0x7f4f10074af0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.402+0000 7f4f1499a700 1 --2- 172.21.15.46:0/2466904408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f10101450 0x7f4f10073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.402+0000 7f4f1499a700 1 -- 172.21.15.46:0/2466904408 >> 172.21.15.46:0/2466904408 conn(0x7f4f100fb7e0 msgr2=0x7f4f10104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.402+0000 7f4f1499a700 1 -- 172.21.15.46:0/2466904408 shutdown_connections 2024-02-19T18:58:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:03.402+0000 7f4f1499a700 1 -- 172.21.15.46:0/2466904408 wait complete. 2024-02-19T18:58:03.467 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:03 smithi046 ceph-mon[29647]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:58:03.467 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:03 smithi046 ceph-mon[29647]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-02-19T18:58:03.468 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:03 smithi046 ceph-mon[29647]: osdmap e38: 6 total, 5 up, 6 in 2024-02-19T18:58:03.468 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:03 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T18:58:03.468 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:03 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T18:58:03.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:03 smithi142 ceph-mon[37169]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:58:03.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:03 smithi142 ceph-mon[37169]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-02-19T18:58:03.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:03 smithi142 ceph-mon[37169]: osdmap e38: 6 total, 5 up, 6 in 2024-02-19T18:58:03.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:03 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T18:58:03.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:03 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T18:58:04.210 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1708369083,"num_in_osds":6,"osd_in_since":1708369064,"num_remapped_pgs":0} 2024-02-19T18:58:04.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T18:58:04.439 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:04.440 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:04 smithi046 ceph-mon[29647]: purged_snaps scrub starts 2024-02-19T18:58:04.441 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:04 smithi046 ceph-mon[29647]: purged_snaps scrub ok 2024-02-19T18:58:04.441 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:04 smithi046 ceph-mon[29647]: osd.5 [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815] boot 2024-02-19T18:58:04.441 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:04 smithi046 ceph-mon[29647]: osdmap e39: 6 total, 6 up, 6 in 2024-02-19T18:58:04.441 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:04 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T18:58:04.441 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:04 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2466904408' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T18:58:04.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:04 smithi142 ceph-mon[37169]: purged_snaps scrub starts 2024-02-19T18:58:04.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:04 smithi142 ceph-mon[37169]: purged_snaps scrub ok 2024-02-19T18:58:04.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:04 smithi142 ceph-mon[37169]: osd.5 [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815] boot 2024-02-19T18:58:04.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:04 smithi142 ceph-mon[37169]: osdmap e39: 6 total, 6 up, 6 in 2024-02-19T18:58:04.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:04 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T18:58:04.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:04 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2466904408' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T18:58:05.473 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: osdmap e40: 6 total, 6 up, 6 in 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:05.474 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:58:05.475 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:05.475 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:05.475 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:05 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:05.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T18:58:05.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: osdmap e40: 6 total, 6 up, 6 in 2024-02-19T18:58:05.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:05.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:05 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:58:06.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.019+0000 7f3c63f88700 1 -- 172.21.15.46:0/1630494462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c5c0ffc50 msgr2=0x7f3c5c103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:06.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.019+0000 7f3c63f88700 1 --2- 172.21.15.46:0/1630494462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c5c0ffc50 0x7f3c5c103c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009910 tx=0x7f3c58009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:06.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.019+0000 7f3c63f88700 1 -- 172.21.15.46:0/1630494462 shutdown_connections 2024-02-19T18:58:06.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.019+0000 7f3c63f88700 1 --2- 172.21.15.46:0/1630494462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c5c0ffc50 0x7f3c5c103c20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:06.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.019+0000 7f3c63f88700 1 --2- 172.21.15.46:0/1630494462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c0ff2b0 0x7f3c5c0ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.019+0000 7f3c63f88700 1 -- 172.21.15.46:0/1630494462 >> 172.21.15.46:0/1630494462 conn(0x7f3c5c0fab50 msgr2=0x7f3c5c0fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.019+0000 7f3c63f88700 1 -- 172.21.15.46:0/1630494462 shutdown_connections 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.019+0000 7f3c63f88700 1 -- 172.21.15.46:0/1630494462 wait complete. 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.020+0000 7f3c63f88700 1 Processor -- start 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.020+0000 7f3c63f88700 1 -- start start 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.020+0000 7f3c63f88700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c0ff2b0 0x7f3c5c196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.020+0000 7f3c63f88700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c5c0ffc50 0x7f3c5c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.020+0000 7f3c63f88700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c1976d0 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.020+0000 7f3c63f88700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c197840 con 0x7f3c5c0ff2b0 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.020+0000 7f3c61523700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c5c0ffc50 0x7f3c5c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:06.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.020+0000 7f3c61523700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c5c0ffc50 0x7f3c5c1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43826/0 (socket says 172.21.15.46:43826) 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.020+0000 7f3c61523700 1 -- 172.21.15.46:0/1686884317 learned_addr learned my addr 172.21.15.46:0/1686884317 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.020+0000 7f3c61d24700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c0ff2b0 0x7f3c5c196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.021+0000 7f3c61523700 1 -- 172.21.15.46:0/1686884317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c0ff2b0 msgr2=0x7f3c5c196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.021+0000 7f3c61523700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c0ff2b0 0x7f3c5c196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.021+0000 7f3c61523700 1 -- 172.21.15.46:0/1686884317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580095f0 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.021+0000 7f3c61523700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c5c0ffc50 0x7f3c5c1970b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009fd0 tx=0x7f3c5800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.021+0000 7f3c52ffd700 1 -- 172.21.15.46:0/1686884317 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c5801d070 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.021+0000 7f3c52ffd700 1 -- 172.21.15.46:0/1686884317 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3c58005640 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.021+0000 7f3c63f88700 1 -- 172.21.15.46:0/1686884317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c19fbe0 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.021+0000 7f3c52ffd700 1 -- 172.21.15.46:0/1686884317 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c58022470 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.021+0000 7f3c63f88700 1 -- 172.21.15.46:0/1686884317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c1a0050 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.022+0000 7f3c63f88700 1 -- 172.21.15.46:0/1686884317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c04f2a0 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.022+0000 7f3c52ffd700 1 -- 172.21.15.46:0/1686884317 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3c58003680 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.023+0000 7f3c52ffd700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3c4806c680 0x7f3c4806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:06.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.023+0000 7f3c52ffd700 1 -- 172.21.15.46:0/1686884317 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3c5808c930 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.023+0000 7f3c61d24700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3c4806c680 0x7f3c4806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:06.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.023+0000 7f3c61d24700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3c4806c680 0x7f3c4806eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009c60 tx=0x7f3c4c009260 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:06.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.027+0000 7f3c52ffd700 1 -- 172.21.15.46:0/1686884317 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3c58057350 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.227+0000 7f3c63f88700 1 -- 172.21.15.46:0/1686884317 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c5c1a0400 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.228+0000 7f3c52ffd700 1 -- 172.21.15.46:0/1686884317 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11350 (secure 0 0 0) 0x7f3c5805a970 con 0x7f3c5c0ffc50 2024-02-19T18:58:06.246 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:58:06.246 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","created":"2024-02-19T18:51:43.710287+0000","modified":"2024-02-19T18:58:04.329187+0000","last_up_change":"2024-02-19T18:58:03.323987+0000","last_in_change":"2024-02-19T18:57:44.164228+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:56:48.450849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ea35c0-be56-4830-9abc-c67aa3feed47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6803","nonce":3909364861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6805","nonce":3909364861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6809","nonce":3909364861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6807","nonce":3909364861}]},"public_addr":"172.21.15.46:6803/3909364861","cluster_addr":"172.21.15.46:6805/3909364861","heartbeat_back_addr":"172.21.15.46:6809/3909364861","heartbeat_front_addr":"172.21.15.46:6807/3909364861","state":["exists","up"]},{"osd":1,"uuid":"0dcb0202-8fa1-4a72-939d-dd8a5ced3a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6811","nonce":1824596762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6813","nonce":1824596762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6817","nonce":1824596762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6815","nonce":1824596762}]},"public_addr":"172.21.15.46:6811/1824596762","cluster_addr":"172.21.15.46:6813/1824596762","heartbeat_back_addr":"172.21.15.46:6817/1824596762","heartbeat_front_addr":"172.21.15.46:6815/1824596762","state":["exists","up"]},{"osd":2,"uuid":"a5ae09b3-9419-4fc7-8cd5-4a2553bca213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6819","nonce":3246046723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6821","nonce":3246046723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6825","nonce":3246046723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6823","nonce":3246046723}]},"public_addr":"172.21.15.46:6819/3246046723","cluster_addr":"172.21.15.46:6821/3246046723","heartbeat_back_addr":"172.21.15.46:6825/3246046723","heartbeat_front_addr":"172.21.15.46:6823/3246046723","state":["exists","up"]},{"osd":3,"uuid":"3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6801","nonce":3699833248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6803","nonce":3699833248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6807","nonce":3699833248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6805","nonce":3699833248}]},"public_addr":"172.21.15.142:6801/3699833248","cluster_addr":"172.21.15.142:6803/3699833248","heartbeat_back_addr":"172.21.15.142:6807/3699833248","heartbeat_front_addr":"172.21.15.142:6805/3699833248","state":["exists","up"]},{"osd":4,"uuid":"0a0ce92a-f9ac-4f83-877f-93eff87a9f8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6809","nonce":2523325445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6811","nonce":2523325445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6815","nonce":2523325445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6813","nonce":2523325445}]},"public_addr":"172.21.15.142:6809/2523325445","cluster_addr":"172.21.15.142:6811/2523325445","heartbeat_back_addr":"172.21.15.142:6815/2523325445","heartbeat_front_addr":"172.21.15.142:6813/2523325445","state":["exists","up"]},{"osd":5,"uuid":"0eed1f5c-a999-43d8-95ae-1671ac54640b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6817","nonce":4119018815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6819","nonce":4119018815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6823","nonce":4119018815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6821","nonce":4119018815}]},"public_addr":"172.21.15.142:6817/4119018815","cluster_addr":"172.21.15.142:6819/4119018815","heartbeat_back_addr":"172.21.15.142:6823/4119018815","heartbeat_front_addr":"172.21.15.142:6821/4119018815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:55:49.856210+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:17.120054+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:46.102265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:10.285252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:35.715008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:01.554947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/664839364":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/1307799669":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/3901080352":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/3708201410":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6801/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6800/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6800/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/4057722486":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/2954390908":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/2407750441":"2024-02-20T18:52:11.766897+0000","172.21.15.46:6800/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:6801/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/1953665533":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/3268130132":"2024-02-20T18:52:44.819852+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 -- 172.21.15.46:0/1686884317 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3c4806c680 msgr2=0x7f3c4806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3c4806c680 0x7f3c4806eb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009c60 tx=0x7f3c4c009260 comp rx=0 tx=0).stop 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 -- 172.21.15.46:0/1686884317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c5c0ffc50 msgr2=0x7f3c5c1970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c5c0ffc50 0x7f3c5c1970b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009fd0 tx=0x7f3c5800fa00 comp rx=0 tx=0).stop 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 -- 172.21.15.46:0/1686884317 shutdown_connections 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3c4806c680 0x7f3c4806eb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c0ff2b0 0x7f3c5c196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 --2- 172.21.15.46:0/1686884317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c5c0ffc50 0x7f3c5c1970b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 -- 172.21.15.46:0/1686884317 >> 172.21.15.46:0/1686884317 conn(0x7f3c5c0fab50 msgr2=0x7f3c5c0fc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 -- 172.21.15.46:0/1686884317 shutdown_connections 2024-02-19T18:58:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:06.230+0000 7f3c63f88700 1 -- 172.21.15.46:0/1686884317 wait complete. 2024-02-19T18:58:06.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:06 smithi142 ceph-mon[37169]: Detected new or changed devices on smithi142 2024-02-19T18:58:06.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:06 smithi142 ceph-mon[37169]: Adjusting osd_memory_target on smithi142 to 4970M 2024-02-19T18:58:06.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:06 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1686884317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T18:58:06.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:06 smithi046 ceph-mon[29647]: Detected new or changed devices on smithi142 2024-02-19T18:58:06.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:06 smithi046 ceph-mon[29647]: Adjusting osd_memory_target on smithi142 to 4970M 2024-02-19T18:58:06.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:06 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1686884317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T18:58:06.886 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T18:56:48.450849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T18:58:06.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-19T18:58:07.098 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:07.551 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:07 smithi046 ceph-mon[29647]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:07.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:07 smithi142 ceph-mon[37169]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:08.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:08 smithi142 ceph-mon[37169]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:08.750 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:08 smithi046 ceph-mon[29647]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:08.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.844+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2959554491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb180ffd60 msgr2=0x7fcb18103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:08.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.844+0000 7fcb1d22d700 1 --2- 172.21.15.46:0/2959554491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb180ffd60 0x7fcb18103d30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009910 tx=0x7fcb0c009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:08.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.844+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2959554491 shutdown_connections 2024-02-19T18:58:08.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.844+0000 7fcb1d22d700 1 --2- 172.21.15.46:0/2959554491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb180ffd60 0x7fcb18103d30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:08.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.844+0000 7fcb1d22d700 1 --2- 172.21.15.46:0/2959554491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb180ff3c0 0x7fcb180ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:08.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.844+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2959554491 >> 172.21.15.46:0/2959554491 conn(0x7fcb180fac80 msgr2=0x7fcb180fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:08.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.844+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2959554491 shutdown_connections 2024-02-19T18:58:08.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.844+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2959554491 wait complete. 2024-02-19T18:58:08.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.845+0000 7fcb1d22d700 1 Processor -- start 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.845+0000 7fcb1d22d700 1 -- start start 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb1d22d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb180ff3c0 0x7fcb18195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb1d22d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb180ffd60 0x7fcb18196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb1d22d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18196b40 con 0x7fcb180ff3c0 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb1d22d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1819a8d0 con 0x7fcb180ffd60 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb16d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb180ff3c0 0x7fcb18195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb16d9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb180ff3c0 0x7fcb18195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38520/0 (socket says 172.21.15.46:38520) 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb16d9d700 1 -- 172.21.15.46:0/2463889724 learned_addr learned my addr 172.21.15.46:0/2463889724 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb1659c700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb180ffd60 0x7fcb18196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb16d9d700 1 -- 172.21.15.46:0/2463889724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb180ffd60 msgr2=0x7fcb18196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb16d9d700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb180ffd60 0x7fcb18196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb16d9d700 1 -- 172.21.15.46:0/2463889724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0095f0 con 0x7fcb180ff3c0 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb1659c700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb180ffd60 0x7fcb18196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T18:58:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb16d9d700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb180ff3c0 0x7fcb18195f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800b4b0 tx=0x7fcb0800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:08.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcafffff700 1 -- 172.21.15.46:0/2463889724 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb08011800 con 0x7fcb180ff3c0 2024-02-19T18:58:08.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2463889724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1819abb0 con 0x7fcb180ff3c0 2024-02-19T18:58:08.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcafffff700 1 -- 172.21.15.46:0/2463889724 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcb08011e10 con 0x7fcb180ff3c0 2024-02-19T18:58:08.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcafffff700 1 -- 172.21.15.46:0/2463889724 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb0800f2e0 con 0x7fcb180ff3c0 2024-02-19T18:58:08.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.846+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2463889724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1819b100 con 0x7fcb180ff3c0 2024-02-19T18:58:08.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.847+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2463889724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1804f2a0 con 0x7fcb180ff3c0 2024-02-19T18:58:08.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.848+0000 7fcafffff700 1 -- 172.21.15.46:0/2463889724 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fcb08010380 con 0x7fcb180ff3c0 2024-02-19T18:58:08.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.848+0000 7fcafffff700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fcb0006c680 0x7fcb0006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:08.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.848+0000 7fcafffff700 1 -- 172.21.15.46:0/2463889724 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fcb0808b190 con 0x7fcb180ff3c0 2024-02-19T18:58:08.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.848+0000 7fcb1659c700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fcb0006c680 0x7fcb0006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:08.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.849+0000 7fcb1659c700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fcb0006c680 0x7fcb0006eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c006010 tx=0x7fcb0c005960 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:08.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:08.853+0000 7fcafffff700 1 -- 172.21.15.46:0/2463889724 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcb08055bb0 con 0x7fcb180ff3c0 2024-02-19T18:58:09.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.050+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2463889724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb18197280 con 0x7fcb180ff3c0 2024-02-19T18:58:09.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.051+0000 7fcafffff700 1 -- 172.21.15.46:0/2463889724 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb080591d0 con 0x7fcb180ff3c0 2024-02-19T18:58:09.069 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T18:58:09.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2463889724 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fcb0006c680 msgr2=0x7fcb0006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:09.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fcb0006c680 0x7fcb0006eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c006010 tx=0x7fcb0c005960 comp rx=0 tx=0).stop 2024-02-19T18:58:09.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2463889724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb180ff3c0 msgr2=0x7fcb18195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:09.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb180ff3c0 0x7fcb18195f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800b4b0 tx=0x7fcb0800b870 comp rx=0 tx=0).stop 2024-02-19T18:58:09.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2463889724 shutdown_connections 2024-02-19T18:58:09.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fcb0006c680 0x7fcb0006eb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:09.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb180ff3c0 0x7fcb18195f20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:09.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 --2- 172.21.15.46:0/2463889724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb180ffd60 0x7fcb18196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:09.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2463889724 >> 172.21.15.46:0/2463889724 conn(0x7fcb180fac80 msgr2=0x7fcb180fc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:09.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2463889724 shutdown_connections 2024-02-19T18:58:09.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:09.054+0000 7fcb1d22d700 1 -- 172.21.15.46:0/2463889724 wait complete. 2024-02-19T18:58:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:09 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2463889724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T18:58:09.745 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:09 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2463889724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T18:58:09.771 INFO:tasks.cephadm:Setting up client nodes... 2024-02-19T18:58:09.771 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-19T18:58:09.983 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:11.304 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:11 smithi046 ceph-mon[29647]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:11.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:11 smithi142 ceph-mon[37169]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.642+0000 7fd984702700 1 -- 172.21.15.46:0/1624107544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c101440 msgr2=0x7fd97c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.642+0000 7fd984702700 1 --2- 172.21.15.46:0/1624107544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c101440 0x7fd97c101890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009910 tx=0x7fd96c009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 -- 172.21.15.46:0/1624107544 shutdown_connections 2024-02-19T18:58:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 --2- 172.21.15.46:0/1624107544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c101440 0x7fd97c101890 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:11.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 --2- 172.21.15.46:0/1624107544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c100240 0x7fd97c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 -- 172.21.15.46:0/1624107544 >> 172.21.15.46:0/1624107544 conn(0x7fd97c0fb7f0 msgr2=0x7fd97c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 -- 172.21.15.46:0/1624107544 shutdown_connections 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 -- 172.21.15.46:0/1624107544 wait complete. 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 Processor -- start 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 -- start start 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c100240 0x7fd97c197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c101440 0x7fd97c1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c1987e0 con 0x7fd97c101440 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.643+0000 7fd984702700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c198950 con 0x7fd97c100240 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd981c9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c101440 0x7fd97c1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd981c9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c101440 0x7fd97c1981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38538/0 (socket says 172.21.15.46:38538) 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd981c9d700 1 -- 172.21.15.46:0/1041593128 learned_addr learned my addr 172.21.15.46:0/1041593128 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:11.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd98249e700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c100240 0x7fd97c197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd981c9d700 1 -- 172.21.15.46:0/1041593128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c100240 msgr2=0x7fd97c197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd981c9d700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c100240 0x7fd97c197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd981c9d700 1 -- 172.21.15.46:0/1041593128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c0095f0 con 0x7fd97c101440 2024-02-19T18:58:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd981c9d700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c101440 0x7fd97c1981e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00bd70 tx=0x7fd96c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd9737fe700 1 -- 172.21.15.46:0/1041593128 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd96c01d070 con 0x7fd97c101440 2024-02-19T18:58:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd9737fe700 1 -- 172.21.15.46:0/1041593128 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd96c005940 con 0x7fd97c101440 2024-02-19T18:58:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd984702700 1 -- 172.21.15.46:0/1041593128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97c19d380 con 0x7fd97c101440 2024-02-19T18:58:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd9737fe700 1 -- 172.21.15.46:0/1041593128 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd96c021430 con 0x7fd97c101440 2024-02-19T18:58:11.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.644+0000 7fd984702700 1 -- 172.21.15.46:0/1041593128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c19d870 con 0x7fd97c101440 2024-02-19T18:58:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.645+0000 7fd984702700 1 -- 172.21.15.46:0/1041593128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97c105520 con 0x7fd97c101440 2024-02-19T18:58:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.646+0000 7fd9737fe700 1 -- 172.21.15.46:0/1041593128 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd96c00f860 con 0x7fd97c101440 2024-02-19T18:58:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.646+0000 7fd9737fe700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd96806c6d0 0x7fd96806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.646+0000 7fd9737fe700 1 -- 172.21.15.46:0/1041593128 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd96c08c8d0 con 0x7fd97c101440 2024-02-19T18:58:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.646+0000 7fd98249e700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd96806c6d0 0x7fd96806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:11.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.647+0000 7fd98249e700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd96806c6d0 0x7fd96806eb80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd97c198b80 tx=0x7fd97800a380 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:11.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.651+0000 7fd9737fe700 1 -- 172.21.15.46:0/1041593128 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd96c057250 con 0x7fd97c101440 2024-02-19T18:58:11.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.933+0000 7fd984702700 1 -- 172.21.15.46:0/1041593128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd97c02cc30 con 0x7fd97c101440 2024-02-19T18:58:11.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.938+0000 7fd9737fe700 1 -- 172.21.15.46:0/1041593128 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd96c05a870 con 0x7fd97c101440 2024-02-19T18:58:11.956 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-02-19T18:58:11.956 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQDDpNNl48e/NxAAt/eY5EPWBM9PzRCYGrDmmQ== 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 -- 172.21.15.46:0/1041593128 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd96806c6d0 msgr2=0x7fd96806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd96806c6d0 0x7fd96806eb80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd97c198b80 tx=0x7fd97800a380 comp rx=0 tx=0).stop 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 -- 172.21.15.46:0/1041593128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c101440 msgr2=0x7fd97c1981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c101440 0x7fd97c1981e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00bd70 tx=0x7fd96c00bda0 comp rx=0 tx=0).stop 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 -- 172.21.15.46:0/1041593128 shutdown_connections 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd96806c6d0 0x7fd96806eb80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c100240 0x7fd97c197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 --2- 172.21.15.46:0/1041593128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c101440 0x7fd97c1981e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 -- 172.21.15.46:0/1041593128 >> 172.21.15.46:0/1041593128 conn(0x7fd97c0fb7f0 msgr2=0x7fd97c102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 -- 172.21.15.46:0/1041593128 shutdown_connections 2024-02-19T18:58:11.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:11.940+0000 7fd984702700 1 -- 172.21.15.46:0/1041593128 wait complete. 2024-02-19T18:58:12.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:12 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1041593128' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T18:58:12.268 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:12 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1041593128' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T18:58:12.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:12 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1041593128' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T18:58:12.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:12 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1041593128' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T18:58:12.686 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:58:12.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-19T18:58:12.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-19T18:58:12.731 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-19T18:58:12.950 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi142/config 2024-02-19T18:58:13.310 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:13 smithi142 ceph-mon[37169]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:13.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:13 smithi046 ceph-mon[29647]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.574+0000 7f3cd8279700 1 -- 172.21.15.142:0/1494611086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cd0100240 msgr2=0x7f3cd0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.574+0000 7f3cd8279700 1 --2- 172.21.15.142:0/1494611086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cd0100240 0x7f3cd0100650 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009910 tx=0x7f3ccc009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.574+0000 7f3cd8279700 1 -- 172.21.15.142:0/1494611086 shutdown_connections 2024-02-19T18:58:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.574+0000 7f3cd8279700 1 --2- 172.21.15.142:0/1494611086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd0101440 0x7f3cd0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.574+0000 7f3cd8279700 1 --2- 172.21.15.142:0/1494611086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cd0100240 0x7f3cd0100650 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:14.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.574+0000 7f3cd8279700 1 -- 172.21.15.142:0/1494611086 >> 172.21.15.142:0/1494611086 conn(0x7f3cd00fb7f0 msgr2=0x7f3cd00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.574+0000 7f3cd8279700 1 -- 172.21.15.142:0/1494611086 shutdown_connections 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.574+0000 7f3cd8279700 1 -- 172.21.15.142:0/1494611086 wait complete. 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd8279700 1 Processor -- start 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd8279700 1 -- start start 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd8279700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cd0100240 0x7f3cd0195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd8279700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd0101440 0x7f3cd01960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd8279700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd01966c0 con 0x7f3cd0101440 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd8279700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0196800 con 0x7f3cd0100240 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd6015700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cd0100240 0x7f3cd0195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd6015700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cd0100240 0x7f3cd0195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44396/0 (socket says 172.21.15.142:44396) 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd6015700 1 -- 172.21.15.142:0/1464772551 learned_addr learned my addr 172.21.15.142:0/1464772551 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd5814700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd0101440 0x7f3cd01960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd6015700 1 -- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd0101440 msgr2=0x7f3cd01960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:14.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd6015700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd0101440 0x7f3cd01960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd6015700 1 -- 172.21.15.142:0/1464772551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0095f0 con 0x7f3cd0100240 2024-02-19T18:58:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.575+0000 7f3cd5814700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd0101440 0x7f3cd01960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T18:58:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.576+0000 7f3cd6015700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cd0100240 0x7f3cd0195b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00bda0 tx=0x7f3ccc00be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.576+0000 7f3cc77fe700 1 -- 172.21.15.142:0/1464772551 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ccc01d070 con 0x7f3cd0100240 2024-02-19T18:58:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.576+0000 7f3cc77fe700 1 -- 172.21.15.142:0/1464772551 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ccc004c50 con 0x7f3cd0100240 2024-02-19T18:58:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.576+0000 7f3cd8279700 1 -- 172.21.15.142:0/1464772551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd019b250 con 0x7f3cd0100240 2024-02-19T18:58:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.576+0000 7f3cc77fe700 1 -- 172.21.15.142:0/1464772551 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ccc00f690 con 0x7f3cd0100240 2024-02-19T18:58:14.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.576+0000 7f3cd8279700 1 -- 172.21.15.142:0/1464772551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd019b740 con 0x7f3cd0100240 2024-02-19T18:58:14.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.577+0000 7f3cd8279700 1 -- 172.21.15.142:0/1464772551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd0108e10 con 0x7f3cd0100240 2024-02-19T18:58:14.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.577+0000 7f3cc77fe700 1 -- 172.21.15.142:0/1464772551 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3ccc00f900 con 0x7f3cd0100240 2024-02-19T18:58:14.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.578+0000 7f3cc77fe700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3cbc06c680 0x7f3cbc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:14.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.578+0000 7f3cc77fe700 1 -- 172.21.15.142:0/1464772551 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3ccc08cd50 con 0x7f3cd0100240 2024-02-19T18:58:14.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.578+0000 7f3cd5814700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3cbc06c680 0x7f3cbc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:14.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.579+0000 7f3cd5814700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3cbc06c680 0x7f3cbc06eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007900 tx=0x7f3cc0008040 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.582+0000 7f3cc77fe700 1 -- 172.21.15.142:0/1464772551 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3ccc05b200 con 0x7f3cd0100240 2024-02-19T18:58:14.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.847+0000 7f3cd8279700 1 -- 172.21.15.142:0/1464772551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3cd0109070 con 0x7f3cd0100240 2024-02-19T18:58:14.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.852+0000 7f3cc77fe700 1 -- 172.21.15.142:0/1464772551 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3ccc027050 con 0x7f3cd0100240 2024-02-19T18:58:14.871 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2024-02-19T18:58:14.871 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDGpNNl6Q2iMhAAhdSAkBUlckDFxZ3pkiAKvw== 2024-02-19T18:58:14.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.854+0000 7f3cd8279700 1 -- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3cbc06c680 msgr2=0x7f3cbc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.854+0000 7f3cd8279700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3cbc06c680 0x7f3cbc06eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007900 tx=0x7f3cc0008040 comp rx=0 tx=0).stop 2024-02-19T18:58:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.854+0000 7f3cd8279700 1 -- 172.21.15.142:0/1464772551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cd0100240 msgr2=0x7f3cd0195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.854+0000 7f3cd8279700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cd0100240 0x7f3cd0195b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00bda0 tx=0x7f3ccc00be80 comp rx=0 tx=0).stop 2024-02-19T18:58:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.854+0000 7f3cd8279700 1 -- 172.21.15.142:0/1464772551 shutdown_connections 2024-02-19T18:58:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.854+0000 7f3cd8279700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3cbc06c680 0x7f3cbc06eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.854+0000 7f3cd8279700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cd0100240 0x7f3cd0195b60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.854+0000 7f3cd8279700 1 --2- 172.21.15.142:0/1464772551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3cd0101440 0x7f3cd01960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.854+0000 7f3cd8279700 1 -- 172.21.15.142:0/1464772551 >> 172.21.15.142:0/1464772551 conn(0x7f3cd00fb7f0 msgr2=0x7f3cd0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.855+0000 7f3cd8279700 1 -- 172.21.15.142:0/1464772551 shutdown_connections 2024-02-19T18:58:14.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-02-19T18:58:14.855+0000 7f3cd8279700 1 -- 172.21.15.142:0/1464772551 wait complete. 2024-02-19T18:58:15.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:15 smithi142 ceph-mon[37169]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:15.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:15 smithi142 ceph-mon[37169]: from='client.? 172.21.15.142:0/1464772551' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T18:58:15.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:15 smithi142 ceph-mon[37169]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T18:58:15.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:15 smithi142 ceph-mon[37169]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T18:58:15.474 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:58:15.474 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-19T18:58:15.474 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-19T18:58:15.516 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-19T18:58:15.516 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-19T18:58:15.516 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph mgr dump --format=json 2024-02-19T18:58:15.546 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:15 smithi046 ceph-mon[29647]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:15.546 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:15 smithi046 ceph-mon[29647]: from='client.? 172.21.15.142:0/1464772551' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T18:58:15.546 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:15 smithi046 ceph-mon[29647]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T18:58:15.546 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:15 smithi046 ceph-mon[29647]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T18:58:15.736 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.432+0000 7f7cb89f4700 1 -- 172.21.15.46:0/604039583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb4101d30 msgr2=0x7f7cb410a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:17.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.432+0000 7f7cb89f4700 1 --2- 172.21.15.46:0/604039583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb4101d30 0x7f7cb410a230 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009910 tx=0x7f7c9c009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:17.451 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:17 smithi046 ceph-mon[29647]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:17.451 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:17.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.432+0000 7f7cb89f4700 1 -- 172.21.15.46:0/604039583 shutdown_connections 2024-02-19T18:58:17.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.432+0000 7f7cb89f4700 1 --2- 172.21.15.46:0/604039583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb4101d30 0x7f7cb410a230 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:17.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.432+0000 7f7cb89f4700 1 --2- 172.21.15.46:0/604039583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb4101420 0x7f7cb41017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:17.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.432+0000 7f7cb89f4700 1 -- 172.21.15.46:0/604039583 >> 172.21.15.46:0/604039583 conn(0x7f7cb40fac80 msgr2=0x7f7cb40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:17.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.432+0000 7f7cb89f4700 1 -- 172.21.15.46:0/604039583 shutdown_connections 2024-02-19T18:58:17.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.432+0000 7f7cb89f4700 1 -- 172.21.15.46:0/604039583 wait complete. 2024-02-19T18:58:17.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.433+0000 7f7cb89f4700 1 Processor -- start 2024-02-19T18:58:17.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.433+0000 7f7cb89f4700 1 -- start start 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.433+0000 7f7cb89f4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb4101420 0x7f7cb4195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.433+0000 7f7cb89f4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb4101d30 0x7f7cb4196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.433+0000 7f7cb89f4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4196b00 con 0x7f7cb4101d30 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.433+0000 7f7cb89f4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb419a890 con 0x7f7cb4101420 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.433+0000 7f7cb1d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb4101d30 0x7f7cb4196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.433+0000 7f7cb1d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb4101d30 0x7f7cb4196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38552/0 (socket says 172.21.15.46:38552) 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.433+0000 7f7cb1d9b700 1 -- 172.21.15.46:0/4242704410 learned_addr learned my addr 172.21.15.46:0/4242704410 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cb259c700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb4101420 0x7f7cb4195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cb1d9b700 1 -- 172.21.15.46:0/4242704410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb4101420 msgr2=0x7f7cb4195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cb1d9b700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb4101420 0x7f7cb4195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cb1d9b700 1 -- 172.21.15.46:0/4242704410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0095f0 con 0x7f7cb4101d30 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cb259c700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb4101420 0x7f7cb4195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cb1d9b700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb4101d30 0x7f7cb4196420 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00b5c0 tx=0x7f7c9c00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:17.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cab7fe700 1 -- 172.21.15.46:0/4242704410 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c9c01d070 con 0x7f7cb4101d30 2024-02-19T18:58:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cab7fe700 1 -- 172.21.15.46:0/4242704410 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7c9c022470 con 0x7f7cb4101d30 2024-02-19T18:58:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cb89f4700 1 -- 172.21.15.46:0/4242704410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb419ab10 con 0x7f7cb4101d30 2024-02-19T18:58:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cab7fe700 1 -- 172.21.15.46:0/4242704410 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c9c00f670 con 0x7f7cb4101d30 2024-02-19T18:58:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.434+0000 7f7cb89f4700 1 -- 172.21.15.46:0/4242704410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb419b000 con 0x7f7cb4101d30 2024-02-19T18:58:17.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.435+0000 7f7cb89f4700 1 -- 172.21.15.46:0/4242704410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb41078a0 con 0x7f7cb4101d30 2024-02-19T18:58:17.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.436+0000 7f7cab7fe700 1 -- 172.21.15.46:0/4242704410 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7c9c004c30 con 0x7f7cb4101d30 2024-02-19T18:58:17.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.436+0000 7f7cab7fe700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ca006c680 0x7f7ca006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:17.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.436+0000 7f7cab7fe700 1 -- 172.21.15.46:0/4242704410 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7c9c08cbf0 con 0x7f7cb4101d30 2024-02-19T18:58:17.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.436+0000 7f7cb259c700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ca006c680 0x7f7ca006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:17.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.436+0000 7f7cb259c700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ca006c680 0x7f7ca006eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009fa0 tx=0x7f7ca4009570 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:17.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.441+0000 7f7cab7fe700 1 -- 172.21.15.46:0/4242704410 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7c9c0576c0 con 0x7f7cb4101d30 2024-02-19T18:58:17.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:17 smithi142 ceph-mon[37169]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:17.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:17.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.699+0000 7f7cb89f4700 1 -- 172.21.15.46:0/4242704410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7cb402cc30 con 0x7f7cb4101d30 2024-02-19T18:58:17.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.703+0000 7f7cab7fe700 1 -- 172.21.15.46:0/4242704410 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172855 (secure 0 0 0) 0x7f7c9c05ace0 con 0x7f7cb4101d30 2024-02-19T18:58:17.723 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.705+0000 7f7cb89f4700 1 -- 172.21.15.46:0/4242704410 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ca006c680 msgr2=0x7f7ca006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.705+0000 7f7cb89f4700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ca006c680 0x7f7ca006eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009fa0 tx=0x7f7ca4009570 comp rx=0 tx=0).stop 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.705+0000 7f7cb89f4700 1 -- 172.21.15.46:0/4242704410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb4101d30 msgr2=0x7f7cb4196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.705+0000 7f7cb89f4700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb4101d30 0x7f7cb4196420 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00b5c0 tx=0x7f7c9c00be00 comp rx=0 tx=0).stop 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.706+0000 7f7cb89f4700 1 -- 172.21.15.46:0/4242704410 shutdown_connections 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.706+0000 7f7cb89f4700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ca006c680 0x7f7ca006eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.706+0000 7f7cb89f4700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb4101420 0x7f7cb4195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.706+0000 7f7cb89f4700 1 --2- 172.21.15.46:0/4242704410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb4101d30 0x7f7cb4196420 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.706+0000 7f7cb89f4700 1 -- 172.21.15.46:0/4242704410 >> 172.21.15.46:0/4242704410 conn(0x7f7cb40fac80 msgr2=0x7f7cb41049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.706+0000 7f7cb89f4700 1 -- 172.21.15.46:0/4242704410 shutdown_connections 2024-02-19T18:58:17.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:17.706+0000 7f7cb89f4700 1 -- 172.21.15.46:0/4242704410 wait complete. 2024-02-19T18:58:18.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:18 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/4242704410' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-19T18:58:18.371 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"active_gid":14237,"active_name":"smithi046.qtceex","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1654096494},{"type":"v1","addr":"172.21.15.46:6801","nonce":1654096494}]},"active_addr":"172.21.15.46:6801/1654096494","active_change":"2024-02-19T18:54:32.109320+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14260,"name":"smithi142.fwekwv","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.46:8443/","prometheus":"http://172.21.15.46:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2538440870}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2139900052}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1304412033}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2827852709}]}]} 2024-02-19T18:58:18.375 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-19T18:58:18.375 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-19T18:58:18.375 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T18:58:18.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:18 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/4242704410' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-19T18:58:18.617 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:19.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:19 smithi046 ceph-mon[29647]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:19.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:19 smithi142 ceph-mon[37169]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.436+0000 7fc980a17700 1 -- 172.21.15.46:0/3070922985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc97c1004e0 msgr2=0x7fc97c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.436+0000 7fc980a17700 1 --2- 172.21.15.46:0/3070922985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc97c1004e0 0x7fc97c1008b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009910 tx=0x7fc96c009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.437+0000 7fc980a17700 1 -- 172.21.15.46:0/3070922985 shutdown_connections 2024-02-19T18:58:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.437+0000 7fc980a17700 1 --2- 172.21.15.46:0/3070922985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c100e80 0x7fc97c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.437+0000 7fc980a17700 1 --2- 172.21.15.46:0/3070922985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc97c1004e0 0x7fc97c1008b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.437+0000 7fc980a17700 1 -- 172.21.15.46:0/3070922985 >> 172.21.15.46:0/3070922985 conn(0x7fc97c0fbda0 msgr2=0x7fc97c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.437+0000 7fc980a17700 1 -- 172.21.15.46:0/3070922985 shutdown_connections 2024-02-19T18:58:20.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.437+0000 7fc980a17700 1 -- 172.21.15.46:0/3070922985 wait complete. 2024-02-19T18:58:20.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc980a17700 1 Processor -- start 2024-02-19T18:58:20.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc980a17700 1 -- start start 2024-02-19T18:58:20.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc980a17700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc97c1004e0 0x7fc97c195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:20.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc980a17700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c100e80 0x7fc97c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:20.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc980a17700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c196b10 con 0x7fc97c1004e0 2024-02-19T18:58:20.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc980a17700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c19a8a0 con 0x7fc97c100e80 2024-02-19T18:58:20.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc97a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc97c1004e0 0x7fc97c195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:20.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc97a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc97c1004e0 0x7fc97c195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53138/0 (socket says 172.21.15.46:53138) 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc97a59c700 1 -- 172.21.15.46:0/2588576031 learned_addr learned my addr 172.21.15.46:0/2588576031 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc979d9b700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c100e80 0x7fc97c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc97a59c700 1 -- 172.21.15.46:0/2588576031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c100e80 msgr2=0x7fc97c196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc97a59c700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c100e80 0x7fc97c196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc97a59c700 1 -- 172.21.15.46:0/2588576031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0095f0 con 0x7fc97c1004e0 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc979d9b700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c100e80 0x7fc97c196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.438+0000 7fc97a59c700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc97c1004e0 0x7fc97c195ef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc96c006010 tx=0x7fc96c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.439+0000 7fc96b7fe700 1 -- 172.21.15.46:0/2588576031 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc96c01d070 con 0x7fc97c1004e0 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.439+0000 7fc96b7fe700 1 -- 172.21.15.46:0/2588576031 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc96c004f50 con 0x7fc97c1004e0 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.439+0000 7fc980a17700 1 -- 172.21.15.46:0/2588576031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c19ab20 con 0x7fc97c1004e0 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.439+0000 7fc96b7fe700 1 -- 172.21.15.46:0/2588576031 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc96c021640 con 0x7fc97c1004e0 2024-02-19T18:58:20.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.439+0000 7fc980a17700 1 -- 172.21.15.46:0/2588576031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c19b010 con 0x7fc97c1004e0 2024-02-19T18:58:20.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.440+0000 7fc980a17700 1 -- 172.21.15.46:0/2588576031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c1087f0 con 0x7fc97c1004e0 2024-02-19T18:58:20.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.440+0000 7fc96b7fe700 1 -- 172.21.15.46:0/2588576031 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc96c00f460 con 0x7fc97c1004e0 2024-02-19T18:58:20.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.440+0000 7fc96b7fe700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc96406c680 0x7fc96406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:20.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.441+0000 7fc96b7fe700 1 -- 172.21.15.46:0/2588576031 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc96c08c6a0 con 0x7fc97c1004e0 2024-02-19T18:58:20.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.441+0000 7fc979d9b700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc96406c680 0x7fc96406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:20.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.441+0000 7fc979d9b700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc96406c680 0x7fc96406eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc970005fd0 tx=0x7fc970005ee0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:20.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.445+0000 7fc96b7fe700 1 -- 172.21.15.46:0/2588576031 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc96c057140 con 0x7fc97c1004e0 2024-02-19T18:58:20.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.648+0000 7fc980a17700 1 -- 172.21.15.46:0/2588576031 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc97c1081d0 con 0x7fc97c1004e0 2024-02-19T18:58:20.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.648+0000 7fc96b7fe700 1 -- 172.21.15.46:0/2588576031 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11350 (secure 0 0 0) 0x7fc96c00fe60 con 0x7fc97c1004e0 2024-02-19T18:58:20.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:58:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","created":"2024-02-19T18:51:43.710287+0000","modified":"2024-02-19T18:58:04.329187+0000","last_up_change":"2024-02-19T18:58:03.323987+0000","last_in_change":"2024-02-19T18:57:44.164228+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:56:48.450849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ea35c0-be56-4830-9abc-c67aa3feed47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6803","nonce":3909364861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6805","nonce":3909364861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6809","nonce":3909364861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6807","nonce":3909364861}]},"public_addr":"172.21.15.46:6803/3909364861","cluster_addr":"172.21.15.46:6805/3909364861","heartbeat_back_addr":"172.21.15.46:6809/3909364861","heartbeat_front_addr":"172.21.15.46:6807/3909364861","state":["exists","up"]},{"osd":1,"uuid":"0dcb0202-8fa1-4a72-939d-dd8a5ced3a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6811","nonce":1824596762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6813","nonce":1824596762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6817","nonce":1824596762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6815","nonce":1824596762}]},"public_addr":"172.21.15.46:6811/1824596762","cluster_addr":"172.21.15.46:6813/1824596762","heartbeat_back_addr":"172.21.15.46:6817/1824596762","heartbeat_front_addr":"172.21.15.46:6815/1824596762","state":["exists","up"]},{"osd":2,"uuid":"a5ae09b3-9419-4fc7-8cd5-4a2553bca213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6819","nonce":3246046723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6821","nonce":3246046723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6825","nonce":3246046723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6823","nonce":3246046723}]},"public_addr":"172.21.15.46:6819/3246046723","cluster_addr":"172.21.15.46:6821/3246046723","heartbeat_back_addr":"172.21.15.46:6825/3246046723","heartbeat_front_addr":"172.21.15.46:6823/3246046723","state":["exists","up"]},{"osd":3,"uuid":"3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6801","nonce":3699833248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6803","nonce":3699833248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6807","nonce":3699833248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6805","nonce":3699833248}]},"public_addr":"172.21.15.142:6801/3699833248","cluster_addr":"172.21.15.142:6803/3699833248","heartbeat_back_addr":"172.21.15.142:6807/3699833248","heartbeat_front_addr":"172.21.15.142:6805/3699833248","state":["exists","up"]},{"osd":4,"uuid":"0a0ce92a-f9ac-4f83-877f-93eff87a9f8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6809","nonce":2523325445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6811","nonce":2523325445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6815","nonce":2523325445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6813","nonce":2523325445}]},"public_addr":"172.21.15.142:6809/2523325445","cluster_addr":"172.21.15.142:6811/2523325445","heartbeat_back_addr":"172.21.15.142:6815/2523325445","heartbeat_front_addr":"172.21.15.142:6813/2523325445","state":["exists","up"]},{"osd":5,"uuid":"0eed1f5c-a999-43d8-95ae-1671ac54640b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6817","nonce":4119018815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6819","nonce":4119018815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6823","nonce":4119018815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6821","nonce":4119018815}]},"public_addr":"172.21.15.142:6817/4119018815","cluster_addr":"172.21.15.142:6819/4119018815","heartbeat_back_addr":"172.21.15.142:6823/4119018815","heartbeat_front_addr":"172.21.15.142:6821/4119018815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:55:49.856210+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:17.120054+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:46.102265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:10.285252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:35.715008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:01.554947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/664839364":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/1307799669":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/3901080352":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/3708201410":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6801/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6800/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6800/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/4057722486":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/2954390908":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/2407750441":"2024-02-20T18:52:11.766897+0000","172.21.15.46:6800/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:6801/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/1953665533":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/3268130132":"2024-02-20T18:52:44.819852+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T18:58:20.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.650+0000 7fc980a17700 1 -- 172.21.15.46:0/2588576031 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc96406c680 msgr2=0x7fc96406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:20.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.650+0000 7fc980a17700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc96406c680 0x7fc96406eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc970005fd0 tx=0x7fc970005ee0 comp rx=0 tx=0).stop 2024-02-19T18:58:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.650+0000 7fc980a17700 1 -- 172.21.15.46:0/2588576031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc97c1004e0 msgr2=0x7fc97c195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.650+0000 7fc980a17700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc97c1004e0 0x7fc97c195ef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc96c006010 tx=0x7fc96c00be20 comp rx=0 tx=0).stop 2024-02-19T18:58:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.651+0000 7fc980a17700 1 -- 172.21.15.46:0/2588576031 shutdown_connections 2024-02-19T18:58:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.651+0000 7fc980a17700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc96406c680 0x7fc96406eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.651+0000 7fc980a17700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc97c1004e0 0x7fc97c195ef0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.651+0000 7fc980a17700 1 --2- 172.21.15.46:0/2588576031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc97c100e80 0x7fc97c196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.651+0000 7fc980a17700 1 -- 172.21.15.46:0/2588576031 >> 172.21.15.46:0/2588576031 conn(0x7fc97c0fbda0 msgr2=0x7fc97c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.651+0000 7fc980a17700 1 -- 172.21.15.46:0/2588576031 shutdown_connections 2024-02-19T18:58:20.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:20.651+0000 7fc980a17700 1 -- 172.21.15.46:0/2588576031 wait complete. 2024-02-19T18:58:21.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:21 smithi046 ceph-mon[29647]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:21.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:21 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2588576031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T18:58:21.339 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-19T18:58:21.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T18:58:21.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:21 smithi142 ceph-mon[37169]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:21.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:21 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2588576031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T18:58:21.550 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:23.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.186+0000 7fbda7b3c700 1 -- 172.21.15.46:0/344007281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda0100e80 msgr2=0x7fbda0104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:23.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.186+0000 7fbda7b3c700 1 --2- 172.21.15.46:0/344007281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda0100e80 0x7fbda0104e50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009910 tx=0x7fbd90009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.186+0000 7fbda7b3c700 1 -- 172.21.15.46:0/344007281 shutdown_connections 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.186+0000 7fbda7b3c700 1 --2- 172.21.15.46:0/344007281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda0100e80 0x7fbda0104e50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.186+0000 7fbda7b3c700 1 --2- 172.21.15.46:0/344007281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbda01004e0 0x7fbda01008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.186+0000 7fbda7b3c700 1 -- 172.21.15.46:0/344007281 >> 172.21.15.46:0/344007281 conn(0x7fbda00fbda0 msgr2=0x7fbda00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.186+0000 7fbda7b3c700 1 -- 172.21.15.46:0/344007281 shutdown_connections 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.186+0000 7fbda7b3c700 1 -- 172.21.15.46:0/344007281 wait complete. 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.186+0000 7fbda7b3c700 1 Processor -- start 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda7b3c700 1 -- start start 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda7b3c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda01004e0 0x7fbda0195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda7b3c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbda0100e80 0x7fbda01963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda7b3c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda0196ab0 con 0x7fbda01004e0 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda7b3c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda019a840 con 0x7fbda0100e80 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda58d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda01004e0 0x7fbda0195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:23.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda58d8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda01004e0 0x7fbda0195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53164/0 (socket says 172.21.15.46:53164) 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda58d8700 1 -- 172.21.15.46:0/1903168060 learned_addr learned my addr 172.21.15.46:0/1903168060 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda50d7700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbda0100e80 0x7fbda01963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda58d8700 1 -- 172.21.15.46:0/1903168060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbda0100e80 msgr2=0x7fbda01963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda58d8700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbda0100e80 0x7fbda01963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda58d8700 1 -- 172.21.15.46:0/1903168060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900095f0 con 0x7fbda01004e0 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda58d8700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda01004e0 0x7fbda0195e90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00c8f0 tx=0x7fbd9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbd96ffd700 1 -- 172.21.15.46:0/1903168060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd9c007a70 con 0x7fbda01004e0 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbd96ffd700 1 -- 172.21.15.46:0/1903168060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbd9c004ce0 con 0x7fbda01004e0 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbda7b3c700 1 -- 172.21.15.46:0/1903168060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda019ab20 con 0x7fbda01004e0 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.187+0000 7fbd96ffd700 1 -- 172.21.15.46:0/1903168060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd9c005610 con 0x7fbda01004e0 2024-02-19T18:58:23.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.188+0000 7fbda7b3c700 1 -- 172.21.15.46:0/1903168060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda019b070 con 0x7fbda01004e0 2024-02-19T18:58:23.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.188+0000 7fbda7b3c700 1 -- 172.21.15.46:0/1903168060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda0108760 con 0x7fbda01004e0 2024-02-19T18:58:23.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.189+0000 7fbd96ffd700 1 -- 172.21.15.46:0/1903168060 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbd9c004750 con 0x7fbda01004e0 2024-02-19T18:58:23.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.189+0000 7fbd96ffd700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbd8c06c6d0 0x7fbd8c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:23.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.190+0000 7fbda50d7700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbd8c06c6d0 0x7fbd8c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:23.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.190+0000 7fbd96ffd700 1 -- 172.21.15.46:0/1903168060 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbd9c013070 con 0x7fbda01004e0 2024-02-19T18:58:23.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.190+0000 7fbda50d7700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbd8c06c6d0 0x7fbd8c06eb80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbda01974b0 tx=0x7fbd9001a040 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:23.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.194+0000 7fbd96ffd700 1 -- 172.21.15.46:0/1903168060 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbd9c055e80 con 0x7fbda01004e0 2024-02-19T18:58:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.394+0000 7fbda7b3c700 1 -- 172.21.15.46:0/1903168060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbda004f2a0 con 0x7fbda01004e0 2024-02-19T18:58:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.395+0000 7fbd96ffd700 1 -- 172.21.15.46:0/1903168060 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11350 (secure 0 0 0) 0x7fbd9c0594a0 con 0x7fbda01004e0 2024-02-19T18:58:23.413 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:58:23.413 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":40,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","created":"2024-02-19T18:51:43.710287+0000","modified":"2024-02-19T18:58:04.329187+0000","last_up_change":"2024-02-19T18:58:03.323987+0000","last_in_change":"2024-02-19T18:57:44.164228+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:56:48.450849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ea35c0-be56-4830-9abc-c67aa3feed47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6803","nonce":3909364861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6805","nonce":3909364861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6809","nonce":3909364861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6807","nonce":3909364861}]},"public_addr":"172.21.15.46:6803/3909364861","cluster_addr":"172.21.15.46:6805/3909364861","heartbeat_back_addr":"172.21.15.46:6809/3909364861","heartbeat_front_addr":"172.21.15.46:6807/3909364861","state":["exists","up"]},{"osd":1,"uuid":"0dcb0202-8fa1-4a72-939d-dd8a5ced3a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6811","nonce":1824596762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6813","nonce":1824596762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6817","nonce":1824596762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6815","nonce":1824596762}]},"public_addr":"172.21.15.46:6811/1824596762","cluster_addr":"172.21.15.46:6813/1824596762","heartbeat_back_addr":"172.21.15.46:6817/1824596762","heartbeat_front_addr":"172.21.15.46:6815/1824596762","state":["exists","up"]},{"osd":2,"uuid":"a5ae09b3-9419-4fc7-8cd5-4a2553bca213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6819","nonce":3246046723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6821","nonce":3246046723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6825","nonce":3246046723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6823","nonce":3246046723}]},"public_addr":"172.21.15.46:6819/3246046723","cluster_addr":"172.21.15.46:6821/3246046723","heartbeat_back_addr":"172.21.15.46:6825/3246046723","heartbeat_front_addr":"172.21.15.46:6823/3246046723","state":["exists","up"]},{"osd":3,"uuid":"3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6801","nonce":3699833248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6803","nonce":3699833248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6807","nonce":3699833248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6805","nonce":3699833248}]},"public_addr":"172.21.15.142:6801/3699833248","cluster_addr":"172.21.15.142:6803/3699833248","heartbeat_back_addr":"172.21.15.142:6807/3699833248","heartbeat_front_addr":"172.21.15.142:6805/3699833248","state":["exists","up"]},{"osd":4,"uuid":"0a0ce92a-f9ac-4f83-877f-93eff87a9f8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6809","nonce":2523325445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6811","nonce":2523325445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6815","nonce":2523325445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6813","nonce":2523325445}]},"public_addr":"172.21.15.142:6809/2523325445","cluster_addr":"172.21.15.142:6811/2523325445","heartbeat_back_addr":"172.21.15.142:6815/2523325445","heartbeat_front_addr":"172.21.15.142:6813/2523325445","state":["exists","up"]},{"osd":5,"uuid":"0eed1f5c-a999-43d8-95ae-1671ac54640b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6817","nonce":4119018815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6819","nonce":4119018815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6823","nonce":4119018815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6821","nonce":4119018815}]},"public_addr":"172.21.15.142:6817/4119018815","cluster_addr":"172.21.15.142:6819/4119018815","heartbeat_back_addr":"172.21.15.142:6823/4119018815","heartbeat_front_addr":"172.21.15.142:6821/4119018815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:55:49.856210+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:17.120054+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:46.102265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:10.285252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:35.715008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:01.554947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6801/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/664839364":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/1307799669":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/3901080352":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/3708201410":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6801/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6800/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6800/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/4057722486":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/2954390908":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/2407750441":"2024-02-20T18:52:11.766897+0000","172.21.15.46:6800/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:6801/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/1953665533":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/3268130132":"2024-02-20T18:52:44.819852+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T18:58:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 -- 172.21.15.46:0/1903168060 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbd8c06c6d0 msgr2=0x7fbd8c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbd8c06c6d0 0x7fbd8c06eb80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbda01974b0 tx=0x7fbd9001a040 comp rx=0 tx=0).stop 2024-02-19T18:58:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 -- 172.21.15.46:0/1903168060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda01004e0 msgr2=0x7fbda0195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda01004e0 0x7fbda0195e90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00c8f0 tx=0x7fbd9c00ccb0 comp rx=0 tx=0).stop 2024-02-19T18:58:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 -- 172.21.15.46:0/1903168060 shutdown_connections 2024-02-19T18:58:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbd8c06c6d0 0x7fbd8c06eb80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbda01004e0 0x7fbda0195e90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 --2- 172.21.15.46:0/1903168060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbda0100e80 0x7fbda01963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 -- 172.21.15.46:0/1903168060 >> 172.21.15.46:0/1903168060 conn(0x7fbda00fbda0 msgr2=0x7fbda01046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 -- 172.21.15.46:0/1903168060 shutdown_connections 2024-02-19T18:58:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:23.397+0000 7fbda7b3c700 1 -- 172.21.15.46:0/1903168060 wait complete. 2024-02-19T18:58:23.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:23 smithi142 ceph-mon[37169]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:23.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:23 smithi046 ceph-mon[29647]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:24.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-19T18:58:24.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-19T18:58:24.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-19T18:58:24.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-19T18:58:24.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-19T18:58:24.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-19T18:58:24.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:24 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1903168060' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T18:58:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:24.627 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:24.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:24 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1903168060' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T18:58:24.905 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:24.905 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:24.906 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:25.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:25 smithi046 ceph-mon[29647]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:25.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:25 smithi142 ceph-mon[37169]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:27.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:27 smithi046 ceph-mon[29647]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:27.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:27 smithi142 ceph-mon[37169]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:29.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.372+0000 7f6d7d257700 1 -- 172.21.15.46:0/1810723163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100e80 msgr2=0x7f6d78104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:29.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.372+0000 7f6d7d257700 1 --2- 172.21.15.46:0/1810723163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100e80 0x7f6d78104e50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c009910 tx=0x7f6d6c009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:29.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.372+0000 7f6d7d257700 1 -- 172.21.15.46:0/1810723163 shutdown_connections 2024-02-19T18:58:29.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.372+0000 7f6d7d257700 1 --2- 172.21.15.46:0/1810723163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100e80 0x7f6d78104e50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:29.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.372+0000 7f6d7d257700 1 --2- 172.21.15.46:0/1810723163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d781004e0 0x7f6d781008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:29.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.372+0000 7f6d7d257700 1 -- 172.21.15.46:0/1810723163 >> 172.21.15.46:0/1810723163 conn(0x7f6d780fbda0 msgr2=0x7f6d780fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:29.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.372+0000 7f6d7d257700 1 -- 172.21.15.46:0/1810723163 shutdown_connections 2024-02-19T18:58:29.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.373+0000 7f6d7d257700 1 -- 172.21.15.46:0/1810723163 wait complete. 2024-02-19T18:58:29.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.373+0000 7f6d7d257700 1 Processor -- start 2024-02-19T18:58:29.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.373+0000 7f6d7d257700 1 -- start start 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7d257700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d781004e0 0x7f6d78195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7d257700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100e80 0x7f6d781964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7d257700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d78196bb0 con 0x7f6d78100e80 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7d257700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7819a940 con 0x7f6d781004e0 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100e80 0x7f6d781964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100e80 0x7f6d781964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41806/0 (socket says 172.21.15.46:41806) 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7659c700 1 -- 172.21.15.46:0/872200835 learned_addr learned my addr 172.21.15.46:0/872200835 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d76d9d700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d781004e0 0x7f6d78195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7659c700 1 -- 172.21.15.46:0/872200835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d781004e0 msgr2=0x7f6d78195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7659c700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d781004e0 0x7f6d78195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:29.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7659c700 1 -- 172.21.15.46:0/872200835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0095f0 con 0x7f6d78100e80 2024-02-19T18:58:29.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7659c700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100e80 0x7f6d781964d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0092e0 tx=0x7f6d6c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:29.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d5ffff700 1 -- 172.21.15.46:0/872200835 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d6c01d070 con 0x7f6d78100e80 2024-02-19T18:58:29.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d7819abc0 con 0x7f6d78100e80 2024-02-19T18:58:29.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d5ffff700 1 -- 172.21.15.46:0/872200835 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d6c004fa0 con 0x7f6d78100e80 2024-02-19T18:58:29.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.374+0000 7f6d5ffff700 1 -- 172.21.15.46:0/872200835 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d6c00f690 con 0x7f6d78100e80 2024-02-19T18:58:29.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.375+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7819b0b0 con 0x7f6d78100e80 2024-02-19T18:58:29.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.375+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d7810d6d0 con 0x7f6d78100e80 2024-02-19T18:58:29.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.376+0000 7f6d5ffff700 1 -- 172.21.15.46:0/872200835 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6d6c022470 con 0x7f6d78100e80 2024-02-19T18:58:29.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.376+0000 7f6d5ffff700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6d6006c680 0x7f6d6006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:29.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.376+0000 7f6d5ffff700 1 -- 172.21.15.46:0/872200835 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6d6c08d6e0 con 0x7f6d78100e80 2024-02-19T18:58:29.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.376+0000 7f6d76d9d700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6d6006c680 0x7f6d6006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:29.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.376+0000 7f6d5ffff700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815] conn(0x7f6d60072350 0x7f6d60074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:29.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.376+0000 7f6d5ffff700 1 -- 172.21.15.46:0/872200835 --> [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d60074e10 con 0x7f6d60072350 2024-02-19T18:58:29.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.376+0000 7f6d5ffff700 1 -- 172.21.15.46:0/872200835 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d6c08daa0 con 0x7f6d78100e80 2024-02-19T18:58:29.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.377+0000 7f6d76d9d700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6d6006c680 0x7f6d6006eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009a10 tx=0x7f6d68009190 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:29.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.377+0000 7f6d7759e700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815] conn(0x7f6d60072350 0x7f6d60074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:29.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.377+0000 7f6d7759e700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815] conn(0x7f6d60072350 0x7f6d60074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:29.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.378+0000 7f6d5ffff700 1 -- 172.21.15.46:0/872200835 <== osd.5 v2:172.21.15.142:6816/4119018815 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6d60074e10 con 0x7f6d60072350 2024-02-19T18:58:29.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.394+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 --> [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6d7804f2a0 con 0x7f6d60072350 2024-02-19T18:58:29.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.394+0000 7f6d5ffff700 1 -- 172.21.15.46:0/872200835 <== osd.5 v2:172.21.15.142:6816/4119018815 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6d7804f2a0 con 0x7f6d60072350 2024-02-19T18:58:29.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 >> [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815] conn(0x7f6d60072350 msgr2=0x7f6d60074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:29.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815] conn(0x7f6d60072350 0x7f6d60074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:29.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6d6006c680 msgr2=0x7f6d6006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:29.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6d6006c680 0x7f6d6006eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009a10 tx=0x7f6d68009190 comp rx=0 tx=0).stop 2024-02-19T18:58:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100e80 msgr2=0x7f6d781964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100e80 0x7f6d781964d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0092e0 tx=0x7f6d6c00bd70 comp rx=0 tx=0).stop 2024-02-19T18:58:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 shutdown_connections 2024-02-19T18:58:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6d6006c680 0x7f6d6006eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d781004e0 0x7f6d78195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.142:6816/4119018815,v1:172.21.15.142:6817/4119018815] conn(0x7f6d60072350 0x7f6d60074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 --2- 172.21.15.46:0/872200835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100e80 0x7f6d781964d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 >> 172.21.15.46:0/872200835 conn(0x7f6d780fbda0 msgr2=0x7f6d780fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 shutdown_connections 2024-02-19T18:58:29.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:29.395+0000 7f6d7d257700 1 -- 172.21.15.46:0/872200835 wait complete. 2024-02-19T18:58:29.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:29 smithi046 ceph-mon[29647]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:29.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:29 smithi142 ceph-mon[37169]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:30.853 INFO:teuthology.orchestra.run.smithi046.stdout:167503724552 2024-02-19T18:58:30.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-19T18:58:31.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:31 smithi046 ceph-mon[29647]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:31.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:31 smithi142 ceph-mon[37169]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.475+0000 7fb114797700 1 -- 172.21.15.46:0/3728125947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb10c0ffd60 msgr2=0x7fb10c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.475+0000 7fb114797700 1 --2- 172.21.15.46:0/3728125947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb10c0ffd60 0x7fb10c103d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009910 tx=0x7fb0fc009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.475+0000 7fb114797700 1 -- 172.21.15.46:0/3728125947 shutdown_connections 2024-02-19T18:58:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.475+0000 7fb114797700 1 --2- 172.21.15.46:0/3728125947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb10c0ffd60 0x7fb10c103d30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.475+0000 7fb114797700 1 --2- 172.21.15.46:0/3728125947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb10c0ff3c0 0x7fb10c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.475+0000 7fb114797700 1 -- 172.21.15.46:0/3728125947 >> 172.21.15.46:0/3728125947 conn(0x7fb10c0fac60 msgr2=0x7fb10c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.475+0000 7fb114797700 1 -- 172.21.15.46:0/3728125947 shutdown_connections 2024-02-19T18:58:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.475+0000 7fb114797700 1 -- 172.21.15.46:0/3728125947 wait complete. 2024-02-19T18:58:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb114797700 1 Processor -- start 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb114797700 1 -- start start 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb114797700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb10c0ff3c0 0x7fb10c100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb114797700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb10c0ffd60 0x7fb10c101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb114797700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c101850 con 0x7fb10c0ffd60 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb114797700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c101990 con 0x7fb10c0ff3c0 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb111d32700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb10c0ffd60 0x7fb10c101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb111d32700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb10c0ffd60 0x7fb10c101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41812/0 (socket says 172.21.15.46:41812) 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb111d32700 1 -- 172.21.15.46:0/2361764739 learned_addr learned my addr 172.21.15.46:0/2361764739 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb112533700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb10c0ff3c0 0x7fb10c100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb111d32700 1 -- 172.21.15.46:0/2361764739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb10c0ff3c0 msgr2=0x7fb10c100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb111d32700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb10c0ff3c0 0x7fb10c100dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.476+0000 7fb111d32700 1 -- 172.21.15.46:0/2361764739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0095f0 con 0x7fb10c0ffd60 2024-02-19T18:58:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.477+0000 7fb111d32700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb10c0ffd60 0x7fb10c101310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0092e0 tx=0x7fb0fc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.477+0000 7fb1037fe700 1 -- 172.21.15.46:0/2361764739 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0fc01d070 con 0x7fb10c0ffd60 2024-02-19T18:58:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.477+0000 7fb1037fe700 1 -- 172.21.15.46:0/2361764739 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb0fc00f460 con 0x7fb10c0ffd60 2024-02-19T18:58:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.477+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c101c10 con 0x7fb10c0ffd60 2024-02-19T18:58:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.477+0000 7fb1037fe700 1 -- 172.21.15.46:0/2361764739 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0fc017630 con 0x7fb10c0ffd60 2024-02-19T18:58:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.477+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c1a2340 con 0x7fb10c0ffd60 2024-02-19T18:58:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.478+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb10c10c530 con 0x7fb10c0ffd60 2024-02-19T18:58:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.478+0000 7fb1037fe700 1 -- 172.21.15.46:0/2361764739 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb0fc00f5d0 con 0x7fb10c0ffd60 2024-02-19T18:58:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.479+0000 7fb1037fe700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb0f806c680 0x7fb0f806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.479+0000 7fb1037fe700 1 -- 172.21.15.46:0/2361764739 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb0fc08c9a0 con 0x7fb10c0ffd60 2024-02-19T18:58:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.479+0000 7fb112533700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb0f806c680 0x7fb0f806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.479+0000 7fb1037fe700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723] conn(0x7fb0f8072350 0x7fb0f8074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.479+0000 7fb1037fe700 1 -- 172.21.15.46:0/2361764739 --> [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0f8074e10 con 0x7fb0f8072350 2024-02-19T18:58:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.479+0000 7fb1037fe700 1 -- 172.21.15.46:0/2361764739 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0fc0912a0 con 0x7fb10c0ffd60 2024-02-19T18:58:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.479+0000 7fb112d34700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723] conn(0x7fb0f8072350 0x7fb0f8074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.479+0000 7fb112533700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb0f806c680 0x7fb0f806eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb108005950 tx=0x7fb1080058e0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.479+0000 7fb112d34700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723] conn(0x7fb0f8072350 0x7fb0f8074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.480+0000 7fb1037fe700 1 -- 172.21.15.46:0/2361764739 <== osd.2 v2:172.21.15.46:6818/3246046723 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb0f8074e10 con 0x7fb0f8072350 2024-02-19T18:58:31.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.496+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 --> [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb10c067980 con 0x7fb0f8072350 2024-02-19T18:58:31.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.496+0000 7fb1037fe700 1 -- 172.21.15.46:0/2361764739 <== osd.2 v2:172.21.15.46:6818/3246046723 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb10c067980 con 0x7fb0f8072350 2024-02-19T18:58:31.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723] conn(0x7fb0f8072350 msgr2=0x7fb0f8074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:31.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723] conn(0x7fb0f8072350 0x7fb0f8074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:31.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb0f806c680 msgr2=0x7fb0f806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:31.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb0f806c680 0x7fb0f806eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb108005950 tx=0x7fb1080058e0 comp rx=0 tx=0).stop 2024-02-19T18:58:31.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb10c0ffd60 msgr2=0x7fb10c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:31.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb10c0ffd60 0x7fb10c101310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0092e0 tx=0x7fb0fc00be20 comp rx=0 tx=0).stop 2024-02-19T18:58:31.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 shutdown_connections 2024-02-19T18:58:31.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6818/3246046723,v1:172.21.15.46:6819/3246046723] conn(0x7fb0f8072350 0x7fb0f8074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:31.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb0f806c680 0x7fb0f806eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:31.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb10c0ff3c0 0x7fb10c100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:31.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 --2- 172.21.15.46:0/2361764739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb10c0ffd60 0x7fb10c101310 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:31.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 >> 172.21.15.46:0/2361764739 conn(0x7fb10c0fac60 msgr2=0x7fb10c069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:31.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 shutdown_connections 2024-02-19T18:58:31.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:31.497+0000 7fb114797700 1 -- 172.21.15.46:0/2361764739 wait complete. 2024-02-19T18:58:32.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.314+0000 7f3d93ec6700 1 -- 172.21.15.46:0/1834878399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d8c104130 msgr2=0x7f3d8c104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:32.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.314+0000 7f3d93ec6700 1 --2- 172.21.15.46:0/1834878399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d8c104130 0x7f3d8c104500 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009910 tx=0x7f3d80009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:32.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.314+0000 7f3d93ec6700 1 -- 172.21.15.46:0/1834878399 shutdown_connections 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.314+0000 7f3d93ec6700 1 --2- 172.21.15.46:0/1834878399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d8c0ffbd0 0x7f3d8c100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.314+0000 7f3d93ec6700 1 --2- 172.21.15.46:0/1834878399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d8c104130 0x7f3d8c104500 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.314+0000 7f3d93ec6700 1 -- 172.21.15.46:0/1834878399 >> 172.21.15.46:0/1834878399 conn(0x7f3d8c075130 msgr2=0x7f3d8c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.314+0000 7f3d93ec6700 1 -- 172.21.15.46:0/1834878399 shutdown_connections 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.314+0000 7f3d93ec6700 1 -- 172.21.15.46:0/1834878399 wait complete. 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.314+0000 7f3d93ec6700 1 Processor -- start 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d93ec6700 1 -- start start 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d93ec6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d8c0ffbd0 0x7f3d8c195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d93ec6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d8c104130 0x7f3d8c196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d93ec6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c1969e0 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d93ec6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c196b20 con 0x7f3d8c104130 2024-02-19T18:58:32.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d91c62700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d8c0ffbd0 0x7f3d8c195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:32.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d91c62700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d8c0ffbd0 0x7f3d8c195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41824/0 (socket says 172.21.15.46:41824) 2024-02-19T18:58:32.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d91c62700 1 -- 172.21.15.46:0/2780608194 learned_addr learned my addr 172.21.15.46:0/2780608194 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:32.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d91461700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d8c104130 0x7f3d8c196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:32.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d91c62700 1 -- 172.21.15.46:0/2780608194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d8c104130 msgr2=0x7f3d8c196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:32.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d91c62700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d8c104130 0x7f3d8c196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:32.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d91c62700 1 -- 172.21.15.46:0/2780608194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800095f0 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d91461700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d8c104130 0x7f3d8c196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T18:58:32.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d91c62700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d8c0ffbd0 0x7f3d8c195e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d80006010 tx=0x7f3d8000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:32.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d7effd700 1 -- 172.21.15.46:0/2780608194 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d8001d070 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c19a910 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d7effd700 1 -- 172.21.15.46:0/2780608194 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3d8000f460 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d7effd700 1 -- 172.21.15.46:0/2780608194 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d80021620 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.315+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c19ae00 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.316+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d8c10c5c0 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.317+0000 7f3d7effd700 1 -- 172.21.15.46:0/2780608194 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3d8000faf0 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.317+0000 7f3d7effd700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3d7806c680 0x7f3d7806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:32.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.317+0000 7f3d7effd700 1 -- 172.21.15.46:0/2780608194 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3d8008cf80 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.317+0000 7f3d91461700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3d7806c680 0x7f3d7806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:32.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.317+0000 7f3d7effd700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861] conn(0x7f3d78072350 0x7f3d78074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:32.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.317+0000 7f3d7effd700 1 -- 172.21.15.46:0/2780608194 --> [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d78074e10 con 0x7f3d78072350 2024-02-19T18:58:32.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.317+0000 7f3d7effd700 1 -- 172.21.15.46:0/2780608194 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d8008d3e0 con 0x7f3d8c0ffbd0 2024-02-19T18:58:32.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.318+0000 7f3d92463700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861] conn(0x7f3d78072350 0x7f3d78074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:32.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.318+0000 7f3d91461700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3d7806c680 0x7f3d7806eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d88005fd0 tx=0x7f3d88005e20 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:32.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.318+0000 7f3d92463700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861] conn(0x7f3d78072350 0x7f3d78074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:32.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.319+0000 7f3d7effd700 1 -- 172.21.15.46:0/2780608194 <== osd.0 v2:172.21.15.46:6802/3909364861 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3d78074e10 con 0x7f3d78072350 2024-02-19T18:58:32.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:32 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:32.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.335+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 --> [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d8c04f2a0 con 0x7f3d78072350 2024-02-19T18:58:32.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.335+0000 7f3d7effd700 1 -- 172.21.15.46:0/2780608194 <== osd.0 v2:172.21.15.46:6802/3909364861 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d8c04f2a0 con 0x7f3d78072350 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861] conn(0x7f3d78072350 msgr2=0x7f3d78074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861] conn(0x7f3d78072350 0x7f3d78074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3d7806c680 msgr2=0x7f3d7806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3d7806c680 0x7f3d7806eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d88005fd0 tx=0x7f3d88005e20 comp rx=0 tx=0).stop 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d8c0ffbd0 msgr2=0x7f3d8c195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d8c0ffbd0 0x7f3d8c195e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d80006010 tx=0x7f3d8000be20 comp rx=0 tx=0).stop 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 shutdown_connections 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6802/3909364861,v1:172.21.15.46:6803/3909364861] conn(0x7f3d78072350 0x7f3d78074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3d7806c680 0x7f3d7806eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d8c0ffbd0 0x7f3d8c195e50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 --2- 172.21.15.46:0/2780608194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d8c104130 0x7f3d8c196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 >> 172.21.15.46:0/2780608194 conn(0x7f3d8c075130 msgr2=0x7f3d8c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 shutdown_connections 2024-02-19T18:58:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:32.336+0000 7f3d93ec6700 1 -- 172.21.15.46:0/2780608194 wait complete. 2024-02-19T18:58:32.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:32 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.224+0000 7f7cb5144700 1 -- 172.21.15.46:0/3726097528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb00ff350 msgr2=0x7f7cb00ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.224+0000 7f7cb5144700 1 --2- 172.21.15.46:0/3726097528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb00ff350 0x7f7cb00ff720 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009910 tx=0x7f7ca4009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.224+0000 7f7cb5144700 1 -- 172.21.15.46:0/3726097528 shutdown_connections 2024-02-19T18:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.224+0000 7f7cb5144700 1 --2- 172.21.15.46:0/3726097528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb00ffc60 0x7f7cb010a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.224+0000 7f7cb5144700 1 --2- 172.21.15.46:0/3726097528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb00ff350 0x7f7cb00ff720 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:33.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.224+0000 7f7cb5144700 1 -- 172.21.15.46:0/3726097528 >> 172.21.15.46:0/3726097528 conn(0x7f7cb00748b0 msgr2=0x7f7cb0074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:33.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.224+0000 7f7cb5144700 1 -- 172.21.15.46:0/3726097528 shutdown_connections 2024-02-19T18:58:33.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.224+0000 7f7cb5144700 1 -- 172.21.15.46:0/3726097528 wait complete. 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7cb5144700 1 Processor -- start 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7cb5144700 1 -- start start 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7cb5144700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb00ff350 0x7f7cb0195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7cb5144700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb00ffc60 0x7f7cb0196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7cb5144700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0196b60 con 0x7f7cb00ffc60 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7cb5144700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb019a8f0 con 0x7f7cb00ff350 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7cae59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb00ffc60 0x7f7cb0196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7caed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb00ff350 0x7f7cb0195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7cae59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb00ffc60 0x7f7cb0196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41850/0 (socket says 172.21.15.46:41850) 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7cae59c700 1 -- 172.21.15.46:0/4048692997 learned_addr learned my addr 172.21.15.46:0/4048692997 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.225+0000 7f7cae59c700 1 -- 172.21.15.46:0/4048692997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb00ff350 msgr2=0x7f7cb0195f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.226+0000 7f7cae59c700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb00ff350 0x7f7cb0195f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:33.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.226+0000 7f7cae59c700 1 -- 172.21.15.46:0/4048692997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40095f0 con 0x7f7cb00ffc60 2024-02-19T18:58:33.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.226+0000 7f7cae59c700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb00ffc60 0x7f7cb0196480 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000b4b0 tx=0x7f7ca000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:33.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.228+0000 7f7c97fff700 1 -- 172.21.15.46:0/4048692997 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ca0011800 con 0x7f7cb00ffc60 2024-02-19T18:58:33.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.228+0000 7f7c97fff700 1 -- 172.21.15.46:0/4048692997 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7ca0011e10 con 0x7f7cb00ffc60 2024-02-19T18:58:33.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.228+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb019abd0 con 0x7f7cb00ffc60 2024-02-19T18:58:33.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.228+0000 7f7c97fff700 1 -- 172.21.15.46:0/4048692997 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ca000f2e0 con 0x7f7cb00ffc60 2024-02-19T18:58:33.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.228+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb019b120 con 0x7f7cb00ffc60 2024-02-19T18:58:33.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.229+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7cb010d620 con 0x7f7cb00ffc60 2024-02-19T18:58:33.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.230+0000 7f7c97fff700 1 -- 172.21.15.46:0/4048692997 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7ca0010380 con 0x7f7cb00ffc60 2024-02-19T18:58:33.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.230+0000 7f7c97fff700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7c9806c680 0x7f7c9806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:33.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.230+0000 7f7c97fff700 1 -- 172.21.15.46:0/4048692997 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7ca008b670 con 0x7f7cb00ffc60 2024-02-19T18:58:33.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.230+0000 7f7caed9d700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7c9806c680 0x7f7c9806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:33.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.230+0000 7f7c97fff700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248] conn(0x7f7c98072350 0x7f7c98074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:33.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.230+0000 7f7c97fff700 1 -- 172.21.15.46:0/4048692997 --> [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c98074e10 con 0x7f7c98072350 2024-02-19T18:58:33.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.230+0000 7f7c97fff700 1 -- 172.21.15.46:0/4048692997 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ca008bad0 con 0x7f7cb00ffc60 2024-02-19T18:58:33.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.231+0000 7f7caf59e700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248] conn(0x7f7c98072350 0x7f7c98074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:33.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.231+0000 7f7caed9d700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7c9806c680 0x7f7c9806eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400b850 tx=0x7f7ca400b540 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:33.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.231+0000 7f7caf59e700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248] conn(0x7f7c98072350 0x7f7c98074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:33.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.232+0000 7f7c97fff700 1 -- 172.21.15.46:0/4048692997 <== osd.3 v2:172.21.15.142:6800/3699833248 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7c98074e10 con 0x7f7c98072350 2024-02-19T18:58:33.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.248+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 --> [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7cb004f2a0 con 0x7f7c98072350 2024-02-19T18:58:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.248+0000 7f7c97fff700 1 -- 172.21.15.46:0/4048692997 <== osd.3 v2:172.21.15.142:6800/3699833248 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7cb004f2a0 con 0x7f7c98072350 2024-02-19T18:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 >> [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248] conn(0x7f7c98072350 msgr2=0x7f7c98074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248] conn(0x7f7c98072350 0x7f7c98074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7c9806c680 msgr2=0x7f7c9806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7c9806c680 0x7f7c9806eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400b850 tx=0x7f7ca400b540 comp rx=0 tx=0).stop 2024-02-19T18:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb00ffc60 msgr2=0x7f7cb0196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb00ffc60 0x7f7cb0196480 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000b4b0 tx=0x7f7ca000b7c0 comp rx=0 tx=0).stop 2024-02-19T18:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 shutdown_connections 2024-02-19T18:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.142:6800/3699833248,v1:172.21.15.142:6801/3699833248] conn(0x7f7c98072350 0x7f7c98074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:33.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7c9806c680 0x7f7c9806eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:33.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cb00ff350 0x7f7cb0195f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:33.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 --2- 172.21.15.46:0/4048692997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cb00ffc60 0x7f7cb0196480 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:33.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 >> 172.21.15.46:0/4048692997 conn(0x7f7cb00748b0 msgr2=0x7f7cb0104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:33.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 shutdown_connections 2024-02-19T18:58:33.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:33.249+0000 7f7cb5144700 1 -- 172.21.15.46:0/4048692997 wait complete. 2024-02-19T18:58:33.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:33 smithi142 ceph-mon[37169]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:33.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:33 smithi046 ceph-mon[29647]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:33.928 INFO:teuthology.orchestra.run.smithi046.stdout:38654705699 2024-02-19T18:58:33.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-19T18:58:34.430 INFO:teuthology.orchestra.run.smithi046.stdout:111669149716 2024-02-19T18:58:34.430 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-19T18:58:34.993 INFO:teuthology.orchestra.run.smithi046.stdout:81604378647 2024-02-19T18:58:34.993 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-19T18:58:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:35 smithi046 ceph-mon[29647]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:35.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:35 smithi142 ceph-mon[37169]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.869+0000 7f9ddfd39700 1 -- 172.21.15.46:0/2212577065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd81004e0 msgr2=0x7f9dd81008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.869+0000 7f9ddfd39700 1 --2- 172.21.15.46:0/2212577065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd81004e0 0x7f9dd81008b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009910 tx=0x7f9dd4009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.869+0000 7f9ddfd39700 1 -- 172.21.15.46:0/2212577065 shutdown_connections 2024-02-19T18:58:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.869+0000 7f9ddfd39700 1 --2- 172.21.15.46:0/2212577065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8100e80 0x7f9dd8104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.869+0000 7f9ddfd39700 1 --2- 172.21.15.46:0/2212577065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd81004e0 0x7f9dd81008b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:35.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.869+0000 7f9ddfd39700 1 -- 172.21.15.46:0/2212577065 >> 172.21.15.46:0/2212577065 conn(0x7f9dd80fbda0 msgr2=0x7f9dd80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:35.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.870+0000 7f9ddfd39700 1 -- 172.21.15.46:0/2212577065 shutdown_connections 2024-02-19T18:58:35.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.870+0000 7f9ddfd39700 1 -- 172.21.15.46:0/2212577065 wait complete. 2024-02-19T18:58:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.870+0000 7f9ddfd39700 1 Processor -- start 2024-02-19T18:58:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.871+0000 7f9ddfd39700 1 -- start start 2024-02-19T18:58:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.871+0000 7f9ddfd39700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd81004e0 0x7f9dd8193af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.871+0000 7f9ddfd39700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100e80 0x7f9dd8194030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.871+0000 7f9ddfd39700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8196c70 con 0x7f9dd8100e80 2024-02-19T18:58:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.871+0000 7f9ddfd39700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8196de0 con 0x7f9dd81004e0 2024-02-19T18:58:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.871+0000 7f9ddd2d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100e80 0x7f9dd8194030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.871+0000 7f9ddd2d4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100e80 0x7f9dd8194030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41866/0 (socket says 172.21.15.46:41866) 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.871+0000 7f9ddd2d4700 1 -- 172.21.15.46:0/3274080963 learned_addr learned my addr 172.21.15.46:0/3274080963 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.871+0000 7f9dddad5700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd81004e0 0x7f9dd8193af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.872+0000 7f9ddd2d4700 1 -- 172.21.15.46:0/3274080963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd81004e0 msgr2=0x7f9dd8193af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.872+0000 7f9ddd2d4700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd81004e0 0x7f9dd8193af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.872+0000 7f9ddd2d4700 1 -- 172.21.15.46:0/3274080963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd40095f0 con 0x7f9dd8100e80 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.872+0000 7f9ddd2d4700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100e80 0x7f9dd8194030 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800d900 tx=0x7f9dc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.872+0000 7f9dceffd700 1 -- 172.21.15.46:0/3274080963 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dc8009900 con 0x7f9dd8100e80 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.872+0000 7f9dceffd700 1 -- 172.21.15.46:0/3274080963 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9dc8010460 con 0x7f9dd8100e80 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.872+0000 7f9dceffd700 1 -- 172.21.15.46:0/3274080963 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dc800f5f0 con 0x7f9dd8100e80 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.872+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd81970c0 con 0x7f9dd8100e80 2024-02-19T18:58:35.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.872+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd8197550 con 0x7f9dd8100e80 2024-02-19T18:58:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.873+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9dd810d670 con 0x7f9dd8100e80 2024-02-19T18:58:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.874+0000 7f9dceffd700 1 -- 172.21.15.46:0/3274080963 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9dc80105d0 con 0x7f9dd8100e80 2024-02-19T18:58:35.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.875+0000 7f9dceffd700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9dc406c680 0x7f9dc406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.875+0000 7f9dceffd700 1 -- 172.21.15.46:0/3274080963 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9dc808b2d0 con 0x7f9dd8100e80 2024-02-19T18:58:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.875+0000 7f9dceffd700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762] conn(0x7f9dc4072350 0x7f9dc4074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.875+0000 7f9dceffd700 1 -- 172.21.15.46:0/3274080963 --> [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9dc4074e10 con 0x7f9dc4072350 2024-02-19T18:58:35.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.875+0000 7f9dceffd700 1 -- 172.21.15.46:0/3274080963 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dc808d9a0 con 0x7f9dd8100e80 2024-02-19T18:58:35.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.875+0000 7f9dddad5700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9dc406c680 0x7f9dc406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:35.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.875+0000 7f9dde2d6700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762] conn(0x7f9dc4072350 0x7f9dc4074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:35.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.876+0000 7f9dddad5700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9dc406c680 0x7f9dc406eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b5c0 tx=0x7f9dd401a040 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:35.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.876+0000 7f9dde2d6700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762] conn(0x7f9dc4072350 0x7f9dc4074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:35.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.877+0000 7f9dceffd700 1 -- 172.21.15.46:0/3274080963 <== osd.1 v2:172.21.15.46:6810/1824596762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9dc4074e10 con 0x7f9dc4072350 2024-02-19T18:58:35.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.895+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 --> [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9dd804f2a0 con 0x7f9dc4072350 2024-02-19T18:58:35.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9dceffd700 1 -- 172.21.15.46:0/3274080963 <== osd.1 v2:172.21.15.46:6810/1824596762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9dd804f2a0 con 0x7f9dc4072350 2024-02-19T18:58:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762] conn(0x7f9dc4072350 msgr2=0x7f9dc4074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762] conn(0x7f9dc4072350 0x7f9dc4074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9dc406c680 msgr2=0x7f9dc406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9dc406c680 0x7f9dc406eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400b5c0 tx=0x7f9dd401a040 comp rx=0 tx=0).stop 2024-02-19T18:58:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100e80 msgr2=0x7f9dd8194030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:35.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100e80 0x7f9dd8194030 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800d900 tx=0x7f9dc800dcc0 comp rx=0 tx=0).stop 2024-02-19T18:58:35.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 shutdown_connections 2024-02-19T18:58:35.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9dc406c680 0x7f9dc406eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:35.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:6810/1824596762,v1:172.21.15.46:6811/1824596762] conn(0x7f9dc4072350 0x7f9dc4074760 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:35.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd81004e0 0x7f9dd8193af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:35.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.896+0000 7f9ddfd39700 1 --2- 172.21.15.46:0/3274080963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100e80 0x7f9dd8194030 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:35.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.897+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 >> 172.21.15.46:0/3274080963 conn(0x7f9dd80fbda0 msgr2=0x7f9dd80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:35.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.897+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 shutdown_connections 2024-02-19T18:58:35.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:35.897+0000 7f9ddfd39700 1 -- 172.21.15.46:0/3274080963 wait complete. 2024-02-19T18:58:35.919 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:36.153 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:36.553 INFO:teuthology.orchestra.run.smithi046.stdout:60129542174 2024-02-19T18:58:36.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-19T18:58:37.220 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:37.508 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:37 smithi046 ceph-mon[29647]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:37.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:37 smithi142 ceph-mon[37169]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.878+0000 7fc0a190a700 1 -- 172.21.15.46:0/868655545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09c101070 msgr2=0x7fc09c101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.878+0000 7fc0a190a700 1 --2- 172.21.15.46:0/868655545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09c101070 0x7fc09c101440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc094009910 tx=0x7fc094009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.878+0000 7fc0a190a700 1 -- 172.21.15.46:0/868655545 shutdown_connections 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.878+0000 7fc0a190a700 1 --2- 172.21.15.46:0/868655545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc09c068540 0x7fc09c0689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.878+0000 7fc0a190a700 1 --2- 172.21.15.46:0/868655545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09c101070 0x7fc09c101440 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.878+0000 7fc0a190a700 1 -- 172.21.15.46:0/868655545 >> 172.21.15.46:0/868655545 conn(0x7fc09c075130 msgr2=0x7fc09c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.878+0000 7fc0a190a700 1 -- 172.21.15.46:0/868655545 shutdown_connections 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.878+0000 7fc0a190a700 1 -- 172.21.15.46:0/868655545 wait complete. 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.879+0000 7fc0a190a700 1 Processor -- start 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.879+0000 7fc0a190a700 1 -- start start 2024-02-19T18:58:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.879+0000 7fc0a190a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09c068540 0x7fc09c198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.879+0000 7fc0a190a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc09c101070 0x7fc09c198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.879+0000 7fc0a190a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c198be0 con 0x7fc09c068540 2024-02-19T18:58:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.879+0000 7fc0a190a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c198d20 con 0x7fc09c101070 2024-02-19T18:58:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc09affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09c068540 0x7fc09c198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc09affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09c068540 0x7fc09c198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36516/0 (socket says 172.21.15.46:36516) 2024-02-19T18:58:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc09affd700 1 -- 172.21.15.46:0/335615342 learned_addr learned my addr 172.21.15.46:0/335615342 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc09a7fc700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc09c101070 0x7fc09c198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc09affd700 1 -- 172.21.15.46:0/335615342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc09c101070 msgr2=0x7fc09c198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc09affd700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc09c101070 0x7fc09c198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:37.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc09affd700 1 -- 172.21.15.46:0/335615342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940095f0 con 0x7fc09c068540 2024-02-19T18:58:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc09affd700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09c068540 0x7fc09c198050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc094006010 tx=0x7fc09400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc0a0908700 1 -- 172.21.15.46:0/335615342 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc09401d070 con 0x7fc09c068540 2024-02-19T18:58:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c19cb10 con 0x7fc09c068540 2024-02-19T18:58:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc0a0908700 1 -- 172.21.15.46:0/335615342 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc094004fa0 con 0x7fc09c068540 2024-02-19T18:58:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.880+0000 7fc0a0908700 1 -- 172.21.15.46:0/335615342 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc09400f690 con 0x7fc09c068540 2024-02-19T18:58:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.881+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c19d000 con 0x7fc09c068540 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.881+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc09c10f840 con 0x7fc09c068540 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.882+0000 7fc0a0908700 1 -- 172.21.15.46:0/335615342 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc094004af0 con 0x7fc09c068540 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.882+0000 7fc0a0908700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc08806c680 0x7fc08806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.883+0000 7fc0a0908700 1 -- 172.21.15.46:0/335615342 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc09408cd00 con 0x7fc09c068540 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.883+0000 7fc09a7fc700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc08806c680 0x7fc08806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.883+0000 7fc0a0908700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445] conn(0x7fc088072350 0x7fc088074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.883+0000 7fc0a0908700 1 -- 172.21.15.46:0/335615342 --> [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc088074e10 con 0x7fc088072350 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.883+0000 7fc0a0908700 1 -- 172.21.15.46:0/335615342 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0940923e0 con 0x7fc09c068540 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.883+0000 7fc09b7fe700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445] conn(0x7fc088072350 0x7fc088074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.883+0000 7fc09a7fc700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc08806c680 0x7fc08806eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc09c199670 tx=0x7fc08400a380 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.883+0000 7fc09b7fe700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445] conn(0x7fc088072350 0x7fc088074760 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:37.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.884+0000 7fc0a0908700 1 -- 172.21.15.46:0/335615342 <== osd.4 v2:172.21.15.142:6808/2523325445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc088074e10 con 0x7fc088072350 2024-02-19T18:58:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.902+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 --> [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc09c04f2a0 con 0x7fc088072350 2024-02-19T18:58:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.902+0000 7fc0a0908700 1 -- 172.21.15.46:0/335615342 <== osd.4 v2:172.21.15.142:6808/2523325445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc09c04f2a0 con 0x7fc088072350 2024-02-19T18:58:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 >> [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445] conn(0x7fc088072350 msgr2=0x7fc088074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445] conn(0x7fc088072350 0x7fc088074760 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc08806c680 msgr2=0x7fc08806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc08806c680 0x7fc08806eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc09c199670 tx=0x7fc08400a380 comp rx=0 tx=0).stop 2024-02-19T18:58:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09c068540 msgr2=0x7fc09c198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09c068540 0x7fc09c198050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc094006010 tx=0x7fc09400bd70 comp rx=0 tx=0).stop 2024-02-19T18:58:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 shutdown_connections 2024-02-19T18:58:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fc08806c680 0x7fc08806eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc09c068540 0x7fc09c198050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.142:6808/2523325445,v1:172.21.15.142:6809/2523325445] conn(0x7fc088072350 0x7fc088074760 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 --2- 172.21.15.46:0/335615342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc09c101070 0x7fc09c198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 >> 172.21.15.46:0/335615342 conn(0x7fc09c075130 msgr2=0x7fc09c0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 shutdown_connections 2024-02-19T18:58:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:37.903+0000 7fc0a190a700 1 -- 172.21.15.46:0/335615342 wait complete. 2024-02-19T18:58:39.526 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:39 smithi046 ceph-mon[29647]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:39.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:39 smithi142 ceph-mon[37169]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:39.998 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:39.999 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:40.388 INFO:teuthology.orchestra.run.smithi046.stdout:146028888078 2024-02-19T18:58:40.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-19T18:58:41.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.259+0000 7f3f8e18e700 1 -- 172.21.15.46:0/1373090682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f880ff3a0 msgr2=0x7f3f880ff770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.259+0000 7f3f8e18e700 1 --2- 172.21.15.46:0/1373090682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f880ff3a0 0x7f3f880ff770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009910 tx=0x7f3f78009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.259+0000 7f3f8e18e700 1 -- 172.21.15.46:0/1373090682 shutdown_connections 2024-02-19T18:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.259+0000 7f3f8e18e700 1 --2- 172.21.15.46:0/1373090682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f880ffd40 0x7f3f88103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.259+0000 7f3f8e18e700 1 --2- 172.21.15.46:0/1373090682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f880ff3a0 0x7f3f880ff770 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.259+0000 7f3f8e18e700 1 -- 172.21.15.46:0/1373090682 >> 172.21.15.46:0/1373090682 conn(0x7f3f880fac40 msgr2=0x7f3f880fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.259+0000 7f3f8e18e700 1 -- 172.21.15.46:0/1373090682 shutdown_connections 2024-02-19T18:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.259+0000 7f3f8e18e700 1 -- 172.21.15.46:0/1373090682 wait complete. 2024-02-19T18:58:41.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.260+0000 7f3f8e18e700 1 Processor -- start 2024-02-19T18:58:41.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.260+0000 7f3f8e18e700 1 -- start start 2024-02-19T18:58:41.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.260+0000 7f3f8e18e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f880ff3a0 0x7f3f881981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:41.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.260+0000 7f3f8e18e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f880ffd40 0x7f3f881986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:41.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.260+0000 7f3f8e18e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88198dd0 con 0x7f3f880ffd40 2024-02-19T18:58:41.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.260+0000 7f3f8e18e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8819cb60 con 0x7f3f880ff3a0 2024-02-19T18:58:41.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.260+0000 7f3f86ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f880ffd40 0x7f3f881986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:41.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.260+0000 7f3f86ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f880ffd40 0x7f3f881986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36542/0 (socket says 172.21.15.46:36542) 2024-02-19T18:58:41.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f86ffd700 1 -- 172.21.15.46:0/2791722037 learned_addr learned my addr 172.21.15.46:0/2791722037 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:41.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f877fe700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f880ff3a0 0x7f3f881981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f86ffd700 1 -- 172.21.15.46:0/2791722037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f880ff3a0 msgr2=0x7f3f881981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f86ffd700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f880ff3a0 0x7f3f881981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f86ffd700 1 -- 172.21.15.46:0/2791722037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f780095f0 con 0x7f3f880ffd40 2024-02-19T18:58:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f86ffd700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f880ffd40 0x7f3f881986f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00b480 tx=0x7f3f7c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f84ff9700 1 -- 172.21.15.46:0/2791722037 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f7c0118c0 con 0x7f3f880ffd40 2024-02-19T18:58:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f84ff9700 1 -- 172.21.15.46:0/2791722037 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3f7c010380 con 0x7f3f880ffd40 2024-02-19T18:58:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f8e18e700 1 -- 172.21.15.46:0/2791722037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8819ce40 con 0x7f3f880ffd40 2024-02-19T18:58:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f84ff9700 1 -- 172.21.15.46:0/2791722037 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f7c00f4f0 con 0x7f3f880ffd40 2024-02-19T18:58:41.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.261+0000 7f3f8e18e700 1 -- 172.21.15.46:0/2791722037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8819d390 con 0x7f3f880ffd40 2024-02-19T18:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.262+0000 7f3f8e18e700 1 -- 172.21.15.46:0/2791722037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8804f2a0 con 0x7f3f880ffd40 2024-02-19T18:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.263+0000 7f3f84ff9700 1 -- 172.21.15.46:0/2791722037 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3f7c011a20 con 0x7f3f880ffd40 2024-02-19T18:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.263+0000 7f3f84ff9700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3f7006c680 0x7f3f7006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.263+0000 7f3f84ff9700 1 -- 172.21.15.46:0/2791722037 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3f7c08b140 con 0x7f3f880ffd40 2024-02-19T18:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.263+0000 7f3f877fe700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3f7006c680 0x7f3f7006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:41.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.264+0000 7f3f877fe700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3f7006c680 0x7f3f7006eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800b5c0 tx=0x7f3f7801a040 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:41.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.268+0000 7f3f84ff9700 1 -- 172.21.15.46:0/2791722037 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3f7c055be0 con 0x7f3f880ffd40 2024-02-19T18:58:41.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:41 smithi046 ceph-mon[29647]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:41.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:41 smithi142 ceph-mon[37169]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:41.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.477+0000 7f3f8e18e700 1 -- 172.21.15.46:0/2791722037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f8819d660 con 0x7f3f880ffd40 2024-02-19T18:58:41.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.478+0000 7f3f84ff9700 1 -- 172.21.15.46:0/2791722037 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f7c059200 con 0x7f3f880ffd40 2024-02-19T18:58:41.496 INFO:teuthology.orchestra.run.smithi046.stdout:81604378649 2024-02-19T18:58:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 -- 172.21.15.46:0/2791722037 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3f7006c680 msgr2=0x7f3f7006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3f7006c680 0x7f3f7006eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800b5c0 tx=0x7f3f7801a040 comp rx=0 tx=0).stop 2024-02-19T18:58:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 -- 172.21.15.46:0/2791722037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f880ffd40 msgr2=0x7f3f881986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f880ffd40 0x7f3f881986f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00b480 tx=0x7f3f7c00b840 comp rx=0 tx=0).stop 2024-02-19T18:58:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 -- 172.21.15.46:0/2791722037 shutdown_connections 2024-02-19T18:58:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3f7006c680 0x7f3f7006eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f880ff3a0 0x7f3f881981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 --2- 172.21.15.46:0/2791722037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f880ffd40 0x7f3f881986f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 -- 172.21.15.46:0/2791722037 >> 172.21.15.46:0/2791722037 conn(0x7f3f880fac40 msgr2=0x7f3f88069720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 -- 172.21.15.46:0/2791722037 shutdown_connections 2024-02-19T18:58:41.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:41.480+0000 7f3f8e18e700 1 -- 172.21.15.46:0/2791722037 wait complete. 2024-02-19T18:58:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.072+0000 7f6f90f07700 1 -- 172.21.15.46:0/937160190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f8c0ffbd0 msgr2=0x7f6f8c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.072+0000 7f6f90f07700 1 --2- 172.21.15.46:0/937160190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f8c0ffbd0 0x7f6f8c100040 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009910 tx=0x7f6f74009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.072+0000 7f6f90f07700 1 -- 172.21.15.46:0/937160190 shutdown_connections 2024-02-19T18:58:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.072+0000 7f6f90f07700 1 --2- 172.21.15.46:0/937160190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f8c0ffbd0 0x7f6f8c100040 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.072+0000 7f6f90f07700 1 --2- 172.21.15.46:0/937160190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f8c104130 0x7f6f8c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.072+0000 7f6f90f07700 1 -- 172.21.15.46:0/937160190 >> 172.21.15.46:0/937160190 conn(0x7f6f8c075130 msgr2=0x7f6f8c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.072+0000 7f6f90f07700 1 -- 172.21.15.46:0/937160190 shutdown_connections 2024-02-19T18:58:42.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.072+0000 7f6f90f07700 1 -- 172.21.15.46:0/937160190 wait complete. 2024-02-19T18:58:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f90f07700 1 Processor -- start 2024-02-19T18:58:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f90f07700 1 -- start start 2024-02-19T18:58:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f90f07700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f8c0ffbd0 0x7f6f8c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:42.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f90f07700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f8c104130 0x7f6f8c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f90f07700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c197860 con 0x7f6f8c104130 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f90f07700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c1979d0 con 0x7f6f8c0ffbd0 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f89d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f8c104130 0x7f6f8c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f89d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f8c104130 0x7f6f8c197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36560/0 (socket says 172.21.15.46:36560) 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f89d9b700 1 -- 172.21.15.46:0/1722492164 learned_addr learned my addr 172.21.15.46:0/1722492164 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f89d9b700 1 -- 172.21.15.46:0/1722492164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f8c0ffbd0 msgr2=0x7f6f8c196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f8a59c700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f8c0ffbd0 0x7f6f8c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f89d9b700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f8c0ffbd0 0x7f6f8c196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.073+0000 7f6f89d9b700 1 -- 172.21.15.46:0/1722492164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740095f0 con 0x7f6f8c104130 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.074+0000 7f6f89d9b700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f8c104130 0x7f6f8c197240 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6f740092e0 tx=0x7f6f7400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.074+0000 7f6f837fe700 1 -- 172.21.15.46:0/1722492164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7401d070 con 0x7f6f8c104130 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.074+0000 7f6f90f07700 1 -- 172.21.15.46:0/1722492164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c19fd70 con 0x7f6f8c104130 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.074+0000 7f6f837fe700 1 -- 172.21.15.46:0/1722492164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f74022470 con 0x7f6f8c104130 2024-02-19T18:58:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.074+0000 7f6f837fe700 1 -- 172.21.15.46:0/1722492164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7400f670 con 0x7f6f8c104130 2024-02-19T18:58:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.074+0000 7f6f90f07700 1 -- 172.21.15.46:0/1722492164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c1a01e0 con 0x7f6f8c104130 2024-02-19T18:58:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.075+0000 7f6f90f07700 1 -- 172.21.15.46:0/1722492164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c1076a0 con 0x7f6f8c104130 2024-02-19T18:58:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.075+0000 7f6f837fe700 1 -- 172.21.15.46:0/1722492164 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6f74004c30 con 0x7f6f8c104130 2024-02-19T18:58:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.076+0000 7f6f837fe700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6f7806c680 0x7f6f7806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.076+0000 7f6f837fe700 1 -- 172.21.15.46:0/1722492164 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6f7408cac0 con 0x7f6f8c104130 2024-02-19T18:58:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.076+0000 7f6f8a59c700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6f7806c680 0x7f6f7806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.076+0000 7f6f8a59c700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6f7806c680 0x7f6f7806eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007dc0 tx=0x7f6f7c0072f0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:42.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.080+0000 7f6f837fe700 1 -- 172.21.15.46:0/1722492164 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6f74057610 con 0x7f6f8c104130 2024-02-19T18:58:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.285+0000 7f6f90f07700 1 -- 172.21.15.46:0/1722492164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6f8c107080 con 0x7f6f8c104130 2024-02-19T18:58:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.285+0000 7f6f837fe700 1 -- 172.21.15.46:0/1722492164 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f74027020 con 0x7f6f8c104130 2024-02-19T18:58:42.303 INFO:teuthology.orchestra.run.smithi046.stdout:167503724554 2024-02-19T18:58:42.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 -- 172.21.15.46:0/1722492164 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6f7806c680 msgr2=0x7f6f7806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:42.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6f7806c680 0x7f6f7806eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007dc0 tx=0x7f6f7c0072f0 comp rx=0 tx=0).stop 2024-02-19T18:58:42.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 -- 172.21.15.46:0/1722492164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f8c104130 msgr2=0x7f6f8c197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:42.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f8c104130 0x7f6f8c197240 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6f740092e0 tx=0x7f6f7400be00 comp rx=0 tx=0).stop 2024-02-19T18:58:42.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 -- 172.21.15.46:0/1722492164 shutdown_connections 2024-02-19T18:58:42.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6f7806c680 0x7f6f7806eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f8c0ffbd0 0x7f6f8c196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 --2- 172.21.15.46:0/1722492164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f8c104130 0x7f6f8c197240 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 -- 172.21.15.46:0/1722492164 >> 172.21.15.46:0/1722492164 conn(0x7f6f8c075130 msgr2=0x7f6f8c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:42.306 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:42 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2791722037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T18:58:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 -- 172.21.15.46:0/1722492164 shutdown_connections 2024-02-19T18:58:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:42.287+0000 7f6f90f07700 1 -- 172.21.15.46:0/1722492164 wait complete. 2024-02-19T18:58:42.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:42 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2791722037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T18:58:43.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:43 smithi046 ceph-mon[29647]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:43.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:43 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1722492164' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T18:58:43.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:43 smithi142 ceph-mon[37169]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:43.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:43 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1722492164' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T18:58:43.853 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724552 got 167503724554 for osd.5 2024-02-19T18:58:43.854 DEBUG:teuthology.parallel:result is None 2024-02-19T18:58:44.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.364+0000 7f262aa13700 1 -- 172.21.15.46:0/2264504736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26240739a0 msgr2=0x7f262410c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:44.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.364+0000 7f262aa13700 1 --2- 172.21.15.46:0/2264504736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26240739a0 0x7f262410c5e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f260c009940 tx=0x7f260c009c50 comp rx=0 tx=0).stop 2024-02-19T18:58:44.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.364+0000 7f262aa13700 1 -- 172.21.15.46:0/2264504736 shutdown_connections 2024-02-19T18:58:44.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.364+0000 7f262aa13700 1 --2- 172.21.15.46:0/2264504736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26240739a0 0x7f262410c5e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:44.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.364+0000 7f262aa13700 1 --2- 172.21.15.46:0/2264504736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2624073090 0x7f2624073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:44.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.364+0000 7f262aa13700 1 -- 172.21.15.46:0/2264504736 >> 172.21.15.46:0/2264504736 conn(0x7f26240fbda0 msgr2=0x7f26240fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:44.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.364+0000 7f262aa13700 1 -- 172.21.15.46:0/2264504736 shutdown_connections 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.364+0000 7f262aa13700 1 -- 172.21.15.46:0/2264504736 wait complete. 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.364+0000 7f262aa13700 1 Processor -- start 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.365+0000 7f262aa13700 1 -- start start 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.365+0000 7f262aa13700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2624073090 0x7f2624198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.365+0000 7f262aa13700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26240739a0 0x7f2624198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.365+0000 7f262aa13700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2624198e40 con 0x7f2624073090 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.365+0000 7f262aa13700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262419cbd0 con 0x7f26240739a0 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.365+0000 7f2623fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2624073090 0x7f2624198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.365+0000 7f2623fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2624073090 0x7f2624198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36574/0 (socket says 172.21.15.46:36574) 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.365+0000 7f2623fff700 1 -- 172.21.15.46:0/2317100828 learned_addr learned my addr 172.21.15.46:0/2317100828 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:44.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.365+0000 7f26237fe700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26240739a0 0x7f2624198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:44.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.366+0000 7f26237fe700 1 -- 172.21.15.46:0/2317100828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2624073090 msgr2=0x7f2624198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:44.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.366+0000 7f26237fe700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2624073090 0x7f2624198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:44.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.366+0000 7f26237fe700 1 -- 172.21.15.46:0/2317100828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0095f0 con 0x7f26240739a0 2024-02-19T18:58:44.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.366+0000 7f2623fff700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2624073090 0x7f2624198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T18:58:44.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.366+0000 7f26237fe700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26240739a0 0x7f2624198760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f260c00b580 tx=0x7f260c005540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:44.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.366+0000 7f26217fa700 1 -- 172.21.15.46:0/2317100828 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f260c01d070 con 0x7f26240739a0 2024-02-19T18:58:44.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.366+0000 7f26217fa700 1 -- 172.21.15.46:0/2317100828 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f260c005dc0 con 0x7f26240739a0 2024-02-19T18:58:44.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.366+0000 7f26217fa700 1 -- 172.21.15.46:0/2317100828 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f260c021410 con 0x7f26240739a0 2024-02-19T18:58:44.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.366+0000 7f262aa13700 1 -- 172.21.15.46:0/2317100828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262419ce50 con 0x7f26240739a0 2024-02-19T18:58:44.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.366+0000 7f262aa13700 1 -- 172.21.15.46:0/2317100828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262419d2f0 con 0x7f26240739a0 2024-02-19T18:58:44.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.367+0000 7f262aa13700 1 -- 172.21.15.46:0/2317100828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2624109ce0 con 0x7f26240739a0 2024-02-19T18:58:44.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.368+0000 7f26217fa700 1 -- 172.21.15.46:0/2317100828 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f260c003a60 con 0x7f26240739a0 2024-02-19T18:58:44.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.368+0000 7f26217fa700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f261006c680 0x7f261006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:44.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.368+0000 7f26217fa700 1 -- 172.21.15.46:0/2317100828 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f260c08c710 con 0x7f26240739a0 2024-02-19T18:58:44.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.368+0000 7f2623fff700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f261006c680 0x7f261006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:44.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.369+0000 7f2623fff700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f261006c680 0x7f261006eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2614005950 tx=0x7f261400b500 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:44.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.374+0000 7f26217fa700 1 -- 172.21.15.46:0/2317100828 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f260c0570d0 con 0x7f26240739a0 2024-02-19T18:58:44.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.582+0000 7f262aa13700 1 -- 172.21.15.46:0/2317100828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f26241096c0 con 0x7f26240739a0 2024-02-19T18:58:44.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.582+0000 7f26217fa700 1 -- 172.21.15.46:0/2317100828 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f260c05a6f0 con 0x7f26240739a0 2024-02-19T18:58:44.600 INFO:teuthology.orchestra.run.smithi046.stdout:38654705702 2024-02-19T18:58:44.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 -- 172.21.15.46:0/2317100828 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f261006c680 msgr2=0x7f261006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:44.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f261006c680 0x7f261006eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2614005950 tx=0x7f261400b500 comp rx=0 tx=0).stop 2024-02-19T18:58:44.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 -- 172.21.15.46:0/2317100828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26240739a0 msgr2=0x7f2624198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:44.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26240739a0 0x7f2624198760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f260c00b580 tx=0x7f260c005540 comp rx=0 tx=0).stop 2024-02-19T18:58:44.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 -- 172.21.15.46:0/2317100828 shutdown_connections 2024-02-19T18:58:44.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f261006c680 0x7f261006eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:44.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2624073090 0x7f2624198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:44.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 --2- 172.21.15.46:0/2317100828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26240739a0 0x7f2624198760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:44.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 -- 172.21.15.46:0/2317100828 >> 172.21.15.46:0/2317100828 conn(0x7f26240fbda0 msgr2=0x7f2624106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:44.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 -- 172.21.15.46:0/2317100828 shutdown_connections 2024-02-19T18:58:44.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:44.584+0000 7f262aa13700 1 -- 172.21.15.46:0/2317100828 wait complete. 2024-02-19T18:58:45.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:45 smithi046 ceph-mon[29647]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:45.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:45 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2317100828' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T18:58:45.349 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705702 for osd.0 2024-02-19T18:58:45.349 DEBUG:teuthology.parallel:result is None 2024-02-19T18:58:45.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:45 smithi142 ceph-mon[37169]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:45.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:45 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2317100828' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T18:58:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.743+0000 7fe981a70700 1 -- 172.21.15.46:0/3481453351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe97c0ffc60 msgr2=0x7fe97c10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.743+0000 7fe981a70700 1 --2- 172.21.15.46:0/3481453351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe97c0ffc60 0x7fe97c10a6d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe970009910 tx=0x7fe970009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.743+0000 7fe981a70700 1 -- 172.21.15.46:0/3481453351 shutdown_connections 2024-02-19T18:58:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.743+0000 7fe981a70700 1 --2- 172.21.15.46:0/3481453351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe97c0ffc60 0x7fe97c10a6d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.743+0000 7fe981a70700 1 --2- 172.21.15.46:0/3481453351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97c0ff350 0x7fe97c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:45.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.743+0000 7fe981a70700 1 -- 172.21.15.46:0/3481453351 >> 172.21.15.46:0/3481453351 conn(0x7fe97c0748b0 msgr2=0x7fe97c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:45.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.743+0000 7fe981a70700 1 -- 172.21.15.46:0/3481453351 shutdown_connections 2024-02-19T18:58:45.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.743+0000 7fe981a70700 1 -- 172.21.15.46:0/3481453351 wait complete. 2024-02-19T18:58:45.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.744+0000 7fe981a70700 1 Processor -- start 2024-02-19T18:58:45.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.744+0000 7fe981a70700 1 -- start start 2024-02-19T18:58:45.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.744+0000 7fe981a70700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97c0ff350 0x7fe97c100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.744+0000 7fe981a70700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe97c0ffc60 0x7fe97c100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.744+0000 7fe981a70700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c100fb0 con 0x7fe97c0ffc60 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.744+0000 7fe981a70700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c1010f0 con 0x7fe97c0ff350 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.744+0000 7fe97affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe97c0ffc60 0x7fe97c100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.744+0000 7fe97affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe97c0ffc60 0x7fe97c100a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36586/0 (socket says 172.21.15.46:36586) 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.744+0000 7fe97affd700 1 -- 172.21.15.46:0/2028277968 learned_addr learned my addr 172.21.15.46:0/2028277968 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.745+0000 7fe97b7fe700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97c0ff350 0x7fe97c100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.745+0000 7fe97affd700 1 -- 172.21.15.46:0/2028277968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97c0ff350 msgr2=0x7fe97c100530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.745+0000 7fe97affd700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97c0ff350 0x7fe97c100530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.745+0000 7fe97affd700 1 -- 172.21.15.46:0/2028277968 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9700095f0 con 0x7fe97c0ffc60 2024-02-19T18:58:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.745+0000 7fe97affd700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe97c0ffc60 0x7fe97c100a70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe970006010 tx=0x7fe9700056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.745+0000 7fe978ff9700 1 -- 172.21.15.46:0/2028277968 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe97001d070 con 0x7fe97c0ffc60 2024-02-19T18:58:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.745+0000 7fe978ff9700 1 -- 172.21.15.46:0/2028277968 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe97000f460 con 0x7fe97c0ffc60 2024-02-19T18:58:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.745+0000 7fe981a70700 1 -- 172.21.15.46:0/2028277968 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c1a2070 con 0x7fe97c0ffc60 2024-02-19T18:58:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.745+0000 7fe978ff9700 1 -- 172.21.15.46:0/2028277968 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe970021640 con 0x7fe97c0ffc60 2024-02-19T18:58:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.745+0000 7fe981a70700 1 -- 172.21.15.46:0/2028277968 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c1a23d0 con 0x7fe97c0ffc60 2024-02-19T18:58:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.746+0000 7fe981a70700 1 -- 172.21.15.46:0/2028277968 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c107dd0 con 0x7fe97c0ffc60 2024-02-19T18:58:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.747+0000 7fe978ff9700 1 -- 172.21.15.46:0/2028277968 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe97000fad0 con 0x7fe97c0ffc60 2024-02-19T18:58:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.747+0000 7fe978ff9700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe96406c680 0x7fe96406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.747+0000 7fe978ff9700 1 -- 172.21.15.46:0/2028277968 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe97008c720 con 0x7fe97c0ffc60 2024-02-19T18:58:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.747+0000 7fe97b7fe700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe96406c680 0x7fe96406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.747+0000 7fe97b7fe700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe96406c680 0x7fe96406eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe96c005ea0 tx=0x7fe96c005e30 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.752+0000 7fe978ff9700 1 -- 172.21.15.46:0/2028277968 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe9700571c0 con 0x7fe97c0ffc60 2024-02-19T18:58:45.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.954+0000 7fe981a70700 1 -- 172.21.15.46:0/2028277968 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe97c04f2a0 con 0x7fe97c0ffc60 2024-02-19T18:58:45.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.954+0000 7fe978ff9700 1 -- 172.21.15.46:0/2028277968 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe97005a7e0 con 0x7fe97c0ffc60 2024-02-19T18:58:45.973 INFO:teuthology.orchestra.run.smithi046.stdout:60129542175 2024-02-19T18:58:45.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 -- 172.21.15.46:0/2028277968 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe96406c680 msgr2=0x7fe96406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:45.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe96406c680 0x7fe96406eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe96c005ea0 tx=0x7fe96c005e30 comp rx=0 tx=0).stop 2024-02-19T18:58:45.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 -- 172.21.15.46:0/2028277968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe97c0ffc60 msgr2=0x7fe97c100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:45.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe97c0ffc60 0x7fe97c100a70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe970006010 tx=0x7fe9700056a0 comp rx=0 tx=0).stop 2024-02-19T18:58:45.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 -- 172.21.15.46:0/2028277968 shutdown_connections 2024-02-19T18:58:45.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fe96406c680 0x7fe96406eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:45.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97c0ff350 0x7fe97c100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:45.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 --2- 172.21.15.46:0/2028277968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe97c0ffc60 0x7fe97c100a70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:45.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 -- 172.21.15.46:0/2028277968 >> 172.21.15.46:0/2028277968 conn(0x7fe97c0748b0 msgr2=0x7fe97c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:45.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 -- 172.21.15.46:0/2028277968 shutdown_connections 2024-02-19T18:58:45.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:45.956+0000 7fe981a70700 1 -- 172.21.15.46:0/2028277968 wait complete. 2024-02-19T18:58:46.572 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:46 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2028277968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T18:58:46.592 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378649 for osd.2 2024-02-19T18:58:46.593 DEBUG:teuthology.parallel:result is None 2024-02-19T18:58:46.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:46 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2028277968' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T18:58:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.977+0000 7f2a16e63700 1 -- 172.21.15.46:0/3333834677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a10100e80 msgr2=0x7f2a10104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.977+0000 7f2a16e63700 1 --2- 172.21.15.46:0/3333834677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a10100e80 0x7f2a10104e50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009910 tx=0x7f29fc009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.977+0000 7f2a16e63700 1 -- 172.21.15.46:0/3333834677 shutdown_connections 2024-02-19T18:58:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.977+0000 7f2a16e63700 1 --2- 172.21.15.46:0/3333834677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a10100e80 0x7f2a10104e50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.977+0000 7f2a16e63700 1 --2- 172.21.15.46:0/3333834677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a101004e0 0x7f2a101008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.977+0000 7f2a16e63700 1 -- 172.21.15.46:0/3333834677 >> 172.21.15.46:0/3333834677 conn(0x7f2a100fbda0 msgr2=0x7f2a100fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.977+0000 7f2a16e63700 1 -- 172.21.15.46:0/3333834677 shutdown_connections 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.977+0000 7f2a16e63700 1 -- 172.21.15.46:0/3333834677 wait complete. 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a16e63700 1 Processor -- start 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a16e63700 1 -- start start 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a16e63700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a101004e0 0x7f2a10195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a16e63700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a10100e80 0x7f2a10196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a16e63700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10196b30 con 0x7f2a10100e80 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a16e63700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1019a8c0 con 0x7f2a101004e0 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a0ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a10100e80 0x7f2a10196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a0ffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a10100e80 0x7f2a10196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36610/0 (socket says 172.21.15.46:36610) 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a0ffff700 1 -- 172.21.15.46:0/1987452521 learned_addr learned my addr 172.21.15.46:0/1987452521 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a0ffff700 1 -- 172.21.15.46:0/1987452521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a101004e0 msgr2=0x7f2a10195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a14bff700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a101004e0 0x7f2a10195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:46.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a0ffff700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a101004e0 0x7f2a10195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:46.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.978+0000 7f2a0ffff700 1 -- 172.21.15.46:0/1987452521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0095f0 con 0x7f2a10100e80 2024-02-19T18:58:46.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.979+0000 7f2a0ffff700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a10100e80 0x7f2a10196450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00bda0 tx=0x7f29fc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:46.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.979+0000 7f2a0dffb700 1 -- 172.21.15.46:0/1987452521 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29fc01d070 con 0x7f2a10100e80 2024-02-19T18:58:46.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.979+0000 7f2a16e63700 1 -- 172.21.15.46:0/1987452521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1019ab40 con 0x7f2a10100e80 2024-02-19T18:58:46.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.979+0000 7f2a0dffb700 1 -- 172.21.15.46:0/1987452521 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29fc022470 con 0x7f2a10100e80 2024-02-19T18:58:46.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.979+0000 7f2a0dffb700 1 -- 172.21.15.46:0/1987452521 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29fc00f690 con 0x7f2a10100e80 2024-02-19T18:58:46.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.979+0000 7f2a16e63700 1 -- 172.21.15.46:0/1987452521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1019b030 con 0x7f2a10100e80 2024-02-19T18:58:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.980+0000 7f2a16e63700 1 -- 172.21.15.46:0/1987452521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a10108850 con 0x7f2a10100e80 2024-02-19T18:58:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.980+0000 7f2a0dffb700 1 -- 172.21.15.46:0/1987452521 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f29fc022b00 con 0x7f2a10100e80 2024-02-19T18:58:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.981+0000 7f2a0dffb700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2a0006c680 0x7f2a0006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.981+0000 7f2a0dffb700 1 -- 172.21.15.46:0/1987452521 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f29fc08ca80 con 0x7f2a10100e80 2024-02-19T18:58:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.981+0000 7f2a14bff700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2a0006c680 0x7f2a0006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:47.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.981+0000 7f2a14bff700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2a0006c680 0x7f2a0006eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a04005950 tx=0x7f2a04005cf0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:47.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:46.985+0000 7f2a0dffb700 1 -- 172.21.15.46:0/1987452521 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f29fc057550 con 0x7f2a10100e80 2024-02-19T18:58:47.209 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:47.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.191+0000 7f2a16e63700 1 -- 172.21.15.46:0/1987452521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2a10108230 con 0x7f2a10100e80 2024-02-19T18:58:47.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.191+0000 7f2a0dffb700 1 -- 172.21.15.46:0/1987452521 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29fc05ab70 con 0x7f2a10100e80 2024-02-19T18:58:47.209 INFO:teuthology.orchestra.run.smithi046.stdout:111669149718 2024-02-19T18:58:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 -- 172.21.15.46:0/1987452521 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2a0006c680 msgr2=0x7f2a0006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2a0006c680 0x7f2a0006eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a04005950 tx=0x7f2a04005cf0 comp rx=0 tx=0).stop 2024-02-19T18:58:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 -- 172.21.15.46:0/1987452521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a10100e80 msgr2=0x7f2a10196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a10100e80 0x7f2a10196450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00bda0 tx=0x7f29fc00be80 comp rx=0 tx=0).stop 2024-02-19T18:58:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 -- 172.21.15.46:0/1987452521 shutdown_connections 2024-02-19T18:58:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2a0006c680 0x7f2a0006eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a101004e0 0x7f2a10195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 --2- 172.21.15.46:0/1987452521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a10100e80 0x7f2a10196450 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 -- 172.21.15.46:0/1987452521 >> 172.21.15.46:0/1987452521 conn(0x7f2a100fbda0 msgr2=0x7f2a100fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 -- 172.21.15.46:0/1987452521 shutdown_connections 2024-02-19T18:58:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:47.194+0000 7f2a16e63700 1 -- 172.21.15.46:0/1987452521 wait complete. 2024-02-19T18:58:47.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:47 smithi046 ceph-mon[29647]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:47.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:47 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:47.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:47 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1987452521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T18:58:47.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:47 smithi142 ceph-mon[37169]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:47.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:47 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:47.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:47 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1987452521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T18:58:48.038 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149716 got 111669149718 for osd.3 2024-02-19T18:58:48.038 DEBUG:teuthology.parallel:result is None 2024-02-19T18:58:48.830 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542175 for osd.1 2024-02-19T18:58:48.830 DEBUG:teuthology.parallel:result is None 2024-02-19T18:58:49.470 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:49 smithi046 ceph-mon[29647]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:49.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:49 smithi142 ceph-mon[37169]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:49.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 -- 172.21.15.46:0/1351240076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91941004e0 msgr2=0x7f91941008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:49.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 --2- 172.21.15.46:0/1351240076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91941004e0 0x7f91941008b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9188009910 tx=0x7f9188009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:49.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 -- 172.21.15.46:0/1351240076 shutdown_connections 2024-02-19T18:58:49.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 --2- 172.21.15.46:0/1351240076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9194100e80 0x7f9194104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:49.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 --2- 172.21.15.46:0/1351240076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91941004e0 0x7f91941008b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:49.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 -- 172.21.15.46:0/1351240076 >> 172.21.15.46:0/1351240076 conn(0x7f91940fbda0 msgr2=0x7f91940fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:49.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 -- 172.21.15.46:0/1351240076 shutdown_connections 2024-02-19T18:58:49.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 -- 172.21.15.46:0/1351240076 wait complete. 2024-02-19T18:58:49.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 Processor -- start 2024-02-19T18:58:49.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 -- start start 2024-02-19T18:58:49.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91941004e0 0x7f9194195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9194100e80 0x7f91941964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194196b90 con 0x7f9194100e80 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.787+0000 7f919b14d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919419a920 con 0x7f91941004e0 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9193fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9194100e80 0x7f91941964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9193fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9194100e80 0x7f91941964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40144/0 (socket says 172.21.15.46:40144) 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9193fff700 1 -- 172.21.15.46:0/3553530005 learned_addr learned my addr 172.21.15.46:0/3553530005 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9198ee9700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91941004e0 0x7f9194195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9193fff700 1 -- 172.21.15.46:0/3553530005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91941004e0 msgr2=0x7f9194195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9193fff700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91941004e0 0x7f9194195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9193fff700 1 -- 172.21.15.46:0/3553530005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91880095f0 con 0x7f9194100e80 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9193fff700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9194100e80 0x7f91941964b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f918000b480 tx=0x7f918000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9191ffb700 1 -- 172.21.15.46:0/3553530005 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91800118c0 con 0x7f9194100e80 2024-02-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9191ffb700 1 -- 172.21.15.46:0/3553530005 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9180010380 con 0x7f9194100e80 2024-02-19T18:58:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f919b14d700 1 -- 172.21.15.46:0/3553530005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919419ac00 con 0x7f9194100e80 2024-02-19T18:58:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f9191ffb700 1 -- 172.21.15.46:0/3553530005 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f918000f4f0 con 0x7f9194100e80 2024-02-19T18:58:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.788+0000 7f919b14d700 1 -- 172.21.15.46:0/3553530005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919419b150 con 0x7f9194100e80 2024-02-19T18:58:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.789+0000 7f919b14d700 1 -- 172.21.15.46:0/3553530005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91941087f0 con 0x7f9194100e80 2024-02-19T18:58:49.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.790+0000 7f9191ffb700 1 -- 172.21.15.46:0/3553530005 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f91800104f0 con 0x7f9194100e80 2024-02-19T18:58:49.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.790+0000 7f9191ffb700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f918406c680 0x7f918406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:49.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.790+0000 7f9191ffb700 1 -- 172.21.15.46:0/3553530005 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f918008b180 con 0x7f9194100e80 2024-02-19T18:58:49.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.790+0000 7f9198ee9700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f918406c680 0x7f918406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:49.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.791+0000 7f9198ee9700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f918406c680 0x7f918406eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f918800b5c0 tx=0x7f918801a040 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:49.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.795+0000 7f9191ffb700 1 -- 172.21.15.46:0/3553530005 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9180055ba0 con 0x7f9194100e80 2024-02-19T18:58:50.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.997+0000 7f919b14d700 1 -- 172.21.15.46:0/3553530005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f919419b3d0 con 0x7f9194100e80 2024-02-19T18:58:50.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.997+0000 7f9191ffb700 1 -- 172.21.15.46:0/3553530005 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91800591c0 con 0x7f9194100e80 2024-02-19T18:58:50.015 INFO:teuthology.orchestra.run.smithi046.stdout:146028888080 2024-02-19T18:58:50.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 -- 172.21.15.46:0/3553530005 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f918406c680 msgr2=0x7f918406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:50.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f918406c680 0x7f918406eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f918800b5c0 tx=0x7f918801a040 comp rx=0 tx=0).stop 2024-02-19T18:58:50.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 -- 172.21.15.46:0/3553530005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9194100e80 msgr2=0x7f91941964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:50.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9194100e80 0x7f91941964b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f918000b480 tx=0x7f918000b840 comp rx=0 tx=0).stop 2024-02-19T18:58:50.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 -- 172.21.15.46:0/3553530005 shutdown_connections 2024-02-19T18:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f918406c680 0x7f918406eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91941004e0 0x7f9194195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 --2- 172.21.15.46:0/3553530005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9194100e80 0x7f91941964b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 -- 172.21.15.46:0/3553530005 >> 172.21.15.46:0/3553530005 conn(0x7f91940fbda0 msgr2=0x7f91940fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 -- 172.21.15.46:0/3553530005 shutdown_connections 2024-02-19T18:58:50.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:49.999+0000 7f919b14d700 1 -- 172.21.15.46:0/3553530005 wait complete. 2024-02-19T18:58:50.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:50 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3553530005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T18:58:50.643 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888078 got 146028888080 for osd.4 2024-02-19T18:58:50.644 DEBUG:teuthology.parallel:result is None 2024-02-19T18:58:50.644 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-19T18:58:50.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T18:58:50.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:50 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/3553530005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T18:58:50.854 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:51.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:51 smithi046 ceph-mon[29647]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:51.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:51 smithi142 ceph-mon[37169]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.461+0000 7fd07029b700 1 -- 172.21.15.46:0/1168954057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0680ffbd0 msgr2=0x7fd068100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.461+0000 7fd07029b700 1 --2- 172.21.15.46:0/1168954057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0680ffbd0 0x7fd068100040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd064009910 tx=0x7fd064009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.461+0000 7fd07029b700 1 -- 172.21.15.46:0/1168954057 shutdown_connections 2024-02-19T18:58:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.461+0000 7fd07029b700 1 --2- 172.21.15.46:0/1168954057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0680ffbd0 0x7fd068100040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.461+0000 7fd07029b700 1 --2- 172.21.15.46:0/1168954057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd068104130 0x7fd068104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.461+0000 7fd07029b700 1 -- 172.21.15.46:0/1168954057 >> 172.21.15.46:0/1168954057 conn(0x7fd068075130 msgr2=0x7fd068075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.461+0000 7fd07029b700 1 -- 172.21.15.46:0/1168954057 shutdown_connections 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.461+0000 7fd07029b700 1 -- 172.21.15.46:0/1168954057 wait complete. 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.461+0000 7fd07029b700 1 Processor -- start 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd07029b700 1 -- start start 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd07029b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0680ffbd0 0x7fd068196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd07029b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd068104130 0x7fd068197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd07029b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd068197860 con 0x7fd0680ffbd0 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd07029b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0681979a0 con 0x7fd068104130 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd06e037700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0680ffbd0 0x7fd068196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd06e037700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0680ffbd0 0x7fd068196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40166/0 (socket says 172.21.15.46:40166) 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd06e037700 1 -- 172.21.15.46:0/3299815651 learned_addr learned my addr 172.21.15.46:0/3299815651 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd06d836700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd068104130 0x7fd068197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd06e037700 1 -- 172.21.15.46:0/3299815651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd068104130 msgr2=0x7fd068197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd06e037700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd068104130 0x7fd068197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:52.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd06e037700 1 -- 172.21.15.46:0/3299815651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640095f0 con 0x7fd0680ffbd0 2024-02-19T18:58:52.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd06e037700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0680ffbd0 0x7fd068196c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00c8a0 tx=0x7fd05c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:52.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd05b7fe700 1 -- 172.21.15.46:0/3299815651 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05c00cea0 con 0x7fd0680ffbd0 2024-02-19T18:58:52.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd05b7fe700 1 -- 172.21.15.46:0/3299815651 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd05c004830 con 0x7fd0680ffbd0 2024-02-19T18:58:52.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd07029b700 1 -- 172.21.15.46:0/3299815651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06819fcb0 con 0x7fd0680ffbd0 2024-02-19T18:58:52.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.462+0000 7fd05b7fe700 1 -- 172.21.15.46:0/3299815651 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd05c0055b0 con 0x7fd0680ffbd0 2024-02-19T18:58:52.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.463+0000 7fd07029b700 1 -- 172.21.15.46:0/3299815651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0681a01d0 con 0x7fd0680ffbd0 2024-02-19T18:58:52.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.463+0000 7fd07029b700 1 -- 172.21.15.46:0/3299815651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06804f2a0 con 0x7fd0680ffbd0 2024-02-19T18:58:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.464+0000 7fd05b7fe700 1 -- 172.21.15.46:0/3299815651 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd05c007ad0 con 0x7fd0680ffbd0 2024-02-19T18:58:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.464+0000 7fd05b7fe700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd05406c680 0x7fd05406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.464+0000 7fd05b7fe700 1 -- 172.21.15.46:0/3299815651 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd05c08b260 con 0x7fd0680ffbd0 2024-02-19T18:58:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.464+0000 7fd06d836700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd05406c680 0x7fd05406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.465+0000 7fd06d836700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd05406c680 0x7fd05406eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd0640059d0 tx=0x7fd06401a040 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:52.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.469+0000 7fd05b7fe700 1 -- 172.21.15.46:0/3299815651 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd05c055c80 con 0x7fd0680ffbd0 2024-02-19T18:58:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.661+0000 7fd07029b700 1 -- 172.21.15.46:0/3299815651 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0680ff240 con 0x7fd05406c680 2024-02-19T18:58:52.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.663+0000 7fd05b7fe700 1 -- 172.21.15.46:0/3299815651 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27859 (secure 0 0 0) 0x7fd0680ff240 con 0x7fd05406c680 2024-02-19T18:58:52.682 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:58:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 -- 172.21.15.46:0/3299815651 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd05406c680 msgr2=0x7fd05406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd05406c680 0x7fd05406eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd0640059d0 tx=0x7fd06401a040 comp rx=0 tx=0).stop 2024-02-19T18:58:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 -- 172.21.15.46:0/3299815651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0680ffbd0 msgr2=0x7fd068196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0680ffbd0 0x7fd068196c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00c8a0 tx=0x7fd05c00cc60 comp rx=0 tx=0).stop 2024-02-19T18:58:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 -- 172.21.15.46:0/3299815651 shutdown_connections 2024-02-19T18:58:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd05406c680 0x7fd05406eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0680ffbd0 0x7fd068196c40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 --2- 172.21.15.46:0/3299815651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd068104130 0x7fd068197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 -- 172.21.15.46:0/3299815651 >> 172.21.15.46:0/3299815651 conn(0x7fd068075130 msgr2=0x7fd0680feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:52.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 -- 172.21.15.46:0/3299815651 shutdown_connections 2024-02-19T18:58:52.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:52.665+0000 7fd07029b700 1 -- 172.21.15.46:0/3299815651 wait complete. 2024-02-19T18:58:52.685 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T18:58:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:53 smithi046 ceph-mon[29647]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:53.380 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-02-19T18:58:52.156352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001834"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-19T18:58:05.504125+0000","last_change":"2024-02-19T18:57:37.757288+0000","last_active":"2024-02-19T18:58:05.504125+0000","last_peered":"2024-02-19T18:58:05.504125+0000","last_clean":"2024-02-19T18:58:05.504125+0000","last_became_active":"2024-02-19T18:57:37.756934+0000","last_became_peered":"2024-02-19T18:57:37.756934+0000","last_unstale":"2024-02-19T18:58:05.504125+0000","last_undegraded":"2024-02-19T18:58:05.504125+0000","last_fullsized":"2024-02-19T18:58:05.504125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T18:56:49.021187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T18:56:49.021187+0000","last_clean_scrub_stamp":"2024-02-19T18:56:49.021187+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-21T05:57:14.083606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 18:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.46999999999999997}]},{"osd":1,"last update":"Mon Feb 19 18:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.502}]},{"osd":2,"last update":"Mon Feb 19 18:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Feb 19 18:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.34399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 18:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.374},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":0.44900000000000001}]},{"osd":1,"last update":"Mon Feb 19 18:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.435}]},{"osd":2,"last update":"Mon Feb 19 18:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.35799999999999998}]},{"osd":4,"last update":"Mon Feb 19 18:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.317},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 18:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34200000000000003,"15min":0.34499999999999997},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.35199999999999998,"15min":0.35899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.439,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.377}]},{"osd":1,"last update":"Mon Feb 19 18:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.36499999999999999,"15min":0.375},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46500000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.313},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38900000000000001,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.49299999999999999,"5min":0.504,"15min":0.504},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Feb 19 18:58:16 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Mon Feb 19 18:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 18:58:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.29899999999999999},"min":{"1min":0.24399999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.372},{"interface":"front","average":{"1min":0.379,"5min":0.311,"15min":0.29899999999999999},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.28799999999999998}]},{"osd":2,"last update":"Mon Feb 19 18:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.309}]},{"osd":3,"last update":"Mon Feb 19 18:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.436}]},{"osd":4,"last update":"Mon Feb 19 18:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 18:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33100000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34399999999999997,"15min":0.34200000000000003},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.379}]},{"osd":2,"last update":"Mon Feb 19 18:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.40200000000000002}]},{"osd":3,"last update":"Mon Feb 19 18:58:14 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Feb 19 18:58:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T18:58:53.381 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T18:58:53.596 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:53.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:53 smithi142 ceph-mon[37169]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:54.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:54 smithi046 ceph-mon[29647]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T18:58:54.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:54 smithi142 ceph-mon[37169]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.240+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/2607891581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8d80ffd60 msgr2=0x7fb8d8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.240+0000 7fb8dd3ce700 1 --2- 172.21.15.46:0/2607891581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8d80ffd60 0x7fb8d8103d30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009910 tx=0x7fb8c8009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.240+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/2607891581 shutdown_connections 2024-02-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.240+0000 7fb8dd3ce700 1 --2- 172.21.15.46:0/2607891581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8d80ffd60 0x7fb8d8103d30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.240+0000 7fb8dd3ce700 1 --2- 172.21.15.46:0/2607891581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d80ff3c0 0x7fb8d80ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.240+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/2607891581 >> 172.21.15.46:0/2607891581 conn(0x7fb8d80fac80 msgr2=0x7fb8d80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.240+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/2607891581 shutdown_connections 2024-02-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.240+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/2607891581 wait complete. 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.241+0000 7fb8dd3ce700 1 Processor -- start 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.241+0000 7fb8dd3ce700 1 -- start start 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.241+0000 7fb8dd3ce700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d80ff3c0 0x7fb8d8195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.241+0000 7fb8dd3ce700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8d80ffd60 0x7fb8d81963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.241+0000 7fb8dd3ce700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8196a40 con 0x7fb8d80ffd60 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.241+0000 7fb8dd3ce700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8196b80 con 0x7fb8d80ff3c0 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.241+0000 7fb8d67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8d80ffd60 0x7fb8d81963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.241+0000 7fb8d67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8d80ffd60 0x7fb8d81963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40184/0 (socket says 172.21.15.46:40184) 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.241+0000 7fb8d67fc700 1 -- 172.21.15.46:0/47206712 learned_addr learned my addr 172.21.15.46:0/47206712 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.241+0000 7fb8d6ffd700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d80ff3c0 0x7fb8d8195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.242+0000 7fb8d67fc700 1 -- 172.21.15.46:0/47206712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d80ff3c0 msgr2=0x7fb8d8195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.242+0000 7fb8d67fc700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d80ff3c0 0x7fb8d8195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.242+0000 7fb8d67fc700 1 -- 172.21.15.46:0/47206712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c80095f0 con 0x7fb8d80ffd60 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.242+0000 7fb8d67fc700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8d80ffd60 0x7fb8d81963f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800bda0 tx=0x7fb8c800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.242+0000 7fb8bffff700 1 -- 172.21.15.46:0/47206712 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c801d070 con 0x7fb8d80ffd60 2024-02-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.242+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/47206712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d819a970 con 0x7fb8d80ffd60 2024-02-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.242+0000 7fb8bffff700 1 -- 172.21.15.46:0/47206712 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8c8022470 con 0x7fb8d80ffd60 2024-02-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.242+0000 7fb8bffff700 1 -- 172.21.15.46:0/47206712 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c800f690 con 0x7fb8d80ffd60 2024-02-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.242+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/47206712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d819ae60 con 0x7fb8d80ffd60 2024-02-19T18:58:55.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.243+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/47206712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d804f2a0 con 0x7fb8d80ffd60 2024-02-19T18:58:55.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.243+0000 7fb8bffff700 1 -- 172.21.15.46:0/47206712 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb8c8022b00 con 0x7fb8d80ffd60 2024-02-19T18:58:55.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.244+0000 7fb8bffff700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb8c006c680 0x7fb8c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:55.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.244+0000 7fb8bffff700 1 -- 172.21.15.46:0/47206712 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb8c808ca80 con 0x7fb8d80ffd60 2024-02-19T18:58:55.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.244+0000 7fb8d6ffd700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb8c006c680 0x7fb8c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:55.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.244+0000 7fb8d6ffd700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb8c006c680 0x7fb8c006eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc005ea0 tx=0x7fb8cc005e30 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:55.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.248+0000 7fb8bffff700 1 -- 172.21.15.46:0/47206712 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb8c8057550 con 0x7fb8d80ffd60 2024-02-19T18:58:55.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:55 smithi046 ceph-mon[29647]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:55.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.444+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/47206712 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8d819b160 con 0x7fb8c006c680 2024-02-19T18:58:55.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.446+0000 7fb8bffff700 1 -- 172.21.15.46:0/47206712 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27945 (secure 0 0 0) 0x7fb8d819b160 con 0x7fb8c006c680 2024-02-19T18:58:55.465 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:58:55.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/47206712 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb8c006c680 msgr2=0x7fb8c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:55.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb8c006c680 0x7fb8c006eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc005ea0 tx=0x7fb8cc005e30 comp rx=0 tx=0).stop 2024-02-19T18:58:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/47206712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8d80ffd60 msgr2=0x7fb8d81963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8d80ffd60 0x7fb8d81963f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800bda0 tx=0x7fb8c800be80 comp rx=0 tx=0).stop 2024-02-19T18:58:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/47206712 shutdown_connections 2024-02-19T18:58:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb8c006c680 0x7fb8c006eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8d80ff3c0 0x7fb8d8195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 --2- 172.21.15.46:0/47206712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8d80ffd60 0x7fb8d81963f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/47206712 >> 172.21.15.46:0/47206712 conn(0x7fb8d80fac80 msgr2=0x7fb8d8103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/47206712 shutdown_connections 2024-02-19T18:58:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:55.448+0000 7fb8dd3ce700 1 -- 172.21.15.46:0/47206712 wait complete. 2024-02-19T18:58:55.469 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-02-19T18:58:55.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:55 smithi142 ceph-mon[37169]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:56.074 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-02-19T18:58:54.156636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001832"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-19T18:58:05.504125+0000","last_change":"2024-02-19T18:57:37.757288+0000","last_active":"2024-02-19T18:58:05.504125+0000","last_peered":"2024-02-19T18:58:05.504125+0000","last_clean":"2024-02-19T18:58:05.504125+0000","last_became_active":"2024-02-19T18:57:37.756934+0000","last_became_peered":"2024-02-19T18:57:37.756934+0000","last_unstale":"2024-02-19T18:58:05.504125+0000","last_undegraded":"2024-02-19T18:58:05.504125+0000","last_fullsized":"2024-02-19T18:58:05.504125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T18:56:49.021187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T18:56:49.021187+0000","last_clean_scrub_stamp":"2024-02-19T18:56:49.021187+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-21T05:57:14.083606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 18:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.39300000000000002}]},{"osd":1,"last update":"Mon Feb 19 18:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Feb 19 18:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Feb 19 18:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 18:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Feb 19 18:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Feb 19 18:58:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.56100000000000005}]},{"osd":4,"last update":"Mon Feb 19 18:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 18:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34200000000000003,"15min":0.34499999999999997},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.316},{"interface":"front","average":{"1min":0.31,"5min":0.35199999999999998,"15min":0.35899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.439,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.27200000000000002}]},{"osd":1,"last update":"Mon Feb 19 18:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.36499999999999999,"15min":0.375},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46500000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38900000000000001,"15min":0.39600000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.49299999999999999,"5min":0.504,"15min":0.504},"last":0.36899999999999999}]},{"osd":3,"last update":"Mon Feb 19 18:58:16 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.45900000000000002}]},{"osd":4,"last update":"Mon Feb 19 18:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.441},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 18:58:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.30499999999999999,"15min":0.29899999999999999},"min":{"1min":0.24399999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.311,"15min":0.29899999999999999},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.26100000000000001}]},{"osd":2,"last update":"Mon Feb 19 18:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.33900000000000002}]},{"osd":3,"last update":"Mon Feb 19 18:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Feb 19 18:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 18:58:19 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33100000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34399999999999997,"15min":0.34200000000000003},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.379}]},{"osd":2,"last update":"Mon Feb 19 18:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.40200000000000002}]},{"osd":3,"last update":"Mon Feb 19 18:58:14 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Feb 19 18:58:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T18:58:56.075 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-19T18:58:56.075 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-19T18:58:56.075 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-19T18:58:56.075 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph health --format=json 2024-02-19T18:58:56.285 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:57.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:57 smithi046 ceph-mon[29647]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T18:58:57.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:57 smithi046 ceph-mon[29647]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:57.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:57 smithi142 ceph-mon[37169]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T18:58:57.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:57 smithi142 ceph-mon[37169]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.850+0000 7f6b1c591700 1 -- 172.21.15.46:0/1118241109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b14106320 msgr2=0x7f6b141066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.850+0000 7f6b1c591700 1 --2- 172.21.15.46:0/1118241109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b14106320 0x7f6b141066f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009910 tx=0x7f6b10009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 -- 172.21.15.46:0/1118241109 shutdown_connections 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 --2- 172.21.15.46:0/1118241109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b14068540 0x7f6b140689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 --2- 172.21.15.46:0/1118241109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b14106320 0x7f6b141066f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 -- 172.21.15.46:0/1118241109 >> 172.21.15.46:0/1118241109 conn(0x7f6b14075130 msgr2=0x7f6b14075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 -- 172.21.15.46:0/1118241109 shutdown_connections 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 -- 172.21.15.46:0/1118241109 wait complete. 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 Processor -- start 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 -- start start 2024-02-19T18:58:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b14068540 0x7f6b14195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b14106320 0x7f6b141963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b14196a90 con 0x7f6b14106320 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b1c591700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1419a820 con 0x7f6b14068540 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b19b2c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b14106320 0x7f6b141963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.851+0000 7f6b19b2c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b14106320 0x7f6b141963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52952/0 (socket says 172.21.15.46:52952) 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b19b2c700 1 -- 172.21.15.46:0/2308497733 learned_addr learned my addr 172.21.15.46:0/2308497733 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b1a32d700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b14068540 0x7f6b14195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b19b2c700 1 -- 172.21.15.46:0/2308497733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b14068540 msgr2=0x7f6b14195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b19b2c700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b14068540 0x7f6b14195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b19b2c700 1 -- 172.21.15.46:0/2308497733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b100095f0 con 0x7f6b14106320 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b19b2c700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b14106320 0x7f6b141963b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400c8a0 tx=0x7f6b0400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b0b7fe700 1 -- 172.21.15.46:0/2308497733 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b0400cea0 con 0x7f6b14106320 2024-02-19T18:58:57.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b0b7fe700 1 -- 172.21.15.46:0/2308497733 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6b04004830 con 0x7f6b14106320 2024-02-19T18:58:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b0b7fe700 1 -- 172.21.15.46:0/2308497733 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b040055b0 con 0x7f6b14106320 2024-02-19T18:58:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b1c591700 1 -- 172.21.15.46:0/2308497733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1419ab00 con 0x7f6b14106320 2024-02-19T18:58:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.852+0000 7f6b1c591700 1 -- 172.21.15.46:0/2308497733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1419b050 con 0x7f6b14106320 2024-02-19T18:58:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.853+0000 7f6b1c591700 1 -- 172.21.15.46:0/2308497733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b14108770 con 0x7f6b14106320 2024-02-19T18:58:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.854+0000 7f6b0b7fe700 1 -- 172.21.15.46:0/2308497733 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6b04007ad0 con 0x7f6b14106320 2024-02-19T18:58:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.854+0000 7f6b0b7fe700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6b0006c680 0x7f6b0006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.854+0000 7f6b0b7fe700 1 -- 172.21.15.46:0/2308497733 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6b0408b1f0 con 0x7f6b14106320 2024-02-19T18:58:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.854+0000 7f6b1a32d700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6b0006c680 0x7f6b0006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.854+0000 7f6b1a32d700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6b0006c680 0x7f6b0006eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000b5c0 tx=0x7f6b1001a040 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:57.858+0000 7f6b0b7fe700 1 -- 172.21.15.46:0/2308497733 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6b04055c90 con 0x7f6b14106320 2024-02-19T18:58:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.106+0000 7f6b1c591700 1 -- 172.21.15.46:0/2308497733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6b1404f2a0 con 0x7f6b14106320 2024-02-19T18:58:58.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.106+0000 7f6b0b7fe700 1 -- 172.21.15.46:0/2308497733 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6b040592b0 con 0x7f6b14106320 2024-02-19T18:58:58.125 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:58:58.126 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-19T18:58:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 -- 172.21.15.46:0/2308497733 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6b0006c680 msgr2=0x7f6b0006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6b0006c680 0x7f6b0006eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000b5c0 tx=0x7f6b1001a040 comp rx=0 tx=0).stop 2024-02-19T18:58:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 -- 172.21.15.46:0/2308497733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b14106320 msgr2=0x7f6b141963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:58.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b14106320 0x7f6b141963b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400c8a0 tx=0x7f6b0400cc60 comp rx=0 tx=0).stop 2024-02-19T18:58:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 -- 172.21.15.46:0/2308497733 shutdown_connections 2024-02-19T18:58:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f6b0006c680 0x7f6b0006eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b14068540 0x7f6b14195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 --2- 172.21.15.46:0/2308497733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b14106320 0x7f6b141963b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 -- 172.21.15.46:0/2308497733 >> 172.21.15.46:0/2308497733 conn(0x7f6b14075130 msgr2=0x7f6b140fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 -- 172.21.15.46:0/2308497733 shutdown_connections 2024-02-19T18:58:58.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:58:58.108+0000 7f6b1c591700 1 -- 172.21.15.46:0/2308497733 wait complete. 2024-02-19T18:58:58.421 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:58 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2308497733' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-19T18:58:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:58 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2308497733' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-19T18:58:58.875 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-19T18:58:58.875 INFO:tasks.cephadm:Setup complete, yielding 2024-02-19T18:58:58.876 INFO:teuthology.run_tasks:Running task print... 2024-02-19T18:58:58.885 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-02-19T18:58:58.885 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T18:58:58.902 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T18:58:58.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:58:59.551 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:58:59 smithi046 ceph-mon[29647]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:58:59.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:58:59 smithi142 ceph-mon[37169]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:00.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.682+0000 7f2b91157700 1 -- 172.21.15.46:0/1157211842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b8c0ff130 msgr2=0x7f2b8c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:00.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.682+0000 7f2b91157700 1 --2- 172.21.15.46:0/1157211842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b8c0ff130 0x7f2b8c0ff540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009910 tx=0x7f2b7c009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:00.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.682+0000 7f2b91157700 1 -- 172.21.15.46:0/1157211842 shutdown_connections 2024-02-19T18:59:00.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.682+0000 7f2b91157700 1 --2- 172.21.15.46:0/1157211842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c1003d0 0x7f2b8c100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:00.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.682+0000 7f2b91157700 1 --2- 172.21.15.46:0/1157211842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b8c0ff130 0x7f2b8c0ff540 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:00.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.682+0000 7f2b91157700 1 -- 172.21.15.46:0/1157211842 >> 172.21.15.46:0/1157211842 conn(0x7f2b8c0fa780 msgr2=0x7f2b8c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:00.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.682+0000 7f2b91157700 1 -- 172.21.15.46:0/1157211842 shutdown_connections 2024-02-19T18:59:00.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.682+0000 7f2b91157700 1 -- 172.21.15.46:0/1157211842 wait complete. 2024-02-19T18:59:00.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b91157700 1 Processor -- start 2024-02-19T18:59:00.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b91157700 1 -- start start 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b91157700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b8c0ff130 0x7f2b8c0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b91157700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c1003d0 0x7f2b8c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b91157700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c19adc0 con 0x7f2b8c0ff130 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b91157700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c19af30 con 0x7f2b8c1003d0 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b8ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b8c0ff130 0x7f2b8c0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b8ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b8c0ff130 0x7f2b8c0690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52976/0 (socket says 172.21.15.46:52976) 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b8ad9d700 1 -- 172.21.15.46:0/833734880 learned_addr learned my addr 172.21.15.46:0/833734880 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b8a59c700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c1003d0 0x7f2b8c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b8ad9d700 1 -- 172.21.15.46:0/833734880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c1003d0 msgr2=0x7f2b8c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b8ad9d700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c1003d0 0x7f2b8c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.683+0000 7f2b8ad9d700 1 -- 172.21.15.46:0/833734880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0095f0 con 0x7f2b8c0ff130 2024-02-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.684+0000 7f2b8ad9d700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b8c0ff130 0x7f2b8c0690c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00b5c0 tx=0x7f2b7c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.684+0000 7f2b73fff700 1 -- 172.21.15.46:0/833734880 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b7c01d070 con 0x7f2b8c0ff130 2024-02-19T18:59:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.684+0000 7f2b73fff700 1 -- 172.21.15.46:0/833734880 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2b7c00f460 con 0x7f2b8c0ff130 2024-02-19T18:59:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.684+0000 7f2b73fff700 1 -- 172.21.15.46:0/833734880 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b7c021640 con 0x7f2b8c0ff130 2024-02-19T18:59:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.684+0000 7f2b91157700 1 -- 172.21.15.46:0/833734880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c19b1b0 con 0x7f2b8c0ff130 2024-02-19T18:59:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.684+0000 7f2b91157700 1 -- 172.21.15.46:0/833734880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c19b6a0 con 0x7f2b8c0ff130 2024-02-19T18:59:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.685+0000 7f2b91157700 1 -- 172.21.15.46:0/833734880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c107c10 con 0x7f2b8c0ff130 2024-02-19T18:59:00.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.685+0000 7f2b73fff700 1 -- 172.21.15.46:0/833734880 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2b7c00fa60 con 0x7f2b8c0ff130 2024-02-19T18:59:00.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.686+0000 7f2b73fff700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2b7406c680 0x7f2b7406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:00.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.686+0000 7f2b73fff700 1 -- 172.21.15.46:0/833734880 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2b7c08c790 con 0x7f2b8c0ff130 2024-02-19T18:59:00.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.686+0000 7f2b8a59c700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2b7406c680 0x7f2b7406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:00.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.686+0000 7f2b8a59c700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2b7406c680 0x7f2b7406eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c069620 tx=0x7f2b8000b410 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:00.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.690+0000 7f2b73fff700 1 -- 172.21.15.46:0/833734880 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2b7c05ac40 con 0x7f2b8c0ff130 2024-02-19T18:59:00.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.889+0000 7f2b91157700 1 -- 172.21.15.46:0/833734880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f2b8c107e00 con 0x7f2b8c0ff130 2024-02-19T18:59:00.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.893+0000 7f2b73fff700 1 -- 172.21.15.46:0/833734880 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f2b8c107e00 con 0x7f2b8c0ff130 2024-02-19T18:59:00.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 -- 172.21.15.46:0/833734880 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2b7406c680 msgr2=0x7f2b7406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:00.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2b7406c680 0x7f2b7406eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c069620 tx=0x7f2b8000b410 comp rx=0 tx=0).stop 2024-02-19T18:59:00.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 -- 172.21.15.46:0/833734880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b8c0ff130 msgr2=0x7f2b8c0690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:00.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b8c0ff130 0x7f2b8c0690c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00b5c0 tx=0x7f2b7c00bd70 comp rx=0 tx=0).stop 2024-02-19T18:59:00.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 -- 172.21.15.46:0/833734880 shutdown_connections 2024-02-19T18:59:00.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2b7406c680 0x7f2b7406eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:00.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b8c0ff130 0x7f2b8c0690c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:00.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 --2- 172.21.15.46:0/833734880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c1003d0 0x7f2b8c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:00.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 -- 172.21.15.46:0/833734880 >> 172.21.15.46:0/833734880 conn(0x7f2b8c0fa780 msgr2=0x7f2b8c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:00.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 -- 172.21.15.46:0/833734880 shutdown_connections 2024-02-19T18:59:00.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:00.895+0000 7f2b91157700 1 -- 172.21.15.46:0/833734880 wait complete. 2024-02-19T18:59:01.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:01 smithi046 ceph-mon[29647]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:01.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:01 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/833734880' entity='client.admin' 2024-02-19T18:59:01.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:01 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:01.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:01 smithi142 ceph-mon[37169]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:01.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:01 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/833734880' entity='client.admin' 2024-02-19T18:59:01.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:01 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:01.507 INFO:teuthology.run_tasks:Running task print... 2024-02-19T18:59:01.515 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-19T18:59:01.516 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T18:59:01.526 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T18:59:01.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph orch status' 2024-02-19T18:59:01.758 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:02.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:02 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:02.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:02 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:02.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:02 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:02.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:02 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:02.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:02 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:02.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:02 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:03.255 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:03 smithi046 ceph-mon[29647]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:03.255 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:03 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:03.408 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:03 smithi142 ceph-mon[37169]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:03.409 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:03 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:03.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.435+0000 7f80b8dd3700 1 -- 172.21.15.46:0/2477803226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40ff150 msgr2=0x7f80b40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:03.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.435+0000 7f80b8dd3700 1 --2- 172.21.15.46:0/2477803226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40ff150 0x7f80b40ff560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f80a400b0a0 tx=0x7f80a400b3b0 comp rx=0 tx=0).stop 2024-02-19T18:59:03.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.435+0000 7f80b8dd3700 1 -- 172.21.15.46:0/2477803226 shutdown_connections 2024-02-19T18:59:03.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.435+0000 7f80b8dd3700 1 --2- 172.21.15.46:0/2477803226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b41003f0 0x7f80b4100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:03.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.435+0000 7f80b8dd3700 1 --2- 172.21.15.46:0/2477803226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40ff150 0x7f80b40ff560 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:03.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.435+0000 7f80b8dd3700 1 -- 172.21.15.46:0/2477803226 >> 172.21.15.46:0/2477803226 conn(0x7f80b40fa7a0 msgr2=0x7f80b40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:03.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.435+0000 7f80b8dd3700 1 -- 172.21.15.46:0/2477803226 shutdown_connections 2024-02-19T18:59:03.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.435+0000 7f80b8dd3700 1 -- 172.21.15.46:0/2477803226 wait complete. 2024-02-19T18:59:03.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b8dd3700 1 Processor -- start 2024-02-19T18:59:03.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b8dd3700 1 -- start start 2024-02-19T18:59:03.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b8dd3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b40ff150 0x7f80b4195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:03.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b8dd3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b41003f0 0x7f80b41963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:03.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b8dd3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4196a00 con 0x7f80b41003f0 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b8dd3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4196b40 con 0x7f80b40ff150 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b1d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b41003f0 0x7f80b41963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b1d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b41003f0 0x7f80b41963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52992/0 (socket says 172.21.15.46:52992) 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b1d9b700 1 -- 172.21.15.46:0/1253148843 learned_addr learned my addr 172.21.15.46:0/1253148843 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b259c700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b40ff150 0x7f80b4195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b1d9b700 1 -- 172.21.15.46:0/1253148843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b40ff150 msgr2=0x7f80b4195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b1d9b700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b40ff150 0x7f80b4195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b1d9b700 1 -- 172.21.15.46:0/1253148843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a4009d00 con 0x7f80b41003f0 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.436+0000 7f80b1d9b700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b41003f0 0x7f80b41963e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f809c00b4b0 tx=0x7f809c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.437+0000 7f80ab7fe700 1 -- 172.21.15.46:0/1253148843 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809c011800 con 0x7f80b41003f0 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.437+0000 7f80ab7fe700 1 -- 172.21.15.46:0/1253148843 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f809c011e10 con 0x7f80b41003f0 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.437+0000 7f80b8dd3700 1 -- 172.21.15.46:0/1253148843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b419b5f0 con 0x7f80b41003f0 2024-02-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.437+0000 7f80ab7fe700 1 -- 172.21.15.46:0/1253148843 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809c00f2e0 con 0x7f80b41003f0 2024-02-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.437+0000 7f80b8dd3700 1 -- 172.21.15.46:0/1253148843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b419bb40 con 0x7f80b41003f0 2024-02-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.438+0000 7f80b8dd3700 1 -- 172.21.15.46:0/1253148843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b4068ab0 con 0x7f80b41003f0 2024-02-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.438+0000 7f80ab7fe700 1 -- 172.21.15.46:0/1253148843 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f809c010380 con 0x7f80b41003f0 2024-02-19T18:59:03.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.439+0000 7f80ab7fe700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f80a006c680 0x7f80a006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:03.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.439+0000 7f80ab7fe700 1 -- 172.21.15.46:0/1253148843 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f809c08b100 con 0x7f80b41003f0 2024-02-19T18:59:03.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.439+0000 7f80b259c700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f80a006c680 0x7f80a006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:03.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.439+0000 7f80b259c700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f80a006c680 0x7f80a006eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80a4000f80 tx=0x7f80a40060c0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:03.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.443+0000 7f80ab7fe700 1 -- 172.21.15.46:0/1253148843 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f809c0595b0 con 0x7f80b41003f0 2024-02-19T18:59:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.663+0000 7f80b8dd3700 1 -- 172.21.15.46:0/1253148843 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80b4069500 con 0x7f80a006c680 2024-02-19T18:59:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.664+0000 7f80ab7fe700 1 -- 172.21.15.46:0/1253148843 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f80b4069500 con 0x7f80a006c680 2024-02-19T18:59:03.683 INFO:teuthology.orchestra.run.smithi046.stdout:Backend: cephadm 2024-02-19T18:59:03.683 INFO:teuthology.orchestra.run.smithi046.stdout:Available: Yes 2024-02-19T18:59:03.683 INFO:teuthology.orchestra.run.smithi046.stdout:Paused: No 2024-02-19T18:59:03.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 -- 172.21.15.46:0/1253148843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f80a006c680 msgr2=0x7f80a006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:03.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f80a006c680 0x7f80a006eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80a4000f80 tx=0x7f80a40060c0 comp rx=0 tx=0).stop 2024-02-19T18:59:03.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 -- 172.21.15.46:0/1253148843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b41003f0 msgr2=0x7f80b41963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:03.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b41003f0 0x7f80b41963e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f809c00b4b0 tx=0x7f809c00b7c0 comp rx=0 tx=0).stop 2024-02-19T18:59:03.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 -- 172.21.15.46:0/1253148843 shutdown_connections 2024-02-19T18:59:03.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f80a006c680 0x7f80a006eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:03.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b40ff150 0x7f80b4195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:03.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 --2- 172.21.15.46:0/1253148843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b41003f0 0x7f80b41963e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:03.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 -- 172.21.15.46:0/1253148843 >> 172.21.15.46:0/1253148843 conn(0x7f80b40fa7a0 msgr2=0x7f80b4068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:03.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 -- 172.21.15.46:0/1253148843 shutdown_connections 2024-02-19T18:59:03.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:03.667+0000 7f80b8dd3700 1 -- 172.21.15.46:0/1253148843 wait complete. 2024-02-19T18:59:04.431 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-19T18:59:04.642 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:05.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:05 smithi046 ceph-mon[29647]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:05.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:05 smithi046 ceph-mon[29647]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:05 smithi142 ceph-mon[37169]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:05 smithi142 ceph-mon[37169]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.275+0000 7f58fd464700 1 -- 172.21.15.46:0/2391995605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58f81003d0 msgr2=0x7f58f8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.275+0000 7f58fd464700 1 --2- 172.21.15.46:0/2391995605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58f81003d0 0x7f58f8100840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f58e0009910 tx=0x7f58e0009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.275+0000 7f58fd464700 1 -- 172.21.15.46:0/2391995605 shutdown_connections 2024-02-19T18:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.275+0000 7f58fd464700 1 --2- 172.21.15.46:0/2391995605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58f81003d0 0x7f58f8100840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.275+0000 7f58fd464700 1 --2- 172.21.15.46:0/2391995605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58f80ff130 0x7f58f80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.275+0000 7f58fd464700 1 -- 172.21.15.46:0/2391995605 >> 172.21.15.46:0/2391995605 conn(0x7f58f80fa780 msgr2=0x7f58f80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.275+0000 7f58fd464700 1 -- 172.21.15.46:0/2391995605 shutdown_connections 2024-02-19T18:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.275+0000 7f58fd464700 1 -- 172.21.15.46:0/2391995605 wait complete. 2024-02-19T18:59:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.275+0000 7f58fd464700 1 Processor -- start 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58fd464700 1 -- start start 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58fd464700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58f80ff130 0x7f58f80690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58fd464700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58f81003d0 0x7f58f819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58fd464700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f819ad90 con 0x7f58f81003d0 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58fd464700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f819aed0 con 0x7f58f80ff130 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58f67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58f81003d0 0x7f58f819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58f67fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58f81003d0 0x7f58f819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53018/0 (socket says 172.21.15.46:53018) 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58f67fc700 1 -- 172.21.15.46:0/1059718518 learned_addr learned my addr 172.21.15.46:0/1059718518 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58f6ffd700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58f80ff130 0x7f58f80690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58f67fc700 1 -- 172.21.15.46:0/1059718518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58f80ff130 msgr2=0x7f58f80690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58f67fc700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58f80ff130 0x7f58f80690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58f67fc700 1 -- 172.21.15.46:0/1059718518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00095f0 con 0x7f58f81003d0 2024-02-19T18:59:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58f67fc700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58f81003d0 0x7f58f819a7c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f58e000b5c0 tx=0x7f58e000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.276+0000 7f58effff700 1 -- 172.21.15.46:0/1059718518 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e001d070 con 0x7f58f81003d0 2024-02-19T18:59:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.277+0000 7f58fd464700 1 -- 172.21.15.46:0/1059718518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f819b150 con 0x7f58f81003d0 2024-02-19T18:59:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.277+0000 7f58effff700 1 -- 172.21.15.46:0/1059718518 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58e000f460 con 0x7f58f81003d0 2024-02-19T18:59:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.277+0000 7f58effff700 1 -- 172.21.15.46:0/1059718518 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e0021640 con 0x7f58f81003d0 2024-02-19T18:59:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.277+0000 7f58fd464700 1 -- 172.21.15.46:0/1059718518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f819b640 con 0x7f58f81003d0 2024-02-19T18:59:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.277+0000 7f58fd464700 1 -- 172.21.15.46:0/1059718518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f8107c10 con 0x7f58f81003d0 2024-02-19T18:59:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.278+0000 7f58effff700 1 -- 172.21.15.46:0/1059718518 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f58e000fa60 con 0x7f58f81003d0 2024-02-19T18:59:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.279+0000 7f58effff700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f58e406c680 0x7f58e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.279+0000 7f58f6ffd700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f58e406c680 0x7f58e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.279+0000 7f58effff700 1 -- 172.21.15.46:0/1059718518 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f58e008c790 con 0x7f58f81003d0 2024-02-19T18:59:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.279+0000 7f58f6ffd700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f58e406c680 0x7f58e406eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f58f0005950 tx=0x7f58f000b410 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.283+0000 7f58effff700 1 -- 172.21.15.46:0/1059718518 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f58e005ac40 con 0x7f58f81003d0 2024-02-19T18:59:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.492+0000 7f58fd464700 1 -- 172.21.15.46:0/1059718518 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f58f8104d20 con 0x7f58e406c680 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.501+0000 7f58effff700 1 -- 172.21.15.46:0/1059718518 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2820 (secure 0 0 0) 0x7f58f8104d20 con 0x7f58e406c680 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (3m) 2m ago 5m 26.0M - 0.25.0 c8568f914cd2 cfbe74f8660f 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (6m) 2m ago 6m 7037k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (4m) 65s ago 4m 6878k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (6m) 2m ago 6m 6656k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (4m) 65s ago 4m 6665k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (3m) 2m ago 5m 78.2M - 9.4.7 954c08fa6188 2fa87d8c964a 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:9283,8765,8443 running (7m) 2m ago 7m 478M - 18.2.0 dc2bc1663786 513c14e92ab1 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (4m) 65s ago 4m 439M - 18.2.0 dc2bc1663786 97004ff2f216 2024-02-19T18:59:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (7m) 2m ago 7m 43.9M 2048M 18.2.0 dc2bc1663786 adb8243bd11c 2024-02-19T18:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (4m) 65s ago 4m 40.9M 2048M 18.2.0 dc2bc1663786 3f6c8b69abc2 2024-02-19T18:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (5m) 2m ago 5m 16.4M - 1.5.0 0da6a335fe13 6fcd0bc86aba 2024-02-19T18:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (4m) 65s ago 4m 15.1M - 1.5.0 0da6a335fe13 bdfda6603f51 2024-02-19T18:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (3m) 2m ago 3m 40.6M 3948M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T18:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (2m) 2m ago 2m 41.9M 3948M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T18:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (2m) 2m ago 2m 42.6M 3948M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T18:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (2m) 65s ago 2m 41.0M 4970M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T18:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (96s) 65s ago 95s 38.7M 4970M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T18:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (70s) 65s ago 69s 11.5M 4970M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T18:59:06.520 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (3m) 2m ago 4m 42.4M - 2.43.0 a07b618ecd1d c0b60f66a9ef 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 -- 172.21.15.46:0/1059718518 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f58e406c680 msgr2=0x7f58e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f58e406c680 0x7f58e406eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f58f0005950 tx=0x7f58f000b410 comp rx=0 tx=0).stop 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 -- 172.21.15.46:0/1059718518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58f81003d0 msgr2=0x7f58f819a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58f81003d0 0x7f58f819a7c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f58e000b5c0 tx=0x7f58e000bd70 comp rx=0 tx=0).stop 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 -- 172.21.15.46:0/1059718518 shutdown_connections 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f58e406c680 0x7f58e406eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58f80ff130 0x7f58f80690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 --2- 172.21.15.46:0/1059718518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58f81003d0 0x7f58f819a7c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 -- 172.21.15.46:0/1059718518 >> 172.21.15.46:0/1059718518 conn(0x7f58f80fa780 msgr2=0x7f58f8103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 -- 172.21.15.46:0/1059718518 shutdown_connections 2024-02-19T18:59:06.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:06.503+0000 7f58fd464700 1 -- 172.21.15.46:0/1059718518 wait complete. 2024-02-19T18:59:07.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-19T18:59:07.387 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:07.506 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:07 smithi046 ceph-mon[29647]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:07.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:07 smithi142 ceph-mon[37169]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:08.509 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:08 smithi046 ceph-mon[29647]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:08.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:08 smithi142 ceph-mon[37169]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.925+0000 7f88b8e2a700 1 -- 172.21.15.46:0/3075817695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b40ff130 msgr2=0x7f88b40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.925+0000 7f88b8e2a700 1 --2- 172.21.15.46:0/3075817695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b40ff130 0x7f88b40ff540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009910 tx=0x7f88a8009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.925+0000 7f88b8e2a700 1 -- 172.21.15.46:0/3075817695 shutdown_connections 2024-02-19T18:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.925+0000 7f88b8e2a700 1 --2- 172.21.15.46:0/3075817695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88b41003d0 0x7f88b4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.925+0000 7f88b8e2a700 1 --2- 172.21.15.46:0/3075817695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b40ff130 0x7f88b40ff540 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.925+0000 7f88b8e2a700 1 -- 172.21.15.46:0/3075817695 >> 172.21.15.46:0/3075817695 conn(0x7f88b40fa780 msgr2=0x7f88b40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.925+0000 7f88b8e2a700 1 -- 172.21.15.46:0/3075817695 shutdown_connections 2024-02-19T18:59:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.925+0000 7f88b8e2a700 1 -- 172.21.15.46:0/3075817695 wait complete. 2024-02-19T18:59:08.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b8e2a700 1 Processor -- start 2024-02-19T18:59:08.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b8e2a700 1 -- start start 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b8e2a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88b40ff130 0x7f88b4069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b8e2a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b41003d0 0x7f88b419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b8e2a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b419ae20 con 0x7f88b41003d0 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b8e2a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b419af60 con 0x7f88b40ff130 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b1d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b41003d0 0x7f88b419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b1d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b41003d0 0x7f88b419a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34348/0 (socket says 172.21.15.46:34348) 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b1d9b700 1 -- 172.21.15.46:0/337385869 learned_addr learned my addr 172.21.15.46:0/337385869 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b259c700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88b40ff130 0x7f88b4069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b1d9b700 1 -- 172.21.15.46:0/337385869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88b40ff130 msgr2=0x7f88b4069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b1d9b700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88b40ff130 0x7f88b4069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b1d9b700 1 -- 172.21.15.46:0/337385869 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a80095f0 con 0x7f88b41003d0 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.926+0000 7f88b1d9b700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b41003d0 0x7f88b419a800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f88a400b4b0 tx=0x7f88a400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.927+0000 7f88a37fe700 1 -- 172.21.15.46:0/337385869 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a4011800 con 0x7f88b41003d0 2024-02-19T18:59:08.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.927+0000 7f88a37fe700 1 -- 172.21.15.46:0/337385869 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f88a4011e10 con 0x7f88b41003d0 2024-02-19T18:59:08.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.927+0000 7f88b8e2a700 1 -- 172.21.15.46:0/337385869 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b419b240 con 0x7f88b41003d0 2024-02-19T18:59:08.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.927+0000 7f88a37fe700 1 -- 172.21.15.46:0/337385869 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88a400f2e0 con 0x7f88b41003d0 2024-02-19T18:59:08.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.927+0000 7f88b8e2a700 1 -- 172.21.15.46:0/337385869 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b419b790 con 0x7f88b41003d0 2024-02-19T18:59:08.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.928+0000 7f88b8e2a700 1 -- 172.21.15.46:0/337385869 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b4107c90 con 0x7f88b41003d0 2024-02-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.928+0000 7f88a37fe700 1 -- 172.21.15.46:0/337385869 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f88a4010380 con 0x7f88b41003d0 2024-02-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.928+0000 7f88a37fe700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f889c06c680 0x7f889c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.929+0000 7f88b259c700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f889c06c680 0x7f889c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.929+0000 7f88a37fe700 1 -- 172.21.15.46:0/337385869 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f88a408aff0 con 0x7f88b41003d0 2024-02-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.929+0000 7f88b259c700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f889c06c680 0x7f889c06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88a8006010 tx=0x7f88a800b540 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:08.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:08.933+0000 7f88a37fe700 1 -- 172.21.15.46:0/337385869 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f88a4059520 con 0x7f88b41003d0 2024-02-19T18:59:09.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.143+0000 7f88b8e2a700 1 -- 172.21.15.46:0/337385869 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f88b4104d20 con 0x7f889c06c680 2024-02-19T18:59:09.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.148+0000 7f88a37fe700 1 -- 172.21.15.46:0/337385869 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7f88b4104d20 con 0x7f889c06c680 2024-02-19T18:59:09.166 INFO:teuthology.orchestra.run.smithi046.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-19T18:59:09.166 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-02-19T18:59:09.166 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter 2/2 2m ago 6m * 2024-02-19T18:59:09.166 INFO:teuthology.orchestra.run.smithi046.stdout:crash 2/2 2m ago 6m * 2024-02-19T18:59:09.166 INFO:teuthology.orchestra.run.smithi046.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-02-19T18:59:09.166 INFO:teuthology.orchestra.run.smithi046.stdout:mgr 2/2 2m ago 6m count:2 2024-02-19T18:59:09.166 INFO:teuthology.orchestra.run.smithi046.stdout:mon 2/2 2m ago 5m smithi046:172.21.15.46=smithi046;smithi142:172.21.15.142=smithi142;count:2 2024-02-19T18:59:09.166 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-02-19T18:59:09.166 INFO:teuthology.orchestra.run.smithi046.stdout:osd 6 2m ago - 2024-02-19T18:59:09.167 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-02-19T18:59:09.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 -- 172.21.15.46:0/337385869 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f889c06c680 msgr2=0x7f889c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:09.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f889c06c680 0x7f889c06eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88a8006010 tx=0x7f88a800b540 comp rx=0 tx=0).stop 2024-02-19T18:59:09.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 -- 172.21.15.46:0/337385869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b41003d0 msgr2=0x7f88b419a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:09.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b41003d0 0x7f88b419a800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f88a400b4b0 tx=0x7f88a400b7c0 comp rx=0 tx=0).stop 2024-02-19T18:59:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 -- 172.21.15.46:0/337385869 shutdown_connections 2024-02-19T18:59:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f889c06c680 0x7f889c06eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88b40ff130 0x7f88b4069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 --2- 172.21.15.46:0/337385869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88b41003d0 0x7f88b419a800 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 -- 172.21.15.46:0/337385869 >> 172.21.15.46:0/337385869 conn(0x7f88b40fa780 msgr2=0x7f88b4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 -- 172.21.15.46:0/337385869 shutdown_connections 2024-02-19T18:59:09.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:09.150+0000 7f88b8e2a700 1 -- 172.21.15.46:0/337385869 wait complete. 2024-02-19T18:59:09.509 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:09 smithi046 ceph-mon[29647]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:09.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:09 smithi142 ceph-mon[37169]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:09.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-19T18:59:09.991 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:10.380 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:10 smithi046 ceph-mon[29647]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:10.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:10 smithi142 ceph-mon[37169]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:11.519 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:11 smithi046 ceph-mon[29647]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:11.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.609+0000 7f080163c700 1 -- 172.21.15.46:0/2400250855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07fc0ff150 msgr2=0x7f07fc0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:11.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.609+0000 7f080163c700 1 --2- 172.21.15.46:0/2400250855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07fc0ff150 0x7f07fc0ff560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009910 tx=0x7f07ec009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:11.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.609+0000 7f080163c700 1 -- 172.21.15.46:0/2400250855 shutdown_connections 2024-02-19T18:59:11.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.609+0000 7f080163c700 1 --2- 172.21.15.46:0/2400250855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07fc1003f0 0x7f07fc100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:11.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.609+0000 7f080163c700 1 --2- 172.21.15.46:0/2400250855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07fc0ff150 0x7f07fc0ff560 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:11.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.609+0000 7f080163c700 1 -- 172.21.15.46:0/2400250855 >> 172.21.15.46:0/2400250855 conn(0x7f07fc0fa7a0 msgr2=0x7f07fc0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:11.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.609+0000 7f080163c700 1 -- 172.21.15.46:0/2400250855 shutdown_connections 2024-02-19T18:59:11.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.609+0000 7f080163c700 1 -- 172.21.15.46:0/2400250855 wait complete. 2024-02-19T18:59:11.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.609+0000 7f080163c700 1 Processor -- start 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.609+0000 7f080163c700 1 -- start start 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f080163c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07fc0ff150 0x7f07fc103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f080163c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07fc1003f0 0x7f07fc1017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f080163c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc101d10 con 0x7f07fc0ff150 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f080163c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc101e50 con 0x7f07fc1003f0 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07faffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07fc0ff150 0x7f07fc103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07faffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07fc0ff150 0x7f07fc103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34360/0 (socket says 172.21.15.46:34360) 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07faffd700 1 -- 172.21.15.46:0/230955527 learned_addr learned my addr 172.21.15.46:0/230955527 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07f27fc700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07fc1003f0 0x7f07fc1017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07faffd700 1 -- 172.21.15.46:0/230955527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07fc1003f0 msgr2=0x7f07fc1017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07faffd700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07fc1003f0 0x7f07fc1017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07faffd700 1 -- 172.21.15.46:0/230955527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0095f0 con 0x7f07fc0ff150 2024-02-19T18:59:11.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07f27fc700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07fc1003f0 0x7f07fc1017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T18:59:11.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07faffd700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07fc0ff150 0x7f07fc103180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00bd70 tx=0x7f07ec00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:11.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07f8ff9700 1 -- 172.21.15.46:0/230955527 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07ec01d070 con 0x7f07fc0ff150 2024-02-19T18:59:11.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07f8ff9700 1 -- 172.21.15.46:0/230955527 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f07ec022470 con 0x7f07fc0ff150 2024-02-19T18:59:11.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f080163c700 1 -- 172.21.15.46:0/230955527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07fc1020d0 con 0x7f07fc0ff150 2024-02-19T18:59:11.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.610+0000 7f07f8ff9700 1 -- 172.21.15.46:0/230955527 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07ec00f670 con 0x7f07fc0ff150 2024-02-19T18:59:11.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.611+0000 7f080163c700 1 -- 172.21.15.46:0/230955527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc1025c0 con 0x7f07fc0ff150 2024-02-19T18:59:11.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.611+0000 7f080163c700 1 -- 172.21.15.46:0/230955527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07fc068ab0 con 0x7f07fc0ff150 2024-02-19T18:59:11.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.612+0000 7f07f8ff9700 1 -- 172.21.15.46:0/230955527 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f07ec022a50 con 0x7f07fc0ff150 2024-02-19T18:59:11.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.612+0000 7f07f8ff9700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f07e806c680 0x7f07e806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:11.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.612+0000 7f07f8ff9700 1 -- 172.21.15.46:0/230955527 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f07ec08cc10 con 0x7f07fc0ff150 2024-02-19T18:59:11.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.612+0000 7f07f27fc700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f07e806c680 0x7f07e806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:11.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.613+0000 7f07f27fc700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f07e806c680 0x7f07e806eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f07e40099d0 tx=0x7f07e4008040 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:11.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.617+0000 7f07f8ff9700 1 -- 172.21.15.46:0/230955527 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f07ec05b170 con 0x7f07fc0ff150 2024-02-19T18:59:11.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:11 smithi142 ceph-mon[37169]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:11.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.824+0000 7f080163c700 1 -- 172.21.15.46:0/230955527 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f07fc0694e0 con 0x7f07e806c680 2024-02-19T18:59:11.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.825+0000 7f07f8ff9700 1 -- 172.21.15.46:0/230955527 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f07fc0694e0 con 0x7f07e806c680 2024-02-19T18:59:11.875 INFO:teuthology.orchestra.run.smithi046.stdout:HOST ADDR LABELS STATUS 2024-02-19T18:59:11.875 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 172.21.15.46 2024-02-19T18:59:11.876 INFO:teuthology.orchestra.run.smithi046.stdout:smithi142 172.21.15.142 2024-02-19T18:59:11.876 INFO:teuthology.orchestra.run.smithi046.stdout:2 hosts in cluster 2024-02-19T18:59:11.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 -- 172.21.15.46:0/230955527 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f07e806c680 msgr2=0x7f07e806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:11.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f07e806c680 0x7f07e806eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f07e40099d0 tx=0x7f07e4008040 comp rx=0 tx=0).stop 2024-02-19T18:59:11.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 -- 172.21.15.46:0/230955527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07fc0ff150 msgr2=0x7f07fc103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07fc0ff150 0x7f07fc103180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00bd70 tx=0x7f07ec00be50 comp rx=0 tx=0).stop 2024-02-19T18:59:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 -- 172.21.15.46:0/230955527 shutdown_connections 2024-02-19T18:59:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f07e806c680 0x7f07e806eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07fc0ff150 0x7f07fc103180 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 --2- 172.21.15.46:0/230955527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07fc1003f0 0x7f07fc1017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 -- 172.21.15.46:0/230955527 >> 172.21.15.46:0/230955527 conn(0x7f07fc0fa7a0 msgr2=0x7f07fc068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 -- 172.21.15.46:0/230955527 shutdown_connections 2024-02-19T18:59:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:11.828+0000 7f080163c700 1 -- 172.21.15.46:0/230955527 wait complete. 2024-02-19T18:59:12.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-19T18:59:12.734 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:13.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:13 smithi046 ceph-mon[29647]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:13.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:13 smithi046 ceph-mon[29647]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:13.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:13 smithi142 ceph-mon[37169]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:13.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:13 smithi142 ceph-mon[37169]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.401+0000 7fa9f7316700 1 -- 172.21.15.46:0/396886094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9f01003d0 msgr2=0x7fa9f0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.401+0000 7fa9f7316700 1 --2- 172.21.15.46:0/396886094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9f01003d0 0x7fa9f0100840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009910 tx=0x7fa9ec009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.401+0000 7fa9f7316700 1 -- 172.21.15.46:0/396886094 shutdown_connections 2024-02-19T18:59:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.401+0000 7fa9f7316700 1 --2- 172.21.15.46:0/396886094 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9f01003d0 0x7fa9f0100840 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.401+0000 7fa9f7316700 1 --2- 172.21.15.46:0/396886094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9f00ff130 0x7fa9f00ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.401+0000 7fa9f7316700 1 -- 172.21.15.46:0/396886094 >> 172.21.15.46:0/396886094 conn(0x7fa9f00fa780 msgr2=0x7fa9f00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.401+0000 7fa9f7316700 1 -- 172.21.15.46:0/396886094 shutdown_connections 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.401+0000 7fa9f7316700 1 -- 172.21.15.46:0/396886094 wait complete. 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f7316700 1 Processor -- start 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f7316700 1 -- start start 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f7316700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9f00ff130 0x7fa9f0195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f7316700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9f01003d0 0x7fa9f0195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f7316700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f01965c0 con 0x7fa9f01003d0 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f7316700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0196700 con 0x7fa9f00ff130 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f48b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9f01003d0 0x7fa9f0195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f48b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9f01003d0 0x7fa9f0195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34382/0 (socket says 172.21.15.46:34382) 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f48b1700 1 -- 172.21.15.46:0/806476803 learned_addr learned my addr 172.21.15.46:0/806476803 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f50b2700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9f00ff130 0x7fa9f0195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f48b1700 1 -- 172.21.15.46:0/806476803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9f00ff130 msgr2=0x7fa9f0195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f48b1700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9f00ff130 0x7fa9f0195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f48b1700 1 -- 172.21.15.46:0/806476803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec0095f0 con 0x7fa9f01003d0 2024-02-19T18:59:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.402+0000 7fa9f48b1700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9f01003d0 0x7fa9f0195fa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec005b40 tx=0x7fa9ec00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.403+0000 7fa9e27fc700 1 -- 172.21.15.46:0/806476803 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec01d070 con 0x7fa9f01003d0 2024-02-19T18:59:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.403+0000 7fa9f7316700 1 -- 172.21.15.46:0/806476803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f019b150 con 0x7fa9f01003d0 2024-02-19T18:59:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.403+0000 7fa9e27fc700 1 -- 172.21.15.46:0/806476803 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9ec00f460 con 0x7fa9f01003d0 2024-02-19T18:59:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.403+0000 7fa9e27fc700 1 -- 172.21.15.46:0/806476803 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec021640 con 0x7fa9f01003d0 2024-02-19T18:59:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.403+0000 7fa9f7316700 1 -- 172.21.15.46:0/806476803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f019b640 con 0x7fa9f01003d0 2024-02-19T18:59:14.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.404+0000 7fa9f7316700 1 -- 172.21.15.46:0/806476803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f0107c10 con 0x7fa9f01003d0 2024-02-19T18:59:14.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.404+0000 7fa9e27fc700 1 -- 172.21.15.46:0/806476803 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa9ec00fa90 con 0x7fa9f01003d0 2024-02-19T18:59:14.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.404+0000 7fa9e27fc700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9dc06c680 0x7fa9dc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:14.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.405+0000 7fa9e27fc700 1 -- 172.21.15.46:0/806476803 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa9ec08c850 con 0x7fa9f01003d0 2024-02-19T18:59:14.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.405+0000 7fa9f50b2700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9dc06c680 0x7fa9dc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:14.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.405+0000 7fa9f50b2700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9dc06c680 0x7fa9dc06eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4005950 tx=0x7fa9e40058e0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:14.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.409+0000 7fa9e27fc700 1 -- 172.21.15.46:0/806476803 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa9ec05ad00 con 0x7fa9f01003d0 2024-02-19T18:59:14.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.617+0000 7fa9f7316700 1 -- 172.21.15.46:0/806476803 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9f019bc80 con 0x7fa9dc06c680 2024-02-19T18:59:14.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.619+0000 7fa9e27fc700 1 -- 172.21.15.46:0/806476803 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa9f019bc80 con 0x7fa9dc06c680 2024-02-19T18:59:14.637 INFO:teuthology.orchestra.run.smithi046.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-19T18:59:14.637 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009A480DGN 447G No 2m ago LVM detected, locked 2024-02-19T18:59:14.637 INFO:teuthology.orchestra.run.smithi046.stdout:smithi142 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN 372G No 69s ago LVM detected, locked 2024-02-19T18:59:14.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 -- 172.21.15.46:0/806476803 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9dc06c680 msgr2=0x7fa9dc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:14.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9dc06c680 0x7fa9dc06eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4005950 tx=0x7fa9e40058e0 comp rx=0 tx=0).stop 2024-02-19T18:59:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 -- 172.21.15.46:0/806476803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9f01003d0 msgr2=0x7fa9f0195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9f01003d0 0x7fa9f0195fa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec005b40 tx=0x7fa9ec00be20 comp rx=0 tx=0).stop 2024-02-19T18:59:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 -- 172.21.15.46:0/806476803 shutdown_connections 2024-02-19T18:59:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9dc06c680 0x7fa9dc06eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9f00ff130 0x7fa9f0195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 --2- 172.21.15.46:0/806476803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9f01003d0 0x7fa9f0195fa0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 -- 172.21.15.46:0/806476803 >> 172.21.15.46:0/806476803 conn(0x7fa9f00fa780 msgr2=0x7fa9f0068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 -- 172.21.15.46:0/806476803 shutdown_connections 2024-02-19T18:59:14.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:14.621+0000 7fa9f7316700 1 -- 172.21.15.46:0/806476803 wait complete. 2024-02-19T18:59:15.321 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:15 smithi046 ceph-mon[29647]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:15.345 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-02-19T18:59:15.355 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T18:59:15.365 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T18:59:15.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-19T18:59:15.578 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:15.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:15 smithi142 ceph-mon[37169]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:16.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:16 smithi046 ceph-mon[29647]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:16.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:16 smithi142 ceph-mon[37169]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.144+0000 7faaba0ec700 1 -- 172.21.15.46:0/2230990085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab40ffae0 msgr2=0x7faab40fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.144+0000 7faaba0ec700 1 --2- 172.21.15.46:0/2230990085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab40ffae0 0x7faab40fff30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009910 tx=0x7faaa8009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.144+0000 7faaba0ec700 1 -- 172.21.15.46:0/2230990085 shutdown_connections 2024-02-19T18:59:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.144+0000 7faaba0ec700 1 --2- 172.21.15.46:0/2230990085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab40ffae0 0x7faab40fff30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.144+0000 7faaba0ec700 1 --2- 172.21.15.46:0/2230990085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faab40fe8e0 0x7faab40fecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.144+0000 7faaba0ec700 1 -- 172.21.15.46:0/2230990085 >> 172.21.15.46:0/2230990085 conn(0x7faab40f9e70 msgr2=0x7faab40fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.144+0000 7faaba0ec700 1 -- 172.21.15.46:0/2230990085 shutdown_connections 2024-02-19T18:59:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.144+0000 7faaba0ec700 1 -- 172.21.15.46:0/2230990085 wait complete. 2024-02-19T18:59:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.144+0000 7faaba0ec700 1 Processor -- start 2024-02-19T18:59:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faaba0ec700 1 -- start start 2024-02-19T18:59:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faaba0ec700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab40fe8e0 0x7faab4195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faaba0ec700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faab40ffae0 0x7faab41960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faaba0ec700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab41966d0 con 0x7faab40fe8e0 2024-02-19T18:59:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faaba0ec700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab4196810 con 0x7faab40ffae0 2024-02-19T18:59:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faab37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab40fe8e0 0x7faab4195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faab37fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab40fe8e0 0x7faab4195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34408/0 (socket says 172.21.15.46:34408) 2024-02-19T18:59:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faab37fe700 1 -- 172.21.15.46:0/3176426661 learned_addr learned my addr 172.21.15.46:0/3176426661 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faab2ffd700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faab40ffae0 0x7faab41960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faab37fe700 1 -- 172.21.15.46:0/3176426661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faab40ffae0 msgr2=0x7faab41960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faab37fe700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faab40ffae0 0x7faab41960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faab37fe700 1 -- 172.21.15.46:0/3176426661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa80095f0 con 0x7faab40fe8e0 2024-02-19T18:59:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.145+0000 7faab37fe700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab40fe8e0 0x7faab4195b70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c8f0 tx=0x7faaa400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.146+0000 7faab0ff9700 1 -- 172.21.15.46:0/3176426661 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaa40078e0 con 0x7faab40fe8e0 2024-02-19T18:59:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.146+0000 7faab0ff9700 1 -- 172.21.15.46:0/3176426661 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faaa400f450 con 0x7faab40fe8e0 2024-02-19T18:59:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.146+0000 7faaba0ec700 1 -- 172.21.15.46:0/3176426661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab419b2c0 con 0x7faab40fe8e0 2024-02-19T18:59:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.146+0000 7faab0ff9700 1 -- 172.21.15.46:0/3176426661 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaa4018610 con 0x7faab40fe8e0 2024-02-19T18:59:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.146+0000 7faaba0ec700 1 -- 172.21.15.46:0/3176426661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab419b810 con 0x7faab40fe8e0 2024-02-19T18:59:17.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.147+0000 7faaba0ec700 1 -- 172.21.15.46:0/3176426661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab4107430 con 0x7faab40fe8e0 2024-02-19T18:59:17.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.147+0000 7faab0ff9700 1 -- 172.21.15.46:0/3176426661 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7faaa400f5c0 con 0x7faab40fe8e0 2024-02-19T18:59:17.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.147+0000 7faab0ff9700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7faa9c06c680 0x7faa9c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:17.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.148+0000 7faab0ff9700 1 -- 172.21.15.46:0/3176426661 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7faaa408b420 con 0x7faab40fe8e0 2024-02-19T18:59:17.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.148+0000 7faab2ffd700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7faa9c06c680 0x7faa9c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:17.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.148+0000 7faab2ffd700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7faa9c06c680 0x7faa9c06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faaa8005090 tx=0x7faaa801a040 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.152+0000 7faab0ff9700 1 -- 172.21.15.46:0/3176426661 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faaa40598d0 con 0x7faab40fe8e0 2024-02-19T18:59:17.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:17.382+0000 7faaba0ec700 1 -- 172.21.15.46:0/3176426661 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7faab40fc1a0 con 0x7faa9c06c680 2024-02-19T18:59:17.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:17 smithi046 ceph-mon[29647]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:17.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:17.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:17 smithi142 ceph-mon[37169]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:17.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:18.520 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:18 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-19T18:59:18.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:18 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-19T18:59:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.271+0000 7faab0ff9700 1 -- 172.21.15.46:0/3176426661 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7faab40fc1a0 con 0x7faa9c06c680 2024-02-19T18:59:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 -- 172.21.15.46:0/3176426661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7faa9c06c680 msgr2=0x7faa9c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7faa9c06c680 0x7faa9c06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faaa8005090 tx=0x7faaa801a040 comp rx=0 tx=0).stop 2024-02-19T18:59:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 -- 172.21.15.46:0/3176426661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab40fe8e0 msgr2=0x7faab4195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab40fe8e0 0x7faab4195b70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c8f0 tx=0x7faaa400cc00 comp rx=0 tx=0).stop 2024-02-19T18:59:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 -- 172.21.15.46:0/3176426661 shutdown_connections 2024-02-19T18:59:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7faa9c06c680 0x7faa9c06eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:19.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab40fe8e0 0x7faab4195b70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 --2- 172.21.15.46:0/3176426661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faab40ffae0 0x7faab41960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 -- 172.21.15.46:0/3176426661 >> 172.21.15.46:0/3176426661 conn(0x7faab40f9e70 msgr2=0x7faab40fba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 -- 172.21.15.46:0/3176426661 shutdown_connections 2024-02-19T18:59:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:19.274+0000 7faaba0ec700 1 -- 172.21.15.46:0/3176426661 wait complete. 2024-02-19T18:59:19.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:19 smithi046 ceph-mon[29647]: from='client.14474 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:19.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:19 smithi046 ceph-mon[29647]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:19.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:19 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046[29643]: 2024-02-19T18:59:19.246+0000 7fa371bcb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T18:59:19.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:19 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-19T18:59:19.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:19 smithi046 ceph-mon[29647]: osdmap e41: 6 total, 6 up, 6 in 2024-02-19T18:59:19.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:19 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-19T18:59:19.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:19 smithi142 ceph-mon[37169]: from='client.14474 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:19.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:19 smithi142 ceph-mon[37169]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:19.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:19 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-19T18:59:19.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:19 smithi142 ceph-mon[37169]: osdmap e41: 6 total, 6 up, 6 in 2024-02-19T18:59:19.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:19 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-19T18:59:19.965 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-19T18:59:20.182 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:20.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-19T18:59:20.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: osdmap e42: 6 total, 6 up, 6 in 2024-02-19T18:59:20.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-19T18:59:20.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T18:59:20.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-19T18:59:20.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: osdmap e43: 6 total, 6 up, 6 in 2024-02-19T18:59:20.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-19T18:59:20.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: fsmap cephfs:0 2024-02-19T18:59:20.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: Saving service mds.cephfs spec with placement count:4 2024-02-19T18:59:20.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:20.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:20.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:20.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:20.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:20.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hrbbel", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T18:59:20.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hrbbel", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T18:59:20.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:20 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:20.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-19T18:59:20.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: osdmap e42: 6 total, 6 up, 6 in 2024-02-19T18:59:20.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-19T18:59:20.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T18:59:20.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-19T18:59:20.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: osdmap e43: 6 total, 6 up, 6 in 2024-02-19T18:59:20.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-19T18:59:20.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: fsmap cephfs:0 2024-02-19T18:59:20.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: Saving service mds.cephfs spec with placement count:4 2024-02-19T18:59:20.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:20.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:20.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:20.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:20.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:20.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hrbbel", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T18:59:20.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hrbbel", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T18:59:20.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:20 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:21.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:21 smithi046 ceph-mon[29647]: Deploying daemon mds.cephfs.smithi046.hrbbel on smithi046 2024-02-19T18:59:21.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:21 smithi046 ceph-mon[29647]: pgmap v175: 65 pgs: 13 creating+peering, 18 active+clean, 34 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:21.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:21 smithi046 ceph-mon[29647]: osdmap e44: 6 total, 6 up, 6 in 2024-02-19T18:59:21.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:21 smithi142 ceph-mon[37169]: Deploying daemon mds.cephfs.smithi046.hrbbel on smithi046 2024-02-19T18:59:21.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:21 smithi142 ceph-mon[37169]: pgmap v175: 65 pgs: 13 creating+peering, 18 active+clean, 34 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:21.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:21 smithi142 ceph-mon[37169]: osdmap e44: 6 total, 6 up, 6 in 2024-02-19T18:59:22.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:22 smithi046 ceph-mon[29647]: osdmap e45: 6 total, 6 up, 6 in 2024-02-19T18:59:22.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:22 smithi142 ceph-mon[37169]: osdmap e45: 6 total, 6 up, 6 in 2024-02-19T18:59:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.306+0000 7f744fff8700 1 -- 172.21.15.46:0/3744000189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7448100d80 msgr2=0x7f7448103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.306+0000 7f744fff8700 1 --2- 172.21.15.46:0/3744000189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7448100d80 0x7f7448103160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f743800b0a0 tx=0x7f743800b3b0 comp rx=0 tx=0).stop 2024-02-19T18:59:23.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.306+0000 7f744fff8700 1 -- 172.21.15.46:0/3744000189 shutdown_connections 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.306+0000 7f744fff8700 1 --2- 172.21.15.46:0/3744000189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74481036a0 0x7f7448105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.306+0000 7f744fff8700 1 --2- 172.21.15.46:0/3744000189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7448100d80 0x7f7448103160 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.306+0000 7f744fff8700 1 -- 172.21.15.46:0/3744000189 >> 172.21.15.46:0/3744000189 conn(0x7f74480fa7a0 msgr2=0x7f74480fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.306+0000 7f744fff8700 1 -- 172.21.15.46:0/3744000189 shutdown_connections 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.306+0000 7f744fff8700 1 -- 172.21.15.46:0/3744000189 wait complete. 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744fff8700 1 Processor -- start 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744fff8700 1 -- start start 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744fff8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7448100d80 0x7f7448195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744fff8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74481036a0 0x7f7448196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744fff8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74481968c0 con 0x7f7448100d80 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744fff8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7448196a00 con 0x7f74481036a0 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744dd94700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7448100d80 0x7f7448195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744dd94700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7448100d80 0x7f7448195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54530/0 (socket says 172.21.15.46:54530) 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744dd94700 1 -- 172.21.15.46:0/86643315 learned_addr learned my addr 172.21.15.46:0/86643315 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744d593700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74481036a0 0x7f7448196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744dd94700 1 -- 172.21.15.46:0/86643315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74481036a0 msgr2=0x7f7448196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744dd94700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74481036a0 0x7f7448196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.307+0000 7f744dd94700 1 -- 172.21.15.46:0/86643315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7438009d00 con 0x7f7448100d80 2024-02-19T18:59:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.308+0000 7f744dd94700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7448100d80 0x7f7448195df0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f74380077b0 tx=0x7f7438003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.308+0000 7f7446ffd700 1 -- 172.21.15.46:0/86643315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f743800e040 con 0x7f7448100d80 2024-02-19T18:59:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.308+0000 7f744fff8700 1 -- 172.21.15.46:0/86643315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744819b460 con 0x7f7448100d80 2024-02-19T18:59:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.308+0000 7f744fff8700 1 -- 172.21.15.46:0/86643315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744819b920 con 0x7f7448100d80 2024-02-19T18:59:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.308+0000 7f7446ffd700 1 -- 172.21.15.46:0/86643315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f743800ce60 con 0x7f7448100d80 2024-02-19T18:59:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.308+0000 7f7446ffd700 1 -- 172.21.15.46:0/86643315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f743801db10 con 0x7f7448100d80 2024-02-19T18:59:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.309+0000 7f744fff8700 1 -- 172.21.15.46:0/86643315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744818fbe0 con 0x7f7448100d80 2024-02-19T18:59:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.309+0000 7f7446ffd700 1 -- 172.21.15.46:0/86643315 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f743801dc90 con 0x7f7448100d80 2024-02-19T18:59:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.310+0000 7f7446ffd700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f743006c680 0x7f743006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.310+0000 7f7446ffd700 1 -- 172.21.15.46:0/86643315 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f743808d340 con 0x7f7448100d80 2024-02-19T18:59:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.310+0000 7f744d593700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f743006c680 0x7f743006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.310+0000 7f744d593700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f743006c680 0x7f743006eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f743c00ba60 tx=0x7f743c005d50 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.315+0000 7f7446ffd700 1 -- 172.21.15.46:0/86643315 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f743805b4b0 con 0x7f7448100d80 2024-02-19T18:59:23.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:23 smithi046 ceph-mon[29647]: pgmap v178: 65 pgs: 13 creating+peering, 18 active+clean, 34 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:23.559 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:23 smithi142 ceph-mon[37169]: pgmap v178: 65 pgs: 13 creating+peering, 18 active+clean, 34 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:23.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.571+0000 7f744fff8700 1 -- 172.21.15.46:0/86643315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7448061960 con 0x7f7448100d80 2024-02-19T18:59:23.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.572+0000 7f7446ffd700 1 -- 172.21.15.46:0/86643315 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7f743805b040 con 0x7f7448100d80 2024-02-19T18:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout:e2 2024-02-19T18:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T18:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T18:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T18:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T18:59:23.590 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 2 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T18:59:19.247814+0000 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 0 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-02-19T18:59:23.591 INFO:teuthology.orchestra.run.smithi046.stdout:in 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 0 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:59:23.592 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:59:23.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 -- 172.21.15.46:0/86643315 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f743006c680 msgr2=0x7f743006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:23.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f743006c680 0x7f743006eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f743c00ba60 tx=0x7f743c005d50 comp rx=0 tx=0).stop 2024-02-19T18:59:23.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 -- 172.21.15.46:0/86643315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7448100d80 msgr2=0x7f7448195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:23.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7448100d80 0x7f7448195df0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f74380077b0 tx=0x7f7438003ce0 comp rx=0 tx=0).stop 2024-02-19T18:59:23.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 -- 172.21.15.46:0/86643315 shutdown_connections 2024-02-19T18:59:23.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f743006c680 0x7f743006eb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:23.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7448100d80 0x7f7448195df0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:23.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 --2- 172.21.15.46:0/86643315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74481036a0 0x7f7448196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:23.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 -- 172.21.15.46:0/86643315 >> 172.21.15.46:0/86643315 conn(0x7f74480fa7a0 msgr2=0x7f74480fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:23.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 -- 172.21.15.46:0/86643315 shutdown_connections 2024-02-19T18:59:23.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:23.574+0000 7f744fff8700 1 -- 172.21.15.46:0/86643315 wait complete. 2024-02-19T18:59:23.594 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2024-02-19T18:59:24.493 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:24 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/86643315' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T18:59:24.493 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:24 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:24.493 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:24 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:24.494 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:24 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:24.494 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:24 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.maazlq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T18:59:24.494 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:24 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.maazlq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T18:59:24.494 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:24 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:24.515 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T18:59:24.525 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T18:59:24.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-02-19T18:59:24.563 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:24 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/86643315' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T18:59:24.563 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:24 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:24.564 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:24 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:24.564 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:24 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:24.564 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:24 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.maazlq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T18:59:24.564 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:24 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.maazlq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T18:59:24.564 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:24 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:24.738 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:25.499 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: Deploying daemon mds.cephfs.smithi142.maazlq on smithi142 2024-02-19T18:59:25.499 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: pgmap v179: 65 pgs: 8 creating+peering, 57 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:25.499 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.46:6826/908936119,v1:172.21.15.46:6827/908936119] up:boot 2024-02-19T18:59:25.499 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: daemon mds.cephfs.smithi046.hrbbel assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-19T18:59:25.499 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-19T18:59:25.499 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-19T18:59:25.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: Cluster is now healthy 2024-02-19T18:59:25.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: fsmap cephfs:0 1 up:standby 2024-02-19T18:59:25.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T18:59:25.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: fsmap cephfs:1 {0=cephfs.smithi046.hrbbel=up:creating} 2024-02-19T18:59:25.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:25 smithi046 ceph-mon[29647]: daemon mds.cephfs.smithi046.hrbbel is now active in filesystem cephfs as rank 0 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: Deploying daemon mds.cephfs.smithi142.maazlq on smithi142 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: pgmap v179: 65 pgs: 8 creating+peering, 57 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.46:6826/908936119,v1:172.21.15.46:6827/908936119] up:boot 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: daemon mds.cephfs.smithi046.hrbbel assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: Cluster is now healthy 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: fsmap cephfs:0 1 up:standby 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: fsmap cephfs:1 {0=cephfs.smithi046.hrbbel=up:creating} 2024-02-19T18:59:25.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:25 smithi142 ceph-mon[37169]: daemon mds.cephfs.smithi046.hrbbel is now active in filesystem cephfs as rank 0 2024-02-19T18:59:26.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.370+0000 7fa175247700 1 -- 172.21.15.46:0/1735019556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa170103680 msgr2=0x7fa170105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:26.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.370+0000 7fa175247700 1 --2- 172.21.15.46:0/1735019556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa170103680 0x7fa170105a60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa158009910 tx=0x7fa158009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:26.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.370+0000 7fa175247700 1 -- 172.21.15.46:0/1735019556 shutdown_connections 2024-02-19T18:59:26.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.370+0000 7fa175247700 1 --2- 172.21.15.46:0/1735019556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa170103680 0x7fa170105a60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:26.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.370+0000 7fa175247700 1 --2- 172.21.15.46:0/1735019556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa170100d60 0x7fa170103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:26.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.370+0000 7fa175247700 1 -- 172.21.15.46:0/1735019556 >> 172.21.15.46:0/1735019556 conn(0x7fa1700fa780 msgr2=0x7fa1700fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:26.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.370+0000 7fa175247700 1 -- 172.21.15.46:0/1735019556 shutdown_connections 2024-02-19T18:59:26.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.370+0000 7fa175247700 1 -- 172.21.15.46:0/1735019556 wait complete. 2024-02-19T18:59:26.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.370+0000 7fa175247700 1 Processor -- start 2024-02-19T18:59:26.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa175247700 1 -- start start 2024-02-19T18:59:26.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa175247700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa170100d60 0x7fa170195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:26.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa175247700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa170103680 0x7fa170196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:26.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa175247700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa170196640 con 0x7fa170103680 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa175247700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa170196780 con 0x7fa170100d60 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa16e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa170103680 0x7fa170196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa16e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa170103680 0x7fa170196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54570/0 (socket says 172.21.15.46:54570) 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa16e59c700 1 -- 172.21.15.46:0/675179500 learned_addr learned my addr 172.21.15.46:0/675179500 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa16ed9d700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa170100d60 0x7fa170195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa16e59c700 1 -- 172.21.15.46:0/675179500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa170100d60 msgr2=0x7fa170195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa16e59c700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa170100d60 0x7fa170195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa16e59c700 1 -- 172.21.15.46:0/675179500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1580095f0 con 0x7fa170103680 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.371+0000 7fa16e59c700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa170103680 0x7fa170196020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa158006010 tx=0x7fa15800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.372+0000 7fa167fff700 1 -- 172.21.15.46:0/675179500 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa15801d070 con 0x7fa170103680 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.372+0000 7fa167fff700 1 -- 172.21.15.46:0/675179500 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa15800f460 con 0x7fa170103680 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.372+0000 7fa175247700 1 -- 172.21.15.46:0/675179500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17019b1d0 con 0x7fa170103680 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.372+0000 7fa167fff700 1 -- 172.21.15.46:0/675179500 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa158021640 con 0x7fa170103680 2024-02-19T18:59:26.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.372+0000 7fa175247700 1 -- 172.21.15.46:0/675179500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17019b6c0 con 0x7fa170103680 2024-02-19T18:59:26.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.373+0000 7fa175247700 1 -- 172.21.15.46:0/675179500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17018fbe0 con 0x7fa170103680 2024-02-19T18:59:26.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.373+0000 7fa167fff700 1 -- 172.21.15.46:0/675179500 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa15800fab0 con 0x7fa170103680 2024-02-19T18:59:26.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.374+0000 7fa167fff700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa15c06c680 0x7fa15c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:26.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.374+0000 7fa16ed9d700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa15c06c680 0x7fa15c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:26.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.374+0000 7fa167fff700 1 -- 172.21.15.46:0/675179500 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa15808cb20 con 0x7fa170103680 2024-02-19T18:59:26.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.374+0000 7fa16ed9d700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa15c06c680 0x7fa15c06eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa168009550 tx=0x7fa1680091b0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:26.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.378+0000 7fa167fff700 1 -- 172.21.15.46:0/675179500 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa15805ac90 con 0x7fa170103680 2024-02-19T18:59:26.560 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:26 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.46:6826/908936119,v1:172.21.15.46:6827/908936119] up:active 2024-02-19T18:59:26.560 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:26 smithi142 ceph-mon[37169]: fsmap cephfs:1 {0=cephfs.smithi046.hrbbel=up:active} 2024-02-19T18:59:26.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:26 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.46:6826/908936119,v1:172.21.15.46:6827/908936119] up:active 2024-02-19T18:59:26.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:26 smithi046 ceph-mon[29647]: fsmap cephfs:1 {0=cephfs.smithi046.hrbbel=up:active} 2024-02-19T18:59:26.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:26.626+0000 7fa175247700 1 -- 172.21.15.46:0/675179500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fa170061960 con 0x7fa170103680 2024-02-19T18:59:27.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.291+0000 7fa167fff700 1 -- 172.21.15.46:0/675179500 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fa15805a820 con 0x7fa170103680 2024-02-19T18:59:27.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 -- 172.21.15.46:0/675179500 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa15c06c680 msgr2=0x7fa15c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:27.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa15c06c680 0x7fa15c06eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa168009550 tx=0x7fa1680091b0 comp rx=0 tx=0).stop 2024-02-19T18:59:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 -- 172.21.15.46:0/675179500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa170103680 msgr2=0x7fa170196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa170103680 0x7fa170196020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa158006010 tx=0x7fa15800bd70 comp rx=0 tx=0).stop 2024-02-19T18:59:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 -- 172.21.15.46:0/675179500 shutdown_connections 2024-02-19T18:59:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa15c06c680 0x7fa15c06eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa170100d60 0x7fa170195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 --2- 172.21.15.46:0/675179500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa170103680 0x7fa170196020 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 -- 172.21.15.46:0/675179500 >> 172.21.15.46:0/675179500 conn(0x7fa1700fa780 msgr2=0x7fa1700fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 -- 172.21.15.46:0/675179500 shutdown_connections 2024-02-19T18:59:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:27.294+0000 7fa175247700 1 -- 172.21.15.46:0/675179500 wait complete. 2024-02-19T18:59:27.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:27 smithi046 ceph-mon[29647]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 296 B/s wr, 0 op/s 2024-02-19T18:59:27.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:27 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/675179500' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-19T18:59:27.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:27 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:27.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:27 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:27.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:27 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:27.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:27 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.bwvkwa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T18:59:27.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:27 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.bwvkwa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T18:59:27.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:27 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:27 smithi142 ceph-mon[37169]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 296 B/s wr, 0 op/s 2024-02-19T18:59:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:27 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/675179500' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-19T18:59:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:27 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:27 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:27 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:27 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.bwvkwa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T18:59:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:27 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.bwvkwa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T18:59:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:27 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: Deploying daemon mds.cephfs.smithi046.bwvkwa on smithi046 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] up:boot 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/675179500' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: daemon mds.cephfs.smithi142.maazlq assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: fsmap cephfs:1 {0=cephfs.smithi046.hrbbel=up:active} 1 up:standby 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:creating} 2024-02-19T18:59:28.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:28 smithi046 ceph-mon[29647]: daemon mds.cephfs.smithi142.maazlq is now active in filesystem cephfs as rank 1 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: Deploying daemon mds.cephfs.smithi046.bwvkwa on smithi046 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] up:boot 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/675179500' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: daemon mds.cephfs.smithi142.maazlq assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: fsmap cephfs:1 {0=cephfs.smithi046.hrbbel=up:active} 1 up:standby 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:creating} 2024-02-19T18:59:28.597 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:28 smithi142 ceph-mon[37169]: daemon mds.cephfs.smithi142.maazlq is now active in filesystem cephfs as rank 1 2024-02-19T18:59:29.086 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T18:59:29.096 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T18:59:29.096 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-02-19T18:59:29.428 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:29 smithi046 ceph-mon[29647]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 2 op/s 2024-02-19T18:59:29.428 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:29 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] up:active 2024-02-19T18:59:29.428 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:29 smithi046 ceph-mon[29647]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:active} 2024-02-19T18:59:29.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:29 smithi142 ceph-mon[37169]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 2 op/s 2024-02-19T18:59:29.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:29 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] up:active 2024-02-19T18:59:29.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:29 smithi142 ceph-mon[37169]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:active} 2024-02-19T18:59:29.701 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:30.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:30.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.eqnctx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.eqnctx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: Deploying daemon mds.cephfs.smithi142.eqnctx on smithi142 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: Cluster is now healthy 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:boot 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:active} 1 up:standby 2024-02-19T18:59:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:30 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.eqnctx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.eqnctx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: Deploying daemon mds.cephfs.smithi142.eqnctx on smithi142 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: Cluster is now healthy 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:boot 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:active} 1 up:standby 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:30 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T18:59:31.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.376+0000 7f5dfe838700 1 -- 172.21.15.46:0/2246540749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df81036a0 msgr2=0x7f5df8105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:31.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.376+0000 7f5dfe838700 1 --2- 172.21.15.46:0/2246540749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df81036a0 0x7f5df8105a80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009910 tx=0x7f5de0009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:31.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.376+0000 7f5dfe838700 1 -- 172.21.15.46:0/2246540749 shutdown_connections 2024-02-19T18:59:31.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.376+0000 7f5dfe838700 1 --2- 172.21.15.46:0/2246540749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df81036a0 0x7f5df8105a80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:31.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.376+0000 7f5dfe838700 1 --2- 172.21.15.46:0/2246540749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df8100d80 0x7f5df8103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:31.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.376+0000 7f5dfe838700 1 -- 172.21.15.46:0/2246540749 >> 172.21.15.46:0/2246540749 conn(0x7f5df80fa7a0 msgr2=0x7f5df80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:31.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.376+0000 7f5dfe838700 1 -- 172.21.15.46:0/2246540749 shutdown_connections 2024-02-19T18:59:31.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.376+0000 7f5dfe838700 1 -- 172.21.15.46:0/2246540749 wait complete. 2024-02-19T18:59:31.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.376+0000 7f5dfe838700 1 Processor -- start 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5dfe838700 1 -- start start 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5dfe838700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df8100d80 0x7f5df8195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5dfe838700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df81036a0 0x7f5df8196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5dfe838700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8196920 con 0x7f5df8100d80 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5dfe838700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8196a60 con 0x7f5df81036a0 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5df7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df8100d80 0x7f5df8195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5df7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df8100d80 0x7f5df8195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57140/0 (socket says 172.21.15.46:57140) 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5df7fff700 1 -- 172.21.15.46:0/1919725312 learned_addr learned my addr 172.21.15.46:0/1919725312 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5deffff700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df81036a0 0x7f5df8196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5df7fff700 1 -- 172.21.15.46:0/1919725312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df81036a0 msgr2=0x7f5df8196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5df7fff700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df81036a0 0x7f5df8196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5df7fff700 1 -- 172.21.15.46:0/1919725312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de00095f0 con 0x7f5df8100d80 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5df7fff700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df8100d80 0x7f5df8195dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5de800e8f0 tx=0x7f5de800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:31.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1919725312 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5de8009790 con 0x7f5df8100d80 2024-02-19T18:59:31.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.377+0000 7f5dfe838700 1 -- 172.21.15.46:0/1919725312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df819b510 con 0x7f5df8100d80 2024-02-19T18:59:31.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.378+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1919725312 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5de800c810 con 0x7f5df8100d80 2024-02-19T18:59:31.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.378+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1919725312 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5de80055b0 con 0x7f5df8100d80 2024-02-19T18:59:31.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.378+0000 7f5dfe838700 1 -- 172.21.15.46:0/1919725312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df819ba60 con 0x7f5df8100d80 2024-02-19T18:59:31.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.378+0000 7f5dfe838700 1 -- 172.21.15.46:0/1919725312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df818fc00 con 0x7f5df8100d80 2024-02-19T18:59:31.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.379+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1919725312 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5de800c980 con 0x7f5df8100d80 2024-02-19T18:59:31.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.379+0000 7f5df5ffb700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5de406c680 0x7f5de406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:31.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.380+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1919725312 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f5de8014070 con 0x7f5df8100d80 2024-02-19T18:59:31.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.380+0000 7f5deffff700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5de406c680 0x7f5de406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:31.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.380+0000 7f5deffff700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5de406c680 0x7f5de406eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009fd0 tx=0x7f5de0005940 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.384+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1919725312 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5de8059da0 con 0x7f5df8100d80 2024-02-19T18:59:31.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:31.632+0000 7f5dfe838700 1 -- 172.21.15.46:0/1919725312 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5df8068ab0 con 0x7f5df8100d80 2024-02-19T18:59:32.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.066+0000 7f5df5ffb700 1 -- 172.21.15.46:0/1919725312 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5de8059930 con 0x7f5df8100d80 2024-02-19T18:59:32.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.068+0000 7f5dfe838700 1 -- 172.21.15.46:0/1919725312 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5de406c680 msgr2=0x7f5de406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.068+0000 7f5dfe838700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5de406c680 0x7f5de406eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009fd0 tx=0x7f5de0005940 comp rx=0 tx=0).stop 2024-02-19T18:59:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.068+0000 7f5dfe838700 1 -- 172.21.15.46:0/1919725312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df8100d80 msgr2=0x7f5df8195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.068+0000 7f5dfe838700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df8100d80 0x7f5df8195dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5de800e8f0 tx=0x7f5de800ec00 comp rx=0 tx=0).stop 2024-02-19T18:59:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.068+0000 7f5dfe838700 1 -- 172.21.15.46:0/1919725312 shutdown_connections 2024-02-19T18:59:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.068+0000 7f5dfe838700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5de406c680 0x7f5de406eb30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.068+0000 7f5dfe838700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df8100d80 0x7f5df8195dc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.068+0000 7f5dfe838700 1 --2- 172.21.15.46:0/1919725312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5df81036a0 0x7f5df8196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.068+0000 7f5dfe838700 1 -- 172.21.15.46:0/1919725312 >> 172.21.15.46:0/1919725312 conn(0x7f5df80fa7a0 msgr2=0x7f5df80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.068+0000 7f5dfe838700 1 -- 172.21.15.46:0/1919725312 shutdown_connections 2024-02-19T18:59:32.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:32.069+0000 7f5dfe838700 1 -- 172.21.15.46:0/1919725312 wait complete. 2024-02-19T18:59:32.170 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:32 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1919725312' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-19T18:59:32.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:32 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1919725312' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-19T18:59:32.713 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T18:59:32.725 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T18:59:32.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1919725312' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:active} 1 up:standby 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.361 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1919725312' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:active} 1 up:standby 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:33.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:33.543 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:34.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:34 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] up:boot 2024-02-19T18:59:34.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:34 smithi142 ceph-mon[37169]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:34.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:34 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T18:59:34.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:34 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] up:boot 2024-02-19T18:59:34.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:34 smithi046 ceph-mon[29647]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:34.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:34 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T18:59:35.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.068+0000 7f0ce77cc700 1 -- 172.21.15.46:0/3636912087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce01003f0 msgr2=0x7f0ce0100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.068+0000 7f0ce77cc700 1 --2- 172.21.15.46:0/3636912087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce01003f0 0x7f0ce0100860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009910 tx=0x7f0cd0009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.068+0000 7f0ce77cc700 1 -- 172.21.15.46:0/3636912087 shutdown_connections 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.068+0000 7f0ce77cc700 1 --2- 172.21.15.46:0/3636912087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce01003f0 0x7f0ce0100860 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.068+0000 7f0ce77cc700 1 --2- 172.21.15.46:0/3636912087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce00ff150 0x7f0ce00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.068+0000 7f0ce77cc700 1 -- 172.21.15.46:0/3636912087 >> 172.21.15.46:0/3636912087 conn(0x7f0ce00fa7a0 msgr2=0x7f0ce00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.068+0000 7f0ce77cc700 1 -- 172.21.15.46:0/3636912087 shutdown_connections 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.068+0000 7f0ce77cc700 1 -- 172.21.15.46:0/3636912087 wait complete. 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.069+0000 7f0ce77cc700 1 Processor -- start 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.069+0000 7f0ce77cc700 1 -- start start 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.069+0000 7f0ce77cc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce00ff150 0x7f0ce0103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.069+0000 7f0ce77cc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce01003f0 0x7f0ce01017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.069+0000 7f0ce77cc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0101d10 con 0x7f0ce01003f0 2024-02-19T18:59:35.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.069+0000 7f0ce77cc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0101e50 con 0x7f0ce00ff150 2024-02-19T18:59:35.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.069+0000 7f0ce4d67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce01003f0 0x7f0ce01017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:35.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.069+0000 7f0ce4d67700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce01003f0 0x7f0ce01017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57176/0 (socket says 172.21.15.46:57176) 2024-02-19T18:59:35.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.069+0000 7f0ce4d67700 1 -- 172.21.15.46:0/2058504560 learned_addr learned my addr 172.21.15.46:0/2058504560 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:35.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.069+0000 7f0ce5568700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce00ff150 0x7f0ce0103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:35.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.070+0000 7f0ce4d67700 1 -- 172.21.15.46:0/2058504560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce00ff150 msgr2=0x7f0ce0103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:35.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.070+0000 7f0ce4d67700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce00ff150 0x7f0ce0103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:35.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.070+0000 7f0ce4d67700 1 -- 172.21.15.46:0/2058504560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00095f0 con 0x7f0ce01003f0 2024-02-19T18:59:35.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.070+0000 7f0ce4d67700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce01003f0 0x7f0ce01017d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0006010 tx=0x7f0cd000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:35.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.070+0000 7f0cd67fc700 1 -- 172.21.15.46:0/2058504560 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd001d070 con 0x7f0ce01003f0 2024-02-19T18:59:35.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.070+0000 7f0ce77cc700 1 -- 172.21.15.46:0/2058504560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce01020d0 con 0x7f0ce01003f0 2024-02-19T18:59:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.070+0000 7f0cd67fc700 1 -- 172.21.15.46:0/2058504560 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0cd000f460 con 0x7f0ce01003f0 2024-02-19T18:59:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.070+0000 7f0cd67fc700 1 -- 172.21.15.46:0/2058504560 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cd0021640 con 0x7f0ce01003f0 2024-02-19T18:59:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.070+0000 7f0ce77cc700 1 -- 172.21.15.46:0/2058504560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce01025c0 con 0x7f0ce01003f0 2024-02-19T18:59:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.071+0000 7f0ce77cc700 1 -- 172.21.15.46:0/2058504560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce0068ab0 con 0x7f0ce01003f0 2024-02-19T18:59:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.071+0000 7f0cd67fc700 1 -- 172.21.15.46:0/2058504560 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0cd000fab0 con 0x7f0ce01003f0 2024-02-19T18:59:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.072+0000 7f0cd67fc700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0ccc06c680 0x7f0ccc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.072+0000 7f0cd67fc700 1 -- 172.21.15.46:0/2058504560 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0cd008cb30 con 0x7f0ce01003f0 2024-02-19T18:59:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.072+0000 7f0ce5568700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0ccc06c680 0x7f0ccc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:35.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.072+0000 7f0ce5568700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0ccc06c680 0x7f0ccc06eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc005950 tx=0x7f0cdc00b410 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:35.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.076+0000 7f0cd67fc700 1 -- 172.21.15.46:0/2058504560 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0cd005ac40 con 0x7f0ce01003f0 2024-02-19T18:59:35.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:35 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:standby 2024-02-19T18:59:35.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:35 smithi046 ceph-mon[29647]: Dropping low affinity active daemon mds.cephfs.smithi046.hrbbel in favor of higher affinity standby. 2024-02-19T18:59:35.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:35 smithi046 ceph-mon[29647]: Replacing daemon mds.cephfs.smithi046.hrbbel as rank 0 with standby daemon mds.cephfs.smithi046.bwvkwa 2024-02-19T18:59:35.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:35 smithi046 ceph-mon[29647]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-19T18:59:35.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:35 smithi046 ceph-mon[29647]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:35.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:35 smithi046 ceph-mon[29647]: osdmap e46: 6 total, 6 up, 6 in 2024-02-19T18:59:35.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:35 smithi046 ceph-mon[29647]: fsmap cephfs:2/2 {0=cephfs.smithi046.bwvkwa=up:replay,1=cephfs.smithi142.maazlq=up:active} 1 up:standby 2024-02-19T18:59:35.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:35 smithi046 ceph-mon[29647]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-02-19T18:59:35.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:35 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:35.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:35 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:35.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:35.339+0000 7f0ce77cc700 1 -- 172.21.15.46:0/2058504560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f0ce019e2c0 con 0x7f0ce01003f0 2024-02-19T18:59:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:35 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:standby 2024-02-19T18:59:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:35 smithi142 ceph-mon[37169]: Dropping low affinity active daemon mds.cephfs.smithi046.hrbbel in favor of higher affinity standby. 2024-02-19T18:59:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:35 smithi142 ceph-mon[37169]: Replacing daemon mds.cephfs.smithi046.hrbbel as rank 0 with standby daemon mds.cephfs.smithi046.bwvkwa 2024-02-19T18:59:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:35 smithi142 ceph-mon[37169]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-19T18:59:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:35 smithi142 ceph-mon[37169]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:35 smithi142 ceph-mon[37169]: osdmap e46: 6 total, 6 up, 6 in 2024-02-19T18:59:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:35 smithi142 ceph-mon[37169]: fsmap cephfs:2/2 {0=cephfs.smithi046.bwvkwa=up:replay,1=cephfs.smithi142.maazlq=up:active} 1 up:standby 2024-02-19T18:59:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:35 smithi142 ceph-mon[37169]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-02-19T18:59:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:35 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:35 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:36.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.088+0000 7f0cd67fc700 1 -- 172.21.15.46:0/2058504560 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v15) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0cd005a7d0 con 0x7f0ce01003f0 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 -- 172.21.15.46:0/2058504560 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0ccc06c680 msgr2=0x7f0ccc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0ccc06c680 0x7f0ccc06eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc005950 tx=0x7f0cdc00b410 comp rx=0 tx=0).stop 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 -- 172.21.15.46:0/2058504560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce01003f0 msgr2=0x7f0ce01017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce01003f0 0x7f0ce01017d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0006010 tx=0x7f0cd000bd70 comp rx=0 tx=0).stop 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 -- 172.21.15.46:0/2058504560 shutdown_connections 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0ccc06c680 0x7f0ccc06eb30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ce00ff150 0x7f0ce0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 --2- 172.21.15.46:0/2058504560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ce01003f0 0x7f0ce01017d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 -- 172.21.15.46:0/2058504560 >> 172.21.15.46:0/2058504560 conn(0x7f0ce00fa7a0 msgr2=0x7f0ce0068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 -- 172.21.15.46:0/2058504560 shutdown_connections 2024-02-19T18:59:36.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:36.090+0000 7f0ce77cc700 1 -- 172.21.15.46:0/2058504560 wait complete. 2024-02-19T18:59:36.110 INFO:teuthology.orchestra.run.smithi046.stderr:inline data disabled 2024-02-19T18:59:36.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:36 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:resolve 2024-02-19T18:59:36.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:36 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] up:boot 2024-02-19T18:59:36.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:36 smithi046 ceph-mon[29647]: fsmap cephfs:2/2 {0=cephfs.smithi046.bwvkwa=up:resolve,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:36.418 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:36 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T18:59:36.418 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:36 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2058504560' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-19T18:59:36.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:36 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:resolve 2024-02-19T18:59:36.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:36 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] up:boot 2024-02-19T18:59:36.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:36 smithi142 ceph-mon[37169]: fsmap cephfs:2/2 {0=cephfs.smithi046.bwvkwa=up:resolve,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:36.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:36 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T18:59:36.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:36 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2058504560' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-19T18:59:37.089 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T18:59:37.099 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T18:59:37.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-19T18:59:37.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:37 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:reconnect 2024-02-19T18:59:37.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:37 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] up:active 2024-02-19T18:59:37.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:37 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2058504560' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-19T18:59:37.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:37 smithi046 ceph-mon[29647]: fsmap cephfs:2/2 {0=cephfs.smithi046.bwvkwa=up:reconnect,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:37.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:37 smithi046 ceph-mon[29647]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 409 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-02-19T18:59:37.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:37 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:reconnect 2024-02-19T18:59:37.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:37 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] up:active 2024-02-19T18:59:37.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:37 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2058504560' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-19T18:59:37.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:37 smithi142 ceph-mon[37169]: fsmap cephfs:2/2 {0=cephfs.smithi046.bwvkwa=up:reconnect,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:37.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:37 smithi142 ceph-mon[37169]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 409 B/s rd, 2.4 KiB/s wr, 8 op/s 2024-02-19T18:59:37.782 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:38.229 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:38 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:rejoin 2024-02-19T18:59:38.229 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:38 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] up:standby 2024-02-19T18:59:38.229 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:38 smithi046 ceph-mon[29647]: fsmap cephfs:2/2 {0=cephfs.smithi046.bwvkwa=up:rejoin,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:38.229 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:38 smithi046 ceph-mon[29647]: daemon mds.cephfs.smithi046.bwvkwa is now active in filesystem cephfs as rank 0 2024-02-19T18:59:38.230 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:38 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:38.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:38 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:rejoin 2024-02-19T18:59:38.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:38 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] up:standby 2024-02-19T18:59:38.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:38 smithi142 ceph-mon[37169]: fsmap cephfs:2/2 {0=cephfs.smithi046.bwvkwa=up:rejoin,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:38.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:38 smithi142 ceph-mon[37169]: daemon mds.cephfs.smithi046.bwvkwa is now active in filesystem cephfs as rank 0 2024-02-19T18:59:38.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:38 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:39.432 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:39 smithi046 ceph-mon[29647]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-19T18:59:39.433 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:39 smithi046 ceph-mon[29647]: Cluster is now healthy 2024-02-19T18:59:39.433 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:39 smithi046 ceph-mon[29647]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:active 2024-02-19T18:59:39.433 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:39 smithi046 ceph-mon[29647]: fsmap cephfs:2 {0=cephfs.smithi046.bwvkwa=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:39.433 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:39 smithi046 ceph-mon[29647]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 716 B/s rd, 1.5 KiB/s wr, 7 op/s 2024-02-19T18:59:39.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:39 smithi142 ceph-mon[37169]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-19T18:59:39.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:39 smithi142 ceph-mon[37169]: Cluster is now healthy 2024-02-19T18:59:39.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:39 smithi142 ceph-mon[37169]: mds.? [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] up:active 2024-02-19T18:59:39.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:39 smithi142 ceph-mon[37169]: fsmap cephfs:2 {0=cephfs.smithi046.bwvkwa=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T18:59:39.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:39 smithi142 ceph-mon[37169]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 716 B/s rd, 1.5 KiB/s wr, 7 op/s 2024-02-19T18:59:40.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.085+0000 7f9a3f520700 1 -- 172.21.15.46:0/2987597128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a38069270 msgr2=0x7f9a38102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:40.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.085+0000 7f9a3f520700 1 --2- 172.21.15.46:0/2987597128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a38069270 0x7f9a38102dd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009910 tx=0x7f9a34009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:40.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.085+0000 7f9a3f520700 1 -- 172.21.15.46:0/2987597128 shutdown_connections 2024-02-19T18:59:40.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.085+0000 7f9a3f520700 1 --2- 172.21.15.46:0/2987597128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38103310 0x7f9a38105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:40.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.085+0000 7f9a3f520700 1 --2- 172.21.15.46:0/2987597128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a38069270 0x7f9a38102dd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:40.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.085+0000 7f9a3f520700 1 -- 172.21.15.46:0/2987597128 >> 172.21.15.46:0/2987597128 conn(0x7f9a380fa780 msgr2=0x7f9a380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:40.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.085+0000 7f9a3f520700 1 -- 172.21.15.46:0/2987597128 shutdown_connections 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.085+0000 7f9a3f520700 1 -- 172.21.15.46:0/2987597128 wait complete. 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.085+0000 7f9a3f520700 1 Processor -- start 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3f520700 1 -- start start 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3f520700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38103310 0x7f9a38195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3f520700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a38196000 0x7f9a3819b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3f520700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a38196500 con 0x7f9a38196000 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3f520700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a38196670 con 0x7f9a38103310 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3cabb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a38196000 0x7f9a3819b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3cabb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a38196000 0x7f9a3819b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51942/0 (socket says 172.21.15.46:51942) 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3cabb700 1 -- 172.21.15.46:0/2008633171 learned_addr learned my addr 172.21.15.46:0/2008633171 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3d2bc700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38103310 0x7f9a38195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3cabb700 1 -- 172.21.15.46:0/2008633171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38103310 msgr2=0x7f9a38195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3cabb700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38103310 0x7f9a38195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:40.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3cabb700 1 -- 172.21.15.46:0/2008633171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a340095f0 con 0x7f9a38196000 2024-02-19T18:59:40.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3cabb700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a38196000 0x7f9a3819b070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d8d0 tx=0x7f9a2800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:40.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a2e7fc700 1 -- 172.21.15.46:0/2008633171 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a280098a0 con 0x7f9a38196000 2024-02-19T18:59:40.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a2e7fc700 1 -- 172.21.15.46:0/2008633171 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9a28010460 con 0x7f9a38196000 2024-02-19T18:59:40.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a3f520700 1 -- 172.21.15.46:0/2008633171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3819b610 con 0x7f9a38196000 2024-02-19T18:59:40.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.086+0000 7f9a2e7fc700 1 -- 172.21.15.46:0/2008633171 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2800f5f0 con 0x7f9a38196000 2024-02-19T18:59:40.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.087+0000 7f9a3f520700 1 -- 172.21.15.46:0/2008633171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3819bb30 con 0x7f9a38196000 2024-02-19T18:59:40.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.088+0000 7f9a3f520700 1 -- 172.21.15.46:0/2008633171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3818fbd0 con 0x7f9a38196000 2024-02-19T18:59:40.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.089+0000 7f9a2e7fc700 1 -- 172.21.15.46:0/2008633171 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f9a28009a00 con 0x7f9a38196000 2024-02-19T18:59:40.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.089+0000 7f9a2e7fc700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9a2406c680 0x7f9a2406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:40.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.089+0000 7f9a2e7fc700 1 -- 172.21.15.46:0/2008633171 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9a2808b870 con 0x7f9a38196000 2024-02-19T18:59:40.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.089+0000 7f9a3d2bc700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9a2406c680 0x7f9a2406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:40.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.090+0000 7f9a3d2bc700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9a2406c680 0x7f9a2406eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9a34006010 tx=0x7f9a3400b540 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:40.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.093+0000 7f9a2e7fc700 1 -- 172.21.15.46:0/2008633171 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9a28059a10 con 0x7f9a38196000 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.362+0000 7f9a3f520700 1 -- 172.21.15.46:0/2008633171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9a38069480 con 0x7f9a38196000 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.362+0000 7f9a2e7fc700 1 -- 172.21.15.46:0/2008633171 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f9a28020740 con 0x7f9a38196000 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stdout:e17 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 17 2024-02-19T18:59:40.381 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T18:59:38.092640+0000 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T18:59:40.382 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:59:40.383 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T18:59:40.384 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:59:40.384 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T18:59:40.384 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.364+0000 7f9a3f520700 1 -- 172.21.15.46:0/2008633171 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9a2406c680 msgr2=0x7f9a2406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.364+0000 7f9a3f520700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9a2406c680 0x7f9a2406eb30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9a34006010 tx=0x7f9a3400b540 comp rx=0 tx=0).stop 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.364+0000 7f9a3f520700 1 -- 172.21.15.46:0/2008633171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a38196000 msgr2=0x7f9a3819b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.364+0000 7f9a3f520700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a38196000 0x7f9a3819b070 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d8d0 tx=0x7f9a2800dbe0 comp rx=0 tx=0).stop 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.364+0000 7f9a3f520700 1 -- 172.21.15.46:0/2008633171 shutdown_connections 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.364+0000 7f9a3f520700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f9a2406c680 0x7f9a2406eb30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.364+0000 7f9a3f520700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a38103310 0x7f9a38195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.364+0000 7f9a3f520700 1 --2- 172.21.15.46:0/2008633171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a38196000 0x7f9a3819b070 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.364+0000 7f9a3f520700 1 -- 172.21.15.46:0/2008633171 >> 172.21.15.46:0/2008633171 conn(0x7f9a380fa780 msgr2=0x7f9a380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.365+0000 7f9a3f520700 1 -- 172.21.15.46:0/2008633171 shutdown_connections 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:40.365+0000 7f9a3f520700 1 -- 172.21.15.46:0/2008633171 wait complete. 2024-02-19T18:59:40.385 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T18:59:40.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-19T18:59:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:41.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:41 smithi046 ceph-mon[29647]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-19T18:59:41.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:41 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:41.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:41 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:41.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:41 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:41.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:41 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:41.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:41 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:41.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:41 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2008633171' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T18:59:41.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:41 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:41.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:41 smithi142 ceph-mon[37169]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-19T18:59:41.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:41 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:41.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:41 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:41.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:41 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:41.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:41 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:41.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:41 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:41.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:41 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2008633171' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T18:59:41.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:41 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:43.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 -- 172.21.15.46:0/833417669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2081003f0 msgr2=0x7ff208100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:43.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 --2- 172.21.15.46:0/833417669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2081003f0 0x7ff208100860 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009910 tx=0x7ff1f8009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:43.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 -- 172.21.15.46:0/833417669 shutdown_connections 2024-02-19T18:59:43.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 --2- 172.21.15.46:0/833417669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2081003f0 0x7ff208100860 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:43.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 --2- 172.21.15.46:0/833417669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2080ff150 0x7ff2080ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:43.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 -- 172.21.15.46:0/833417669 >> 172.21.15.46:0/833417669 conn(0x7ff2080fa7a0 msgr2=0x7ff2080fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:43.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 -- 172.21.15.46:0/833417669 shutdown_connections 2024-02-19T18:59:43.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 -- 172.21.15.46:0/833417669 wait complete. 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 Processor -- start 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 -- start start 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2080ff150 0x7ff208103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2081003f0 0x7ff2081017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff208101d10 con 0x7ff2081003f0 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.423+0000 7ff20ffe2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff208101e50 con 0x7ff2080ff150 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff20d57d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2081003f0 0x7ff2081017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff20d57d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2081003f0 0x7ff2081017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51964/0 (socket says 172.21.15.46:51964) 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff20d57d700 1 -- 172.21.15.46:0/283706434 learned_addr learned my addr 172.21.15.46:0/283706434 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff20dd7e700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2080ff150 0x7ff208103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:43.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff20d57d700 1 -- 172.21.15.46:0/283706434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2080ff150 msgr2=0x7ff208103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:43.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff20d57d700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2080ff150 0x7ff208103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:43.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff20d57d700 1 -- 172.21.15.46:0/283706434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f80095f0 con 0x7ff2081003f0 2024-02-19T18:59:43.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff20d57d700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2081003f0 0x7ff2081017d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8006010 tx=0x7ff1f800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:43.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff1feffd700 1 -- 172.21.15.46:0/283706434 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1f801d070 con 0x7ff2081003f0 2024-02-19T18:59:43.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff1feffd700 1 -- 172.21.15.46:0/283706434 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff1f800f460 con 0x7ff2081003f0 2024-02-19T18:59:43.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff20ffe2700 1 -- 172.21.15.46:0/283706434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2081020d0 con 0x7ff2081003f0 2024-02-19T18:59:43.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff1feffd700 1 -- 172.21.15.46:0/283706434 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1f8021640 con 0x7ff2081003f0 2024-02-19T18:59:43.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.424+0000 7ff20ffe2700 1 -- 172.21.15.46:0/283706434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2081025c0 con 0x7ff2081003f0 2024-02-19T18:59:43.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.425+0000 7ff20ffe2700 1 -- 172.21.15.46:0/283706434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff208068ab0 con 0x7ff2081003f0 2024-02-19T18:59:43.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.426+0000 7ff1feffd700 1 -- 172.21.15.46:0/283706434 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff1f800fab0 con 0x7ff2081003f0 2024-02-19T18:59:43.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.426+0000 7ff1feffd700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7ff1f406c680 0x7ff1f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:43.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.426+0000 7ff20dd7e700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7ff1f406c680 0x7ff1f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:43.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.426+0000 7ff1feffd700 1 -- 172.21.15.46:0/283706434 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff1f808cb30 con 0x7ff2081003f0 2024-02-19T18:59:43.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.427+0000 7ff20dd7e700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7ff1f406c680 0x7ff1f406eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff204005950 tx=0x7ff20400b410 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:43.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.431+0000 7ff1feffd700 1 -- 172.21.15.46:0/283706434 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff1f805ac40 con 0x7ff2081003f0 2024-02-19T18:59:43.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:43 smithi046 ceph-mon[29647]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-19T18:59:43.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:43.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:43 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:43.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.679+0000 7ff20ffe2700 1 -- 172.21.15.46:0/283706434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff20819e2c0 con 0x7ff2081003f0 2024-02-19T18:59:43.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.680+0000 7ff1feffd700 1 -- 172.21.15.46:0/283706434 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4757 (secure 0 0 0) 0x7ff1f805a7d0 con 0x7ff2081003f0 2024-02-19T18:59:43.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:43 smithi142 ceph-mon[37169]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-19T18:59:43.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:43 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:43.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:43 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:43.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 -- 172.21.15.46:0/283706434 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7ff1f406c680 msgr2=0x7ff1f406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:43.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7ff1f406c680 0x7ff1f406eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff204005950 tx=0x7ff20400b410 comp rx=0 tx=0).stop 2024-02-19T18:59:43.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 -- 172.21.15.46:0/283706434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2081003f0 msgr2=0x7ff2081017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2081003f0 0x7ff2081017d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8006010 tx=0x7ff1f800bd70 comp rx=0 tx=0).stop 2024-02-19T18:59:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 -- 172.21.15.46:0/283706434 shutdown_connections 2024-02-19T18:59:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7ff1f406c680 0x7ff1f406eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2080ff150 0x7ff208103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 --2- 172.21.15.46:0/283706434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2081003f0 0x7ff2081017d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 -- 172.21.15.46:0/283706434 >> 172.21.15.46:0/283706434 conn(0x7ff2080fa7a0 msgr2=0x7ff208068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:43.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 -- 172.21.15.46:0/283706434 shutdown_connections 2024-02-19T18:59:43.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:43.682+0000 7ff20ffe2700 1 -- 172.21.15.46:0/283706434 wait complete. 2024-02-19T18:59:43.702 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T18:59:43.712 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T18:59:44.397 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:44 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/283706434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T18:59:44.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-19T18:59:44.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:44 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/283706434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T18:59:44.847 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:45.598 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:45 smithi046 ceph-mon[29647]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-02-19T18:59:45.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:45 smithi142 ceph-mon[37169]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-02-19T18:59:47.480 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:47 smithi046 ceph-mon[29647]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-19T18:59:47.480 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:47 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.565+0000 7fab35abd700 1 -- 172.21.15.46:0/1427277543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab30100240 msgr2=0x7fab30100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.565+0000 7fab35abd700 1 --2- 172.21.15.46:0/1427277543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab30100240 0x7fab30100650 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fab20009910 tx=0x7fab20009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.565+0000 7fab35abd700 1 -- 172.21.15.46:0/1427277543 shutdown_connections 2024-02-19T18:59:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.565+0000 7fab35abd700 1 --2- 172.21.15.46:0/1427277543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab30101440 0x7fab30101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.565+0000 7fab35abd700 1 --2- 172.21.15.46:0/1427277543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab30100240 0x7fab30100650 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.565+0000 7fab35abd700 1 -- 172.21.15.46:0/1427277543 >> 172.21.15.46:0/1427277543 conn(0x7fab300fb7f0 msgr2=0x7fab300fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.565+0000 7fab35abd700 1 -- 172.21.15.46:0/1427277543 shutdown_connections 2024-02-19T18:59:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.565+0000 7fab35abd700 1 -- 172.21.15.46:0/1427277543 wait complete. 2024-02-19T18:59:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.566+0000 7fab35abd700 1 Processor -- start 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.566+0000 7fab35abd700 1 -- start start 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.566+0000 7fab35abd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab30100240 0x7fab30074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.566+0000 7fab35abd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab30101440 0x7fab30073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.566+0000 7fab35abd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab30073680 con 0x7fab30101440 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.566+0000 7fab35abd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab300737c0 con 0x7fab30100240 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.566+0000 7fab2effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab30101440 0x7fab30073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.566+0000 7fab2effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab30101440 0x7fab30073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59970/0 (socket says 172.21.15.46:59970) 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.566+0000 7fab2effd700 1 -- 172.21.15.46:0/3023517701 learned_addr learned my addr 172.21.15.46:0/3023517701 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.566+0000 7fab2f7fe700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab30100240 0x7fab30074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.567+0000 7fab2effd700 1 -- 172.21.15.46:0/3023517701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab30100240 msgr2=0x7fab30074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.567+0000 7fab2effd700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab30100240 0x7fab30074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.567+0000 7fab2effd700 1 -- 172.21.15.46:0/3023517701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200095f0 con 0x7fab30101440 2024-02-19T18:59:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.567+0000 7fab2effd700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab30101440 0x7fab30073140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab2400d8d0 tx=0x7fab2400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.567+0000 7fab2cff9700 1 -- 172.21.15.46:0/3023517701 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab240098a0 con 0x7fab30101440 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.567+0000 7fab35abd700 1 -- 172.21.15.46:0/3023517701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab30073aa0 con 0x7fab30101440 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.567+0000 7fab2cff9700 1 -- 172.21.15.46:0/3023517701 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab24010460 con 0x7fab30101440 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.567+0000 7fab2cff9700 1 -- 172.21.15.46:0/3023517701 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab2400f5f0 con 0x7fab30101440 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.567+0000 7fab35abd700 1 -- 172.21.15.46:0/3023517701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3019db30 con 0x7fab30101440 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.568+0000 7fab35abd700 1 -- 172.21.15.46:0/3023517701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab30108d90 con 0x7fab30101440 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.569+0000 7fab2cff9700 1 -- 172.21.15.46:0/3023517701 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fab24009a00 con 0x7fab30101440 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.569+0000 7fab2cff9700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fab1806c680 0x7fab1806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.569+0000 7fab2cff9700 1 -- 172.21.15.46:0/3023517701 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fab2408b6e0 con 0x7fab30101440 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.569+0000 7fab2f7fe700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fab1806c680 0x7fab1806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.570+0000 7fab2f7fe700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fab1806c680 0x7fab1806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fab20006010 tx=0x7fab20005ec0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:47.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.574+0000 7fab2cff9700 1 -- 172.21.15.46:0/3023517701 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fab24059870 con 0x7fab30101440 2024-02-19T18:59:47.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:47 smithi142 ceph-mon[37169]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-19T18:59:47.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:47 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:47.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.880+0000 7fab35abd700 1 -- 172.21.15.46:0/3023517701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fab30108f50 con 0x7fab30101440 2024-02-19T18:59:47.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.880+0000 7fab2cff9700 1 -- 172.21.15.46:0/3023517701 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v17) v1 ==== 78+0+83 (secure 0 0 0) 0x7fab24059400 con 0x7fab30101440 2024-02-19T18:59:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.882+0000 7fab35abd700 1 -- 172.21.15.46:0/3023517701 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fab1806c680 msgr2=0x7fab1806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.882+0000 7fab35abd700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fab1806c680 0x7fab1806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fab20006010 tx=0x7fab20005ec0 comp rx=0 tx=0).stop 2024-02-19T18:59:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.882+0000 7fab35abd700 1 -- 172.21.15.46:0/3023517701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab30101440 msgr2=0x7fab30073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.882+0000 7fab35abd700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab30101440 0x7fab30073140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab2400d8d0 tx=0x7fab2400dbe0 comp rx=0 tx=0).stop 2024-02-19T18:59:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.882+0000 7fab35abd700 1 -- 172.21.15.46:0/3023517701 shutdown_connections 2024-02-19T18:59:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.882+0000 7fab35abd700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fab1806c680 0x7fab1806eb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.882+0000 7fab35abd700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab30100240 0x7fab30074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.882+0000 7fab35abd700 1 --2- 172.21.15.46:0/3023517701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab30101440 0x7fab30073140 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.882+0000 7fab35abd700 1 -- 172.21.15.46:0/3023517701 >> 172.21.15.46:0/3023517701 conn(0x7fab300fb7f0 msgr2=0x7fab30104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.883+0000 7fab35abd700 1 -- 172.21.15.46:0/3023517701 shutdown_connections 2024-02-19T18:59:47.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:47.883+0000 7fab35abd700 1 -- 172.21.15.46:0/3023517701 wait complete. 2024-02-19T18:59:47.912 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T18:59:48.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:48 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3023517701' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-19T18:59:48.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:48 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/3023517701' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-19T18:59:48.852 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-19T18:59:48.864 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T18:59:48.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.972+0000 7f276a1d0640 1 -- 172.21.15.46:0/885175058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27640ff670 msgr2=0x7f27640ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:48.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.972+0000 7f276a1d0640 1 --2- 172.21.15.46:0/885175058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27640ff670 0x7f27640ffa80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2754009880 tx=0x7f275402bce0 comp rx=0 tx=0).stop 2024-02-19T18:59:48.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.972+0000 7f276a1d0640 1 -- 172.21.15.46:0/885175058 shutdown_connections 2024-02-19T18:59:48.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.972+0000 7f276a1d0640 1 --2- 172.21.15.46:0/885175058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2764100860 0x7f2764100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:48.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.972+0000 7f276a1d0640 1 --2- 172.21.15.46:0/885175058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27640ff670 0x7f27640ffa80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:48.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.972+0000 7f276a1d0640 1 -- 172.21.15.46:0/885175058 >> 172.21.15.46:0/885175058 conn(0x7f27640fabd0 msgr2=0x7f27640fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:48.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.973+0000 7f276a1d0640 1 -- 172.21.15.46:0/885175058 shutdown_connections 2024-02-19T18:59:48.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.973+0000 7f276a1d0640 1 -- 172.21.15.46:0/885175058 wait complete. 2024-02-19T18:59:48.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.973+0000 7f276a1d0640 1 Processor -- start 2024-02-19T18:59:48.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.973+0000 7f276a1d0640 1 -- start start 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.973+0000 7f276a1d0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27640ff670 0x7f2764074010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.973+0000 7f276a1d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2764100860 0x7f2764072650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.973+0000 7f276a1d0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2764072b90 con 0x7f2764100860 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.973+0000 7f276a1d0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2764072d00 con 0x7f27640ff670 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f2762ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2764100860 0x7f2764072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f2762ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2764100860 0x7f2764072650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59990/0 (socket says 172.21.15.46:59990) 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f2762ffd640 1 -- 172.21.15.46:0/211847812 learned_addr learned my addr 172.21.15.46:0/211847812 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f27637fe640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27640ff670 0x7f2764074010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f2762ffd640 1 -- 172.21.15.46:0/211847812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27640ff670 msgr2=0x7f2764074010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f2762ffd640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27640ff670 0x7f2764074010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f2762ffd640 1 -- 172.21.15.46:0/211847812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2754009560 con 0x7f2764100860 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f2762ffd640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2764100860 0x7f2764072650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f275800d8d0 tx=0x7f275800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f2760ff9640 1 -- 172.21.15.46:0/211847812 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2758009c00 con 0x7f2764100860 2024-02-19T18:59:48.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f276a1d0640 1 -- 172.21.15.46:0/211847812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2764072fe0 con 0x7f2764100860 2024-02-19T18:59:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f2760ff9640 1 -- 172.21.15.46:0/211847812 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f27580044d0 con 0x7f2764100860 2024-02-19T18:59:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f2760ff9640 1 -- 172.21.15.46:0/211847812 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27580049d0 con 0x7f2764100860 2024-02-19T18:59:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.974+0000 7f276a1d0640 1 -- 172.21.15.46:0/211847812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276419cf10 con 0x7f2764100860 2024-02-19T18:59:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.975+0000 7f276a1d0640 1 -- 172.21.15.46:0/211847812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2764108230 con 0x7f2764100860 2024-02-19T18:59:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.976+0000 7f2760ff9640 1 -- 172.21.15.46:0/211847812 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2758004c40 con 0x7f2764100860 2024-02-19T18:59:48.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.976+0000 7f2760ff9640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f274c06c6b0 0x7f274c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:48.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.977+0000 7f2760ff9640 1 -- 172.21.15.46:0/211847812 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f275808b640 con 0x7f2764100860 2024-02-19T18:59:48.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.977+0000 7f27637fe640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f274c06c6b0 0x7f274c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:48.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.977+0000 7f27637fe640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f274c06c6b0 0x7f274c06eb60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2754006010 tx=0x7f2754000bc0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:48.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:48.981+0000 7f2760ff9640 1 -- 172.21.15.46:0/211847812 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2758055cc0 con 0x7f2764100860 2024-02-19T18:59:49.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.164+0000 7f276a1d0640 1 -- 172.21.15.46:0/211847812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2764108440 con 0x7f2764100860 2024-02-19T18:59:49.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.165+0000 7f2760ff9640 1 -- 172.21.15.46:0/211847812 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15141 (secure 0 0 0) 0x7f27580592e0 con 0x7f2764100860 2024-02-19T18:59:49.184 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:59:49.184 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":46,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","created":"2024-02-19T18:51:43.710287+0000","modified":"2024-02-19T18:59:34.073513+0000","last_up_change":"2024-02-19T18:58:03.323987+0000","last_in_change":"2024-02-19T18:57:44.164228+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:56:48.450849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-19T18:59:17.631025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-19T18:59:18.491487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ea35c0-be56-4830-9abc-c67aa3feed47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6803","nonce":3909364861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6805","nonce":3909364861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6809","nonce":3909364861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3909364861},{"type":"v1","addr":"172.21.15.46:6807","nonce":3909364861}]},"public_addr":"172.21.15.46:6803/3909364861","cluster_addr":"172.21.15.46:6805/3909364861","heartbeat_back_addr":"172.21.15.46:6809/3909364861","heartbeat_front_addr":"172.21.15.46:6807/3909364861","state":["exists","up"]},{"osd":1,"uuid":"0dcb0202-8fa1-4a72-939d-dd8a5ced3a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6811","nonce":1824596762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6813","nonce":1824596762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6817","nonce":1824596762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":1824596762},{"type":"v1","addr":"172.21.15.46:6815","nonce":1824596762}]},"public_addr":"172.21.15.46:6811/1824596762","cluster_addr":"172.21.15.46:6813/1824596762","heartbeat_back_addr":"172.21.15.46:6817/1824596762","heartbeat_front_addr":"172.21.15.46:6815/1824596762","state":["exists","up"]},{"osd":2,"uuid":"a5ae09b3-9419-4fc7-8cd5-4a2553bca213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6819","nonce":3246046723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6821","nonce":3246046723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6825","nonce":3246046723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3246046723},{"type":"v1","addr":"172.21.15.46:6823","nonce":3246046723}]},"public_addr":"172.21.15.46:6819/3246046723","cluster_addr":"172.21.15.46:6821/3246046723","heartbeat_back_addr":"172.21.15.46:6825/3246046723","heartbeat_front_addr":"172.21.15.46:6823/3246046723","state":["exists","up"]},{"osd":3,"uuid":"3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6801","nonce":3699833248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6803","nonce":3699833248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6807","nonce":3699833248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3699833248},{"type":"v1","addr":"172.21.15.142:6805","nonce":3699833248}]},"public_addr":"172.21.15.142:6801/3699833248","cluster_addr":"172.21.15.142:6803/3699833248","heartbeat_back_addr":"172.21.15.142:6807/3699833248","heartbeat_front_addr":"172.21.15.142:6805/3699833248","state":["exists","up"]},{"osd":4,"uuid":"0a0ce92a-f9ac-4f83-877f-93eff87a9f8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6809","nonce":2523325445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6811","nonce":2523325445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6815","nonce":2523325445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2523325445},{"type":"v1","addr":"172.21.15.142:6813","nonce":2523325445}]},"public_addr":"172.21.15.142:6809/2523325445","cluster_addr":"172.21.15.142:6811/2523325445","heartbeat_back_addr":"172.21.15.142:6815/2523325445","heartbeat_front_addr":"172.21.15.142:6813/2523325445","state":["exists","up"]},{"osd":5,"uuid":"0eed1f5c-a999-43d8-95ae-1671ac54640b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6817","nonce":4119018815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6819","nonce":4119018815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6823","nonce":4119018815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":4119018815},{"type":"v1","addr":"172.21.15.142:6821","nonce":4119018815}]},"public_addr":"172.21.15.142:6817/4119018815","cluster_addr":"172.21.15.142:6819/4119018815","heartbeat_back_addr":"172.21.15.142:6823/4119018815","heartbeat_front_addr":"172.21.15.142:6821/4119018815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:55:49.856210+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:17.120054+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:46.102265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:10.285252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:35.715008+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:01.554947+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6827/908936119":"2024-02-20T18:59:34.073482+0000","172.21.15.46:0/3268130132":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/1953665533":"2024-02-20T18:52:11.766897+0000","172.21.15.46:6801/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/2407750441":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/2954390908":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/4057722486":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6800/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6800/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6801/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/3708201410":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/3901080352":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6800/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/1307799669":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6826/908936119":"2024-02-20T18:59:34.073482+0000","172.21.15.46:0/664839364":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6801/3727775990":"2024-02-20T18:54:32.109212+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T18:59:49.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 -- 172.21.15.46:0/211847812 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f274c06c6b0 msgr2=0x7f274c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f274c06c6b0 0x7f274c06eb60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2754006010 tx=0x7f2754000bc0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 -- 172.21.15.46:0/211847812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2764100860 msgr2=0x7f2764072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2764100860 0x7f2764072650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f275800d8d0 tx=0x7f275800dd90 comp rx=0 tx=0).stop 2024-02-19T18:59:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 -- 172.21.15.46:0/211847812 shutdown_connections 2024-02-19T18:59:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f274c06c6b0 0x7f274c06eb60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2764100860 0x7f2764072650 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 --2- 172.21.15.46:0/211847812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27640ff670 0x7f2764074010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 -- 172.21.15.46:0/211847812 >> 172.21.15.46:0/211847812 conn(0x7f27640fabd0 msgr2=0x7f2764103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 -- 172.21.15.46:0/211847812 shutdown_connections 2024-02-19T18:59:49.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.168+0000 7f276a1d0640 1 -- 172.21.15.46:0/211847812 wait complete. 2024-02-19T18:59:49.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T18:56:48.450849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-19T18:59:17.631025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-19T18:59:18.491487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T18:59:49.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T18:59:49.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.286+0000 7f4eca5b1640 1 -- 172.21.15.46:0/2008201931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ec4100840 msgr2=0x7f4ec4100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.286+0000 7f4eca5b1640 1 --2- 172.21.15.46:0/2008201931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ec4100840 0x7f4ec4100cb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009880 tx=0x7f4eb402bce0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.286+0000 7f4eca5b1640 1 -- 172.21.15.46:0/2008201931 shutdown_connections 2024-02-19T18:59:49.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.286+0000 7f4eca5b1640 1 --2- 172.21.15.46:0/2008201931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ec4100840 0x7f4ec4100cb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.286+0000 7f4eca5b1640 1 --2- 172.21.15.46:0/2008201931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec40ff650 0x7f4ec40ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.286+0000 7f4eca5b1640 1 -- 172.21.15.46:0/2008201931 >> 172.21.15.46:0/2008201931 conn(0x7f4ec40fabd0 msgr2=0x7f4ec40fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:49.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.286+0000 7f4eca5b1640 1 -- 172.21.15.46:0/2008201931 shutdown_connections 2024-02-19T18:59:49.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.286+0000 7f4eca5b1640 1 -- 172.21.15.46:0/2008201931 wait complete. 2024-02-19T18:59:49.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.286+0000 7f4eca5b1640 1 Processor -- start 2024-02-19T18:59:49.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.286+0000 7f4eca5b1640 1 -- start start 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4eca5b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ec40ff650 0x7f4ec4194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4eca5b1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec4100840 0x7f4ec4195500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4eca5b1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec4195ad0 con 0x7f4ec40ff650 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4eca5b1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec4195c40 con 0x7f4ec4100840 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ec40ff650 0x7f4ec4194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ec40ff650 0x7f4ec4194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60002/0 (socket says 172.21.15.46:60002) 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec3fff640 1 -- 172.21.15.46:0/1753861999 learned_addr learned my addr 172.21.15.46:0/1753861999 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec37fe640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec4100840 0x7f4ec4195500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec3fff640 1 -- 172.21.15.46:0/1753861999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec4100840 msgr2=0x7f4ec4195500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec3fff640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec4100840 0x7f4ec4195500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec3fff640 1 -- 172.21.15.46:0/1753861999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb4009560 con 0x7f4ec40ff650 2024-02-19T18:59:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec3fff640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ec40ff650 0x7f4ec4194fc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00b3d0 tx=0x7f4eac00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec17fa640 1 -- 172.21.15.46:0/1753861999 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eac011800 con 0x7f4ec40ff650 2024-02-19T18:59:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4eca5b1640 1 -- 172.21.15.46:0/1753861999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec419a6d0 con 0x7f4ec40ff650 2024-02-19T18:59:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec17fa640 1 -- 172.21.15.46:0/1753861999 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4eac011e10 con 0x7f4ec40ff650 2024-02-19T18:59:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4ec17fa640 1 -- 172.21.15.46:0/1753861999 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eac00f510 con 0x7f4ec40ff650 2024-02-19T18:59:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.287+0000 7f4eca5b1640 1 -- 172.21.15.46:0/1753861999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec419ac80 con 0x7f4ec40ff650 2024-02-19T18:59:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.288+0000 7f4eca5b1640 1 -- 172.21.15.46:0/1753861999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec41082b0 con 0x7f4ec40ff650 2024-02-19T18:59:49.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.289+0000 7f4ec17fa640 1 -- 172.21.15.46:0/1753861999 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4eac010380 con 0x7f4ec40ff650 2024-02-19T18:59:49.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.289+0000 7f4ec17fa640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4eb006c640 0x7f4eb006eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:49.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.289+0000 7f4ec17fa640 1 -- 172.21.15.46:0/1753861999 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4eac08b660 con 0x7f4ec40ff650 2024-02-19T18:59:49.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.289+0000 7f4ec37fe640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4eb006c640 0x7f4eb006eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:49.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.290+0000 7f4ec37fe640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4eb006c640 0x7f4eb006eaf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4006010 tx=0x7f4eb4005d70 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:49.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.294+0000 7f4ec17fa640 1 -- 172.21.15.46:0/1753861999 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4eac055c40 con 0x7f4ec40ff650 2024-02-19T18:59:49.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.467+0000 7f4eca5b1640 1 -- 172.21.15.46:0/1753861999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ec419af00 con 0x7f4ec40ff650 2024-02-19T18:59:49.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.467+0000 7f4ec17fa640 1 -- 172.21.15.46:0/1753861999 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4eac059260 con 0x7f4ec40ff650 2024-02-19T18:59:49.486 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T18:59:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 -- 172.21.15.46:0/1753861999 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4eb006c640 msgr2=0x7f4eb006eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4eb006c640 0x7f4eb006eaf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4006010 tx=0x7f4eb4005d70 comp rx=0 tx=0).stop 2024-02-19T18:59:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 -- 172.21.15.46:0/1753861999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ec40ff650 msgr2=0x7f4ec4194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ec40ff650 0x7f4ec4194fc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00b3d0 tx=0x7f4eac00b890 comp rx=0 tx=0).stop 2024-02-19T18:59:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 -- 172.21.15.46:0/1753861999 shutdown_connections 2024-02-19T18:59:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f4eb006c640 0x7f4eb006eaf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec4100840 0x7f4ec4195500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 --2- 172.21.15.46:0/1753861999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ec40ff650 0x7f4ec4194fc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 -- 172.21.15.46:0/1753861999 >> 172.21.15.46:0/1753861999 conn(0x7f4ec40fabd0 msgr2=0x7f4ec4103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 -- 172.21.15.46:0/1753861999 shutdown_connections 2024-02-19T18:59:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.469+0000 7f4eca5b1640 1 -- 172.21.15.46:0/1753861999 wait complete. 2024-02-19T18:59:49.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:49 smithi046 ceph-mon[29647]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-19T18:59:49.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:49 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:49.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:49 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/211847812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T18:59:49.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:49 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:49.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:49 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:49.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:49 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:49.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:49 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:49.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-19T18:59:49.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.585+0000 7fd112a8b640 1 -- 172.21.15.46:0/4243617345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd10c100840 msgr2=0x7fd10c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.585+0000 7fd112a8b640 1 --2- 172.21.15.46:0/4243617345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd10c100840 0x7fd10c100cb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009880 tx=0x7fd0f802bce0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.585+0000 7fd112a8b640 1 -- 172.21.15.46:0/4243617345 shutdown_connections 2024-02-19T18:59:49.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.585+0000 7fd112a8b640 1 --2- 172.21.15.46:0/4243617345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd10c100840 0x7fd10c100cb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.585+0000 7fd112a8b640 1 --2- 172.21.15.46:0/4243617345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd10c0ff650 0x7fd10c0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.585+0000 7fd112a8b640 1 -- 172.21.15.46:0/4243617345 >> 172.21.15.46:0/4243617345 conn(0x7fd10c0fabd0 msgr2=0x7fd10c0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.585+0000 7fd112a8b640 1 -- 172.21.15.46:0/4243617345 shutdown_connections 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.585+0000 7fd112a8b640 1 -- 172.21.15.46:0/4243617345 wait complete. 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd112a8b640 1 Processor -- start 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd112a8b640 1 -- start start 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd112a8b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd10c0ff650 0x7fd10c194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd112a8b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd10c100840 0x7fd10c195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd112a8b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c195a60 con 0x7fd10c100840 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd112a8b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c195bd0 con 0x7fd10c0ff650 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd10bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd10c100840 0x7fd10c195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd10bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd10c100840 0x7fd10c195490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60034/0 (socket says 172.21.15.46:60034) 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd10bfff640 1 -- 172.21.15.46:0/4191714617 learned_addr learned my addr 172.21.15.46:0/4191714617 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd10bfff640 1 -- 172.21.15.46:0/4191714617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd10c0ff650 msgr2=0x7fd10c194f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd10bfff640 1 --2- 172.21.15.46:0/4191714617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd10c0ff650 0x7fd10c194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd10bfff640 1 -- 172.21.15.46:0/4191714617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8009560 con 0x7fd10c100840 2024-02-19T18:59:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd10bfff640 1 --2- 172.21.15.46:0/4191714617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd10c100840 0x7fd10c195490 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009230 tx=0x7fd0f8004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd109ffb640 1 -- 172.21.15.46:0/4191714617 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f8004520 con 0x7fd10c100840 2024-02-19T18:59:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd112a8b640 1 -- 172.21.15.46:0/4191714617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c19a600 con 0x7fd10c100840 2024-02-19T18:59:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd109ffb640 1 -- 172.21.15.46:0/4191714617 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd0f80054b0 con 0x7fd10c100840 2024-02-19T18:59:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.586+0000 7fd109ffb640 1 -- 172.21.15.46:0/4191714617 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f8034670 con 0x7fd10c100840 2024-02-19T18:59:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.587+0000 7fd112a8b640 1 -- 172.21.15.46:0/4191714617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c19ab00 con 0x7fd10c100840 2024-02-19T18:59:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.587+0000 7fd112a8b640 1 -- 172.21.15.46:0/4191714617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c108390 con 0x7fd10c100840 2024-02-19T18:59:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.588+0000 7fd109ffb640 1 -- 172.21.15.46:0/4191714617 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd0f80038b0 con 0x7fd10c100840 2024-02-19T18:59:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.588+0000 7fd109ffb640 1 --2- 172.21.15.46:0/4191714617 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd0fc06c5f0 0x7fd0fc06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:49.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.588+0000 7fd109ffb640 1 -- 172.21.15.46:0/4191714617 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd0f80ade80 con 0x7fd10c100840 2024-02-19T18:59:49.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.589+0000 7fd110827640 1 --2- 172.21.15.46:0/4191714617 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd0fc06c5f0 0x7fd0fc06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:49.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.589+0000 7fd110827640 1 --2- 172.21.15.46:0/4191714617 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd0fc06c5f0 0x7fd0fc06eaa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd100005fd0 tx=0x7fd10000b410 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:49.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.593+0000 7fd109ffb640 1 -- 172.21.15.46:0/4191714617 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd0f8078500 con 0x7fd10c100840 2024-02-19T18:59:49.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:49 smithi142 ceph-mon[37169]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-19T18:59:49.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:49 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:49.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:49 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/211847812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T18:59:49.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:49 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:49.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:49 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:49.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:49 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:49.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:49 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T18:59:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.766+0000 7fd112a8b640 1 -- 172.21.15.46:0/4191714617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fd10c19b1c0 con 0x7fd10c100840 2024-02-19T18:59:49.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.766+0000 7fd109ffb640 1 -- 172.21.15.46:0/4191714617 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd0f8041020 con 0x7fd10c100840 2024-02-19T18:59:49.784 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 -- 172.21.15.46:0/4191714617 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd0fc06c5f0 msgr2=0x7fd0fc06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 --2- 172.21.15.46:0/4191714617 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd0fc06c5f0 0x7fd0fc06eaa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd100005fd0 tx=0x7fd10000b410 comp rx=0 tx=0).stop 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 -- 172.21.15.46:0/4191714617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd10c100840 msgr2=0x7fd10c195490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 --2- 172.21.15.46:0/4191714617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd10c100840 0x7fd10c195490 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009230 tx=0x7fd0f8004e30 comp rx=0 tx=0).stop 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 -- 172.21.15.46:0/4191714617 shutdown_connections 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 --2- 172.21.15.46:0/4191714617 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd0fc06c5f0 0x7fd0fc06eaa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 --2- 172.21.15.46:0/4191714617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd10c100840 0x7fd10c195490 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 --2- 172.21.15.46:0/4191714617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd10c0ff650 0x7fd10c194f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 -- 172.21.15.46:0/4191714617 >> 172.21.15.46:0/4191714617 conn(0x7fd10c0fabd0 msgr2=0x7fd10c103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 -- 172.21.15.46:0/4191714617 shutdown_connections 2024-02-19T18:59:49.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.768+0000 7fd112a8b640 1 -- 172.21.15.46:0/4191714617 wait complete. 2024-02-19T18:59:49.798 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-19T18:59:49.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.884+0000 7f601d215640 1 -- 172.21.15.46:0/415647871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6018102a40 msgr2=0x7f6018104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.884+0000 7f601d215640 1 --2- 172.21.15.46:0/415647871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6018102a40 0x7f6018104e20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6000009880 tx=0x7f600002bce0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.884+0000 7f601d215640 1 -- 172.21.15.46:0/415647871 shutdown_connections 2024-02-19T18:59:49.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.884+0000 7f601d215640 1 --2- 172.21.15.46:0/415647871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6018102a40 0x7f6018104e20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.884+0000 7f601d215640 1 --2- 172.21.15.46:0/415647871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6018100120 0x7f6018102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.884+0000 7f601d215640 1 -- 172.21.15.46:0/415647871 >> 172.21.15.46:0/415647871 conn(0x7f60180f9ac0 msgr2=0x7f60180fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:49.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.884+0000 7f601d215640 1 -- 172.21.15.46:0/415647871 shutdown_connections 2024-02-19T18:59:49.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.884+0000 7f601d215640 1 -- 172.21.15.46:0/415647871 wait complete. 2024-02-19T18:59:49.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.884+0000 7f601d215640 1 Processor -- start 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.884+0000 7f601d215640 1 -- start start 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f601d215640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6018100120 0x7f60180ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f601d215640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6018102a40 0x7f60180fe0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f601d215640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180fe610 con 0x7f6018100120 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f601d215640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180fe780 con 0x7f6018102a40 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f6016d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6018100120 0x7f60180ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f6016d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6018100120 0x7f60180ffa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60062/0 (socket says 172.21.15.46:60062) 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f6016d9d640 1 -- 172.21.15.46:0/4242190661 learned_addr learned my addr 172.21.15.46:0/4242190661 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f600ffff640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6018102a40 0x7f60180fe0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f6016d9d640 1 -- 172.21.15.46:0/4242190661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6018102a40 msgr2=0x7f60180fe0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f6016d9d640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6018102a40 0x7f60180fe0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f6016d9d640 1 -- 172.21.15.46:0/4242190661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6000009560 con 0x7f6018100120 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f600ffff640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6018102a40 0x7f60180fe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T18:59:49.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f6016d9d640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6018100120 0x7f60180ffa90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f600800d8d0 tx=0x7f600800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:49.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f6014d99640 1 -- 172.21.15.46:0/4242190661 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600800bea0 con 0x7f6018100120 2024-02-19T18:59:49.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f601d215640 1 -- 172.21.15.46:0/4242190661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60180fea60 con 0x7f6018100120 2024-02-19T18:59:49.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f6014d99640 1 -- 172.21.15.46:0/4242190661 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6008009c00 con 0x7f6018100120 2024-02-19T18:59:49.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f6014d99640 1 -- 172.21.15.46:0/4242190661 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600800f710 con 0x7f6018100120 2024-02-19T18:59:49.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.885+0000 7f601d215640 1 -- 172.21.15.46:0/4242190661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601819cf40 con 0x7f6018100120 2024-02-19T18:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.886+0000 7f601d215640 1 -- 172.21.15.46:0/4242190661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601818efe0 con 0x7f6018100120 2024-02-19T18:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.887+0000 7f6014d99640 1 -- 172.21.15.46:0/4242190661 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f600800f990 con 0x7f6018100120 2024-02-19T18:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.887+0000 7f6014d99640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f600406c5f0 0x7f600406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.887+0000 7f600ffff640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f600406c5f0 0x7f600406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.887+0000 7f6014d99640 1 -- 172.21.15.46:0/4242190661 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f600808b6a0 con 0x7f6018100120 2024-02-19T18:59:49.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.888+0000 7f600ffff640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f600406c5f0 0x7f600406eaa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6000036040 tx=0x7f6000000bc0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:49.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:49.892+0000 7f6014d99640 1 -- 172.21.15.46:0/4242190661 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f60080597b0 con 0x7f6018100120 2024-02-19T18:59:50.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.066+0000 7f601d215640 1 -- 172.21.15.46:0/4242190661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f60181083c0 con 0x7f6018100120 2024-02-19T18:59:50.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.066+0000 7f6014d99640 1 -- 172.21.15.46:0/4242190661 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6008059340 con 0x7f6018100120 2024-02-19T18:59:50.085 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 -- 172.21.15.46:0/4242190661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f600406c5f0 msgr2=0x7f600406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f600406c5f0 0x7f600406eaa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6000036040 tx=0x7f6000000bc0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 -- 172.21.15.46:0/4242190661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6018100120 msgr2=0x7f60180ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6018100120 0x7f60180ffa90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f600800d8d0 tx=0x7f600800dd90 comp rx=0 tx=0).stop 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 -- 172.21.15.46:0/4242190661 shutdown_connections 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f600406c5f0 0x7f600406eaa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6018102a40 0x7f60180fe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 --2- 172.21.15.46:0/4242190661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6018100120 0x7f60180ffa90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 -- 172.21.15.46:0/4242190661 >> 172.21.15.46:0/4242190661 conn(0x7f60180f9ac0 msgr2=0x7f60180fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 -- 172.21.15.46:0/4242190661 shutdown_connections 2024-02-19T18:59:50.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.068+0000 7f601d215640 1 -- 172.21.15.46:0/4242190661 wait complete. 2024-02-19T18:59:50.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T18:59:50.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.181+0000 7f6116f00640 1 -- 172.21.15.46:0/3224156747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6110100830 msgr2=0x7f6110100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:50.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.181+0000 7f6116f00640 1 --2- 172.21.15.46:0/3224156747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6110100830 0x7f6110100ca0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009880 tx=0x7f60fc02bce0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.181+0000 7f6116f00640 1 -- 172.21.15.46:0/3224156747 shutdown_connections 2024-02-19T18:59:50.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.181+0000 7f6116f00640 1 --2- 172.21.15.46:0/3224156747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6110100830 0x7f6110100ca0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.181+0000 7f6116f00640 1 --2- 172.21.15.46:0/3224156747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61100ff640 0x7f61100ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.181+0000 7f6116f00640 1 -- 172.21.15.46:0/3224156747 >> 172.21.15.46:0/3224156747 conn(0x7f61100fabc0 msgr2=0x7f61100fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.181+0000 7f6116f00640 1 -- 172.21.15.46:0/3224156747 shutdown_connections 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.181+0000 7f6116f00640 1 -- 172.21.15.46:0/3224156747 wait complete. 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.181+0000 7f6116f00640 1 Processor -- start 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.181+0000 7f6116f00640 1 -- start start 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6116f00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61100ff640 0x7f6110074010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6116f00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6110100830 0x7f6110072650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6116f00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110074550 con 0x7f61100ff640 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6116f00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110072bc0 con 0x7f6110100830 2024-02-19T18:59:50.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6114c9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61100ff640 0x7f6110074010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6114c9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61100ff640 0x7f6110074010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60082/0 (socket says 172.21.15.46:60082) 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6114c9c640 1 -- 172.21.15.46:0/194547629 learned_addr learned my addr 172.21.15.46:0/194547629 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6114c9c640 1 -- 172.21.15.46:0/194547629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6110100830 msgr2=0x7f6110072650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6114c9c640 1 --2- 172.21.15.46:0/194547629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6110100830 0x7f6110072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6114c9c640 1 -- 172.21.15.46:0/194547629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc009560 con 0x7f61100ff640 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6114c9c640 1 --2- 172.21.15.46:0/194547629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61100ff640 0x7f6110074010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f610400c8f0 tx=0x7f610400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f610dffb640 1 -- 172.21.15.46:0/194547629 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61040041f0 con 0x7f61100ff640 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f610dffb640 1 -- 172.21.15.46:0/194547629 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6104007e00 con 0x7f61100ff640 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f6116f00640 1 -- 172.21.15.46:0/194547629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6110072ea0 con 0x7f61100ff640 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.182+0000 7f610dffb640 1 -- 172.21.15.46:0/194547629 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610400f450 con 0x7f61100ff640 2024-02-19T18:59:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.183+0000 7f6116f00640 1 -- 172.21.15.46:0/194547629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6110073400 con 0x7f61100ff640 2024-02-19T18:59:50.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.183+0000 7f6116f00640 1 -- 172.21.15.46:0/194547629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6110108360 con 0x7f61100ff640 2024-02-19T18:59:50.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.184+0000 7f610dffb640 1 -- 172.21.15.46:0/194547629 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6104004350 con 0x7f61100ff640 2024-02-19T18:59:50.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.184+0000 7f610dffb640 1 --2- 172.21.15.46:0/194547629 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f610006c6b0 0x7f610006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:50.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.184+0000 7f610dffb640 1 -- 172.21.15.46:0/194547629 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6104013070 con 0x7f61100ff640 2024-02-19T18:59:50.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.184+0000 7f610ffff640 1 --2- 172.21.15.46:0/194547629 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f610006c6b0 0x7f610006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:50.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.185+0000 7f610ffff640 1 --2- 172.21.15.46:0/194547629 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f610006c6b0 0x7f610006eb60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f60fc02c7c0 tx=0x7f60fc000bc0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:50.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.189+0000 7f610dffb640 1 -- 172.21.15.46:0/194547629 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6104056050 con 0x7f61100ff640 2024-02-19T18:59:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.402+0000 7f6116f00640 1 -- 172.21.15.46:0/194547629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f611019d470 con 0x7f61100ff640 2024-02-19T18:59:50.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.402+0000 7f610dffb640 1 -- 172.21.15.46:0/194547629 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f610405d2b0 con 0x7f61100ff640 2024-02-19T18:59:50.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T18:59:50.421 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14506,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3116160429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3116160429},{"type":"v1","addr":"172.21.15.46:6827","nonce":3116160429}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T18:59:38.092640+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14494,"mds_1":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14494":{"gid":14494,"name":"cephfs.smithi046.bwvkwa","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6829/2235495765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2235495765},{"type":"v1","addr":"172.21.15.46:6829","nonce":2235495765}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24265":{"gid":24265,"name":"cephfs.smithi142.maazlq","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6825/445093561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":445093561},{"type":"v1","addr":"172.21.15.142:6825","nonce":445093561}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T18:59:50.421 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T18:59:50.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.404+0000 7f6116f00640 1 -- 172.21.15.46:0/194547629 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f610006c6b0 msgr2=0x7f610006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:50.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.404+0000 7f6116f00640 1 --2- 172.21.15.46:0/194547629 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f610006c6b0 0x7f610006eb60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f60fc02c7c0 tx=0x7f60fc000bc0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.404+0000 7f6116f00640 1 -- 172.21.15.46:0/194547629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61100ff640 msgr2=0x7f6110074010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:50.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.404+0000 7f6116f00640 1 --2- 172.21.15.46:0/194547629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61100ff640 0x7f6110074010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f610400c8f0 tx=0x7f610400cdb0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.405+0000 7f6116f00640 1 -- 172.21.15.46:0/194547629 shutdown_connections 2024-02-19T18:59:50.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.405+0000 7f6116f00640 1 --2- 172.21.15.46:0/194547629 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f610006c6b0 0x7f610006eb60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.405+0000 7f6116f00640 1 --2- 172.21.15.46:0/194547629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6110100830 0x7f6110072650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.405+0000 7f6116f00640 1 --2- 172.21.15.46:0/194547629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61100ff640 0x7f6110074010 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:50.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.405+0000 7f6116f00640 1 -- 172.21.15.46:0/194547629 >> 172.21.15.46:0/194547629 conn(0x7f61100fabc0 msgr2=0x7f6110103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:50.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.405+0000 7f6116f00640 1 -- 172.21.15.46:0/194547629 shutdown_connections 2024-02-19T18:59:50.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:50.405+0000 7f6116f00640 1 -- 172.21.15.46:0/194547629 wait complete. 2024-02-19T18:59:50.433 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:50 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1753861999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T18:59:50.433 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:50 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/4191714617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T18:59:50.433 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:50 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/4242190661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T18:59:50.434 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 2, 'flags': 18} 2024-02-19T18:59:50.434 INFO:teuthology.run_tasks:Running task kclient... 2024-02-19T18:59:50.458 INFO:tasks.kclient:Mounting kernel clients... 2024-02-19T18:59:50.458 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-02-19T18:59:50.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:50.458 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-02-19T18:59:50.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:50.473 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-02-19T18:59:50.541 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-02-19T18:59:50.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T18:59:50.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:50.543 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-19T18:59:50.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:50.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-02-19T18:59:50.631 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:50 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1753861999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T18:59:50.631 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:50 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/4191714617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T18:59:50.631 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:50 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/4242190661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T18:59:50.639 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-02-19T18:59:50.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T18:59:50.640 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-02-19T18:59:50.640 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-19T18:59:50.641 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-19T18:59:50.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph fs ls 2024-02-19T18:59:50.850 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:51.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:51 smithi046 ceph-mon[29647]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-19T18:59:51.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:51 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/194547629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T18:59:51.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:51 smithi142 ceph-mon[37169]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-02-19T18:59:51.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:51 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/194547629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T18:59:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.500+0000 7fa9c745d700 1 -- 172.21.15.46:0/2875190523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c01004e0 msgr2=0x7fa9c01008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.500+0000 7fa9c745d700 1 --2- 172.21.15.46:0/2875190523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c01004e0 0x7fa9c01008b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800b0a0 tx=0x7fa9b800b3b0 comp rx=0 tx=0).stop 2024-02-19T18:59:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.500+0000 7fa9c745d700 1 -- 172.21.15.46:0/2875190523 shutdown_connections 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.500+0000 7fa9c745d700 1 --2- 172.21.15.46:0/2875190523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9c0100e80 0x7fa9c0104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.500+0000 7fa9c745d700 1 --2- 172.21.15.46:0/2875190523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c01004e0 0x7fa9c01008b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.500+0000 7fa9c745d700 1 -- 172.21.15.46:0/2875190523 >> 172.21.15.46:0/2875190523 conn(0x7fa9c00fbda0 msgr2=0x7fa9c00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.500+0000 7fa9c745d700 1 -- 172.21.15.46:0/2875190523 shutdown_connections 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.500+0000 7fa9c745d700 1 -- 172.21.15.46:0/2875190523 wait complete. 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c745d700 1 Processor -- start 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c745d700 1 -- start start 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c745d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9c01004e0 0x7fa9c0073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c745d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c0100e80 0x7fa9c0073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c745d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c0073ad0 con 0x7fa9c0100e80 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c745d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c0073c10 con 0x7fa9c01004e0 2024-02-19T18:59:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c49f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c0100e80 0x7fa9c0073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c49f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c0100e80 0x7fa9c0073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60104/0 (socket says 172.21.15.46:60104) 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c49f8700 1 -- 172.21.15.46:0/1947392962 learned_addr learned my addr 172.21.15.46:0/1947392962 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c51f9700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9c01004e0 0x7fa9c0073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c49f8700 1 -- 172.21.15.46:0/1947392962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9c01004e0 msgr2=0x7fa9c0073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c49f8700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9c01004e0 0x7fa9c0073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.501+0000 7fa9c49f8700 1 -- 172.21.15.46:0/1947392962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8009d00 con 0x7fa9c0100e80 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.502+0000 7fa9c49f8700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c0100e80 0x7fa9c0073590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400b480 tx=0x7fa9b400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.502+0000 7fa9be7fc700 1 -- 172.21.15.46:0/1947392962 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9b40118c0 con 0x7fa9c0100e80 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.502+0000 7fa9c745d700 1 -- 172.21.15.46:0/1947392962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c01a2160 con 0x7fa9c0100e80 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.502+0000 7fa9be7fc700 1 -- 172.21.15.46:0/1947392962 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa9b4010380 con 0x7fa9c0100e80 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.502+0000 7fa9be7fc700 1 -- 172.21.15.46:0/1947392962 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9b400f4f0 con 0x7fa9c0100e80 2024-02-19T18:59:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.502+0000 7fa9c745d700 1 -- 172.21.15.46:0/1947392962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c01a2570 con 0x7fa9c0100e80 2024-02-19T18:59:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.503+0000 7fa9c745d700 1 -- 172.21.15.46:0/1947392962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c01087f0 con 0x7fa9c0100e80 2024-02-19T18:59:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.503+0000 7fa9be7fc700 1 -- 172.21.15.46:0/1947392962 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa9b40104f0 con 0x7fa9c0100e80 2024-02-19T18:59:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.504+0000 7fa9be7fc700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9a806c680 0x7fa9a806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.504+0000 7fa9be7fc700 1 -- 172.21.15.46:0/1947392962 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa9b408b520 con 0x7fa9c0100e80 2024-02-19T18:59:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.504+0000 7fa9c51f9700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9a806c680 0x7fa9a806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:52.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.504+0000 7fa9c51f9700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9a806c680 0x7fa9a806eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800b830 tx=0x7fa9b80097c0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:52.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.508+0000 7fa9be7fc700 1 -- 172.21.15.46:0/1947392962 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa9b4055ba0 con 0x7fa9c0100e80 2024-02-19T18:59:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.754+0000 7fa9c745d700 1 -- 172.21.15.46:0/1947392962 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa9c004f2a0 con 0x7fa9c0100e80 2024-02-19T18:59:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.755+0000 7fa9be7fc700 1 -- 172.21.15.46:0/1947392962 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+83 (secure 0 0 0) 0x7fa9b40591c0 con 0x7fa9c0100e80 2024-02-19T18:59:52.773 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-19T18:59:52.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 -- 172.21.15.46:0/1947392962 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9a806c680 msgr2=0x7fa9a806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9a806c680 0x7fa9a806eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800b830 tx=0x7fa9b80097c0 comp rx=0 tx=0).stop 2024-02-19T18:59:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 -- 172.21.15.46:0/1947392962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c0100e80 msgr2=0x7fa9c0073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c0100e80 0x7fa9c0073590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400b480 tx=0x7fa9b400b840 comp rx=0 tx=0).stop 2024-02-19T18:59:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 -- 172.21.15.46:0/1947392962 shutdown_connections 2024-02-19T18:59:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fa9a806c680 0x7fa9a806eb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9c01004e0 0x7fa9c0073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 --2- 172.21.15.46:0/1947392962 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c0100e80 0x7fa9c0073590 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 -- 172.21.15.46:0/1947392962 >> 172.21.15.46:0/1947392962 conn(0x7fa9c00fbda0 msgr2=0x7fa9c00fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 -- 172.21.15.46:0/1947392962 shutdown_connections 2024-02-19T18:59:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:52.757+0000 7fa9c745d700 1 -- 172.21.15.46:0/1947392962 wait complete. 2024-02-19T18:59:53.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:53 smithi046 ceph-mon[29647]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 0 op/s 2024-02-19T18:59:53.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:53 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1947392962' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T18:59:53.525 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-19T18:59:53.526 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T18:59:53.526 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-02-19T18:59:53.526 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-19T18:59:53.526 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-19T18:59:53.526 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-19T18:59:53.526 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T18:59:53.526 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T18:59:53.526 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-19T18:59:53.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:53.526 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T18:59:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42078sec preferred_lft 42078sec 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-02-19T18:59:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-02-19T18:59:53.546 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-19T18:59:53.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:53.546 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T18:59:53.546 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T18:59:53.546 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-02-19T18:59:53.546 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-02-19T18:59:53.546 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-02-19T18:59:53.546 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-19T18:59:53.546 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T18:59:53.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:53 smithi142 ceph-mon[37169]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 0 op/s 2024-02-19T18:59:53.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:53 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1947392962' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T18:59:53.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:53.707 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T18:59:53.735 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-02-19T18:59:53.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:53.737 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-02-19T18:59:53.802 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-02-19T18:59:53.803 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T18:59:53.803 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-19T18:59:53.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-19T18:59:53.803 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T18:59:53.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:53.803 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T18:59:53.803 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T18:59:53.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-19T18:59:53.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-19T18:59:53.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-19T18:59:53.804 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T18:59:54.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.046 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-02-19T18:59:54.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.061 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-02-19T18:59:54.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.114 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T18:59:54.114 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T18:59:54.114 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T18:59:54.114 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-19T18:59:54.114 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T18:59:54.196 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-19T18:59:54.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.197 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T18:59:54.197 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T18:59:54.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-19T18:59:54.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-19T18:59:54.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-19T18:59:54.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-19T18:59:54.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-19T18:59:54.197 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T18:59:54.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.336 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-02-19T18:59:54.336 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-02-19T18:59:54.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-02-19T18:59:54.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-02-19T18:59:54.336 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-02-19T18:59:54.377 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T18:59:54.377 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-19T18:59:54.435 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-19T18:59:54.436 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T18:59:54.436 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-19T18:59:54.490 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-19T18:59:54.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-19T18:59:54.590 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-19T18:59:54.590 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-19T18:59:54.590 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2024-02-19T18:59:54.694 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-19T18:59:54.694 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-19T18:59:54.694 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2024-02-19T18:59:54.694 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.142:3300" 2024-02-19T18:59:54.694 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-19T18:59:54.699 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-19T18:59:54.699 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-19T18:59:54.700 INFO:teuthology.orchestra.run.smithi046.stdout:invalid new device string format 2024-02-19T18:59:54.700 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.142:3300" 2024-02-19T18:59:54.700 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-19T18:59:54.700 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.142:6789" 2024-02-19T18:59:54.700 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.142:6789:/ 2024-02-19T18:59:54.700 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c412ec66-cf57-11ee-95bb-87774f69a715" will pass to kernel 2024-02-19T18:59:54.701 INFO:teuthology.orchestra.run.smithi046.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-19T18:59:54.701 INFO:teuthology.orchestra.run.smithi046.stdout: You just mounted a file system that supports labels which does not 2024-02-19T18:59:54.701 INFO:teuthology.orchestra.run.smithi046.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-19T18:59:54.701 INFO:teuthology.orchestra.run.smithi046.stdout: applications will generate AVC messages and not be allowed access to 2024-02-19T18:59:54.701 INFO:teuthology.orchestra.run.smithi046.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-19T18:59:54.702 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-19T18:59:54.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-19T18:59:54.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.733 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T18:59:54.793 INFO:teuthology.orchestra.run.smithi046.stdout:client14548 2024-02-19T18:59:54.793 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T18:59:54.793 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T18:59:54.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.849 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T18:59:54.910 INFO:teuthology.orchestra.run.smithi046.stdout:client14548 2024-02-19T18:59:54.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.911 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T18:59:54.971 INFO:teuthology.orchestra.run.smithi046.stdout:client14548 2024-02-19T18:59:54.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:54.972 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c412ec66-cf57-11ee-95bb-87774f69a715.client14548/status') 2024-02-19T18:59:55.043 INFO:teuthology.orchestra.run.smithi046.stdout:instance: client.14548 (3)192.168.0.1:0/920633814 2024-02-19T18:59:55.043 INFO:teuthology.orchestra.run.smithi046.stdout:blocklisted: false 2024-02-19T18:59:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records in 2024-02-19T18:59:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records out 2024-02-19T18:59:55.043 INFO:teuthology.orchestra.run.smithi046.stderr:69 bytes copied, 2.5195e-05 s, 2.7 MB/s 2024-02-19T18:59:55.044 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-02-19T18:59:55.044 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-19T18:59:55.045 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-19T18:59:55.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- ceph fs ls 2024-02-19T18:59:55.293 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T18:59:55.597 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:55 smithi046 ceph-mon[29647]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 0 op/s 2024-02-19T18:59:55.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:55 smithi142 ceph-mon[37169]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 0 op/s 2024-02-19T18:59:56.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.873+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/252078056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f041004e0 msgr2=0x7f7f041008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:56.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.873+0000 7f7f0b4b7700 1 --2- 172.21.15.46:0/252078056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f041004e0 0x7f7f041008b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009910 tx=0x7f7f00009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:56.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.874+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/252078056 shutdown_connections 2024-02-19T18:59:56.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.874+0000 7f7f0b4b7700 1 --2- 172.21.15.46:0/252078056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f04100e80 0x7f7f04104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:56.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.874+0000 7f7f0b4b7700 1 --2- 172.21.15.46:0/252078056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f041004e0 0x7f7f041008b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:56.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.874+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/252078056 >> 172.21.15.46:0/252078056 conn(0x7f7f040fbda0 msgr2=0x7f7f040fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:56.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.874+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/252078056 shutdown_connections 2024-02-19T18:59:56.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.874+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/252078056 wait complete. 2024-02-19T18:59:56.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.874+0000 7f7f0b4b7700 1 Processor -- start 2024-02-19T18:59:56.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.874+0000 7f7f0b4b7700 1 -- start start 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f0b4b7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f041004e0 0x7f7f041980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f0b4b7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04100e80 0x7f7f041985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f0b4b7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04198cc0 con 0x7f7f04100e80 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f0b4b7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0419ca50 con 0x7f7f041004e0 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f08a52700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04100e80 0x7f7f041985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f09253700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f041004e0 0x7f7f041980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f08a52700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04100e80 0x7f7f041985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60132/0 (socket says 172.21.15.46:60132) 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f08a52700 1 -- 172.21.15.46:0/4078733819 learned_addr learned my addr 172.21.15.46:0/4078733819 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f08a52700 1 -- 172.21.15.46:0/4078733819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f041004e0 msgr2=0x7f7f041980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f08a52700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f041004e0 0x7f7f041980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f08a52700 1 -- 172.21.15.46:0/4078733819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f000095f0 con 0x7f7f04100e80 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f09253700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f041004e0 0x7f7f041980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7f08a52700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04100e80 0x7f7f041985e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400d900 tx=0x7f7ef400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:56.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.875+0000 7f7efa7fc700 1 -- 172.21.15.46:0/4078733819 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ef4009900 con 0x7f7f04100e80 2024-02-19T18:59:56.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.876+0000 7f7efa7fc700 1 -- 172.21.15.46:0/4078733819 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7ef4010460 con 0x7f7f04100e80 2024-02-19T18:59:56.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.876+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/4078733819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0419cd30 con 0x7f7f04100e80 2024-02-19T18:59:56.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.876+0000 7f7efa7fc700 1 -- 172.21.15.46:0/4078733819 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ef400f5f0 con 0x7f7f04100e80 2024-02-19T18:59:56.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.876+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/4078733819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0419d280 con 0x7f7f04100e80 2024-02-19T18:59:56.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.877+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/4078733819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f041045d0 con 0x7f7f04100e80 2024-02-19T18:59:56.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.877+0000 7f7efa7fc700 1 -- 172.21.15.46:0/4078733819 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7ef40105d0 con 0x7f7f04100e80 2024-02-19T18:59:56.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.878+0000 7f7efa7fc700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ef006c680 0x7f7ef006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:56.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.878+0000 7f7efa7fc700 1 -- 172.21.15.46:0/4078733819 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7ef408ad90 con 0x7f7f04100e80 2024-02-19T18:59:56.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.878+0000 7f7f09253700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ef006c680 0x7f7ef006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:56.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.878+0000 7f7f09253700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ef006c680 0x7f7ef006eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7f00006010 tx=0x7f7f0001a040 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:56.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:56.882+0000 7f7efa7fc700 1 -- 172.21.15.46:0/4078733819 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7ef4055490 con 0x7f7f04100e80 2024-02-19T18:59:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.128+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/4078733819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7f0404f2a0 con 0x7f7f04100e80 2024-02-19T18:59:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.128+0000 7f7efa7fc700 1 -- 172.21.15.46:0/4078733819 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+83 (secure 0 0 0) 0x7f7ef4020070 con 0x7f7f04100e80 2024-02-19T18:59:57.147 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-19T18:59:57.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.130+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/4078733819 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ef006c680 msgr2=0x7f7ef006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:57.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.130+0000 7f7f0b4b7700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ef006c680 0x7f7ef006eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7f00006010 tx=0x7f7f0001a040 comp rx=0 tx=0).stop 2024-02-19T18:59:57.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.130+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/4078733819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04100e80 msgr2=0x7f7f041985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:57.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.130+0000 7f7f0b4b7700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04100e80 0x7f7f041985e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400d900 tx=0x7f7ef400dc10 comp rx=0 tx=0).stop 2024-02-19T18:59:57.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.131+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/4078733819 shutdown_connections 2024-02-19T18:59:57.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.131+0000 7f7f0b4b7700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7ef006c680 0x7f7ef006eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.131+0000 7f7f0b4b7700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f041004e0 0x7f7f041980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.131+0000 7f7f0b4b7700 1 --2- 172.21.15.46:0/4078733819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f04100e80 0x7f7f041985e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.131+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/4078733819 >> 172.21.15.46:0/4078733819 conn(0x7f7f040fbda0 msgr2=0x7f7f040fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.131+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/4078733819 shutdown_connections 2024-02-19T18:59:57.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T18:59:57.131+0000 7f7f0b4b7700 1 -- 172.21.15.46:0/4078733819 wait complete. 2024-02-19T18:59:57.439 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:57 smithi046 ceph-mon[29647]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-19T18:59:57.439 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:57 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/4078733819' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T18:59:57.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:57 smithi142 ceph-mon[37169]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-19T18:59:57.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:57 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/4078733819' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T18:59:57.861 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-19T18:59:57.862 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T18:59:57.862 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-02-19T18:59:57.862 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-19T18:59:57.862 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-19T18:59:57.862 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-19T18:59:57.862 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T18:59:57.862 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T18:59:57.862 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-19T18:59:57.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:57.862 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-02-19T18:59:57.883 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T18:59:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T18:59:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T18:59:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T18:59:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-02-19T18:59:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T18:59:57.883 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T18:59:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-02-19T18:59:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42082sec preferred_lft 42082sec 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2024-02-19T18:59:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-02-19T18:59:57.884 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-19T18:59:57.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:57.885 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T18:59:57.885 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T18:59:57.885 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2024-02-19T18:59:57.885 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2024-02-19T18:59:57.885 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2024-02-19T18:59:57.885 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-19T18:59:57.885 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T18:59:58.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:58.055 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T18:59:58.081 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-02-19T18:59:58.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:58.083 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-02-19T18:59:58.150 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-02-19T18:59:58.150 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T18:59:58.150 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-19T18:59:58.150 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-19T18:59:58.150 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T18:59:58.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:58.150 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T18:59:58.151 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T18:59:58.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-19T18:59:58.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-19T18:59:58.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-19T18:59:58.151 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T18:59:58.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:58.395 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-19T18:59:58.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:58.410 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-02-19T18:59:58.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:58.464 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T18:59:58.464 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T18:59:58.464 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T18:59:58.464 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-19T18:59:58.464 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T18:59:58.546 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-19T18:59:58.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:58.547 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T18:59:58.547 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T18:59:58.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-19T18:59:58.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-19T18:59:58.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-19T18:59:58.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-19T18:59:58.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-19T18:59:58.547 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T18:59:58.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:58.687 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2024-02-19T18:59:58.687 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-02-19T18:59:58.687 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-02-19T18:59:58.687 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2024-02-19T18:59:58.687 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-02-19T18:59:58.728 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T18:59:58.728 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-19T18:59:58.783 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-19T18:59:58.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T18:59:58.783 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-19T18:59:58.837 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-19T18:59:58.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:58.837 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-19T18:59:58.933 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-19T18:59:58.933 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-19T18:59:58.933 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-02-19T18:59:59.053 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-19T18:59:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-19T18:59:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-02-19T18:59:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.142:3300" 2024-02-19T18:59:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-19T18:59:59.058 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-19T18:59:59.058 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-19T18:59:59.058 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-02-19T18:59:59.058 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.142:3300" 2024-02-19T18:59:59.058 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-19T18:59:59.058 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.46:6789,172.21.15.142:6789" 2024-02-19T18:59:59.058 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.46:6789,172.21.15.142:6789:/ 2024-02-19T18:59:59.058 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c412ec66-cf57-11ee-95bb-87774f69a715" will pass to kernel 2024-02-19T18:59:59.059 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-02-19T18:59:59.059 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2024-02-19T18:59:59.059 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-19T18:59:59.059 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2024-02-19T18:59:59.059 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-19T18:59:59.060 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-19T18:59:59.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:59.061 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-19T18:59:59.609 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 18:59:59 smithi142 ceph-mon[37169]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-19T18:59:59.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:59.610 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T18:59:59.626 INFO:teuthology.orchestra.run.smithi142.stdout:client24313 2024-02-19T18:59:59.626 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T18:59:59.626 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T18:59:59.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:59.682 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T18:59:59.738 INFO:teuthology.orchestra.run.smithi142.stdout:client24313 2024-02-19T18:59:59.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:59.738 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T18:59:59.794 INFO:teuthology.orchestra.run.smithi142.stdout:client24313 2024-02-19T18:59:59.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T18:59:59.794 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c412ec66-cf57-11ee-95bb-87774f69a715.client24313/status') 2024-02-19T18:59:59.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 18:59:59 smithi046 ceph-mon[29647]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-19T18:59:59.860 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.24313 (3)192.168.0.1:0/3968508409 2024-02-19T18:59:59.861 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2024-02-19T18:59:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2024-02-19T18:59:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2024-02-19T18:59:59.861 INFO:teuthology.orchestra.run.smithi142.stderr:70 bytes copied, 2.1141e-05 s, 3.3 MB/s 2024-02-19T18:59:59.862 INFO:teuthology.run_tasks:Running task print... 2024-02-19T18:59:59.873 INFO:teuthology.task.print:**** done client 2024-02-19T18:59:59.873 INFO:teuthology.run_tasks:Running task parallel... 2024-02-19T18:59:59.883 INFO:teuthology.task.parallel:starting parallel... 2024-02-19T18:59:59.883 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-19T18:59:59.884 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-19T18:59:59.884 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T18:59:59.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-19T18:59:59.885 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-19T18:59:59.885 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-19T18:59:59.888 INFO:tasks.workunit:Pulling workunits from ref 1ce7ea8877c709fa862eac608550374bd96e166e 2024-02-19T18:59:59.888 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-19T18:59:59.888 INFO:tasks.workunit:timeout=3h 2024-02-19T18:59:59.888 INFO:tasks.workunit:cleanup=True 2024-02-19T18:59:59.889 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-19T18:59:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-19T18:59:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-19T18:59:59.908 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 9fh/159d Inode: 1 Links: 2 2024-02-19T18:59:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:59:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-19T18:59:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-19T18:59:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-02-19 18:59:24.278016345 +0000 2024-02-19T18:59:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-02-19 18:59:54.709321208 +0000 2024-02-19T18:59:59.909 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-02-19 18:59:24.278016345 +0000 2024-02-19T18:59:59.909 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-19T18:59:59.909 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-19T18:59:59.982 DEBUG:teuthology.orchestra.run.smithi142:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-19T18:59:59.998 INFO:teuthology.orchestra.run.smithi142.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-19T18:59:59.998 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-02-19T18:59:59.998 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 7eh/126d Inode: 1 Links: 3 2024-02-19T18:59:59.998 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:59:59.998 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-19T18:59:59.998 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-19T18:59:59.998 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-02-19 18:59:59.959264086 +0000 2024-02-19T18:59:59.999 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-02-19 18:59:59.959264086 +0000 2024-02-19T18:59:59.999 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-02-19 18:59:24.278016345 +0000 2024-02-19T18:59:59.999 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-19T18:59:59.999 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-19T19:00:00.073 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/batrick/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1ce7ea8877c709fa862eac608550374bd96e166e 2024-02-19T19:00:00.073 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/batrick/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1ce7ea8877c709fa862eac608550374bd96e166e 2024-02-19T19:00:00.088 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-19T19:00:00.118 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:00:00.127 INFO:tasks.workunit.client.1.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-19T19:00:00.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:00 smithi046 ceph-mon[29647]: overall HEALTH_OK 2024-02-19T19:00:00.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:00 smithi142 ceph-mon[37169]: overall HEALTH_OK 2024-02-19T19:00:01.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:01 smithi046 ceph-mon[29647]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-19T19:00:01.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.623+0000 7fb06c44a700 1 -- 172.21.15.46:0/3287100119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb064101440 msgr2=0x7fb064101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:01.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.623+0000 7fb06c44a700 1 --2- 172.21.15.46:0/3287100119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb064101440 0x7fb064101890 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb054009910 tx=0x7fb054009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:01.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.623+0000 7fb06c44a700 1 -- 172.21.15.46:0/3287100119 shutdown_connections 2024-02-19T19:00:01.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.623+0000 7fb06c44a700 1 --2- 172.21.15.46:0/3287100119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb064101440 0x7fb064101890 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:01.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.623+0000 7fb06c44a700 1 --2- 172.21.15.46:0/3287100119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb064100240 0x7fb064100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:01.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.623+0000 7fb06c44a700 1 -- 172.21.15.46:0/3287100119 >> 172.21.15.46:0/3287100119 conn(0x7fb0640fb7f0 msgr2=0x7fb0640fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:01.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.623+0000 7fb06c44a700 1 -- 172.21.15.46:0/3287100119 shutdown_connections 2024-02-19T19:00:01.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.623+0000 7fb06c44a700 1 -- 172.21.15.46:0/3287100119 wait complete. 2024-02-19T19:00:01.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06c44a700 1 Processor -- start 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06c44a700 1 -- start start 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06c44a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb064100240 0x7fb064195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06c44a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb064101440 0x7fb064195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06c44a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0641965f0 con 0x7fb064100240 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06c44a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb064196730 con 0x7fb064101440 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06a1e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb064100240 0x7fb064195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06a1e6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb064100240 0x7fb064195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34492/0 (socket says 172.21.15.46:34492) 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06a1e6700 1 -- 172.21.15.46:0/2657534848 learned_addr learned my addr 172.21.15.46:0/2657534848 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb0699e5700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb064101440 0x7fb064195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06a1e6700 1 -- 172.21.15.46:0/2657534848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb064101440 msgr2=0x7fb064195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06a1e6700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb064101440 0x7fb064195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06a1e6700 1 -- 172.21.15.46:0/2657534848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0540095f0 con 0x7fb064100240 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.624+0000 7fb06a1e6700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb064100240 0x7fb064195a90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb06000c8f0 tx=0x7fb06000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:01.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.625+0000 7fb05b7fe700 1 -- 172.21.15.46:0/2657534848 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0600078e0 con 0x7fb064100240 2024-02-19T19:00:01.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.625+0000 7fb05b7fe700 1 -- 172.21.15.46:0/2657534848 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb06000f450 con 0x7fb064100240 2024-02-19T19:00:01.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.625+0000 7fb06c44a700 1 -- 172.21.15.46:0/2657534848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06419b1e0 con 0x7fb064100240 2024-02-19T19:00:01.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.625+0000 7fb05b7fe700 1 -- 172.21.15.46:0/2657534848 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb060018610 con 0x7fb064100240 2024-02-19T19:00:01.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.625+0000 7fb06c44a700 1 -- 172.21.15.46:0/2657534848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06419b730 con 0x7fb064100240 2024-02-19T19:00:01.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.626+0000 7fb06c44a700 1 -- 172.21.15.46:0/2657534848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb064108d90 con 0x7fb064100240 2024-02-19T19:00:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.626+0000 7fb05b7fe700 1 -- 172.21.15.46:0/2657534848 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb06000f5c0 con 0x7fb064100240 2024-02-19T19:00:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.627+0000 7fb05b7fe700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb05006c680 0x7fb05006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.627+0000 7fb05b7fe700 1 -- 172.21.15.46:0/2657534848 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb06008b7b0 con 0x7fb064100240 2024-02-19T19:00:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.627+0000 7fb0699e5700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb05006c680 0x7fb05006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:01.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.627+0000 7fb0699e5700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb05006c680 0x7fb05006eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb054006010 tx=0x7fb05400b560 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.631+0000 7fb05b7fe700 1 -- 172.21.15.46:0/2657534848 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb0600598c0 con 0x7fb064100240 2024-02-19T19:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:01 smithi142 ceph-mon[37169]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-19T19:00:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.840+0000 7fb06c44a700 1 -- 172.21.15.46:0/2657534848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fb064108f50 con 0x7fb064100240 2024-02-19T19:00:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.841+0000 7fb05b7fe700 1 -- 172.21.15.46:0/2657534848 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fb060059450 con 0x7fb064100240 2024-02-19T19:00:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 -- 172.21.15.46:0/2657534848 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb05006c680 msgr2=0x7fb05006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb05006c680 0x7fb05006eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb054006010 tx=0x7fb05400b560 comp rx=0 tx=0).stop 2024-02-19T19:00:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 -- 172.21.15.46:0/2657534848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb064100240 msgr2=0x7fb064195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb064100240 0x7fb064195a90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb06000c8f0 tx=0x7fb06000cc00 comp rx=0 tx=0).stop 2024-02-19T19:00:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 -- 172.21.15.46:0/2657534848 shutdown_connections 2024-02-19T19:00:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb05006c680 0x7fb05006eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb064100240 0x7fb064195a90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 --2- 172.21.15.46:0/2657534848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb064101440 0x7fb064195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 -- 172.21.15.46:0/2657534848 >> 172.21.15.46:0/2657534848 conn(0x7fb0640fb7f0 msgr2=0x7fb064104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 -- 172.21.15.46:0/2657534848 shutdown_connections 2024-02-19T19:00:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:01.843+0000 7fb06c44a700 1 -- 172.21.15.46:0/2657534848 wait complete. 2024-02-19T19:00:02.514 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:02 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:02.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-19T19:00:02.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:02 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:02.786 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:00:03.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:03 smithi046 ceph-mon[29647]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-19T19:00:03.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:03 smithi142 ceph-mon[37169]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-19T19:00:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.523+0000 7fd4dda91700 1 -- 172.21.15.46:0/199494806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4d81018e0 msgr2=0x7fd4d8101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.523+0000 7fd4dda91700 1 --2- 172.21.15.46:0/199494806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4d81018e0 0x7fd4d8101cf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800b0a0 tx=0x7fd4c800b3b0 comp rx=0 tx=0).stop 2024-02-19T19:00:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.523+0000 7fd4dda91700 1 -- 172.21.15.46:0/199494806 shutdown_connections 2024-02-19T19:00:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.523+0000 7fd4dda91700 1 --2- 172.21.15.46:0/199494806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4d8102230 0x7fd4d80fe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.523+0000 7fd4dda91700 1 --2- 172.21.15.46:0/199494806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4d81018e0 0x7fd4d8101cf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.523+0000 7fd4dda91700 1 -- 172.21.15.46:0/199494806 >> 172.21.15.46:0/199494806 conn(0x7fd4d80f9f10 msgr2=0x7fd4d80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.524+0000 7fd4dda91700 1 -- 172.21.15.46:0/199494806 shutdown_connections 2024-02-19T19:00:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.524+0000 7fd4dda91700 1 -- 172.21.15.46:0/199494806 wait complete. 2024-02-19T19:00:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.524+0000 7fd4dda91700 1 Processor -- start 2024-02-19T19:00:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.524+0000 7fd4dda91700 1 -- start start 2024-02-19T19:00:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4dda91700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4d81018e0 0x7fd4d8195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4dda91700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4d8102230 0x7fd4d8196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4dda91700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8196680 con 0x7fd4d81018e0 2024-02-19T19:00:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4dda91700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d81967c0 con 0x7fd4d8102230 2024-02-19T19:00:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4d81018e0 0x7fd4d8195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4d81018e0 0x7fd4d8195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34512/0 (socket says 172.21.15.46:34512) 2024-02-19T19:00:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d77fe700 1 -- 172.21.15.46:0/2927917334 learned_addr learned my addr 172.21.15.46:0/2927917334 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d6ffd700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4d8102230 0x7fd4d8196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d77fe700 1 -- 172.21.15.46:0/2927917334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4d8102230 msgr2=0x7fd4d8196060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d77fe700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4d8102230 0x7fd4d8196060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d77fe700 1 -- 172.21.15.46:0/2927917334 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8009d00 con 0x7fd4d81018e0 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d6ffd700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4d8102230 0x7fd4d8196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d77fe700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4d81018e0 0x7fd4d8195b20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80077b0 tx=0x7fd4c8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d4ff9700 1 -- 172.21.15.46:0/2927917334 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4c800e040 con 0x7fd4d81018e0 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4dda91700 1 -- 172.21.15.46:0/2927917334 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d819b210 con 0x7fd4d81018e0 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.525+0000 7fd4d4ff9700 1 -- 172.21.15.46:0/2927917334 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4c800ce60 con 0x7fd4d81018e0 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.526+0000 7fd4d4ff9700 1 -- 172.21.15.46:0/2927917334 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4c801daf0 con 0x7fd4d81018e0 2024-02-19T19:00:04.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.526+0000 7fd4dda91700 1 -- 172.21.15.46:0/2927917334 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d819b700 con 0x7fd4d81018e0 2024-02-19T19:00:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.526+0000 7fd4dda91700 1 -- 172.21.15.46:0/2927917334 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8108d60 con 0x7fd4d81018e0 2024-02-19T19:00:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.527+0000 7fd4d4ff9700 1 -- 172.21.15.46:0/2927917334 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd4c8004250 con 0x7fd4d81018e0 2024-02-19T19:00:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.528+0000 7fd4d4ff9700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd4c006c680 0x7fd4c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.528+0000 7fd4d4ff9700 1 -- 172.21.15.46:0/2927917334 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd4c808d410 con 0x7fd4d81018e0 2024-02-19T19:00:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.528+0000 7fd4d6ffd700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd4c006c680 0x7fd4c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:04.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.528+0000 7fd4d6ffd700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd4c006c680 0x7fd4c006eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc005950 tx=0x7fd4cc005f50 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:04.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.532+0000 7fd4d4ff9700 1 -- 172.21.15.46:0/2927917334 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd4c805b500 con 0x7fd4d81018e0 2024-02-19T19:00:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.732+0000 7fd4dda91700 1 -- 172.21.15.46:0/2927917334 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fd4d819be50 con 0x7fd4d81018e0 2024-02-19T19:00:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.732+0000 7fd4d4ff9700 1 -- 172.21.15.46:0/2927917334 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd4d819be50 con 0x7fd4d81018e0 2024-02-19T19:00:04.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 -- 172.21.15.46:0/2927917334 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd4c006c680 msgr2=0x7fd4c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:04.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd4c006c680 0x7fd4c006eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc005950 tx=0x7fd4cc005f50 comp rx=0 tx=0).stop 2024-02-19T19:00:04.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 -- 172.21.15.46:0/2927917334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4d81018e0 msgr2=0x7fd4d8195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:04.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4d81018e0 0x7fd4d8195b20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80077b0 tx=0x7fd4c8003ce0 comp rx=0 tx=0).stop 2024-02-19T19:00:04.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 -- 172.21.15.46:0/2927917334 shutdown_connections 2024-02-19T19:00:04.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fd4c006c680 0x7fd4c006eb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:04.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4d81018e0 0x7fd4d8195b20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:04.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 --2- 172.21.15.46:0/2927917334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4d8102230 0x7fd4d8196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:04.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 -- 172.21.15.46:0/2927917334 >> 172.21.15.46:0/2927917334 conn(0x7fd4d80f9f10 msgr2=0x7fd4d81048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:04.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 -- 172.21.15.46:0/2927917334 shutdown_connections 2024-02-19T19:00:04.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:04.735+0000 7fd4dda91700 1 -- 172.21.15.46:0/2927917334 wait complete. 2024-02-19T19:00:05.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-19T19:00:05.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:05 smithi046 ceph-mon[29647]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-02-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:00:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:05 smithi142 ceph-mon[37169]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-02-19T19:00:07.431 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:07 smithi046 ceph-mon[29647]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-02-19T19:00:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.420+0000 7f3034f6a700 1 -- 172.21.15.46:0/3172212234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3030103650 msgr2=0x7f3030105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.420+0000 7f3034f6a700 1 --2- 172.21.15.46:0/3172212234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3030103650 0x7f3030105a30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3024009910 tx=0x7f3024009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.421+0000 7f3034f6a700 1 -- 172.21.15.46:0/3172212234 shutdown_connections 2024-02-19T19:00:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.421+0000 7f3034f6a700 1 --2- 172.21.15.46:0/3172212234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3030103650 0x7f3030105a30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.421+0000 7f3034f6a700 1 --2- 172.21.15.46:0/3172212234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3030100d30 0x7f3030103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.421+0000 7f3034f6a700 1 -- 172.21.15.46:0/3172212234 >> 172.21.15.46:0/3172212234 conn(0x7f30300fa6d0 msgr2=0x7f30300fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.421+0000 7f3034f6a700 1 -- 172.21.15.46:0/3172212234 shutdown_connections 2024-02-19T19:00:07.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.421+0000 7f3034f6a700 1 -- 172.21.15.46:0/3172212234 wait complete. 2024-02-19T19:00:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.421+0000 7f3034f6a700 1 Processor -- start 2024-02-19T19:00:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.421+0000 7f3034f6a700 1 -- start start 2024-02-19T19:00:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f3034f6a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3030100d30 0x7f3030100690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f3034f6a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3030103650 0x7f30300fece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f3034f6a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30300ff220 con 0x7f3030100d30 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f3034f6a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30300ff360 con 0x7f3030103650 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f302e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3030100d30 0x7f3030100690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f302e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3030100d30 0x7f3030100690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34520/0 (socket says 172.21.15.46:34520) 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f302e59c700 1 -- 172.21.15.46:0/1736275555 learned_addr learned my addr 172.21.15.46:0/1736275555 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f302dd9b700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3030103650 0x7f30300fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f302e59c700 1 -- 172.21.15.46:0/1736275555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3030103650 msgr2=0x7f30300fece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f302e59c700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3030103650 0x7f30300fece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f302e59c700 1 -- 172.21.15.46:0/1736275555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240095f0 con 0x7f3030100d30 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f302e59c700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3030100d30 0x7f3030100690 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f302000c930 tx=0x7f302000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f301f7fe700 1 -- 172.21.15.46:0/1736275555 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3020007ad0 con 0x7f3030100d30 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f301f7fe700 1 -- 172.21.15.46:0/1736275555 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3020007c30 con 0x7f3030100d30 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f3034f6a700 1 -- 172.21.15.46:0/1736275555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30300ff640 con 0x7f3030100d30 2024-02-19T19:00:07.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.422+0000 7f301f7fe700 1 -- 172.21.15.46:0/1736275555 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3020018630 con 0x7f3030100d30 2024-02-19T19:00:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.423+0000 7f3034f6a700 1 -- 172.21.15.46:0/1736275555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303019db00 con 0x7f3030100d30 2024-02-19T19:00:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.424+0000 7f3034f6a700 1 -- 172.21.15.46:0/1736275555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303018fc60 con 0x7f3030100d30 2024-02-19T19:00:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.424+0000 7f301f7fe700 1 -- 172.21.15.46:0/1736275555 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f302000f450 con 0x7f3030100d30 2024-02-19T19:00:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.424+0000 7f301f7fe700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f301806c680 0x7f301806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:07.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.424+0000 7f301f7fe700 1 -- 172.21.15.46:0/1736275555 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f302008bab0 con 0x7f3030100d30 2024-02-19T19:00:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.425+0000 7f302dd9b700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f301806c680 0x7f301806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.425+0000 7f302dd9b700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f301806c680 0x7f301806eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3024006010 tx=0x7f302400b580 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:07.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.429+0000 7f301f7fe700 1 -- 172.21.15.46:0/1736275555 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3020059c70 con 0x7f3030100d30 2024-02-19T19:00:07.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.626+0000 7f3034f6a700 1 -- 172.21.15.46:0/1736275555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f303002cc30 con 0x7f3030100d30 2024-02-19T19:00:07.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.626+0000 7f301f7fe700 1 -- 172.21.15.46:0/1736275555 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f3020059800 con 0x7f3030100d30 2024-02-19T19:00:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 -- 172.21.15.46:0/1736275555 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f301806c680 msgr2=0x7f301806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f301806c680 0x7f301806eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3024006010 tx=0x7f302400b580 comp rx=0 tx=0).stop 2024-02-19T19:00:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 -- 172.21.15.46:0/1736275555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3030100d30 msgr2=0x7f3030100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3030100d30 0x7f3030100690 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f302000c930 tx=0x7f302000ccf0 comp rx=0 tx=0).stop 2024-02-19T19:00:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 -- 172.21.15.46:0/1736275555 shutdown_connections 2024-02-19T19:00:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f301806c680 0x7f301806eb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3030100d30 0x7f3030100690 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 --2- 172.21.15.46:0/1736275555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3030103650 0x7f30300fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 -- 172.21.15.46:0/1736275555 >> 172.21.15.46:0/1736275555 conn(0x7f30300fa6d0 msgr2=0x7f30300fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 -- 172.21.15.46:0/1736275555 shutdown_connections 2024-02-19T19:00:07.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:07.628+0000 7f3034f6a700 1 -- 172.21.15.46:0/1736275555 wait complete. 2024-02-19T19:00:07.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:07 smithi142 ceph-mon[37169]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-02-19T19:00:08.341 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-19T19:00:08.599 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:00:09.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:09 smithi142 ceph-mon[37169]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-02-19T19:00:09.756 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:09 smithi046 ceph-mon[29647]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-02-19T19:00:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.450+0000 7f684e34b700 1 -- 172.21.15.46:0/2346704318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68480ff4c0 msgr2=0x7f68480ff930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.450+0000 7f684e34b700 1 --2- 172.21.15.46:0/2346704318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68480ff4c0 0x7f68480ff930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f683c009910 tx=0x7f683c009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.450+0000 7f684e34b700 1 -- 172.21.15.46:0/2346704318 shutdown_connections 2024-02-19T19:00:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.450+0000 7f684e34b700 1 --2- 172.21.15.46:0/2346704318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68480ff4c0 0x7f68480ff930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.450+0000 7f684e34b700 1 --2- 172.21.15.46:0/2346704318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480feb70 0x7f68480fef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.450+0000 7f684e34b700 1 -- 172.21.15.46:0/2346704318 >> 172.21.15.46:0/2346704318 conn(0x7f68480fa7a0 msgr2=0x7f68480fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.450+0000 7f684e34b700 1 -- 172.21.15.46:0/2346704318 shutdown_connections 2024-02-19T19:00:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.450+0000 7f684e34b700 1 -- 172.21.15.46:0/2346704318 wait complete. 2024-02-19T19:00:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.450+0000 7f684e34b700 1 Processor -- start 2024-02-19T19:00:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.450+0000 7f684e34b700 1 -- start start 2024-02-19T19:00:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f684e34b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68480feb70 0x7f6848197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f684e34b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480ff4c0 0x7f6848198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f684e34b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6848198b40 con 0x7f68480feb70 2024-02-19T19:00:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f684e34b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6848198c80 con 0x7f68480ff4c0 2024-02-19T19:00:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f6847fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68480feb70 0x7f6848197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f6847fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68480feb70 0x7f6848197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43176/0 (socket says 172.21.15.46:43176) 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f6847fff700 1 -- 172.21.15.46:0/2071861914 learned_addr learned my addr 172.21.15.46:0/2071861914 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f68477fe700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480ff4c0 0x7f6848198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f6847fff700 1 -- 172.21.15.46:0/2071861914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480ff4c0 msgr2=0x7f6848198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f6847fff700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480ff4c0 0x7f6848198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f6847fff700 1 -- 172.21.15.46:0/2071861914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c0095f0 con 0x7f68480feb70 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.451+0000 7f6847fff700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68480feb70 0x7f6848197fe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f683800e8f0 tx=0x7f683800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.452+0000 7f68457fa700 1 -- 172.21.15.46:0/2071861914 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6838009790 con 0x7f68480feb70 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.452+0000 7f68457fa700 1 -- 172.21.15.46:0/2071861914 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f683800c810 con 0x7f68480feb70 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.452+0000 7f684e34b700 1 -- 172.21.15.46:0/2071861914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684819d730 con 0x7f68480feb70 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.452+0000 7f68457fa700 1 -- 172.21.15.46:0/2071861914 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6838003d20 con 0x7f68480feb70 2024-02-19T19:00:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.452+0000 7f684e34b700 1 -- 172.21.15.46:0/2071861914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684819dc80 con 0x7f68480feb70 2024-02-19T19:00:10.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.453+0000 7f684e34b700 1 -- 172.21.15.46:0/2071861914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6848068ab0 con 0x7f68480feb70 2024-02-19T19:00:10.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.453+0000 7f68457fa700 1 -- 172.21.15.46:0/2071861914 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f68380041f0 con 0x7f68480feb70 2024-02-19T19:00:10.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.453+0000 7f68457fa700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f683006c680 0x7f683006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:10.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.454+0000 7f68457fa700 1 -- 172.21.15.46:0/2071861914 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6838014070 con 0x7f68480feb70 2024-02-19T19:00:10.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.454+0000 7f68477fe700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f683006c680 0x7f683006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:10.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.454+0000 7f68477fe700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f683006c680 0x7f683006eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f683c00b6f0 tx=0x7f683c005a90 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:10.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.458+0000 7f68457fa700 1 -- 172.21.15.46:0/2071861914 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6838059e20 con 0x7f68480feb70 2024-02-19T19:00:10.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:10.693+0000 7f684e34b700 1 -- 172.21.15.46:0/2071861914 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f68481089c0 con 0x7f683006c680 2024-02-19T19:00:11.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:11 smithi046 ceph-mon[29647]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-02-19T19:00:11.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:11 smithi142 ceph-mon[37169]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-02-19T19:00:12.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:12 smithi046 ceph-mon[29647]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:12.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:12 smithi142 ceph-mon[37169]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:13.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:13 smithi142 ceph-mon[37169]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-19T19:00:13.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:13 smithi046 ceph-mon[29647]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-19T19:00:15.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:15 smithi046 ceph-mon[29647]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-19T19:00:15.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:15 smithi142 ceph-mon[37169]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-19T19:00:17.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:17 smithi046 ceph-mon[29647]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-19T19:00:17.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:17.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:17 smithi142 ceph-mon[37169]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-19T19:00:17.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:19.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:19 smithi142 ceph-mon[37169]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:19.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:19 smithi046 ceph-mon[29647]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:21.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:21 smithi046 ceph-mon[29647]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:21.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:21 smithi142 ceph-mon[37169]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:23.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:23 smithi046 ceph-mon[29647]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:23.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:23 smithi142 ceph-mon[37169]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:25.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:25 smithi046 ceph-mon[29647]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:25.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:25 smithi142 ceph-mon[37169]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:27.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:27 smithi046 ceph-mon[29647]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:27 smithi142 ceph-mon[37169]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:29.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:29 smithi142 ceph-mon[37169]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:29.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:29 smithi046 ceph-mon[29647]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:31.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:31 smithi142 ceph-mon[37169]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:31.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:31 smithi046 ceph-mon[29647]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:32.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:32 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:32.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:32 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:33.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:33 smithi046 ceph-mon[29647]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:33.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:33 smithi142 ceph-mon[37169]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:35.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:35 smithi046 ceph-mon[29647]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-19T19:00:35.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:35 smithi142 ceph-mon[37169]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-19T19:00:37.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:37 smithi046 ceph-mon[29647]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:00:37.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:37 smithi142 ceph-mon[37169]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:00:39.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:39 smithi046 ceph-mon[29647]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:00:39.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:39 smithi142 ceph-mon[37169]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:00:41.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:41 smithi142 ceph-mon[37169]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-19T19:00:41.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:41 smithi046 ceph-mon[29647]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-19T19:00:43.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:43 smithi046 ceph-mon[29647]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-19T19:00:43.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:43 smithi142 ceph-mon[37169]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-19T19:00:45.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:45 smithi046 ceph-mon[29647]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-19T19:00:45.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:45 smithi142 ceph-mon[37169]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-19T19:00:47.184 INFO:teuthology.orchestra.run.smithi046.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:00:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.165+0000 7f68457fa700 1 -- 172.21.15.46:0/2071861914 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f68481089c0 con 0x7f683006c680 2024-02-19T19:00:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 -- 172.21.15.46:0/2071861914 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f683006c680 msgr2=0x7f683006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f683006c680 0x7f683006eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f683c00b6f0 tx=0x7f683c005a90 comp rx=0 tx=0).stop 2024-02-19T19:00:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 -- 172.21.15.46:0/2071861914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68480feb70 msgr2=0x7f6848197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68480feb70 0x7f6848197fe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f683800e8f0 tx=0x7f683800ec00 comp rx=0 tx=0).stop 2024-02-19T19:00:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 -- 172.21.15.46:0/2071861914 shutdown_connections 2024-02-19T19:00:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f683006c680 0x7f683006eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68480feb70 0x7f6848197fe0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:47.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 --2- 172.21.15.46:0/2071861914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480ff4c0 0x7f6848198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:47.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 -- 172.21.15.46:0/2071861914 >> 172.21.15.46:0/2071861914 conn(0x7f68480fa7a0 msgr2=0x7f6848107240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:47.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 -- 172.21.15.46:0/2071861914 shutdown_connections 2024-02-19T19:00:47.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:47.167+0000 7f684e34b700 1 -- 172.21.15.46:0/2071861914 wait complete. 2024-02-19T19:00:47.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:47 smithi046 ceph-mon[29647]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-19T19:00:47.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:47 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:00:47.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:47 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:47.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:47 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:00:47.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:47 smithi142 ceph-mon[37169]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-19T19:00:47.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:47 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:00:47.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:47 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:47.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:47 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:00:47.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-19T19:00:48.170 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:00:48.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:48 smithi046 ceph-mon[29647]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:00:48.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:48.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:00:48.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:48 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:00:48.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:48 smithi142 ceph-mon[37169]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:00:48.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:48 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:48.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:48 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:00:48.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:48 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:00:49.513 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:49 smithi046 ceph-mon[29647]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-19T19:00:49.513 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:49 smithi046 ceph-mon[29647]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:00:49.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:49 smithi142 ceph-mon[37169]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-19T19:00:49.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:49 smithi142 ceph-mon[37169]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:00:51.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:51 smithi142 ceph-mon[37169]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-19T19:00:51.551 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:51 smithi046 ceph-mon[29647]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-19T19:00:53.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.300+0000 7fef8935d700 1 -- 172.21.15.46:0/3835710237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef84103670 msgr2=0x7fef84105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:53.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.300+0000 7fef8935d700 1 --2- 172.21.15.46:0/3835710237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef84103670 0x7fef84105a50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fef78009910 tx=0x7fef78009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:53.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.300+0000 7fef8935d700 1 -- 172.21.15.46:0/3835710237 shutdown_connections 2024-02-19T19:00:53.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.300+0000 7fef8935d700 1 --2- 172.21.15.46:0/3835710237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef84103670 0x7fef84105a50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.300+0000 7fef8935d700 1 --2- 172.21.15.46:0/3835710237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef84100d50 0x7fef84103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.300+0000 7fef8935d700 1 -- 172.21.15.46:0/3835710237 >> 172.21.15.46:0/3835710237 conn(0x7fef840fa6d0 msgr2=0x7fef840fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:53.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.300+0000 7fef8935d700 1 -- 172.21.15.46:0/3835710237 shutdown_connections 2024-02-19T19:00:53.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.300+0000 7fef8935d700 1 -- 172.21.15.46:0/3835710237 wait complete. 2024-02-19T19:00:53.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.301+0000 7fef8935d700 1 Processor -- start 2024-02-19T19:00:53.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.301+0000 7fef8935d700 1 -- start start 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.301+0000 7fef8935d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef84100d50 0x7fef84195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.301+0000 7fef8935d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef84103670 0x7fef84195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.301+0000 7fef8935d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef841965c0 con 0x7fef84103670 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.301+0000 7fef8935d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef84196700 con 0x7fef84100d50 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.301+0000 7fef827fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef84103670 0x7fef84195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.301+0000 7fef827fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef84103670 0x7fef84195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56354/0 (socket says 172.21.15.46:56354) 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.301+0000 7fef827fc700 1 -- 172.21.15.46:0/1893576266 learned_addr learned my addr 172.21.15.46:0/1893576266 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.301+0000 7fef82ffd700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef84100d50 0x7fef84195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.302+0000 7fef827fc700 1 -- 172.21.15.46:0/1893576266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef84100d50 msgr2=0x7fef84195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.302+0000 7fef827fc700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef84100d50 0x7fef84195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.302+0000 7fef827fc700 1 -- 172.21.15.46:0/1893576266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef780095f0 con 0x7fef84103670 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.302+0000 7fef827fc700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef84103670 0x7fef84195fa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fef7800bd70 tx=0x7fef7800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.302+0000 7fef6bfff700 1 -- 172.21.15.46:0/1893576266 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef7801d070 con 0x7fef84103670 2024-02-19T19:00:53.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.302+0000 7fef8935d700 1 -- 172.21.15.46:0/1893576266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8419b150 con 0x7fef84103670 2024-02-19T19:00:53.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.302+0000 7fef6bfff700 1 -- 172.21.15.46:0/1893576266 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fef78005dc0 con 0x7fef84103670 2024-02-19T19:00:53.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.302+0000 7fef6bfff700 1 -- 172.21.15.46:0/1893576266 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef78021410 con 0x7fef84103670 2024-02-19T19:00:53.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.302+0000 7fef8935d700 1 -- 172.21.15.46:0/1893576266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8419b640 con 0x7fef84103670 2024-02-19T19:00:53.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.303+0000 7fef8935d700 1 -- 172.21.15.46:0/1893576266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8418fc60 con 0x7fef84103670 2024-02-19T19:00:53.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.304+0000 7fef6bfff700 1 -- 172.21.15.46:0/1893576266 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fef78003a60 con 0x7fef84103670 2024-02-19T19:00:53.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.304+0000 7fef6bfff700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fef6c06c680 0x7fef6c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:53.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.304+0000 7fef6bfff700 1 -- 172.21.15.46:0/1893576266 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fef7808cbd0 con 0x7fef84103670 2024-02-19T19:00:53.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.304+0000 7fef82ffd700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fef6c06c680 0x7fef6c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:53.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.305+0000 7fef82ffd700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fef6c06c680 0x7fef6c06eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef74005950 tx=0x7fef7400b410 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:53.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.309+0000 7fef6bfff700 1 -- 172.21.15.46:0/1893576266 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fef7805ace0 con 0x7fef84103670 2024-02-19T19:00:53.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:53 smithi046 ceph-mon[29647]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:00:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:00:53.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:53 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:00:53.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.541+0000 7fef8935d700 1 -- 172.21.15.46:0/1893576266 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef84061190 con 0x7fef6c06c680 2024-02-19T19:00:53.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.542+0000 7fef6bfff700 1 -- 172.21.15.46:0/1893576266 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fef84061190 con 0x7fef6c06c680 2024-02-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 -- 172.21.15.46:0/1893576266 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fef6c06c680 msgr2=0x7fef6c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fef6c06c680 0x7fef6c06eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef74005950 tx=0x7fef7400b410 comp rx=0 tx=0).stop 2024-02-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 -- 172.21.15.46:0/1893576266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef84103670 msgr2=0x7fef84195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef84103670 0x7fef84195fa0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fef7800bd70 tx=0x7fef7800bda0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 -- 172.21.15.46:0/1893576266 shutdown_connections 2024-02-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fef6c06c680 0x7fef6c06eb30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef84100d50 0x7fef84195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 --2- 172.21.15.46:0/1893576266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef84103670 0x7fef84195fa0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 -- 172.21.15.46:0/1893576266 >> 172.21.15.46:0/1893576266 conn(0x7fef840fa6d0 msgr2=0x7fef840fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:53.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 -- 172.21.15.46:0/1893576266 shutdown_connections 2024-02-19T19:00:53.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.544+0000 7fef8935d700 1 -- 172.21.15.46:0/1893576266 wait complete. 2024-02-19T19:00:53.574 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.653+0000 7feed67f6700 1 -- 172.21.15.46:0/934472514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed00ff140 msgr2=0x7feed00ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.653+0000 7feed67f6700 1 --2- 172.21.15.46:0/934472514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed00ff140 0x7feed00ff550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feec0009910 tx=0x7feec0009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.653+0000 7feed67f6700 1 -- 172.21.15.46:0/934472514 shutdown_connections 2024-02-19T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.653+0000 7feed67f6700 1 --2- 172.21.15.46:0/934472514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed0100340 0x7feed0100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.653+0000 7feed67f6700 1 --2- 172.21.15.46:0/934472514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed00ff140 0x7feed00ff550 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.653+0000 7feed67f6700 1 -- 172.21.15.46:0/934472514 >> 172.21.15.46:0/934472514 conn(0x7feed00fa6d0 msgr2=0x7feed00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.653+0000 7feed67f6700 1 -- 172.21.15.46:0/934472514 shutdown_connections 2024-02-19T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.653+0000 7feed67f6700 1 -- 172.21.15.46:0/934472514 wait complete. 2024-02-19T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.653+0000 7feed67f6700 1 Processor -- start 2024-02-19T19:00:53.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.653+0000 7feed67f6700 1 -- start start 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feed67f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed00ff140 0x7feed0069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feed67f6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed0100340 0x7feed019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feed67f6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019ade0 con 0x7feed00ff140 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feed67f6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019af20 con 0x7feed0100340 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed00ff140 0x7feed0069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecffff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed00ff140 0x7feed0069970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56374/0 (socket says 172.21.15.46:56374) 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecffff700 1 -- 172.21.15.46:0/2992974279 learned_addr learned my addr 172.21.15.46:0/2992974279 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecf7fe700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed0100340 0x7feed019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecffff700 1 -- 172.21.15.46:0/2992974279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed0100340 msgr2=0x7feed019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecffff700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed0100340 0x7feed019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecffff700 1 -- 172.21.15.46:0/2992974279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00095f0 con 0x7feed00ff140 2024-02-19T19:00:53.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecffff700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed00ff140 0x7feed0069970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feec000bda0 tx=0x7feec000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:53.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecd7fa700 1 -- 172.21.15.46:0/2992974279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feec001d070 con 0x7feed00ff140 2024-02-19T19:00:53.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feed67f6700 1 -- 172.21.15.46:0/2992974279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed019b1a0 con 0x7feed00ff140 2024-02-19T19:00:53.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecd7fa700 1 -- 172.21.15.46:0/2992974279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feec000f460 con 0x7feed00ff140 2024-02-19T19:00:53.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feecd7fa700 1 -- 172.21.15.46:0/2992974279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feec0021640 con 0x7feed00ff140 2024-02-19T19:00:53.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.654+0000 7feed67f6700 1 -- 172.21.15.46:0/2992974279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed019b690 con 0x7feed00ff140 2024-02-19T19:00:53.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.655+0000 7feed67f6700 1 -- 172.21.15.46:0/2992974279 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed0107c90 con 0x7feed00ff140 2024-02-19T19:00:53.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.656+0000 7feecd7fa700 1 -- 172.21.15.46:0/2992974279 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7feec000f5d0 con 0x7feed00ff140 2024-02-19T19:00:53.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.656+0000 7feecd7fa700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7feebc06c680 0x7feebc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:53.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.656+0000 7feecd7fa700 1 -- 172.21.15.46:0/2992974279 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7feec008cbb0 con 0x7feed00ff140 2024-02-19T19:00:53.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.656+0000 7feecf7fe700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7feebc06c680 0x7feebc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:53.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.657+0000 7feecf7fe700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7feebc06c680 0x7feebc06eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feed0069ef0 tx=0x7feeb800b410 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:53.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.661+0000 7feecd7fa700 1 -- 172.21.15.46:0/2992974279 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7feec0093080 con 0x7feed00ff140 2024-02-19T19:00:53.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:53 smithi142 ceph-mon[37169]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:53.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:53 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:00:53.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:53 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:00:53.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:53 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:00:53.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.879+0000 7feed67f6700 1 -- 172.21.15.46:0/2992974279 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feed0104c90 con 0x7feebc06c680 2024-02-19T19:00:53.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.880+0000 7feecd7fa700 1 -- 172.21.15.46:0/2992974279 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7feed0104c90 con 0x7feebc06c680 2024-02-19T19:00:53.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 -- 172.21.15.46:0/2992974279 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7feebc06c680 msgr2=0x7feebc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:53.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7feebc06c680 0x7feebc06eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feed0069ef0 tx=0x7feeb800b410 comp rx=0 tx=0).stop 2024-02-19T19:00:53.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 -- 172.21.15.46:0/2992974279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed00ff140 msgr2=0x7feed0069970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:53.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed00ff140 0x7feed0069970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feec000bda0 tx=0x7feec000bdd0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 -- 172.21.15.46:0/2992974279 shutdown_connections 2024-02-19T19:00:53.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7feebc06c680 0x7feebc06eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feed00ff140 0x7feed0069970 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 --2- 172.21.15.46:0/2992974279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feed0100340 0x7feed019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:53.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 -- 172.21.15.46:0/2992974279 >> 172.21.15.46:0/2992974279 conn(0x7feed00fa6d0 msgr2=0x7feed0103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:53.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 -- 172.21.15.46:0/2992974279 shutdown_connections 2024-02-19T19:00:53.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.883+0000 7feed67f6700 1 -- 172.21.15.46:0/2992974279 wait complete. 2024-02-19T19:00:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.990+0000 7fbb276ca700 1 -- 172.21.15.46:0/1689644558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb201003f0 msgr2=0x7fbb20100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.990+0000 7fbb276ca700 1 --2- 172.21.15.46:0/1689644558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb201003f0 0x7fbb20100860 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009910 tx=0x7fbb14009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.990+0000 7fbb276ca700 1 -- 172.21.15.46:0/1689644558 shutdown_connections 2024-02-19T19:00:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.990+0000 7fbb276ca700 1 --2- 172.21.15.46:0/1689644558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb201003f0 0x7fbb20100860 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.990+0000 7fbb276ca700 1 --2- 172.21.15.46:0/1689644558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb200ff150 0x7fbb200ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.990+0000 7fbb276ca700 1 -- 172.21.15.46:0/1689644558 >> 172.21.15.46:0/1689644558 conn(0x7fbb200fa7a0 msgr2=0x7fbb200fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:54.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.990+0000 7fbb276ca700 1 -- 172.21.15.46:0/1689644558 shutdown_connections 2024-02-19T19:00:54.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.990+0000 7fbb276ca700 1 -- 172.21.15.46:0/1689644558 wait complete. 2024-02-19T19:00:54.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.991+0000 7fbb276ca700 1 Processor -- start 2024-02-19T19:00:54.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.991+0000 7fbb276ca700 1 -- start start 2024-02-19T19:00:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.991+0000 7fbb276ca700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb200ff150 0x7fbb20197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.991+0000 7fbb276ca700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb201003f0 0x7fbb201984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.991+0000 7fbb276ca700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20198b10 con 0x7fbb201003f0 2024-02-19T19:00:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.991+0000 7fbb276ca700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20198c50 con 0x7fbb200ff150 2024-02-19T19:00:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.991+0000 7fbb24c65700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb201003f0 0x7fbb201984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.991+0000 7fbb24c65700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb201003f0 0x7fbb201984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56394/0 (socket says 172.21.15.46:56394) 2024-02-19T19:00:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.991+0000 7fbb24c65700 1 -- 172.21.15.46:0/1103218433 learned_addr learned my addr 172.21.15.46:0/1103218433 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:00:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.991+0000 7fbb25466700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb200ff150 0x7fbb20197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.992+0000 7fbb24c65700 1 -- 172.21.15.46:0/1103218433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb200ff150 msgr2=0x7fbb20197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.992+0000 7fbb24c65700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb200ff150 0x7fbb20197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.992+0000 7fbb24c65700 1 -- 172.21.15.46:0/1103218433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb140095f0 con 0x7fbb201003f0 2024-02-19T19:00:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.992+0000 7fbb24c65700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb201003f0 0x7fbb201984f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbb14006010 tx=0x7fbb1400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.992+0000 7fbb127fc700 1 -- 172.21.15.46:0/1103218433 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb1401d070 con 0x7fbb201003f0 2024-02-19T19:00:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.992+0000 7fbb276ca700 1 -- 172.21.15.46:0/1103218433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2019d6a0 con 0x7fbb201003f0 2024-02-19T19:00:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.992+0000 7fbb127fc700 1 -- 172.21.15.46:0/1103218433 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb1400f460 con 0x7fbb201003f0 2024-02-19T19:00:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.992+0000 7fbb127fc700 1 -- 172.21.15.46:0/1103218433 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb14021640 con 0x7fbb201003f0 2024-02-19T19:00:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.992+0000 7fbb276ca700 1 -- 172.21.15.46:0/1103218433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2019db90 con 0x7fbb201003f0 2024-02-19T19:00:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.993+0000 7fbb276ca700 1 -- 172.21.15.46:0/1103218433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb20068ab0 con 0x7fbb201003f0 2024-02-19T19:00:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.994+0000 7fbb127fc700 1 -- 172.21.15.46:0/1103218433 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbb1400fab0 con 0x7fbb201003f0 2024-02-19T19:00:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.994+0000 7fbb127fc700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb0c06c680 0x7fbb0c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.994+0000 7fbb127fc700 1 -- 172.21.15.46:0/1103218433 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbb1408cb60 con 0x7fbb201003f0 2024-02-19T19:00:54.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.994+0000 7fbb25466700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb0c06c680 0x7fbb0c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:54.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.995+0000 7fbb25466700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb0c06c680 0x7fbb0c06eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c005950 tx=0x7fbb1c00b410 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:54.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:53.999+0000 7fbb127fc700 1 -- 172.21.15.46:0/1103218433 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbb1405ac70 con 0x7fbb201003f0 2024-02-19T19:00:54.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.213+0000 7fbb276ca700 1 -- 172.21.15.46:0/1103218433 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb200694e0 con 0x7fbb0c06c680 2024-02-19T19:00:54.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.223+0000 7fbb127fc700 1 -- 172.21.15.46:0/1103218433 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7fbb200694e0 con 0x7fbb0c06c680 2024-02-19T19:00:54.271 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:00:54.271 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 65s ago 7m 25.1M - 0.25.0 c8568f914cd2 cfbe74f8660f 2024-02-19T19:00:54.271 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (7m) 65s ago 7m 7428k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:00:54.271 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (6m) 71s ago 6m 7352k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:00:54.271 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (7m) 65s ago 7m 6656k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:00:54.271 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (6m) 71s ago 6m 6665k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:00:54.271 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 65s ago 6m 84.3M - 9.4.7 954c08fa6188 2fa87d8c964a 2024-02-19T19:00:54.271 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (85s) 65s ago 84s 17.1M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:00:54.271 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (90s) 65s ago 90s 11.4M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:00:54.271 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (82s) 71s ago 81s 12.3M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (88s) 71s ago 87s 15.0M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:9283,8765,8443 running (9m) 65s ago 9m 488M - 18.2.0 dc2bc1663786 513c14e92ab1 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (5m) 71s ago 5m 440M - 18.2.0 dc2bc1663786 97004ff2f216 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (9m) 65s ago 9m 45.3M 2048M 18.2.0 dc2bc1663786 adb8243bd11c 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (5m) 71s ago 5m 36.5M 2048M 18.2.0 dc2bc1663786 3f6c8b69abc2 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 65s ago 7m 16.4M - 1.5.0 0da6a335fe13 6fcd0bc86aba 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (6m) 71s ago 6m 15.9M - 1.5.0 0da6a335fe13 bdfda6603f51 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (5m) 65s ago 5m 48.8M 3948M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (4m) 65s ago 4m 47.0M 3948M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (4m) 65s ago 4m 48.8M 3948M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (3m) 71s ago 3m 46.5M 4970M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (3m) 71s ago 3m 43.8M 4970M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:00:54.272 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (2m) 71s ago 2m 44.3M 4970M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:00:54.273 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 65s ago 6m 64.5M - 2.43.0 a07b618ecd1d c0b60f66a9ef 2024-02-19T19:00:54.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 -- 172.21.15.46:0/1103218433 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb0c06c680 msgr2=0x7fbb0c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb0c06c680 0x7fbb0c06eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c005950 tx=0x7fbb1c00b410 comp rx=0 tx=0).stop 2024-02-19T19:00:54.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 -- 172.21.15.46:0/1103218433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb201003f0 msgr2=0x7fbb201984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb201003f0 0x7fbb201984f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbb14006010 tx=0x7fbb1400bd70 comp rx=0 tx=0).stop 2024-02-19T19:00:54.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 -- 172.21.15.46:0/1103218433 shutdown_connections 2024-02-19T19:00:54.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fbb0c06c680 0x7fbb0c06eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb200ff150 0x7fbb20197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 --2- 172.21.15.46:0/1103218433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb201003f0 0x7fbb201984f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 -- 172.21.15.46:0/1103218433 >> 172.21.15.46:0/1103218433 conn(0x7fbb200fa7a0 msgr2=0x7fbb20068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:54.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 -- 172.21.15.46:0/1103218433 shutdown_connections 2024-02-19T19:00:54.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.226+0000 7fbb276ca700 1 -- 172.21.15.46:0/1103218433 wait complete. 2024-02-19T19:00:54.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:54 smithi046 ceph-mon[29647]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (unknown) 2024-02-19T19:00:54.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:54 smithi046 ceph-mon[29647]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-19T19:00:54.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:54 smithi046 ceph-mon[29647]: Upgrade: Need to upgrade myself (mgr.smithi046.qtceex) 2024-02-19T19:00:54.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.332+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/76006111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e18100d60 msgr2=0x7f3e18103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.332+0000 7f3e1d7d6700 1 --2- 172.21.15.46:0/76006111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e18100d60 0x7f3e18103140 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800b0a0 tx=0x7f3e0800b3b0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.332+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/76006111 shutdown_connections 2024-02-19T19:00:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.332+0000 7f3e1d7d6700 1 --2- 172.21.15.46:0/76006111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e18103680 0x7f3e18105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.332+0000 7f3e1d7d6700 1 --2- 172.21.15.46:0/76006111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e18100d60 0x7f3e18103140 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.332+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/76006111 >> 172.21.15.46:0/76006111 conn(0x7f3e180fa780 msgr2=0x7f3e180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.332+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/76006111 shutdown_connections 2024-02-19T19:00:54.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.332+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/76006111 wait complete. 2024-02-19T19:00:54.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.332+0000 7f3e1d7d6700 1 Processor -- start 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e1d7d6700 1 -- start start 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e1d7d6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e18100d60 0x7f3e18195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e1d7d6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e18103680 0x7f3e18195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e1d7d6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e18196610 con 0x7f3e18100d60 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e1d7d6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e18196750 con 0x7f3e18103680 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e16ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e18100d60 0x7f3e18195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e16ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e18100d60 0x7f3e18195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56414/0 (socket says 172.21.15.46:56414) 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e16ffd700 1 -- 172.21.15.46:0/1030224822 learned_addr learned my addr 172.21.15.46:0/1030224822 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e167fc700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e18103680 0x7f3e18195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e16ffd700 1 -- 172.21.15.46:0/1030224822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e18103680 msgr2=0x7f3e18195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e16ffd700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e18103680 0x7f3e18195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e16ffd700 1 -- 172.21.15.46:0/1030224822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e08009d00 con 0x7f3e18100d60 2024-02-19T19:00:54.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.333+0000 7f3e16ffd700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e18100d60 0x7f3e18195ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3e080077b0 tx=0x7f3e08009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.334+0000 7f3e0ffff700 1 -- 172.21.15.46:0/1030224822 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e0800e040 con 0x7f3e18100d60 2024-02-19T19:00:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.334+0000 7f3e0ffff700 1 -- 172.21.15.46:0/1030224822 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e08003de0 con 0x7f3e18100d60 2024-02-19T19:00:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.334+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/1030224822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1819b1a0 con 0x7f3e18100d60 2024-02-19T19:00:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.334+0000 7f3e0ffff700 1 -- 172.21.15.46:0/1030224822 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e0801d7f0 con 0x7f3e18100d60 2024-02-19T19:00:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.334+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/1030224822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1819b690 con 0x7f3e18100d60 2024-02-19T19:00:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.334+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/1030224822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1818fbc0 con 0x7f3e18100d60 2024-02-19T19:00:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.335+0000 7f3e0ffff700 1 -- 172.21.15.46:0/1030224822 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3e08004780 con 0x7f3e18100d60 2024-02-19T19:00:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.335+0000 7f3e0ffff700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3e0406c680 0x7f3e0406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.336+0000 7f3e0ffff700 1 -- 172.21.15.46:0/1030224822 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3e0808d4d0 con 0x7f3e18100d60 2024-02-19T19:00:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.336+0000 7f3e167fc700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3e0406c680 0x7f3e0406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:54.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.336+0000 7f3e167fc700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3e0406c680 0x7f3e0406eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3e00007be0 tx=0x7f3e000073d0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:54.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.340+0000 7f3e0ffff700 1 -- 172.21.15.46:0/1030224822 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3e0805b6a0 con 0x7f3e18100d60 2024-02-19T19:00:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.629+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/1030224822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e1802cc30 con 0x7f3e18100d60 2024-02-19T19:00:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.630+0000 7f3e0ffff700 1 -- 172.21.15.46:0/1030224822 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f3e0805b230 con 0x7f3e18100d60 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:00:54.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:00:54.650 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:00:54.650 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-02-19T19:00:54.650 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:00:54.650 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:00:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/1030224822 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3e0406c680 msgr2=0x7f3e0406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3e0406c680 0x7f3e0406eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3e00007be0 tx=0x7f3e000073d0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/1030224822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e18100d60 msgr2=0x7f3e18195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e18100d60 0x7f3e18195ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3e080077b0 tx=0x7f3e08009760 comp rx=0 tx=0).stop 2024-02-19T19:00:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/1030224822 shutdown_connections 2024-02-19T19:00:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f3e0406c680 0x7f3e0406eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e18100d60 0x7f3e18195ab0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 --2- 172.21.15.46:0/1030224822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e18103680 0x7f3e18195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/1030224822 >> 172.21.15.46:0/1030224822 conn(0x7f3e180fa780 msgr2=0x7f3e180fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/1030224822 shutdown_connections 2024-02-19T19:00:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.632+0000 7f3e1d7d6700 1 -- 172.21.15.46:0/1030224822 wait complete. 2024-02-19T19:00:54.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:54 smithi142 ceph-mon[37169]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (unknown) 2024-02-19T19:00:54.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:54 smithi142 ceph-mon[37169]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-19T19:00:54.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:54 smithi142 ceph-mon[37169]: Upgrade: Need to upgrade myself (mgr.smithi046.qtceex) 2024-02-19T19:00:54.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.742+0000 7f5a9ab23700 1 -- 172.21.15.46:0/36238860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a941006f0 msgr2=0x7f5a94100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.742+0000 7f5a9ab23700 1 --2- 172.21.15.46:0/36238860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a941006f0 0x7f5a94100b00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009910 tx=0x7f5a88009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.742+0000 7f5a9ab23700 1 -- 172.21.15.46:0/36238860 shutdown_connections 2024-02-19T19:00:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.742+0000 7f5a9ab23700 1 --2- 172.21.15.46:0/36238860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a940ff430 0x7f5a940ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.742+0000 7f5a9ab23700 1 --2- 172.21.15.46:0/36238860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a941006f0 0x7f5a94100b00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.742+0000 7f5a9ab23700 1 -- 172.21.15.46:0/36238860 >> 172.21.15.46:0/36238860 conn(0x7f5a940f9e70 msgr2=0x7f5a940fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.742+0000 7f5a9ab23700 1 -- 172.21.15.46:0/36238860 shutdown_connections 2024-02-19T19:00:54.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.742+0000 7f5a9ab23700 1 -- 172.21.15.46:0/36238860 wait complete. 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.742+0000 7f5a9ab23700 1 Processor -- start 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.742+0000 7f5a9ab23700 1 -- start start 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a9ab23700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a940ff430 0x7f5a941031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a9ab23700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a941006f0 0x7f5a94101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a9ab23700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94101d60 con 0x7f5a941006f0 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a9ab23700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94101ea0 con 0x7f5a940ff430 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a93fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a941006f0 0x7f5a94101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a93fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a941006f0 0x7f5a94101820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56434/0 (socket says 172.21.15.46:56434) 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a93fff700 1 -- 172.21.15.46:0/1569113444 learned_addr learned my addr 172.21.15.46:0/1569113444 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a988bf700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a940ff430 0x7f5a941031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a93fff700 1 -- 172.21.15.46:0/1569113444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a940ff430 msgr2=0x7f5a941031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a93fff700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a940ff430 0x7f5a941031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a93fff700 1 -- 172.21.15.46:0/1569113444 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a880095f0 con 0x7f5a941006f0 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a93fff700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a941006f0 0x7f5a94101820 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000e920 tx=0x7f5a8000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:54.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a91ffb700 1 -- 172.21.15.46:0/1569113444 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a8000c9d0 con 0x7f5a941006f0 2024-02-19T19:00:54.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a91ffb700 1 -- 172.21.15.46:0/1569113444 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a80010430 con 0x7f5a941006f0 2024-02-19T19:00:54.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a91ffb700 1 -- 172.21.15.46:0/1569113444 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a80018650 con 0x7f5a941006f0 2024-02-19T19:00:54.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.743+0000 7f5a9ab23700 1 -- 172.21.15.46:0/1569113444 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a94102180 con 0x7f5a941006f0 2024-02-19T19:00:54.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.744+0000 7f5a9ab23700 1 -- 172.21.15.46:0/1569113444 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9419db80 con 0x7f5a941006f0 2024-02-19T19:00:54.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.745+0000 7f5a9ab23700 1 -- 172.21.15.46:0/1569113444 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a94107ca0 con 0x7f5a941006f0 2024-02-19T19:00:54.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.745+0000 7f5a91ffb700 1 -- 172.21.15.46:0/1569113444 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5a800105a0 con 0x7f5a941006f0 2024-02-19T19:00:54.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.746+0000 7f5a91ffb700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a8406c680 0x7f5a8406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:54.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.746+0000 7f5a91ffb700 1 -- 172.21.15.46:0/1569113444 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5a80014070 con 0x7f5a941006f0 2024-02-19T19:00:54.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.746+0000 7f5a988bf700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a8406c680 0x7f5a8406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:54.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.746+0000 7f5a988bf700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a8406c680 0x7f5a8406eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009fd0 tx=0x7f5a88005a90 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:54.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.750+0000 7f5a91ffb700 1 -- 172.21.15.46:0/1569113444 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5a80051720 con 0x7f5a941006f0 2024-02-19T19:00:54.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.969+0000 7f5a9ab23700 1 -- 172.21.15.46:0/1569113444 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a940fea30 con 0x7f5a8406c680 2024-02-19T19:00:54.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.970+0000 7f5a91ffb700 1 -- 172.21.15.46:0/1569113444 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f5a940fea30 con 0x7f5a8406c680 2024-02-19T19:00:54.989 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:00:54.989 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:00:54.989 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:00:54.989 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:00:54.989 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-02-19T19:00:54.989 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "0/2 daemons upgraded", 2024-02-19T19:00:54.989 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 image on host smithi142", 2024-02-19T19:00:54.989 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:00:54.989 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:00:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 -- 172.21.15.46:0/1569113444 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a8406c680 msgr2=0x7f5a8406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a8406c680 0x7f5a8406eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009fd0 tx=0x7f5a88005a90 comp rx=0 tx=0).stop 2024-02-19T19:00:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 -- 172.21.15.46:0/1569113444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a941006f0 msgr2=0x7f5a94101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a941006f0 0x7f5a94101820 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000e920 tx=0x7f5a8000ec30 comp rx=0 tx=0).stop 2024-02-19T19:00:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 -- 172.21.15.46:0/1569113444 shutdown_connections 2024-02-19T19:00:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a8406c680 0x7f5a8406eb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a940ff430 0x7f5a941031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 --2- 172.21.15.46:0/1569113444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a941006f0 0x7f5a94101820 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:54.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 -- 172.21.15.46:0/1569113444 >> 172.21.15.46:0/1569113444 conn(0x7f5a940f9e70 msgr2=0x7f5a940fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 -- 172.21.15.46:0/1569113444 shutdown_connections 2024-02-19T19:00:54.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:00:54.973+0000 7f5a9ab23700 1 -- 172.21.15.46:0/1569113444 wait complete. 2024-02-19T19:00:55.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:55 smithi046 ceph-mon[29647]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 on smithi142 2024-02-19T19:00:55.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:55 smithi046 ceph-mon[29647]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:55.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:55 smithi046 ceph-mon[29647]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:55.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:55 smithi046 ceph-mon[29647]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:55.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:55 smithi046 ceph-mon[29647]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:55.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:55 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1030224822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:00:55.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:55 smithi142 ceph-mon[37169]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 on smithi142 2024-02-19T19:00:55.600 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:55 smithi142 ceph-mon[37169]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:55.600 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:55 smithi142 ceph-mon[37169]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:55.600 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:55 smithi142 ceph-mon[37169]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:55.600 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:55 smithi142 ceph-mon[37169]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:55.600 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:55 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1030224822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:00:56.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:56 smithi046 ceph-mon[29647]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:56.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:56 smithi142 ceph-mon[37169]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:57.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:57 smithi142 ceph-mon[37169]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:57.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:57 smithi046 ceph-mon[29647]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:59.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:00:59 smithi046 ceph-mon[29647]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:59.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:00:59 smithi142 ceph-mon[37169]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:01.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:01 smithi142 ceph-mon[37169]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:01.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:01 smithi046 ceph-mon[29647]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:02.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:02 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:02.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:02 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:03.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:03 smithi046 ceph-mon[29647]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:03.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:03 smithi142 ceph-mon[37169]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:05.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:05 smithi046 ceph-mon[29647]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:05.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:05 smithi142 ceph-mon[37169]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:07.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:07 smithi142 ceph-mon[37169]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:07.532 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:07 smithi046 ceph-mon[29647]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:09.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:09 smithi046 ceph-mon[29647]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:09.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:09 smithi142 ceph-mon[37169]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:11.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:11 smithi142 ceph-mon[37169]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:11.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:11 smithi046 ceph-mon[29647]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:13.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:13 smithi046 ceph-mon[29647]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:13.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:13 smithi142 ceph-mon[37169]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:15.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:15 smithi046 ceph-mon[29647]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:15.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:15 smithi142 ceph-mon[37169]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:17.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:17 smithi046 ceph-mon[29647]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:17.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:17 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:17.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:17 smithi142 ceph-mon[37169]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:17.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:17 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:19.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:19 smithi046 ceph-mon[29647]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:19.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:19 smithi142 ceph-mon[37169]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:21.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:21 smithi142 ceph-mon[37169]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:21.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:21 smithi046 ceph-mon[29647]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:23.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:23 smithi046 ceph-mon[29647]: pgmap v239: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:23.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:23 smithi142 ceph-mon[37169]: pgmap v239: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:25.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.093+0000 7f7e56a59700 1 -- 172.21.15.46:0/193530794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e501014e0 msgr2=0x7f7e50101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.093+0000 7f7e56a59700 1 --2- 172.21.15.46:0/193530794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e501014e0 0x7f7e50101950 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009910 tx=0x7f7e38009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.093+0000 7f7e56a59700 1 -- 172.21.15.46:0/193530794 shutdown_connections 2024-02-19T19:01:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.093+0000 7f7e56a59700 1 --2- 172.21.15.46:0/193530794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e501014e0 0x7f7e50101950 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.093+0000 7f7e56a59700 1 --2- 172.21.15.46:0/193530794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e50100240 0x7f7e50100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.093+0000 7f7e56a59700 1 -- 172.21.15.46:0/193530794 >> 172.21.15.46:0/193530794 conn(0x7f7e500fb890 msgr2=0x7f7e500fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.093+0000 7f7e56a59700 1 -- 172.21.15.46:0/193530794 shutdown_connections 2024-02-19T19:01:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.093+0000 7f7e56a59700 1 -- 172.21.15.46:0/193530794 wait complete. 2024-02-19T19:01:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.094+0000 7f7e56a59700 1 Processor -- start 2024-02-19T19:01:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.094+0000 7f7e56a59700 1 -- start start 2024-02-19T19:01:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.094+0000 7f7e56a59700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e50100240 0x7f7e50197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.094+0000 7f7e56a59700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e501014e0 0x7f7e501981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.094+0000 7f7e56a59700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e501987d0 con 0x7f7e501014e0 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.094+0000 7f7e56a59700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50198940 con 0x7f7e50100240 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.094+0000 7f7e47fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e501014e0 0x7f7e501981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.094+0000 7f7e47fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e501014e0 0x7f7e501981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44354/0 (socket says 172.21.15.46:44354) 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.094+0000 7f7e47fff700 1 -- 172.21.15.46:0/2479447477 learned_addr learned my addr 172.21.15.46:0/2479447477 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.094+0000 7f7e4ffff700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e50100240 0x7f7e50197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.095+0000 7f7e47fff700 1 -- 172.21.15.46:0/2479447477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e50100240 msgr2=0x7f7e50197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.095+0000 7f7e47fff700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e50100240 0x7f7e50197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.095+0000 7f7e47fff700 1 -- 172.21.15.46:0/2479447477 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e380095f0 con 0x7f7e501014e0 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.095+0000 7f7e47fff700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e501014e0 0x7f7e501981d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e38000c00 tx=0x7f7e3800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.095+0000 7f7e4dffb700 1 -- 172.21.15.46:0/2479447477 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e3801d070 con 0x7f7e501014e0 2024-02-19T19:01:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.095+0000 7f7e56a59700 1 -- 172.21.15.46:0/2479447477 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5019d370 con 0x7f7e501014e0 2024-02-19T19:01:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.095+0000 7f7e56a59700 1 -- 172.21.15.46:0/2479447477 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5019d860 con 0x7f7e501014e0 2024-02-19T19:01:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.095+0000 7f7e4dffb700 1 -- 172.21.15.46:0/2479447477 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e38005dc0 con 0x7f7e501014e0 2024-02-19T19:01:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.095+0000 7f7e4dffb700 1 -- 172.21.15.46:0/2479447477 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e380226a0 con 0x7f7e501014e0 2024-02-19T19:01:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.096+0000 7f7e56a59700 1 -- 172.21.15.46:0/2479447477 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e30005320 con 0x7f7e501014e0 2024-02-19T19:01:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.097+0000 7f7e4dffb700 1 -- 172.21.15.46:0/2479447477 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7e3800faf0 con 0x7f7e501014e0 2024-02-19T19:01:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.097+0000 7f7e4dffb700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7e3c06c680 0x7f7e3c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.097+0000 7f7e4ffff700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7e3c06c680 0x7f7e3c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.097+0000 7f7e4dffb700 1 -- 172.21.15.46:0/2479447477 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7e3808cd00 con 0x7f7e501014e0 2024-02-19T19:01:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.098+0000 7f7e4ffff700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7e3c06c680 0x7f7e3c06eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7e50198b70 tx=0x7f7e40009260 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.102+0000 7f7e4dffb700 1 -- 172.21.15.46:0/2479447477 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7e38090030 con 0x7f7e501014e0 2024-02-19T19:01:25.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.318+0000 7f7e56a59700 1 -- 172.21.15.46:0/2479447477 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e30000bf0 con 0x7f7e3c06c680 2024-02-19T19:01:25.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.319+0000 7f7e4dffb700 1 -- 172.21.15.46:0/2479447477 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f7e30000bf0 con 0x7f7e3c06c680 2024-02-19T19:01:25.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 -- 172.21.15.46:0/2479447477 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7e3c06c680 msgr2=0x7f7e3c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7e3c06c680 0x7f7e3c06eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7e50198b70 tx=0x7f7e40009260 comp rx=0 tx=0).stop 2024-02-19T19:01:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 -- 172.21.15.46:0/2479447477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e501014e0 msgr2=0x7f7e501981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e501014e0 0x7f7e501981d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e38000c00 tx=0x7f7e3800f690 comp rx=0 tx=0).stop 2024-02-19T19:01:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 -- 172.21.15.46:0/2479447477 shutdown_connections 2024-02-19T19:01:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f7e3c06c680 0x7f7e3c06eb30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e50100240 0x7f7e50197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 --2- 172.21.15.46:0/2479447477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e501014e0 0x7f7e501981d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 -- 172.21.15.46:0/2479447477 >> 172.21.15.46:0/2479447477 conn(0x7f7e500fb890 msgr2=0x7f7e50102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 -- 172.21.15.46:0/2479447477 shutdown_connections 2024-02-19T19:01:25.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.321+0000 7f7e56a59700 1 -- 172.21.15.46:0/2479447477 wait complete. 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:01:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.430+0000 7f5a65497700 1 -- 172.21.15.46:0/710727560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a600fe500 msgr2=0x7f5a600fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.430+0000 7f5a65497700 1 --2- 172.21.15.46:0/710727560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a600fe500 0x7f5a600fe910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800b0a0 tx=0x7f5a5800b3b0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.430+0000 7f5a65497700 1 -- 172.21.15.46:0/710727560 shutdown_connections 2024-02-19T19:01:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.430+0000 7f5a65497700 1 --2- 172.21.15.46:0/710727560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a600fee50 0x7f5a60101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.430+0000 7f5a65497700 1 --2- 172.21.15.46:0/710727560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a600fe500 0x7f5a600fe910 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.430+0000 7f5a65497700 1 -- 172.21.15.46:0/710727560 >> 172.21.15.46:0/710727560 conn(0x7f5a600f9f10 msgr2=0x7f5a600fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:25.449 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:25 smithi046 ceph-mon[29647]: pgmap v240: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:25.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.430+0000 7f5a65497700 1 -- 172.21.15.46:0/710727560 shutdown_connections 2024-02-19T19:01:25.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.430+0000 7f5a65497700 1 -- 172.21.15.46:0/710727560 wait complete. 2024-02-19T19:01:25.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.430+0000 7f5a65497700 1 Processor -- start 2024-02-19T19:01:25.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a65497700 1 -- start start 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a65497700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a600fe500 0x7f5a60100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a65497700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a600fee50 0x7f5a600ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a65497700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600ffa70 con 0x7f5a600fee50 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a65497700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600ffbb0 con 0x7f5a600fe500 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a5e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a600fee50 0x7f5a600ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a5e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a600fee50 0x7f5a600ff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44380/0 (socket says 172.21.15.46:44380) 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a5effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a600fe500 0x7f5a60100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a5e7fc700 1 -- 172.21.15.46:0/3029319006 learned_addr learned my addr 172.21.15.46:0/3029319006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a5e7fc700 1 -- 172.21.15.46:0/3029319006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a600fe500 msgr2=0x7f5a60100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a5e7fc700 1 --2- 172.21.15.46:0/3029319006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a600fe500 0x7f5a60100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.431+0000 7f5a5e7fc700 1 -- 172.21.15.46:0/3029319006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a58009d00 con 0x7f5a600fee50 2024-02-19T19:01:25.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.432+0000 7f5a5e7fc700 1 --2- 172.21.15.46:0/3029319006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a600fee50 0x7f5a600ff530 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800d8d0 tx=0x7f5a4800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:25.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.432+0000 7f5a57fff700 1 -- 172.21.15.46:0/3029319006 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a4800f860 con 0x7f5a600fee50 2024-02-19T19:01:25.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.432+0000 7f5a57fff700 1 -- 172.21.15.46:0/3029319006 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a4800fe70 con 0x7f5a600fee50 2024-02-19T19:01:25.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.432+0000 7f5a65497700 1 -- 172.21.15.46:0/3029319006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a600ffe90 con 0x7f5a600fee50 2024-02-19T19:01:25.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.432+0000 7f5a57fff700 1 -- 172.21.15.46:0/3029319006 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a4800e5e0 con 0x7f5a600fee50 2024-02-19T19:01:25.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.432+0000 7f5a65497700 1 -- 172.21.15.46:0/3029319006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6019dbb0 con 0x7f5a600fee50 2024-02-19T19:01:25.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.433+0000 7f5a65497700 1 -- 172.21.15.46:0/3029319006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a60108d50 con 0x7f5a600fee50 2024-02-19T19:01:25.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.433+0000 7f5a57fff700 1 -- 172.21.15.46:0/3029319006 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5a48010460 con 0x7f5a600fee50 2024-02-19T19:01:25.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.434+0000 7f5a57fff700 1 --2- 172.21.15.46:0/3029319006 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a4c06c680 0x7f5a4c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.434+0000 7f5a57fff700 1 -- 172.21.15.46:0/3029319006 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5a4808b4e0 con 0x7f5a600fee50 2024-02-19T19:01:25.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.434+0000 7f5a5effd700 1 --2- 172.21.15.46:0/3029319006 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a4c06c680 0x7f5a4c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.434+0000 7f5a5effd700 1 --2- 172.21.15.46:0/3029319006 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a4c06c680 0x7f5a4c06eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800b830 tx=0x7f5a58000f40 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:25.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.439+0000 7f5a57fff700 1 -- 172.21.15.46:0/3029319006 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5a480595f0 con 0x7f5a600fee50 2024-02-19T19:01:25.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.658+0000 7f5a65497700 1 -- 172.21.15.46:0/3029319006 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a60105ed0 con 0x7f5a4c06c680 2024-02-19T19:01:25.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.659+0000 7f5a57fff700 1 -- 172.21.15.46:0/3029319006 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f5a60105ed0 con 0x7f5a4c06c680 2024-02-19T19:01:25.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.661+0000 7f5a65497700 1 -- 172.21.15.46:0/3029319006 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a4c06c680 msgr2=0x7f5a4c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.661+0000 7f5a65497700 1 --2- 172.21.15.46:0/3029319006 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a4c06c680 0x7f5a4c06eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800b830 tx=0x7f5a58000f40 comp rx=0 tx=0).stop 2024-02-19T19:01:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.661+0000 7f5a65497700 1 -- 172.21.15.46:0/3029319006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a600fee50 msgr2=0x7f5a600ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.661+0000 7f5a65497700 1 --2- 172.21.15.46:0/3029319006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a600fee50 0x7f5a600ff530 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800d8d0 tx=0x7f5a4800dbe0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.661+0000 7f5a65497700 1 -- 172.21.15.46:0/3029319006 shutdown_connections 2024-02-19T19:01:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.661+0000 7f5a65497700 1 --2- 172.21.15.46:0/3029319006 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f5a4c06c680 0x7f5a4c06eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.661+0000 7f5a65497700 1 --2- 172.21.15.46:0/3029319006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a600fe500 0x7f5a60100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.661+0000 7f5a65497700 1 --2- 172.21.15.46:0/3029319006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a600fee50 0x7f5a600ff530 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.661+0000 7f5a65497700 1 -- 172.21.15.46:0/3029319006 >> 172.21.15.46:0/3029319006 conn(0x7f5a600f9f10 msgr2=0x7f5a601047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.662+0000 7f5a65497700 1 -- 172.21.15.46:0/3029319006 shutdown_connections 2024-02-19T19:01:25.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.662+0000 7f5a65497700 1 -- 172.21.15.46:0/3029319006 wait complete. 2024-02-19T19:01:25.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:25 smithi142 ceph-mon[37169]: pgmap v240: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:25.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.768+0000 7f0aa647e700 1 -- 172.21.15.46:0/2876694403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aa0100240 msgr2=0x7f0aa0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.768+0000 7f0aa647e700 1 --2- 172.21.15.46:0/2876694403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aa0100240 0x7f0aa0100650 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009910 tx=0x7f0a90009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.768+0000 7f0aa647e700 1 -- 172.21.15.46:0/2876694403 shutdown_connections 2024-02-19T19:01:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.768+0000 7f0aa647e700 1 --2- 172.21.15.46:0/2876694403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0aa0101440 0x7f0aa0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.768+0000 7f0aa647e700 1 --2- 172.21.15.46:0/2876694403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aa0100240 0x7f0aa0100650 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.768+0000 7f0aa647e700 1 -- 172.21.15.46:0/2876694403 >> 172.21.15.46:0/2876694403 conn(0x7f0aa00fb7f0 msgr2=0x7f0aa00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.768+0000 7f0aa647e700 1 -- 172.21.15.46:0/2876694403 shutdown_connections 2024-02-19T19:01:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.768+0000 7f0aa647e700 1 -- 172.21.15.46:0/2876694403 wait complete. 2024-02-19T19:01:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.769+0000 7f0aa647e700 1 Processor -- start 2024-02-19T19:01:25.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.769+0000 7f0aa647e700 1 -- start start 2024-02-19T19:01:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.769+0000 7f0aa647e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0aa0100240 0x7f0aa0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.769+0000 7f0aa647e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aa0101440 0x7f0aa0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.769+0000 7f0aa647e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0073680 con 0x7f0aa0101440 2024-02-19T19:01:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.769+0000 7f0aa647e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00737c0 con 0x7f0aa0100240 2024-02-19T19:01:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aa0101440 0x7f0aa0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aa0101440 0x7f0aa0073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44402/0 (socket says 172.21.15.46:44402) 2024-02-19T19:01:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9f7fe700 1 -- 172.21.15.46:0/4131340255 learned_addr learned my addr 172.21.15.46:0/4131340255 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:01:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9ffff700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0aa0100240 0x7f0aa0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9f7fe700 1 -- 172.21.15.46:0/4131340255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0aa0100240 msgr2=0x7f0aa0074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9f7fe700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0aa0100240 0x7f0aa0074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9f7fe700 1 -- 172.21.15.46:0/4131340255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900095f0 con 0x7f0aa0101440 2024-02-19T19:01:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9f7fe700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aa0101440 0x7f0aa0073140 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400b4b0 tx=0x7f0a9400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9d7fa700 1 -- 172.21.15.46:0/4131340255 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a94011800 con 0x7f0aa0101440 2024-02-19T19:01:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0aa647e700 1 -- 172.21.15.46:0/4131340255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa0073aa0 con 0x7f0aa0101440 2024-02-19T19:01:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9d7fa700 1 -- 172.21.15.46:0/4131340255 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a94011e10 con 0x7f0aa0101440 2024-02-19T19:01:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0a9d7fa700 1 -- 172.21.15.46:0/4131340255 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a9400f2e0 con 0x7f0aa0101440 2024-02-19T19:01:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.770+0000 7f0aa647e700 1 -- 172.21.15.46:0/4131340255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa019dbc0 con 0x7f0aa0101440 2024-02-19T19:01:25.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.772+0000 7f0aa647e700 1 -- 172.21.15.46:0/4131340255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa0108e10 con 0x7f0aa0101440 2024-02-19T19:01:25.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.772+0000 7f0a9d7fa700 1 -- 172.21.15.46:0/4131340255 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0a94010380 con 0x7f0aa0101440 2024-02-19T19:01:25.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.772+0000 7f0a9d7fa700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0a8806c680 0x7f0a8806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.772+0000 7f0a9d7fa700 1 -- 172.21.15.46:0/4131340255 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0a9408b460 con 0x7f0aa0101440 2024-02-19T19:01:25.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.772+0000 7f0a9ffff700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0a8806c680 0x7f0a8806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.773+0000 7f0a9ffff700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0a8806c680 0x7f0a8806eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a90006010 tx=0x7f0a90005280 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:25.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.777+0000 7f0a9d7fa700 1 -- 172.21.15.46:0/4131340255 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0a94059570 con 0x7f0aa0101440 2024-02-19T19:01:26.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.985+0000 7f0aa647e700 1 -- 172.21.15.46:0/4131340255 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0aa0105d90 con 0x7f0a8806c680 2024-02-19T19:01:26.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.995+0000 7f0a9d7fa700 1 -- 172.21.15.46:0/4131340255 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f0aa0105d90 con 0x7f0a8806c680 2024-02-19T19:01:26.014 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:01:26.014 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (6m) 96s ago 8m 25.1M - 0.25.0 c8568f914cd2 cfbe74f8660f 2024-02-19T19:01:26.014 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (8m) 96s ago 8m 7428k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:01:26.014 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (6m) 103s ago 6m 7352k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:01:26.014 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (8m) 96s ago 8m 6656k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (6m) 103s ago 6m 6665k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 96s ago 7m 84.3M - 9.4.7 954c08fa6188 2fa87d8c964a 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (116s) 96s ago 116s 17.1M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (2m) 96s ago 2m 11.4M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (114s) 103s ago 113s 12.3M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (119s) 103s ago 119s 15.0M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:9283,8765,8443 running (9m) 96s ago 9m 488M - 18.2.0 dc2bc1663786 513c14e92ab1 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (6m) 103s ago 6m 440M - 18.2.0 dc2bc1663786 97004ff2f216 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (9m) 96s ago 9m 45.3M 2048M 18.2.0 dc2bc1663786 adb8243bd11c 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (6m) 103s ago 6m 36.5M 2048M 18.2.0 dc2bc1663786 3f6c8b69abc2 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 96s ago 8m 16.4M - 1.5.0 0da6a335fe13 6fcd0bc86aba 2024-02-19T19:01:26.015 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (6m) 103s ago 6m 15.9M - 1.5.0 0da6a335fe13 bdfda6603f51 2024-02-19T19:01:26.016 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (5m) 96s ago 5m 48.8M 3948M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:01:26.016 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (5m) 96s ago 5m 47.0M 3948M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:01:26.016 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (4m) 96s ago 4m 48.8M 3948M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:01:26.016 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (4m) 103s ago 4m 46.5M 4970M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:01:26.016 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (3m) 103s ago 3m 43.8M 4970M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:01:26.016 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (3m) 103s ago 3m 44.3M 4970M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:01:26.016 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 96s ago 7m 64.5M - 2.43.0 a07b618ecd1d c0b60f66a9ef 2024-02-19T19:01:26.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.997+0000 7f0aa647e700 1 -- 172.21.15.46:0/4131340255 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0a8806c680 msgr2=0x7f0a8806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:26.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.997+0000 7f0aa647e700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0a8806c680 0x7f0a8806eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a90006010 tx=0x7f0a90005280 comp rx=0 tx=0).stop 2024-02-19T19:01:26.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.997+0000 7f0aa647e700 1 -- 172.21.15.46:0/4131340255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aa0101440 msgr2=0x7f0aa0073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:26.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.997+0000 7f0aa647e700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aa0101440 0x7f0aa0073140 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400b4b0 tx=0x7f0a9400b7c0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.998+0000 7f0aa647e700 1 -- 172.21.15.46:0/4131340255 shutdown_connections 2024-02-19T19:01:26.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.998+0000 7f0aa647e700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f0a8806c680 0x7f0a8806eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.998+0000 7f0aa647e700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0aa0100240 0x7f0aa0074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.998+0000 7f0aa647e700 1 --2- 172.21.15.46:0/4131340255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aa0101440 0x7f0aa0073140 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.998+0000 7f0aa647e700 1 -- 172.21.15.46:0/4131340255 >> 172.21.15.46:0/4131340255 conn(0x7f0aa00fb7f0 msgr2=0x7f0aa0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:26.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.998+0000 7f0aa647e700 1 -- 172.21.15.46:0/4131340255 shutdown_connections 2024-02-19T19:01:26.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:25.998+0000 7f0aa647e700 1 -- 172.21.15.46:0/4131340255 wait complete. 2024-02-19T19:01:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.102+0000 7f2df9a66700 1 -- 172.21.15.46:0/669820882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df40ff150 msgr2=0x7f2df40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.102+0000 7f2df9a66700 1 --2- 172.21.15.46:0/669820882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df40ff150 0x7f2df40ff560 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009910 tx=0x7f2de4009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.102+0000 7f2df9a66700 1 -- 172.21.15.46:0/669820882 shutdown_connections 2024-02-19T19:01:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.102+0000 7f2df9a66700 1 --2- 172.21.15.46:0/669820882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df41003f0 0x7f2df4100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.102+0000 7f2df9a66700 1 --2- 172.21.15.46:0/669820882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df40ff150 0x7f2df40ff560 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.102+0000 7f2df9a66700 1 -- 172.21.15.46:0/669820882 >> 172.21.15.46:0/669820882 conn(0x7f2df40fa7a0 msgr2=0x7f2df40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.103+0000 7f2df9a66700 1 -- 172.21.15.46:0/669820882 shutdown_connections 2024-02-19T19:01:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.103+0000 7f2df9a66700 1 -- 172.21.15.46:0/669820882 wait complete. 2024-02-19T19:01:26.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.103+0000 7f2df9a66700 1 Processor -- start 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.103+0000 7f2df9a66700 1 -- start start 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df9a66700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df40ff150 0x7f2df4194d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df9a66700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df41003f0 0x7f2df4195250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df9a66700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df41957e0 con 0x7f2df41003f0 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df9a66700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4195950 con 0x7f2df40ff150 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df41003f0 0x7f2df4195250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df40ff150 0x7f2df4194d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df41003f0 0x7f2df4195250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44432/0 (socket says 172.21.15.46:44432) 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df2ffd700 1 -- 172.21.15.46:0/1719099557 learned_addr learned my addr 172.21.15.46:0/1719099557 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df2ffd700 1 -- 172.21.15.46:0/1719099557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df40ff150 msgr2=0x7f2df4194d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:26.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df2ffd700 1 --2- 172.21.15.46:0/1719099557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df40ff150 0x7f2df4194d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df2ffd700 1 -- 172.21.15.46:0/1719099557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40095f0 con 0x7f2df41003f0 2024-02-19T19:01:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df2ffd700 1 --2- 172.21.15.46:0/1719099557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df41003f0 0x7f2df4195250 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c960 tx=0x7f2de800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df0ff9700 1 -- 172.21.15.46:0/1719099557 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2de8007a30 con 0x7f2df41003f0 2024-02-19T19:01:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df0ff9700 1 -- 172.21.15.46:0/1719099557 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2de8007b90 con 0x7f2df41003f0 2024-02-19T19:01:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df9a66700 1 -- 172.21.15.46:0/1719099557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df419a3a0 con 0x7f2df41003f0 2024-02-19T19:01:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df0ff9700 1 -- 172.21.15.46:0/1719099557 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2de8018630 con 0x7f2df41003f0 2024-02-19T19:01:26.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.104+0000 7f2df9a66700 1 -- 172.21.15.46:0/1719099557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df419a8f0 con 0x7f2df41003f0 2024-02-19T19:01:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.105+0000 7f2df9a66700 1 -- 172.21.15.46:0/1719099557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4068ab0 con 0x7f2df41003f0 2024-02-19T19:01:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.106+0000 7f2df0ff9700 1 -- 172.21.15.46:0/1719099557 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2de8007d00 con 0x7f2df41003f0 2024-02-19T19:01:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.106+0000 7f2df0ff9700 1 --2- 172.21.15.46:0/1719099557 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2ddc06c680 0x7f2ddc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.106+0000 7f2df0ff9700 1 -- 172.21.15.46:0/1719099557 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2de808b7a0 con 0x7f2df41003f0 2024-02-19T19:01:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.106+0000 7f2df37fe700 1 --2- 172.21.15.46:0/1719099557 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2ddc06c680 0x7f2ddc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:26.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.107+0000 7f2df37fe700 1 --2- 172.21.15.46:0/1719099557 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2ddc06c680 0x7f2ddc06eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2de4006010 tx=0x7f2de40052a0 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:26.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.111+0000 7f2df0ff9700 1 -- 172.21.15.46:0/1719099557 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2de8055ea0 con 0x7f2df41003f0 2024-02-19T19:01:26.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.399+0000 7f2df9a66700 1 -- 172.21.15.46:0/1719099557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2df419ac20 con 0x7f2df41003f0 2024-02-19T19:01:26.418 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:26 smithi046 ceph-mon[29647]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:26.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.399+0000 7f2df0ff9700 1 -- 172.21.15.46:0/1719099557 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f2de80594c0 con 0x7f2df41003f0 2024-02-19T19:01:26.419 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:01:26.419 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:01:26.419 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-19T19:01:26.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:01:26.419 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:01:26.419 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-19T19:01:26.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:01:26.419 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:01:26.419 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-19T19:01:26.419 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:01:26.420 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:01:26.420 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:01:26.420 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:01:26.420 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:01:26.420 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-02-19T19:01:26.420 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:01:26.420 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:01:26.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.401+0000 7f2df9a66700 1 -- 172.21.15.46:0/1719099557 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2ddc06c680 msgr2=0x7f2ddc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.401+0000 7f2df9a66700 1 --2- 172.21.15.46:0/1719099557 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2ddc06c680 0x7f2ddc06eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2de4006010 tx=0x7f2de40052a0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.401+0000 7f2df9a66700 1 -- 172.21.15.46:0/1719099557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df41003f0 msgr2=0x7f2df4195250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.401+0000 7f2df9a66700 1 --2- 172.21.15.46:0/1719099557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df41003f0 0x7f2df4195250 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c960 tx=0x7f2de800cc70 comp rx=0 tx=0).stop 2024-02-19T19:01:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.401+0000 7f2df9a66700 1 -- 172.21.15.46:0/1719099557 shutdown_connections 2024-02-19T19:01:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.401+0000 7f2df9a66700 1 --2- 172.21.15.46:0/1719099557 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7f2ddc06c680 0x7f2ddc06eb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.401+0000 7f2df9a66700 1 --2- 172.21.15.46:0/1719099557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2df40ff150 0x7f2df4194d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.401+0000 7f2df9a66700 1 --2- 172.21.15.46:0/1719099557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2df41003f0 0x7f2df4195250 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.401+0000 7f2df9a66700 1 -- 172.21.15.46:0/1719099557 >> 172.21.15.46:0/1719099557 conn(0x7f2df40fa7a0 msgr2=0x7f2df41036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.402+0000 7f2df9a66700 1 -- 172.21.15.46:0/1719099557 shutdown_connections 2024-02-19T19:01:26.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.402+0000 7f2df9a66700 1 -- 172.21.15.46:0/1719099557 wait complete. 2024-02-19T19:01:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.510+0000 7fb882b13700 1 -- 172.21.15.46:0/867175421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb87c0ff150 msgr2=0x7fb87c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.510+0000 7fb882b13700 1 --2- 172.21.15.46:0/867175421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb87c0ff150 0x7fb87c0ff560 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb870009910 tx=0x7fb870009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.510+0000 7fb882b13700 1 -- 172.21.15.46:0/867175421 shutdown_connections 2024-02-19T19:01:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.510+0000 7fb882b13700 1 --2- 172.21.15.46:0/867175421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb87c1003f0 0x7fb87c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.510+0000 7fb882b13700 1 --2- 172.21.15.46:0/867175421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb87c0ff150 0x7fb87c0ff560 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.510+0000 7fb882b13700 1 -- 172.21.15.46:0/867175421 >> 172.21.15.46:0/867175421 conn(0x7fb87c0fa7a0 msgr2=0x7fb87c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:26.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.510+0000 7fb882b13700 1 -- 172.21.15.46:0/867175421 shutdown_connections 2024-02-19T19:01:26.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.510+0000 7fb882b13700 1 -- 172.21.15.46:0/867175421 wait complete. 2024-02-19T19:01:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb882b13700 1 Processor -- start 2024-02-19T19:01:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb882b13700 1 -- start start 2024-02-19T19:01:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb882b13700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb87c0ff150 0x7fb87c069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:26.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb882b13700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb87c1003f0 0x7fb87c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb882b13700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c19b110 con 0x7fb87c0ff150 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb882b13700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c19b250 con 0x7fb87c1003f0 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb8808af700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb87c0ff150 0x7fb87c069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb8808af700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb87c0ff150 0x7fb87c069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44458/0 (socket says 172.21.15.46:44458) 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb8808af700 1 -- 172.21.15.46:0/3974319326 learned_addr learned my addr 172.21.15.46:0/3974319326 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb87bfff700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb87c1003f0 0x7fb87c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb8808af700 1 -- 172.21.15.46:0/3974319326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb87c1003f0 msgr2=0x7fb87c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb8808af700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb87c1003f0 0x7fb87c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.511+0000 7fb8808af700 1 -- 172.21.15.46:0/3974319326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700095f0 con 0x7fb87c0ff150 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.512+0000 7fb8808af700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb87c0ff150 0x7fb87c069990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb87000bd70 tx=0x7fb87000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.512+0000 7fb879ffb700 1 -- 172.21.15.46:0/3974319326 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb87001d070 con 0x7fb87c0ff150 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.512+0000 7fb879ffb700 1 -- 172.21.15.46:0/3974319326 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb870005dc0 con 0x7fb87c0ff150 2024-02-19T19:01:26.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.512+0000 7fb879ffb700 1 -- 172.21.15.46:0/3974319326 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb870021410 con 0x7fb87c0ff150 2024-02-19T19:01:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.512+0000 7fb882b13700 1 -- 172.21.15.46:0/3974319326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c19b4d0 con 0x7fb87c0ff150 2024-02-19T19:01:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.512+0000 7fb882b13700 1 -- 172.21.15.46:0/3974319326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c19b9c0 con 0x7fb87c0ff150 2024-02-19T19:01:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.513+0000 7fb882b13700 1 -- 172.21.15.46:0/3974319326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c068ab0 con 0x7fb87c0ff150 2024-02-19T19:01:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.514+0000 7fb879ffb700 1 -- 172.21.15.46:0/3974319326 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb87000f7d0 con 0x7fb87c0ff150 2024-02-19T19:01:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.514+0000 7fb879ffb700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb86c06c680 0x7fb86c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.514+0000 7fb879ffb700 1 -- 172.21.15.46:0/3974319326 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb87008cb00 con 0x7fb87c0ff150 2024-02-19T19:01:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.514+0000 7fb87bfff700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb86c06c680 0x7fb86c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.514+0000 7fb87bfff700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb86c06c680 0x7fb86c06eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb868005950 tx=0x7fb86800b410 comp rx=0 tx=0).ready entity=mgr.14237 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:26.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.519+0000 7fb879ffb700 1 -- 172.21.15.46:0/3974319326 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb87005ac10 con 0x7fb87c0ff150 2024-02-19T19:01:26.612 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:26 smithi142 ceph-mon[37169]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:26.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.735+0000 7fb882b13700 1 -- 172.21.15.46:0/3974319326 --> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb87c104e20 con 0x7fb86c06c680 2024-02-19T19:01:26.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.736+0000 7fb879ffb700 1 -- 172.21.15.46:0/3974319326 <== mgr.14237 v2:172.21.15.46:6800/1654096494 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fb87c104e20 con 0x7fb86c06c680 2024-02-19T19:01:26.755 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:01:26.755 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:01:26.755 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:01:26.755 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:01:26.755 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-02-19T19:01:26.755 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "0/2 daemons upgraded", 2024-02-19T19:01:26.755 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 image on host smithi142", 2024-02-19T19:01:26.756 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:01:26.756 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:01:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 -- 172.21.15.46:0/3974319326 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb86c06c680 msgr2=0x7fb86c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb86c06c680 0x7fb86c06eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb868005950 tx=0x7fb86800b410 comp rx=0 tx=0).stop 2024-02-19T19:01:26.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 -- 172.21.15.46:0/3974319326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb87c0ff150 msgr2=0x7fb87c069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb87c0ff150 0x7fb87c069990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb87000bd70 tx=0x7fb87000bda0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 -- 172.21.15.46:0/3974319326 shutdown_connections 2024-02-19T19:01:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.46:6800/1654096494,v1:172.21.15.46:6801/1654096494] conn(0x7fb86c06c680 0x7fb86c06eb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb87c0ff150 0x7fb87c069990 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 --2- 172.21.15.46:0/3974319326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb87c1003f0 0x7fb87c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 -- 172.21.15.46:0/3974319326 >> 172.21.15.46:0/3974319326 conn(0x7fb87c0fa7a0 msgr2=0x7fb87c1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 -- 172.21.15.46:0/3974319326 shutdown_connections 2024-02-19T19:01:26.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:26.738+0000 7fb882b13700 1 -- 172.21.15.46:0/3974319326 wait complete. 2024-02-19T19:01:27.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:27 smithi046 ceph-mon[29647]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:27.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:27 smithi046 ceph-mon[29647]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:27.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:27 smithi046 ceph-mon[29647]: pgmap v241: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:27.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:27 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1719099557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:01:27.652 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:27 smithi142 ceph-mon[37169]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:27.652 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:27 smithi142 ceph-mon[37169]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:27.652 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:27 smithi142 ceph-mon[37169]: pgmap v241: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:27.652 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:27 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1719099557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:01:28.576 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:28 smithi142 ceph-mon[37169]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:28.576 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:28 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:28.577 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:28 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.fwekwv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:01:28.577 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:28 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:01:28.577 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:28 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:28.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:28 smithi046 ceph-mon[29647]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:28.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:28 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:28.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:28 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.fwekwv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:01:28.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:28 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:01:28.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:28 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:29.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:29 smithi046 ceph-mon[29647]: Upgrade: Updating mgr.smithi142.fwekwv 2024-02-19T19:01:29.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:29 smithi046 ceph-mon[29647]: Deploying daemon mgr.smithi142.fwekwv on smithi142 2024-02-19T19:01:29.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:29 smithi046 ceph-mon[29647]: pgmap v242: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:29.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:29 smithi142 ceph-mon[37169]: Upgrade: Updating mgr.smithi142.fwekwv 2024-02-19T19:01:29.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:29 smithi142 ceph-mon[37169]: Deploying daemon mgr.smithi142.fwekwv on smithi142 2024-02-19T19:01:29.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:29 smithi142 ceph-mon[37169]: pgmap v242: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:31.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:31 smithi142 ceph-mon[37169]: pgmap v243: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:31.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:31 smithi046 ceph-mon[29647]: pgmap v243: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:32.401 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:32 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:32.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:32 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:33.514 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:33 smithi142 ceph-mon[37169]: pgmap v244: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:33.514 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:33.515 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:33.515 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:33 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:33.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:33 smithi046 ceph-mon[29647]: pgmap v244: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:33.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:33.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:33.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:33 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:35.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:35 smithi142 ceph-mon[37169]: pgmap v245: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:35.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:35 smithi046 ceph-mon[29647]: pgmap v245: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:36.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:36 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:36.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:36 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:36.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:36 smithi142 ceph-mon[37169]: pgmap v246: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:36.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:36 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:36.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:36 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:37.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:36 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:37.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:36 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:37.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:36 smithi046 ceph-mon[29647]: pgmap v246: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:37.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:36 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:37.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:36 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:39.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:39 smithi046 ceph-mon[29647]: pgmap v247: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:39.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:39 smithi142 ceph-mon[37169]: pgmap v247: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:01:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: Standby manager daemon smithi142.fwekwv restarted 2024-02-19T19:01:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: Standby manager daemon smithi142.fwekwv started 2024-02-19T19:01:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/crt"}]: dispatch 2024-02-19T19:01:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/key"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr fail", "who": "smithi046.qtceex"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: osdmap e47: 6 total, 6 up, 6 in 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "mgr fail", "who": "smithi046.qtceex"}]': finished 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: mgrmap e20: smithi142.fwekwv(active, starting, since 0.00725414s) 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:01:40.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mgr metadata", "who": "smithi142.fwekwv", "id": "smithi142.fwekwv"}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: Manager daemon smithi142.fwekwv is now available 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.fwekwv/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:01:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.fwekwv/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:01:40.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.fwekwv/trash_purge_schedule"}]: dispatch 2024-02-19T19:01:40.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.fwekwv/trash_purge_schedule"}]: dispatch 2024-02-19T19:01:40.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: [19/Feb/2024:19:01:40] ENGINE Bus STARTING 2024-02-19T19:01:40.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: Deploying cephadm binary to smithi142 2024-02-19T19:01:40.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: Deploying cephadm binary to smithi046 2024-02-19T19:01:40.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:40 smithi142 ceph-mon[37169]: [19/Feb/2024:19:01:40] ENGINE Serving on http://172.21.15.142:8765 2024-02-19T19:01:41.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:41.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: Standby manager daemon smithi142.fwekwv restarted 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: Standby manager daemon smithi142.fwekwv started 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/crt"}]: dispatch 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/key"}]: dispatch 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr fail", "who": "smithi046.qtceex"}]: dispatch 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: osdmap e47: 6 total, 6 up, 6 in 2024-02-19T19:01:41.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.14237 172.21.15.46:0/3408694290' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "mgr fail", "who": "smithi046.qtceex"}]': finished 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: mgrmap e20: smithi142.fwekwv(active, starting, since 0.00725414s) 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mgr metadata", "who": "smithi142.fwekwv", "id": "smithi142.fwekwv"}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:01:41.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: Manager daemon smithi142.fwekwv is now available 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.fwekwv/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.fwekwv/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.fwekwv/trash_purge_schedule"}]: dispatch 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.fwekwv/trash_purge_schedule"}]: dispatch 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: [19/Feb/2024:19:01:40] ENGINE Bus STARTING 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: Deploying cephadm binary to smithi142 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: Deploying cephadm binary to smithi046 2024-02-19T19:01:41.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:40 smithi046 ceph-mon[29647]: [19/Feb/2024:19:01:40] ENGINE Serving on http://172.21.15.142:8765 2024-02-19T19:01:42.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:41 smithi046 ceph-mon[29647]: [19/Feb/2024:19:01:40] ENGINE Serving on https://172.21.15.142:7150 2024-02-19T19:01:42.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:41 smithi046 ceph-mon[29647]: [19/Feb/2024:19:01:40] ENGINE Bus STARTED 2024-02-19T19:01:42.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:41 smithi046 ceph-mon[29647]: mgrmap e21: smithi142.fwekwv(active, since 1.00785s) 2024-02-19T19:01:42.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:41 smithi046 ceph-mon[29647]: pgmap v3: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:41 smithi142 ceph-mon[37169]: [19/Feb/2024:19:01:40] ENGINE Serving on https://172.21.15.142:7150 2024-02-19T19:01:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:41 smithi142 ceph-mon[37169]: [19/Feb/2024:19:01:40] ENGINE Bus STARTED 2024-02-19T19:01:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:41 smithi142 ceph-mon[37169]: mgrmap e21: smithi142.fwekwv(active, since 1.00785s) 2024-02-19T19:01:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:41 smithi142 ceph-mon[37169]: pgmap v3: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:43.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:42 smithi046 ceph-mon[29647]: mgrmap e22: smithi142.fwekwv(active, since 2s) 2024-02-19T19:01:43.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:42 smithi046 ceph-mon[29647]: pgmap v4: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:43.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:42 smithi142 ceph-mon[37169]: mgrmap e22: smithi142.fwekwv(active, since 2s) 2024-02-19T19:01:43.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:42 smithi142 ceph-mon[37169]: pgmap v4: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:45.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:44 smithi046 ceph-mon[29647]: pgmap v5: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:45.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:44 smithi046 ceph-mon[29647]: mgrmap e23: smithi142.fwekwv(active, since 4s) 2024-02-19T19:01:45.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:44 smithi142 ceph-mon[37169]: pgmap v5: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:45.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:44 smithi142 ceph-mon[37169]: mgrmap e23: smithi142.fwekwv(active, since 4s) 2024-02-19T19:01:47.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:47 smithi142 ceph-mon[37169]: pgmap v6: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:47.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:47 smithi142 ceph-mon[37169]: Standby manager daemon smithi046.qtceex started 2024-02-19T19:01:47.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:47 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.46:0/3668486242' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.qtceex/crt"}]: dispatch 2024-02-19T19:01:47.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:47 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.46:0/3668486242' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:01:47.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:47 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.46:0/3668486242' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.qtceex/key"}]: dispatch 2024-02-19T19:01:47.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:47 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.46:0/3668486242' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:01:47.511 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:47 smithi046 ceph-mon[29647]: pgmap v6: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:47.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:47 smithi046 ceph-mon[29647]: Standby manager daemon smithi046.qtceex started 2024-02-19T19:01:47.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:47 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.46:0/3668486242' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.qtceex/crt"}]: dispatch 2024-02-19T19:01:47.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:47 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.46:0/3668486242' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:01:47.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:47 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.46:0/3668486242' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.qtceex/key"}]: dispatch 2024-02-19T19:01:47.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:47 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.46:0/3668486242' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:01:48.427 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:48 smithi046 ceph-mon[29647]: mgrmap e24: smithi142.fwekwv(active, since 7s), standbys: smithi046.qtceex 2024-02-19T19:01:48.427 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:48 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mgr metadata", "who": "smithi046.qtceex", "id": "smithi046.qtceex"}]: dispatch 2024-02-19T19:01:48.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:48 smithi142 ceph-mon[37169]: mgrmap e24: smithi142.fwekwv(active, since 7s), standbys: smithi046.qtceex 2024-02-19T19:01:48.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:48 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mgr metadata", "who": "smithi046.qtceex", "id": "smithi046.qtceex"}]: dispatch 2024-02-19T19:01:49.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:49 smithi046 ceph-mon[29647]: pgmap v7: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-19T19:01:49.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:49 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:49.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:49 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:49.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:49 smithi142 ceph-mon[37169]: pgmap v7: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-19T19:01:49.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:49 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:49.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:49 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:50.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:50 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:50.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:50 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:50.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:50 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:50.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:50 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:50.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:50 smithi142 ceph-mon[37169]: pgmap v8: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-19T19:01:51.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:50 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:51.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:50 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:51.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:50 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:51.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:50 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:51.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:50 smithi046 ceph-mon[29647]: pgmap v8: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-19T19:01:52.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:51 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:52.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:51 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:52.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:51 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:51 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:51 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:51 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:51 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:51 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:51 smithi046 ceph-mon[29647]: Adjusting osd_memory_target on smithi046 to 1217M 2024-02-19T19:01:52.133 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:51 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:52.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:51 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:52.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:51 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:51 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:51 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:51 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:51 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:51 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:51 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:51 smithi142 ceph-mon[37169]: Adjusting osd_memory_target on smithi046 to 1217M 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:51 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:01:53.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:52 smithi142 ceph-mon[37169]: pgmap v9: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:01:53.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:52 smithi046 ceph-mon[29647]: pgmap v9: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:01:55.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:54 smithi046 ceph-mon[29647]: pgmap v10: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:01:55.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:54 smithi142 ceph-mon[37169]: pgmap v10: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:01:56.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:55 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:56.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:55 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:56.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.858+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/1314638877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0101440 msgr2=0x7fb2a0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:56.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.858+0000 7fb2a5e4e700 1 --2- 172.21.15.46:0/1314638877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0101440 0x7fb2a0101890 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb290009910 tx=0x7fb290009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.858+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/1314638877 shutdown_connections 2024-02-19T19:01:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.858+0000 7fb2a5e4e700 1 --2- 172.21.15.46:0/1314638877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0101440 0x7fb2a0101890 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.858+0000 7fb2a5e4e700 1 --2- 172.21.15.46:0/1314638877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2a0100240 0x7fb2a0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.858+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/1314638877 >> 172.21.15.46:0/1314638877 conn(0x7fb2a00fb7f0 msgr2=0x7fb2a00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.858+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/1314638877 shutdown_connections 2024-02-19T19:01:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.858+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/1314638877 wait complete. 2024-02-19T19:01:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.858+0000 7fb2a5e4e700 1 Processor -- start 2024-02-19T19:01:56.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb2a5e4e700 1 -- start start 2024-02-19T19:01:56.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb2a5e4e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2a0100240 0x7fb2a0195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb2a5e4e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0101440 0x7fb2a0195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb2a5e4e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a01965f0 con 0x7fb2a0101440 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb2a5e4e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0196730 con 0x7fb2a0100240 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb29effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0101440 0x7fb2a0195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb29effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0101440 0x7fb2a0195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48496/0 (socket says 172.21.15.46:48496) 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb29effd700 1 -- 172.21.15.46:0/2059191342 learned_addr learned my addr 172.21.15.46:0/2059191342 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb29f7fe700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2a0100240 0x7fb2a0195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb29effd700 1 -- 172.21.15.46:0/2059191342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2a0100240 msgr2=0x7fb2a0195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb29effd700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2a0100240 0x7fb2a0195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb29effd700 1 -- 172.21.15.46:0/2059191342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2900095f0 con 0x7fb2a0101440 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.859+0000 7fb29effd700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0101440 0x7fb2a0195fd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb290000c00 tx=0x7fb29000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.860+0000 7fb29cff9700 1 -- 172.21.15.46:0/2059191342 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb29001d070 con 0x7fb2a0101440 2024-02-19T19:01:56.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.860+0000 7fb29cff9700 1 -- 172.21.15.46:0/2059191342 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb290005dc0 con 0x7fb2a0101440 2024-02-19T19:01:56.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.860+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/2059191342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a019b180 con 0x7fb2a0101440 2024-02-19T19:01:56.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.860+0000 7fb29cff9700 1 -- 172.21.15.46:0/2059191342 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2900226a0 con 0x7fb2a0101440 2024-02-19T19:01:56.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.860+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/2059191342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a019b670 con 0x7fb2a0101440 2024-02-19T19:01:56.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.861+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/2059191342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a0108d90 con 0x7fb2a0101440 2024-02-19T19:01:56.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.861+0000 7fb29cff9700 1 -- 172.21.15.46:0/2059191342 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7fb2900038f0 con 0x7fb2a0101440 2024-02-19T19:01:56.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.862+0000 7fb29cff9700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb28806cf10 0x7fb28806f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:56.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.862+0000 7fb29cff9700 1 -- 172.21.15.46:0/2059191342 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb29008dae0 con 0x7fb2a0101440 2024-02-19T19:01:56.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.862+0000 7fb29f7fe700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb28806cf10 0x7fb28806f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:56.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.862+0000 7fb29f7fe700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb28806cf10 0x7fb28806f3c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2a01012a0 tx=0x7fb294009260 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:56.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:56.866+0000 7fb29cff9700 1 -- 172.21.15.46:0/2059191342 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fb29005b220 con 0x7fb2a0101440 2024-02-19T19:01:57.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.093+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/2059191342 --> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2a019bd70 con 0x7fb28806cf10 2024-02-19T19:01:57.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.095+0000 7fb29cff9700 1 -- 172.21.15.46:0/2059191342 <== mgr.24363 v2:172.21.15.142:6828/3077186414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb2a019bd70 con 0x7fb28806cf10 2024-02-19T19:01:57.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/2059191342 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb28806cf10 msgr2=0x7fb28806f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb28806cf10 0x7fb28806f3c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2a01012a0 tx=0x7fb294009260 comp rx=0 tx=0).stop 2024-02-19T19:01:57.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/2059191342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0101440 msgr2=0x7fb2a0195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0101440 0x7fb2a0195fd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb290000c00 tx=0x7fb29000f690 comp rx=0 tx=0).stop 2024-02-19T19:01:57.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/2059191342 shutdown_connections 2024-02-19T19:01:57.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb28806cf10 0x7fb28806f3c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2a0100240 0x7fb2a0195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 --2- 172.21.15.46:0/2059191342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2a0101440 0x7fb2a0195fd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/2059191342 >> 172.21.15.46:0/2059191342 conn(0x7fb2a00fb7f0 msgr2=0x7fb2a0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:57.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/2059191342 shutdown_connections 2024-02-19T19:01:57.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.097+0000 7fb2a5e4e700 1 -- 172.21.15.46:0/2059191342 wait complete. 2024-02-19T19:01:57.127 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:01:57.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:57 smithi142 ceph-mon[37169]: pgmap v11: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:01:57.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.203+0000 7fe14acd9700 1 -- 172.21.15.46:0/316123817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1441021f0 msgr2=0x7fe1440fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.203+0000 7fe14acd9700 1 --2- 172.21.15.46:0/316123817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1441021f0 0x7fe1440fe320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe130009910 tx=0x7fe130009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:57.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.203+0000 7fe14acd9700 1 -- 172.21.15.46:0/316123817 shutdown_connections 2024-02-19T19:01:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.203+0000 7fe14acd9700 1 --2- 172.21.15.46:0/316123817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1441021f0 0x7fe1440fe320 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.203+0000 7fe14acd9700 1 --2- 172.21.15.46:0/316123817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1441018a0 0x7fe144101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.224 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:57 smithi046 ceph-mon[29647]: pgmap v11: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.203+0000 7fe14acd9700 1 -- 172.21.15.46:0/316123817 >> 172.21.15.46:0/316123817 conn(0x7fe1440f9f10 msgr2=0x7fe1440fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.203+0000 7fe14acd9700 1 -- 172.21.15.46:0/316123817 shutdown_connections 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.203+0000 7fe14acd9700 1 -- 172.21.15.46:0/316123817 wait complete. 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.204+0000 7fe14acd9700 1 Processor -- start 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.204+0000 7fe14acd9700 1 -- start start 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.204+0000 7fe14acd9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1441018a0 0x7fe144195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.204+0000 7fe14acd9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1441021f0 0x7fe144196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.204+0000 7fe14acd9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144196630 con 0x7fe1441018a0 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.204+0000 7fe14acd9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144196770 con 0x7fe1441021f0 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.204+0000 7fe148a75700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1441018a0 0x7fe144195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.204+0000 7fe148a75700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1441018a0 0x7fe144195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48510/0 (socket says 172.21.15.46:48510) 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.204+0000 7fe148a75700 1 -- 172.21.15.46:0/720712194 learned_addr learned my addr 172.21.15.46:0/720712194 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:01:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.205+0000 7fe143fff700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1441021f0 0x7fe144196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.205+0000 7fe148a75700 1 -- 172.21.15.46:0/720712194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1441021f0 msgr2=0x7fe144196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.205+0000 7fe148a75700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1441021f0 0x7fe144196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.205+0000 7fe148a75700 1 -- 172.21.15.46:0/720712194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1300095f0 con 0x7fe1441018a0 2024-02-19T19:01:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.205+0000 7fe148a75700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1441018a0 0x7fe144195ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe13800d900 tx=0x7fe13800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.205+0000 7fe141ffb700 1 -- 172.21.15.46:0/720712194 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1380041f0 con 0x7fe1441018a0 2024-02-19T19:01:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.205+0000 7fe14acd9700 1 -- 172.21.15.46:0/720712194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14419b220 con 0x7fe1441018a0 2024-02-19T19:01:57.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.205+0000 7fe141ffb700 1 -- 172.21.15.46:0/720712194 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe138004ce0 con 0x7fe1441018a0 2024-02-19T19:01:57.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.205+0000 7fe141ffb700 1 -- 172.21.15.46:0/720712194 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13800b750 con 0x7fe1441018a0 2024-02-19T19:01:57.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.206+0000 7fe14acd9700 1 -- 172.21.15.46:0/720712194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14419b770 con 0x7fe1441018a0 2024-02-19T19:01:57.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.207+0000 7fe14acd9700 1 -- 172.21.15.46:0/720712194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe144108d10 con 0x7fe1441018a0 2024-02-19T19:01:57.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.208+0000 7fe141ffb700 1 -- 172.21.15.46:0/720712194 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7fe138004e50 con 0x7fe1441018a0 2024-02-19T19:01:57.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.208+0000 7fe141ffb700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fe13406cf10 0x7fe13406f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:57.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.208+0000 7fe141ffb700 1 -- 172.21.15.46:0/720712194 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe13808c560 con 0x7fe1441018a0 2024-02-19T19:01:57.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.208+0000 7fe143fff700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fe13406cf10 0x7fe13406f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:57.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.209+0000 7fe143fff700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fe13406cf10 0x7fe13406f3c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe130006010 tx=0x7fe130005ec0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.213+0000 7fe141ffb700 1 -- 172.21.15.46:0/720712194 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fe138059ca0 con 0x7fe1441018a0 2024-02-19T19:01:57.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.438+0000 7fe14acd9700 1 -- 172.21.15.46:0/720712194 --> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe144105f90 con 0x7fe13406cf10 2024-02-19T19:01:57.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.439+0000 7fe141ffb700 1 -- 172.21.15.46:0/720712194 <== mgr.24363 v2:172.21.15.142:6828/3077186414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe144105f90 con 0x7fe13406cf10 2024-02-19T19:01:57.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 -- 172.21.15.46:0/720712194 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fe13406cf10 msgr2=0x7fe13406f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fe13406cf10 0x7fe13406f3c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe130006010 tx=0x7fe130005ec0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 -- 172.21.15.46:0/720712194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1441018a0 msgr2=0x7fe144195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1441018a0 0x7fe144195ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe13800d900 tx=0x7fe13800dc10 comp rx=0 tx=0).stop 2024-02-19T19:01:57.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 -- 172.21.15.46:0/720712194 shutdown_connections 2024-02-19T19:01:57.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1441018a0 0x7fe144195ad0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fe13406cf10 0x7fe13406f3c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 --2- 172.21.15.46:0/720712194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1441021f0 0x7fe144196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 -- 172.21.15.46:0/720712194 >> 172.21.15.46:0/720712194 conn(0x7fe1440f9f10 msgr2=0x7fe144104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:57.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 -- 172.21.15.46:0/720712194 shutdown_connections 2024-02-19T19:01:57.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.441+0000 7fe14acd9700 1 -- 172.21.15.46:0/720712194 wait complete. 2024-02-19T19:01:57.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.550+0000 7f0a0dfba700 1 -- 172.21.15.46:0/52890981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a08101450 msgr2=0x7f0a081018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.550+0000 7f0a0dfba700 1 --2- 172.21.15.46:0/52890981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a08101450 0x7f0a081018a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009910 tx=0x7f09fc009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:57.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.550+0000 7f0a0dfba700 1 -- 172.21.15.46:0/52890981 shutdown_connections 2024-02-19T19:01:57.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.550+0000 7f0a0dfba700 1 --2- 172.21.15.46:0/52890981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a08101450 0x7f0a081018a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.550+0000 7f0a0dfba700 1 --2- 172.21.15.46:0/52890981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a08100250 0x7f0a08100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.550+0000 7f0a0dfba700 1 -- 172.21.15.46:0/52890981 >> 172.21.15.46:0/52890981 conn(0x7f0a080fb7e0 msgr2=0x7f0a080fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:57.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.550+0000 7f0a0dfba700 1 -- 172.21.15.46:0/52890981 shutdown_connections 2024-02-19T19:01:57.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.550+0000 7f0a0dfba700 1 -- 172.21.15.46:0/52890981 wait complete. 2024-02-19T19:01:57.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.551+0000 7f0a0dfba700 1 Processor -- start 2024-02-19T19:01:57.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.551+0000 7f0a0dfba700 1 -- start start 2024-02-19T19:01:57.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.551+0000 7f0a0dfba700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a08100250 0x7f0a08195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:57.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.551+0000 7f0a0dfba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a08101450 0x7f0a08195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:57.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.551+0000 7f0a0dfba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081965b0 con 0x7f0a08101450 2024-02-19T19:01:57.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.551+0000 7f0a0dfba700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081966f0 con 0x7f0a08100250 2024-02-19T19:01:57.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.551+0000 7f0a06ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a08101450 0x7f0a08195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.551+0000 7f0a06ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a08101450 0x7f0a08195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47864/0 (socket says 172.21.15.46:47864) 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.551+0000 7f0a06ffd700 1 -- 172.21.15.46:0/2590046635 learned_addr learned my addr 172.21.15.46:0/2590046635 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.551+0000 7f0a077fe700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a08100250 0x7f0a08195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.552+0000 7f0a06ffd700 1 -- 172.21.15.46:0/2590046635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a08100250 msgr2=0x7f0a08195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.552+0000 7f0a06ffd700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a08100250 0x7f0a08195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.552+0000 7f0a06ffd700 1 -- 172.21.15.46:0/2590046635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc0095f0 con 0x7f0a08101450 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.552+0000 7f0a06ffd700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a08101450 0x7f0a08195f90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f09fc006010 tx=0x7f09fc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.552+0000 7f0a04ff9700 1 -- 172.21.15.46:0/2590046635 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09fc01d070 con 0x7f0a08101450 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.552+0000 7f0a04ff9700 1 -- 172.21.15.46:0/2590046635 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f09fc00f460 con 0x7f0a08101450 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.552+0000 7f0a0dfba700 1 -- 172.21.15.46:0/2590046635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0819b140 con 0x7f0a08101450 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.552+0000 7f0a04ff9700 1 -- 172.21.15.46:0/2590046635 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09fc021640 con 0x7f0a08101450 2024-02-19T19:01:57.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.552+0000 7f0a0dfba700 1 -- 172.21.15.46:0/2590046635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0819b630 con 0x7f0a08101450 2024-02-19T19:01:57.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.553+0000 7f0a0dfba700 1 -- 172.21.15.46:0/2590046635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a08108dc0 con 0x7f0a08101450 2024-02-19T19:01:57.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.554+0000 7f0a04ff9700 1 -- 172.21.15.46:0/2590046635 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7f09fc00fab0 con 0x7f0a08101450 2024-02-19T19:01:57.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.554+0000 7f0a04ff9700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f09f006cf10 0x7f09f006f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:57.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.554+0000 7f0a04ff9700 1 -- 172.21.15.46:0/2590046635 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f09fc08da30 con 0x7f0a08101450 2024-02-19T19:01:57.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.554+0000 7f0a077fe700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f09f006cf10 0x7f09f006f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:57.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.555+0000 7f0a077fe700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f09f006cf10 0x7f09f006f3c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f09f8005950 tx=0x7f09f800a300 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:57.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.559+0000 7f0a04ff9700 1 -- 172.21.15.46:0/2590046635 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f09fc05b170 con 0x7f0a08101450 2024-02-19T19:01:57.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.777+0000 7f0a0dfba700 1 -- 172.21.15.46:0/2590046635 --> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a08105da0 con 0x7f09f006cf10 2024-02-19T19:01:57.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.788+0000 7f0a04ff9700 1 -- 172.21.15.46:0/2590046635 <== mgr.24363 v2:172.21.15.142:6828/3077186414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0a08105da0 con 0x7f09f006cf10 2024-02-19T19:01:57.808 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:01:57.808 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (6m) 8s ago 8m 24.8M - 0.25.0 c8568f914cd2 cfbe74f8660f 2024-02-19T19:01:57.808 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (8m) 8s ago 8m 7658k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:01:57.808 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (7m) 9s ago 7m 7562k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:01:57.808 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (8m) 8s ago 8m 6656k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:01:57.808 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (7m) 9s ago 7m 6665k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:01:57.808 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 8s ago 7m 85.4M - 9.4.7 954c08fa6188 2fa87d8c964a 2024-02-19T19:01:57.808 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (2m) 8s ago 2m 25.4M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:01:57.808 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (2m) 8s ago 2m 12.8M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (2m) 9s ago 2m 13.5M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (2m) 9s ago 2m 19.6M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:9283,8765,8443 running (10m) 8s ago 10m 371M - 18.2.0 dc2bc1663786 513c14e92ab1 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (25s) 9s ago 7m 489M - 19.0.0-1450-gf78a58c0 f081f847070a 0f8aadaa6198 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (10m) 8s ago 10m 46.8M 2048M 18.2.0 dc2bc1663786 adb8243bd11c 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (6m) 9s ago 6m 38.3M 2048M 18.2.0 dc2bc1663786 3f6c8b69abc2 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 8s ago 8m 16.9M - 1.5.0 0da6a335fe13 6fcd0bc86aba 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (7m) 9s ago 7m 14.8M - 1.5.0 0da6a335fe13 bdfda6603f51 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (6m) 8s ago 6m 50.5M 1217M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (5m) 8s ago 5m 49.1M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (5m) 8s ago 5m 50.8M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (4m) 9s ago 4m 47.1M 4970M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (4m) 9s ago 4m 45.5M 4970M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (4m) 9s ago 4m 46.3M 4970M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:01:57.809 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (6m) 8s ago 7m 68.9M - 2.43.0 a07b618ecd1d c0b60f66a9ef 2024-02-19T19:01:57.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 -- 172.21.15.46:0/2590046635 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f09f006cf10 msgr2=0x7f09f006f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f09f006cf10 0x7f09f006f3c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f09f8005950 tx=0x7f09f800a300 comp rx=0 tx=0).stop 2024-02-19T19:01:57.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 -- 172.21.15.46:0/2590046635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a08101450 msgr2=0x7f0a08195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a08101450 0x7f0a08195f90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f09fc006010 tx=0x7f09fc00bd70 comp rx=0 tx=0).stop 2024-02-19T19:01:57.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 -- 172.21.15.46:0/2590046635 shutdown_connections 2024-02-19T19:01:57.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f09f006cf10 0x7f09f006f3c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a08100250 0x7f0a08195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 --2- 172.21.15.46:0/2590046635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a08101450 0x7f0a08195f90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 -- 172.21.15.46:0/2590046635 >> 172.21.15.46:0/2590046635 conn(0x7f0a080fb7e0 msgr2=0x7f0a08104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:57.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 -- 172.21.15.46:0/2590046635 shutdown_connections 2024-02-19T19:01:57.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.790+0000 7f0a0dfba700 1 -- 172.21.15.46:0/2590046635 wait complete. 2024-02-19T19:01:57.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.897+0000 7fb6daa8f700 1 -- 172.21.15.46:0/139094976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d41003d0 msgr2=0x7fb6d4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.897+0000 7fb6daa8f700 1 --2- 172.21.15.46:0/139094976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d41003d0 0x7fb6d4100840 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009910 tx=0x7fb6c0009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:57.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 -- 172.21.15.46:0/139094976 shutdown_connections 2024-02-19T19:01:57.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 --2- 172.21.15.46:0/139094976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d41003d0 0x7fb6d4100840 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 --2- 172.21.15.46:0/139094976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6d40ff130 0x7fb6d40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 -- 172.21.15.46:0/139094976 >> 172.21.15.46:0/139094976 conn(0x7fb6d40fa780 msgr2=0x7fb6d40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:57.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 -- 172.21.15.46:0/139094976 shutdown_connections 2024-02-19T19:01:57.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 -- 172.21.15.46:0/139094976 wait complete. 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 Processor -- start 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 -- start start 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6d40ff130 0x7fb6d40690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d41003d0 0x7fb6d419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d419ad90 con 0x7fb6d41003d0 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6daa8f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d419aed0 con 0x7fb6d40ff130 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.898+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d41003d0 0x7fb6d419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d41003d0 0x7fb6d419a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47886/0 (socket says 172.21.15.46:47886) 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6d3fff700 1 -- 172.21.15.46:0/3484417808 learned_addr learned my addr 172.21.15.46:0/3484417808 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6d882b700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6d40ff130 0x7fb6d40690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6d3fff700 1 -- 172.21.15.46:0/3484417808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6d40ff130 msgr2=0x7fb6d40690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6d3fff700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6d40ff130 0x7fb6d40690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6d3fff700 1 -- 172.21.15.46:0/3484417808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c00095f0 con 0x7fb6d41003d0 2024-02-19T19:01:57.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6d3fff700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d41003d0 0x7fb6d419a7c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0006010 tx=0x7fb6c000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6d1ffb700 1 -- 172.21.15.46:0/3484417808 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6c001d070 con 0x7fb6d41003d0 2024-02-19T19:01:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6daa8f700 1 -- 172.21.15.46:0/3484417808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d419b150 con 0x7fb6d41003d0 2024-02-19T19:01:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6d1ffb700 1 -- 172.21.15.46:0/3484417808 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb6c000f460 con 0x7fb6d41003d0 2024-02-19T19:01:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6d1ffb700 1 -- 172.21.15.46:0/3484417808 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6c0021640 con 0x7fb6d41003d0 2024-02-19T19:01:57.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.899+0000 7fb6daa8f700 1 -- 172.21.15.46:0/3484417808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d419b640 con 0x7fb6d41003d0 2024-02-19T19:01:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.900+0000 7fb6daa8f700 1 -- 172.21.15.46:0/3484417808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d4107c10 con 0x7fb6d41003d0 2024-02-19T19:01:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.901+0000 7fb6d1ffb700 1 -- 172.21.15.46:0/3484417808 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7fb6c0003a60 con 0x7fb6d41003d0 2024-02-19T19:01:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.902+0000 7fb6d1ffb700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb6c406cf10 0x7fb6c406f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.902+0000 7fb6d1ffb700 1 -- 172.21.15.46:0/3484417808 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb6c008d9a0 con 0x7fb6d41003d0 2024-02-19T19:01:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.902+0000 7fb6d882b700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb6c406cf10 0x7fb6c406f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:57.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.902+0000 7fb6d882b700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb6c406cf10 0x7fb6c406f3c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8005950 tx=0x7fb6c800a300 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:57.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:57.906+0000 7fb6d1ffb700 1 -- 172.21.15.46:0/3484417808 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fb6c005b0e0 con 0x7fb6d41003d0 2024-02-19T19:01:58.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.199+0000 7fb6daa8f700 1 -- 172.21.15.46:0/3484417808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb6d4107e30 con 0x7fb6d41003d0 2024-02-19T19:01:58.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.200+0000 7fb6d1ffb700 1 -- 172.21.15.46:0/3484417808 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7fb6c005ac70 con 0x7fb6d41003d0 2024-02-19T19:01:58.220 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:01:58.220 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:01:58.220 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-19T19:01:58.220 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:01:58.220 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:01:58.220 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:01:58.221 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:01:58.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.202+0000 7fb6daa8f700 1 -- 172.21.15.46:0/3484417808 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb6c406cf10 msgr2=0x7fb6c406f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:58.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.202+0000 7fb6daa8f700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb6c406cf10 0x7fb6c406f3c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8005950 tx=0x7fb6c800a300 comp rx=0 tx=0).stop 2024-02-19T19:01:58.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.202+0000 7fb6daa8f700 1 -- 172.21.15.46:0/3484417808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d41003d0 msgr2=0x7fb6d419a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:58.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.202+0000 7fb6daa8f700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d41003d0 0x7fb6d419a7c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0006010 tx=0x7fb6c000bd70 comp rx=0 tx=0).stop 2024-02-19T19:01:58.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.202+0000 7fb6daa8f700 1 -- 172.21.15.46:0/3484417808 shutdown_connections 2024-02-19T19:01:58.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.202+0000 7fb6daa8f700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7fb6c406cf10 0x7fb6c406f3c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:58.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.202+0000 7fb6daa8f700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6d40ff130 0x7fb6d40690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:58.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.202+0000 7fb6daa8f700 1 --2- 172.21.15.46:0/3484417808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6d41003d0 0x7fb6d419a7c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:58.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.202+0000 7fb6daa8f700 1 -- 172.21.15.46:0/3484417808 >> 172.21.15.46:0/3484417808 conn(0x7fb6d40fa780 msgr2=0x7fb6d4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:58.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.202+0000 7fb6daa8f700 1 -- 172.21.15.46:0/3484417808 shutdown_connections 2024-02-19T19:01:58.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.203+0000 7fb6daa8f700 1 -- 172.21.15.46:0/3484417808 wait complete. 2024-02-19T19:01:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.310+0000 7f6d1823b700 1 -- 172.21.15.46:0/2316796141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d100ff490 msgr2=0x7f6d100ff900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.310+0000 7f6d1823b700 1 --2- 172.21.15.46:0/2316796141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d100ff490 0x7f6d100ff900 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009910 tx=0x7f6d0c009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.310+0000 7f6d1823b700 1 -- 172.21.15.46:0/2316796141 shutdown_connections 2024-02-19T19:01:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.310+0000 7f6d1823b700 1 --2- 172.21.15.46:0/2316796141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d100ff490 0x7f6d100ff900 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.310+0000 7f6d1823b700 1 --2- 172.21.15.46:0/2316796141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d100feb40 0x7f6d100fef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.310+0000 7f6d1823b700 1 -- 172.21.15.46:0/2316796141 >> 172.21.15.46:0/2316796141 conn(0x7f6d100fa6d0 msgr2=0x7f6d100fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.310+0000 7f6d1823b700 1 -- 172.21.15.46:0/2316796141 shutdown_connections 2024-02-19T19:01:58.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.310+0000 7f6d1823b700 1 -- 172.21.15.46:0/2316796141 wait complete. 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.311+0000 7f6d1823b700 1 Processor -- start 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.311+0000 7f6d1823b700 1 -- start start 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.311+0000 7f6d1823b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d100feb40 0x7f6d10197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.311+0000 7f6d1823b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d100ff490 0x7f6d101981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.311+0000 7f6d1823b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10198740 con 0x7f6d100feb40 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.311+0000 7f6d1823b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d101988b0 con 0x7f6d100ff490 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.311+0000 7f6d15fd7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d100feb40 0x7f6d10197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.311+0000 7f6d15fd7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d100feb40 0x7f6d10197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47896/0 (socket says 172.21.15.46:47896) 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.311+0000 7f6d15fd7700 1 -- 172.21.15.46:0/100679834 learned_addr learned my addr 172.21.15.46:0/100679834 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.311+0000 7f6d157d6700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d100ff490 0x7f6d101981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:58.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.312+0000 7f6d15fd7700 1 -- 172.21.15.46:0/100679834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d100ff490 msgr2=0x7f6d101981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.312+0000 7f6d15fd7700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d100ff490 0x7f6d101981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.312+0000 7f6d15fd7700 1 -- 172.21.15.46:0/100679834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0095f0 con 0x7f6d100feb40 2024-02-19T19:01:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.312+0000 7f6d15fd7700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d100feb40 0x7f6d10197c90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000c930 tx=0x7f6d0000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.312+0000 7f6d06ffd700 1 -- 172.21.15.46:0/100679834 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d00007ad0 con 0x7f6d100feb40 2024-02-19T19:01:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.312+0000 7f6d1823b700 1 -- 172.21.15.46:0/100679834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1019d350 con 0x7f6d100feb40 2024-02-19T19:01:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.312+0000 7f6d06ffd700 1 -- 172.21.15.46:0/100679834 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d0000ce80 con 0x7f6d100feb40 2024-02-19T19:01:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.312+0000 7f6d06ffd700 1 -- 172.21.15.46:0/100679834 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d00018630 con 0x7f6d100feb40 2024-02-19T19:01:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.312+0000 7f6d1823b700 1 -- 172.21.15.46:0/100679834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1019d870 con 0x7f6d100feb40 2024-02-19T19:01:58.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.313+0000 7f6d1823b700 1 -- 172.21.15.46:0/100679834 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1010af70 con 0x7f6d100feb40 2024-02-19T19:01:58.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.314+0000 7f6d06ffd700 1 -- 172.21.15.46:0/100679834 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7f6d00007c30 con 0x7f6d100feb40 2024-02-19T19:01:58.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.314+0000 7f6d06ffd700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f6cfc06cf10 0x7f6cfc06f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:58.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.314+0000 7f6d06ffd700 1 -- 172.21.15.46:0/100679834 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6d0008c680 con 0x7f6d100feb40 2024-02-19T19:01:58.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.314+0000 7f6d157d6700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f6cfc06cf10 0x7f6cfc06f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:58.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.315+0000 7f6d157d6700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f6cfc06cf10 0x7f6cfc06f3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00b5c0 tx=0x7f6d0c0052a0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:58.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.319+0000 7f6d06ffd700 1 -- 172.21.15.46:0/100679834 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f6d00056290 con 0x7f6d100feb40 2024-02-19T19:01:58.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:58 smithi142 ceph-mon[37169]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:58.465 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:58 smithi046 ceph-mon[29647]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:58.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.547+0000 7f6d1823b700 1 -- 172.21.15.46:0/100679834 --> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d10108890 con 0x7f6cfc06cf10 2024-02-19T19:01:58.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.549+0000 7f6d06ffd700 1 -- 172.21.15.46:0/100679834 <== mgr.24363 v2:172.21.15.142:6828/3077186414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f6d10108890 con 0x7f6cfc06cf10 2024-02-19T19:01:58.569 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:01:58.569 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:01:58.569 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:01:58.569 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:01:58.569 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-02-19T19:01:58.569 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "1/2 daemons upgraded", 2024-02-19T19:01:58.569 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "", 2024-02-19T19:01:58.569 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:01:58.569 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:01:58.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.550+0000 7f6d1823b700 1 -- 172.21.15.46:0/100679834 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f6cfc06cf10 msgr2=0x7f6cfc06f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:58.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.550+0000 7f6d1823b700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f6cfc06cf10 0x7f6cfc06f3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00b5c0 tx=0x7f6d0c0052a0 comp rx=0 tx=0).stop 2024-02-19T19:01:58.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.550+0000 7f6d1823b700 1 -- 172.21.15.46:0/100679834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d100feb40 msgr2=0x7f6d10197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:58.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.550+0000 7f6d1823b700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d100feb40 0x7f6d10197c90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000c930 tx=0x7f6d0000cc40 comp rx=0 tx=0).stop 2024-02-19T19:01:58.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.551+0000 7f6d1823b700 1 -- 172.21.15.46:0/100679834 shutdown_connections 2024-02-19T19:01:58.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.551+0000 7f6d1823b700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d100feb40 0x7f6d10197c90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:58.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.551+0000 7f6d1823b700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.142:6828/3077186414,v1:172.21.15.142:6829/3077186414] conn(0x7f6cfc06cf10 0x7f6cfc06f3c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:58.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.551+0000 7f6d1823b700 1 --2- 172.21.15.46:0/100679834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d100ff490 0x7f6d101981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:58.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.551+0000 7f6d1823b700 1 -- 172.21.15.46:0/100679834 >> 172.21.15.46:0/100679834 conn(0x7f6d100fa6d0 msgr2=0x7f6d10107170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:58.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.551+0000 7f6d1823b700 1 -- 172.21.15.46:0/100679834 shutdown_connections 2024-02-19T19:01:58.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:01:58.551+0000 7f6d1823b700 1 -- 172.21.15.46:0/100679834 wait complete. 2024-02-19T19:01:59.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:59 smithi142 ceph-mon[37169]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:59.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:59 smithi142 ceph-mon[37169]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:59.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:59 smithi142 ceph-mon[37169]: pgmap v12: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:01:59.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:01:59 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/3484417808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:01:59.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:59 smithi046 ceph-mon[29647]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:59.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:59 smithi046 ceph-mon[29647]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:59.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:59 smithi046 ceph-mon[29647]: pgmap v12: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:01:59.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:01:59 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3484417808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:00.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:00 smithi142 ceph-mon[37169]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:00.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:00 smithi046 ceph-mon[29647]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:01.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:01 smithi142 ceph-mon[37169]: pgmap v13: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:01.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:01 smithi046 ceph-mon[29647]: pgmap v13: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: pgmap v14: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: Adjusting osd_memory_target on smithi142 to 2240M 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:03.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:03.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: Updating smithi046:/etc/ceph/ceph.conf 2024-02-19T19:02:03.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: Updating smithi142:/etc/ceph/ceph.conf 2024-02-19T19:02:03.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:02:03.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:02:03.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:02 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: pgmap v14: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: Adjusting osd_memory_target on smithi142 to 2240M 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:03.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:03.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: Updating smithi046:/etc/ceph/ceph.conf 2024-02-19T19:02:03.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: Updating smithi142:/etc/ceph/ceph.conf 2024-02-19T19:02:03.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:02:03.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:02:03.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:03.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:02 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:04.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:03 smithi046 ceph-mon[29647]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:02:04.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:03 smithi046 ceph-mon[29647]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:02:04.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:03 smithi046 ceph-mon[29647]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:02:04.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:03 smithi046 ceph-mon[29647]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:02:04.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:03 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:04.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:03 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:04.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:03 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:04.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:03 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:04.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:03 smithi046 ceph-mon[29647]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-02-19T19:02:04.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:03 smithi046 ceph-mon[29647]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-02-19T19:02:04.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:03 smithi142 ceph-mon[37169]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:02:04.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:03 smithi142 ceph-mon[37169]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:02:04.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:03 smithi142 ceph-mon[37169]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:02:04.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:03 smithi142 ceph-mon[37169]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:02:04.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:03 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:04.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:03 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:04.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:03 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:04.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:03 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:04.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:03 smithi142 ceph-mon[37169]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-02-19T19:02:04.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:03 smithi142 ceph-mon[37169]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-02-19T19:02:05.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:05 smithi046 ceph-mon[29647]: pgmap v15: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:05.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:05 smithi142 ceph-mon[37169]: pgmap v15: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:07.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:07 smithi142 ceph-mon[37169]: pgmap v16: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:07.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:07 smithi046 ceph-mon[29647]: pgmap v16: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:09.379 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:09 smithi046 ceph-mon[29647]: pgmap v17: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:09.379 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:09 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:09.379 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:09 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:09.379 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:09 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:02:09.379 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:09 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:09.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:09 smithi142 ceph-mon[37169]: pgmap v17: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:09.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:09 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:09.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:09 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:09.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:09 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:02:09.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:09 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:10.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:10 smithi142 ceph-mon[37169]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:02:10.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:10 smithi142 ceph-mon[37169]: Upgrade: Need to upgrade myself (mgr.smithi142.fwekwv) 2024-02-19T19:02:10.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:10 smithi142 ceph-mon[37169]: Upgrade: Need to upgrade myself (mgr.smithi142.fwekwv) 2024-02-19T19:02:10.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:10 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:10.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:10 smithi046 ceph-mon[29647]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:02:10.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:10 smithi046 ceph-mon[29647]: Upgrade: Need to upgrade myself (mgr.smithi142.fwekwv) 2024-02-19T19:02:10.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:10 smithi046 ceph-mon[29647]: Upgrade: Need to upgrade myself (mgr.smithi142.fwekwv) 2024-02-19T19:02:10.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:10 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:11.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:11 smithi046 ceph-mon[29647]: pgmap v18: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:11.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:11 smithi046 ceph-mon[29647]: Upgrade: Updating mgr.smithi046.qtceex 2024-02-19T19:02:11.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:11 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:11.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:11 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.qtceex", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:02:11.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:11 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.qtceex", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:02:11.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:11 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:02:11.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:11 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:11.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:11 smithi046 ceph-mon[29647]: Deploying daemon mgr.smithi046.qtceex on smithi046 2024-02-19T19:02:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:11 smithi142 ceph-mon[37169]: pgmap v18: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:11 smithi142 ceph-mon[37169]: Upgrade: Updating mgr.smithi046.qtceex 2024-02-19T19:02:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:11 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:11 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.qtceex", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:02:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:11 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.qtceex", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:02:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:11 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:02:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:11 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:11 smithi142 ceph-mon[37169]: Deploying daemon mgr.smithi046.qtceex on smithi046 2024-02-19T19:02:13.506 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:13 smithi046 ceph-mon[29647]: pgmap v19: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:13.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:13 smithi142 ceph-mon[37169]: pgmap v19: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:15.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:15 smithi046 ceph-mon[29647]: pgmap v20: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:15.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:15 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:15.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:15 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:15.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:15 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:15.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:15 smithi142 ceph-mon[37169]: pgmap v20: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:15 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:15 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:15 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:17.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:17 smithi142 ceph-mon[37169]: pgmap v21: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:17.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:17 smithi046 ceph-mon[29647]: pgmap v21: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:19.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:19 smithi142 ceph-mon[37169]: pgmap v22: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:19.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:19 smithi046 ceph-mon[29647]: pgmap v22: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:20.702 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:20 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:20.702 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:20 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:20.702 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:20 smithi046 ceph-mon[29647]: pgmap v23: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:20.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:20 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:20.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:20 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:20.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:20 smithi142 ceph-mon[37169]: pgmap v23: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:22.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:21 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:22.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:21 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:22.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:21 smithi046 ceph-mon[29647]: Standby manager daemon smithi046.qtceex restarted 2024-02-19T19:02:22.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:21 smithi046 ceph-mon[29647]: Standby manager daemon smithi046.qtceex started 2024-02-19T19:02:22.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:21 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.qtceex/crt"}]: dispatch 2024-02-19T19:02:22.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:21 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:02:22.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:21 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.qtceex/key"}]: dispatch 2024-02-19T19:02:22.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:21 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:02:22.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:21 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:22.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:21 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:22.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:21 smithi142 ceph-mon[37169]: Standby manager daemon smithi046.qtceex restarted 2024-02-19T19:02:22.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:21 smithi142 ceph-mon[37169]: Standby manager daemon smithi046.qtceex started 2024-02-19T19:02:22.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:21 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.qtceex/crt"}]: dispatch 2024-02-19T19:02:22.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:21 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:02:22.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:21 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.qtceex/key"}]: dispatch 2024-02-19T19:02:22.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:21 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:02:23.051 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:22 smithi046 ceph-mon[29647]: pgmap v24: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:23.051 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:22 smithi046 ceph-mon[29647]: mgrmap e25: smithi142.fwekwv(active, since 42s), standbys: smithi046.qtceex 2024-02-19T19:02:23.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:22 smithi142 ceph-mon[37169]: pgmap v24: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:23.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:22 smithi142 ceph-mon[37169]: mgrmap e25: smithi142.fwekwv(active, since 42s), standbys: smithi046.qtceex 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mgr fail", "who": "smithi142.fwekwv"}]: dispatch 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mgr fail", "who": "smithi142.fwekwv"}]: dispatch 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: osdmap e48: 6 total, 6 up, 6 in 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd='[{"prefix": "mgr fail", "who": "smithi142.fwekwv"}]': finished 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: mgrmap e26: smithi046.qtceex(active, starting, since 0.00609588s) 2024-02-19T19:02:25.358 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi046.qtceex", "id": "smithi046.qtceex"}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:02:25.359 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: Manager daemon smithi046.qtceex is now available 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/trash_purge_schedule"}]: dispatch 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: [19/Feb/2024:19:02:24] ENGINE Bus STARTING 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: [19/Feb/2024:19:02:24] ENGINE Serving on https://172.21.15.46:7150 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: [19/Feb/2024:19:02:24] ENGINE Serving on http://172.21.15.46:8765 2024-02-19T19:02:25.360 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:25 smithi142 ceph-mon[37169]: [19/Feb/2024:19:02:24] ENGINE Bus STARTED 2024-02-19T19:02:25.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.24363 172.21.15.142:0/2829087512' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mgr fail", "who": "smithi142.fwekwv"}]: dispatch 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "mgr fail", "who": "smithi142.fwekwv"}]: dispatch 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: osdmap e48: 6 total, 6 up, 6 in 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.24363 ' entity='mgr.smithi142.fwekwv' cmd='[{"prefix": "mgr fail", "who": "smithi142.fwekwv"}]': finished 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: mgrmap e26: smithi046.qtceex(active, starting, since 0.00609588s) 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T19:02:25.501 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi046.qtceex", "id": "smithi046.qtceex"}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:02:25.502 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:02:25.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: Manager daemon smithi046.qtceex is now available 2024-02-19T19:02:25.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:25.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:25.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:25.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:02:25.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/trash_purge_schedule"}]: dispatch 2024-02-19T19:02:25.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: [19/Feb/2024:19:02:24] ENGINE Bus STARTING 2024-02-19T19:02:25.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: [19/Feb/2024:19:02:24] ENGINE Serving on https://172.21.15.46:7150 2024-02-19T19:02:25.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: [19/Feb/2024:19:02:24] ENGINE Serving on http://172.21.15.46:8765 2024-02-19T19:02:25.503 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:25 smithi046 ceph-mon[29647]: [19/Feb/2024:19:02:24] ENGINE Bus STARTED 2024-02-19T19:02:26.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:26 smithi046 ceph-mon[29647]: mgrmap e27: smithi046.qtceex(active, since 1.00854s) 2024-02-19T19:02:26.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:26 smithi046 ceph-mon[29647]: pgmap v3: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:26.629 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:26 smithi142 ceph-mon[37169]: mgrmap e27: smithi046.qtceex(active, since 1.00854s) 2024-02-19T19:02:26.629 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:26 smithi142 ceph-mon[37169]: pgmap v3: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:27.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:27 smithi046 ceph-mon[29647]: pgmap v4: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:27.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:27 smithi046 ceph-mon[29647]: mgrmap e28: smithi046.qtceex(active, since 2s) 2024-02-19T19:02:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:27 smithi142 ceph-mon[37169]: pgmap v4: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:27 smithi142 ceph-mon[37169]: mgrmap e28: smithi046.qtceex(active, since 2s) 2024-02-19T19:02:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.677+0000 7ff0a586b700 1 -- 172.21.15.46:0/2039526554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0a00ff140 msgr2=0x7ff0a00ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.677+0000 7ff0a586b700 1 --2- 172.21.15.46:0/2039526554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0a00ff140 0x7ff0a00ff550 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff09800b0a0 tx=0x7ff09800b3b0 comp rx=0 tx=0).stop 2024-02-19T19:02:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.677+0000 7ff0a586b700 1 -- 172.21.15.46:0/2039526554 shutdown_connections 2024-02-19T19:02:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.677+0000 7ff0a586b700 1 --2- 172.21.15.46:0/2039526554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a0100340 0x7ff0a0100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.677+0000 7ff0a586b700 1 --2- 172.21.15.46:0/2039526554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0a00ff140 0x7ff0a00ff550 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.677+0000 7ff0a586b700 1 -- 172.21.15.46:0/2039526554 >> 172.21.15.46:0/2039526554 conn(0x7ff0a00fa6d0 msgr2=0x7ff0a00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.677+0000 7ff0a586b700 1 -- 172.21.15.46:0/2039526554 shutdown_connections 2024-02-19T19:02:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.677+0000 7ff0a586b700 1 -- 172.21.15.46:0/2039526554 wait complete. 2024-02-19T19:02:28.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.678+0000 7ff0a586b700 1 Processor -- start 2024-02-19T19:02:28.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.678+0000 7ff0a586b700 1 -- start start 2024-02-19T19:02:28.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.678+0000 7ff0a586b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00ff140 0x7ff0a01949d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:28.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.678+0000 7ff0a586b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0a0100340 0x7ff0a0194f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:28.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.678+0000 7ff0a586b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0195530 con 0x7ff0a0100340 2024-02-19T19:02:28.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.678+0000 7ff0a586b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0195670 con 0x7ff0a00ff140 2024-02-19T19:02:28.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff09effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00ff140 0x7ff0a01949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:28.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff09e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0a0100340 0x7ff0a0194f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:28.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff09effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00ff140 0x7ff0a01949d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:41840/0 (socket says 172.21.15.46:41840) 2024-02-19T19:02:28.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff09effd700 1 -- 172.21.15.46:0/2587802958 learned_addr learned my addr 172.21.15.46:0/2587802958 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:02:28.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff09e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0a0100340 0x7ff0a0194f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58048/0 (socket says 172.21.15.46:58048) 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff09e7fc700 1 -- 172.21.15.46:0/2587802958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00ff140 msgr2=0x7ff0a01949d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff09e7fc700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00ff140 0x7ff0a01949d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff09e7fc700 1 -- 172.21.15.46:0/2587802958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098009d00 con 0x7ff0a0100340 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff09effd700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00ff140 0x7ff0a01949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff09e7fc700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0a0100340 0x7ff0a0194f10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff08800d6d0 tx=0x7ff08800d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff0a4869700 1 -- 172.21.15.46:0/2587802958 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0880041f0 con 0x7ff0a0100340 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff0a586b700 1 -- 172.21.15.46:0/2587802958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a019a120 con 0x7ff0a0100340 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff0a4869700 1 -- 172.21.15.46:0/2587802958 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff088004ce0 con 0x7ff0a0100340 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff0a4869700 1 -- 172.21.15.46:0/2587802958 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff08800f690 con 0x7ff0a0100340 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.679+0000 7ff0a586b700 1 -- 172.21.15.46:0/2587802958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a0068dd0 con 0x7ff0a0100340 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.680+0000 7ff0a4869700 1 -- 172.21.15.46:0/2587802958 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 29) v1 ==== 46071+0+0 (secure 0 0 0) 0x7ff08800f910 con 0x7ff0a0100340 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.681+0000 7ff0a4869700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff08c03b0c0 0x7ff08c03d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.681+0000 7ff0a4869700 1 -- 172.21.15.46:0/2587802958 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff08804cbb0 con 0x7ff0a0100340 2024-02-19T19:02:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.681+0000 7ff09effd700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff08c03b0c0 0x7ff08c03d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:28.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.681+0000 7ff0a586b700 1 -- 172.21.15.46:0/2587802958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a0107c90 con 0x7ff0a0100340 2024-02-19T19:02:28.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.681+0000 7ff09effd700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff08c03b0c0 0x7ff08c03d570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff098009480 tx=0x7ff0980060c0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:28.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.686+0000 7ff0a4869700 1 -- 172.21.15.46:0/2587802958 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7ff088014070 con 0x7ff0a0100340 2024-02-19T19:02:28.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.941+0000 7ff0a586b700 1 -- 172.21.15.46:0/2587802958 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0a0069a20 con 0x7ff08c03b0c0 2024-02-19T19:02:28.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.942+0000 7ff0a4869700 1 -- 172.21.15.46:0/2587802958 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7ff0a0069a20 con 0x7ff08c03b0c0 2024-02-19T19:02:28.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 -- 172.21.15.46:0/2587802958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff08c03b0c0 msgr2=0x7ff08c03d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:28.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff08c03b0c0 0x7ff08c03d570 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff098009480 tx=0x7ff0980060c0 comp rx=0 tx=0).stop 2024-02-19T19:02:28.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 -- 172.21.15.46:0/2587802958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0a0100340 msgr2=0x7ff0a0194f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:28.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0a0100340 0x7ff0a0194f10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff08800d6d0 tx=0x7ff08800d9e0 comp rx=0 tx=0).stop 2024-02-19T19:02:28.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 -- 172.21.15.46:0/2587802958 shutdown_connections 2024-02-19T19:02:28.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff08c03b0c0 0x7ff08c03d570 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:28.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a00ff140 0x7ff0a01949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:28.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 --2- 172.21.15.46:0/2587802958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0a0100340 0x7ff0a0194f10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:28.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 -- 172.21.15.46:0/2587802958 >> 172.21.15.46:0/2587802958 conn(0x7ff0a00fa6d0 msgr2=0x7ff0a0103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:28.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 -- 172.21.15.46:0/2587802958 shutdown_connections 2024-02-19T19:02:28.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:28.944+0000 7ff0a586b700 1 -- 172.21.15.46:0/2587802958 wait complete. 2024-02-19T19:02:28.973 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:02:29.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.053+0000 7f74f2468700 1 -- 172.21.15.46:0/4181677813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec1003d0 msgr2=0x7f74ec100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:29.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.053+0000 7f74f2468700 1 --2- 172.21.15.46:0/4181677813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec1003d0 0x7f74ec100840 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009910 tx=0x7f74e0009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:29.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.053+0000 7f74f2468700 1 -- 172.21.15.46:0/4181677813 shutdown_connections 2024-02-19T19:02:29.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.053+0000 7f74f2468700 1 --2- 172.21.15.46:0/4181677813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec1003d0 0x7f74ec100840 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.053+0000 7f74f2468700 1 --2- 172.21.15.46:0/4181677813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0ff130 0x7f74ec0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.053+0000 7f74f2468700 1 -- 172.21.15.46:0/4181677813 >> 172.21.15.46:0/4181677813 conn(0x7f74ec0fa780 msgr2=0x7f74ec0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:29.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.054+0000 7f74f2468700 1 -- 172.21.15.46:0/4181677813 shutdown_connections 2024-02-19T19:02:29.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.054+0000 7f74f2468700 1 -- 172.21.15.46:0/4181677813 wait complete. 2024-02-19T19:02:29.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.054+0000 7f74f2468700 1 Processor -- start 2024-02-19T19:02:29.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.054+0000 7f74f2468700 1 -- start start 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74f2468700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0ff130 0x7f74ec195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74f2468700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec1003d0 0x7f74ec195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74f2468700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec1965c0 con 0x7f74ec1003d0 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74f2468700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec196700 con 0x7f74ec0ff130 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74eb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec1003d0 0x7f74ec195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74ebfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0ff130 0x7f74ec195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74eb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec1003d0 0x7f74ec195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58078/0 (socket says 172.21.15.46:58078) 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74eb7fe700 1 -- 172.21.15.46:0/2400890482 learned_addr learned my addr 172.21.15.46:0/2400890482 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74eb7fe700 1 -- 172.21.15.46:0/2400890482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0ff130 msgr2=0x7f74ec195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74eb7fe700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0ff130 0x7f74ec195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74eb7fe700 1 -- 172.21.15.46:0/2400890482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e00095f0 con 0x7f74ec1003d0 2024-02-19T19:02:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.055+0000 7f74ebfff700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0ff130 0x7f74ec195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:02:29.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.056+0000 7f74eb7fe700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec1003d0 0x7f74ec195fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f74e000bd70 tx=0x7f74e000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:29.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.057+0000 7f74e97fa700 1 -- 172.21.15.46:0/2400890482 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e001d070 con 0x7f74ec1003d0 2024-02-19T19:02:29.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.057+0000 7f74f2468700 1 -- 172.21.15.46:0/2400890482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec19b150 con 0x7f74ec1003d0 2024-02-19T19:02:29.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.057+0000 7f74e97fa700 1 -- 172.21.15.46:0/2400890482 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f74e0005dc0 con 0x7f74ec1003d0 2024-02-19T19:02:29.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.057+0000 7f74e97fa700 1 -- 172.21.15.46:0/2400890482 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e0021410 con 0x7f74ec1003d0 2024-02-19T19:02:29.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.057+0000 7f74f2468700 1 -- 172.21.15.46:0/2400890482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec19b640 con 0x7f74ec1003d0 2024-02-19T19:02:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.058+0000 7f74e97fa700 1 -- 172.21.15.46:0/2400890482 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 29) v1 ==== 46071+0+0 (secure 0 0 0) 0x7f74e002b440 con 0x7f74ec1003d0 2024-02-19T19:02:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.058+0000 7f74f2468700 1 -- 172.21.15.46:0/2400890482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec107c10 con 0x7f74ec1003d0 2024-02-19T19:02:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.059+0000 7f74e97fa700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f74d4038eb0 0x7f74d403b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.059+0000 7f74e97fa700 1 -- 172.21.15.46:0/2400890482 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f74e004e380 con 0x7f74ec1003d0 2024-02-19T19:02:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.059+0000 7f74ebfff700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f74d4038eb0 0x7f74d403b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:29.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.059+0000 7f74ebfff700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f74d4038eb0 0x7f74d403b360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f74dc007fd0 tx=0x7f74dc0073d0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:29.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.064+0000 7f74e97fa700 1 -- 172.21.15.46:0/2400890482 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f74e0029930 con 0x7f74ec1003d0 2024-02-19T19:02:29.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:28 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:29.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:28 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:29.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:28 smithi142 ceph-mon[37169]: mgrmap e29: smithi046.qtceex(active, since 4s) 2024-02-19T19:02:29.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.308+0000 7f74f2468700 1 -- 172.21.15.46:0/2400890482 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74ec068c50 con 0x7f74d4038eb0 2024-02-19T19:02:29.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:28 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:29.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:28 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:29.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:28 smithi046 ceph-mon[29647]: mgrmap e29: smithi046.qtceex(active, since 4s) 2024-02-19T19:02:29.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.309+0000 7f74e97fa700 1 -- 172.21.15.46:0/2400890482 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f74ec068c50 con 0x7f74d4038eb0 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.311+0000 7f74f2468700 1 -- 172.21.15.46:0/2400890482 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f74d4038eb0 msgr2=0x7f74d403b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.311+0000 7f74f2468700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f74d4038eb0 0x7f74d403b360 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f74dc007fd0 tx=0x7f74dc0073d0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.311+0000 7f74f2468700 1 -- 172.21.15.46:0/2400890482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec1003d0 msgr2=0x7f74ec195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.311+0000 7f74f2468700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec1003d0 0x7f74ec195fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f74e000bd70 tx=0x7f74e000bda0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.311+0000 7f74f2468700 1 -- 172.21.15.46:0/2400890482 shutdown_connections 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.311+0000 7f74f2468700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f74d4038eb0 0x7f74d403b360 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.311+0000 7f74f2468700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74ec0ff130 0x7f74ec195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.311+0000 7f74f2468700 1 --2- 172.21.15.46:0/2400890482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74ec1003d0 0x7f74ec195fa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.311+0000 7f74f2468700 1 -- 172.21.15.46:0/2400890482 >> 172.21.15.46:0/2400890482 conn(0x7f74ec0fa780 msgr2=0x7f74ec068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.311+0000 7f74f2468700 1 -- 172.21.15.46:0/2400890482 shutdown_connections 2024-02-19T19:02:29.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.312+0000 7f74f2468700 1 -- 172.21.15.46:0/2400890482 wait complete. 2024-02-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.417+0000 7fc1c1556700 1 -- 172.21.15.46:0/3564959512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1bc100d60 msgr2=0x7fc1bc103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.417+0000 7fc1c1556700 1 --2- 172.21.15.46:0/3564959512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1bc100d60 0x7fc1bc103140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009910 tx=0x7fc1ac009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.417+0000 7fc1c1556700 1 -- 172.21.15.46:0/3564959512 shutdown_connections 2024-02-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.417+0000 7fc1c1556700 1 --2- 172.21.15.46:0/3564959512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc103680 0x7fc1bc105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.417+0000 7fc1c1556700 1 --2- 172.21.15.46:0/3564959512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1bc100d60 0x7fc1bc103140 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.417+0000 7fc1c1556700 1 -- 172.21.15.46:0/3564959512 >> 172.21.15.46:0/3564959512 conn(0x7fc1bc0fa780 msgr2=0x7fc1bc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.417+0000 7fc1c1556700 1 -- 172.21.15.46:0/3564959512 shutdown_connections 2024-02-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.417+0000 7fc1c1556700 1 -- 172.21.15.46:0/3564959512 wait complete. 2024-02-19T19:02:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.418+0000 7fc1c1556700 1 Processor -- start 2024-02-19T19:02:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.418+0000 7fc1c1556700 1 -- start start 2024-02-19T19:02:29.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.418+0000 7fc1c1556700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc100d60 0x7fc1bc1006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.418+0000 7fc1c1556700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1bc103680 0x7fc1bc0fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.418+0000 7fc1c1556700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc0ff250 con 0x7fc1bc103680 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.418+0000 7fc1c1556700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc0ff390 con 0x7fc1bc100d60 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.418+0000 7fc1ba7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1bc103680 0x7fc1bc0fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.418+0000 7fc1ba7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1bc103680 0x7fc1bc0fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58096/0 (socket says 172.21.15.46:58096) 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.418+0000 7fc1ba7fc700 1 -- 172.21.15.46:0/1068773310 learned_addr learned my addr 172.21.15.46:0/1068773310 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.419+0000 7fc1baffd700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc100d60 0x7fc1bc1006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.419+0000 7fc1ba7fc700 1 -- 172.21.15.46:0/1068773310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc100d60 msgr2=0x7fc1bc1006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.419+0000 7fc1ba7fc700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc100d60 0x7fc1bc1006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.419+0000 7fc1ba7fc700 1 -- 172.21.15.46:0/1068773310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0095f0 con 0x7fc1bc103680 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.419+0000 7fc1ba7fc700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1bc103680 0x7fc1bc0fed10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000d8d0 tx=0x7fc1b000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.419+0000 7fc1a3fff700 1 -- 172.21.15.46:0/1068773310 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1b00098a0 con 0x7fc1bc103680 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.419+0000 7fc1a3fff700 1 -- 172.21.15.46:0/1068773310 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc1b0010460 con 0x7fc1bc103680 2024-02-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.419+0000 7fc1c1556700 1 -- 172.21.15.46:0/1068773310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc0ff670 con 0x7fc1bc103680 2024-02-19T19:02:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.419+0000 7fc1a3fff700 1 -- 172.21.15.46:0/1068773310 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1b000f5f0 con 0x7fc1bc103680 2024-02-19T19:02:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.419+0000 7fc1c1556700 1 -- 172.21.15.46:0/1068773310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc19db10 con 0x7fc1bc103680 2024-02-19T19:02:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.420+0000 7fc1a3fff700 1 -- 172.21.15.46:0/1068773310 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 29) v1 ==== 46071+0+0 (secure 0 0 0) 0x7fc1b0009a00 con 0x7fc1bc103680 2024-02-19T19:02:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.420+0000 7fc1a3fff700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1a4038eb0 0x7fc1a403b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.420+0000 7fc1c1556700 1 -- 172.21.15.46:0/1068773310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1bc18fbc0 con 0x7fc1bc103680 2024-02-19T19:02:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.420+0000 7fc1a3fff700 1 -- 172.21.15.46:0/1068773310 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc1b004cee0 con 0x7fc1bc103680 2024-02-19T19:02:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.420+0000 7fc1baffd700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1a4038eb0 0x7fc1a403b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:29.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.421+0000 7fc1baffd700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1a4038eb0 0x7fc1a403b360 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac006010 tx=0x7fc1ac005ec0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:29.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.425+0000 7fc1a3fff700 1 -- 172.21.15.46:0/1068773310 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fc1b00105d0 con 0x7fc1bc103680 2024-02-19T19:02:29.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.646+0000 7fc1c1556700 1 -- 172.21.15.46:0/1068773310 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1bc061190 con 0x7fc1a4038eb0 2024-02-19T19:02:29.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.657+0000 7fc1a3fff700 1 -- 172.21.15.46:0/1068773310 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc1bc061190 con 0x7fc1a4038eb0 2024-02-19T19:02:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:02:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (7m) 9s ago 9m 24.8M - 0.25.0 c8568f914cd2 cfbe74f8660f 2024-02-19T19:02:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (9m) 10s ago 9m 7692k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:02:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (7m) 1s ago 7m 7625k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:02:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (9m) 10s ago 9m 6656k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:02:29.676 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (7m) 1s ago 7m 6665k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 9s ago 8m 85.5M - 9.4.7 954c08fa6188 2fa87d8c964a 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (3m) 9s ago 3m 25.4M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (3m) 9s ago 3m 13.1M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (2m) 1s ago 2m 14.2M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (3m) 1s ago 3m 21.4M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (16s) 10s ago 10m 65.8M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (57s) 1s ago 7m 74.1M - 19.0.0-1450-gf78a58c0 f081f847070a 0f8aadaa6198 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (10m) 10s ago 10m 47.9M 2048M 18.2.0 dc2bc1663786 adb8243bd11c 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (7m) 1s ago 7m 40.3M 2048M 18.2.0 dc2bc1663786 3f6c8b69abc2 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (9m) 10s ago 9m 16.2M - 1.5.0 0da6a335fe13 6fcd0bc86aba 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (7m) 1s ago 7m 14.6M - 1.5.0 0da6a335fe13 bdfda6603f51 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (6m) 9s ago 6m 50.1M 1217M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (6m) 9s ago 6m 48.9M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (5m) 9s ago 5m 50.6M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:02:29.677 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (5m) 1s ago 5m 47.8M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:02:29.678 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (4m) 1s ago 4m 46.1M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:02:29.678 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (4m) 1s ago 4m 46.9M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:02:29.678 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (21s) 9s ago 8m 44.2M - 2.43.0 a07b618ecd1d bf6f02bce884 2024-02-19T19:02:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 -- 172.21.15.46:0/1068773310 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1a4038eb0 msgr2=0x7fc1a403b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1a4038eb0 0x7fc1a403b360 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac006010 tx=0x7fc1ac005ec0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 -- 172.21.15.46:0/1068773310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1bc103680 msgr2=0x7fc1bc0fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1bc103680 0x7fc1bc0fed10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000d8d0 tx=0x7fc1b000dbe0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 -- 172.21.15.46:0/1068773310 shutdown_connections 2024-02-19T19:02:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1a4038eb0 0x7fc1a403b360 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc100d60 0x7fc1bc1006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 --2- 172.21.15.46:0/1068773310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1bc103680 0x7fc1bc0fed10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 -- 172.21.15.46:0/1068773310 >> 172.21.15.46:0/1068773310 conn(0x7fc1bc0fa780 msgr2=0x7fc1bc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 -- 172.21.15.46:0/1068773310 shutdown_connections 2024-02-19T19:02:29.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.659+0000 7fc1c1556700 1 -- 172.21.15.46:0/1068773310 wait complete. 2024-02-19T19:02:29.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.766+0000 7f764e5ba700 1 -- 172.21.15.46:0/1812196793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76481002a0 msgr2=0x7f7648100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:29.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.766+0000 7f764e5ba700 1 --2- 172.21.15.46:0/1812196793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76481002a0 0x7f7648100710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f763c009910 tx=0x7f763c009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.766+0000 7f764e5ba700 1 -- 172.21.15.46:0/1812196793 shutdown_connections 2024-02-19T19:02:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.766+0000 7f764e5ba700 1 --2- 172.21.15.46:0/1812196793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76481002a0 0x7f7648100710 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.766+0000 7f764e5ba700 1 --2- 172.21.15.46:0/1812196793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76480ff000 0x7f76480ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.766+0000 7f764e5ba700 1 -- 172.21.15.46:0/1812196793 >> 172.21.15.46:0/1812196793 conn(0x7f76480fa610 msgr2=0x7f76480fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.766+0000 7f764e5ba700 1 -- 172.21.15.46:0/1812196793 shutdown_connections 2024-02-19T19:02:29.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.766+0000 7f764e5ba700 1 -- 172.21.15.46:0/1812196793 wait complete. 2024-02-19T19:02:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.767+0000 7f764e5ba700 1 Processor -- start 2024-02-19T19:02:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.767+0000 7f764e5ba700 1 -- start start 2024-02-19T19:02:29.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.767+0000 7f764e5ba700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76480ff000 0x7f76481958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.767+0000 7f764e5ba700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76481002a0 0x7f7648195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.767+0000 7f764e5ba700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7648196420 con 0x7f76481002a0 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.767+0000 7f764e5ba700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7648196560 con 0x7f76480ff000 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.767+0000 7f76477fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76481002a0 0x7f7648195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.767+0000 7f76477fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76481002a0 0x7f7648195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58124/0 (socket says 172.21.15.46:58124) 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.767+0000 7f76477fe700 1 -- 172.21.15.46:0/2982328594 learned_addr learned my addr 172.21.15.46:0/2982328594 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.767+0000 7f7647fff700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76480ff000 0x7f76481958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.768+0000 7f76477fe700 1 -- 172.21.15.46:0/2982328594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76480ff000 msgr2=0x7f76481958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.768+0000 7f76477fe700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76480ff000 0x7f76481958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.768+0000 7f76477fe700 1 -- 172.21.15.46:0/2982328594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c0095f0 con 0x7f76481002a0 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.768+0000 7f76477fe700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76481002a0 0x7f7648195e00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f763c0092e0 tx=0x7f763c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:29.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.768+0000 7f76457fa700 1 -- 172.21.15.46:0/2982328594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f763c01d070 con 0x7f76481002a0 2024-02-19T19:02:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.768+0000 7f76457fa700 1 -- 172.21.15.46:0/2982328594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f763c00f460 con 0x7f76481002a0 2024-02-19T19:02:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.768+0000 7f764e5ba700 1 -- 172.21.15.46:0/2982328594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764819afb0 con 0x7f76481002a0 2024-02-19T19:02:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.768+0000 7f76457fa700 1 -- 172.21.15.46:0/2982328594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f763c021620 con 0x7f76481002a0 2024-02-19T19:02:29.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.768+0000 7f764e5ba700 1 -- 172.21.15.46:0/2982328594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764819b4f0 con 0x7f76481002a0 2024-02-19T19:02:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.769+0000 7f76457fa700 1 -- 172.21.15.46:0/2982328594 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 29) v1 ==== 46071+0+0 (secure 0 0 0) 0x7f763c02b440 con 0x7f76481002a0 2024-02-19T19:02:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.769+0000 7f764e5ba700 1 -- 172.21.15.46:0/2982328594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7648107b00 con 0x7f76481002a0 2024-02-19T19:02:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.769+0000 7f76457fa700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7630038eb0 0x7f763003b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.769+0000 7f76457fa700 1 -- 172.21.15.46:0/2982328594 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f763c04e230 con 0x7f76481002a0 2024-02-19T19:02:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.769+0000 7f7647fff700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7630038eb0 0x7f763003b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:29.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.770+0000 7f7647fff700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7630038eb0 0x7f763003b360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7638004630 tx=0x7f763800b3c0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:29.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:29.774+0000 7f76457fa700 1 -- 172.21.15.46:0/2982328594 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f763c029950 con 0x7f76481002a0 2024-02-19T19:02:30.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.076+0000 7f764e5ba700 1 -- 172.21.15.46:0/2982328594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7648107cf0 con 0x7f76481002a0 2024-02-19T19:02:30.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.077+0000 7f76457fa700 1 -- 172.21.15.46:0/2982328594 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f763c026070 con 0x7f76481002a0 2024-02-19T19:02:30.096 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:02:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:02:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-19T19:02:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:02:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:02:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:02:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:02:30.096 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:02:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-19T19:02:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:02:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:02:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:02:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:02:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:02:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-19T19:02:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:02:30.097 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:02:30.097 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:02:30.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 -- 172.21.15.46:0/2982328594 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7630038eb0 msgr2=0x7f763003b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:30.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7630038eb0 0x7f763003b360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7638004630 tx=0x7f763800b3c0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 -- 172.21.15.46:0/2982328594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76481002a0 msgr2=0x7f7648195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76481002a0 0x7f7648195e00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f763c0092e0 tx=0x7f763c00bd70 comp rx=0 tx=0).stop 2024-02-19T19:02:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 -- 172.21.15.46:0/2982328594 shutdown_connections 2024-02-19T19:02:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7630038eb0 0x7f763003b360 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76480ff000 0x7f76481958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 --2- 172.21.15.46:0/2982328594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76481002a0 0x7f7648195e00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 -- 172.21.15.46:0/2982328594 >> 172.21.15.46:0/2982328594 conn(0x7f76480fa610 msgr2=0x7f7648068640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 -- 172.21.15.46:0/2982328594 shutdown_connections 2024-02-19T19:02:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.079+0000 7f764e5ba700 1 -- 172.21.15.46:0/2982328594 wait complete. 2024-02-19T19:02:30.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:29 smithi142 ceph-mon[37169]: pgmap v5: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:30.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:29 smithi142 ceph-mon[37169]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:30.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:29 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:30.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:29 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:30.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.211+0000 7f41360fc700 1 -- 172.21.15.46:0/1630362935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41301003d0 msgr2=0x7f4130100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:30.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.211+0000 7f41360fc700 1 --2- 172.21.15.46:0/1630362935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41301003d0 0x7f4130100840 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4120009910 tx=0x7f4120009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:30.230 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:29 smithi046 ceph-mon[29647]: pgmap v5: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:30.230 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:29 smithi046 ceph-mon[29647]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:30.230 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:29 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:30.230 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:29 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:30.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.211+0000 7f41360fc700 1 -- 172.21.15.46:0/1630362935 shutdown_connections 2024-02-19T19:02:30.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.211+0000 7f41360fc700 1 --2- 172.21.15.46:0/1630362935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41301003d0 0x7f4130100840 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.211+0000 7f41360fc700 1 --2- 172.21.15.46:0/1630362935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41300ff130 0x7f41300ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.211+0000 7f41360fc700 1 -- 172.21.15.46:0/1630362935 >> 172.21.15.46:0/1630362935 conn(0x7f41300fa780 msgr2=0x7f41300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.211+0000 7f41360fc700 1 -- 172.21.15.46:0/1630362935 shutdown_connections 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.211+0000 7f41360fc700 1 -- 172.21.15.46:0/1630362935 wait complete. 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.211+0000 7f41360fc700 1 Processor -- start 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f41360fc700 1 -- start start 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f41360fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41300ff130 0x7f4130103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f41360fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41301003d0 0x7f41301017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f41360fc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130101cf0 con 0x7f41300ff130 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f41360fc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130101e30 con 0x7f41301003d0 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f412f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41300ff130 0x7f4130103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f412f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41300ff130 0x7f4130103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58142/0 (socket says 172.21.15.46:58142) 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f412f7fe700 1 -- 172.21.15.46:0/3282856222 learned_addr learned my addr 172.21.15.46:0/3282856222 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f412effd700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41301003d0 0x7f41301017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:30.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f412f7fe700 1 -- 172.21.15.46:0/3282856222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41301003d0 msgr2=0x7f41301017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:30.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f412f7fe700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41301003d0 0x7f41301017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.212+0000 7f412f7fe700 1 -- 172.21.15.46:0/3282856222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41200095f0 con 0x7f41300ff130 2024-02-19T19:02:30.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.213+0000 7f412f7fe700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41300ff130 0x7f4130103160 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f411800d900 tx=0x7f411800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:30.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.213+0000 7f412cff9700 1 -- 172.21.15.46:0/3282856222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41180041f0 con 0x7f41300ff130 2024-02-19T19:02:30.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.213+0000 7f412cff9700 1 -- 172.21.15.46:0/3282856222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4118004ce0 con 0x7f41300ff130 2024-02-19T19:02:30.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.213+0000 7f412cff9700 1 -- 172.21.15.46:0/3282856222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f411800b750 con 0x7f41300ff130 2024-02-19T19:02:30.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.213+0000 7f41360fc700 1 -- 172.21.15.46:0/3282856222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4130102110 con 0x7f41300ff130 2024-02-19T19:02:30.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.213+0000 7f41360fc700 1 -- 172.21.15.46:0/3282856222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4130102610 con 0x7f41300ff130 2024-02-19T19:02:30.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.214+0000 7f41360fc700 1 -- 172.21.15.46:0/3282856222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413018fb00 con 0x7f41300ff130 2024-02-19T19:02:30.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.214+0000 7f412cff9700 1 -- 172.21.15.46:0/3282856222 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 29) v1 ==== 46071+0+0 (secure 0 0 0) 0x7f411800b9c0 con 0x7f41300ff130 2024-02-19T19:02:30.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.214+0000 7f412cff9700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f411c038eb0 0x7f411c03b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:30.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.215+0000 7f412cff9700 1 -- 172.21.15.46:0/3282856222 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f411804d0b0 con 0x7f41300ff130 2024-02-19T19:02:30.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.215+0000 7f412effd700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f411c038eb0 0x7f411c03b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:30.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.215+0000 7f412effd700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f411c038eb0 0x7f411c03b360 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4120006010 tx=0x7f412000b540 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:30.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.220+0000 7f412cff9700 1 -- 172.21.15.46:0/3282856222 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f4118022730 con 0x7f41300ff130 2024-02-19T19:02:30.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.454+0000 7f41360fc700 1 -- 172.21.15.46:0/3282856222 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4130061190 con 0x7f411c038eb0 2024-02-19T19:02:30.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.455+0000 7f412cff9700 1 -- 172.21.15.46:0/3282856222 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f4130061190 con 0x7f411c038eb0 2024-02-19T19:02:30.474 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:02:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:02:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:02:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:02:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:02:30.474 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:02:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:02:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-02-19T19:02:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "", 2024-02-19T19:02:30.475 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:02:30.475 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:02:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.457+0000 7f41360fc700 1 -- 172.21.15.46:0/3282856222 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f411c038eb0 msgr2=0x7f411c03b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:30.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.457+0000 7f41360fc700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f411c038eb0 0x7f411c03b360 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4120006010 tx=0x7f412000b540 comp rx=0 tx=0).stop 2024-02-19T19:02:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.457+0000 7f41360fc700 1 -- 172.21.15.46:0/3282856222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41300ff130 msgr2=0x7f4130103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.457+0000 7f41360fc700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41300ff130 0x7f4130103160 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f411800d900 tx=0x7f411800dc10 comp rx=0 tx=0).stop 2024-02-19T19:02:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.457+0000 7f41360fc700 1 -- 172.21.15.46:0/3282856222 shutdown_connections 2024-02-19T19:02:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.457+0000 7f41360fc700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f411c038eb0 0x7f411c03b360 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.457+0000 7f41360fc700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41300ff130 0x7f4130103160 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.457+0000 7f41360fc700 1 --2- 172.21.15.46:0/3282856222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41301003d0 0x7f41301017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.457+0000 7f41360fc700 1 -- 172.21.15.46:0/3282856222 >> 172.21.15.46:0/3282856222 conn(0x7f41300fa780 msgr2=0x7f41300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.457+0000 7f41360fc700 1 -- 172.21.15.46:0/3282856222 shutdown_connections 2024-02-19T19:02:30.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:02:30.458+0000 7f41360fc700 1 -- 172.21.15.46:0/3282856222 wait complete. 2024-02-19T19:02:30.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:30 smithi142 ceph-mon[37169]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:30.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:30 smithi142 ceph-mon[37169]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:30.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:30 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2982328594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:30.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:30 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:30.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:30 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:31.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:30 smithi046 ceph-mon[29647]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:31.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:30 smithi046 ceph-mon[29647]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:31.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:30 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2982328594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:31.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:30 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:31.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:30 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:32.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:31 smithi142 ceph-mon[37169]: pgmap v6: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:32.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:31 smithi142 ceph-mon[37169]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:32.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:31 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:32.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:31 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:32.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:31 smithi142 ceph-mon[37169]: Standby manager daemon smithi142.fwekwv started 2024-02-19T19:02:32.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:31 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/2178815907' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/crt"}]: dispatch 2024-02-19T19:02:32.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:31 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/2178815907' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:02:32.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:31 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/2178815907' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/key"}]: dispatch 2024-02-19T19:02:32.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:31 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/2178815907' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:02:32.202 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:31 smithi046 ceph-mon[29647]: pgmap v6: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:32.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:31 smithi046 ceph-mon[29647]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:32.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:31 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:32.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:31 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:32.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:31 smithi046 ceph-mon[29647]: Standby manager daemon smithi142.fwekwv started 2024-02-19T19:02:32.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:31 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/2178815907' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/crt"}]: dispatch 2024-02-19T19:02:32.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:31 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/2178815907' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:02:32.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:31 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/2178815907' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/key"}]: dispatch 2024-02-19T19:02:32.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:31 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/2178815907' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:02:33.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:33 smithi046 ceph-mon[29647]: mgrmap e30: smithi046.qtceex(active, since 7s), standbys: smithi142.fwekwv 2024-02-19T19:02:33.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi142.fwekwv", "id": "smithi142.fwekwv"}]: dispatch 2024-02-19T19:02:33.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:33 smithi046 ceph-mon[29647]: pgmap v7: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-19T19:02:33.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:33 smithi142 ceph-mon[37169]: mgrmap e30: smithi046.qtceex(active, since 7s), standbys: smithi142.fwekwv 2024-02-19T19:02:33.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi142.fwekwv", "id": "smithi142.fwekwv"}]: dispatch 2024-02-19T19:02:33.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:33 smithi142 ceph-mon[37169]: pgmap v7: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: pgmap v8: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: Updating smithi046:/etc/ceph/ceph.conf 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: Updating smithi142:/etc/ceph/ceph.conf 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:35.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:35.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:35.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:35 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:36.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: pgmap v8: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: Updating smithi046:/etc/ceph/ceph.conf 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: Updating smithi142:/etc/ceph/ceph.conf 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:36.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:36.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:36.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:35 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:36.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:36 smithi046 ceph-mon[29647]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:02:36.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:36 smithi046 ceph-mon[29647]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:02:36.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:36 smithi046 ceph-mon[29647]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:02:36.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:36 smithi046 ceph-mon[29647]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:02:36.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:36 smithi046 ceph-mon[29647]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-02-19T19:02:36.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:36 smithi046 ceph-mon[29647]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-02-19T19:02:36.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:36 smithi142 ceph-mon[37169]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:02:36.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:36 smithi142 ceph-mon[37169]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:02:36.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:36 smithi142 ceph-mon[37169]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:02:36.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:36 smithi142 ceph-mon[37169]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:02:36.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:36 smithi142 ceph-mon[37169]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-02-19T19:02:36.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:36 smithi142 ceph-mon[37169]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-02-19T19:02:37.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:37 smithi046 ceph-mon[29647]: pgmap v9: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:02:37.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:37 smithi142 ceph-mon[37169]: pgmap v9: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:02:39.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:39 smithi046 ceph-mon[29647]: pgmap v10: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:02:39.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:39 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:39.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:39 smithi142 ceph-mon[37169]: pgmap v10: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:02:39.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:39 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:42.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:41 smithi142 ceph-mon[37169]: pgmap v11: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:02:42.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:41 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:42.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:41 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:42.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:41 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:02:42.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:41 smithi142 ceph-mon[37169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:02:42.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:41 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:42.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:41 smithi046 ceph-mon[29647]: pgmap v11: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:02:42.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:41 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:42.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:41 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:42.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:41 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:02:42.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:41 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:02:42.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:41 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:43.313 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:42 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.fwekwv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:02:43.313 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:42 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:02:43.313 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:42 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:43.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:42 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.fwekwv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:02:43.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:42 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:02:43.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:42 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:44.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:43 smithi046 ceph-mon[29647]: pgmap v12: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:02:44.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:43 smithi046 ceph-mon[29647]: Upgrade: Updating mgr.smithi142.fwekwv 2024-02-19T19:02:44.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:43 smithi046 ceph-mon[29647]: Deploying daemon mgr.smithi142.fwekwv on smithi142 2024-02-19T19:02:44.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:43 smithi142 ceph-mon[37169]: pgmap v12: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:02:44.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:43 smithi142 ceph-mon[37169]: Upgrade: Updating mgr.smithi142.fwekwv 2024-02-19T19:02:44.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:43 smithi142 ceph-mon[37169]: Deploying daemon mgr.smithi142.fwekwv on smithi142 2024-02-19T19:02:46.125 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:45 smithi142 ceph-mon[37169]: pgmap v13: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:46.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:45 smithi046 ceph-mon[29647]: pgmap v13: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:47.949 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:47 smithi142 ceph-mon[37169]: pgmap v14: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:47.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:47 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:47.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:47 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:47.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:47 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:47.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:47 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:47.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:47 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:48.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:47 smithi046 ceph-mon[29647]: pgmap v14: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:48.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:47 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:48.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:47 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:48.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:47 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:48.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:47 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:48.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:47 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:50.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:49 smithi046 ceph-mon[29647]: pgmap v15: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:50.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:49 smithi142 ceph-mon[37169]: pgmap v15: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:51.515 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:51.515 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:51.515 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:51 smithi046 ceph-mon[29647]: pgmap v16: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:51.646 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:51.646 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:51.646 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:51 smithi142 ceph-mon[37169]: pgmap v16: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:52.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:52 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:52.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:52 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:52.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:52 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:52.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:52 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:53.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:53 smithi046 ceph-mon[29647]: pgmap v17: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:53.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:53 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:53.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:53 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:53.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:53 smithi142 ceph-mon[37169]: pgmap v17: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:53.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:53 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:53.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:53 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:54.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:54 smithi142 ceph-mon[37169]: Standby manager daemon smithi142.fwekwv restarted 2024-02-19T19:02:54.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:54 smithi142 ceph-mon[37169]: Standby manager daemon smithi142.fwekwv started 2024-02-19T19:02:54.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:54 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/4148710995' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/crt"}]: dispatch 2024-02-19T19:02:54.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:54 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/4148710995' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:02:54.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:54 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/4148710995' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/key"}]: dispatch 2024-02-19T19:02:54.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:54 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/4148710995' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:02:54.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:54 smithi046 ceph-mon[29647]: Standby manager daemon smithi142.fwekwv restarted 2024-02-19T19:02:54.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:54 smithi046 ceph-mon[29647]: Standby manager daemon smithi142.fwekwv started 2024-02-19T19:02:54.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:54 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/4148710995' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/crt"}]: dispatch 2024-02-19T19:02:54.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:54 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/4148710995' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:02:54.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:54 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/4148710995' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/key"}]: dispatch 2024-02-19T19:02:54.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:54 smithi046 ceph-mon[29647]: from='mgr.? 172.21.15.142:0/4148710995' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:02:55.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: mgrmap e31: smithi046.qtceex(active, since 29s), standbys: smithi142.fwekwv 2024-02-19T19:02:55.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: pgmap v18: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:55.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:55.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.qtceex"}]: dispatch 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.qtceex"}]': finished 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.fwekwv"}]: dispatch 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.fwekwv"}]': finished 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:55 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: mgrmap e31: smithi046.qtceex(active, since 29s), standbys: smithi142.fwekwv 2024-02-19T19:02:55.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: pgmap v18: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:55.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:55.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:55.727 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.qtceex"}]: dispatch 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.qtceex"}]': finished 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.fwekwv"}]: dispatch 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.fwekwv"}]': finished 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.728 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:55.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:02:55.729 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:55 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:02:56.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:56 smithi142 ceph-mon[37169]: Upgrade: Setting container_image for all mgr 2024-02-19T19:02:56.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:56 smithi142 ceph-mon[37169]: Upgrade: Setting container_image for all rgw 2024-02-19T19:02:56.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:56 smithi142 ceph-mon[37169]: Upgrade: Setting container_image for all rbd-mirror 2024-02-19T19:02:56.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:56 smithi142 ceph-mon[37169]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-19T19:02:56.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:56 smithi142 ceph-mon[37169]: Upgrade: Setting container_image for all iscsi 2024-02-19T19:02:56.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:56 smithi142 ceph-mon[37169]: Upgrade: Setting container_image for all nfs 2024-02-19T19:02:56.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:56 smithi142 ceph-mon[37169]: Upgrade: Setting container_image for all nvmeof 2024-02-19T19:02:56.745 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:56 smithi046 ceph-mon[29647]: Upgrade: Setting container_image for all mgr 2024-02-19T19:02:56.746 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:56 smithi046 ceph-mon[29647]: Upgrade: Setting container_image for all rgw 2024-02-19T19:02:56.746 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:56 smithi046 ceph-mon[29647]: Upgrade: Setting container_image for all rbd-mirror 2024-02-19T19:02:56.746 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:56 smithi046 ceph-mon[29647]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-19T19:02:56.746 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:56 smithi046 ceph-mon[29647]: Upgrade: Setting container_image for all iscsi 2024-02-19T19:02:56.746 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:56 smithi046 ceph-mon[29647]: Upgrade: Setting container_image for all nfs 2024-02-19T19:02:56.746 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:56 smithi046 ceph-mon[29647]: Upgrade: Setting container_image for all nvmeof 2024-02-19T19:02:57.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:57 smithi142 ceph-mon[37169]: pgmap v19: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:57.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:57 smithi142 ceph-mon[37169]: Upgrade: Updating node-exporter.smithi046 (1/2) 2024-02-19T19:02:57.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:57 smithi142 ceph-mon[37169]: Deploying daemon node-exporter.smithi046 on smithi046 2024-02-19T19:02:57.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:57 smithi046 ceph-mon[29647]: pgmap v19: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:57.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:57 smithi046 ceph-mon[29647]: Upgrade: Updating node-exporter.smithi046 (1/2) 2024-02-19T19:02:57.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:57 smithi046 ceph-mon[29647]: Deploying daemon node-exporter.smithi046 on smithi046 2024-02-19T19:02:59.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:02:59 smithi142 ceph-mon[37169]: pgmap v20: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:02:59.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:02:59 smithi046 ceph-mon[29647]: pgmap v20: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:00.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.571+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3033281046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4100240 msgr2=0x7f31d4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.571+0000 7f31dc2d9700 1 --2- 172.21.15.46:0/3033281046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4100240 0x7f31d4100650 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f31c400b0a0 tx=0x7f31c400b3b0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.571+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3033281046 shutdown_connections 2024-02-19T19:03:00.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.571+0000 7f31dc2d9700 1 --2- 172.21.15.46:0/3033281046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d4101440 0x7f31d4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.571+0000 7f31dc2d9700 1 --2- 172.21.15.46:0/3033281046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4100240 0x7f31d4100650 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.571+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3033281046 >> 172.21.15.46:0/3033281046 conn(0x7f31d40fb7f0 msgr2=0x7f31d40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.571+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3033281046 shutdown_connections 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.572+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3033281046 wait complete. 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.572+0000 7f31dc2d9700 1 Processor -- start 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.572+0000 7f31dc2d9700 1 -- start start 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.572+0000 7f31dc2d9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4100240 0x7f31d4195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.572+0000 7f31dc2d9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d4101440 0x7f31d4196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.572+0000 7f31dc2d9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4196630 con 0x7f31d4100240 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.572+0000 7f31dc2d9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d4196770 con 0x7f31d4101440 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31da075700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4100240 0x7f31d4195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31da075700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4100240 0x7f31d4195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48884/0 (socket says 172.21.15.46:48884) 2024-02-19T19:03:00.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31da075700 1 -- 172.21.15.46:0/3379738274 learned_addr learned my addr 172.21.15.46:0/3379738274 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:03:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31d9874700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d4101440 0x7f31d4196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31da075700 1 -- 172.21.15.46:0/3379738274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d4101440 msgr2=0x7f31d4196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31da075700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d4101440 0x7f31d4196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31da075700 1 -- 172.21.15.46:0/3379738274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4009d00 con 0x7f31d4100240 2024-02-19T19:03:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31da075700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4100240 0x7f31d4195ad0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f31c40077b0 tx=0x7f31c4009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31d37fe700 1 -- 172.21.15.46:0/3379738274 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31c400e040 con 0x7f31d4100240 2024-02-19T19:03:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31d37fe700 1 -- 172.21.15.46:0/3379738274 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f31c4003de0 con 0x7f31d4100240 2024-02-19T19:03:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3379738274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d419b1c0 con 0x7f31d4100240 2024-02-19T19:03:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31d37fe700 1 -- 172.21.15.46:0/3379738274 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31c401d7f0 con 0x7f31d4100240 2024-02-19T19:03:00.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.573+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3379738274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d419b6b0 con 0x7f31d4100240 2024-02-19T19:03:00.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.574+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3379738274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d4108d90 con 0x7f31d4100240 2024-02-19T19:03:00.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.575+0000 7f31d37fe700 1 -- 172.21.15.46:0/3379738274 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f31c4004780 con 0x7f31d4100240 2024-02-19T19:03:00.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.575+0000 7f31d37fe700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f31bc06d660 0x7f31bc06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.575+0000 7f31d37fe700 1 -- 172.21.15.46:0/3379738274 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f31c408ec60 con 0x7f31d4100240 2024-02-19T19:03:00.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.575+0000 7f31d9874700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f31bc06d660 0x7f31bc06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.576+0000 7f31d9874700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f31bc06d660 0x7f31bc06fb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31c8005950 tx=0x7f31c800b410 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:00.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.580+0000 7f31d37fe700 1 -- 172.21.15.46:0/3379738274 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f31c405c310 con 0x7f31d4100240 2024-02-19T19:03:00.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:00 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:00.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:00 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.808+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3379738274 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f31d419bcf0 con 0x7f31bc06d660 2024-02-19T19:03:00.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:00 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:00.828 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:00 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:00.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.810+0000 7f31d37fe700 1 -- 172.21.15.46:0/3379738274 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f31d419bcf0 con 0x7f31bc06d660 2024-02-19T19:03:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.811+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3379738274 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f31bc06d660 msgr2=0x7f31bc06fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.811+0000 7f31dc2d9700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f31bc06d660 0x7f31bc06fb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31c8005950 tx=0x7f31c800b410 comp rx=0 tx=0).stop 2024-02-19T19:03:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.811+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3379738274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4100240 msgr2=0x7f31d4195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.812+0000 7f31dc2d9700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4100240 0x7f31d4195ad0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f31c40077b0 tx=0x7f31c4009760 comp rx=0 tx=0).stop 2024-02-19T19:03:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.812+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3379738274 shutdown_connections 2024-02-19T19:03:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.812+0000 7f31dc2d9700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f31bc06d660 0x7f31bc06fb10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.812+0000 7f31dc2d9700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31d4100240 0x7f31d4195ad0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.812+0000 7f31dc2d9700 1 --2- 172.21.15.46:0/3379738274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d4101440 0x7f31d4196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.812+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3379738274 >> 172.21.15.46:0/3379738274 conn(0x7f31d40fb7f0 msgr2=0x7f31d4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:00.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.812+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3379738274 shutdown_connections 2024-02-19T19:03:00.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.812+0000 7f31dc2d9700 1 -- 172.21.15.46:0/3379738274 wait complete. 2024-02-19T19:03:00.842 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:03:00.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.925+0000 7fc61ab88700 1 -- 172.21.15.46:0/4220299118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc614100730 msgr2=0x7fc614100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.925+0000 7fc61ab88700 1 --2- 172.21.15.46:0/4220299118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc614100730 0x7fc614100b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc608009910 tx=0x7fc608009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:00.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.925+0000 7fc61ab88700 1 -- 172.21.15.46:0/4220299118 shutdown_connections 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.925+0000 7fc61ab88700 1 --2- 172.21.15.46:0/4220299118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6140ff430 0x7fc6140ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.925+0000 7fc61ab88700 1 --2- 172.21.15.46:0/4220299118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc614100730 0x7fc614100b40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.925+0000 7fc61ab88700 1 -- 172.21.15.46:0/4220299118 >> 172.21.15.46:0/4220299118 conn(0x7fc6140f9f10 msgr2=0x7fc6140fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.925+0000 7fc61ab88700 1 -- 172.21.15.46:0/4220299118 shutdown_connections 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.925+0000 7fc61ab88700 1 -- 172.21.15.46:0/4220299118 wait complete. 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc61ab88700 1 Processor -- start 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc61ab88700 1 -- start start 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc61ab88700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6140ff430 0x7fc6141031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc61ab88700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc614100730 0x7fc614101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc61ab88700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc614101d60 con 0x7fc6140ff430 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc61ab88700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc614101ea0 con 0x7fc614100730 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc618924700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6140ff430 0x7fc6141031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc618924700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6140ff430 0x7fc6141031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48902/0 (socket says 172.21.15.46:48902) 2024-02-19T19:03:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc618924700 1 -- 172.21.15.46:0/1130794670 learned_addr learned my addr 172.21.15.46:0/1130794670 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:03:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc613fff700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc614100730 0x7fc614101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc618924700 1 -- 172.21.15.46:0/1130794670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc614100730 msgr2=0x7fc614101820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc618924700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc614100730 0x7fc614101820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc618924700 1 -- 172.21.15.46:0/1130794670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6080095f0 con 0x7fc6140ff430 2024-02-19T19:03:00.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.926+0000 7fc618924700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6140ff430 0x7fc6141031d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc60800bd70 tx=0x7fc60800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:00.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.927+0000 7fc611ffb700 1 -- 172.21.15.46:0/1130794670 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc60801d070 con 0x7fc6140ff430 2024-02-19T19:03:00.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.927+0000 7fc611ffb700 1 -- 172.21.15.46:0/1130794670 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc608005940 con 0x7fc6140ff430 2024-02-19T19:03:00.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.927+0000 7fc61ab88700 1 -- 172.21.15.46:0/1130794670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc614102120 con 0x7fc6140ff430 2024-02-19T19:03:00.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.927+0000 7fc611ffb700 1 -- 172.21.15.46:0/1130794670 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc608021430 con 0x7fc6140ff430 2024-02-19T19:03:00.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.927+0000 7fc61ab88700 1 -- 172.21.15.46:0/1130794670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc614102610 con 0x7fc6140ff430 2024-02-19T19:03:00.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.928+0000 7fc61ab88700 1 -- 172.21.15.46:0/1130794670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc614107c70 con 0x7fc6140ff430 2024-02-19T19:03:00.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.928+0000 7fc611ffb700 1 -- 172.21.15.46:0/1130794670 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 91448+0+0 (secure 0 0 0) 0x7fc608003a60 con 0x7fc6140ff430 2024-02-19T19:03:00.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.929+0000 7fc611ffb700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc60406d660 0x7fc60406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.929+0000 7fc611ffb700 1 -- 172.21.15.46:0/1130794670 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc60808e550 con 0x7fc6140ff430 2024-02-19T19:03:00.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.929+0000 7fc613fff700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc60406d660 0x7fc60406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.929+0000 7fc613fff700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc60406d660 0x7fc60406fb10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc600009a10 tx=0x7fc600009190 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:00.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:00.933+0000 7fc611ffb700 1 -- 172.21.15.46:0/1130794670 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fc60805bb40 con 0x7fc6140ff430 2024-02-19T19:03:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.157+0000 7fc61ab88700 1 -- 172.21.15.46:0/1130794670 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6140fe9f0 con 0x7fc60406d660 2024-02-19T19:03:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.158+0000 7fc611ffb700 1 -- 172.21.15.46:0/1130794670 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fc6140fe9f0 con 0x7fc60406d660 2024-02-19T19:03:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 -- 172.21.15.46:0/1130794670 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc60406d660 msgr2=0x7fc60406fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc60406d660 0x7fc60406fb10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc600009a10 tx=0x7fc600009190 comp rx=0 tx=0).stop 2024-02-19T19:03:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 -- 172.21.15.46:0/1130794670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6140ff430 msgr2=0x7fc6141031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6140ff430 0x7fc6141031d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc60800bd70 tx=0x7fc60800bda0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 -- 172.21.15.46:0/1130794670 shutdown_connections 2024-02-19T19:03:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc60406d660 0x7fc60406fb10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6140ff430 0x7fc6141031d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 --2- 172.21.15.46:0/1130794670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc614100730 0x7fc614101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 -- 172.21.15.46:0/1130794670 >> 172.21.15.46:0/1130794670 conn(0x7fc6140f9f10 msgr2=0x7fc6140fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 -- 172.21.15.46:0/1130794670 shutdown_connections 2024-02-19T19:03:01.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.161+0000 7fc61ab88700 1 -- 172.21.15.46:0/1130794670 wait complete. 2024-02-19T19:03:01.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.267+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/3998862519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf00ff130 msgr2=0x7f6bf00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.267+0000 7f6bf7e2d700 1 --2- 172.21.15.46:0/3998862519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf00ff130 0x7f6bf00ff540 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009910 tx=0x7f6bec009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:01.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.267+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/3998862519 shutdown_connections 2024-02-19T19:03:01.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.267+0000 7f6bf7e2d700 1 --2- 172.21.15.46:0/3998862519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf01003d0 0x7f6bf0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.267+0000 7f6bf7e2d700 1 --2- 172.21.15.46:0/3998862519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf00ff130 0x7f6bf00ff540 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.267+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/3998862519 >> 172.21.15.46:0/3998862519 conn(0x7f6bf00fa780 msgr2=0x7f6bf00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.267+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/3998862519 shutdown_connections 2024-02-19T19:03:01.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.267+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/3998862519 wait complete. 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.267+0000 7f6bf7e2d700 1 Processor -- start 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.267+0000 7f6bf7e2d700 1 -- start start 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf7e2d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf00ff130 0x7f6bf0103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf7e2d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf01003d0 0x7f6bf01017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf7e2d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0101cf0 con 0x7f6bf00ff130 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf7e2d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0101e30 con 0x7f6bf01003d0 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf5bc9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf00ff130 0x7f6bf0103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf5bc9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf00ff130 0x7f6bf0103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48932/0 (socket says 172.21.15.46:48932) 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf5bc9700 1 -- 172.21.15.46:0/2228646952 learned_addr learned my addr 172.21.15.46:0/2228646952 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf53c8700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf01003d0 0x7f6bf01017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf5bc9700 1 -- 172.21.15.46:0/2228646952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf01003d0 msgr2=0x7f6bf01017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf5bc9700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf01003d0 0x7f6bf01017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf5bc9700 1 -- 172.21.15.46:0/2228646952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec0095f0 con 0x7f6bf00ff130 2024-02-19T19:03:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf5bc9700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf00ff130 0x7f6bf0103160 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6bec006010 tx=0x7f6bec00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6be6ffd700 1 -- 172.21.15.46:0/2228646952 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bec01d070 con 0x7f6bf00ff130 2024-02-19T19:03:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/2228646952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf01020b0 con 0x7f6bf00ff130 2024-02-19T19:03:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6be6ffd700 1 -- 172.21.15.46:0/2228646952 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6bec00f460 con 0x7f6bf00ff130 2024-02-19T19:03:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.268+0000 7f6be6ffd700 1 -- 172.21.15.46:0/2228646952 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bec021640 con 0x7f6bf00ff130 2024-02-19T19:03:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.269+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/2228646952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf01025a0 con 0x7f6bf00ff130 2024-02-19T19:03:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.269+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/2228646952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf0107c10 con 0x7f6bf00ff130 2024-02-19T19:03:01.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.270+0000 7f6be6ffd700 1 -- 172.21.15.46:0/2228646952 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f6bec00fab0 con 0x7f6bf00ff130 2024-02-19T19:03:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.270+0000 7f6be6ffd700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f6bdc06d660 0x7f6bdc06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.271+0000 7f6bf53c8700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f6bdc06d660 0x7f6bdc06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.271+0000 7f6be6ffd700 1 -- 172.21.15.46:0/2228646952 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6bec08e5e0 con 0x7f6bf00ff130 2024-02-19T19:03:01.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.271+0000 7f6bf53c8700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f6bdc06d660 0x7f6bdc06fb10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6be000ac50 tx=0x7f6be000a380 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:01.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.275+0000 7f6be6ffd700 1 -- 172.21.15.46:0/2228646952 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f6bec05bbd0 con 0x7f6bf00ff130 2024-02-19T19:03:01.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.510+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/2228646952 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bf0107da0 con 0x7f6bdc06d660 2024-02-19T19:03:01.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.520+0000 7f6be6ffd700 1 -- 172.21.15.46:0/2228646952 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6bf0107da0 con 0x7f6bdc06d660 2024-02-19T19:03:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:03:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (7m) 8s ago 9m 24.8M - 0.25.0 c8568f914cd2 cfbe74f8660f 2024-02-19T19:03:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (10m) 8s ago 10m 7738k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:03:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (8m) 11s ago 8m 7658k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:03:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (9m) 8s ago 9m 6656k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:03:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (8m) 11s ago 8m 6665k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:03:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (7m) 8s ago 8m 82.1M - 9.4.7 954c08fa6188 2fa87d8c964a 2024-02-19T19:03:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (3m) 8s ago 3m 26.0M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:03:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (3m) 8s ago 3m 13.7M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:03:01.540 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (3m) 11s ago 3m 14.4M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (3m) 11s ago 3m 22.1M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (47s) 8s ago 11m 491M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (15s) 11s ago 8m 66.3M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (11m) 8s ago 11m 50.5M 2048M 18.2.0 dc2bc1663786 adb8243bd11c 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (8m) 11s ago 8m 39.6M 2048M 18.2.0 dc2bc1663786 3f6c8b69abc2 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 starting - - - - 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (8m) 11s ago 8m 14.9M - 1.5.0 0da6a335fe13 bdfda6603f51 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (7m) 8s ago 7m 50.8M 1217M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (6m) 8s ago 6m 49.6M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (6m) 8s ago 6m 51.0M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:03:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (5m) 11s ago 5m 48.2M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:03:01.542 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (5m) 11s ago 5m 46.3M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:03:01.542 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (5m) 11s ago 5m 47.1M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:03:01.542 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (21s) 8s ago 8m 42.2M - 2.43.0 a07b618ecd1d e10cba0e7f13 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/2228646952 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f6bdc06d660 msgr2=0x7f6bdc06fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f6bdc06d660 0x7f6bdc06fb10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6be000ac50 tx=0x7f6be000a380 comp rx=0 tx=0).stop 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/2228646952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf00ff130 msgr2=0x7f6bf0103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf00ff130 0x7f6bf0103160 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6bec006010 tx=0x7f6bec00bd70 comp rx=0 tx=0).stop 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/2228646952 shutdown_connections 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f6bdc06d660 0x7f6bdc06fb10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bf00ff130 0x7f6bf0103160 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 --2- 172.21.15.46:0/2228646952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bf01003d0 0x7f6bf01017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/2228646952 >> 172.21.15.46:0/2228646952 conn(0x7f6bf00fa780 msgr2=0x7f6bf0068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/2228646952 shutdown_connections 2024-02-19T19:03:01.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.523+0000 7f6bf7e2d700 1 -- 172.21.15.46:0/2228646952 wait complete. 2024-02-19T19:03:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.628+0000 7f61a9a94700 1 -- 172.21.15.46:0/3095684926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61a4100240 msgr2=0x7f61a4100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.628+0000 7f61a9a94700 1 --2- 172.21.15.46:0/3095684926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61a4100240 0x7f61a4100650 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6194009910 tx=0x7f6194009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.628+0000 7f61a9a94700 1 -- 172.21.15.46:0/3095684926 shutdown_connections 2024-02-19T19:03:01.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.628+0000 7f61a9a94700 1 --2- 172.21.15.46:0/3095684926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a4101440 0x7f61a4101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.628+0000 7f61a9a94700 1 --2- 172.21.15.46:0/3095684926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61a4100240 0x7f61a4100650 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.628+0000 7f61a9a94700 1 -- 172.21.15.46:0/3095684926 >> 172.21.15.46:0/3095684926 conn(0x7f61a40fb7f0 msgr2=0x7f61a40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.628+0000 7f61a9a94700 1 -- 172.21.15.46:0/3095684926 shutdown_connections 2024-02-19T19:03:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.628+0000 7f61a9a94700 1 -- 172.21.15.46:0/3095684926 wait complete. 2024-02-19T19:03:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.628+0000 7f61a9a94700 1 Processor -- start 2024-02-19T19:03:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a9a94700 1 -- start start 2024-02-19T19:03:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a9a94700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a4100240 0x7f61a4195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a9a94700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61a4101440 0x7f61a4195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a9a94700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4196610 con 0x7f61a4101440 2024-02-19T19:03:01.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a9a94700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4196750 con 0x7f61a4100240 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61a4101440 0x7f61a4195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61a4101440 0x7f61a4195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48958/0 (socket says 172.21.15.46:48958) 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a2ffd700 1 -- 172.21.15.46:0/1412446453 learned_addr learned my addr 172.21.15.46:0/1412446453 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a37fe700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a4100240 0x7f61a4195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a2ffd700 1 -- 172.21.15.46:0/1412446453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a4100240 msgr2=0x7f61a4195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a2ffd700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a4100240 0x7f61a4195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a2ffd700 1 -- 172.21.15.46:0/1412446453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61940095f0 con 0x7f61a4101440 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.629+0000 7f61a2ffd700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61a4101440 0x7f61a4195ff0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f619800d900 tx=0x7f619800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.630+0000 7f61a0ff9700 1 -- 172.21.15.46:0/1412446453 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61980041f0 con 0x7f61a4101440 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.630+0000 7f61a0ff9700 1 -- 172.21.15.46:0/1412446453 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6198004ce0 con 0x7f61a4101440 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.630+0000 7f61a9a94700 1 -- 172.21.15.46:0/1412446453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a419b200 con 0x7f61a4101440 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.630+0000 7f61a0ff9700 1 -- 172.21.15.46:0/1412446453 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f619800b750 con 0x7f61a4101440 2024-02-19T19:03:01.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.630+0000 7f61a9a94700 1 -- 172.21.15.46:0/1412446453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a419b750 con 0x7f61a4101440 2024-02-19T19:03:01.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.631+0000 7f61a9a94700 1 -- 172.21.15.46:0/1412446453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a4108d90 con 0x7f61a4101440 2024-02-19T19:03:01.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.631+0000 7f61a0ff9700 1 -- 172.21.15.46:0/1412446453 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f6198004e50 con 0x7f61a4101440 2024-02-19T19:03:01.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.631+0000 7f61a0ff9700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f618c06d660 0x7f618c06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.632+0000 7f61a0ff9700 1 -- 172.21.15.46:0/1412446453 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f619808d0a0 con 0x7f61a4101440 2024-02-19T19:03:01.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.632+0000 7f61a37fe700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f618c06d660 0x7f618c06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.632+0000 7f61a37fe700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f618c06d660 0x7f618c06fb10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6194006010 tx=0x7f6194005ec0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:01.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.636+0000 7f61a0ff9700 1 -- 172.21.15.46:0/1412446453 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f619805a690 con 0x7f61a4101440 2024-02-19T19:03:01.823 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:01 smithi142 ceph-mon[37169]: pgmap v21: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:01.823 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:01 smithi142 ceph-mon[37169]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:01.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:01 smithi046 ceph-mon[29647]: pgmap v21: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:01.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:01 smithi046 ceph-mon[29647]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:01.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.935+0000 7f61a9a94700 1 -- 172.21.15.46:0/1412446453 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f61a4108f50 con 0x7f61a4101440 2024-02-19T19:03:01.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.935+0000 7f61a0ff9700 1 -- 172.21.15.46:0/1412446453 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f619805a220 con 0x7f61a4101440 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-19T19:03:01.955 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:03:01.956 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:03:01.956 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:03:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 -- 172.21.15.46:0/1412446453 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f618c06d660 msgr2=0x7f618c06fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f618c06d660 0x7f618c06fb10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6194006010 tx=0x7f6194005ec0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 -- 172.21.15.46:0/1412446453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61a4101440 msgr2=0x7f61a4195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61a4101440 0x7f61a4195ff0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f619800d900 tx=0x7f619800dc10 comp rx=0 tx=0).stop 2024-02-19T19:03:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 -- 172.21.15.46:0/1412446453 shutdown_connections 2024-02-19T19:03:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f618c06d660 0x7f618c06fb10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61a4100240 0x7f61a4195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 --2- 172.21.15.46:0/1412446453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f61a4101440 0x7f61a4195ff0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 -- 172.21.15.46:0/1412446453 >> 172.21.15.46:0/1412446453 conn(0x7f61a40fb7f0 msgr2=0x7f61a4104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 -- 172.21.15.46:0/1412446453 shutdown_connections 2024-02-19T19:03:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:01.938+0000 7f61a9a94700 1 -- 172.21.15.46:0/1412446453 wait complete. 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.045+0000 7f10b5cf7700 1 -- 172.21.15.46:0/4017491839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10b0100d60 msgr2=0x7f10b0103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.045+0000 7f10b5cf7700 1 --2- 172.21.15.46:0/4017491839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10b0100d60 0x7f10b0103140 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009910 tx=0x7f10a0009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.045+0000 7f10b5cf7700 1 -- 172.21.15.46:0/4017491839 shutdown_connections 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.045+0000 7f10b5cf7700 1 --2- 172.21.15.46:0/4017491839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10b0103680 0x7f10b0105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.045+0000 7f10b5cf7700 1 --2- 172.21.15.46:0/4017491839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10b0100d60 0x7f10b0103140 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.045+0000 7f10b5cf7700 1 -- 172.21.15.46:0/4017491839 >> 172.21.15.46:0/4017491839 conn(0x7f10b00fa780 msgr2=0x7f10b00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.045+0000 7f10b5cf7700 1 -- 172.21.15.46:0/4017491839 shutdown_connections 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.045+0000 7f10b5cf7700 1 -- 172.21.15.46:0/4017491839 wait complete. 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.046+0000 7f10b5cf7700 1 Processor -- start 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.046+0000 7f10b5cf7700 1 -- start start 2024-02-19T19:03:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.046+0000 7f10b5cf7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10b0100d60 0x7f10b0195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.046+0000 7f10b5cf7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10b0103680 0x7f10b0195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.046+0000 7f10b5cf7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0196610 con 0x7f10b0103680 2024-02-19T19:03:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.046+0000 7f10b5cf7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b0196750 con 0x7f10b0100d60 2024-02-19T19:03:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.046+0000 7f10a6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10b0103680 0x7f10b0195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.046+0000 7f10a6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10b0103680 0x7f10b0195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48974/0 (socket says 172.21.15.46:48974) 2024-02-19T19:03:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.046+0000 7f10a6ffd700 1 -- 172.21.15.46:0/2435835516 learned_addr learned my addr 172.21.15.46:0/2435835516 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:03:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.046+0000 7f10af7fe700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10b0100d60 0x7f10b0195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.047+0000 7f10a6ffd700 1 -- 172.21.15.46:0/2435835516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10b0100d60 msgr2=0x7f10b0195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.047+0000 7f10a6ffd700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10b0100d60 0x7f10b0195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.047+0000 7f10a6ffd700 1 -- 172.21.15.46:0/2435835516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00095f0 con 0x7f10b0103680 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.047+0000 7f10a6ffd700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10b0103680 0x7f10b0195ff0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f109800d900 tx=0x7f109800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.047+0000 7f10ad7fa700 1 -- 172.21.15.46:0/2435835516 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10980041f0 con 0x7f10b0103680 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.047+0000 7f10ad7fa700 1 -- 172.21.15.46:0/2435835516 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1098004ce0 con 0x7f10b0103680 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.047+0000 7f10b5cf7700 1 -- 172.21.15.46:0/2435835516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b019b200 con 0x7f10b0103680 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.047+0000 7f10ad7fa700 1 -- 172.21.15.46:0/2435835516 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f109800b750 con 0x7f10b0103680 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.047+0000 7f10b5cf7700 1 -- 172.21.15.46:0/2435835516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b019b750 con 0x7f10b0103680 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.048+0000 7f10b5cf7700 1 -- 172.21.15.46:0/2435835516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b018fbc0 con 0x7f10b0103680 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.049+0000 7f10ad7fa700 1 -- 172.21.15.46:0/2435835516 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f1098004e50 con 0x7f10b0103680 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.049+0000 7f10ad7fa700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f109c06d660 0x7f109c06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.049+0000 7f10ad7fa700 1 -- 172.21.15.46:0/2435835516 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f109808d020 con 0x7f10b0103680 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.049+0000 7f10af7fe700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f109c06d660 0x7f109c06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.050+0000 7f10af7fe700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f109c06d660 0x7f109c06fb10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10a0006010 tx=0x7f10a0005ec0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:02.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.054+0000 7f10ad7fa700 1 -- 172.21.15.46:0/2435835516 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f109805a690 con 0x7f10b0103680 2024-02-19T19:03:02.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.287+0000 7f10b5cf7700 1 -- 172.21.15.46:0/2435835516 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10b0061190 con 0x7f109c06d660 2024-02-19T19:03:02.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.289+0000 7f10ad7fa700 1 -- 172.21.15.46:0/2435835516 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f10b0061190 con 0x7f109c06d660 2024-02-19T19:03:02.308 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:03:02.308 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:03:02.308 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:03:02.308 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:03:02.309 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:03:02.309 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:03:02.309 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:03:02.309 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-02-19T19:03:02.309 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-19T19:03:02.309 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:03:02.309 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.291+0000 7f10b5cf7700 1 -- 172.21.15.46:0/2435835516 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f109c06d660 msgr2=0x7f109c06fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.291+0000 7f10b5cf7700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f109c06d660 0x7f109c06fb10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10a0006010 tx=0x7f10a0005ec0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.291+0000 7f10b5cf7700 1 -- 172.21.15.46:0/2435835516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10b0103680 msgr2=0x7f10b0195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.291+0000 7f10b5cf7700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10b0103680 0x7f10b0195ff0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f109800d900 tx=0x7f109800dc10 comp rx=0 tx=0).stop 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.291+0000 7f10b5cf7700 1 -- 172.21.15.46:0/2435835516 shutdown_connections 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.291+0000 7f10b5cf7700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f109c06d660 0x7f109c06fb10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.291+0000 7f10b5cf7700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10b0100d60 0x7f10b0195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.291+0000 7f10b5cf7700 1 --2- 172.21.15.46:0/2435835516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10b0103680 0x7f10b0195ff0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.291+0000 7f10b5cf7700 1 -- 172.21.15.46:0/2435835516 >> 172.21.15.46:0/2435835516 conn(0x7f10b00fa780 msgr2=0x7f10b00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.292+0000 7f10b5cf7700 1 -- 172.21.15.46:0/2435835516 shutdown_connections 2024-02-19T19:03:02.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:02.292+0000 7f10b5cf7700 1 -- 172.21.15.46:0/2435835516 wait complete. 2024-02-19T19:03:02.556 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:02 smithi142 ceph-mon[37169]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:02.556 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:02 smithi142 ceph-mon[37169]: Upgrade: Updating node-exporter.smithi142 (2/2) 2024-02-19T19:03:02.556 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:02 smithi142 ceph-mon[37169]: Deploying daemon node-exporter.smithi142 on smithi142 2024-02-19T19:03:02.556 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:02 smithi142 ceph-mon[37169]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:02.556 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:02 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1412446453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:02.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:02 smithi046 ceph-mon[29647]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:02.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:02 smithi046 ceph-mon[29647]: Upgrade: Updating node-exporter.smithi142 (2/2) 2024-02-19T19:03:02.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:02 smithi046 ceph-mon[29647]: Deploying daemon node-exporter.smithi142 on smithi142 2024-02-19T19:03:02.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:02 smithi046 ceph-mon[29647]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:02.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:02 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1412446453' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:03.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:03 smithi142 ceph-mon[37169]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:03.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:03 smithi142 ceph-mon[37169]: pgmap v22: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:03.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:03 smithi046 ceph-mon[29647]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:03.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:03 smithi046 ceph-mon[29647]: pgmap v22: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:05.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:05 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:05.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:05 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:05.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:05 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:05.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:05 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:05.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:05 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:05.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:05 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:06.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:06 smithi142 ceph-mon[37169]: pgmap v23: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:06.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:06 smithi046 ceph-mon[29647]: pgmap v23: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:08.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:08 smithi046 ceph-mon[29647]: pgmap v24: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:08.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:08 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:08.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:08 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:08.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:08 smithi142 ceph-mon[37169]: pgmap v24: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:08.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:08 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:08.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:08 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:09.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:09 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:09.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:09 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:09.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:09 smithi142 ceph-mon[37169]: pgmap v25: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:09.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:09 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:09.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:09 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:09.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:09 smithi046 ceph-mon[29647]: pgmap v25: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:10.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:10 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:10.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:10 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:10.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:10 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:10.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:10 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:10.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:10 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:10.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:10 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:11 smithi142 ceph-mon[37169]: pgmap v26: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:11 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:11 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:11.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:11 smithi046 ceph-mon[29647]: pgmap v26: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:11.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:11 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:11.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:11 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:13.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:12 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:13.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:12 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:13.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:12 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:13.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:12 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:14.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:13 smithi046 ceph-mon[29647]: pgmap v27: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:14.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:13 smithi142 ceph-mon[37169]: pgmap v27: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:15.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:15.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:15.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:03:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:03:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:15.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:16.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:15 smithi046 ceph-mon[29647]: pgmap v28: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:16.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:15 smithi142 ceph-mon[37169]: pgmap v28: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:17.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:16 smithi046 ceph-mon[29647]: Upgrade: Updating prometheus.smithi046 2024-02-19T19:03:17.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:16 smithi142 ceph-mon[37169]: Upgrade: Updating prometheus.smithi046 2024-02-19T19:03:18.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:17 smithi046 ceph-mon[29647]: Deploying daemon prometheus.smithi046 on smithi046 2024-02-19T19:03:18.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:17 smithi046 ceph-mon[29647]: pgmap v29: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:18.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:17 smithi142 ceph-mon[37169]: Deploying daemon prometheus.smithi046 on smithi046 2024-02-19T19:03:18.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:17 smithi142 ceph-mon[37169]: pgmap v29: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:20.180 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:19 smithi046 ceph-mon[29647]: pgmap v30: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:20.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:19 smithi142 ceph-mon[37169]: pgmap v30: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:21.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:21 smithi142 ceph-mon[37169]: pgmap v31: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:21.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:21 smithi046 ceph-mon[29647]: pgmap v31: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:23.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:23 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:23.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:23 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:23.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:23 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:23.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:23 smithi046 ceph-mon[29647]: pgmap v32: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:23.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:23 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:23.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:23 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:23.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:23 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:23.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:23 smithi142 ceph-mon[37169]: pgmap v32: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:25.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:25 smithi142 ceph-mon[37169]: pgmap v33: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:25.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:25 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:25.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:25 smithi046 ceph-mon[29647]: pgmap v33: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:25.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:25 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:27.626 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:27 smithi046 ceph-mon[29647]: pgmap v34: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:27.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:27 smithi142 ceph-mon[37169]: pgmap v34: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:29.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:28 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:29.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:28 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:29.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:28 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:29.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:28 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:30.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:29 smithi046 ceph-mon[29647]: pgmap v35: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:30.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:29 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:30.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:29 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:30.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:29 smithi142 ceph-mon[37169]: pgmap v35: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:30.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:29 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:30.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:29 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:31.405 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:31 smithi046 ceph-mon[29647]: pgmap v36: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:31.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:31 smithi142 ceph-mon[37169]: pgmap v36: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.404+0000 7efeb4a40700 1 -- 172.21.15.46:0/2254480670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb01014e0 msgr2=0x7efeb0101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.404+0000 7efeb4a40700 1 --2- 172.21.15.46:0/2254480670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb01014e0 0x7efeb0101950 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efea4009910 tx=0x7efea4009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.404+0000 7efeb4a40700 1 -- 172.21.15.46:0/2254480670 shutdown_connections 2024-02-19T19:03:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.404+0000 7efeb4a40700 1 --2- 172.21.15.46:0/2254480670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb01014e0 0x7efeb0101950 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.404+0000 7efeb4a40700 1 --2- 172.21.15.46:0/2254480670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb0100240 0x7efeb0100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.404+0000 7efeb4a40700 1 -- 172.21.15.46:0/2254480670 >> 172.21.15.46:0/2254480670 conn(0x7efeb00fb890 msgr2=0x7efeb00fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.404+0000 7efeb4a40700 1 -- 172.21.15.46:0/2254480670 shutdown_connections 2024-02-19T19:03:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.404+0000 7efeb4a40700 1 -- 172.21.15.46:0/2254480670 wait complete. 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeb4a40700 1 Processor -- start 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeb4a40700 1 -- start start 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeb4a40700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb0100240 0x7efeb0074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeb4a40700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb01014e0 0x7efeb0073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeb4a40700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0073680 con 0x7efeb01014e0 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeb4a40700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00737c0 con 0x7efeb0100240 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeadd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb01014e0 0x7efeb0073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeadd9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb01014e0 0x7efeb0073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59716/0 (socket says 172.21.15.46:59716) 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeadd9b700 1 -- 172.21.15.46:0/3133929995 learned_addr learned my addr 172.21.15.46:0/3133929995 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeae59c700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb0100240 0x7efeb0074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeadd9b700 1 -- 172.21.15.46:0/3133929995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb0100240 msgr2=0x7efeb0074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeadd9b700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb0100240 0x7efeb0074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.405+0000 7efeadd9b700 1 -- 172.21.15.46:0/3133929995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40095f0 con 0x7efeb01014e0 2024-02-19T19:03:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.406+0000 7efeadd9b700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb01014e0 0x7efeb0073140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efea400bd70 tx=0x7efea400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.406+0000 7efe9f7fe700 1 -- 172.21.15.46:0/3133929995 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efea401d070 con 0x7efeb01014e0 2024-02-19T19:03:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.406+0000 7efe9f7fe700 1 -- 172.21.15.46:0/3133929995 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efea4022470 con 0x7efeb01014e0 2024-02-19T19:03:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.406+0000 7efeb4a40700 1 -- 172.21.15.46:0/3133929995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb0073a40 con 0x7efeb01014e0 2024-02-19T19:03:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.407+0000 7efe9f7fe700 1 -- 172.21.15.46:0/3133929995 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efea400f670 con 0x7efeb01014e0 2024-02-19T19:03:32.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.407+0000 7efeb4a40700 1 -- 172.21.15.46:0/3133929995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb0073f30 con 0x7efeb01014e0 2024-02-19T19:03:32.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.407+0000 7efe9f7fe700 1 -- 172.21.15.46:0/3133929995 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 91448+0+0 (secure 0 0 0) 0x7efea400f8e0 con 0x7efeb01014e0 2024-02-19T19:03:32.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.407+0000 7efeb4a40700 1 -- 172.21.15.46:0/3133929995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0108d20 con 0x7efeb01014e0 2024-02-19T19:03:32.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.408+0000 7efe9f7fe700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efe9806d660 0x7efe9806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.408+0000 7efe9f7fe700 1 -- 172.21.15.46:0/3133929995 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efea408e760 con 0x7efeb01014e0 2024-02-19T19:03:32.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.408+0000 7efeae59c700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efe9806d660 0x7efe9806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.408+0000 7efeae59c700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efe9806d660 0x7efe9806fb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efea0005950 tx=0x7efea00058e0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:32.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.413+0000 7efe9f7fe700 1 -- 172.21.15.46:0/3133929995 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7efea405be70 con 0x7efeb01014e0 2024-02-19T19:03:32.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.645+0000 7efeb4a40700 1 -- 172.21.15.46:0/3133929995 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efeb0105e30 con 0x7efe9806d660 2024-02-19T19:03:32.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.646+0000 7efe9f7fe700 1 -- 172.21.15.46:0/3133929995 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7efeb0105e30 con 0x7efe9806d660 2024-02-19T19:03:32.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 -- 172.21.15.46:0/3133929995 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efe9806d660 msgr2=0x7efe9806fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efe9806d660 0x7efe9806fb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efea0005950 tx=0x7efea00058e0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 -- 172.21.15.46:0/3133929995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb01014e0 msgr2=0x7efeb0073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb01014e0 0x7efeb0073140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efea400bd70 tx=0x7efea400be50 comp rx=0 tx=0).stop 2024-02-19T19:03:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 -- 172.21.15.46:0/3133929995 shutdown_connections 2024-02-19T19:03:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efe9806d660 0x7efe9806fb10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb0100240 0x7efeb0074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 --2- 172.21.15.46:0/3133929995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb01014e0 0x7efeb0073140 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 -- 172.21.15.46:0/3133929995 >> 172.21.15.46:0/3133929995 conn(0x7efeb00fb890 msgr2=0x7efeb0104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 -- 172.21.15.46:0/3133929995 shutdown_connections 2024-02-19T19:03:32.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.649+0000 7efeb4a40700 1 -- 172.21.15.46:0/3133929995 wait complete. 2024-02-19T19:03:32.679 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:03:32.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.758+0000 7f72f20ca700 1 -- 172.21.15.46:0/2761393999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec100240 msgr2=0x7f72ec100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.758+0000 7f72f20ca700 1 --2- 172.21.15.46:0/2761393999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec100240 0x7f72ec100650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009910 tx=0x7f72dc009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:32.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.758+0000 7f72f20ca700 1 -- 172.21.15.46:0/2761393999 shutdown_connections 2024-02-19T19:03:32.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.758+0000 7f72f20ca700 1 --2- 172.21.15.46:0/2761393999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec101440 0x7f72ec101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.758+0000 7f72f20ca700 1 --2- 172.21.15.46:0/2761393999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec100240 0x7f72ec100650 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.758+0000 7f72f20ca700 1 -- 172.21.15.46:0/2761393999 >> 172.21.15.46:0/2761393999 conn(0x7f72ec0fb7f0 msgr2=0x7f72ec0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:32.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.758+0000 7f72f20ca700 1 -- 172.21.15.46:0/2761393999 shutdown_connections 2024-02-19T19:03:32.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.759+0000 7f72f20ca700 1 -- 172.21.15.46:0/2761393999 wait complete. 2024-02-19T19:03:32.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.759+0000 7f72f20ca700 1 Processor -- start 2024-02-19T19:03:32.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.759+0000 7f72f20ca700 1 -- start start 2024-02-19T19:03:32.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.759+0000 7f72f20ca700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec100240 0x7f72ec195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.759+0000 7f72f20ca700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec101440 0x7f72ec1960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.759+0000 7f72f20ca700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec1966c0 con 0x7f72ec100240 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.759+0000 7f72f20ca700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec196800 con 0x7f72ec101440 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.759+0000 7f72eb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec100240 0x7f72ec195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72eb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec100240 0x7f72ec195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59740/0 (socket says 172.21.15.46:59740) 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72eb7fe700 1 -- 172.21.15.46:0/2121169313 learned_addr learned my addr 172.21.15.46:0/2121169313 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72eaffd700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec101440 0x7f72ec1960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72eb7fe700 1 -- 172.21.15.46:0/2121169313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec101440 msgr2=0x7f72ec1960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72eb7fe700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec101440 0x7f72ec1960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72eb7fe700 1 -- 172.21.15.46:0/2121169313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc0095f0 con 0x7f72ec100240 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72eb7fe700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec100240 0x7f72ec195b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00bda0 tx=0x7f72dc00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72e8ff9700 1 -- 172.21.15.46:0/2121169313 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72dc01d070 con 0x7f72ec100240 2024-02-19T19:03:32.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72e8ff9700 1 -- 172.21.15.46:0/2121169313 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f72dc022470 con 0x7f72ec100240 2024-02-19T19:03:32.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72f20ca700 1 -- 172.21.15.46:0/2121169313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec19b250 con 0x7f72ec100240 2024-02-19T19:03:32.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72e8ff9700 1 -- 172.21.15.46:0/2121169313 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72dc00f650 con 0x7f72ec100240 2024-02-19T19:03:32.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.760+0000 7f72f20ca700 1 -- 172.21.15.46:0/2121169313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec19b740 con 0x7f72ec100240 2024-02-19T19:03:32.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.761+0000 7f72f20ca700 1 -- 172.21.15.46:0/2121169313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ec108e10 con 0x7f72ec100240 2024-02-19T19:03:32.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.762+0000 7f72e8ff9700 1 -- 172.21.15.46:0/2121169313 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f72dc004af0 con 0x7f72ec100240 2024-02-19T19:03:32.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.762+0000 7f72e8ff9700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f72d806d650 0x7f72d806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.762+0000 7f72e8ff9700 1 -- 172.21.15.46:0/2121169313 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f72dc08eb70 con 0x7f72ec100240 2024-02-19T19:03:32.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.762+0000 7f72eaffd700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f72d806d650 0x7f72d806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.763+0000 7f72eaffd700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f72d806d650 0x7f72d806fb00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009a10 tx=0x7f72d4009190 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:32.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.767+0000 7f72e8ff9700 1 -- 172.21.15.46:0/2121169313 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f72dc05c290 con 0x7f72ec100240 2024-02-19T19:03:33.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:32.999+0000 7f72f20ca700 1 -- 172.21.15.46:0/2121169313 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f72ec19bd80 con 0x7f72d806d650 2024-02-19T19:03:33.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.001+0000 7f72e8ff9700 1 -- 172.21.15.46:0/2121169313 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f72ec19bd80 con 0x7f72d806d650 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 -- 172.21.15.46:0/2121169313 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f72d806d650 msgr2=0x7f72d806fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f72d806d650 0x7f72d806fb00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009a10 tx=0x7f72d4009190 comp rx=0 tx=0).stop 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 -- 172.21.15.46:0/2121169313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec100240 msgr2=0x7f72ec195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec100240 0x7f72ec195b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00bda0 tx=0x7f72dc00bdd0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 -- 172.21.15.46:0/2121169313 shutdown_connections 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f72d806d650 0x7f72d806fb00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72ec100240 0x7f72ec195b60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 --2- 172.21.15.46:0/2121169313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72ec101440 0x7f72ec1960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 -- 172.21.15.46:0/2121169313 >> 172.21.15.46:0/2121169313 conn(0x7f72ec0fb7f0 msgr2=0x7f72ec104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 -- 172.21.15.46:0/2121169313 shutdown_connections 2024-02-19T19:03:33.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.003+0000 7f72f20ca700 1 -- 172.21.15.46:0/2121169313 wait complete. 2024-02-19T19:03:33.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.113+0000 7f0b02409700 1 -- 172.21.15.46:0/4161065965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc0ff150 msgr2=0x7f0afc0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.113+0000 7f0b02409700 1 --2- 172.21.15.46:0/4161065965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc0ff150 0x7f0afc0ff560 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009910 tx=0x7f0aec009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.114+0000 7f0b02409700 1 -- 172.21.15.46:0/4161065965 shutdown_connections 2024-02-19T19:03:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.114+0000 7f0b02409700 1 --2- 172.21.15.46:0/4161065965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc100350 0x7f0afc1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.114+0000 7f0b02409700 1 --2- 172.21.15.46:0/4161065965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc0ff150 0x7f0afc0ff560 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.114+0000 7f0b02409700 1 -- 172.21.15.46:0/4161065965 >> 172.21.15.46:0/4161065965 conn(0x7f0afc0fa700 msgr2=0x7f0afc0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.114+0000 7f0b02409700 1 -- 172.21.15.46:0/4161065965 shutdown_connections 2024-02-19T19:03:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.114+0000 7f0b02409700 1 -- 172.21.15.46:0/4161065965 wait complete. 2024-02-19T19:03:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.114+0000 7f0b02409700 1 Processor -- start 2024-02-19T19:03:33.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.114+0000 7f0b02409700 1 -- start start 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0b02409700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc0ff150 0x7f0afc069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0b02409700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc100350 0x7f0afc19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0b02409700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc19ae10 con 0x7f0afc100350 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0b02409700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc19af50 con 0x7f0afc0ff150 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0afb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc100350 0x7f0afc19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0afb7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc100350 0x7f0afc19a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59752/0 (socket says 172.21.15.46:59752) 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0afb7fe700 1 -- 172.21.15.46:0/4014451387 learned_addr learned my addr 172.21.15.46:0/4014451387 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0afbfff700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc0ff150 0x7f0afc069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0afb7fe700 1 -- 172.21.15.46:0/4014451387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc0ff150 msgr2=0x7f0afc069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0afb7fe700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc0ff150 0x7f0afc069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0afb7fe700 1 -- 172.21.15.46:0/4014451387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0095f0 con 0x7f0afc100350 2024-02-19T19:03:33.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0afb7fe700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc100350 0x7f0afc19a840 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0af000d900 tx=0x7f0af000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:33.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0af97fa700 1 -- 172.21.15.46:0/4014451387 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0af00041f0 con 0x7f0afc100350 2024-02-19T19:03:33.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0b02409700 1 -- 172.21.15.46:0/4014451387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc19b230 con 0x7f0afc100350 2024-02-19T19:03:33.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0af97fa700 1 -- 172.21.15.46:0/4014451387 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0af0004ce0 con 0x7f0afc100350 2024-02-19T19:03:33.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.115+0000 7f0af97fa700 1 -- 172.21.15.46:0/4014451387 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0af000b750 con 0x7f0afc100350 2024-02-19T19:03:33.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.116+0000 7f0b02409700 1 -- 172.21.15.46:0/4014451387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc19b780 con 0x7f0afc100350 2024-02-19T19:03:33.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.116+0000 7f0b02409700 1 -- 172.21.15.46:0/4014451387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc107ca0 con 0x7f0afc100350 2024-02-19T19:03:33.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.117+0000 7f0af97fa700 1 -- 172.21.15.46:0/4014451387 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f0af0004830 con 0x7f0afc100350 2024-02-19T19:03:33.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.117+0000 7f0af97fa700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f0ae406d660 0x7f0ae406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.118+0000 7f0af97fa700 1 -- 172.21.15.46:0/4014451387 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0af008d030 con 0x7f0afc100350 2024-02-19T19:03:33.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.118+0000 7f0afbfff700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f0ae406d660 0x7f0ae406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.118+0000 7f0afbfff700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f0ae406d660 0x7f0ae406fb10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0aec006010 tx=0x7f0aec00b580 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:33.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.122+0000 7f0af97fa700 1 -- 172.21.15.46:0/4014451387 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f0af005a6a0 con 0x7f0afc100350 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: pgmap v37: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:33.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:33.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:33 smithi046 ceph-mon[29647]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:33.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.343+0000 7f0b02409700 1 -- 172.21.15.46:0/4014451387 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0afc19b3c0 con 0x7f0ae406d660 2024-02-19T19:03:33.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.354+0000 7f0af97fa700 1 -- 172.21.15.46:0/4014451387 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0afc19b3c0 con 0x7f0ae406d660 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (8m) 5s ago 10m 24.8M - 0.25.0 c8568f914cd2 cfbe74f8660f 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (10m) 5s ago 10m 7784k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (8m) 26s ago 8m 7680k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (10m) 5s ago 10m 6660k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (8m) 26s ago 8m 6665k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (7m) 5s ago 9m 84.7M - 9.4.7 954c08fa6188 2fa87d8c964a 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (4m) 5s ago 4m 26.0M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (4m) 5s ago 4m 13.9M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (4m) 26s ago 4m 14.5M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (4m) 26s ago 4m 22.2M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:03:33.374 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (79s) 5s ago 11m 496M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (47s) 26s ago 8m 447M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (11m) 5s ago 11m 52.0M 2048M 18.2.0 dc2bc1663786 adb8243bd11c 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (8m) 26s ago 8m 40.8M 2048M 18.2.0 dc2bc1663786 3f6c8b69abc2 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (34s) 5s ago 10m 15.4M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (29s) 26s ago 8m 5486k - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (7m) 5s ago 7m 50.9M 1217M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (7m) 5s ago 7m 49.8M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (6m) 5s ago 6m 51.0M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (6m) 26s ago 6m 48.2M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (6m) 26s ago 6m 46.4M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (5m) 26s ago 5m 47.2M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:03:33.375 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (11s) 5s ago 9m 40.7M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:03:33.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 -- 172.21.15.46:0/4014451387 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f0ae406d660 msgr2=0x7f0ae406fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f0ae406d660 0x7f0ae406fb10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0aec006010 tx=0x7f0aec00b580 comp rx=0 tx=0).stop 2024-02-19T19:03:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 -- 172.21.15.46:0/4014451387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc100350 msgr2=0x7f0afc19a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc100350 0x7f0afc19a840 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0af000d900 tx=0x7f0af000dcc0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 -- 172.21.15.46:0/4014451387 shutdown_connections 2024-02-19T19:03:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f0ae406d660 0x7f0ae406fb10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc0ff150 0x7f0afc069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 --2- 172.21.15.46:0/4014451387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc100350 0x7f0afc19a840 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 -- 172.21.15.46:0/4014451387 >> 172.21.15.46:0/4014451387 conn(0x7f0afc0fa700 msgr2=0x7f0afc103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 -- 172.21.15.46:0/4014451387 shutdown_connections 2024-02-19T19:03:33.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.357+0000 7f0b02409700 1 -- 172.21.15.46:0/4014451387 wait complete. 2024-02-19T19:03:33.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:33.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:33.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:03:33.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:03:33.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:33.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:03:33.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:03:33.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: pgmap v37: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:33.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:33 smithi142 ceph-mon[37169]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.462+0000 7f92d4cab700 1 -- 172.21.15.46:0/4170932991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d0100240 msgr2=0x7f92d0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.462+0000 7f92d4cab700 1 --2- 172.21.15.46:0/4170932991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d0100240 0x7f92d0100650 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009910 tx=0x7f92c0009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.462+0000 7f92d4cab700 1 -- 172.21.15.46:0/4170932991 shutdown_connections 2024-02-19T19:03:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.462+0000 7f92d4cab700 1 --2- 172.21.15.46:0/4170932991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d0101440 0x7f92d0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.462+0000 7f92d4cab700 1 --2- 172.21.15.46:0/4170932991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d0100240 0x7f92d0100650 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.462+0000 7f92d4cab700 1 -- 172.21.15.46:0/4170932991 >> 172.21.15.46:0/4170932991 conn(0x7f92d00fb7f0 msgr2=0x7f92d00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.463+0000 7f92d4cab700 1 -- 172.21.15.46:0/4170932991 shutdown_connections 2024-02-19T19:03:33.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.463+0000 7f92d4cab700 1 -- 172.21.15.46:0/4170932991 wait complete. 2024-02-19T19:03:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.463+0000 7f92d4cab700 1 Processor -- start 2024-02-19T19:03:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.463+0000 7f92d4cab700 1 -- start start 2024-02-19T19:03:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.463+0000 7f92d4cab700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d0100240 0x7f92d0195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.463+0000 7f92d4cab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d0101440 0x7f92d01960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.463+0000 7f92d4cab700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d01966c0 con 0x7f92d0100240 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.463+0000 7f92d4cab700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d0196800 con 0x7f92d0101440 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92ce59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d0100240 0x7f92d0195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92ce59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d0100240 0x7f92d0195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59770/0 (socket says 172.21.15.46:59770) 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92ce59c700 1 -- 172.21.15.46:0/3164544901 learned_addr learned my addr 172.21.15.46:0/3164544901 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92cdd9b700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d0101440 0x7f92d01960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92ce59c700 1 -- 172.21.15.46:0/3164544901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d0101440 msgr2=0x7f92d01960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92ce59c700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d0101440 0x7f92d01960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92ce59c700 1 -- 172.21.15.46:0/3164544901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00095f0 con 0x7f92d0100240 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92ce59c700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d0100240 0x7f92d0195b60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f92c000bda0 tx=0x7f92c000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92bf7fe700 1 -- 172.21.15.46:0/3164544901 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92c001d070 con 0x7f92d0100240 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92bf7fe700 1 -- 172.21.15.46:0/3164544901 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92c0004c50 con 0x7f92d0100240 2024-02-19T19:03:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92d4cab700 1 -- 172.21.15.46:0/3164544901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d019b250 con 0x7f92d0100240 2024-02-19T19:03:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92bf7fe700 1 -- 172.21.15.46:0/3164544901 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92c000f690 con 0x7f92d0100240 2024-02-19T19:03:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.464+0000 7f92d4cab700 1 -- 172.21.15.46:0/3164544901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d019b740 con 0x7f92d0100240 2024-02-19T19:03:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.465+0000 7f92d4cab700 1 -- 172.21.15.46:0/3164544901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d0108e10 con 0x7f92d0100240 2024-02-19T19:03:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.466+0000 7f92bf7fe700 1 -- 172.21.15.46:0/3164544901 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f92c00229b0 con 0x7f92d0100240 2024-02-19T19:03:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.466+0000 7f92bf7fe700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f92b806d660 0x7f92b806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.466+0000 7f92bf7fe700 1 -- 172.21.15.46:0/3164544901 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f92c008e930 con 0x7f92d0100240 2024-02-19T19:03:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.466+0000 7f92cdd9b700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f92b806d660 0x7f92b806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.467+0000 7f92cdd9b700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f92b806d660 0x7f92b806fb10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f92c4006fd0 tx=0x7f92c4008040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:33.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.471+0000 7f92bf7fe700 1 -- 172.21.15.46:0/3164544901 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f92c005bfd0 con 0x7f92d0100240 2024-02-19T19:03:33.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.768+0000 7f92d4cab700 1 -- 172.21.15.46:0/3164544901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f92d0108fd0 con 0x7f92d0100240 2024-02-19T19:03:33.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.769+0000 7f92bf7fe700 1 -- 172.21.15.46:0/3164544901 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f92c005bb60 con 0x7f92d0100240 2024-02-19T19:03:33.788 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:03:33.788 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:03:33.788 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:03:33.789 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:03:33.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 -- 172.21.15.46:0/3164544901 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f92b806d660 msgr2=0x7f92b806fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f92b806d660 0x7f92b806fb10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f92c4006fd0 tx=0x7f92c4008040 comp rx=0 tx=0).stop 2024-02-19T19:03:33.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 -- 172.21.15.46:0/3164544901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d0100240 msgr2=0x7f92d0195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d0100240 0x7f92d0195b60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f92c000bda0 tx=0x7f92c000be80 comp rx=0 tx=0).stop 2024-02-19T19:03:33.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 -- 172.21.15.46:0/3164544901 shutdown_connections 2024-02-19T19:03:33.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f92b806d660 0x7f92b806fb10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f92d0100240 0x7f92d0195b60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 --2- 172.21.15.46:0/3164544901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d0101440 0x7f92d01960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 -- 172.21.15.46:0/3164544901 >> 172.21.15.46:0/3164544901 conn(0x7f92d00fb7f0 msgr2=0x7f92d0104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 -- 172.21.15.46:0/3164544901 shutdown_connections 2024-02-19T19:03:33.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.771+0000 7f92d4cab700 1 -- 172.21.15.46:0/3164544901 wait complete. 2024-02-19T19:03:33.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.879+0000 7faf5b00b700 1 -- 172.21.15.46:0/473136431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf540ff150 msgr2=0x7faf540ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.879+0000 7faf5b00b700 1 --2- 172.21.15.46:0/473136431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf540ff150 0x7faf540ff560 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faf48009910 tx=0x7faf48009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:33.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.879+0000 7faf5b00b700 1 -- 172.21.15.46:0/473136431 shutdown_connections 2024-02-19T19:03:33.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.879+0000 7faf5b00b700 1 --2- 172.21.15.46:0/473136431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf541003f0 0x7faf54100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.879+0000 7faf5b00b700 1 --2- 172.21.15.46:0/473136431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf540ff150 0x7faf540ff560 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.879+0000 7faf5b00b700 1 -- 172.21.15.46:0/473136431 >> 172.21.15.46:0/473136431 conn(0x7faf540fa7a0 msgr2=0x7faf540fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.879+0000 7faf5b00b700 1 -- 172.21.15.46:0/473136431 shutdown_connections 2024-02-19T19:03:33.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.879+0000 7faf5b00b700 1 -- 172.21.15.46:0/473136431 wait complete. 2024-02-19T19:03:33.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf5b00b700 1 Processor -- start 2024-02-19T19:03:33.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf5b00b700 1 -- start start 2024-02-19T19:03:33.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf5b00b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf540ff150 0x7faf54103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf5b00b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf541003f0 0x7faf541017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf5b00b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf54101d10 con 0x7faf541003f0 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf5b00b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf54101e50 con 0x7faf540ff150 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf53fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf541003f0 0x7faf541017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf53fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf541003f0 0x7faf541017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59792/0 (socket says 172.21.15.46:59792) 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf53fff700 1 -- 172.21.15.46:0/3409162958 learned_addr learned my addr 172.21.15.46:0/3409162958 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf58da7700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf540ff150 0x7faf54103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf53fff700 1 -- 172.21.15.46:0/3409162958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf540ff150 msgr2=0x7faf54103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf53fff700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf540ff150 0x7faf54103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf53fff700 1 -- 172.21.15.46:0/3409162958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf480095f0 con 0x7faf541003f0 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.880+0000 7faf58da7700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf540ff150 0x7faf54103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.881+0000 7faf53fff700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf541003f0 0x7faf541017d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7faf4000b4b0 tx=0x7faf4000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.881+0000 7faf51ffb700 1 -- 172.21.15.46:0/3409162958 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf40011800 con 0x7faf541003f0 2024-02-19T19:03:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.881+0000 7faf51ffb700 1 -- 172.21.15.46:0/3409162958 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faf40011e10 con 0x7faf541003f0 2024-02-19T19:03:33.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.881+0000 7faf5b00b700 1 -- 172.21.15.46:0/3409162958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf54102130 con 0x7faf541003f0 2024-02-19T19:03:33.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.881+0000 7faf51ffb700 1 -- 172.21.15.46:0/3409162958 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf4000f2e0 con 0x7faf541003f0 2024-02-19T19:03:33.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.881+0000 7faf5b00b700 1 -- 172.21.15.46:0/3409162958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5419dec0 con 0x7faf541003f0 2024-02-19T19:03:33.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.882+0000 7faf5b00b700 1 -- 172.21.15.46:0/3409162958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf54068ab0 con 0x7faf541003f0 2024-02-19T19:03:33.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.882+0000 7faf51ffb700 1 -- 172.21.15.46:0/3409162958 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) v1 ==== 91448+0+0 (secure 0 0 0) 0x7faf40010380 con 0x7faf541003f0 2024-02-19T19:03:33.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.883+0000 7faf51ffb700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7faf4406d660 0x7faf4406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.883+0000 7faf51ffb700 1 -- 172.21.15.46:0/3409162958 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7faf4008cd10 con 0x7faf541003f0 2024-02-19T19:03:33.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.883+0000 7faf58da7700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7faf4406d660 0x7faf4406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.883+0000 7faf58da7700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7faf4406d660 0x7faf4406fb10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf4800b5c0 tx=0x7faf48005960 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:33.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:33.887+0000 7faf51ffb700 1 -- 172.21.15.46:0/3409162958 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7faf4005a410 con 0x7faf541003f0 2024-02-19T19:03:34.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.132+0000 7faf5b00b700 1 -- 172.21.15.46:0/3409162958 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf540694e0 con 0x7faf4406d660 2024-02-19T19:03:34.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.133+0000 7faf51ffb700 1 -- 172.21.15.46:0/3409162958 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7faf540694e0 con 0x7faf4406d660 2024-02-19T19:03:34.152 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:03:34.152 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:03:34.152 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:03:34.152 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:03:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:03:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:03:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:03:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-02-19T19:03:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading alertmanager daemons", 2024-02-19T19:03:34.153 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:03:34.153 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 -- 172.21.15.46:0/3409162958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7faf4406d660 msgr2=0x7faf4406fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7faf4406d660 0x7faf4406fb10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faf4800b5c0 tx=0x7faf48005960 comp rx=0 tx=0).stop 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 -- 172.21.15.46:0/3409162958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf541003f0 msgr2=0x7faf541017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf541003f0 0x7faf541017d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7faf4000b4b0 tx=0x7faf4000b870 comp rx=0 tx=0).stop 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 -- 172.21.15.46:0/3409162958 shutdown_connections 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7faf4406d660 0x7faf4406fb10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf540ff150 0x7faf54103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 --2- 172.21.15.46:0/3409162958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf541003f0 0x7faf541017d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 -- 172.21.15.46:0/3409162958 >> 172.21.15.46:0/3409162958 conn(0x7faf540fa7a0 msgr2=0x7faf54068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 -- 172.21.15.46:0/3409162958 shutdown_connections 2024-02-19T19:03:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:03:34.135+0000 7faf5b00b700 1 -- 172.21.15.46:0/3409162958 wait complete. 2024-02-19T19:03:34.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:34 smithi142 ceph-mon[37169]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:34.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:34 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/3164544901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:34.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:34 smithi142 ceph-mon[37169]: Upgrade: Updating alertmanager.smithi046 2024-02-19T19:03:34.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:34 smithi142 ceph-mon[37169]: Deploying daemon alertmanager.smithi046 on smithi046 2024-02-19T19:03:34.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:34 smithi046 ceph-mon[29647]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:34.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:34 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3164544901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:34.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:34 smithi046 ceph-mon[29647]: Upgrade: Updating alertmanager.smithi046 2024-02-19T19:03:34.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:34 smithi046 ceph-mon[29647]: Deploying daemon alertmanager.smithi046 on smithi046 2024-02-19T19:03:35.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:35 smithi046 ceph-mon[29647]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:35.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:35 smithi046 ceph-mon[29647]: pgmap v38: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:35.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:35 smithi142 ceph-mon[37169]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:35.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:35 smithi142 ceph-mon[37169]: pgmap v38: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:37.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:37 smithi142 ceph-mon[37169]: pgmap v39: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:37.764 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:37 smithi046 ceph-mon[29647]: pgmap v39: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:39.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:39 smithi046 ceph-mon[29647]: pgmap v40: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:39.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:39 smithi142 ceph-mon[37169]: pgmap v40: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:40.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:40 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:40 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:41.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:41 smithi046 ceph-mon[29647]: pgmap v41: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:41.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:41 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:41.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:41 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:41.498 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:41 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:41.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:41 smithi142 ceph-mon[37169]: pgmap v41: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:41.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:41 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:41.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:41 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:41.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:41 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:43.768 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:43 smithi046 ceph-mon[29647]: pgmap v42: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:43.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:43 smithi142 ceph-mon[37169]: pgmap v42: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:45.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:45 smithi046 ceph-mon[29647]: pgmap v43: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:45.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:45 smithi142 ceph-mon[37169]: pgmap v43: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:47.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:46 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:47.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:46 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:47.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:46 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:47.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:46 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:48.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:48 smithi046 ceph-mon[29647]: pgmap v44: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:48.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:48 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:48.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:48 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:48.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:48 smithi142 ceph-mon[37169]: pgmap v44: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:48.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:48 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:48.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:48 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:50.122 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:50 smithi046 ceph-mon[29647]: pgmap v45: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:50.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:50 smithi142 ceph-mon[37169]: pgmap v45: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:51.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: pgmap v46: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:51.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:51.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:51 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: pgmap v46: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:51.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:51.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:51 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:53.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:53 smithi046 ceph-mon[29647]: Upgrade: Updating grafana.smithi046 2024-02-19T19:03:53.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:53 smithi046 ceph-mon[29647]: Deploying daemon grafana.smithi046 on smithi046 2024-02-19T19:03:53.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:53 smithi046 ceph-mon[29647]: pgmap v47: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:53.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:53 smithi142 ceph-mon[37169]: Upgrade: Updating grafana.smithi046 2024-02-19T19:03:53.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:53 smithi142 ceph-mon[37169]: Deploying daemon grafana.smithi046 on smithi046 2024-02-19T19:03:53.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:53 smithi142 ceph-mon[37169]: pgmap v47: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:54.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:54 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:55.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:54 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:55.851 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:55 smithi142 ceph-mon[37169]: pgmap v48: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:56.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:55 smithi046 ceph-mon[29647]: pgmap v48: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:57.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:57 smithi142 ceph-mon[37169]: pgmap v49: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:03:57.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:57 smithi142 ceph-mon[37169]: mgrmap e32: smithi046.qtceex(active, since 92s), standbys: smithi142.fwekwv 2024-02-19T19:03:58.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:57 smithi046 ceph-mon[29647]: pgmap v49: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:03:58.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:57 smithi046 ceph-mon[29647]: mgrmap e32: smithi046.qtceex(active, since 92s), standbys: smithi142.fwekwv 2024-02-19T19:03:59.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:03:59 smithi142 ceph-mon[37169]: pgmap v50: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:04:00.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:03:59 smithi046 ceph-mon[29647]: pgmap v50: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:04:01.423 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:01 smithi046 ceph-mon[29647]: pgmap v51: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:04:01.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:01 smithi142 ceph-mon[37169]: pgmap v51: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:04:03.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:03 smithi046 ceph-mon[29647]: pgmap v52: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:04:03.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:03 smithi142 ceph-mon[37169]: pgmap v52: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:04:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.247+0000 7f54e1b44700 1 -- 172.21.15.46:0/3862025966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54dc101440 msgr2=0x7f54dc101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.247+0000 7f54e1b44700 1 --2- 172.21.15.46:0/3862025966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54dc101440 0x7f54dc101890 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009910 tx=0x7f54d0009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.247+0000 7f54e1b44700 1 -- 172.21.15.46:0/3862025966 shutdown_connections 2024-02-19T19:04:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.247+0000 7f54e1b44700 1 --2- 172.21.15.46:0/3862025966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54dc101440 0x7f54dc101890 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.247+0000 7f54e1b44700 1 --2- 172.21.15.46:0/3862025966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54dc100240 0x7f54dc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.247+0000 7f54e1b44700 1 -- 172.21.15.46:0/3862025966 >> 172.21.15.46:0/3862025966 conn(0x7f54dc0fb7f0 msgr2=0x7f54dc0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:04.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.248+0000 7f54e1b44700 1 -- 172.21.15.46:0/3862025966 shutdown_connections 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.248+0000 7f54e1b44700 1 -- 172.21.15.46:0/3862025966 wait complete. 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.248+0000 7f54e1b44700 1 Processor -- start 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.248+0000 7f54e1b44700 1 -- start start 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.248+0000 7f54e1b44700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54dc100240 0x7f54dc195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.248+0000 7f54e1b44700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54dc101440 0x7f54dc195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.248+0000 7f54e1b44700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc1965f0 con 0x7f54dc100240 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.248+0000 7f54e1b44700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc196730 con 0x7f54dc101440 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54db7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54dc100240 0x7f54dc195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54db7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54dc100240 0x7f54dc195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44774/0 (socket says 172.21.15.46:44774) 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54db7fe700 1 -- 172.21.15.46:0/2310213914 learned_addr learned my addr 172.21.15.46:0/2310213914 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54daffd700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54dc101440 0x7f54dc195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54db7fe700 1 -- 172.21.15.46:0/2310213914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54dc101440 msgr2=0x7f54dc195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54db7fe700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54dc101440 0x7f54dc195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54db7fe700 1 -- 172.21.15.46:0/2310213914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d00095f0 con 0x7f54dc100240 2024-02-19T19:04:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54db7fe700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54dc100240 0x7f54dc195a90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00d900 tx=0x7f54cc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:04.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54d8ff9700 1 -- 172.21.15.46:0/2310213914 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54cc0041f0 con 0x7f54dc100240 2024-02-19T19:04:04.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54d8ff9700 1 -- 172.21.15.46:0/2310213914 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f54cc004350 con 0x7f54dc100240 2024-02-19T19:04:04.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54e1b44700 1 -- 172.21.15.46:0/2310213914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc19b1e0 con 0x7f54dc100240 2024-02-19T19:04:04.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54d8ff9700 1 -- 172.21.15.46:0/2310213914 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54cc003d20 con 0x7f54dc100240 2024-02-19T19:04:04.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.249+0000 7f54e1b44700 1 -- 172.21.15.46:0/2310213914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc19b730 con 0x7f54dc100240 2024-02-19T19:04:04.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.250+0000 7f54e1b44700 1 -- 172.21.15.46:0/2310213914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc108d90 con 0x7f54dc100240 2024-02-19T19:04:04.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.251+0000 7f54d8ff9700 1 -- 172.21.15.46:0/2310213914 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f54cc009730 con 0x7f54dc100240 2024-02-19T19:04:04.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.251+0000 7f54d8ff9700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f54c406d520 0x7f54c406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.251+0000 7f54d8ff9700 1 -- 172.21.15.46:0/2310213914 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f54cc08ce40 con 0x7f54dc100240 2024-02-19T19:04:04.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.251+0000 7f54daffd700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f54c406d520 0x7f54c406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.252+0000 7f54daffd700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f54c406d520 0x7f54c406f9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f54d000b5c0 tx=0x7f54d0005ee0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:04.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.256+0000 7f54d8ff9700 1 -- 172.21.15.46:0/2310213914 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f54cc05a650 con 0x7f54dc100240 2024-02-19T19:04:04.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.520+0000 7f54e1b44700 1 -- 172.21.15.46:0/2310213914 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54dc105d90 con 0x7f54c406d520 2024-02-19T19:04:04.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.522+0000 7f54d8ff9700 1 -- 172.21.15.46:0/2310213914 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f54dc105d90 con 0x7f54c406d520 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 -- 172.21.15.46:0/2310213914 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f54c406d520 msgr2=0x7f54c406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f54c406d520 0x7f54c406f9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f54d000b5c0 tx=0x7f54d0005ee0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 -- 172.21.15.46:0/2310213914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54dc100240 msgr2=0x7f54dc195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54dc100240 0x7f54dc195a90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00d900 tx=0x7f54cc00dc10 comp rx=0 tx=0).stop 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 -- 172.21.15.46:0/2310213914 shutdown_connections 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f54c406d520 0x7f54c406f9d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54dc100240 0x7f54dc195a90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 --2- 172.21.15.46:0/2310213914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54dc101440 0x7f54dc195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 -- 172.21.15.46:0/2310213914 >> 172.21.15.46:0/2310213914 conn(0x7f54dc0fb7f0 msgr2=0x7f54dc104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 -- 172.21.15.46:0/2310213914 shutdown_connections 2024-02-19T19:04:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.524+0000 7f54e1b44700 1 -- 172.21.15.46:0/2310213914 wait complete. 2024-02-19T19:04:04.556 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:04:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.650+0000 7f822a94a700 1 -- 172.21.15.46:0/1274832955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8224100240 msgr2=0x7f8224100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.650+0000 7f822a94a700 1 --2- 172.21.15.46:0/1274832955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8224100240 0x7f8224100650 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8214009910 tx=0x7f8214009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.650+0000 7f822a94a700 1 -- 172.21.15.46:0/1274832955 shutdown_connections 2024-02-19T19:04:04.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.650+0000 7f822a94a700 1 --2- 172.21.15.46:0/1274832955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82241014e0 0x7f8224101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.650+0000 7f822a94a700 1 --2- 172.21.15.46:0/1274832955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8224100240 0x7f8224100650 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.650+0000 7f822a94a700 1 -- 172.21.15.46:0/1274832955 >> 172.21.15.46:0/1274832955 conn(0x7f82240fb890 msgr2=0x7f82240fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:04.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.650+0000 7f822a94a700 1 -- 172.21.15.46:0/1274832955 shutdown_connections 2024-02-19T19:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.651+0000 7f822a94a700 1 -- 172.21.15.46:0/1274832955 wait complete. 2024-02-19T19:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.651+0000 7f822a94a700 1 Processor -- start 2024-02-19T19:04:04.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.652+0000 7f822a94a700 1 -- start start 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.652+0000 7f822a94a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8224100240 0x7f8224195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.652+0000 7f822a94a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82241014e0 0x7f8224195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.652+0000 7f822a94a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82241965f0 con 0x7f8224100240 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.652+0000 7f822a94a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8224196730 con 0x7f82241014e0 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.652+0000 7f8223fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8224100240 0x7f8224195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.652+0000 7f8223fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8224100240 0x7f8224195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44784/0 (socket says 172.21.15.46:44784) 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.652+0000 7f8223fff700 1 -- 172.21.15.46:0/2472973610 learned_addr learned my addr 172.21.15.46:0/2472973610 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.652+0000 7f82237fe700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82241014e0 0x7f8224195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.653+0000 7f8223fff700 1 -- 172.21.15.46:0/2472973610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82241014e0 msgr2=0x7f8224195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.653+0000 7f8223fff700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82241014e0 0x7f8224195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.653+0000 7f8223fff700 1 -- 172.21.15.46:0/2472973610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140095f0 con 0x7f8224100240 2024-02-19T19:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.653+0000 7f8223fff700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8224100240 0x7f8224195a90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8214006010 tx=0x7f8214004910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.653+0000 7f82217fa700 1 -- 172.21.15.46:0/2472973610 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f821401d070 con 0x7f8224100240 2024-02-19T19:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.653+0000 7f822a94a700 1 -- 172.21.15.46:0/2472973610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822419b180 con 0x7f8224100240 2024-02-19T19:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.653+0000 7f822a94a700 1 -- 172.21.15.46:0/2472973610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822419b670 con 0x7f8224100240 2024-02-19T19:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.653+0000 7f82217fa700 1 -- 172.21.15.46:0/2472973610 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8214005dc0 con 0x7f8224100240 2024-02-19T19:04:04.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.653+0000 7f82217fa700 1 -- 172.21.15.46:0/2472973610 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f821400f690 con 0x7f8224100240 2024-02-19T19:04:04.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.654+0000 7f822a94a700 1 -- 172.21.15.46:0/2472973610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8210005320 con 0x7f8224100240 2024-02-19T19:04:04.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.655+0000 7f82217fa700 1 -- 172.21.15.46:0/2472973610 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f821400f7f0 con 0x7f8224100240 2024-02-19T19:04:04.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.655+0000 7f82217fa700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f820c06d520 0x7f820c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.656+0000 7f82217fa700 1 -- 172.21.15.46:0/2472973610 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f821408e710 con 0x7f8224100240 2024-02-19T19:04:04.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.656+0000 7f82237fe700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f820c06d520 0x7f820c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.656+0000 7f82237fe700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f820c06d520 0x7f820c06f9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8218005950 tx=0x7f821800b410 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:04.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.661+0000 7f82217fa700 1 -- 172.21.15.46:0/2472973610 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f821405c160 con 0x7f8224100240 2024-02-19T19:04:04.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.952+0000 7f822a94a700 1 -- 172.21.15.46:0/2472973610 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8210000bf0 con 0x7f820c06d520 2024-02-19T19:04:04.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.953+0000 7f82217fa700 1 -- 172.21.15.46:0/2472973610 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f8210000bf0 con 0x7f820c06d520 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.956+0000 7f822a94a700 1 -- 172.21.15.46:0/2472973610 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f820c06d520 msgr2=0x7f820c06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.956+0000 7f822a94a700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f820c06d520 0x7f820c06f9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8218005950 tx=0x7f821800b410 comp rx=0 tx=0).stop 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.956+0000 7f822a94a700 1 -- 172.21.15.46:0/2472973610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8224100240 msgr2=0x7f8224195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.956+0000 7f822a94a700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8224100240 0x7f8224195a90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8214006010 tx=0x7f8214004910 comp rx=0 tx=0).stop 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.956+0000 7f822a94a700 1 -- 172.21.15.46:0/2472973610 shutdown_connections 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.956+0000 7f822a94a700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f820c06d520 0x7f820c06f9d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.956+0000 7f822a94a700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8224100240 0x7f8224195a90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.956+0000 7f822a94a700 1 --2- 172.21.15.46:0/2472973610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82241014e0 0x7f8224195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.956+0000 7f822a94a700 1 -- 172.21.15.46:0/2472973610 >> 172.21.15.46:0/2472973610 conn(0x7f82240fb890 msgr2=0x7f8224104710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.957+0000 7f822a94a700 1 -- 172.21.15.46:0/2472973610 shutdown_connections 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:04.957+0000 7f822a94a700 1 -- 172.21.15.46:0/2472973610 wait complete. 2024-02-19T19:04:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.076+0000 7f961d99c700 1 -- 172.21.15.46:0/2671217727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9618100ce0 msgr2=0x7f96181030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.076+0000 7f961d99c700 1 --2- 172.21.15.46:0/2671217727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9618100ce0 0x7f96181030c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9608009910 tx=0x7f9608009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.076+0000 7f961d99c700 1 -- 172.21.15.46:0/2671217727 shutdown_connections 2024-02-19T19:04:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.076+0000 7f961d99c700 1 --2- 172.21.15.46:0/2671217727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9618103600 0x7f96181059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.076+0000 7f961d99c700 1 --2- 172.21.15.46:0/2671217727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9618100ce0 0x7f96181030c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.076+0000 7f961d99c700 1 -- 172.21.15.46:0/2671217727 >> 172.21.15.46:0/2671217727 conn(0x7f96180fa700 msgr2=0x7f96180fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.076+0000 7f961d99c700 1 -- 172.21.15.46:0/2671217727 shutdown_connections 2024-02-19T19:04:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.076+0000 7f961d99c700 1 -- 172.21.15.46:0/2671217727 wait complete. 2024-02-19T19:04:05.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.077+0000 7f961d99c700 1 Processor -- start 2024-02-19T19:04:05.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.077+0000 7f961d99c700 1 -- start start 2024-02-19T19:04:05.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.077+0000 7f961d99c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9618100ce0 0x7f9618195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:05.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.077+0000 7f961d99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9618103600 0x7f9618195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:05.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.077+0000 7f961d99c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618196610 con 0x7f9618100ce0 2024-02-19T19:04:05.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.077+0000 7f961d99c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618196750 con 0x7f9618103600 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f9616ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9618100ce0 0x7f9618195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f9616ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9618100ce0 0x7f9618195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44788/0 (socket says 172.21.15.46:44788) 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f9616ffd700 1 -- 172.21.15.46:0/1994667586 learned_addr learned my addr 172.21.15.46:0/1994667586 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f96167fc700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9618103600 0x7f9618195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f9616ffd700 1 -- 172.21.15.46:0/1994667586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9618103600 msgr2=0x7f9618195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f9616ffd700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9618103600 0x7f9618195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f9616ffd700 1 -- 172.21.15.46:0/1994667586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96080095f0 con 0x7f9618100ce0 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f9616ffd700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9618100ce0 0x7f9618195ab0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9608006010 tx=0x7f960800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f961c99a700 1 -- 172.21.15.46:0/1994667586 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960801d070 con 0x7f9618100ce0 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f961d99c700 1 -- 172.21.15.46:0/1994667586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961819b1a0 con 0x7f9618100ce0 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f961d99c700 1 -- 172.21.15.46:0/1994667586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961819b690 con 0x7f9618100ce0 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f961c99a700 1 -- 172.21.15.46:0/1994667586 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f960800f460 con 0x7f9618100ce0 2024-02-19T19:04:05.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.078+0000 7f961c99a700 1 -- 172.21.15.46:0/1994667586 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9608021640 con 0x7f9618100ce0 2024-02-19T19:04:05.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.080+0000 7f961d99c700 1 -- 172.21.15.46:0/1994667586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9604005320 con 0x7f9618100ce0 2024-02-19T19:04:05.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.080+0000 7f961c99a700 1 -- 172.21.15.46:0/1994667586 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f960802b440 con 0x7f9618100ce0 2024-02-19T19:04:05.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.080+0000 7f961c99a700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f960006d520 0x7f960006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:05.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.080+0000 7f961c99a700 1 -- 172.21.15.46:0/1994667586 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f960808e090 con 0x7f9618100ce0 2024-02-19T19:04:05.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.080+0000 7f96167fc700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f960006d520 0x7f960006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:05.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.081+0000 7f96167fc700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f960006d520 0x7f960006f9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f960c005950 tx=0x7f960c00b410 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.086+0000 7f961c99a700 1 -- 172.21.15.46:0/1994667586 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f960805b920 con 0x7f9618100ce0 2024-02-19T19:04:05.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.327+0000 7f961d99c700 1 -- 172.21.15.46:0/1994667586 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9604000bf0 con 0x7f960006d520 2024-02-19T19:04:05.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.340+0000 7f961c99a700 1 -- 172.21.15.46:0/1994667586 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f9604000bf0 con 0x7f960006d520 2024-02-19T19:04:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:04:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (25s) 19s ago 10m 16.6M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:04:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (11m) 19s ago 11m 7805k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:04:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (9m) 58s ago 9m 7680k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:04:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (11m) 19s ago 11m 6660k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:04:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (9m) 58s ago 9m 6665k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:04:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (8m) 19s ago 10m 85.1M - 9.4.7 954c08fa6188 2fa87d8c964a 2024-02-19T19:04:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (4m) 19s ago 4m 25.8M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:04:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (4m) 19s ago 4m 14.0M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:04:05.360 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (4m) 58s ago 4m 14.5M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (4m) 58s ago 4m 22.2M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (111s) 19s ago 12m 497M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (79s) 58s ago 9m 447M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (12m) 19s ago 12m 52.6M 2048M 18.2.0 dc2bc1663786 adb8243bd11c 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (9m) 58s ago 9m 40.8M 2048M 18.2.0 dc2bc1663786 3f6c8b69abc2 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (66s) 19s ago 10m 16.8M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (61s) 58s ago 9m 5486k - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (8m) 19s ago 8m 51.0M 1217M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (7m) 19s ago 7m 49.8M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (7m) 19s ago 7m 51.1M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (7m) 58s ago 6m 48.2M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (6m) 58s ago 6m 46.4M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (6m) 58s ago 6m 47.2M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:04:05.361 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (43s) 19s ago 9m 48.8M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:04:05.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.342+0000 7f961d99c700 1 -- 172.21.15.46:0/1994667586 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f960006d520 msgr2=0x7f960006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.342+0000 7f961d99c700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f960006d520 0x7f960006f9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f960c005950 tx=0x7f960c00b410 comp rx=0 tx=0).stop 2024-02-19T19:04:05.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.342+0000 7f961d99c700 1 -- 172.21.15.46:0/1994667586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9618100ce0 msgr2=0x7f9618195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.342+0000 7f961d99c700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9618100ce0 0x7f9618195ab0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9608006010 tx=0x7f960800bd70 comp rx=0 tx=0).stop 2024-02-19T19:04:05.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.343+0000 7f961d99c700 1 -- 172.21.15.46:0/1994667586 shutdown_connections 2024-02-19T19:04:05.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.343+0000 7f961d99c700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f960006d520 0x7f960006f9d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.343+0000 7f961d99c700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9618100ce0 0x7f9618195ab0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.343+0000 7f961d99c700 1 --2- 172.21.15.46:0/1994667586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9618103600 0x7f9618195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.343+0000 7f961d99c700 1 -- 172.21.15.46:0/1994667586 >> 172.21.15.46:0/1994667586 conn(0x7f96180fa700 msgr2=0x7f96180fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:05.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.343+0000 7f961d99c700 1 -- 172.21.15.46:0/1994667586 shutdown_connections 2024-02-19T19:04:05.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.343+0000 7f961d99c700 1 -- 172.21.15.46:0/1994667586 wait complete. 2024-02-19T19:04:05.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.478+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1607373129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e240ff130 msgr2=0x7f7e240ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.478+0000 7f7e28a9c700 1 --2- 172.21.15.46:0/1607373129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e240ff130 0x7f7e240ff540 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009910 tx=0x7f7e14009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:05.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.478+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1607373129 shutdown_connections 2024-02-19T19:04:05.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.478+0000 7f7e28a9c700 1 --2- 172.21.15.46:0/1607373129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e241003d0 0x7f7e24100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.478+0000 7f7e28a9c700 1 --2- 172.21.15.46:0/1607373129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e240ff130 0x7f7e240ff540 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.478+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1607373129 >> 172.21.15.46:0/1607373129 conn(0x7f7e240fa780 msgr2=0x7f7e240fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:05.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.478+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1607373129 shutdown_connections 2024-02-19T19:04:05.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.479+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1607373129 wait complete. 2024-02-19T19:04:05.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.479+0000 7f7e28a9c700 1 Processor -- start 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.479+0000 7f7e28a9c700 1 -- start start 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.480+0000 7f7e28a9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e240ff130 0x7f7e24069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.480+0000 7f7e28a9c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e241003d0 0x7f7e241985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.480+0000 7f7e28a9c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24198bc0 con 0x7f7e241003d0 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.480+0000 7f7e28a9c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24198d00 con 0x7f7e240ff130 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.480+0000 7f7e21d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e241003d0 0x7f7e241985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.480+0000 7f7e21d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e241003d0 0x7f7e241985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44810/0 (socket says 172.21.15.46:44810) 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.480+0000 7f7e21d9b700 1 -- 172.21.15.46:0/1218578200 learned_addr learned my addr 172.21.15.46:0/1218578200 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.480+0000 7f7e21d9b700 1 -- 172.21.15.46:0/1218578200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e240ff130 msgr2=0x7f7e24069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.480+0000 7f7e21d9b700 1 --2- 172.21.15.46:0/1218578200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e240ff130 0x7f7e24069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.480+0000 7f7e21d9b700 1 -- 172.21.15.46:0/1218578200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140095f0 con 0x7f7e241003d0 2024-02-19T19:04:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.481+0000 7f7e21d9b700 1 --2- 172.21.15.46:0/1218578200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e241003d0 0x7f7e241985a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800e920 tx=0x7f7e1800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:05.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.481+0000 7f7e137fe700 1 -- 172.21.15.46:0/1218578200 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e18009790 con 0x7f7e241003d0 2024-02-19T19:04:05.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.481+0000 7f7e137fe700 1 -- 172.21.15.46:0/1218578200 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e1800cba0 con 0x7f7e241003d0 2024-02-19T19:04:05.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.481+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1218578200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e24198fe0 con 0x7f7e241003d0 2024-02-19T19:04:05.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.481+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1218578200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e24199530 con 0x7f7e241003d0 2024-02-19T19:04:05.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.481+0000 7f7e137fe700 1 -- 172.21.15.46:0/1218578200 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e18018630 con 0x7f7e241003d0 2024-02-19T19:04:05.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.482+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1218578200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e24107c10 con 0x7f7e241003d0 2024-02-19T19:04:05.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.483+0000 7f7e137fe700 1 -- 172.21.15.46:0/1218578200 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f7e1800cd10 con 0x7f7e241003d0 2024-02-19T19:04:05.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.483+0000 7f7e137fe700 1 --2- 172.21.15.46:0/1218578200 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7e0c06d520 0x7f7e0c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:05.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.483+0000 7f7e137fe700 1 -- 172.21.15.46:0/1218578200 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7e18014070 con 0x7f7e241003d0 2024-02-19T19:04:05.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.483+0000 7f7e2259c700 1 --2- 172.21.15.46:0/1218578200 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7e0c06d520 0x7f7e0c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:05.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.484+0000 7f7e2259c700 1 --2- 172.21.15.46:0/1218578200 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7e0c06d520 0x7f7e0c06f9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009fd0 tx=0x7f7e14000bc0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:05.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.490+0000 7f7e137fe700 1 -- 172.21.15.46:0/1218578200 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f7e18052a50 con 0x7f7e241003d0 2024-02-19T19:04:05.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:05 smithi046 ceph-mon[29647]: pgmap v53: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:04:05.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:05 smithi046 ceph-mon[29647]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:05.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:05 smithi046 ceph-mon[29647]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:05.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.927+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1218578200 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7e2419a110 con 0x7f7e241003d0 2024-02-19T19:04:05.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.927+0000 7f7e137fe700 1 -- 172.21.15.46:0/1218578200 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f7e1805aae0 con 0x7f7e241003d0 2024-02-19T19:04:05.947 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:04:05.947 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:04:05.947 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:04:05.948 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:04:05.949 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1218578200 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7e0c06d520 msgr2=0x7f7e0c06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 --2- 172.21.15.46:0/1218578200 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7e0c06d520 0x7f7e0c06f9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009fd0 tx=0x7f7e14000bc0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1218578200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e241003d0 msgr2=0x7f7e241985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 --2- 172.21.15.46:0/1218578200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e241003d0 0x7f7e241985a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800e920 tx=0x7f7e1800ece0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1218578200 shutdown_connections 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 --2- 172.21.15.46:0/1218578200 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f7e0c06d520 0x7f7e0c06f9d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 --2- 172.21.15.46:0/1218578200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e240ff130 0x7f7e24069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 --2- 172.21.15.46:0/1218578200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e241003d0 0x7f7e241985a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1218578200 >> 172.21.15.46:0/1218578200 conn(0x7f7e240fa780 msgr2=0x7f7e24103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1218578200 shutdown_connections 2024-02-19T19:04:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:05.930+0000 7f7e28a9c700 1 -- 172.21.15.46:0/1218578200 wait complete. 2024-02-19T19:04:05.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:05 smithi142 ceph-mon[37169]: pgmap v53: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:04:05.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:05 smithi142 ceph-mon[37169]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:05.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:05 smithi142 ceph-mon[37169]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:06.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.045+0000 7fc89d403700 1 -- 172.21.15.46:0/2795430293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc898100bc0 msgr2=0x7fc898102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:06.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.045+0000 7fc89d403700 1 --2- 172.21.15.46:0/2795430293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc898100bc0 0x7fc898102fa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc888009910 tx=0x7fc888009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:06.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.045+0000 7fc89d403700 1 -- 172.21.15.46:0/2795430293 shutdown_connections 2024-02-19T19:04:06.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.045+0000 7fc89d403700 1 --2- 172.21.15.46:0/2795430293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8981034e0 0x7fc8981058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:06.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.045+0000 7fc89d403700 1 --2- 172.21.15.46:0/2795430293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc898100bc0 0x7fc898102fa0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:06.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.045+0000 7fc89d403700 1 -- 172.21.15.46:0/2795430293 >> 172.21.15.46:0/2795430293 conn(0x7fc8980fa560 msgr2=0x7fc8980fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:06.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.045+0000 7fc89d403700 1 -- 172.21.15.46:0/2795430293 shutdown_connections 2024-02-19T19:04:06.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.046+0000 7fc89d403700 1 -- 172.21.15.46:0/2795430293 wait complete. 2024-02-19T19:04:06.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.046+0000 7fc89d403700 1 Processor -- start 2024-02-19T19:04:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.046+0000 7fc89d403700 1 -- start start 2024-02-19T19:04:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc89d403700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc898100bc0 0x7fc898195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc89d403700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8981034e0 0x7fc898195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc89d403700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8981963b0 con 0x7fc898100bc0 2024-02-19T19:04:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc89d403700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8981964f0 con 0x7fc8981034e0 2024-02-19T19:04:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc896ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc898100bc0 0x7fc898195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc896ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc898100bc0 0x7fc898195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44828/0 (socket says 172.21.15.46:44828) 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc896ffd700 1 -- 172.21.15.46:0/4137736881 learned_addr learned my addr 172.21.15.46:0/4137736881 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc8967fc700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8981034e0 0x7fc898195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc896ffd700 1 -- 172.21.15.46:0/4137736881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8981034e0 msgr2=0x7fc898195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc896ffd700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8981034e0 0x7fc898195d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc896ffd700 1 -- 172.21.15.46:0/4137736881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880095f0 con 0x7fc898100bc0 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.047+0000 7fc896ffd700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc898100bc0 0x7fc898195850 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc888006010 tx=0x7fc88800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.048+0000 7fc87ffff700 1 -- 172.21.15.46:0/4137736881 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc88801d070 con 0x7fc898100bc0 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.048+0000 7fc89d403700 1 -- 172.21.15.46:0/4137736881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89819af40 con 0x7fc898100bc0 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.048+0000 7fc87ffff700 1 -- 172.21.15.46:0/4137736881 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc88800f460 con 0x7fc898100bc0 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.048+0000 7fc87ffff700 1 -- 172.21.15.46:0/4137736881 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc888021640 con 0x7fc898100bc0 2024-02-19T19:04:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.048+0000 7fc89d403700 1 -- 172.21.15.46:0/4137736881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89819b3b0 con 0x7fc898100bc0 2024-02-19T19:04:06.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.049+0000 7fc89d403700 1 -- 172.21.15.46:0/4137736881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89818fac0 con 0x7fc898100bc0 2024-02-19T19:04:06.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.050+0000 7fc87ffff700 1 -- 172.21.15.46:0/4137736881 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fc88800fab0 con 0x7fc898100bc0 2024-02-19T19:04:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.050+0000 7fc87ffff700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc88006d520 0x7fc88006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.050+0000 7fc87ffff700 1 -- 172.21.15.46:0/4137736881 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc88808e250 con 0x7fc898100bc0 2024-02-19T19:04:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.050+0000 7fc8967fc700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc88006d520 0x7fc88006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.051+0000 7fc8967fc700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc88006d520 0x7fc88006f9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc88c005fd0 tx=0x7fc88c00a560 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:06.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.055+0000 7fc87ffff700 1 -- 172.21.15.46:0/4137736881 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fc888093060 con 0x7fc898100bc0 2024-02-19T19:04:06.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.295+0000 7fc89d403700 1 -- 172.21.15.46:0/4137736881 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc898061190 con 0x7fc88006d520 2024-02-19T19:04:06.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.297+0000 7fc87ffff700 1 -- 172.21.15.46:0/4137736881 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fc898061190 con 0x7fc88006d520 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading grafana daemons", 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:04:06.317 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:04:06.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.299+0000 7fc89d403700 1 -- 172.21.15.46:0/4137736881 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc88006d520 msgr2=0x7fc88006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:06.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.299+0000 7fc89d403700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc88006d520 0x7fc88006f9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc88c005fd0 tx=0x7fc88c00a560 comp rx=0 tx=0).stop 2024-02-19T19:04:06.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.299+0000 7fc89d403700 1 -- 172.21.15.46:0/4137736881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc898100bc0 msgr2=0x7fc898195850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:06.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.299+0000 7fc89d403700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc898100bc0 0x7fc898195850 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc888006010 tx=0x7fc88800be20 comp rx=0 tx=0).stop 2024-02-19T19:04:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.299+0000 7fc89d403700 1 -- 172.21.15.46:0/4137736881 shutdown_connections 2024-02-19T19:04:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.299+0000 7fc89d403700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc88006d520 0x7fc88006f9d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.299+0000 7fc89d403700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc898100bc0 0x7fc898195850 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.299+0000 7fc89d403700 1 --2- 172.21.15.46:0/4137736881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8981034e0 0x7fc898195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.299+0000 7fc89d403700 1 -- 172.21.15.46:0/4137736881 >> 172.21.15.46:0/4137736881 conn(0x7fc8980fa560 msgr2=0x7fc8980fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.300+0000 7fc89d403700 1 -- 172.21.15.46:0/4137736881 shutdown_connections 2024-02-19T19:04:06.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:06.300+0000 7fc89d403700 1 -- 172.21.15.46:0/4137736881 wait complete. 2024-02-19T19:04:06.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:06 smithi046 ceph-mon[29647]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:06.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:06 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1218578200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:06.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:06 smithi142 ceph-mon[37169]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:06.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:06 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1218578200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:07.779 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:07 smithi046 ceph-mon[29647]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:07.779 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:07 smithi046 ceph-mon[29647]: pgmap v54: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:04:07.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:07 smithi142 ceph-mon[37169]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:07.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:07 smithi142 ceph-mon[37169]: pgmap v54: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:04:09.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:09 smithi046 ceph-mon[29647]: pgmap v55: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:09.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:09 smithi142 ceph-mon[37169]: pgmap v55: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:10.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:10 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:10.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:10 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:11.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:11 smithi142 ceph-mon[37169]: pgmap v56: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:11.723 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:11 smithi046 ceph-mon[29647]: pgmap v56: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:13.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:13 smithi046 ceph-mon[29647]: pgmap v57: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:13.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:13 smithi142 ceph-mon[37169]: pgmap v57: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:14.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:14.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:14.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:14 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:14.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:14.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:14.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:14 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:15.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:15 smithi142 ceph-mon[37169]: pgmap v58: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:16.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:15 smithi046 ceph-mon[29647]: pgmap v58: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:17.799 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:17 smithi046 ceph-mon[29647]: pgmap v59: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:17.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:17 smithi142 ceph-mon[37169]: pgmap v59: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:19.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:19 smithi142 ceph-mon[37169]: pgmap v60: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:19.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:19 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:19.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:19 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:20.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:19 smithi046 ceph-mon[29647]: pgmap v60: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:20.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:19 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:20.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:19 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:21.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:21 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:21.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:21 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:21.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:21 smithi142 ceph-mon[37169]: pgmap v61: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:21.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:21 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:21.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:21 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:21.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:21 smithi046 ceph-mon[29647]: pgmap v61: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:23.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:23 smithi046 ceph-mon[29647]: pgmap v62: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:23.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:23 smithi142 ceph-mon[37169]: pgmap v62: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: Upgrade: Finalizing container_image settings 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-19T19:04:24.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:24.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: Upgrade: Complete! 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:24.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:24.956 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:24 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T19:04:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:25.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: Upgrade: Finalizing container_image settings 2024-02-19T19:04:25.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-19T19:04:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-19T19:04:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-19T19:04:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-19T19:04:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-19T19:04:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-19T19:04:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-19T19:04:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-19T19:04:25.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:25.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: Upgrade: Complete! 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:25.086 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:25.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:25.087 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:24 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:26.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:25 smithi046 ceph-mon[29647]: pgmap v63: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:26.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:25 smithi142 ceph-mon[37169]: pgmap v63: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:28.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:27 smithi046 ceph-mon[29647]: pgmap v64: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:28.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:27 smithi142 ceph-mon[37169]: pgmap v64: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:30.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:29 smithi046 ceph-mon[29647]: pgmap v65: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:30.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:29 smithi142 ceph-mon[37169]: pgmap v65: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:31.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:31 smithi142 ceph-mon[37169]: pgmap v66: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:31.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:31 smithi046 ceph-mon[29647]: pgmap v66: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:33.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:33 smithi046 ceph-mon[29647]: pgmap v67: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:33.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:33 smithi142 ceph-mon[37169]: pgmap v67: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:35.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:35 smithi046 ceph-mon[29647]: pgmap v68: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:35 smithi142 ceph-mon[37169]: pgmap v68: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.422+0000 7efd1cad4700 1 -- 172.21.15.46:0/2870984218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd180ff140 msgr2=0x7efd180ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.422+0000 7efd1cad4700 1 --2- 172.21.15.46:0/2870984218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd180ff140 0x7efd180ff550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009910 tx=0x7efd0c009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.423+0000 7efd1cad4700 1 -- 172.21.15.46:0/2870984218 shutdown_connections 2024-02-19T19:04:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.423+0000 7efd1cad4700 1 --2- 172.21.15.46:0/2870984218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd18100340 0x7efd18100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.423+0000 7efd1cad4700 1 --2- 172.21.15.46:0/2870984218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd180ff140 0x7efd180ff550 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.423+0000 7efd1cad4700 1 -- 172.21.15.46:0/2870984218 >> 172.21.15.46:0/2870984218 conn(0x7efd180fa6d0 msgr2=0x7efd180fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.423+0000 7efd1cad4700 1 -- 172.21.15.46:0/2870984218 shutdown_connections 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.423+0000 7efd1cad4700 1 -- 172.21.15.46:0/2870984218 wait complete. 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.423+0000 7efd1cad4700 1 Processor -- start 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd1cad4700 1 -- start start 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd1cad4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd180ff140 0x7efd18195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd1cad4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd18100340 0x7efd18196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd1cad4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd18196740 con 0x7efd18100340 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd1cad4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd18196880 con 0x7efd180ff140 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd15d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd18100340 0x7efd18196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd15d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd18100340 0x7efd18196120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34512/0 (socket says 172.21.15.46:34512) 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd15d9b700 1 -- 172.21.15.46:0/1127672833 learned_addr learned my addr 172.21.15.46:0/1127672833 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd1659c700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd180ff140 0x7efd18195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd15d9b700 1 -- 172.21.15.46:0/1127672833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd180ff140 msgr2=0x7efd18195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd15d9b700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd180ff140 0x7efd18195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.424+0000 7efd15d9b700 1 -- 172.21.15.46:0/1127672833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0095f0 con 0x7efd18100340 2024-02-19T19:04:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.425+0000 7efd15d9b700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd18100340 0x7efd18196120 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efd0800b4b0 tx=0x7efd0800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.425+0000 7efd077fe700 1 -- 172.21.15.46:0/1127672833 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd08011800 con 0x7efd18100340 2024-02-19T19:04:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.425+0000 7efd077fe700 1 -- 172.21.15.46:0/1127672833 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd08011e20 con 0x7efd18100340 2024-02-19T19:04:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.425+0000 7efd1cad4700 1 -- 172.21.15.46:0/1127672833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1819b330 con 0x7efd18100340 2024-02-19T19:04:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.425+0000 7efd077fe700 1 -- 172.21.15.46:0/1127672833 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd0800f2e0 con 0x7efd18100340 2024-02-19T19:04:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.425+0000 7efd1cad4700 1 -- 172.21.15.46:0/1127672833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1819b880 con 0x7efd18100340 2024-02-19T19:04:36.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.426+0000 7efd1cad4700 1 -- 172.21.15.46:0/1127672833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd18107d10 con 0x7efd18100340 2024-02-19T19:04:36.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.426+0000 7efd077fe700 1 -- 172.21.15.46:0/1127672833 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7efd08010380 con 0x7efd18100340 2024-02-19T19:04:36.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.427+0000 7efd077fe700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efd0006d520 0x7efd0006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.427+0000 7efd077fe700 1 -- 172.21.15.46:0/1127672833 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efd0808cb00 con 0x7efd18100340 2024-02-19T19:04:36.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.427+0000 7efd1659c700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efd0006d520 0x7efd0006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.427+0000 7efd1659c700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efd0006d520 0x7efd0006f9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efd0c005090 tx=0x7efd0c0058e0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:36.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.432+0000 7efd077fe700 1 -- 172.21.15.46:0/1127672833 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7efd0805a310 con 0x7efd18100340 2024-02-19T19:04:36.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.656+0000 7efd1cad4700 1 -- 172.21.15.46:0/1127672833 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd1819bf80 con 0x7efd0006d520 2024-02-19T19:04:36.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.658+0000 7efd077fe700 1 -- 172.21.15.46:0/1127672833 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7efd1819bf80 con 0x7efd0006d520 2024-02-19T19:04:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 -- 172.21.15.46:0/1127672833 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efd0006d520 msgr2=0x7efd0006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efd0006d520 0x7efd0006f9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efd0c005090 tx=0x7efd0c0058e0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 -- 172.21.15.46:0/1127672833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd18100340 msgr2=0x7efd18196120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd18100340 0x7efd18196120 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efd0800b4b0 tx=0x7efd0800b7c0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 -- 172.21.15.46:0/1127672833 shutdown_connections 2024-02-19T19:04:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7efd0006d520 0x7efd0006f9d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd180ff140 0x7efd18195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 --2- 172.21.15.46:0/1127672833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd18100340 0x7efd18196120 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 -- 172.21.15.46:0/1127672833 >> 172.21.15.46:0/1127672833 conn(0x7efd180fa6d0 msgr2=0x7efd18068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:36.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 -- 172.21.15.46:0/1127672833 shutdown_connections 2024-02-19T19:04:36.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:36.660+0000 7efd1cad4700 1 -- 172.21.15.46:0/1127672833 wait complete. 2024-02-19T19:04:37.494 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-19T19:04:37.749 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:04:37.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:37 smithi046 ceph-mon[29647]: pgmap v69: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:37.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:37 smithi046 ceph-mon[29647]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:37.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:37 smithi142 ceph-mon[37169]: pgmap v69: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:37.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:37 smithi142 ceph-mon[37169]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:39.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.584+0000 7fc164810700 1 -- 172.21.15.46:0/1031700058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1600ff3c0 msgr2=0x7fc1600ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:39.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.584+0000 7fc164810700 1 --2- 172.21.15.46:0/1031700058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1600ff3c0 0x7fc1600ff790 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc158009910 tx=0x7fc158009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:39.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.584+0000 7fc164810700 1 -- 172.21.15.46:0/1031700058 shutdown_connections 2024-02-19T19:04:39.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.584+0000 7fc164810700 1 --2- 172.21.15.46:0/1031700058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1600ffd60 0x7fc160103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:39.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.584+0000 7fc164810700 1 --2- 172.21.15.46:0/1031700058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1600ff3c0 0x7fc1600ff790 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:39.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.584+0000 7fc164810700 1 -- 172.21.15.46:0/1031700058 >> 172.21.15.46:0/1031700058 conn(0x7fc1600fac80 msgr2=0x7fc1600fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:39.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.584+0000 7fc164810700 1 -- 172.21.15.46:0/1031700058 shutdown_connections 2024-02-19T19:04:39.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.584+0000 7fc164810700 1 -- 172.21.15.46:0/1031700058 wait complete. 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.585+0000 7fc164810700 1 Processor -- start 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.585+0000 7fc164810700 1 -- start start 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.585+0000 7fc164810700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1600ff3c0 0x7fc160196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.585+0000 7fc164810700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1600ffd60 0x7fc160196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.585+0000 7fc164810700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc160196c40 con 0x7fc1600ff3c0 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.585+0000 7fc164810700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16019a9d0 con 0x7fc1600ffd60 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.585+0000 7fc15e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1600ff3c0 0x7fc160196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.585+0000 7fc15e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1600ff3c0 0x7fc160196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51600/0 (socket says 172.21.15.46:51600) 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.585+0000 7fc15e59c700 1 -- 172.21.15.46:0/381546104 learned_addr learned my addr 172.21.15.46:0/381546104 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.586+0000 7fc15e59c700 1 -- 172.21.15.46:0/381546104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1600ffd60 msgr2=0x7fc160196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:39.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.586+0000 7fc15e59c700 1 --2- 172.21.15.46:0/381546104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1600ffd60 0x7fc160196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:39.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.586+0000 7fc15e59c700 1 -- 172.21.15.46:0/381546104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1580095f0 con 0x7fc1600ff3c0 2024-02-19T19:04:39.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.586+0000 7fc15e59c700 1 --2- 172.21.15.46:0/381546104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1600ff3c0 0x7fc160196020 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc158005b40 tx=0x7fc15800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:39.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.586+0000 7fc1577fe700 1 -- 172.21.15.46:0/381546104 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc15801d070 con 0x7fc1600ff3c0 2024-02-19T19:04:39.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.586+0000 7fc1577fe700 1 -- 172.21.15.46:0/381546104 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1580048e0 con 0x7fc1600ff3c0 2024-02-19T19:04:39.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.586+0000 7fc164810700 1 -- 172.21.15.46:0/381546104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16019ac50 con 0x7fc1600ff3c0 2024-02-19T19:04:39.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.586+0000 7fc1577fe700 1 -- 172.21.15.46:0/381546104 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc158003bc0 con 0x7fc1600ff3c0 2024-02-19T19:04:39.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.586+0000 7fc164810700 1 -- 172.21.15.46:0/381546104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16019b0e0 con 0x7fc1600ff3c0 2024-02-19T19:04:39.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.587+0000 7fc164810700 1 -- 172.21.15.46:0/381546104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16004f2a0 con 0x7fc1600ff3c0 2024-02-19T19:04:39.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.588+0000 7fc1577fe700 1 -- 172.21.15.46:0/381546104 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fc158004a50 con 0x7fc1600ff3c0 2024-02-19T19:04:39.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.588+0000 7fc1577fe700 1 --2- 172.21.15.46:0/381546104 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc14c06d520 0x7fc14c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:39.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.588+0000 7fc1577fe700 1 -- 172.21.15.46:0/381546104 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc15808e610 con 0x7fc1600ff3c0 2024-02-19T19:04:39.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.588+0000 7fc15dd9b700 1 --2- 172.21.15.46:0/381546104 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc14c06d520 0x7fc14c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:39.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.589+0000 7fc15dd9b700 1 --2- 172.21.15.46:0/381546104 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc14c06d520 0x7fc14c06f9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc160197640 tx=0x7fc148006cd0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:39.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.593+0000 7fc1577fe700 1 -- 172.21.15.46:0/381546104 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fc158058490 con 0x7fc1600ff3c0 2024-02-19T19:04:39.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:39 smithi046 ceph-mon[29647]: pgmap v70: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:39.613 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:39 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:39.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.887+0000 7fc164810700 1 -- 172.21.15.46:0/381546104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc16019b3b0 con 0x7fc1600ff3c0 2024-02-19T19:04:39.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.887+0000 7fc1577fe700 1 -- 172.21.15.46:0/381546104 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fc15805bb50 con 0x7fc1600ff3c0 2024-02-19T19:04:39.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.889+0000 7fc164810700 1 -- 172.21.15.46:0/381546104 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc14c06d520 msgr2=0x7fc14c06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:39.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.889+0000 7fc164810700 1 --2- 172.21.15.46:0/381546104 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc14c06d520 0x7fc14c06f9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc160197640 tx=0x7fc148006cd0 comp rx=0 tx=0).stop 2024-02-19T19:04:39.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.889+0000 7fc164810700 1 -- 172.21.15.46:0/381546104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1600ff3c0 msgr2=0x7fc160196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:39.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.889+0000 7fc164810700 1 --2- 172.21.15.46:0/381546104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1600ff3c0 0x7fc160196020 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc158005b40 tx=0x7fc15800be20 comp rx=0 tx=0).stop 2024-02-19T19:04:39.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.889+0000 7fc164810700 1 -- 172.21.15.46:0/381546104 shutdown_connections 2024-02-19T19:04:39.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.889+0000 7fc164810700 1 --2- 172.21.15.46:0/381546104 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc14c06d520 0x7fc14c06f9d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:39.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.889+0000 7fc164810700 1 --2- 172.21.15.46:0/381546104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1600ff3c0 0x7fc160196020 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:39.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.889+0000 7fc164810700 1 --2- 172.21.15.46:0/381546104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1600ffd60 0x7fc160196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:39.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.889+0000 7fc164810700 1 -- 172.21.15.46:0/381546104 >> 172.21.15.46:0/381546104 conn(0x7fc1600fac80 msgr2=0x7fc160103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:39.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.890+0000 7fc164810700 1 -- 172.21.15.46:0/381546104 shutdown_connections 2024-02-19T19:04:39.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:39.890+0000 7fc164810700 1 -- 172.21.15.46:0/381546104 wait complete. 2024-02-19T19:04:39.920 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:04:39.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:39 smithi142 ceph-mon[37169]: pgmap v70: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:39.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:39 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:40.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:40 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/381546104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:40.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-19T19:04:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:04:40.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:40 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/381546104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:41.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:41 smithi046 ceph-mon[29647]: pgmap v71: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:41.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:41 smithi142 ceph-mon[37169]: pgmap v71: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.667+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/2178532544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f4101d20 msgr2=0x7fa7f410a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.667+0000 7fa7fb2b1700 1 --2- 172.21.15.46:0/2178532544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f4101d20 0x7fa7f410a220 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009910 tx=0x7fa7e4009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.667+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/2178532544 shutdown_connections 2024-02-19T19:04:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.667+0000 7fa7fb2b1700 1 --2- 172.21.15.46:0/2178532544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f4101d20 0x7fa7f410a220 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.667+0000 7fa7fb2b1700 1 --2- 172.21.15.46:0/2178532544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f4101410 0x7fa7f41017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:42.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.667+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/2178532544 >> 172.21.15.46:0/2178532544 conn(0x7fa7f40fac90 msgr2=0x7fa7f40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.667+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/2178532544 shutdown_connections 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.667+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/2178532544 wait complete. 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7fb2b1700 1 Processor -- start 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7fb2b1700 1 -- start start 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7fb2b1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f4101410 0x7fa7f4195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7fb2b1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f4101d20 0x7fa7f4196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7fb2b1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f41969d0 con 0x7fa7f4101410 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7fb2b1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4196b10 con 0x7fa7f4101d20 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7f904d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f4101410 0x7fa7f4195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7f904d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f4101410 0x7fa7f4195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51620/0 (socket says 172.21.15.46:51620) 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7f904d700 1 -- 172.21.15.46:0/618160621 learned_addr learned my addr 172.21.15.46:0/618160621 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7f884c700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f4101d20 0x7fa7f4196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7f904d700 1 -- 172.21.15.46:0/618160621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f4101d20 msgr2=0x7fa7f4196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:42.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7f904d700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f4101d20 0x7fa7f4196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:42.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.668+0000 7fa7f904d700 1 -- 172.21.15.46:0/618160621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e40095f0 con 0x7fa7f4101410 2024-02-19T19:04:42.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.669+0000 7fa7f904d700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f4101410 0x7fa7f4195e40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000c930 tx=0x7fa7f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:42.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.669+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/618160621 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7f0007ad0 con 0x7fa7f4101410 2024-02-19T19:04:42.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.669+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/618160621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f419a960 con 0x7fa7f4101410 2024-02-19T19:04:42.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.669+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/618160621 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7f000ce80 con 0x7fa7f4101410 2024-02-19T19:04:42.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.669+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/618160621 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7f0018630 con 0x7fa7f4101410 2024-02-19T19:04:42.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.669+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/618160621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f419aeb0 con 0x7fa7f4101410 2024-02-19T19:04:42.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.670+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/618160621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f4107890 con 0x7fa7f4101410 2024-02-19T19:04:42.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.670+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/618160621 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fa7f0007c30 con 0x7fa7f4101410 2024-02-19T19:04:42.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.671+0000 7fa7ea7fc700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fa7e006d520 0x7fa7e006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:42.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.671+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/618160621 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa7f008cfe0 con 0x7fa7f4101410 2024-02-19T19:04:42.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.671+0000 7fa7f884c700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fa7e006d520 0x7fa7e006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:42.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.671+0000 7fa7f884c700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fa7e006d520 0x7fa7e006f9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4197460 tx=0x7fa7e401a040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:42.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.675+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/618160621 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fa7f0056c80 con 0x7fa7f4101410 2024-02-19T19:04:42.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.970+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/618160621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa7f4107270 con 0x7fa7f4101410 2024-02-19T19:04:42.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.971+0000 7fa7ea7fc700 1 -- 172.21.15.46:0/618160621 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fa7f005a340 con 0x7fa7f4101410 2024-02-19T19:04:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/618160621 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fa7e006d520 msgr2=0x7fa7e006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fa7e006d520 0x7fa7e006f9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4197460 tx=0x7fa7e401a040 comp rx=0 tx=0).stop 2024-02-19T19:04:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/618160621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f4101410 msgr2=0x7fa7f4195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f4101410 0x7fa7f4195e40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000c930 tx=0x7fa7f000cc40 comp rx=0 tx=0).stop 2024-02-19T19:04:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/618160621 shutdown_connections 2024-02-19T19:04:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fa7e006d520 0x7fa7e006f9d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7f4101410 0x7fa7f4195e40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 --2- 172.21.15.46:0/618160621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7f4101d20 0x7fa7f4196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/618160621 >> 172.21.15.46:0/618160621 conn(0x7fa7f40fac90 msgr2=0x7fa7f41049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/618160621 shutdown_connections 2024-02-19T19:04:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:42.973+0000 7fa7fb2b1700 1 -- 172.21.15.46:0/618160621 wait complete. 2024-02-19T19:04:43.003 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)" 2024-02-19T19:04:43.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:43 smithi046 ceph-mon[29647]: pgmap v72: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:43.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:43 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/618160621' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:43.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-19T19:04:43.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:43 smithi142 ceph-mon[37169]: pgmap v72: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:43.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:43 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/618160621' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:04:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.693+0000 7fc1e679f700 1 -- 172.21.15.46:0/4017098954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1e0102e30 msgr2=0x7fc1e0103200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.693+0000 7fc1e679f700 1 --2- 172.21.15.46:0/4017098954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1e0102e30 0x7fc1e0103200 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000b0a0 tx=0x7fc1d000b3b0 comp rx=0 tx=0).stop 2024-02-19T19:04:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.693+0000 7fc1e679f700 1 -- 172.21.15.46:0/4017098954 shutdown_connections 2024-02-19T19:04:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.693+0000 7fc1e679f700 1 --2- 172.21.15.46:0/4017098954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e00ff9e0 0x7fc1e00ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.693+0000 7fc1e679f700 1 --2- 172.21.15.46:0/4017098954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1e0102e30 0x7fc1e0103200 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.693+0000 7fc1e679f700 1 -- 172.21.15.46:0/4017098954 >> 172.21.15.46:0/4017098954 conn(0x7fc1e0074fa0 msgr2=0x7fc1e00753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.694+0000 7fc1e679f700 1 -- 172.21.15.46:0/4017098954 shutdown_connections 2024-02-19T19:04:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.694+0000 7fc1e679f700 1 -- 172.21.15.46:0/4017098954 wait complete. 2024-02-19T19:04:45.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.694+0000 7fc1e679f700 1 Processor -- start 2024-02-19T19:04:45.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.694+0000 7fc1e679f700 1 -- start start 2024-02-19T19:04:45.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e679f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1e00ff9e0 0x7fc1e0196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:45.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e679f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e0102e30 0x7fc1e0197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:45.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e679f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0197680 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e679f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e01977c0 con 0x7fc1e0102e30 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e579d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1e00ff9e0 0x7fc1e0196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e579d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1e00ff9e0 0x7fc1e0196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51648/0 (socket says 172.21.15.46:51648) 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e579d700 1 -- 172.21.15.46:0/3015238146 learned_addr learned my addr 172.21.15.46:0/3015238146 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e4f9c700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e0102e30 0x7fc1e0197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e579d700 1 -- 172.21.15.46:0/3015238146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e0102e30 msgr2=0x7fc1e0197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e579d700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e0102e30 0x7fc1e0197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e579d700 1 -- 172.21.15.46:0/3015238146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0009d00 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.695+0000 7fc1e579d700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1e00ff9e0 0x7fc1e0196b20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0000f80 tx=0x7fc1d000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.696+0000 7fc1de7fc700 1 -- 172.21.15.46:0/3015238146 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d000e040 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.696+0000 7fc1de7fc700 1 -- 172.21.15.46:0/3015238146 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1d0003e60 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.696+0000 7fc1e679f700 1 -- 172.21.15.46:0/3015238146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e019fb90 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.696+0000 7fc1de7fc700 1 -- 172.21.15.46:0/3015238146 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d001d910 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.696+0000 7fc1e679f700 1 -- 172.21.15.46:0/3015238146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e01a0020 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.697+0000 7fc1e679f700 1 -- 172.21.15.46:0/3015238146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e0107530 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.697+0000 7fc1de7fc700 1 -- 172.21.15.46:0/3015238146 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fc1d0004820 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.697+0000 7fc1de7fc700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1c806d520 0x7fc1c806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.698+0000 7fc1de7fc700 1 -- 172.21.15.46:0/3015238146 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc1d008e850 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.698+0000 7fc1e4f9c700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1c806d520 0x7fc1c806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.698+0000 7fc1e4f9c700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1c806d520 0x7fc1c806f9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4006fd0 tx=0x7fc1d4008040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.702+0000 7fc1de7fc700 1 -- 172.21.15.46:0/3015238146 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fc1d0058530 con 0x7fc1e00ff9e0 2024-02-19T19:04:45.722 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:45 smithi046 ceph-mon[29647]: pgmap v73: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:45.909 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:45 smithi142 ceph-mon[37169]: pgmap v73: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.997+0000 7fc1e679f700 1 -- 172.21.15.46:0/3015238146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc1e002cc80 con 0x7fc1e00ff9e0 2024-02-19T19:04:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:45.997+0000 7fc1de7fc700 1 -- 172.21.15.46:0/3015238146 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fc1d005bbf0 con 0x7fc1e00ff9e0 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 -- 172.21.15.46:0/3015238146 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1c806d520 msgr2=0x7fc1c806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1c806d520 0x7fc1c806f9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4006fd0 tx=0x7fc1d4008040 comp rx=0 tx=0).stop 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 -- 172.21.15.46:0/3015238146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1e00ff9e0 msgr2=0x7fc1e0196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1e00ff9e0 0x7fc1e0196b20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0000f80 tx=0x7fc1d000cdd0 comp rx=0 tx=0).stop 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 -- 172.21.15.46:0/3015238146 shutdown_connections 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc1c806d520 0x7fc1c806f9d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1e00ff9e0 0x7fc1e0196b20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 --2- 172.21.15.46:0/3015238146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e0102e30 0x7fc1e0197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 -- 172.21.15.46:0/3015238146 >> 172.21.15.46:0/3015238146 conn(0x7fc1e0074fa0 msgr2=0x7fc1e0100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 -- 172.21.15.46:0/3015238146 shutdown_connections 2024-02-19T19:04:46.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:46.000+0000 7fc1e679f700 1 -- 172.21.15.46:0/3015238146 wait complete. 2024-02-19T19:04:46.030 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:04:46.707 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:46 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3015238146' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:46.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-19T19:04:46.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:46 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/3015238146' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:46.939 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:04:47.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:47 smithi046 ceph-mon[29647]: pgmap v74: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:47.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:47 smithi142 ceph-mon[37169]: pgmap v74: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:48.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.940+0000 7f2a0cb92700 1 -- 172.21.15.46:0/160666749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a080ffd60 msgr2=0x7f2a08103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:48.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.940+0000 7f2a0cb92700 1 --2- 172.21.15.46:0/160666749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a080ffd60 0x7f2a08103d30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009910 tx=0x7f29fc009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.941+0000 7f2a0cb92700 1 -- 172.21.15.46:0/160666749 shutdown_connections 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.941+0000 7f2a0cb92700 1 --2- 172.21.15.46:0/160666749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a080ffd60 0x7f2a08103d30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.941+0000 7f2a0cb92700 1 --2- 172.21.15.46:0/160666749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a080ff3c0 0x7f2a080ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.941+0000 7f2a0cb92700 1 -- 172.21.15.46:0/160666749 >> 172.21.15.46:0/160666749 conn(0x7f2a080fac80 msgr2=0x7f2a080fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.941+0000 7f2a0cb92700 1 -- 172.21.15.46:0/160666749 shutdown_connections 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.941+0000 7f2a0cb92700 1 -- 172.21.15.46:0/160666749 wait complete. 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.941+0000 7f2a0cb92700 1 Processor -- start 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.941+0000 7f2a0cb92700 1 -- start start 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a0cb92700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a080ff3c0 0x7f2a08195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a0cb92700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a080ffd60 0x7f2a08196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a0cb92700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08196ae0 con 0x7f2a080ffd60 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a0cb92700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0819a870 con 0x7f2a080ff3c0 2024-02-19T19:04:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a05d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a080ffd60 0x7f2a08196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a05d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a080ffd60 0x7f2a08196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36750/0 (socket says 172.21.15.46:36750) 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a05d9b700 1 -- 172.21.15.46:0/237386278 learned_addr learned my addr 172.21.15.46:0/237386278 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a0659c700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a080ff3c0 0x7f2a08195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a05d9b700 1 -- 172.21.15.46:0/237386278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a080ff3c0 msgr2=0x7f2a08195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a05d9b700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a080ff3c0 0x7f2a08195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a05d9b700 1 -- 172.21.15.46:0/237386278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc0095f0 con 0x7f2a080ffd60 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a05d9b700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a080ffd60 0x7f2a08196400 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0092e0 tx=0x7f29fc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f29f77fe700 1 -- 172.21.15.46:0/237386278 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29fc01d070 con 0x7f2a080ffd60 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f29f77fe700 1 -- 172.21.15.46:0/237386278 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29fc005dc0 con 0x7f2a080ffd60 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f2a0cb92700 1 -- 172.21.15.46:0/237386278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0819aaf0 con 0x7f2a080ffd60 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.942+0000 7f29f77fe700 1 -- 172.21.15.46:0/237386278 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29fc017400 con 0x7f2a080ffd60 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.943+0000 7f2a0cb92700 1 -- 172.21.15.46:0/237386278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0819af90 con 0x7f2a080ffd60 2024-02-19T19:04:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.943+0000 7f2a0cb92700 1 -- 172.21.15.46:0/237386278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0804f2a0 con 0x7f2a080ffd60 2024-02-19T19:04:48.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.944+0000 7f29f77fe700 1 -- 172.21.15.46:0/237386278 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f29fc00f460 con 0x7f2a080ffd60 2024-02-19T19:04:48.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.944+0000 7f29f77fe700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f29f006d570 0x7f29f006fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:48.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.944+0000 7f29f77fe700 1 -- 172.21.15.46:0/237386278 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f29fc08e530 con 0x7f2a080ffd60 2024-02-19T19:04:48.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.944+0000 7f2a0659c700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f29f006d570 0x7f29f006fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:48.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.945+0000 7f2a0659c700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f29f006d570 0x7f29f006fa20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29f8005950 tx=0x7f29f80058e0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:48.949+0000 7f29f77fe700 1 -- 172.21.15.46:0/237386278 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f29fc058170 con 0x7f2a080ffd60 2024-02-19T19:04:49.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:49.175+0000 7f2a0cb92700 1 -- 172.21.15.46:0/237386278 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a0819b330 con 0x7f29f006d570 2024-02-19T19:04:49.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:49 smithi046 ceph-mon[29647]: pgmap v75: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:49.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:49 smithi142 ceph-mon[37169]: pgmap v75: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:50.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:50 smithi046 ceph-mon[29647]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:50.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:50 smithi142 ceph-mon[37169]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:51.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.245+0000 7f29f77fe700 1 -- 172.21.15.46:0/237386278 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5391 (secure 0 0 0) 0x7f2a0819b330 con 0x7f29f006d570 2024-02-19T19:04:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.247+0000 7f2a0cb92700 1 -- 172.21.15.46:0/237386278 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f29f006d570 msgr2=0x7f29f006fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.247+0000 7f2a0cb92700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f29f006d570 0x7f29f006fa20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29f8005950 tx=0x7f29f80058e0 comp rx=0 tx=0).stop 2024-02-19T19:04:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.247+0000 7f2a0cb92700 1 -- 172.21.15.46:0/237386278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a080ffd60 msgr2=0x7f2a08196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.247+0000 7f2a0cb92700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a080ffd60 0x7f2a08196400 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0092e0 tx=0x7f29fc00be20 comp rx=0 tx=0).stop 2024-02-19T19:04:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.247+0000 7f2a0cb92700 1 -- 172.21.15.46:0/237386278 shutdown_connections 2024-02-19T19:04:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.247+0000 7f2a0cb92700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f29f006d570 0x7f29f006fa20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.247+0000 7f2a0cb92700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a080ff3c0 0x7f2a08195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.247+0000 7f2a0cb92700 1 --2- 172.21.15.46:0/237386278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a080ffd60 0x7f2a08196400 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.247+0000 7f2a0cb92700 1 -- 172.21.15.46:0/237386278 >> 172.21.15.46:0/237386278 conn(0x7f2a080fac80 msgr2=0x7f2a080fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.248+0000 7f2a0cb92700 1 -- 172.21.15.46:0/237386278 shutdown_connections 2024-02-19T19:04:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:51.248+0000 7f2a0cb92700 1 -- 172.21.15.46:0/237386278 wait complete. 2024-02-19T19:04:51.278 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:04:51.808 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:51 smithi142 ceph-mon[37169]: pgmap v76: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:51.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:51 smithi046 ceph-mon[29647]: pgmap v76: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:52.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-19T19:04:52.259 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:04:53.757 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:53 smithi046 ceph-mon[29647]: pgmap v77: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:53.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:53 smithi142 ceph-mon[37169]: pgmap v77: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:54.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.134+0000 7f188dee6700 1 -- 172.21.15.46:0/2228952675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18880ffbd0 msgr2=0x7f1888100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:54.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.134+0000 7f188dee6700 1 --2- 172.21.15.46:0/2228952675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18880ffbd0 0x7f1888100040 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1870009910 tx=0x7f1870009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:54.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.134+0000 7f188dee6700 1 -- 172.21.15.46:0/2228952675 shutdown_connections 2024-02-19T19:04:54.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.134+0000 7f188dee6700 1 --2- 172.21.15.46:0/2228952675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18880ffbd0 0x7f1888100040 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:54.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.134+0000 7f188dee6700 1 --2- 172.21.15.46:0/2228952675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1888104130 0x7f1888104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:54.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.134+0000 7f188dee6700 1 -- 172.21.15.46:0/2228952675 >> 172.21.15.46:0/2228952675 conn(0x7f1888075130 msgr2=0x7f1888075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.134+0000 7f188dee6700 1 -- 172.21.15.46:0/2228952675 shutdown_connections 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.134+0000 7f188dee6700 1 -- 172.21.15.46:0/2228952675 wait complete. 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.135+0000 7f188dee6700 1 Processor -- start 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.135+0000 7f188dee6700 1 -- start start 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.135+0000 7f188dee6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18880ffbd0 0x7f1888196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.135+0000 7f188dee6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1888104130 0x7f1888197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.135+0000 7f188dee6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18881977d0 con 0x7f18880ffbd0 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.135+0000 7f188dee6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1888197910 con 0x7f1888104130 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.135+0000 7f18877fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18880ffbd0 0x7f1888196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.135+0000 7f18877fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18880ffbd0 0x7f1888196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36776/0 (socket says 172.21.15.46:36776) 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.135+0000 7f18877fe700 1 -- 172.21.15.46:0/3424813284 learned_addr learned my addr 172.21.15.46:0/3424813284 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f1886ffd700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1888104130 0x7f1888197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f18877fe700 1 -- 172.21.15.46:0/3424813284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1888104130 msgr2=0x7f1888197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:54.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f18877fe700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1888104130 0x7f1888197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f18877fe700 1 -- 172.21.15.46:0/3424813284 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700095f0 con 0x7f18880ffbd0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f1886ffd700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1888104130 0x7f1888197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f18877fe700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18880ffbd0 0x7f1888196c40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f187800c930 tx=0x7f187800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f1884ff9700 1 -- 172.21.15.46:0/3424813284 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1878007ad0 con 0x7f18880ffbd0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f1884ff9700 1 -- 172.21.15.46:0/3424813284 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1878007c30 con 0x7f18880ffbd0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f188dee6700 1 -- 172.21.15.46:0/3424813284 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188819fcb0 con 0x7f18880ffbd0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f1884ff9700 1 -- 172.21.15.46:0/3424813284 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1878018610 con 0x7f18880ffbd0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.136+0000 7f188dee6700 1 -- 172.21.15.46:0/3424813284 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18881a0150 con 0x7f18880ffbd0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.137+0000 7f188dee6700 1 -- 172.21.15.46:0/3424813284 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188804f2a0 con 0x7f18880ffbd0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.138+0000 7f1884ff9700 1 -- 172.21.15.46:0/3424813284 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f18780188a0 con 0x7f18880ffbd0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.138+0000 7f1884ff9700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f187406d520 0x7f187406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.138+0000 7f1884ff9700 1 -- 172.21.15.46:0/3424813284 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f187808d120 con 0x7f18880ffbd0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.138+0000 7f1886ffd700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f187406d520 0x7f187406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:54.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.139+0000 7f1886ffd700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f187406d520 0x7f187406f9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1870005f50 tx=0x7f1870005dc0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:54.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.143+0000 7f1884ff9700 1 -- 172.21.15.46:0/3424813284 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f1878056e70 con 0x7f18880ffbd0 2024-02-19T19:04:54.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.361+0000 7f188dee6700 1 -- 172.21.15.46:0/3424813284 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f18880ff240 con 0x7f187406d520 2024-02-19T19:04:54.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.373+0000 7f1884ff9700 1 -- 172.21.15.46:0/3424813284 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f18880ff240 con 0x7f187406d520 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (74s) 35s ago 11m 16.6M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (11m) 35s ago 11m 7852k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (10m) 107s ago 10m 7680k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (11m) 35s ago 11m 6660k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (10m) 107s ago 10m 6665k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (41s) 35s ago 10m 57.0M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (5m) 35s ago 5m 25.7M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (5m) 35s ago 5m 14.4M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (5m) 107s ago 5m 14.5M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:04:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (5m) 107s ago 5m 22.2M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (2m) 35s ago 13m 498M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (2m) 107s ago 9m 447M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (13m) 35s ago 13m 53.5M 2048M 18.2.0 dc2bc1663786 adb8243bd11c 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (9m) 107s ago 9m 40.8M 2048M 18.2.0 dc2bc1663786 3f6c8b69abc2 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (115s) 35s ago 11m 16.8M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (110s) 107s ago 10m 5486k - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (9m) 35s ago 9m 51.2M 1217M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (8m) 35s ago 8m 50.2M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (8m) 35s ago 8m 51.4M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (7m) 107s ago 7m 48.2M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (7m) 107s ago 7m 46.4M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (6m) 107s ago 6m 47.2M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:04:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (92s) 35s ago 10m 53.0M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:04:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 -- 172.21.15.46:0/3424813284 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f187406d520 msgr2=0x7f187406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f187406d520 0x7f187406f9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1870005f50 tx=0x7f1870005dc0 comp rx=0 tx=0).stop 2024-02-19T19:04:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 -- 172.21.15.46:0/3424813284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18880ffbd0 msgr2=0x7f1888196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18880ffbd0 0x7f1888196c40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f187800c930 tx=0x7f187800ccf0 comp rx=0 tx=0).stop 2024-02-19T19:04:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 -- 172.21.15.46:0/3424813284 shutdown_connections 2024-02-19T19:04:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f187406d520 0x7f187406f9d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18880ffbd0 0x7f1888196c40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 --2- 172.21.15.46:0/3424813284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1888104130 0x7f1888197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 -- 172.21.15.46:0/3424813284 >> 172.21.15.46:0/3424813284 conn(0x7f1888075130 msgr2=0x7f18880feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 -- 172.21.15.46:0/3424813284 shutdown_connections 2024-02-19T19:04:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:54.375+0000 7f188dee6700 1 -- 172.21.15.46:0/3424813284 wait complete. 2024-02-19T19:04:54.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:54 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:54.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:54 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:55.091 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-19T19:04:55.092 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T19:04:55.092 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-02-19T19:04:55.315 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:04:55.698 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:55 smithi046 ceph-mon[29647]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:55.698 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:55 smithi046 ceph-mon[29647]: pgmap v78: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:55.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:55 smithi142 ceph-mon[37169]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:55.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:55 smithi142 ceph-mon[37169]: pgmap v78: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.201+0000 7f516783e700 1 -- 172.21.15.46:0/357271145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5160068540 msgr2=0x7f51600689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.201+0000 7f516783e700 1 --2- 172.21.15.46:0/357271145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5160068540 0x7f51600689b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5154009910 tx=0x7f5154009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.201+0000 7f516783e700 1 -- 172.21.15.46:0/357271145 shutdown_connections 2024-02-19T19:04:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.201+0000 7f516783e700 1 --2- 172.21.15.46:0/357271145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5160068540 0x7f51600689b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.201+0000 7f516783e700 1 --2- 172.21.15.46:0/357271145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5160106320 0x7f51601066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.201+0000 7f516783e700 1 -- 172.21.15.46:0/357271145 >> 172.21.15.46:0/357271145 conn(0x7f5160075130 msgr2=0x7f5160075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.201+0000 7f516783e700 1 -- 172.21.15.46:0/357271145 shutdown_connections 2024-02-19T19:04:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.201+0000 7f516783e700 1 -- 172.21.15.46:0/357271145 wait complete. 2024-02-19T19:04:57.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f516783e700 1 Processor -- start 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f516783e700 1 -- start start 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f516783e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5160068540 0x7f5160195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f516783e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5160106320 0x7f5160196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f516783e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5160196a70 con 0x7f5160106320 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f516783e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516019a800 con 0x7f5160068540 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f5164dd9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5160106320 0x7f5160196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f5164dd9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5160106320 0x7f5160196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36788/0 (socket says 172.21.15.46:36788) 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f5164dd9700 1 -- 172.21.15.46:0/2351669631 learned_addr learned my addr 172.21.15.46:0/2351669631 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f51655da700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5160068540 0x7f5160195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f5164dd9700 1 -- 172.21.15.46:0/2351669631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5160068540 msgr2=0x7f5160195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f5164dd9700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5160068540 0x7f5160195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.202+0000 7f5164dd9700 1 -- 172.21.15.46:0/2351669631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540095f0 con 0x7f5160106320 2024-02-19T19:04:57.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.203+0000 7f5164dd9700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5160106320 0x7f5160196390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5154006010 tx=0x7f515400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.203+0000 7f515e7fc700 1 -- 172.21.15.46:0/2351669631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515401d070 con 0x7f5160106320 2024-02-19T19:04:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.203+0000 7f515e7fc700 1 -- 172.21.15.46:0/2351669631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5154005dc0 con 0x7f5160106320 2024-02-19T19:04:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.203+0000 7f516783e700 1 -- 172.21.15.46:0/2351669631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516019aa80 con 0x7f5160106320 2024-02-19T19:04:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.203+0000 7f515e7fc700 1 -- 172.21.15.46:0/2351669631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5154017400 con 0x7f5160106320 2024-02-19T19:04:57.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.203+0000 7f516783e700 1 -- 172.21.15.46:0/2351669631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516019af70 con 0x7f5160106320 2024-02-19T19:04:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.204+0000 7f516783e700 1 -- 172.21.15.46:0/2351669631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5160108770 con 0x7f5160106320 2024-02-19T19:04:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.204+0000 7f515e7fc700 1 -- 172.21.15.46:0/2351669631 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f5154003a60 con 0x7f5160106320 2024-02-19T19:04:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.205+0000 7f515e7fc700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f514806d520 0x7f514806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.205+0000 7f515e7fc700 1 -- 172.21.15.46:0/2351669631 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f515408e410 con 0x7f5160106320 2024-02-19T19:04:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.205+0000 7f51655da700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f514806d520 0x7f514806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:57.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.205+0000 7f51655da700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f514806d520 0x7f514806f9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5150009550 tx=0x7f51500091b0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:57.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.209+0000 7f515e7fc700 1 -- 172.21.15.46:0/2351669631 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f51540580f0 con 0x7f5160106320 2024-02-19T19:04:57.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.419+0000 7f516783e700 1 -- 172.21.15.46:0/2351669631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f516019b250 con 0x7f5160106320 2024-02-19T19:04:57.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.423+0000 7f515e7fc700 1 -- 172.21.15.46:0/2351669631 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v44)=0 v44) v1 ==== 125+0+0 (secure 0 0 0) 0x7f515405b7b0 con 0x7f5160106320 2024-02-19T19:04:57.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.425+0000 7f516783e700 1 -- 172.21.15.46:0/2351669631 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f514806d520 msgr2=0x7f514806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:57.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.425+0000 7f516783e700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f514806d520 0x7f514806f9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5150009550 tx=0x7f51500091b0 comp rx=0 tx=0).stop 2024-02-19T19:04:57.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.425+0000 7f516783e700 1 -- 172.21.15.46:0/2351669631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5160106320 msgr2=0x7f5160196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:57.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.425+0000 7f516783e700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5160106320 0x7f5160196390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5154006010 tx=0x7f515400bd70 comp rx=0 tx=0).stop 2024-02-19T19:04:57.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.425+0000 7f516783e700 1 -- 172.21.15.46:0/2351669631 shutdown_connections 2024-02-19T19:04:57.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.425+0000 7f516783e700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f514806d520 0x7f514806f9d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:57.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.426+0000 7f516783e700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5160068540 0x7f5160195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:57.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.426+0000 7f516783e700 1 --2- 172.21.15.46:0/2351669631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5160106320 0x7f5160196390 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:57.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.426+0000 7f516783e700 1 -- 172.21.15.46:0/2351669631 >> 172.21.15.46:0/2351669631 conn(0x7f5160075130 msgr2=0x7f51600feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:57.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.426+0000 7f516783e700 1 -- 172.21.15.46:0/2351669631 shutdown_connections 2024-02-19T19:04:57.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:04:57.426+0000 7f516783e700 1 -- 172.21.15.46:0/2351669631 wait complete. 2024-02-19T19:04:57.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:57 smithi046 ceph-mon[29647]: pgmap v79: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:57.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:57 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2351669631' entity='client.admin' 2024-02-19T19:04:57.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:57 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:57.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:57 smithi142 ceph-mon[37169]: pgmap v79: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:57.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:57 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2351669631' entity='client.admin' 2024-02-19T19:04:57.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:57 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:58.360 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-19T19:04:58.361 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T19:04:58.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-19T19:04:58.573 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:04:59.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:58 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:59.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:58 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:59.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:58 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:59.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:58 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:59.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:58 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:59.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:58 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:59.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:58 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:04:59.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:58 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:59.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:58 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:59.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:58 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:00.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:04:59 smithi046 ceph-mon[29647]: pgmap v80: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:00.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.279+0000 7f32f64a5700 1 -- 172.21.15.46:0/2172905863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32f01004e0 msgr2=0x7f32f01008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:00.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.279+0000 7f32f64a5700 1 --2- 172.21.15.46:0/2172905863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32f01004e0 0x7f32f01008b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009910 tx=0x7f32e0009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:00.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.279+0000 7f32f64a5700 1 -- 172.21.15.46:0/2172905863 shutdown_connections 2024-02-19T19:05:00.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.279+0000 7f32f64a5700 1 --2- 172.21.15.46:0/2172905863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0100e80 0x7f32f0104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:00.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.279+0000 7f32f64a5700 1 --2- 172.21.15.46:0/2172905863 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32f01004e0 0x7f32f01008b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:00.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.279+0000 7f32f64a5700 1 -- 172.21.15.46:0/2172905863 >> 172.21.15.46:0/2172905863 conn(0x7f32f00fbda0 msgr2=0x7f32f00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:00.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.279+0000 7f32f64a5700 1 -- 172.21.15.46:0/2172905863 shutdown_connections 2024-02-19T19:05:00.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.279+0000 7f32f64a5700 1 -- 172.21.15.46:0/2172905863 wait complete. 2024-02-19T19:05:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.280+0000 7f32f64a5700 1 Processor -- start 2024-02-19T19:05:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.280+0000 7f32f64a5700 1 -- start start 2024-02-19T19:05:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32f64a5700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32f01004e0 0x7f32f0195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32f64a5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0100e80 0x7f32f01964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32f64a5700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f0196bb0 con 0x7f32f01004e0 2024-02-19T19:05:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32f64a5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f019a940 con 0x7f32f0100e80 2024-02-19T19:05:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32effff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32f01004e0 0x7f32f0195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32effff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32f01004e0 0x7f32f0195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44280/0 (socket says 172.21.15.46:44280) 2024-02-19T19:05:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32effff700 1 -- 172.21.15.46:0/2958184273 learned_addr learned my addr 172.21.15.46:0/2958184273 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:00.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32ef7fe700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0100e80 0x7f32f01964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:00.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32effff700 1 -- 172.21.15.46:0/2958184273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0100e80 msgr2=0x7f32f01964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:00.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32effff700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0100e80 0x7f32f01964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:00.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32effff700 1 -- 172.21.15.46:0/2958184273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e00095f0 con 0x7f32f01004e0 2024-02-19T19:05:00.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.281+0000 7f32effff700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32f01004e0 0x7f32f0195f90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f32e0006010 tx=0x7f32e000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:00.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.282+0000 7f32ed7fa700 1 -- 172.21.15.46:0/2958184273 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32e001d070 con 0x7f32f01004e0 2024-02-19T19:05:00.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.282+0000 7f32f64a5700 1 -- 172.21.15.46:0/2958184273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f019abc0 con 0x7f32f01004e0 2024-02-19T19:05:00.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.282+0000 7f32ed7fa700 1 -- 172.21.15.46:0/2958184273 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32e000f460 con 0x7f32f01004e0 2024-02-19T19:05:00.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.282+0000 7f32ed7fa700 1 -- 172.21.15.46:0/2958184273 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32e0017610 con 0x7f32f01004e0 2024-02-19T19:05:00.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.282+0000 7f32f64a5700 1 -- 172.21.15.46:0/2958184273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f019b0b0 con 0x7f32f01004e0 2024-02-19T19:05:00.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.283+0000 7f32f64a5700 1 -- 172.21.15.46:0/2958184273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f01087f0 con 0x7f32f01004e0 2024-02-19T19:05:00.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.283+0000 7f32ed7fa700 1 -- 172.21.15.46:0/2958184273 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f32e000f5d0 con 0x7f32f01004e0 2024-02-19T19:05:00.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.283+0000 7f32ed7fa700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f32d806d520 0x7f32d806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:00.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.284+0000 7f32ed7fa700 1 -- 172.21.15.46:0/2958184273 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f32e008e4c0 con 0x7f32f01004e0 2024-02-19T19:05:00.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.284+0000 7f32ef7fe700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f32d806d520 0x7f32d806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:00.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.284+0000 7f32ef7fe700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f32d806d520 0x7f32d806f9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32f01975b0 tx=0x7f32e4009190 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:00.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.289+0000 7f32ed7fa700 1 -- 172.21.15.46:0/2958184273 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f32e00581a0 con 0x7f32f01004e0 2024-02-19T19:05:00.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:04:59 smithi142 ceph-mon[37169]: pgmap v80: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:00.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.494+0000 7f32f64a5700 1 -- 172.21.15.46:0/2958184273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f32f004f2a0 con 0x7f32f01004e0 2024-02-19T19:05:00.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.494+0000 7f32ed7fa700 1 -- 172.21.15.46:0/2958184273 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v44)=0 v44) v1 ==== 155+0+0 (secure 0 0 0) 0x7f32e005b860 con 0x7f32f01004e0 2024-02-19T19:05:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.496+0000 7f32f64a5700 1 -- 172.21.15.46:0/2958184273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f32d806d520 msgr2=0x7f32d806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.496+0000 7f32f64a5700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f32d806d520 0x7f32d806f9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32f01975b0 tx=0x7f32e4009190 comp rx=0 tx=0).stop 2024-02-19T19:05:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.496+0000 7f32f64a5700 1 -- 172.21.15.46:0/2958184273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32f01004e0 msgr2=0x7f32f0195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.496+0000 7f32f64a5700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32f01004e0 0x7f32f0195f90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f32e0006010 tx=0x7f32e000bd70 comp rx=0 tx=0).stop 2024-02-19T19:05:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.497+0000 7f32f64a5700 1 -- 172.21.15.46:0/2958184273 shutdown_connections 2024-02-19T19:05:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.497+0000 7f32f64a5700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f32d806d520 0x7f32d806f9d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.497+0000 7f32f64a5700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32f01004e0 0x7f32f0195f90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.497+0000 7f32f64a5700 1 --2- 172.21.15.46:0/2958184273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32f0100e80 0x7f32f01964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.497+0000 7f32f64a5700 1 -- 172.21.15.46:0/2958184273 >> 172.21.15.46:0/2958184273 conn(0x7f32f00fbda0 msgr2=0x7f32f00fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.497+0000 7f32f64a5700 1 -- 172.21.15.46:0/2958184273 shutdown_connections 2024-02-19T19:05:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:00.497+0000 7f32f64a5700 1 -- 172.21.15.46:0/2958184273 wait complete. 2024-02-19T19:05:01.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-19T19:05:01.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:01 smithi142 ceph-mon[37169]: pgmap v81: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:01.498 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:05:01.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:01 smithi046 ceph-mon[29647]: pgmap v81: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:03.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.247+0000 7f8fd939e700 1 -- 172.21.15.46:0/693403240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fd41004e0 msgr2=0x7f8fd41008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:03.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.247+0000 7f8fd939e700 1 --2- 172.21.15.46:0/693403240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fd41004e0 0x7f8fd41008b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009910 tx=0x7f8fc4009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.248+0000 7f8fd939e700 1 -- 172.21.15.46:0/693403240 shutdown_connections 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.248+0000 7f8fd939e700 1 --2- 172.21.15.46:0/693403240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fd4100e80 0x7f8fd4104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.248+0000 7f8fd939e700 1 --2- 172.21.15.46:0/693403240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fd41004e0 0x7f8fd41008b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.248+0000 7f8fd939e700 1 -- 172.21.15.46:0/693403240 >> 172.21.15.46:0/693403240 conn(0x7f8fd40fbda0 msgr2=0x7f8fd40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.248+0000 7f8fd939e700 1 -- 172.21.15.46:0/693403240 shutdown_connections 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.248+0000 7f8fd939e700 1 -- 172.21.15.46:0/693403240 wait complete. 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.248+0000 7f8fd939e700 1 Processor -- start 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.248+0000 7f8fd939e700 1 -- start start 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd939e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fd41004e0 0x7f8fd4195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd939e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fd4100e80 0x7f8fd41964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd939e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd4196bb0 con 0x7f8fd41004e0 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd939e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd419a940 con 0x7f8fd4100e80 2024-02-19T19:05:03.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fd41004e0 0x7f8fd4195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fd41004e0 0x7f8fd4195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44302/0 (socket says 172.21.15.46:44302) 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd2ffd700 1 -- 172.21.15.46:0/3754683534 learned_addr learned my addr 172.21.15.46:0/3754683534 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd2ffd700 1 -- 172.21.15.46:0/3754683534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fd4100e80 msgr2=0x7f8fd41964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd2ffd700 1 --2- 172.21.15.46:0/3754683534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fd4100e80 0x7f8fd41964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd2ffd700 1 -- 172.21.15.46:0/3754683534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40095f0 con 0x7f8fd41004e0 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd2ffd700 1 --2- 172.21.15.46:0/3754683534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fd41004e0 0x7f8fd4195f90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4006010 tx=0x7f8fc400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fbbfff700 1 -- 172.21.15.46:0/3754683534 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fc401d070 con 0x7f8fd41004e0 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fbbfff700 1 -- 172.21.15.46:0/3754683534 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8fc4004fb0 con 0x7f8fd41004e0 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fd939e700 1 -- 172.21.15.46:0/3754683534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd419abc0 con 0x7f8fd41004e0 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.249+0000 7f8fbbfff700 1 -- 172.21.15.46:0/3754683534 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fc4022ea0 con 0x7f8fd41004e0 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.250+0000 7f8fd939e700 1 -- 172.21.15.46:0/3754683534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd419b0b0 con 0x7f8fd41004e0 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.251+0000 7f8fd939e700 1 -- 172.21.15.46:0/3754683534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd41087f0 con 0x7f8fd41004e0 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.251+0000 7f8fbbfff700 1 -- 172.21.15.46:0/3754683534 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f8fc4022470 con 0x7f8fd41004e0 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.252+0000 7f8fbbfff700 1 --2- 172.21.15.46:0/3754683534 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f8fbc06d520 0x7f8fbc06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:03.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.252+0000 7f8fbbfff700 1 -- 172.21.15.46:0/3754683534 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8fc408e6b0 con 0x7f8fd41004e0 2024-02-19T19:05:03.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.252+0000 7f8fd27fc700 1 --2- 172.21.15.46:0/3754683534 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f8fbc06d520 0x7f8fbc06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:03.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.252+0000 7f8fd27fc700 1 --2- 172.21.15.46:0/3754683534 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f8fbc06d520 0x7f8fbc06f9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8fd41975b0 tx=0x7f8fc8006d20 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:03.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.256+0000 7f8fbbfff700 1 -- 172.21.15.46:0/3754683534 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f8fc4058500 con 0x7f8fd41004e0 2024-02-19T19:05:03.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.465+0000 7f8fd939e700 1 -- 172.21.15.46:0/3754683534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f8fd404f2a0 con 0x7f8fd41004e0 2024-02-19T19:05:03.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.465+0000 7f8fbbfff700 1 -- 172.21.15.46:0/3754683534 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v44)=0 v44) v1 ==== 163+0+0 (secure 0 0 0) 0x7f8fc4022720 con 0x7f8fd41004e0 2024-02-19T19:05:03.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 -- 172.21.15.46:0/3754683534 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f8fbc06d520 msgr2=0x7f8fbc06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:03.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 --2- 172.21.15.46:0/3754683534 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f8fbc06d520 0x7f8fbc06f9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8fd41975b0 tx=0x7f8fc8006d20 comp rx=0 tx=0).stop 2024-02-19T19:05:03.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 -- 172.21.15.46:0/3754683534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fd41004e0 msgr2=0x7f8fd4195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:03.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 --2- 172.21.15.46:0/3754683534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fd41004e0 0x7f8fd4195f90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4006010 tx=0x7f8fc400be20 comp rx=0 tx=0).stop 2024-02-19T19:05:03.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 -- 172.21.15.46:0/3754683534 shutdown_connections 2024-02-19T19:05:03.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 --2- 172.21.15.46:0/3754683534 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f8fbc06d520 0x7f8fbc06f9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:03.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 --2- 172.21.15.46:0/3754683534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fd41004e0 0x7f8fd4195f90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:03.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 --2- 172.21.15.46:0/3754683534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fd4100e80 0x7f8fd41964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:03.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 -- 172.21.15.46:0/3754683534 >> 172.21.15.46:0/3754683534 conn(0x7f8fd40fbda0 msgr2=0x7f8fd40fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:03.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 -- 172.21.15.46:0/3754683534 shutdown_connections 2024-02-19T19:05:03.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:03.467+0000 7f8fd939e700 1 -- 172.21.15.46:0/3754683534 wait complete. 2024-02-19T19:05:03.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:03 smithi046 ceph-mon[29647]: pgmap v82: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:03.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:03 smithi142 ceph-mon[37169]: pgmap v82: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:04.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-19T19:05:04.484 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:05:05.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:05 smithi046 ceph-mon[29647]: pgmap v83: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:05.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:05 smithi142 ceph-mon[37169]: pgmap v83: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.206+0000 7f75220b3700 1 -- 172.21.15.46:0/1864352736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751c1004e0 msgr2=0x7f751c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.206+0000 7f75220b3700 1 --2- 172.21.15.46:0/1864352736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751c1004e0 0x7f751c1008b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f750c00b0a0 tx=0x7f750c00b3b0 comp rx=0 tx=0).stop 2024-02-19T19:05:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.206+0000 7f75220b3700 1 -- 172.21.15.46:0/1864352736 shutdown_connections 2024-02-19T19:05:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.206+0000 7f75220b3700 1 --2- 172.21.15.46:0/1864352736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f751c100e80 0x7f751c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.206+0000 7f75220b3700 1 --2- 172.21.15.46:0/1864352736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751c1004e0 0x7f751c1008b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.206+0000 7f75220b3700 1 -- 172.21.15.46:0/1864352736 >> 172.21.15.46:0/1864352736 conn(0x7f751c0fbda0 msgr2=0x7f751c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.206+0000 7f75220b3700 1 -- 172.21.15.46:0/1864352736 shutdown_connections 2024-02-19T19:05:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.206+0000 7f75220b3700 1 -- 172.21.15.46:0/1864352736 wait complete. 2024-02-19T19:05:06.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f75220b3700 1 Processor -- start 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f75220b3700 1 -- start start 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f75220b3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f751c1004e0 0x7f751c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f75220b3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751c100e80 0x7f751c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f75220b3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c073ad0 con 0x7f751c100e80 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f75220b3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c073c10 con 0x7f751c1004e0 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f751affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751c100e80 0x7f751c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f751affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751c100e80 0x7f751c073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44312/0 (socket says 172.21.15.46:44312) 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f751affd700 1 -- 172.21.15.46:0/3132777449 learned_addr learned my addr 172.21.15.46:0/3132777449 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f751b7fe700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f751c1004e0 0x7f751c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f751affd700 1 -- 172.21.15.46:0/3132777449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f751c1004e0 msgr2=0x7f751c073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f751affd700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f751c1004e0 0x7f751c073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.207+0000 7f751affd700 1 -- 172.21.15.46:0/3132777449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c009d00 con 0x7f751c100e80 2024-02-19T19:05:06.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.208+0000 7f751affd700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751c100e80 0x7f751c073590 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f751000d900 tx=0x7f751000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:06.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.208+0000 7f7518ff9700 1 -- 172.21.15.46:0/3132777449 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7510009900 con 0x7f751c100e80 2024-02-19T19:05:06.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.208+0000 7f7518ff9700 1 -- 172.21.15.46:0/3132777449 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7510010460 con 0x7f751c100e80 2024-02-19T19:05:06.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.208+0000 7f75220b3700 1 -- 172.21.15.46:0/3132777449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c1a20c0 con 0x7f751c100e80 2024-02-19T19:05:06.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.208+0000 7f7518ff9700 1 -- 172.21.15.46:0/3132777449 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f751000f5f0 con 0x7f751c100e80 2024-02-19T19:05:06.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.208+0000 7f75220b3700 1 -- 172.21.15.46:0/3132777449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c1a24d0 con 0x7f751c100e80 2024-02-19T19:05:06.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.209+0000 7f75220b3700 1 -- 172.21.15.46:0/3132777449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c1087f0 con 0x7f751c100e80 2024-02-19T19:05:06.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.209+0000 7f7518ff9700 1 -- 172.21.15.46:0/3132777449 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f75100105d0 con 0x7f751c100e80 2024-02-19T19:05:06.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.210+0000 7f7518ff9700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f750406d520 0x7f750406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:06.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.210+0000 7f7518ff9700 1 -- 172.21.15.46:0/3132777449 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f751008cb20 con 0x7f751c100e80 2024-02-19T19:05:06.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.210+0000 7f751b7fe700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f750406d520 0x7f750406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:06.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.210+0000 7f751b7fe700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f750406d520 0x7f750406f9d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f750c000f80 tx=0x7f750c0060c0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:06.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.214+0000 7f7518ff9700 1 -- 172.21.15.46:0/3132777449 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f7510056800 con 0x7f751c100e80 2024-02-19T19:05:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.420+0000 7f75220b3700 1 -- 172.21.15.46:0/3132777449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f751c04f2a0 con 0x7f751c100e80 2024-02-19T19:05:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.420+0000 7f7518ff9700 1 -- 172.21.15.46:0/3132777449 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v44)=0 v44) v1 ==== 135+0+0 (secure 0 0 0) 0x7f7510059ec0 con 0x7f751c100e80 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.422+0000 7f75220b3700 1 -- 172.21.15.46:0/3132777449 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f750406d520 msgr2=0x7f750406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.422+0000 7f75220b3700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f750406d520 0x7f750406f9d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f750c000f80 tx=0x7f750c0060c0 comp rx=0 tx=0).stop 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.422+0000 7f75220b3700 1 -- 172.21.15.46:0/3132777449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751c100e80 msgr2=0x7f751c073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.422+0000 7f75220b3700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751c100e80 0x7f751c073590 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f751000d900 tx=0x7f751000dc10 comp rx=0 tx=0).stop 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.422+0000 7f75220b3700 1 -- 172.21.15.46:0/3132777449 shutdown_connections 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.422+0000 7f75220b3700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f750406d520 0x7f750406f9d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.422+0000 7f75220b3700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f751c1004e0 0x7f751c073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.422+0000 7f75220b3700 1 --2- 172.21.15.46:0/3132777449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f751c100e80 0x7f751c073590 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.422+0000 7f75220b3700 1 -- 172.21.15.46:0/3132777449 >> 172.21.15.46:0/3132777449 conn(0x7f751c0fbda0 msgr2=0x7f751c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.423+0000 7f75220b3700 1 -- 172.21.15.46:0/3132777449 shutdown_connections 2024-02-19T19:05:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:06.423+0000 7f75220b3700 1 -- 172.21.15.46:0/3132777449 wait complete. 2024-02-19T19:05:07.203 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-19T19:05:07.413 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:05:07.803 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:07 smithi046 ceph-mon[29647]: pgmap v84: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:07.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:07 smithi142 ceph-mon[37169]: pgmap v84: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.372+0000 7f3b72b07700 1 -- 172.21.15.46:0/3927324388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b6c101420 msgr2=0x7f3b6c1017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.372+0000 7f3b72b07700 1 --2- 172.21.15.46:0/3927324388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b6c101420 0x7f3b6c1017f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009910 tx=0x7f3b60009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.372+0000 7f3b72b07700 1 -- 172.21.15.46:0/3927324388 shutdown_connections 2024-02-19T19:05:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.372+0000 7f3b72b07700 1 --2- 172.21.15.46:0/3927324388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b6c101d30 0x7f3b6c10a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.372+0000 7f3b72b07700 1 --2- 172.21.15.46:0/3927324388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b6c101420 0x7f3b6c1017f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.372+0000 7f3b72b07700 1 -- 172.21.15.46:0/3927324388 >> 172.21.15.46:0/3927324388 conn(0x7f3b6c0fac60 msgr2=0x7f3b6c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:09.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.372+0000 7f3b72b07700 1 -- 172.21.15.46:0/3927324388 shutdown_connections 2024-02-19T19:05:09.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.372+0000 7f3b72b07700 1 -- 172.21.15.46:0/3927324388 wait complete. 2024-02-19T19:05:09.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.372+0000 7f3b72b07700 1 Processor -- start 2024-02-19T19:05:09.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.372+0000 7f3b72b07700 1 -- start start 2024-02-19T19:05:09.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b72b07700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b6c101420 0x7f3b6c195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b72b07700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b6c101d30 0x7f3b6c1964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b72b07700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c196ba0 con 0x7f3b6c101d30 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b72b07700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c19a930 con 0x7f3b6c101420 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b6c101d30 0x7f3b6c1964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b6c101d30 0x7f3b6c1964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60790/0 (socket says 172.21.15.46:60790) 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b6bfff700 1 -- 172.21.15.46:0/4051931273 learned_addr learned my addr 172.21.15.46:0/4051931273 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b708a3700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b6c101420 0x7f3b6c195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b6bfff700 1 -- 172.21.15.46:0/4051931273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b6c101420 msgr2=0x7f3b6c195f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b6bfff700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b6c101420 0x7f3b6c195f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b6bfff700 1 -- 172.21.15.46:0/4051931273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b600095f0 con 0x7f3b6c101d30 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.373+0000 7f3b6bfff700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b6c101d30 0x7f3b6c1964c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800b4b0 tx=0x7f3b5800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.374+0000 7f3b69ffb700 1 -- 172.21.15.46:0/4051931273 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b58011800 con 0x7f3b6c101d30 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.374+0000 7f3b69ffb700 1 -- 172.21.15.46:0/4051931273 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b58011e20 con 0x7f3b6c101d30 2024-02-19T19:05:09.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.374+0000 7f3b72b07700 1 -- 172.21.15.46:0/4051931273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c19ac10 con 0x7f3b6c101d30 2024-02-19T19:05:09.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.374+0000 7f3b69ffb700 1 -- 172.21.15.46:0/4051931273 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b5800f2e0 con 0x7f3b6c101d30 2024-02-19T19:05:09.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.374+0000 7f3b72b07700 1 -- 172.21.15.46:0/4051931273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c19b160 con 0x7f3b6c101d30 2024-02-19T19:05:09.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.375+0000 7f3b72b07700 1 -- 172.21.15.46:0/4051931273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6c1078e0 con 0x7f3b6c101d30 2024-02-19T19:05:09.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.375+0000 7f3b69ffb700 1 -- 172.21.15.46:0/4051931273 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f3b58010380 con 0x7f3b6c101d30 2024-02-19T19:05:09.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.375+0000 7f3b69ffb700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f3b5c06d520 0x7f3b5c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:09.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.376+0000 7f3b69ffb700 1 -- 172.21.15.46:0/4051931273 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3b5808ca90 con 0x7f3b6c101d30 2024-02-19T19:05:09.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.376+0000 7f3b708a3700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f3b5c06d520 0x7f3b5c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:09.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.376+0000 7f3b708a3700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f3b5c06d520 0x7f3b5c06f9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b60006010 tx=0x7f3b6001a040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:09.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.380+0000 7f3b69ffb700 1 -- 172.21.15.46:0/4051931273 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f3b58056770 con 0x7f3b6c101d30 2024-02-19T19:05:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.611+0000 7f3b72b07700 1 -- 172.21.15.46:0/4051931273 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b6c19b3e0 con 0x7f3b5c06d520 2024-02-19T19:05:09.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.617+0000 7f3b69ffb700 1 -- 172.21.15.46:0/4051931273 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f3b6c19b3e0 con 0x7f3b5c06d520 2024-02-19T19:05:09.637 INFO:teuthology.orchestra.run.smithi046.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:05:09.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 -- 172.21.15.46:0/4051931273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f3b5c06d520 msgr2=0x7f3b5c06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:09.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f3b5c06d520 0x7f3b5c06f9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b60006010 tx=0x7f3b6001a040 comp rx=0 tx=0).stop 2024-02-19T19:05:09.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 -- 172.21.15.46:0/4051931273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b6c101d30 msgr2=0x7f3b6c1964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:09.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b6c101d30 0x7f3b6c1964c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800b4b0 tx=0x7f3b5800b7c0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 -- 172.21.15.46:0/4051931273 shutdown_connections 2024-02-19T19:05:09.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f3b5c06d520 0x7f3b5c06f9d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b6c101420 0x7f3b6c195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 --2- 172.21.15.46:0/4051931273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b6c101d30 0x7f3b6c1964c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 -- 172.21.15.46:0/4051931273 >> 172.21.15.46:0/4051931273 conn(0x7f3b6c0fac60 msgr2=0x7f3b6c104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 -- 172.21.15.46:0/4051931273 shutdown_connections 2024-02-19T19:05:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:09.619+0000 7f3b72b07700 1 -- 172.21.15.46:0/4051931273 wait complete. 2024-02-19T19:05:09.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:09 smithi046 ceph-mon[29647]: pgmap v85: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:09.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:09 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:09.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:09 smithi142 ceph-mon[37169]: pgmap v85: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:09.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:09 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:10.361 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-19T19:05:10.362 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T19:05:10.362 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-19T19:05:10.587 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:05:10.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:10 smithi142 ceph-mon[37169]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:10.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:10 smithi142 ceph-mon[37169]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:05:10.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:10 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:10.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:10 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:10.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:10 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:10.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:10 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:10.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:10 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:10.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:10 smithi142 ceph-mon[37169]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:05:10.958 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:10 smithi046 ceph-mon[29647]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:10.958 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:10 smithi046 ceph-mon[29647]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:05:10.958 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:10 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:10.958 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:10 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:10.958 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:10 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:10.958 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:10 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:10.958 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:10 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:10.958 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:10 smithi046 ceph-mon[29647]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:05:11.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:11 smithi046 ceph-mon[29647]: pgmap v86: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:11.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:11 smithi142 ceph-mon[37169]: pgmap v86: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.988+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1201873955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c00ffd50 msgr2=0x7ff1c0103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.988+0000 7ff1c6e82700 1 --2- 172.21.15.46:0/1201873955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c00ffd50 0x7ff1c0103d20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009910 tx=0x7ff1ac009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.988+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1201873955 shutdown_connections 2024-02-19T19:05:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.988+0000 7ff1c6e82700 1 --2- 172.21.15.46:0/1201873955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c00ffd50 0x7ff1c0103d20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.988+0000 7ff1c6e82700 1 --2- 172.21.15.46:0/1201873955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1c00ff3b0 0x7ff1c00ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.988+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1201873955 >> 172.21.15.46:0/1201873955 conn(0x7ff1c00fac90 msgr2=0x7ff1c00fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.988+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1201873955 shutdown_connections 2024-02-19T19:05:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.989+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1201873955 wait complete. 2024-02-19T19:05:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.989+0000 7ff1c6e82700 1 Processor -- start 2024-02-19T19:05:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.989+0000 7ff1c6e82700 1 -- start start 2024-02-19T19:05:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c6e82700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c00ff3b0 0x7ff1c0196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c6e82700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1c00ffd50 0x7ff1c0197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c6e82700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c01979a0 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c6e82700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0197ae0 con 0x7ff1c00ffd50 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c4c1e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c00ff3b0 0x7ff1c0196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c4c1e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c00ff3b0 0x7ff1c0196e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60814/0 (socket says 172.21.15.46:60814) 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c4c1e700 1 -- 172.21.15.46:0/1013530543 learned_addr learned my addr 172.21.15.46:0/1013530543 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1bffff700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1c00ffd50 0x7ff1c0197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c4c1e700 1 -- 172.21.15.46:0/1013530543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1c00ffd50 msgr2=0x7ff1c0197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c4c1e700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1c00ffd50 0x7ff1c0197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c4c1e700 1 -- 172.21.15.46:0/1013530543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0095f0 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c4c1e700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c00ff3b0 0x7ff1c0196e40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400b4b0 tx=0x7ff1b400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1bdffb700 1 -- 172.21.15.46:0/1013530543 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1b4011800 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1013530543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c019feb0 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1bdffb700 1 -- 172.21.15.46:0/1013530543 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1b4011e20 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.990+0000 7ff1bdffb700 1 -- 172.21.15.46:0/1013530543 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1b400f2e0 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.991+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1013530543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c0194e00 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.992+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1013530543 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c0107650 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.992+0000 7ff1bdffb700 1 -- 172.21.15.46:0/1013530543 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7ff1b4010380 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.993+0000 7ff1bdffb700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff1b0071930 0x7ff1b0073de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.993+0000 7ff1bdffb700 1 -- 172.21.15.46:0/1013530543 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff1b408ca20 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.993+0000 7ff1bffff700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff1b0071930 0x7ff1b0073de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.993+0000 7ff1bffff700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff1b0071930 0x7ff1b0073de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009fd0 tx=0x7ff1ac01a040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:13.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:12.997+0000 7ff1bdffb700 1 -- 172.21.15.46:0/1013530543 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7ff1b4056700 con 0x7ff1c00ff3b0 2024-02-19T19:05:13.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.227+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1013530543 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1c0061190 con 0x7ff1b0071930 2024-02-19T19:05:13.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.228+0000 7ff1bdffb700 1 -- 172.21.15.46:0/1013530543 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7ff1c0061190 con 0x7ff1b0071930 2024-02-19T19:05:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.230+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1013530543 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff1b0071930 msgr2=0x7ff1b0073de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.231+0000 7ff1c6e82700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff1b0071930 0x7ff1b0073de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009fd0 tx=0x7ff1ac01a040 comp rx=0 tx=0).stop 2024-02-19T19:05:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.231+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1013530543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c00ff3b0 msgr2=0x7ff1c0196e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.231+0000 7ff1c6e82700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c00ff3b0 0x7ff1c0196e40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400b4b0 tx=0x7ff1b400b7c0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.231+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1013530543 shutdown_connections 2024-02-19T19:05:13.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.231+0000 7ff1c6e82700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7ff1b0071930 0x7ff1b0073de0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.231+0000 7ff1c6e82700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff1c00ff3b0 0x7ff1c0196e40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.231+0000 7ff1c6e82700 1 --2- 172.21.15.46:0/1013530543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1c00ffd50 0x7ff1c0197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.231+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1013530543 >> 172.21.15.46:0/1013530543 conn(0x7ff1c00fac90 msgr2=0x7ff1c00fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.231+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1013530543 shutdown_connections 2024-02-19T19:05:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.231+0000 7ff1c6e82700 1 -- 172.21.15.46:0/1013530543 wait complete. 2024-02-19T19:05:13.261 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:05:13.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.337+0000 7f943105e700 1 -- 172.21.15.46:0/319486003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f942c1004e0 msgr2=0x7f942c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.337+0000 7f943105e700 1 --2- 172.21.15.46:0/319486003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f942c1004e0 0x7f942c1008b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f941c009910 tx=0x7f941c009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:13.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.338+0000 7f943105e700 1 -- 172.21.15.46:0/319486003 shutdown_connections 2024-02-19T19:05:13.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.338+0000 7f943105e700 1 --2- 172.21.15.46:0/319486003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c100e80 0x7f942c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.338+0000 7f943105e700 1 --2- 172.21.15.46:0/319486003 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f942c1004e0 0x7f942c1008b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.338+0000 7f943105e700 1 -- 172.21.15.46:0/319486003 >> 172.21.15.46:0/319486003 conn(0x7f942c0fbda0 msgr2=0x7f942c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:13.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.338+0000 7f943105e700 1 -- 172.21.15.46:0/319486003 shutdown_connections 2024-02-19T19:05:13.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.338+0000 7f943105e700 1 -- 172.21.15.46:0/319486003 wait complete. 2024-02-19T19:05:13.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.338+0000 7f943105e700 1 Processor -- start 2024-02-19T19:05:13.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.338+0000 7f943105e700 1 -- start start 2024-02-19T19:05:13.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f943105e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f942c1004e0 0x7f942c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:13.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f943105e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c100e80 0x7f942c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:13.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f943105e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c073ad0 con 0x7f942c1004e0 2024-02-19T19:05:13.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f943105e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c073c10 con 0x7f942c100e80 2024-02-19T19:05:13.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f942ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f942c1004e0 0x7f942c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:13.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f942ad9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f942c1004e0 0x7f942c073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60820/0 (socket says 172.21.15.46:60820) 2024-02-19T19:05:13.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f942ad9d700 1 -- 172.21.15.46:0/3174008827 learned_addr learned my addr 172.21.15.46:0/3174008827 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f942a59c700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c100e80 0x7f942c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f942ad9d700 1 -- 172.21.15.46:0/3174008827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c100e80 msgr2=0x7f942c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f942ad9d700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c100e80 0x7f942c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f942ad9d700 1 -- 172.21.15.46:0/3174008827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0095f0 con 0x7f942c1004e0 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.339+0000 7f942ad9d700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f942c1004e0 0x7f942c073050 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f941c006010 tx=0x7f941c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.340+0000 7f9413fff700 1 -- 172.21.15.46:0/3174008827 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f941c01d070 con 0x7f942c1004e0 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.340+0000 7f943105e700 1 -- 172.21.15.46:0/3174008827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942c073e90 con 0x7f942c1004e0 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.340+0000 7f9413fff700 1 -- 172.21.15.46:0/3174008827 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f941c00f460 con 0x7f942c1004e0 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.340+0000 7f9413fff700 1 -- 172.21.15.46:0/3174008827 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f941c017630 con 0x7f942c1004e0 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.340+0000 7f943105e700 1 -- 172.21.15.46:0/3174008827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c1a2490 con 0x7f942c1004e0 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.341+0000 7f943105e700 1 -- 172.21.15.46:0/3174008827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f942c1087f0 con 0x7f942c1004e0 2024-02-19T19:05:13.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.341+0000 7f9413fff700 1 -- 172.21.15.46:0/3174008827 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f941c00f5d0 con 0x7f942c1004e0 2024-02-19T19:05:13.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.342+0000 7f9413fff700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f941406d520 0x7f941406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:13.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.342+0000 7f9413fff700 1 -- 172.21.15.46:0/3174008827 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f941c08e490 con 0x7f942c1004e0 2024-02-19T19:05:13.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.342+0000 7f942a59c700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f941406d520 0x7f941406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:13.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.342+0000 7f942a59c700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f941406d520 0x7f941406f9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f942c074840 tx=0x7f9420009190 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:13.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.346+0000 7f9413fff700 1 -- 172.21.15.46:0/3174008827 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f941c058170 con 0x7f942c1004e0 2024-02-19T19:05:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.583+0000 7f943105e700 1 -- 172.21.15.46:0/3174008827 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f942c061190 con 0x7f941406d520 2024-02-19T19:05:13.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.584+0000 7f9413fff700 1 -- 172.21.15.46:0/3174008827 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f942c061190 con 0x7f941406d520 2024-02-19T19:05:13.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.586+0000 7f943105e700 1 -- 172.21.15.46:0/3174008827 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f941406d520 msgr2=0x7f941406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.586+0000 7f943105e700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f941406d520 0x7f941406f9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f942c074840 tx=0x7f9420009190 comp rx=0 tx=0).stop 2024-02-19T19:05:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.586+0000 7f943105e700 1 -- 172.21.15.46:0/3174008827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f942c1004e0 msgr2=0x7f942c073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.586+0000 7f943105e700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f942c1004e0 0x7f942c073050 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f941c006010 tx=0x7f941c00bd70 comp rx=0 tx=0).stop 2024-02-19T19:05:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.586+0000 7f943105e700 1 -- 172.21.15.46:0/3174008827 shutdown_connections 2024-02-19T19:05:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.586+0000 7f943105e700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f941406d520 0x7f941406f9d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.586+0000 7f943105e700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f942c1004e0 0x7f942c073050 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.586+0000 7f943105e700 1 --2- 172.21.15.46:0/3174008827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c100e80 0x7f942c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.586+0000 7f943105e700 1 -- 172.21.15.46:0/3174008827 >> 172.21.15.46:0/3174008827 conn(0x7f942c0fbda0 msgr2=0x7f942c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.587+0000 7f943105e700 1 -- 172.21.15.46:0/3174008827 shutdown_connections 2024-02-19T19:05:13.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.587+0000 7f943105e700 1 -- 172.21.15.46:0/3174008827 wait complete. 2024-02-19T19:05:13.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.695+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/650535625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aa80ffd60 msgr2=0x7f4aa8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.695+0000 7f4aaf3b7700 1 --2- 172.21.15.46:0/650535625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aa80ffd60 0x7f4aa8103d30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009910 tx=0x7f4a98009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.696+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/650535625 shutdown_connections 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.696+0000 7f4aaf3b7700 1 --2- 172.21.15.46:0/650535625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aa80ffd60 0x7f4aa8103d30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.696+0000 7f4aaf3b7700 1 --2- 172.21.15.46:0/650535625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa80ff3c0 0x7f4aa80ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.696+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/650535625 >> 172.21.15.46:0/650535625 conn(0x7f4aa80fac80 msgr2=0x7f4aa80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.696+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/650535625 shutdown_connections 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.696+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/650535625 wait complete. 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.696+0000 7f4aaf3b7700 1 Processor -- start 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.696+0000 7f4aaf3b7700 1 -- start start 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.696+0000 7f4aaf3b7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa80ff3c0 0x7f4aa8196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aaf3b7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aa80ffd60 0x7f4aa81973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aaf3b7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa81979c0 con 0x7f4aa80ffd60 2024-02-19T19:05:13.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aaf3b7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8197b00 con 0x7f4aa80ff3c0 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aac952700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aa80ffd60 0x7f4aa81973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aac952700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aa80ffd60 0x7f4aa81973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60840/0 (socket says 172.21.15.46:60840) 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aac952700 1 -- 172.21.15.46:0/1642677351 learned_addr learned my addr 172.21.15.46:0/1642677351 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aad153700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa80ff3c0 0x7f4aa8196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aac952700 1 -- 172.21.15.46:0/1642677351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa80ff3c0 msgr2=0x7f4aa8196e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aac952700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa80ff3c0 0x7f4aa8196e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aac952700 1 -- 172.21.15.46:0/1642677351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a980095f0 con 0x7f4aa80ffd60 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aac952700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aa80ffd60 0x7f4aa81973a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800bd70 tx=0x7f4a9800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4a9e7fc700 1 -- 172.21.15.46:0/1642677351 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a9801d070 con 0x7f4aa80ffd60 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/1642677351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa819fed0 con 0x7f4aa80ffd60 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4a9e7fc700 1 -- 172.21.15.46:0/1642677351 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a9800f460 con 0x7f4aa80ffd60 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/1642677351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa81a02e0 con 0x7f4aa80ffd60 2024-02-19T19:05:13.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.697+0000 7f4a9e7fc700 1 -- 172.21.15.46:0/1642677351 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a98017630 con 0x7f4aa80ffd60 2024-02-19T19:05:13.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.698+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/1642677351 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa8107730 con 0x7f4aa80ffd60 2024-02-19T19:05:13.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.699+0000 7f4a9e7fc700 1 -- 172.21.15.46:0/1642677351 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f4a9800f5d0 con 0x7f4aa80ffd60 2024-02-19T19:05:13.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.699+0000 7f4a9e7fc700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f4a9406d520 0x7f4a9406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:13.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.700+0000 7f4a9e7fc700 1 -- 172.21.15.46:0/1642677351 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4a9808e4c0 con 0x7f4aa80ffd60 2024-02-19T19:05:13.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.700+0000 7f4aad153700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f4a9406d520 0x7f4a9406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:13.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.700+0000 7f4aad153700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f4a9406d520 0x7f4a9406f9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009910 tx=0x7f4aa4008040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:13.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.704+0000 7f4a9e7fc700 1 -- 172.21.15.46:0/1642677351 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f4a98058220 con 0x7f4aa80ffd60 2024-02-19T19:05:13.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.924+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/1642677351 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aa8061190 con 0x7f4a9406d520 2024-02-19T19:05:13.945 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:13 smithi046 ceph-mon[29647]: pgmap v87: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:13.945 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:13 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:13.945 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:13 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:13.945 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:13 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:13.945 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:13 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:13.945 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:13 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-19T19:05:13.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:13 smithi142 ceph-mon[37169]: pgmap v87: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:13.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:13 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:13.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:13 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:13.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:13 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:13.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:13 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:13.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:13 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-19T19:05:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.936+0000 7f4a9e7fc700 1 -- 172.21.15.46:0/1642677351 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f4aa8061190 con 0x7f4a9406d520 2024-02-19T19:05:13.956 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:05:13.956 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (94s) 54s ago 11m 16.6M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:05:13.956 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (12m) 54s ago 12m 7852k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:05:13.956 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (10m) 2m ago 10m 7680k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:05:13.956 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (12m) 54s ago 12m 6660k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:05:13.956 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (10m) 2m ago 10m 6665k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:05:13.956 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (60s) 54s ago 11m 57.0M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:05:13.956 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (5m) 54s ago 5m 25.7M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:05:13.956 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (5m) 54s ago 5m 14.4M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (5m) 2m ago 5m 14.5M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (5m) 2m ago 5m 22.2M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (3m) 54s ago 13m 498M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (2m) 2m ago 10m 447M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (13m) 54s ago 13m 53.5M 2048M 18.2.0 dc2bc1663786 adb8243bd11c 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (10m) 2m ago 10m 40.8M 2048M 18.2.0 dc2bc1663786 3f6c8b69abc2 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (2m) 54s ago 12m 16.8M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (2m) 2m ago 10m 5486k - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (9m) 54s ago 9m 51.2M 1217M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (9m) 54s ago 9m 50.2M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (8m) 54s ago 8m 51.4M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (8m) 2m ago 8m 48.2M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (7m) 2m ago 7m 46.4M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:05:13.957 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (7m) 2m ago 7m 47.2M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:05:13.958 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (112s) 54s ago 10m 53.0M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:05:13.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/1642677351 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f4a9406d520 msgr2=0x7f4a9406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f4a9406d520 0x7f4a9406f9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009910 tx=0x7f4aa4008040 comp rx=0 tx=0).stop 2024-02-19T19:05:13.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/1642677351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aa80ffd60 msgr2=0x7f4aa81973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:13.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aa80ffd60 0x7f4aa81973a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800bd70 tx=0x7f4a9800be50 comp rx=0 tx=0).stop 2024-02-19T19:05:13.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/1642677351 shutdown_connections 2024-02-19T19:05:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f4a9406d520 0x7f4a9406f9d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4aa80ff3c0 0x7f4aa8196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 --2- 172.21.15.46:0/1642677351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aa80ffd60 0x7f4aa81973a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/1642677351 >> 172.21.15.46:0/1642677351 conn(0x7f4aa80fac80 msgr2=0x7f4aa80fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/1642677351 shutdown_connections 2024-02-19T19:05:13.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:13.938+0000 7f4aaf3b7700 1 -- 172.21.15.46:0/1642677351 wait complete. 2024-02-19T19:05:14.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.052+0000 7fc135a35700 1 -- 172.21.15.46:0/4160629078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc130104130 msgr2=0x7fc130104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:14.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.052+0000 7fc135a35700 1 --2- 172.21.15.46:0/4160629078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc130104130 0x7fc130104500 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc12000b0a0 tx=0x7fc12000b3b0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.052+0000 7fc135a35700 1 -- 172.21.15.46:0/4160629078 shutdown_connections 2024-02-19T19:05:14.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.052+0000 7fc135a35700 1 --2- 172.21.15.46:0/4160629078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1300ffbd0 0x7fc130100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.052+0000 7fc135a35700 1 --2- 172.21.15.46:0/4160629078 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc130104130 0x7fc130104500 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.052+0000 7fc135a35700 1 -- 172.21.15.46:0/4160629078 >> 172.21.15.46:0/4160629078 conn(0x7fc130075130 msgr2=0x7fc130075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:14.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.052+0000 7fc135a35700 1 -- 172.21.15.46:0/4160629078 shutdown_connections 2024-02-19T19:05:14.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.052+0000 7fc135a35700 1 -- 172.21.15.46:0/4160629078 wait complete. 2024-02-19T19:05:14.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.052+0000 7fc135a35700 1 Processor -- start 2024-02-19T19:05:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.052+0000 7fc135a35700 1 -- start start 2024-02-19T19:05:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc135a35700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1300ffbd0 0x7fc130195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc135a35700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc130104130 0x7fc130196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc135a35700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc130196bf0 con 0x7fc1300ffbd0 2024-02-19T19:05:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc135a35700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13019a980 con 0x7fc130104130 2024-02-19T19:05:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc12effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1300ffbd0 0x7fc130195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:14.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc12effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1300ffbd0 0x7fc130195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60864/0 (socket says 172.21.15.46:60864) 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc12effd700 1 -- 172.21.15.46:0/2134153668 learned_addr learned my addr 172.21.15.46:0/2134153668 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc12e7fc700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc130104130 0x7fc130196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc12effd700 1 -- 172.21.15.46:0/2134153668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc130104130 msgr2=0x7fc130196510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc12effd700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc130104130 0x7fc130196510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc12effd700 1 -- 172.21.15.46:0/2134153668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc120009d00 con 0x7fc1300ffbd0 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc12effd700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1300ffbd0 0x7fc130195fd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc120000f80 tx=0x7fc12000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc134a33700 1 -- 172.21.15.46:0/2134153668 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc12000e040 con 0x7fc1300ffbd0 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.053+0000 7fc135a35700 1 -- 172.21.15.46:0/2134153668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13019ac00 con 0x7fc1300ffbd0 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.054+0000 7fc134a33700 1 -- 172.21.15.46:0/2134153668 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc120003de0 con 0x7fc1300ffbd0 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.054+0000 7fc135a35700 1 -- 172.21.15.46:0/2134153668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13019b0f0 con 0x7fc1300ffbd0 2024-02-19T19:05:14.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.054+0000 7fc134a33700 1 -- 172.21.15.46:0/2134153668 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc12001d7d0 con 0x7fc1300ffbd0 2024-02-19T19:05:14.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.055+0000 7fc135a35700 1 -- 172.21.15.46:0/2134153668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13004f2a0 con 0x7fc1300ffbd0 2024-02-19T19:05:14.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.055+0000 7fc134a33700 1 -- 172.21.15.46:0/2134153668 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fc120004040 con 0x7fc1300ffbd0 2024-02-19T19:05:14.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.055+0000 7fc134a33700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc11c06d520 0x7fc11c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:14.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.056+0000 7fc134a33700 1 -- 172.21.15.46:0/2134153668 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc12008e8d0 con 0x7fc1300ffbd0 2024-02-19T19:05:14.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.056+0000 7fc12e7fc700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc11c06d520 0x7fc11c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:14.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.056+0000 7fc12e7fc700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc11c06d520 0x7fc11c06f9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1301975f0 tx=0x7fc118009190 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:14.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.060+0000 7fc134a33700 1 -- 172.21.15.46:0/2134153668 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fc1200585b0 con 0x7fc1300ffbd0 2024-02-19T19:05:14.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.360+0000 7fc135a35700 1 -- 172.21.15.46:0/2134153668 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc13019b420 con 0x7fc1300ffbd0 2024-02-19T19:05:14.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.361+0000 7fc134a33700 1 -- 172.21.15.46:0/2134153668 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fc12005bc70 con 0x7fc1300ffbd0 2024-02-19T19:05:14.381 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:05:14.381 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:05:14.381 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-19T19:05:14.382 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:05:14.383 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:05:14.383 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:05:14.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.364+0000 7fc135a35700 1 -- 172.21.15.46:0/2134153668 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc11c06d520 msgr2=0x7fc11c06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:14.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.364+0000 7fc135a35700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc11c06d520 0x7fc11c06f9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1301975f0 tx=0x7fc118009190 comp rx=0 tx=0).stop 2024-02-19T19:05:14.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.364+0000 7fc135a35700 1 -- 172.21.15.46:0/2134153668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1300ffbd0 msgr2=0x7fc130195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:14.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.364+0000 7fc135a35700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1300ffbd0 0x7fc130195fd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc120000f80 tx=0x7fc12000cd20 comp rx=0 tx=0).stop 2024-02-19T19:05:14.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.365+0000 7fc135a35700 1 -- 172.21.15.46:0/2134153668 shutdown_connections 2024-02-19T19:05:14.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.365+0000 7fc135a35700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fc11c06d520 0x7fc11c06f9d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.365+0000 7fc135a35700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1300ffbd0 0x7fc130195fd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.365+0000 7fc135a35700 1 --2- 172.21.15.46:0/2134153668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc130104130 0x7fc130196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.365+0000 7fc135a35700 1 -- 172.21.15.46:0/2134153668 >> 172.21.15.46:0/2134153668 conn(0x7fc130075130 msgr2=0x7fc130109220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:14.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.365+0000 7fc135a35700 1 -- 172.21.15.46:0/2134153668 shutdown_connections 2024-02-19T19:05:14.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.365+0000 7fc135a35700 1 -- 172.21.15.46:0/2134153668 wait complete. 2024-02-19T19:05:14.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.480+0000 7fee30e8d700 1 -- 172.21.15.46:0/3707370409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee2c101d30 msgr2=0x7fee2c10a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:14.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.480+0000 7fee30e8d700 1 --2- 172.21.15.46:0/3707370409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee2c101d30 0x7fee2c10a230 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fee14009910 tx=0x7fee14009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:14.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.480+0000 7fee30e8d700 1 -- 172.21.15.46:0/3707370409 shutdown_connections 2024-02-19T19:05:14.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.480+0000 7fee30e8d700 1 --2- 172.21.15.46:0/3707370409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee2c101d30 0x7fee2c10a230 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.480+0000 7fee30e8d700 1 --2- 172.21.15.46:0/3707370409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee2c101420 0x7fee2c1017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.480+0000 7fee30e8d700 1 -- 172.21.15.46:0/3707370409 >> 172.21.15.46:0/3707370409 conn(0x7fee2c0fac60 msgr2=0x7fee2c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:14.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.480+0000 7fee30e8d700 1 -- 172.21.15.46:0/3707370409 shutdown_connections 2024-02-19T19:05:14.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.480+0000 7fee30e8d700 1 -- 172.21.15.46:0/3707370409 wait complete. 2024-02-19T19:05:14.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.481+0000 7fee30e8d700 1 Processor -- start 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.481+0000 7fee30e8d700 1 -- start start 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.481+0000 7fee30e8d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee2c101420 0x7fee2c195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.481+0000 7fee30e8d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee2c101d30 0x7fee2c196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.481+0000 7fee30e8d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c196a70 con 0x7fee2c101420 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.481+0000 7fee30e8d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c19a800 con 0x7fee2c101d30 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.481+0000 7fee2a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee2c101420 0x7fee2c195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.481+0000 7fee2a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee2c101420 0x7fee2c195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60884/0 (socket says 172.21.15.46:60884) 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.481+0000 7fee2a59c700 1 -- 172.21.15.46:0/1879145571 learned_addr learned my addr 172.21.15.46:0/1879145571 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.482+0000 7fee29d9b700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee2c101d30 0x7fee2c196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.482+0000 7fee2a59c700 1 -- 172.21.15.46:0/1879145571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee2c101d30 msgr2=0x7fee2c196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.482+0000 7fee2a59c700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee2c101d30 0x7fee2c196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.482+0000 7fee2a59c700 1 -- 172.21.15.46:0/1879145571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140095f0 con 0x7fee2c101420 2024-02-19T19:05:14.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.482+0000 7fee2a59c700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee2c101420 0x7fee2c195e50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00e920 tx=0x7fee1c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:14.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.482+0000 7fee237fe700 1 -- 172.21.15.46:0/1879145571 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee1c009790 con 0x7fee2c101420 2024-02-19T19:05:14.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.482+0000 7fee237fe700 1 -- 172.21.15.46:0/1879145571 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee1c00cba0 con 0x7fee2c101420 2024-02-19T19:05:14.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.482+0000 7fee30e8d700 1 -- 172.21.15.46:0/1879145571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c19aae0 con 0x7fee2c101420 2024-02-19T19:05:14.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.482+0000 7fee237fe700 1 -- 172.21.15.46:0/1879145571 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee1c018650 con 0x7fee2c101420 2024-02-19T19:05:14.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.483+0000 7fee30e8d700 1 -- 172.21.15.46:0/1879145571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c19b030 con 0x7fee2c101420 2024-02-19T19:05:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.484+0000 7fee30e8d700 1 -- 172.21.15.46:0/1879145571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c1078a0 con 0x7fee2c101420 2024-02-19T19:05:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.484+0000 7fee237fe700 1 -- 172.21.15.46:0/1879145571 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fee1c00cd10 con 0x7fee2c101420 2024-02-19T19:05:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.485+0000 7fee237fe700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fee1806d520 0x7fee1806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.485+0000 7fee237fe700 1 -- 172.21.15.46:0/1879145571 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fee1c014070 con 0x7fee2c101420 2024-02-19T19:05:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.485+0000 7fee29d9b700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fee1806d520 0x7fee1806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.485+0000 7fee29d9b700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fee1806d520 0x7fee1806f9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fee1400b760 tx=0x7fee14005fd0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:14.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.489+0000 7fee237fe700 1 -- 172.21.15.46:0/1879145571 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fee1c052a50 con 0x7fee2c101420 2024-02-19T19:05:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.749+0000 7fee30e8d700 1 -- 172.21.15.46:0/1879145571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fee2c19b210 con 0x7fee2c101420 2024-02-19T19:05:14.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:14 smithi046 ceph-mon[29647]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:14.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:14 smithi046 ceph-mon[29647]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (squid) 2024-02-19T19:05:14.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:14 smithi046 ceph-mon[29647]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-19T19:05:14.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:14 smithi046 ceph-mon[29647]: Upgrade: Setting container_image for all mgr 2024-02-19T19:05:14.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:14 smithi046 ceph-mon[29647]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:14.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:14 smithi046 ceph-mon[29647]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:14.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:14 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/2134153668' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.750+0000 7fee237fe700 1 -- 172.21.15.46:0/1879145571 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1835 (secure 0 0 0) 0x7fee1c05ab50 con 0x7fee2c101420 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stdout:e17 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 17 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:05:14.771 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T18:59:38.092640+0000 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:05:14.772 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:05:14.773 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:05:14.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:05:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:14.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 -- 172.21.15.46:0/1879145571 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fee1806d520 msgr2=0x7fee1806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:14.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fee1806d520 0x7fee1806f9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fee1400b760 tx=0x7fee14005fd0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 -- 172.21.15.46:0/1879145571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee2c101420 msgr2=0x7fee2c195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee2c101420 0x7fee2c195e50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00e920 tx=0x7fee1c00ece0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 -- 172.21.15.46:0/1879145571 shutdown_connections 2024-02-19T19:05:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7fee1806d520 0x7fee1806f9d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee2c101420 0x7fee2c195e50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 --2- 172.21.15.46:0/1879145571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee2c101d30 0x7fee2c196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 -- 172.21.15.46:0/1879145571 >> 172.21.15.46:0/1879145571 conn(0x7fee2c0fac60 msgr2=0x7fee2c1049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 -- 172.21.15.46:0/1879145571 shutdown_connections 2024-02-19T19:05:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.752+0000 7fee30e8d700 1 -- 172.21.15.46:0/1879145571 wait complete. 2024-02-19T19:05:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T19:05:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.860+0000 7f1d81c0d700 1 -- 172.21.15.46:0/759030652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c0ffd60 msgr2=0x7f1d7c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.860+0000 7f1d81c0d700 1 --2- 172.21.15.46:0/759030652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c0ffd60 0x7f1d7c103d30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009910 tx=0x7f1d70009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.860+0000 7f1d81c0d700 1 -- 172.21.15.46:0/759030652 shutdown_connections 2024-02-19T19:05:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.860+0000 7f1d81c0d700 1 --2- 172.21.15.46:0/759030652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c0ffd60 0x7f1d7c103d30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.860+0000 7f1d81c0d700 1 --2- 172.21.15.46:0/759030652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d7c0ff3c0 0x7f1d7c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.860+0000 7f1d81c0d700 1 -- 172.21.15.46:0/759030652 >> 172.21.15.46:0/759030652 conn(0x7f1d7c0fac80 msgr2=0x7f1d7c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.860+0000 7f1d81c0d700 1 -- 172.21.15.46:0/759030652 shutdown_connections 2024-02-19T19:05:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.860+0000 7f1d81c0d700 1 -- 172.21.15.46:0/759030652 wait complete. 2024-02-19T19:05:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.861+0000 7f1d81c0d700 1 Processor -- start 2024-02-19T19:05:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.861+0000 7f1d81c0d700 1 -- start start 2024-02-19T19:05:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.861+0000 7f1d81c0d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c0ff3c0 0x7f1d7c195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.861+0000 7f1d81c0d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d7c0ffd60 0x7f1d7c196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.861+0000 7f1d81c0d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c196bf0 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.861+0000 7f1d81c0d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c19a980 con 0x7f1d7c0ffd60 2024-02-19T19:05:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.861+0000 7f1d7b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c0ff3c0 0x7f1d7c195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.861+0000 7f1d7b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c0ff3c0 0x7f1d7c195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60892/0 (socket says 172.21.15.46:60892) 2024-02-19T19:05:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.861+0000 7f1d7b7fe700 1 -- 172.21.15.46:0/1823547558 learned_addr learned my addr 172.21.15.46:0/1823547558 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.861+0000 7f1d7affd700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d7c0ffd60 0x7f1d7c196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.862+0000 7f1d7b7fe700 1 -- 172.21.15.46:0/1823547558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d7c0ffd60 msgr2=0x7f1d7c196510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.862+0000 7f1d7b7fe700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d7c0ffd60 0x7f1d7c196510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.862+0000 7f1d7b7fe700 1 -- 172.21.15.46:0/1823547558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d700095f0 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.862+0000 7f1d7b7fe700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c0ff3c0 0x7f1d7c195fd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00b4d0 tx=0x7f1d6c00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.862+0000 7f1d78ff9700 1 -- 172.21.15.46:0/1823547558 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d6c011800 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.862+0000 7f1d81c0d700 1 -- 172.21.15.46:0/1823547558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c19ac60 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.862+0000 7f1d78ff9700 1 -- 172.21.15.46:0/1823547558 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d6c011e20 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.862+0000 7f1d78ff9700 1 -- 172.21.15.46:0/1823547558 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d6c00f2e0 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.862+0000 7f1d81c0d700 1 -- 172.21.15.46:0/1823547558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c19b1b0 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.863+0000 7f1d81c0d700 1 -- 172.21.15.46:0/1823547558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c108740 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.863+0000 7f1d78ff9700 1 -- 172.21.15.46:0/1823547558 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f1d6c010380 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.864+0000 7f1d78ff9700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f1d6406d520 0x7f1d6406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:14.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.864+0000 7f1d78ff9700 1 -- 172.21.15.46:0/1823547558 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1d6c08ca40 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.864+0000 7f1d7affd700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f1d6406d520 0x7f1d6406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:14.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.864+0000 7f1d7affd700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f1d6406d520 0x7f1d6406f9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c1975f0 tx=0x7f1d7001a040 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:14.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:14.868+0000 7f1d78ff9700 1 -- 172.21.15.46:0/1823547558 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f1d6c056720 con 0x7f1d7c0ff3c0 2024-02-19T19:05:14.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:14 smithi142 ceph-mon[37169]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:14.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:14 smithi142 ceph-mon[37169]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (squid) 2024-02-19T19:05:14.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:14 smithi142 ceph-mon[37169]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-19T19:05:14.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:14 smithi142 ceph-mon[37169]: Upgrade: Setting container_image for all mgr 2024-02-19T19:05:14.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:14 smithi142 ceph-mon[37169]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:14.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:14 smithi142 ceph-mon[37169]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:14.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:14 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/2134153668' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:15.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.100+0000 7f1d81c0d700 1 -- 172.21.15.46:0/1823547558 --> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d7c19b430 con 0x7f1d6406d520 2024-02-19T19:05:15.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.101+0000 7f1d78ff9700 1 -- 172.21.15.46:0/1823547558 <== mgr.14662 v2:172.21.15.46:6800/1269498854 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1d7c19b430 con 0x7f1d6406d520 2024-02-19T19:05:15.121 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:05:15.121 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:05:15.121 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:05:15.122 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:05:15.122 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:05:15.122 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:05:15.122 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:05:15.122 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/23 daemons upgraded", 2024-02-19T19:05:15.122 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mon daemons", 2024-02-19T19:05:15.122 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:05:15.122 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:05:15.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.103+0000 7f1d81c0d700 1 -- 172.21.15.46:0/1823547558 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f1d6406d520 msgr2=0x7f1d6406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:15.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.103+0000 7f1d81c0d700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f1d6406d520 0x7f1d6406f9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c1975f0 tx=0x7f1d7001a040 comp rx=0 tx=0).stop 2024-02-19T19:05:15.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.103+0000 7f1d81c0d700 1 -- 172.21.15.46:0/1823547558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c0ff3c0 msgr2=0x7f1d7c195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:15.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.103+0000 7f1d81c0d700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c0ff3c0 0x7f1d7c195fd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00b4d0 tx=0x7f1d6c00b7e0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.104+0000 7f1d81c0d700 1 -- 172.21.15.46:0/1823547558 shutdown_connections 2024-02-19T19:05:15.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.104+0000 7f1d81c0d700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f1d6406d520 0x7f1d6406f9d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.104+0000 7f1d81c0d700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c0ff3c0 0x7f1d7c195fd0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.104+0000 7f1d81c0d700 1 --2- 172.21.15.46:0/1823547558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d7c0ffd60 0x7f1d7c196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.104+0000 7f1d81c0d700 1 -- 172.21.15.46:0/1823547558 >> 172.21.15.46:0/1823547558 conn(0x7f1d7c0fac80 msgr2=0x7f1d7c069150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:15.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.104+0000 7f1d81c0d700 1 -- 172.21.15.46:0/1823547558 shutdown_connections 2024-02-19T19:05:15.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.104+0000 7f1d81c0d700 1 -- 172.21.15.46:0/1823547558 wait complete. 2024-02-19T19:05:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.217+0000 7f464984e700 1 -- 172.21.15.46:0/2372329038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46440ffd60 msgr2=0x7f4644103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.217+0000 7f464984e700 1 --2- 172.21.15.46:0/2372329038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46440ffd60 0x7f4644103d30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f463800bb20 tx=0x7f463800be30 comp rx=0 tx=0).stop 2024-02-19T19:05:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.217+0000 7f464984e700 1 -- 172.21.15.46:0/2372329038 shutdown_connections 2024-02-19T19:05:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.217+0000 7f464984e700 1 --2- 172.21.15.46:0/2372329038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46440ffd60 0x7f4644103d30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.217+0000 7f464984e700 1 --2- 172.21.15.46:0/2372329038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46440ff3c0 0x7f46440ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.217+0000 7f464984e700 1 -- 172.21.15.46:0/2372329038 >> 172.21.15.46:0/2372329038 conn(0x7f46440fac80 msgr2=0x7f46440fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.217+0000 7f464984e700 1 -- 172.21.15.46:0/2372329038 shutdown_connections 2024-02-19T19:05:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.217+0000 7f464984e700 1 -- 172.21.15.46:0/2372329038 wait complete. 2024-02-19T19:05:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.217+0000 7f464984e700 1 Processor -- start 2024-02-19T19:05:15.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f464984e700 1 -- start start 2024-02-19T19:05:15.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f464984e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46440ff3c0 0x7f4644198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:15.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f464984e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46440ffd60 0x7f4644198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:15.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f464984e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644198d30 con 0x7f46440ff3c0 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f464984e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464419cac0 con 0x7f46440ffd60 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f4642ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46440ff3c0 0x7f4644198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f4642ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46440ff3c0 0x7f4644198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60908/0 (socket says 172.21.15.46:60908) 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f4642ffd700 1 -- 172.21.15.46:0/3338413661 learned_addr learned my addr 172.21.15.46:0/3338413661 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f4642ffd700 1 -- 172.21.15.46:0/3338413661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46440ffd60 msgr2=0x7f4644198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f4642ffd700 1 --2- 172.21.15.46:0/3338413661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46440ffd60 0x7f4644198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f4642ffd700 1 -- 172.21.15.46:0/3338413661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463800b800 con 0x7f46440ff3c0 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.218+0000 7f4642ffd700 1 --2- 172.21.15.46:0/3338413661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46440ff3c0 0x7f4644198110 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f463400d8d0 tx=0x7f463400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.219+0000 7f464884c700 1 -- 172.21.15.46:0/3338413661 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4634009940 con 0x7f46440ff3c0 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.219+0000 7f464984e700 1 -- 172.21.15.46:0/3338413661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464419cda0 con 0x7f46440ff3c0 2024-02-19T19:05:15.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.219+0000 7f464884c700 1 -- 172.21.15.46:0/3338413661 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4634010460 con 0x7f46440ff3c0 2024-02-19T19:05:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.219+0000 7f464884c700 1 -- 172.21.15.46:0/3338413661 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f463400f5f0 con 0x7f46440ff3c0 2024-02-19T19:05:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.219+0000 7f464984e700 1 -- 172.21.15.46:0/3338413661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464419d2f0 con 0x7f46440ff3c0 2024-02-19T19:05:15.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.220+0000 7f464984e700 1 -- 172.21.15.46:0/3338413661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4644107730 con 0x7f46440ff3c0 2024-02-19T19:05:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.220+0000 7f464884c700 1 -- 172.21.15.46:0/3338413661 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f46340105d0 con 0x7f46440ff3c0 2024-02-19T19:05:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.221+0000 7f464884c700 1 --2- 172.21.15.46:0/3338413661 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f462c06d520 0x7f462c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.221+0000 7f464884c700 1 -- 172.21.15.46:0/3338413661 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f463408cf80 con 0x7f46440ff3c0 2024-02-19T19:05:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.221+0000 7f46427fc700 1 --2- 172.21.15.46:0/3338413661 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f462c06d520 0x7f462c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:15.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.221+0000 7f46427fc700 1 --2- 172.21.15.46:0/3338413661 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f462c06d520 0x7f462c06f9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f463800baf0 tx=0x7f4638005dc0 comp rx=0 tx=0).ready entity=mgr.14662 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:15.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.226+0000 7f464884c700 1 -- 172.21.15.46:0/3338413661 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f4634056c60 con 0x7f46440ff3c0 2024-02-19T19:05:15.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.521+0000 7f464984e700 1 -- 172.21.15.46:0/3338413661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f464404f2a0 con 0x7f46440ff3c0 2024-02-19T19:05:15.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.521+0000 7f464884c700 1 -- 172.21.15.46:0/3338413661 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f463405a320 con 0x7f46440ff3c0 2024-02-19T19:05:15.542 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_OK 2024-02-19T19:05:15.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 -- 172.21.15.46:0/3338413661 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f462c06d520 msgr2=0x7f462c06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:15.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 --2- 172.21.15.46:0/3338413661 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f462c06d520 0x7f462c06f9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f463800baf0 tx=0x7f4638005dc0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 -- 172.21.15.46:0/3338413661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46440ff3c0 msgr2=0x7f4644198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:15.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 --2- 172.21.15.46:0/3338413661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46440ff3c0 0x7f4644198110 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f463400d8d0 tx=0x7f463400dc90 comp rx=0 tx=0).stop 2024-02-19T19:05:15.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 -- 172.21.15.46:0/3338413661 shutdown_connections 2024-02-19T19:05:15.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 --2- 172.21.15.46:0/3338413661 >> [v2:172.21.15.46:6800/1269498854,v1:172.21.15.46:6801/1269498854] conn(0x7f462c06d520 0x7f462c06f9d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 --2- 172.21.15.46:0/3338413661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46440ff3c0 0x7f4644198110 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 --2- 172.21.15.46:0/3338413661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46440ffd60 0x7f4644198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:15.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 -- 172.21.15.46:0/3338413661 >> 172.21.15.46:0/3338413661 conn(0x7f46440fac80 msgr2=0x7f46440fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:15.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 -- 172.21.15.46:0/3338413661 shutdown_connections 2024-02-19T19:05:15.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:15.524+0000 7f464984e700 1 -- 172.21.15.46:0/3338413661 wait complete. 2024-02-19T19:05:15.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:15 smithi046 ceph-mon[29647]: pgmap v88: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:15.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:15 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/1879145571' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:05:15.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:15 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:15.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:15 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:05:15.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:15 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:05:15.801 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:15 smithi046 ceph-mon[29647]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:15.801 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:15 smithi046 ceph-mon[29647]: from='client.? 172.21.15.46:0/3338413661' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:05:15.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:15 smithi142 ceph-mon[37169]: pgmap v88: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:15.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:15 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/1879145571' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:05:15.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:15 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:15.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:15 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:05:15.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:15 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:05:15.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:15 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:15.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:15 smithi142 ceph-mon[37169]: from='client.? 172.21.15.46:0/3338413661' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:05:16.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:16 smithi046 ceph-mon[29647]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:16.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:16 smithi046 ceph-mon[29647]: Upgrade: Updating mon.smithi046 2024-02-19T19:05:16.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:16 smithi046 ceph-mon[29647]: Deploying daemon mon.smithi046 on smithi046 2024-02-19T19:05:16.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:16 smithi142 ceph-mon[37169]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:16.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:16 smithi142 ceph-mon[37169]: Upgrade: Updating mon.smithi046 2024-02-19T19:05:16.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:16 smithi142 ceph-mon[37169]: Deploying daemon mon.smithi046 on smithi046 2024-02-19T19:05:17.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:17 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:05:17.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:17 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046[29643]: 2024-02-19T19:05:17.409+0000 7fa3773d6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:05:17.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:17 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046[29643]: 2024-02-19T19:05:17.409+0000 7fa3773d6700 -1 mon.smithi046@0(leader) e2 *** Got Signal Terminated *** 2024-02-19T19:05:17.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:17 smithi046 podman[88754]: 2024-02-19 19:05:17.552481274 +0000 UTC m=+0.255911568 container died adb8243bd11cd1ee476ca98fae6e94f4cda69e8b6f8843985db2662054078170 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-02-19T19:05:18.222 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:17 smithi046 podman[88754]: 2024-02-19 19:05:17.91815849 +0000 UTC m=+0.621588797 container cleanup adb8243bd11cd1ee476ca98fae6e94f4cda69e8b6f8843985db2662054078170 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, ceph=True, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-02-19T19:05:18.223 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:17 smithi046 bash[88754]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046 2024-02-19T19:05:18.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:18 smithi046 podman[88779]: 2024-02-19 19:05:18.203187598 +0000 UTC m=+0.647210762 container remove adb8243bd11cd1ee476ca98fae6e94f4cda69e8b6f8843985db2662054078170 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-19T19:05:18.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:18 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046.service: Deactivated successfully. 2024-02-19T19:05:18.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:18 smithi046 systemd[1]: Stopped Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:05:18.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:18 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046.service: Consumed 13.417s CPU time. 2024-02-19T19:05:18.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:18 smithi046 systemd[1]: Starting Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:05:18.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:18 smithi046 podman[88909]: 2024-02-19 19:05:18.646469062 +0000 UTC m=+0.018817394 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:05:18.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:18 smithi046 podman[88909]: 2024-02-19 19:05:18.754471934 +0000 UTC m=+0.126820300 container create ef2d7130eaeee122a8d81b50306aaf05ebeae8d124fb6d7a761da4df7fd601f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:05:19.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:18 smithi046 podman[88909]: 2024-02-19 19:05:18.998779897 +0000 UTC m=+0.371128222 container init ef2d7130eaeee122a8d81b50306aaf05ebeae8d124fb6d7a761da4df7fd601f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True) 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 podman[88909]: 2024-02-19 19:05:19.002392998 +0000 UTC m=+0.374741329 container start ef2d7130eaeee122a8d81b50306aaf05ebeae8d124fb6d7a761da4df7fd601f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: set uid:gid to 167:167 (ceph:ceph) 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev), process ceph-mon, pid 2 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: pidfile_write: ignore empty --pid-file 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: load: jerasure load: lrc 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: RocksDB version: 7.9.2 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Git sha 0 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Compile date 2024-02-15 18:05:23 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: DB SUMMARY 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: DB Session ID: 5VVORWVIGMLKRM5RZONS 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: CURRENT file: CURRENT 2024-02-19T19:05:19.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: IDENTITY file: IDENTITY 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1509 Bytes 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi046/store.db dir, Total Num: 1, files: 000032.sst 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi046/store.db: 000030.log size: 3319792 ; 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.error_if_exists: 0 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.create_if_missing: 0 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.paranoid_checks: 1 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.env: 0x55e2acb31ae0 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.fs: PosixFileSystem 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.info_log: 0x55e2ae48d760 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_file_opening_threads: 16 2024-02-19T19:05:19.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.statistics: (nil) 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.use_fsync: 0 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_log_file_size: 0 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.keep_log_file_num: 1000 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.recycle_log_file_num: 0 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.allow_fallocate: 1 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.allow_mmap_reads: 0 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.allow_mmap_writes: 0 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.use_direct_reads: 0 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.create_missing_column_families: 0 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.db_log_dir: 2024-02-19T19:05:19.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.wal_dir: 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.advise_random_on_open: 1 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.db_write_buffer_size: 0 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.write_buffer_manager: 0x55e2ae461400 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.rate_limiter: (nil) 2024-02-19T19:05:19.336 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.wal_recovery_mode: 2 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.enable_thread_tracking: 0 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.enable_pipelined_write: 0 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.unordered_write: 0 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.row_cache: None 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.wal_filter: None 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.allow_ingest_behind: 0 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.two_write_queues: 0 2024-02-19T19:05:19.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.manual_wal_flush: 0 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.wal_compression: 0 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.atomic_flush: 0 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.log_readahead_size: 0 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.best_efforts_recovery: 0 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.allow_data_in_errors: 0 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.db_host_id: __hostname__ 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_background_jobs: 2 2024-02-19T19:05:19.338 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_background_compactions: -1 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_subcompactions: 1 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_total_wal_size: 0 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_open_files: -1 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bytes_per_sync: 0 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_readahead_size: 0 2024-02-19T19:05:19.339 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_background_flushes: -1 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Compression algorithms supported: 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: kZSTD supported: 0 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: kXpressCompression supported: 0 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: kLZ4HCCompression supported: 1 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: kZlibCompression supported: 1 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: kSnappyCompression supported: 1 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: kLZ4Compression supported: 1 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: kBZip2Compression supported: 0 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000015 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T19:05:19.340 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.merge_operator: 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_filter: None 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_filter_factory: None 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.sst_partitioner_factory: None 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e2ae48d880) 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks: 1 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_top_level_index_and_filter: 1 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_type: 0 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_index_type: 0 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_shortening: 1 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-19T19:05:19.341 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: checksum: 4 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: no_block_cache: 0 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache: 0x55e2ae491090 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_name: BinnedLRUCache 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_options: 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: capacity : 536870912 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_shard_bits : 4 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: strict_capacity_limit : 0 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: high_pri_pool_ratio: 0.000 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_compressed: (nil) 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: persistent_cache: (nil) 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size: 4096 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size_deviation: 10 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_restart_interval: 16 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_block_restart_interval: 1 2024-02-19T19:05:19.342 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: metadata_block_size: 4096 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: partition_filters: 0 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: use_delta_encoding: 1 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: filter_policy: bloomfilter 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: whole_key_filtering: 1 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: verify_compression: 0 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: read_amp_bytes_per_bit: 0 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: format_version: 5 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_index_compression: 1 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_align: 0 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_auto_readahead_size: 262144 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: prepopulate_block_cache: 0 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: initial_auto_readahead_size: 8192 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_file_reads_for_auto_readahead: 2 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.write_buffer_size: 33554432 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_write_buffer_number: 2 2024-02-19T19:05:19.343 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compression: NoCompression 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bottommost_compression: Disabled 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.prefix_extractor: nullptr 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.num_levels: 7 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T19:05:19.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compression_opts.level: 32767 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compression_opts.strategy: 0 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compression_opts.enabled: false 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-19T19:05:19.345 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T19:05:19.346 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T19:05:19.346 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T19:05:19.346 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.target_file_size_base: 67108864 2024-02-19T19:05:19.346 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T19:05:19.346 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T19:05:19.346 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T19:05:19.346 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T19:05:19.346 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T19:05:19.347 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T19:05:19.347 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T19:05:19.347 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T19:05:19.347 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T19:05:19.347 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T19:05:19.347 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T19:05:19.347 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.arena_block_size: 1048576 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.disable_auto_compactions: 0 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T19:05:19.348 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.table_properties_collectors: 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.inplace_update_support: 0 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.bloom_locality: 0 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.max_successive_merges: 0 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.paranoid_file_checks: 0 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.force_consistency_checks: 1 2024-02-19T19:05:19.349 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.report_bg_io_stats: 0 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.ttl: 2592000 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.enable_blob_files: false 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.min_blob_size: 0 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.blob_file_size: 268435456 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.blob_file_starting_level: 0 2024-02-19T19:05:19.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12107, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 54d4c747-ce59-4d51-8e89-5318704cd6a8 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369519031208, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369519041093, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2890349, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12108, "largest_seqno": 14997, "table_properties": {"data_size": 2879252, "index_size": 6748, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3333, "raw_key_size": 29107, "raw_average_key_size": 22, "raw_value_size": 2853612, "raw_average_value_size": 2161, "num_data_blocks": 307, "num_entries": 1320, "num_filter_entries": 1320, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708369519, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "54d4c747-ce59-4d51-8e89-5318704cd6a8", "db_session_id": "5VVORWVIGMLKRM5RZONS", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369519041198, "job": 1, "event": "recovery_finished"} 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi046/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e2ae580000 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: DB pointer 0x55e2ae56c000 2024-02-19T19:05:19.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-19T19:05:19.352 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-19T19:05:19.352 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** DB Stats ** 2024-02-19T19:05:19.352 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T19:05:19.352 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T19:05:19.352 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T19:05:19.352 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T19:05:19.352 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T19:05:19.352 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T19:05:19.352 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L0 1/0 2.76 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 592.9 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L6 1/0 5.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Sum 2/0 8.57 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 592.9 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 592.9 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 592.9 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-19T19:05:19.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative compaction: 0.00 GB write, 220.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval compaction: 0.00 GB write, 220.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache BinnedLRUCache@0x55e2ae491090#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-02-19T19:05:19.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: starting mon.smithi046 rank 0 at public addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] at bind addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi046 fsid c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: mon.smithi046@-1(???) e2 preinit fsid c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: mon.smithi046@-1(???).mds e17 new map 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: mon.smithi046@-1(???).mds e17 print_map 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: e17 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: legacy client fscid: 1 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T19:05:19.355 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Filesystem 'cephfs' (1) 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: fs_name cephfs 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: epoch 17 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: modified 2024-02-19T18:59:38.092640+0000 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: tableserver 0 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: root 0 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: session_timeout 60 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: session_autoclose 300 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_file_size 1099511627776 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_xattr_size 65536 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: required_client_features {} 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: last_failure 0 2024-02-19T19:05:19.356 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: last_failure_osd_epoch 46 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_mds 2 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: in 0,1 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: up {0=14494,1=24265} 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: failed 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: damaged 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: stopped 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_pools [3] 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: metadata_pool 2 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: inline_data disabled 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: balancer 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: bal_rank_mask -1 2024-02-19T19:05:19.357 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: standby_count_wanted 1 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Standby daemons: 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: mon.smithi046@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: mon.smithi046@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: mon.smithi046@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:05:19.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: mon.smithi046@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:05:19.359 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 ceph-mon[88928]: mon.smithi046@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-02-19T19:05:19.359 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 bash[88909]: ef2d7130eaeee122a8d81b50306aaf05ebeae8d124fb6d7a761da4df7fd601f4 2024-02-19T19:05:19.359 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:19 smithi046 systemd[1]: Started Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:05:20.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T19:05:20.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T19:05:20.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: pgmap v90: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:20.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: mon.smithi046 calling monitor election 2024-02-19T19:05:20.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: mon.smithi046 is new leader, mons smithi046,smithi142 in quorum (ranks 0,1) 2024-02-19T19:05:20.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: monmap e2: 2 mons at {smithi046=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T19:05:20.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: fsmap cephfs:2 {0=cephfs.smithi046.bwvkwa=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T19:05:20.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: osdmap e48: 6 total, 6 up, 6 in 2024-02-19T19:05:20.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: mgrmap e32: smithi046.qtceex(active, since 2m), standbys: smithi142.fwekwv 2024-02-19T19:05:20.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: overall HEALTH_OK 2024-02-19T19:05:20.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: from='mgr.14662 ' entity='' 2024-02-19T19:05:20.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:20 smithi046 ceph-mon[88928]: mgrmap e33: smithi046.qtceex(active, since 2m), standbys: smithi142.fwekwv 2024-02-19T19:05:20.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: from='mgr.14662 172.21.15.46:0/2995298795' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: pgmap v90: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: mon.smithi046 calling monitor election 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: mon.smithi046 is new leader, mons smithi046,smithi142 in quorum (ranks 0,1) 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: monmap e2: 2 mons at {smithi046=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: fsmap cephfs:2 {0=cephfs.smithi046.bwvkwa=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: osdmap e48: 6 total, 6 up, 6 in 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: mgrmap e32: smithi046.qtceex(active, since 2m), standbys: smithi142.fwekwv 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: overall HEALTH_OK 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: from='mgr.14662 ' entity='' 2024-02-19T19:05:20.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:20 smithi142 ceph-mon[37169]: mgrmap e33: smithi046.qtceex(active, since 2m), standbys: smithi142.fwekwv 2024-02-19T19:05:27.799 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:27 smithi142 ceph-mon[37169]: Standby manager daemon smithi142.fwekwv restarted 2024-02-19T19:05:27.800 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:27 smithi142 ceph-mon[37169]: Standby manager daemon smithi142.fwekwv started 2024-02-19T19:05:27.800 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:27 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/1384650493' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/crt"}]: dispatch 2024-02-19T19:05:27.800 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:27 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/1384650493' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:05:27.800 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:27 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/1384650493' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/key"}]: dispatch 2024-02-19T19:05:27.800 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:27 smithi142 ceph-mon[37169]: from='mgr.? 172.21.15.142:0/1384650493' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:05:27.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:27 smithi046 ceph-mon[88928]: Standby manager daemon smithi142.fwekwv restarted 2024-02-19T19:05:27.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:27 smithi046 ceph-mon[88928]: Standby manager daemon smithi142.fwekwv started 2024-02-19T19:05:27.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:27 smithi046 ceph-mon[88928]: from='mgr.? 172.21.15.142:0/1384650493' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/crt"}]: dispatch 2024-02-19T19:05:27.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:27 smithi046 ceph-mon[88928]: from='mgr.? 172.21.15.142:0/1384650493' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:05:27.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:27 smithi046 ceph-mon[88928]: from='mgr.? 172.21.15.142:0/1384650493' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.fwekwv/key"}]: dispatch 2024-02-19T19:05:27.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:27 smithi046 ceph-mon[88928]: from='mgr.? 172.21.15.142:0/1384650493' entity='mgr.smithi142.fwekwv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:05:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: mgrmap e34: smithi046.qtceex(active, since 3m), standbys: smithi142.fwekwv 2024-02-19T19:05:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: Active manager daemon smithi046.qtceex restarted 2024-02-19T19:05:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: Activating manager daemon smithi046.qtceex 2024-02-19T19:05:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: osdmap e49: 6 total, 6 up, 6 in 2024-02-19T19:05:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: mgrmap e35: smithi046.qtceex(active, starting, since 0.00601604s), standbys: smithi142.fwekwv 2024-02-19T19:05:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T19:05:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T19:05:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:05:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T19:05:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi046.qtceex", "id": "smithi046.qtceex"}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi142.fwekwv", "id": "smithi142.fwekwv"}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:05:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: Manager daemon smithi046.qtceex is now available 2024-02-19T19:05:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:05:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/trash_purge_schedule"}]: dispatch 2024-02-19T19:05:28.857 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: mgrmap e34: smithi046.qtceex(active, since 3m), standbys: smithi142.fwekwv 2024-02-19T19:05:28.857 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: Active manager daemon smithi046.qtceex restarted 2024-02-19T19:05:28.857 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: Activating manager daemon smithi046.qtceex 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: osdmap e49: 6 total, 6 up, 6 in 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: mgrmap e35: smithi046.qtceex(active, starting, since 0.00601604s), standbys: smithi142.fwekwv 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi046.qtceex", "id": "smithi046.qtceex"}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr metadata", "who": "smithi142.fwekwv", "id": "smithi142.fwekwv"}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:05:28.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:05:28.859 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:05:28.859 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:05:28.859 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:05:28.859 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:05:28.859 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: Manager daemon smithi046.qtceex is now available 2024-02-19T19:05:28.859 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:28.859 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:28.859 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:28.859 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:05:28.859 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:28 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.qtceex/trash_purge_schedule"}]: dispatch 2024-02-19T19:05:29.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:29 smithi046 ceph-mon[88928]: [19/Feb/2024:19:05:28] ENGINE Bus STARTING 2024-02-19T19:05:29.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:29 smithi046 ceph-mon[88928]: [19/Feb/2024:19:05:28] ENGINE Serving on http://172.21.15.46:8765 2024-02-19T19:05:29.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:29 smithi046 ceph-mon[88928]: mgrmap e36: smithi046.qtceex(active, since 1.01075s), standbys: smithi142.fwekwv 2024-02-19T19:05:29.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:29 smithi142 ceph-mon[37169]: [19/Feb/2024:19:05:28] ENGINE Bus STARTING 2024-02-19T19:05:29.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:29 smithi142 ceph-mon[37169]: [19/Feb/2024:19:05:28] ENGINE Serving on http://172.21.15.46:8765 2024-02-19T19:05:29.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:29 smithi142 ceph-mon[37169]: mgrmap e36: smithi046.qtceex(active, since 1.01075s), standbys: smithi142.fwekwv 2024-02-19T19:05:30.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:30 smithi142 ceph-mon[37169]: [19/Feb/2024:19:05:28] ENGINE Serving on https://172.21.15.46:7150 2024-02-19T19:05:30.738 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:30 smithi142 ceph-mon[37169]: [19/Feb/2024:19:05:28] ENGINE Bus STARTED 2024-02-19T19:05:30.738 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:30 smithi142 ceph-mon[37169]: pgmap v3: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:30 smithi046 ceph-mon[88928]: [19/Feb/2024:19:05:28] ENGINE Serving on https://172.21.15.46:7150 2024-02-19T19:05:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:30 smithi046 ceph-mon[88928]: [19/Feb/2024:19:05:28] ENGINE Bus STARTED 2024-02-19T19:05:30.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:30 smithi046 ceph-mon[88928]: pgmap v3: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:31.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:31 smithi046 ceph-mon[88928]: pgmap v4: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:31.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:31 smithi046 ceph-mon[88928]: mgrmap e37: smithi046.qtceex(active, since 3s), standbys: smithi142.fwekwv 2024-02-19T19:05:31.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:31.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:31.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:31 smithi142 ceph-mon[37169]: pgmap v4: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:31.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:31 smithi142 ceph-mon[37169]: mgrmap e37: smithi046.qtceex(active, since 3s), standbys: smithi142.fwekwv 2024-02-19T19:05:31.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:31 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:31.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:31 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:33.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:33 smithi046 ceph-mon[88928]: pgmap v5: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:33.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:33 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:33.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:33 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:33.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:33 smithi046 ceph-mon[88928]: mgrmap e38: smithi046.qtceex(active, since 4s), standbys: smithi142.fwekwv 2024-02-19T19:05:33.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:33 smithi142 ceph-mon[37169]: pgmap v5: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:33.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:33 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:33.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:33 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:33.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:33 smithi142 ceph-mon[37169]: mgrmap e38: smithi046.qtceex(active, since 4s), standbys: smithi142.fwekwv 2024-02-19T19:05:34.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:34 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:34.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:34 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:34.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:34 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:34.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:34 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:35.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:35 smithi046 ceph-mon[88928]: pgmap v6: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:35.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:35.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:35.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:35 smithi142 ceph-mon[37169]: pgmap v6: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:35.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:35 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:35.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:35 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:37.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:37 smithi142 ceph-mon[37169]: pgmap v7: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-19T19:05:37.777 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:37 smithi046 ceph-mon[88928]: pgmap v7: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-19T19:05:39.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: pgmap v8: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-19T19:05:39.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: Detected new or changed devices on smithi046 2024-02-19T19:05:39.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:39.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:39.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: Updating smithi046:/etc/ceph/ceph.conf 2024-02-19T19:05:39.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: Updating smithi142:/etc/ceph/ceph.conf 2024-02-19T19:05:39.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:05:39.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:05:39.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:39 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: pgmap v8: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: Detected new or changed devices on smithi046 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: Updating smithi046:/etc/ceph/ceph.conf 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: Updating smithi142:/etc/ceph/ceph.conf 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:39.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:40.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:40 smithi142 ceph-mon[37169]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:05:40.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:40 smithi142 ceph-mon[37169]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:05:40.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:40 smithi142 ceph-mon[37169]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:05:40.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:40 smithi142 ceph-mon[37169]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:05:40.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:40 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:40.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:40 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:40.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:40 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-19T19:05:40.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:40 smithi046 ceph-mon[88928]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:05:40.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:40 smithi046 ceph-mon[88928]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:05:40.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:40 smithi046 ceph-mon[88928]: Updating smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:05:40.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:40 smithi046 ceph-mon[88928]: Updating smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:05:40.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:40 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:40.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:40 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:40.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:40 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-19T19:05:41.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:41 smithi142 ceph-mon[37169]: pgmap v9: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:05:41.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:41 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:41.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:41 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:05:41.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:41 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:05:41.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:41 smithi142 ceph-mon[37169]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:41.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:41 smithi046 ceph-mon[88928]: pgmap v9: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:05:41.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:41.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:05:41.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:05:41.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:42.404 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:42 smithi046 ceph-mon[88928]: Upgrade: Updating mon.smithi142 2024-02-19T19:05:42.405 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:42 smithi046 ceph-mon[88928]: Deploying daemon mon.smithi142 on smithi142 2024-02-19T19:05:42.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:42 smithi142 ceph-mon[37169]: Upgrade: Updating mon.smithi142 2024-02-19T19:05:42.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:42 smithi142 ceph-mon[37169]: Deploying daemon mon.smithi142 on smithi142 2024-02-19T19:05:43.053 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:42 smithi142 systemd[1]: Stopping Ceph mon.smithi142 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:05:43.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:43 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142[37150]: 2024-02-19T19:05:43.032+0000 7fe87a626700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi142 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:05:43.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:43 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142[37150]: 2024-02-19T19:05:43.032+0000 7fe87a626700 -1 mon.smithi142@1(peon) e2 *** Got Signal Terminated *** 2024-02-19T19:05:43.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:43 smithi142 podman[68954]: 2024-02-19 19:05:43.124493679 +0000 UTC m=+0.214037797 container died 3f6c8b69abc2e25b18a10d68ce3a5618f481fd2f97856ae0e1ae906eb9245edf (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212) 2024-02-19T19:05:43.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:43 smithi142 podman[68954]: 2024-02-19 19:05:43.533330463 +0000 UTC m=+0.622874583 container cleanup 3f6c8b69abc2e25b18a10d68ce3a5618f481fd2f97856ae0e1ae906eb9245edf (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, io.buildah.version=1.29.1) 2024-02-19T19:05:43.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:43 smithi142 bash[68954]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142 2024-02-19T19:05:44.128 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:43 smithi142 podman[68969]: 2024-02-19 19:05:43.768322261 +0000 UTC m=+0.639024737 container remove 3f6c8b69abc2e25b18a10d68ce3a5618f481fd2f97856ae0e1ae906eb9245edf (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:05:44.129 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:43 smithi142 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi142.service: Deactivated successfully. 2024-02-19T19:05:44.129 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:43 smithi142 systemd[1]: Stopped Ceph mon.smithi142 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:05:44.129 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:43 smithi142 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi142.service: Consumed 7.094s CPU time. 2024-02-19T19:05:44.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 systemd[1]: Starting Ceph mon.smithi142 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:05:44.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 podman[69099]: 2024-02-19 19:05:44.225247492 +0000 UTC m=+0.017735541 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:05:44.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 podman[69099]: 2024-02-19 19:05:44.353126398 +0000 UTC m=+0.145614431 container create 013f41b4fcd9504daa7dcdb74ad5eebbf5bcc7c46ad6ef96e4be42cd5ff42bf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-02-19T19:05:44.742 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 podman[69099]: 2024-02-19 19:05:44.597767202 +0000 UTC m=+0.390255245 container init 013f41b4fcd9504daa7dcdb74ad5eebbf5bcc7c46ad6ef96e4be42cd5ff42bf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 podman[69099]: 2024-02-19 19:05:44.60126935 +0000 UTC m=+0.393757393 container start 013f41b4fcd9504daa7dcdb74ad5eebbf5bcc7c46ad6ef96e4be42cd5ff42bf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS) 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: set uid:gid to 167:167 (ceph:ceph) 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev), process ceph-mon, pid 2 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: pidfile_write: ignore empty --pid-file 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: load: jerasure load: lrc 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: RocksDB version: 7.9.2 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Git sha 0 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Compile date 2024-02-15 18:05:23 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: DB SUMMARY 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: DB Session ID: HB8G29FGGPSJMRXGBA2M 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: CURRENT file: CURRENT 2024-02-19T19:05:44.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: IDENTITY file: IDENTITY 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1403 Bytes 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi142/store.db dir, Total Num: 1, files: 000027.sst 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi142/store.db: 000025.log size: 7867594 ; 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.error_if_exists: 0 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.create_if_missing: 0 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.paranoid_checks: 1 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.env: 0x564d011f6ae0 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.fs: PosixFileSystem 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.info_log: 0x564d02b29760 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_file_opening_threads: 16 2024-02-19T19:05:44.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.statistics: (nil) 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.use_fsync: 0 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_log_file_size: 0 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.keep_log_file_num: 1000 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.recycle_log_file_num: 0 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.allow_fallocate: 1 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.allow_mmap_reads: 0 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.allow_mmap_writes: 0 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.use_direct_reads: 0 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.create_missing_column_families: 0 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.db_log_dir: 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.wal_dir: 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T19:05:44.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.advise_random_on_open: 1 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.db_write_buffer_size: 0 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.write_buffer_manager: 0x564d02afd400 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.rate_limiter: (nil) 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.wal_recovery_mode: 2 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.enable_thread_tracking: 0 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.enable_pipelined_write: 0 2024-02-19T19:05:44.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.unordered_write: 0 2024-02-19T19:05:44.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T19:05:44.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T19:05:44.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T19:05:44.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T19:05:44.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.row_cache: None 2024-02-19T19:05:44.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.wal_filter: None 2024-02-19T19:05:44.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T19:05:44.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.allow_ingest_behind: 0 2024-02-19T19:05:44.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.two_write_queues: 0 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.manual_wal_flush: 0 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.wal_compression: 0 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.atomic_flush: 0 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.log_readahead_size: 0 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.best_efforts_recovery: 0 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.allow_data_in_errors: 0 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.db_host_id: __hostname__ 2024-02-19T19:05:44.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_background_jobs: 2 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_background_compactions: -1 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_subcompactions: 1 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_total_wal_size: 0 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_open_files: -1 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bytes_per_sync: 0 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T19:05:44.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_readahead_size: 0 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_background_flushes: -1 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Compression algorithms supported: 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: kZSTD supported: 0 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: kXpressCompression supported: 0 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: kLZ4HCCompression supported: 1 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: kZlibCompression supported: 1 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: kSnappyCompression supported: 1 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: kLZ4Compression supported: 1 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: kBZip2Compression supported: 0 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi142/store.db/MANIFEST-000010 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T19:05:44.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.merge_operator: 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_filter: None 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_filter_factory: None 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.sst_partitioner_factory: None 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564d02b29880) 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: cache_index_and_filter_blocks: 1 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: pin_top_level_index_and_filter: 1 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_type: 0 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_block_index_type: 0 2024-02-19T19:05:44.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_shortening: 1 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: checksum: 4 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: no_block_cache: 0 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache: 0x564d02b2d090 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_name: BinnedLRUCache 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_options: 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: capacity : 536870912 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: num_shard_bits : 4 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: strict_capacity_limit : 0 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: high_pri_pool_ratio: 0.000 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_compressed: (nil) 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: persistent_cache: (nil) 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_size: 4096 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_size_deviation: 10 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_restart_interval: 16 2024-02-19T19:05:44.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_block_restart_interval: 1 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: metadata_block_size: 4096 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: partition_filters: 0 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: use_delta_encoding: 1 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: filter_policy: bloomfilter 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: whole_key_filtering: 1 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: verify_compression: 0 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: read_amp_bytes_per_bit: 0 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: format_version: 5 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: enable_index_compression: 1 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_align: 0 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_auto_readahead_size: 262144 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: prepopulate_block_cache: 0 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: initial_auto_readahead_size: 8192 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: num_file_reads_for_auto_readahead: 2 2024-02-19T19:05:44.754 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.write_buffer_size: 33554432 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_write_buffer_number: 2 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compression: NoCompression 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bottommost_compression: Disabled 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.prefix_extractor: nullptr 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.num_levels: 7 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-19T19:05:44.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compression_opts.level: 32767 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compression_opts.strategy: 0 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compression_opts.enabled: false 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T19:05:44.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.target_file_size_base: 67108864 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T19:05:44.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.arena_block_size: 1048576 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.disable_auto_compactions: 0 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T19:05:44.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.table_properties_collectors: 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.inplace_update_support: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.bloom_locality: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.max_successive_merges: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.paranoid_file_checks: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.force_consistency_checks: 1 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.report_bg_io_stats: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.ttl: 2592000 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-19T19:05:44.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.enable_blob_files: false 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.min_blob_size: 0 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.blob_file_size: 268435456 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.blob_file_starting_level: 0 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi142/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 11961, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-02-19T19:05:44.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ed15eb38-d3bb-466b-ab8c-fa8d7d1130af 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369544629975, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369544647473, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4704088, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11966, "largest_seqno": 15649, "table_properties": {"data_size": 4690986, "index_size": 8241, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3845, "raw_key_size": 33808, "raw_average_key_size": 22, "raw_value_size": 4660976, "raw_average_value_size": 3060, "num_data_blocks": 373, "num_entries": 1523, "num_filter_entries": 1523, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708369544, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ed15eb38-d3bb-466b-ab8c-fa8d7d1130af", "db_session_id": "HB8G29FGGPSJMRXGBA2M", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369544647584, "job": 1, "event": "recovery_finished"} 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi142/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564d02c1c000 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: DB pointer 0x564d02c08000 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** DB Stats ** 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T19:05:44.761 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** Compaction Stats [default] ** 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: L0 1/0 4.49 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 701.3 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: L6 1/0 5.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Sum 2/0 10.30 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 701.3 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 701.3 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-02-19T19:05:44.762 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** Compaction Stats [default] ** 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 701.3 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative compaction: 0.00 GB write, 203.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T19:05:44.763 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval compaction: 0.00 GB write, 203.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Block cache BinnedLRUCache@0x564d02b2d090#2 capacity: 512.00 MB usage: 13.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,9.08 KB,0.00173151%) Misc(1,0.00 KB,0%) 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: starting mon.smithi142 rank 1 at public addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] at bind addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi142 fsid c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: mon.smithi142@-1(???) e2 preinit fsid c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: mon.smithi142@-1(???).mds e17 new map 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: mon.smithi142@-1(???).mds e17 print_map 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: e17 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:05:44.764 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: legacy client fscid: 1 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Filesystem 'cephfs' (1) 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: fs_name cephfs 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: epoch 17 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: modified 2024-02-19T18:59:38.092640+0000 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: tableserver 0 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: root 0 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: session_timeout 60 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: session_autoclose 300 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_file_size 1099511627776 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_xattr_size 65536 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: required_client_features {} 2024-02-19T19:05:44.765 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: last_failure 0 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: last_failure_osd_epoch 46 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_mds 2 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: in 0,1 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: up {0=14494,1=24265} 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: failed 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: damaged 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: stopped 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_pools [3] 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: metadata_pool 2 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: inline_data disabled 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: balancer 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: bal_rank_mask -1 2024-02-19T19:05:44.766 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: standby_count_wanted 1 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Standby daemons: 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: mon.smithi142@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: mon.smithi142@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: mon.smithi142@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: mon.smithi142@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 ceph-mon[69118]: mon.smithi142@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-02-19T19:05:44.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 bash[69099]: 013f41b4fcd9504daa7dcdb74ad5eebbf5bcc7c46ad6ef96e4be42cd5ff42bf5 2024-02-19T19:05:45.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:44 smithi142 systemd[1]: Started Ceph mon.smithi142 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:05:45.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.645+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/1750456018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1edc100e80 msgr2=0x7f1edc104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:45.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.645+0000 7f1ee2cf7700 1 --2- 172.21.15.46:0/1750456018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1edc100e80 0x7f1edc104e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009910 tx=0x7f1ecc009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:45.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.645+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/1750456018 shutdown_connections 2024-02-19T19:05:45.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.645+0000 7f1ee2cf7700 1 --2- 172.21.15.46:0/1750456018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1edc100e80 0x7f1edc104e50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:45.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.645+0000 7f1ee2cf7700 1 --2- 172.21.15.46:0/1750456018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc1004e0 0x7f1edc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:45.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.645+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/1750456018 >> 172.21.15.46:0/1750456018 conn(0x7f1edc0fbda0 msgr2=0x7f1edc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:45.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.645+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/1750456018 shutdown_connections 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.645+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/1750456018 wait complete. 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.646+0000 7f1ee2cf7700 1 Processor -- start 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.646+0000 7f1ee2cf7700 1 -- start start 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.646+0000 7f1ee2cf7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc1004e0 0x7f1edc195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.646+0000 7f1ee2cf7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1edc100e80 0x7f1edc196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.646+0000 7f1ee2cf7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc196b30 con 0x7f1edc100e80 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.646+0000 7f1ee2cf7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc19a8c0 con 0x7f1edc1004e0 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1edbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1edc100e80 0x7f1edc196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1edbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1edc100e80 0x7f1edc196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38508/0 (socket says 172.21.15.46:38508) 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1edbfff700 1 -- 172.21.15.46:0/2581938738 learned_addr learned my addr 172.21.15.46:0/2581938738 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1ee0a93700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc1004e0 0x7f1edc195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1ee0a93700 1 -- 172.21.15.46:0/2581938738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc1004e0 msgr2=0x7f1edc195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-19T19:05:45.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1ee0a93700 1 -- 172.21.15.46:0/2581938738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc1004e0 msgr2=0x7f1edc195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1ee0a93700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc1004e0 0x7f1edc195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1ee0a93700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc1004e0 0x7f1edc195f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1edbfff700 1 -- 172.21.15.46:0/2581938738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc1004e0 msgr2=0x7f1edc195f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1edbfff700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc1004e0 0x7f1edc195f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1edbfff700 1 -- 172.21.15.46:0/2581938738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc0095f0 con 0x7f1edc100e80 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1edbfff700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1edc100e80 0x7f1edc196450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0092e0 tx=0x7f1ecc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1ed9ffb700 1 -- 172.21.15.46:0/2581938738 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ecc01d070 con 0x7f1edc100e80 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/2581938738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc19ab40 con 0x7f1edc100e80 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1ed9ffb700 1 -- 172.21.15.46:0/2581938738 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ecc005dc0 con 0x7f1edc100e80 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.647+0000 7f1ed9ffb700 1 -- 172.21.15.46:0/2581938738 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ecc017400 con 0x7f1edc100e80 2024-02-19T19:05:45.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.648+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/2581938738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc19b030 con 0x7f1edc100e80 2024-02-19T19:05:45.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.649+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/2581938738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc108850 con 0x7f1edc100e80 2024-02-19T19:05:45.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.649+0000 7f1ed9ffb700 1 -- 172.21.15.46:0/2581938738 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f1ecc003a60 con 0x7f1edc100e80 2024-02-19T19:05:45.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.650+0000 7f1ed9ffb700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1ec806d9e0 0x7f1ec806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:45.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.650+0000 7f1ed9ffb700 1 -- 172.21.15.46:0/2581938738 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1ecc08eb70 con 0x7f1edc100e80 2024-02-19T19:05:45.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.650+0000 7f1ee0a93700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1ec806d9e0 0x7f1ec806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:45.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.650+0000 7f1ee0a93700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1ec806d9e0 0x7f1ec806fe90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4005920 tx=0x7f1ec400b2c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:45.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.655+0000 7f1ed9ffb700 1 -- 172.21.15.46:0/2581938738 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1ecc058230 con 0x7f1edc100e80 2024-02-19T19:05:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.880+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/2581938738 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1edc1972e0 con 0x7f1ec806d9e0 2024-02-19T19:05:45.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.881+0000 7f1ed9ffb700 1 -- 172.21.15.46:0/2581938738 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1edc1972e0 con 0x7f1ec806d9e0 2024-02-19T19:05:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/2581938738 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1ec806d9e0 msgr2=0x7f1ec806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1ec806d9e0 0x7f1ec806fe90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4005920 tx=0x7f1ec400b2c0 comp rx=0 tx=0).stop 2024-02-19T19:05:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/2581938738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1edc100e80 msgr2=0x7f1edc196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1edc100e80 0x7f1edc196450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0092e0 tx=0x7f1ecc00be20 comp rx=0 tx=0).stop 2024-02-19T19:05:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/2581938738 shutdown_connections 2024-02-19T19:05:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1ec806d9e0 0x7f1ec806fe90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc1004e0 0x7f1edc195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 --2- 172.21.15.46:0/2581938738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1edc100e80 0x7f1edc196450 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/2581938738 >> 172.21.15.46:0/2581938738 conn(0x7f1edc0fbda0 msgr2=0x7f1edc0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/2581938738 shutdown_connections 2024-02-19T19:05:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.884+0000 7f1ee2cf7700 1 -- 172.21.15.46:0/2581938738 wait complete. 2024-02-19T19:05:45.914 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:05:46.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.992+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2235815875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cf80ffd60 msgr2=0x7f7cf8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:46.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.992+0000 7f7cffcfc700 1 --2- 172.21.15.46:0/2235815875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cf80ffd60 0x7f7cf8103d30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009910 tx=0x7f7ce8009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:46.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.992+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2235815875 shutdown_connections 2024-02-19T19:05:46.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.992+0000 7f7cffcfc700 1 --2- 172.21.15.46:0/2235815875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cf80ffd60 0x7f7cf8103d30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.992+0000 7f7cffcfc700 1 --2- 172.21.15.46:0/2235815875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf80ff3c0 0x7f7cf80ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.992+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2235815875 >> 172.21.15.46:0/2235815875 conn(0x7f7cf80fac60 msgr2=0x7f7cf80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:46.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.992+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2235815875 shutdown_connections 2024-02-19T19:05:46.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.992+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2235815875 wait complete. 2024-02-19T19:05:46.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.992+0000 7f7cffcfc700 1 Processor -- start 2024-02-19T19:05:46.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cffcfc700 1 -- start start 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cffcfc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf80ff3c0 0x7f7cf810a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cffcfc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cf80ffd60 0x7f7cf810a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cffcfc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf810ab20 con 0x7f7cf80ffd60 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cffcfc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf810ac60 con 0x7f7cf80ff3c0 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfd297700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cf80ffd60 0x7f7cf810a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfd297700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cf80ffd60 0x7f7cf810a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38532/0 (socket says 172.21.15.46:38532) 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfd297700 1 -- 172.21.15.46:0/2762708920 learned_addr learned my addr 172.21.15.46:0/2762708920 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfda98700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf80ff3c0 0x7f7cf810a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfda98700 1 -- 172.21.15.46:0/2762708920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf80ff3c0 msgr2=0x7f7cf810a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfda98700 1 -- 172.21.15.46:0/2762708920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf80ff3c0 msgr2=0x7f7cf810a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfda98700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf80ff3c0 0x7f7cf810a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfda98700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf80ff3c0 0x7f7cf810a0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:05:46.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfd297700 1 -- 172.21.15.46:0/2762708920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf80ff3c0 msgr2=0x7f7cf810a0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:05:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfd297700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf80ff3c0 0x7f7cf810a0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfd297700 1 -- 172.21.15.46:0/2762708920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce80095f0 con 0x7f7cf80ffd60 2024-02-19T19:05:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.993+0000 7f7cfd297700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cf80ffd60 0x7f7cf810a5e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80092e0 tx=0x7f7ce800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.994+0000 7f7ceeffd700 1 -- 172.21.15.46:0/2762708920 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ce801d070 con 0x7f7cf80ffd60 2024-02-19T19:05:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.994+0000 7f7ceeffd700 1 -- 172.21.15.46:0/2762708920 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ce8005dc0 con 0x7f7cf80ffd60 2024-02-19T19:05:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.994+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2762708920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf810aee0 con 0x7f7cf80ffd60 2024-02-19T19:05:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.994+0000 7f7ceeffd700 1 -- 172.21.15.46:0/2762708920 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ce8017400 con 0x7f7cf80ffd60 2024-02-19T19:05:46.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.994+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2762708920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf81a2420 con 0x7f7cf80ffd60 2024-02-19T19:05:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.995+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2762708920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf8107730 con 0x7f7cf80ffd60 2024-02-19T19:05:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.995+0000 7f7ceeffd700 1 -- 172.21.15.46:0/2762708920 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f7ce800f460 con 0x7f7cf80ffd60 2024-02-19T19:05:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.996+0000 7f7ceeffd700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ce406d9e0 0x7f7ce406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.996+0000 7f7ceeffd700 1 -- 172.21.15.46:0/2762708920 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7ce808ebd0 con 0x7f7cf80ffd60 2024-02-19T19:05:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.996+0000 7f7cfda98700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ce406d9e0 0x7f7ce406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:46.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:45.996+0000 7f7cfda98700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ce406d9e0 0x7f7ce406fe90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00098c0 tx=0x7f7cf0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:46.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.001+0000 7f7ceeffd700 1 -- 172.21.15.46:0/2762708920 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ce8058210 con 0x7f7cf80ffd60 2024-02-19T19:05:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.190+0000 7f7ceeffd700 1 -- 172.21.15.46:0/2762708920 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ce8058210 con 0x7f7cf80ffd60 2024-02-19T19:05:46.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.239+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2762708920 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cf810b640 con 0x7f7ce406d9e0 2024-02-19T19:05:46.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.240+0000 7f7ceeffd700 1 -- 172.21.15.46:0/2762708920 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7cf810b640 con 0x7f7ce406d9e0 2024-02-19T19:05:46.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.242+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2762708920 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ce406d9e0 msgr2=0x7f7ce406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:46.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.242+0000 7f7cffcfc700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ce406d9e0 0x7f7ce406fe90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00098c0 tx=0x7f7cf0009040 comp rx=0 tx=0).stop 2024-02-19T19:05:46.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.242+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2762708920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cf80ffd60 msgr2=0x7f7cf810a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:46.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.242+0000 7f7cffcfc700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cf80ffd60 0x7f7cf810a5e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80092e0 tx=0x7f7ce800be20 comp rx=0 tx=0).stop 2024-02-19T19:05:46.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.242+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2762708920 shutdown_connections 2024-02-19T19:05:46.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.242+0000 7f7cffcfc700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ce406d9e0 0x7f7ce406fe90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:46 smithi046 ceph-mon[88928]: pgmap v10: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:05:46.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:46 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.242+0000 7f7cffcfc700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf80ff3c0 0x7f7cf810a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.242+0000 7f7cffcfc700 1 --2- 172.21.15.46:0/2762708920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7cf80ffd60 0x7f7cf810a5e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.242+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2762708920 >> 172.21.15.46:0/2762708920 conn(0x7f7cf80fac60 msgr2=0x7f7cf80fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.243+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2762708920 shutdown_connections 2024-02-19T19:05:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.243+0000 7f7cffcfc700 1 -- 172.21.15.46:0/2762708920 wait complete. 2024-02-19T19:05:46.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.350+0000 7f39b3c13700 1 -- 172.21.15.46:0/862597812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39ac101d20 msgr2=0x7f39ac10a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:46.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.350+0000 7f39b3c13700 1 --2- 172.21.15.46:0/862597812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39ac101d20 0x7f39ac10a220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f399c009910 tx=0x7f399c009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:46.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.350+0000 7f39b3c13700 1 -- 172.21.15.46:0/862597812 shutdown_connections 2024-02-19T19:05:46.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.350+0000 7f39b3c13700 1 --2- 172.21.15.46:0/862597812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39ac101d20 0x7f39ac10a220 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.350+0000 7f39b3c13700 1 --2- 172.21.15.46:0/862597812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ac101410 0x7f39ac1017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.350+0000 7f39b3c13700 1 -- 172.21.15.46:0/862597812 >> 172.21.15.46:0/862597812 conn(0x7f39ac0fac90 msgr2=0x7f39ac0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:46.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.351+0000 7f39b3c13700 1 -- 172.21.15.46:0/862597812 shutdown_connections 2024-02-19T19:05:46.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.351+0000 7f39b3c13700 1 -- 172.21.15.46:0/862597812 wait complete. 2024-02-19T19:05:46.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.351+0000 7f39b3c13700 1 Processor -- start 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.351+0000 7f39b3c13700 1 -- start start 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.351+0000 7f39b3c13700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39ac101410 0x7f39ac195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.351+0000 7f39b3c13700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ac101d20 0x7f39ac196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.351+0000 7f39b3c13700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac196a60 con 0x7f39ac101410 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.351+0000 7f39b3c13700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac19a7f0 con 0x7f39ac101d20 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b19af700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39ac101410 0x7f39ac195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b19af700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39ac101410 0x7f39ac195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38550/0 (socket says 172.21.15.46:38550) 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b19af700 1 -- 172.21.15.46:0/1896150951 learned_addr learned my addr 172.21.15.46:0/1896150951 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b11ae700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ac101d20 0x7f39ac196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b11ae700 1 -- 172.21.15.46:0/1896150951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ac101d20 msgr2=0x7f39ac196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b11ae700 1 -- 172.21.15.46:0/1896150951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ac101d20 msgr2=0x7f39ac196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b11ae700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ac101d20 0x7f39ac196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:05:46.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b11ae700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ac101d20 0x7f39ac196380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b19af700 1 -- 172.21.15.46:0/1896150951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ac101d20 msgr2=0x7f39ac196380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b19af700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ac101d20 0x7f39ac196380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b19af700 1 -- 172.21.15.46:0/1896150951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c0095f0 con 0x7f39ac101410 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b19af700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39ac101410 0x7f39ac195e40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f39a80060b0 tx=0x7f39a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39a2ffd700 1 -- 172.21.15.46:0/1896150951 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39a800dda0 con 0x7f39ac101410 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39a2ffd700 1 -- 172.21.15.46:0/1896150951 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39a800f040 con 0x7f39ac101410 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b3c13700 1 -- 172.21.15.46:0/1896150951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac19aad0 con 0x7f39ac101410 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39a2ffd700 1 -- 172.21.15.46:0/1896150951 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39a8014790 con 0x7f39ac101410 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.352+0000 7f39b3c13700 1 -- 172.21.15.46:0/1896150951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac19b020 con 0x7f39ac101410 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.353+0000 7f39b3c13700 1 -- 172.21.15.46:0/1896150951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ac107890 con 0x7f39ac101410 2024-02-19T19:05:46.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.354+0000 7f39a2ffd700 1 -- 172.21.15.46:0/1896150951 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f39a80148f0 con 0x7f39ac101410 2024-02-19T19:05:46.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.354+0000 7f39a2ffd700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f399806d9e0 0x7f399806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:46.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.354+0000 7f39a2ffd700 1 -- 172.21.15.46:0/1896150951 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f39a808d0b0 con 0x7f39ac101410 2024-02-19T19:05:46.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.354+0000 7f39b11ae700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f399806d9e0 0x7f399806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:46.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.355+0000 7f39b11ae700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f399806d9e0 0x7f399806fe90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f399c005b40 tx=0x7f399c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:46.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.359+0000 7f39a2ffd700 1 -- 172.21.15.46:0/1896150951 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f39a8056820 con 0x7f39ac101410 2024-02-19T19:05:46.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:46 smithi142 ceph-mon[69118]: pgmap v10: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:05:46.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:46 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:46.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.578+0000 7f39b3c13700 1 -- 172.21.15.46:0/1896150951 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f39ac19b350 con 0x7f399806d9e0 2024-02-19T19:05:46.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.589+0000 7f39a2ffd700 1 -- 172.21.15.46:0/1896150951 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f39ac19b350 con 0x7f399806d9e0 2024-02-19T19:05:46.609 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:05:46.609 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (2m) 13s ago 12m 26.2M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:05:46.609 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (12m) 13s ago 12m 7952k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:05:46.609 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (11m) 15s ago 11m 7872k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:05:46.609 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (12m) 13s ago 12m 6660k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (11m) 15s ago 11m 6669k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (93s) 13s ago 11m 81.0M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (6m) 13s ago 6m 26.4M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (6m) 13s ago 6m 15.4M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (6m) 15s ago 6m 15.7M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (6m) 15s ago 6m 25.0M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (3m) 13s ago 13m 475M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (3m) 15s ago 10m 446M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (27s) 13s ago 14m 28.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 starting - - - 2048M 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (2m) 13s ago 12m 16.4M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (2m) 15s ago 10m 8158k - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (10m) 13s ago 10m 51.7M 1217M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (9m) 13s ago 9m 50.7M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:05:46.610 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (9m) 13s ago 9m 51.9M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:05:46.611 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (8m) 15s ago 8m 49.1M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:05:46.611 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (8m) 15s ago 8m 47.2M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:05:46.611 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (7m) 15s ago 7m 48.2M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:05:46.611 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (2m) 13s ago 11m 58.2M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:05:46.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 -- 172.21.15.46:0/1896150951 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f399806d9e0 msgr2=0x7f399806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:46.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f399806d9e0 0x7f399806fe90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f399c005b40 tx=0x7f399c01a040 comp rx=0 tx=0).stop 2024-02-19T19:05:46.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 -- 172.21.15.46:0/1896150951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39ac101410 msgr2=0x7f39ac195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:46.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39ac101410 0x7f39ac195e40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f39a80060b0 tx=0x7f39a800d3b0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 -- 172.21.15.46:0/1896150951 shutdown_connections 2024-02-19T19:05:46.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f399806d9e0 0x7f399806fe90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39ac101410 0x7f39ac195e40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 --2- 172.21.15.46:0/1896150951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ac101d20 0x7f39ac196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 -- 172.21.15.46:0/1896150951 >> 172.21.15.46:0/1896150951 conn(0x7f39ac0fac90 msgr2=0x7f39ac1049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:46.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 -- 172.21.15.46:0/1896150951 shutdown_connections 2024-02-19T19:05:46.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.591+0000 7f39b3c13700 1 -- 172.21.15.46:0/1896150951 wait complete. 2024-02-19T19:05:46.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.696+0000 7f6358b7d700 1 -- 172.21.15.46:0/1402957013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6354100e80 msgr2=0x7f6354104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:46.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.696+0000 7f6358b7d700 1 --2- 172.21.15.46:0/1402957013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6354100e80 0x7f6354104e50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6348009910 tx=0x7f6348009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:46.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.696+0000 7f6358b7d700 1 -- 172.21.15.46:0/1402957013 shutdown_connections 2024-02-19T19:05:46.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.696+0000 7f6358b7d700 1 --2- 172.21.15.46:0/1402957013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6354100e80 0x7f6354104e50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.696+0000 7f6358b7d700 1 --2- 172.21.15.46:0/1402957013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63541004e0 0x7f63541008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.696+0000 7f6358b7d700 1 -- 172.21.15.46:0/1402957013 >> 172.21.15.46:0/1402957013 conn(0x7f63540fbda0 msgr2=0x7f63540fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:46.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.696+0000 7f6358b7d700 1 -- 172.21.15.46:0/1402957013 shutdown_connections 2024-02-19T19:05:46.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.696+0000 7f6358b7d700 1 -- 172.21.15.46:0/1402957013 wait complete. 2024-02-19T19:05:46.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.697+0000 7f6358b7d700 1 Processor -- start 2024-02-19T19:05:46.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.697+0000 7f6358b7d700 1 -- start start 2024-02-19T19:05:46.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.697+0000 7f6358b7d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63541004e0 0x7f6354195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:46.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.697+0000 7f6358b7d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6354100e80 0x7f6354196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:46.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.697+0000 7f6358b7d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6354196b30 con 0x7f6354100e80 2024-02-19T19:05:46.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.697+0000 7f6358b7d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635419a8c0 con 0x7f63541004e0 2024-02-19T19:05:46.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f6351d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6354100e80 0x7f6354196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:46.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f6351d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6354100e80 0x7f6354196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38558/0 (socket says 172.21.15.46:38558) 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f6351d9b700 1 -- 172.21.15.46:0/596126866 learned_addr learned my addr 172.21.15.46:0/596126866 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f635259c700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63541004e0 0x7f6354195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f635259c700 1 -- 172.21.15.46:0/596126866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63541004e0 msgr2=0x7f6354195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f635259c700 1 -- 172.21.15.46:0/596126866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63541004e0 msgr2=0x7f6354195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f635259c700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63541004e0 0x7f6354195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f635259c700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63541004e0 0x7f6354195f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f6351d9b700 1 -- 172.21.15.46:0/596126866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63541004e0 msgr2=0x7f6354195f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f6351d9b700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63541004e0 0x7f6354195f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f6351d9b700 1 -- 172.21.15.46:0/596126866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63480095f0 con 0x7f6354100e80 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f6351d9b700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6354100e80 0x7f6354196450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63480092e0 tx=0x7f634800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f63437fe700 1 -- 172.21.15.46:0/596126866 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f634801d070 con 0x7f6354100e80 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f6358b7d700 1 -- 172.21.15.46:0/596126866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635419ab40 con 0x7f6354100e80 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f63437fe700 1 -- 172.21.15.46:0/596126866 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6348005dc0 con 0x7f6354100e80 2024-02-19T19:05:46.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f63437fe700 1 -- 172.21.15.46:0/596126866 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6348017400 con 0x7f6354100e80 2024-02-19T19:05:46.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.698+0000 7f6358b7d700 1 -- 172.21.15.46:0/596126866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635419b030 con 0x7f6354100e80 2024-02-19T19:05:46.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.699+0000 7f6358b7d700 1 -- 172.21.15.46:0/596126866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6354108850 con 0x7f6354100e80 2024-02-19T19:05:46.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.700+0000 7f63437fe700 1 -- 172.21.15.46:0/596126866 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f634800f460 con 0x7f6354100e80 2024-02-19T19:05:46.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.700+0000 7f63437fe700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f633c06d9e0 0x7f633c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:46.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.700+0000 7f63437fe700 1 -- 172.21.15.46:0/596126866 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f634808ec00 con 0x7f6354100e80 2024-02-19T19:05:46.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.700+0000 7f635259c700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f633c06d9e0 0x7f633c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:46.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.701+0000 7f635259c700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f633c06d9e0 0x7f633c06fe90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6344005920 tx=0x7f634400b2c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:46.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.705+0000 7f63437fe700 1 -- 172.21.15.46:0/596126866 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6348058240 con 0x7f6354100e80 2024-02-19T19:05:47.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:46.999+0000 7f6358b7d700 1 -- 172.21.15.46:0/596126866 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f635404f2a0 con 0x7f6354100e80 2024-02-19T19:05:47.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.000+0000 7f63437fe700 1 -- 172.21.15.46:0/596126866 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f634805b900 con 0x7f6354100e80 2024-02-19T19:05:47.020 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:05:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:05:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:05:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:05:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:05:47.022 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:05:47.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 -- 172.21.15.46:0/596126866 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f633c06d9e0 msgr2=0x7f633c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:47.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f633c06d9e0 0x7f633c06fe90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6344005920 tx=0x7f634400b2c0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 -- 172.21.15.46:0/596126866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6354100e80 msgr2=0x7f6354196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:47.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6354100e80 0x7f6354196450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63480092e0 tx=0x7f634800be20 comp rx=0 tx=0).stop 2024-02-19T19:05:47.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 -- 172.21.15.46:0/596126866 shutdown_connections 2024-02-19T19:05:47.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f633c06d9e0 0x7f633c06fe90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63541004e0 0x7f6354195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 --2- 172.21.15.46:0/596126866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6354100e80 0x7f6354196450 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 -- 172.21.15.46:0/596126866 >> 172.21.15.46:0/596126866 conn(0x7f63540fbda0 msgr2=0x7f63540fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:47.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 -- 172.21.15.46:0/596126866 shutdown_connections 2024-02-19T19:05:47.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.002+0000 7f6358b7d700 1 -- 172.21.15.46:0/596126866 wait complete. 2024-02-19T19:05:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.109+0000 7fd98117b700 1 -- 172.21.15.46:0/1451669511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c068540 msgr2=0x7fd97c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.109+0000 7fd98117b700 1 --2- 172.21.15.46:0/1451669511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c068540 0x7fd97c0689b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd964009910 tx=0x7fd964009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.109+0000 7fd98117b700 1 -- 172.21.15.46:0/1451669511 shutdown_connections 2024-02-19T19:05:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.109+0000 7fd98117b700 1 --2- 172.21.15.46:0/1451669511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c068540 0x7fd97c0689b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.109+0000 7fd98117b700 1 --2- 172.21.15.46:0/1451669511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c106320 0x7fd97c1066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.109+0000 7fd98117b700 1 -- 172.21.15.46:0/1451669511 >> 172.21.15.46:0/1451669511 conn(0x7fd97c075130 msgr2=0x7fd97c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.109+0000 7fd98117b700 1 -- 172.21.15.46:0/1451669511 shutdown_connections 2024-02-19T19:05:47.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.109+0000 7fd98117b700 1 -- 172.21.15.46:0/1451669511 wait complete. 2024-02-19T19:05:47.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.109+0000 7fd98117b700 1 Processor -- start 2024-02-19T19:05:47.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd98117b700 1 -- start start 2024-02-19T19:05:47.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd98117b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c068540 0x7fd97c195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd98117b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c106320 0x7fd97c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd98117b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c196a80 con 0x7fd97c106320 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd98117b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c19a810 con 0x7fd97c068540 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c106320 0x7fd97c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c106320 0x7fd97c1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38566/0 (socket says 172.21.15.46:38566) 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97a59c700 1 -- 172.21.15.46:0/51127535 learned_addr learned my addr 172.21.15.46:0/51127535 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97ad9d700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c068540 0x7fd97c195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97ad9d700 1 -- 172.21.15.46:0/51127535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c068540 msgr2=0x7fd97c195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97ad9d700 1 -- 172.21.15.46:0/51127535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c068540 msgr2=0x7fd97c195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97ad9d700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c068540 0x7fd97c195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97ad9d700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c068540 0x7fd97c195e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:05:47.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97a59c700 1 -- 172.21.15.46:0/51127535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c068540 msgr2=0x7fd97c195e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:05:47.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97a59c700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c068540 0x7fd97c195e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97a59c700 1 -- 172.21.15.46:0/51127535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640095f0 con 0x7fd97c106320 2024-02-19T19:05:47.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.110+0000 7fd97a59c700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c106320 0x7fd97c1963a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd964006010 tx=0x7fd96400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:47.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.111+0000 7fd973fff700 1 -- 172.21.15.46:0/51127535 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd96401d070 con 0x7fd97c106320 2024-02-19T19:05:47.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.111+0000 7fd973fff700 1 -- 172.21.15.46:0/51127535 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd96400f460 con 0x7fd97c106320 2024-02-19T19:05:47.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.111+0000 7fd98117b700 1 -- 172.21.15.46:0/51127535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97c19aa90 con 0x7fd97c106320 2024-02-19T19:05:47.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.111+0000 7fd973fff700 1 -- 172.21.15.46:0/51127535 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd964017630 con 0x7fd97c106320 2024-02-19T19:05:47.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.111+0000 7fd98117b700 1 -- 172.21.15.46:0/51127535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c19af80 con 0x7fd97c106320 2024-02-19T19:05:47.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.112+0000 7fd98117b700 1 -- 172.21.15.46:0/51127535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97c108770 con 0x7fd97c106320 2024-02-19T19:05:47.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.112+0000 7fd973fff700 1 -- 172.21.15.46:0/51127535 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fd96400f5d0 con 0x7fd97c106320 2024-02-19T19:05:47.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.113+0000 7fd973fff700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd96806d9e0 0x7fd96806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:47.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.113+0000 7fd973fff700 1 -- 172.21.15.46:0/51127535 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd96408ebc0 con 0x7fd97c106320 2024-02-19T19:05:47.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.113+0000 7fd97ad9d700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd96806d9e0 0x7fd96806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:47.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.113+0000 7fd97ad9d700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd96806d9e0 0x7fd96806fe90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd974005920 tx=0x7fd97400b2c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:47.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.117+0000 7fd973fff700 1 -- 172.21.15.46:0/51127535 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd964058200 con 0x7fd97c106320 2024-02-19T19:05:47.320 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: pgmap v12: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:05:47.320 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:47.320 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T19:05:47.320 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: mon.smithi142 calling monitor election 2024-02-19T19:05:47.320 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: mon.smithi046 calling monitor election 2024-02-19T19:05:47.320 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T19:05:47.320 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: mon.smithi046 is new leader, mons smithi046,smithi142 in quorum (ranks 0,1) 2024-02-19T19:05:47.320 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: monmap e3: 2 mons at {smithi046=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T19:05:47.321 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: fsmap cephfs:2 {0=cephfs.smithi046.bwvkwa=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T19:05:47.321 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: osdmap e49: 6 total, 6 up, 6 in 2024-02-19T19:05:47.321 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: mgrmap e38: smithi046.qtceex(active, since 18s), standbys: smithi142.fwekwv 2024-02-19T19:05:47.321 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: overall HEALTH_OK 2024-02-19T19:05:47.321 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:47.321 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:47.321 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:47.321 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:47.321 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:47 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/596126866' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:47.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: pgmap v12: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:05:47.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: mon.smithi142 calling monitor election 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: mon.smithi046 calling monitor election 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: mon.smithi046 is new leader, mons smithi046,smithi142 in quorum (ranks 0,1) 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: monmap e3: 2 mons at {smithi046=[v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0],smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: fsmap cephfs:2 {0=cephfs.smithi046.bwvkwa=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: osdmap e49: 6 total, 6 up, 6 in 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: mgrmap e38: smithi046.qtceex(active, since 18s), standbys: smithi142.fwekwv 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: overall HEALTH_OK 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:47 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/596126866' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:47.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.378+0000 7fd98117b700 1 -- 172.21.15.46:0/51127535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd97c04f2a0 con 0x7fd97c106320 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.378+0000 7fd973fff700 1 -- 172.21.15.46:0/51127535 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1856 (secure 0 0 0) 0x7fd96405b8c0 con 0x7fd97c106320 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:e17 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 17 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:05:47.399 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T18:59:38.092640+0000 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:05:47.400 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:05:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:05:47.402 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:05:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:05:47.402 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:47.402 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:05:47.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.380+0000 7fd98117b700 1 -- 172.21.15.46:0/51127535 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd96806d9e0 msgr2=0x7fd96806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:47.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.381+0000 7fd98117b700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd96806d9e0 0x7fd96806fe90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd974005920 tx=0x7fd97400b2c0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.381+0000 7fd98117b700 1 -- 172.21.15.46:0/51127535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c106320 msgr2=0x7fd97c1963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:47.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.381+0000 7fd98117b700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c106320 0x7fd97c1963a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd964006010 tx=0x7fd96400be20 comp rx=0 tx=0).stop 2024-02-19T19:05:47.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.381+0000 7fd98117b700 1 -- 172.21.15.46:0/51127535 shutdown_connections 2024-02-19T19:05:47.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.381+0000 7fd98117b700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd96806d9e0 0x7fd96806fe90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.381+0000 7fd98117b700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd97c068540 0x7fd97c195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.381+0000 7fd98117b700 1 --2- 172.21.15.46:0/51127535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd97c106320 0x7fd97c1963a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.381+0000 7fd98117b700 1 -- 172.21.15.46:0/51127535 >> 172.21.15.46:0/51127535 conn(0x7fd97c075130 msgr2=0x7fd97c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:47.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.381+0000 7fd98117b700 1 -- 172.21.15.46:0/51127535 shutdown_connections 2024-02-19T19:05:47.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.381+0000 7fd98117b700 1 -- 172.21.15.46:0/51127535 wait complete. 2024-02-19T19:05:47.403 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T19:05:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.496+0000 7f8d44d40700 1 -- 172.21.15.46:0/3133445524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d40101420 msgr2=0x7f8d401017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.496+0000 7f8d44d40700 1 --2- 172.21.15.46:0/3133445524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d40101420 0x7f8d401017f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009910 tx=0x7f8d34009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.496+0000 7f8d44d40700 1 -- 172.21.15.46:0/3133445524 shutdown_connections 2024-02-19T19:05:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.496+0000 7f8d44d40700 1 --2- 172.21.15.46:0/3133445524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d40101d30 0x7f8d4010a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.496+0000 7f8d44d40700 1 --2- 172.21.15.46:0/3133445524 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d40101420 0x7f8d401017f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.496+0000 7f8d44d40700 1 -- 172.21.15.46:0/3133445524 >> 172.21.15.46:0/3133445524 conn(0x7f8d400fac60 msgr2=0x7f8d400fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.496+0000 7f8d44d40700 1 -- 172.21.15.46:0/3133445524 shutdown_connections 2024-02-19T19:05:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.496+0000 7f8d44d40700 1 -- 172.21.15.46:0/3133445524 wait complete. 2024-02-19T19:05:47.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.497+0000 7f8d44d40700 1 Processor -- start 2024-02-19T19:05:47.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.497+0000 7f8d44d40700 1 -- start start 2024-02-19T19:05:47.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d44d40700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d40101420 0x7f8d40195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:47.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d44d40700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d40101d30 0x7f8d40196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:47.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d44d40700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d40196a70 con 0x7f8d40101420 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d44d40700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4019a800 con 0x7f8d40101d30 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d40101420 0x7f8d40195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d40101420 0x7f8d40195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34046/0 (socket says 172.21.15.46:34046) 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3e59c700 1 -- 172.21.15.46:0/496915009 learned_addr learned my addr 172.21.15.46:0/496915009 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3dd9b700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d40101d30 0x7f8d40196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3dd9b700 1 -- 172.21.15.46:0/496915009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d40101d30 msgr2=0x7f8d40196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3dd9b700 1 -- 172.21.15.46:0/496915009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d40101d30 msgr2=0x7f8d40196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3dd9b700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d40101d30 0x7f8d40196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3dd9b700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d40101d30 0x7f8d40196390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3e59c700 1 -- 172.21.15.46:0/496915009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d40101d30 msgr2=0x7f8d40196390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3e59c700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d40101d30 0x7f8d40196390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3e59c700 1 -- 172.21.15.46:0/496915009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340095f0 con 0x7f8d40101420 2024-02-19T19:05:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d3e59c700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d40101420 0x7f8d40195e50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8d34006010 tx=0x7f8d3400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.498+0000 7f8d2f7fe700 1 -- 172.21.15.46:0/496915009 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d3401d070 con 0x7f8d40101420 2024-02-19T19:05:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.499+0000 7f8d2f7fe700 1 -- 172.21.15.46:0/496915009 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d3400f460 con 0x7f8d40101420 2024-02-19T19:05:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.499+0000 7f8d44d40700 1 -- 172.21.15.46:0/496915009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4019aa80 con 0x7f8d40101420 2024-02-19T19:05:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.499+0000 7f8d2f7fe700 1 -- 172.21.15.46:0/496915009 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d34017630 con 0x7f8d40101420 2024-02-19T19:05:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.499+0000 7f8d44d40700 1 -- 172.21.15.46:0/496915009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4019af70 con 0x7f8d40101420 2024-02-19T19:05:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.500+0000 7f8d44d40700 1 -- 172.21.15.46:0/496915009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d401078d0 con 0x7f8d40101420 2024-02-19T19:05:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.500+0000 7f8d2f7fe700 1 -- 172.21.15.46:0/496915009 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f8d340178a0 con 0x7f8d40101420 2024-02-19T19:05:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.501+0000 7f8d2f7fe700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8d2806d9e0 0x7f8d2806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.501+0000 7f8d2f7fe700 1 -- 172.21.15.46:0/496915009 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8d3408eb90 con 0x7f8d40101420 2024-02-19T19:05:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.501+0000 7f8d3dd9b700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8d2806d9e0 0x7f8d2806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.501+0000 7f8d3dd9b700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8d2806d9e0 0x7f8d2806fe90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8d30005950 tx=0x7f8d300058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:47.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.505+0000 7f8d2f7fe700 1 -- 172.21.15.46:0/496915009 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8d340581d0 con 0x7f8d40101420 2024-02-19T19:05:47.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.738+0000 7f8d44d40700 1 -- 172.21.15.46:0/496915009 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d4019b250 con 0x7f8d2806d9e0 2024-02-19T19:05:47.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.740+0000 7f8d2f7fe700 1 -- 172.21.15.46:0/496915009 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8d4019b250 con 0x7f8d2806d9e0 2024-02-19T19:05:47.760 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:05:47.760 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:05:47.760 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:05:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:05:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:05:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:05:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:05:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "3/23 daemons upgraded", 2024-02-19T19:05:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mon daemons", 2024-02-19T19:05:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:05:47.761 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 -- 172.21.15.46:0/496915009 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8d2806d9e0 msgr2=0x7f8d2806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8d2806d9e0 0x7f8d2806fe90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8d30005950 tx=0x7f8d300058e0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 -- 172.21.15.46:0/496915009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d40101420 msgr2=0x7f8d40195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d40101420 0x7f8d40195e50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8d34006010 tx=0x7f8d3400be20 comp rx=0 tx=0).stop 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 -- 172.21.15.46:0/496915009 shutdown_connections 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8d2806d9e0 0x7f8d2806fe90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d40101420 0x7f8d40195e50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 --2- 172.21.15.46:0/496915009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d40101d30 0x7f8d40196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 -- 172.21.15.46:0/496915009 >> 172.21.15.46:0/496915009 conn(0x7f8d400fac60 msgr2=0x7f8d40104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 -- 172.21.15.46:0/496915009 shutdown_connections 2024-02-19T19:05:47.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.742+0000 7f8d44d40700 1 -- 172.21.15.46:0/496915009 wait complete. 2024-02-19T19:05:47.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.849+0000 7f9330a97700 1 -- 172.21.15.46:0/2031706328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f932c100e40 msgr2=0x7f932c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:47.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.849+0000 7f9330a97700 1 --2- 172.21.15.46:0/2031706328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f932c100e40 0x7f932c104e10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f931c009910 tx=0x7f931c009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:47.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.849+0000 7f9330a97700 1 -- 172.21.15.46:0/2031706328 shutdown_connections 2024-02-19T19:05:47.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.849+0000 7f9330a97700 1 --2- 172.21.15.46:0/2031706328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f932c100e40 0x7f932c104e10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.849+0000 7f9330a97700 1 --2- 172.21.15.46:0/2031706328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f932c1004a0 0x7f932c100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.849+0000 7f9330a97700 1 -- 172.21.15.46:0/2031706328 >> 172.21.15.46:0/2031706328 conn(0x7f932c0fbd40 msgr2=0x7f932c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:47.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.849+0000 7f9330a97700 1 -- 172.21.15.46:0/2031706328 shutdown_connections 2024-02-19T19:05:47.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.849+0000 7f9330a97700 1 -- 172.21.15.46:0/2031706328 wait complete. 2024-02-19T19:05:47.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f9330a97700 1 Processor -- start 2024-02-19T19:05:47.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f9330a97700 1 -- start start 2024-02-19T19:05:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f9330a97700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f932c1004a0 0x7f932c195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f9330a97700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f932c100e40 0x7f932c196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f9330a97700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c196b60 con 0x7f932c1004a0 2024-02-19T19:05:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f9330a97700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c19a8f0 con 0x7f932c100e40 2024-02-19T19:05:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f932a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f932c1004a0 0x7f932c195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f932a59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f932c1004a0 0x7f932c195f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34054/0 (socket says 172.21.15.46:34054) 2024-02-19T19:05:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f932a59c700 1 -- 172.21.15.46:0/2711132221 learned_addr learned my addr 172.21.15.46:0/2711132221 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:05:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f9329d9b700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f932c100e40 0x7f932c196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f9329d9b700 1 -- 172.21.15.46:0/2711132221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f932c100e40 msgr2=0x7f932c196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-19T19:05:47.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f9329d9b700 1 -- 172.21.15.46:0/2711132221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f932c100e40 msgr2=0x7f932c196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.850+0000 7f9329d9b700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f932c100e40 0x7f932c196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.851+0000 7f932a59c700 1 -- 172.21.15.46:0/2711132221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f932c100e40 msgr2=0x7f932c196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.851+0000 7f9329d9b700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f932c100e40 0x7f932c196480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.851+0000 7f932a59c700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f932c100e40 0x7f932c196480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.851+0000 7f932a59c700 1 -- 172.21.15.46:0/2711132221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c0095f0 con 0x7f932c1004a0 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.851+0000 7f932a59c700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f932c1004a0 0x7f932c195f40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f932000b4b0 tx=0x7f932000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.851+0000 7f931b7fe700 1 -- 172.21.15.46:0/2711132221 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9320011800 con 0x7f932c1004a0 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.851+0000 7f931b7fe700 1 -- 172.21.15.46:0/2711132221 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9320011e20 con 0x7f932c1004a0 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.851+0000 7f9330a97700 1 -- 172.21.15.46:0/2711132221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c19abd0 con 0x7f932c1004a0 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.851+0000 7f931b7fe700 1 -- 172.21.15.46:0/2711132221 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f932000f2e0 con 0x7f932c1004a0 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.851+0000 7f9330a97700 1 -- 172.21.15.46:0/2711132221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c19b120 con 0x7f932c1004a0 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.852+0000 7f9330a97700 1 -- 172.21.15.46:0/2711132221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c108740 con 0x7f932c1004a0 2024-02-19T19:05:47.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.852+0000 7f931b7fe700 1 -- 172.21.15.46:0/2711132221 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f9320011960 con 0x7f932c1004a0 2024-02-19T19:05:47.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.853+0000 7f931b7fe700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f931406d9e0 0x7f931406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:47.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.853+0000 7f931b7fe700 1 -- 172.21.15.46:0/2711132221 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f932008d0a0 con 0x7f932c1004a0 2024-02-19T19:05:47.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.853+0000 7f9329d9b700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f931406d9e0 0x7f931406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:47.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.853+0000 7f9329d9b700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f931406d9e0 0x7f931406fe90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f932c197560 tx=0x7f931c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:47.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:47.857+0000 7f931b7fe700 1 -- 172.21.15.46:0/2711132221 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9320056870 con 0x7f932c1004a0 2024-02-19T19:05:48.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.153+0000 7f9330a97700 1 -- 172.21.15.46:0/2711132221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f932c04f2a0 con 0x7f932c1004a0 2024-02-19T19:05:48.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.154+0000 7f931b7fe700 1 -- 172.21.15.46:0/2711132221 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9320059f30 con 0x7f932c1004a0 2024-02-19T19:05:48.174 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_OK 2024-02-19T19:05:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 -- 172.21.15.46:0/2711132221 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f931406d9e0 msgr2=0x7f931406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f931406d9e0 0x7f931406fe90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f932c197560 tx=0x7f931c01a040 comp rx=0 tx=0).stop 2024-02-19T19:05:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 -- 172.21.15.46:0/2711132221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f932c1004a0 msgr2=0x7f932c195f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:48.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f932c1004a0 0x7f932c195f40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f932000b4b0 tx=0x7f932000b870 comp rx=0 tx=0).stop 2024-02-19T19:05:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 -- 172.21.15.46:0/2711132221 shutdown_connections 2024-02-19T19:05:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f931406d9e0 0x7f931406fe90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f932c1004a0 0x7f932c195f40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 --2- 172.21.15.46:0/2711132221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f932c100e40 0x7f932c196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 -- 172.21.15.46:0/2711132221 >> 172.21.15.46:0/2711132221 conn(0x7f932c0fbd40 msgr2=0x7f932c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 -- 172.21.15.46:0/2711132221 shutdown_connections 2024-02-19T19:05:48.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:05:48.156+0000 7f9330a97700 1 -- 172.21.15.46:0/2711132221 wait complete. 2024-02-19T19:05:48.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:48 smithi046 ceph-mon[88928]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:48.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:48 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/51127535' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:05:48.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:48 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2711132221' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:05:48.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:48 smithi142 ceph-mon[69118]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:48.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:48 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/51127535' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:05:48.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:48 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2711132221' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:05:49.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:49 smithi046 ceph-mon[88928]: pgmap v13: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:49.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:49 smithi046 ceph-mon[88928]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:49.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:49 smithi142 ceph-mon[69118]: pgmap v13: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:49.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:49 smithi142 ceph-mon[69118]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:50.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:50 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:50.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:50 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:50.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:50 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:50.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:50 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:51.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:51 smithi046 ceph-mon[88928]: pgmap v14: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:51 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:51.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:51 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:51 smithi142 ceph-mon[69118]: pgmap v14: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:51 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:51 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:53.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:53 smithi046 ceph-mon[88928]: pgmap v15: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:53.843 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:53 smithi142 ceph-mon[69118]: pgmap v15: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: pgmap v16: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: Detected new or changed devices on smithi142 2024-02-19T19:05:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: Reconfiguring mon.smithi046 (monmap changed)... 2024-02-19T19:05:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:05:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:05:55.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:55.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:55 smithi046 ceph-mon[88928]: Reconfiguring daemon mon.smithi046 on smithi046 2024-02-19T19:05:55.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: pgmap v16: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:55.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: Detected new or changed devices on smithi142 2024-02-19T19:05:55.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:55.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:55.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:55.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:55.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:55.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: Reconfiguring mon.smithi046 (monmap changed)... 2024-02-19T19:05:55.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:05:55.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:05:55.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:55.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:55 smithi142 ceph-mon[69118]: Reconfiguring daemon mon.smithi046 on smithi046 2024-02-19T19:05:57.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:57 smithi046 ceph-mon[88928]: pgmap v17: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:57.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:57.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:57.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:57 smithi046 ceph-mon[88928]: Reconfiguring mgr.smithi046.qtceex (monmap changed)... 2024-02-19T19:05:57.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.qtceex", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:05:57.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:05:57.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:57.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:57 smithi046 ceph-mon[88928]: Reconfiguring daemon mgr.smithi046.qtceex on smithi046 2024-02-19T19:05:57.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:57 smithi142 ceph-mon[69118]: pgmap v17: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:57.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:57.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:57.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:57 smithi142 ceph-mon[69118]: Reconfiguring mgr.smithi046.qtceex (monmap changed)... 2024-02-19T19:05:57.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.qtceex", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:05:57.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:05:57.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:57.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:57 smithi142 ceph-mon[69118]: Reconfiguring daemon mgr.smithi046.qtceex on smithi046 2024-02-19T19:05:58.466 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:58.466 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:58.466 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:58.466 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:05:58.466 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:05:58.466 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T19:05:58.466 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi046"}]: dispatch 2024-02-19T19:05:58.466 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:58.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:58.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:58.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:05:58.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:05:58.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:05:58.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T19:05:58.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi046"}]: dispatch 2024-02-19T19:05:58.493 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:59.527 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:59 smithi046 ceph-mon[88928]: pgmap v18: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:59.527 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:59 smithi046 ceph-mon[88928]: Reconfiguring ceph-exporter.smithi046 (monmap changed)... 2024-02-19T19:05:59.527 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:59 smithi046 ceph-mon[88928]: Unable to update caps for client.ceph-exporter.smithi046 2024-02-19T19:05:59.527 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:05:59 smithi046 ceph-mon[88928]: Reconfiguring daemon ceph-exporter.smithi046 on smithi046 2024-02-19T19:05:59.666 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:59 smithi142 ceph-mon[69118]: pgmap v18: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:05:59.666 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:59 smithi142 ceph-mon[69118]: Reconfiguring ceph-exporter.smithi046 (monmap changed)... 2024-02-19T19:05:59.666 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:59 smithi142 ceph-mon[69118]: Unable to update caps for client.ceph-exporter.smithi046 2024-02-19T19:05:59.666 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:05:59 smithi142 ceph-mon[69118]: Reconfiguring daemon ceph-exporter.smithi046 on smithi046 2024-02-19T19:06:00.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:00.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:00.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:06:00.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:00.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:00.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:00.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:06:00.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:01.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:01 smithi046 ceph-mon[88928]: Reconfiguring crash.smithi046 (monmap changed)... 2024-02-19T19:06:01.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:01 smithi046 ceph-mon[88928]: Reconfiguring daemon crash.smithi046 on smithi046 2024-02-19T19:06:01.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:01 smithi046 ceph-mon[88928]: pgmap v19: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:01.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:01.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:01.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T19:06:01.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:01.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:01 smithi142 ceph-mon[69118]: Reconfiguring crash.smithi046 (monmap changed)... 2024-02-19T19:06:01.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:01 smithi142 ceph-mon[69118]: Reconfiguring daemon crash.smithi046 on smithi046 2024-02-19T19:06:01.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:01 smithi142 ceph-mon[69118]: pgmap v19: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:01.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:01.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:01.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T19:06:01.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:02.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:02 smithi046 ceph-mon[88928]: Reconfiguring osd.0 (monmap changed)... 2024-02-19T19:06:02.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:02 smithi046 ceph-mon[88928]: Reconfiguring daemon osd.0 on smithi046 2024-02-19T19:06:02.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:02 smithi142 ceph-mon[69118]: Reconfiguring osd.0 (monmap changed)... 2024-02-19T19:06:02.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:02 smithi142 ceph-mon[69118]: Reconfiguring daemon osd.0 on smithi046 2024-02-19T19:06:03.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:03 smithi046 ceph-mon[88928]: pgmap v20: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:03.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:03 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:03.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:03 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:03.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:03 smithi046 ceph-mon[88928]: Reconfiguring osd.1 (monmap changed)... 2024-02-19T19:06:03.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:03 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T19:06:03.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:03 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:03.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:03 smithi046 ceph-mon[88928]: Reconfiguring daemon osd.1 on smithi046 2024-02-19T19:06:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:03 smithi142 ceph-mon[69118]: pgmap v20: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:03 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:03 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:03 smithi142 ceph-mon[69118]: Reconfiguring osd.1 (monmap changed)... 2024-02-19T19:06:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:03 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T19:06:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:03 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:03 smithi142 ceph-mon[69118]: Reconfiguring daemon osd.1 on smithi046 2024-02-19T19:06:04.644 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:04 smithi046 ceph-mon[88928]: pgmap v21: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:04.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:04 smithi142 ceph-mon[69118]: pgmap v21: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:06.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:05 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:06.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:05 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:06.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:05 smithi046 ceph-mon[88928]: Reconfiguring osd.2 (monmap changed)... 2024-02-19T19:06:06.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:05 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T19:06:06.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:05 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:06.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:05 smithi046 ceph-mon[88928]: Reconfiguring daemon osd.2 on smithi046 2024-02-19T19:06:06.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:05 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:06.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:05 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:06.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:05 smithi142 ceph-mon[69118]: Reconfiguring osd.2 (monmap changed)... 2024-02-19T19:06:06.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:05 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T19:06:06.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:05 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:06.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:05 smithi142 ceph-mon[69118]: Reconfiguring daemon osd.2 on smithi046 2024-02-19T19:06:07.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:07 smithi046 ceph-mon[88928]: pgmap v22: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:07.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:07.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:07.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:07 smithi046 ceph-mon[88928]: Reconfiguring mds.cephfs.smithi046.hrbbel (monmap changed)... 2024-02-19T19:06:07.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hrbbel", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:06:07.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:07.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:07 smithi046 ceph-mon[88928]: Reconfiguring daemon mds.cephfs.smithi046.hrbbel on smithi046 2024-02-19T19:06:07.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:07 smithi142 ceph-mon[69118]: pgmap v22: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:07.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:07.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:07.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:07 smithi142 ceph-mon[69118]: Reconfiguring mds.cephfs.smithi046.hrbbel (monmap changed)... 2024-02-19T19:06:07.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hrbbel", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:06:07.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:07.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:07 smithi142 ceph-mon[69118]: Reconfiguring daemon mds.cephfs.smithi046.hrbbel on smithi046 2024-02-19T19:06:09.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:09 smithi046 ceph-mon[88928]: pgmap v23: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:09.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:09 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:09.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:09 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:09.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:09 smithi046 ceph-mon[88928]: Reconfiguring mds.cephfs.smithi046.bwvkwa (monmap changed)... 2024-02-19T19:06:09.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:09 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.bwvkwa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:06:09.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:09 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:09.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:09 smithi046 ceph-mon[88928]: Reconfiguring daemon mds.cephfs.smithi046.bwvkwa on smithi046 2024-02-19T19:06:09.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:09 smithi142 ceph-mon[69118]: pgmap v23: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:09.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:09 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:09.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:09 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:09.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:09 smithi142 ceph-mon[69118]: Reconfiguring mds.cephfs.smithi046.bwvkwa (monmap changed)... 2024-02-19T19:06:09.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:09 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.bwvkwa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:06:09.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:09 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:09.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:09 smithi142 ceph-mon[69118]: Reconfiguring daemon mds.cephfs.smithi046.bwvkwa on smithi046 2024-02-19T19:06:10.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: pgmap v24: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:10.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:10.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:10.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-02-19T19:06:10.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:06:10.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:06:10.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T19:06:10.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: Unable to update caps for client.ceph-exporter.smithi142 2024-02-19T19:06:10.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi142"}]: dispatch 2024-02-19T19:06:10.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:10.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:10 smithi142 ceph-mon[69118]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-02-19T19:06:11.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: pgmap v24: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:11.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:11.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:11.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-02-19T19:06:11.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:06:11.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:06:11.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T19:06:11.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: Unable to update caps for client.ceph-exporter.smithi142 2024-02-19T19:06:11.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi142"}]: dispatch 2024-02-19T19:06:11.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:11.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:10 smithi046 ceph-mon[88928]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-02-19T19:06:12.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:12.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:12.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:12 smithi142 ceph-mon[69118]: Reconfiguring crash.smithi142 (monmap changed)... 2024-02-19T19:06:12.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:06:12.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:12.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:12 smithi142 ceph-mon[69118]: Reconfiguring daemon crash.smithi142 on smithi142 2024-02-19T19:06:12.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:12 smithi142 ceph-mon[69118]: pgmap v25: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:12 smithi046 ceph-mon[88928]: Reconfiguring crash.smithi142 (monmap changed)... 2024-02-19T19:06:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:06:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:12 smithi046 ceph-mon[88928]: Reconfiguring daemon crash.smithi142 on smithi142 2024-02-19T19:06:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:12 smithi046 ceph-mon[88928]: pgmap v25: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:13.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:13.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:13.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:13.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:13 smithi142 ceph-mon[69118]: Reconfiguring mgr.smithi142.fwekwv (monmap changed)... 2024-02-19T19:06:13.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.fwekwv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:06:13.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:06:13.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:13.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:13 smithi142 ceph-mon[69118]: Reconfiguring daemon mgr.smithi142.fwekwv on smithi142 2024-02-19T19:06:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:13 smithi046 ceph-mon[88928]: Reconfiguring mgr.smithi142.fwekwv (monmap changed)... 2024-02-19T19:06:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.fwekwv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:06:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:06:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:13 smithi046 ceph-mon[88928]: Reconfiguring daemon mgr.smithi142.fwekwv on smithi142 2024-02-19T19:06:14.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:14 smithi142 ceph-mon[69118]: pgmap v26: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:15.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:14 smithi046 ceph-mon[88928]: pgmap v26: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:16.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:16.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:16.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:16 smithi142 ceph-mon[69118]: Reconfiguring mon.smithi142 (monmap changed)... 2024-02-19T19:06:16.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:06:16.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:06:16.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:16.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:16 smithi142 ceph-mon[69118]: Reconfiguring daemon mon.smithi142 on smithi142 2024-02-19T19:06:16.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:16.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:16.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:16 smithi046 ceph-mon[88928]: Reconfiguring mon.smithi142 (monmap changed)... 2024-02-19T19:06:16.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:06:16.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:06:16.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:16.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:16 smithi046 ceph-mon[88928]: Reconfiguring daemon mon.smithi142 on smithi142 2024-02-19T19:06:17.428 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:17 smithi142 ceph-mon[69118]: pgmap v27: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:17.429 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:17.429 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:17.429 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T19:06:17.429 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:17.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:17 smithi046 ceph-mon[88928]: pgmap v27: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:17.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:17.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:17.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T19:06:17.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.276+0000 7fd75b0c1700 1 -- 172.21.15.46:0/2872571225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7541004e0 msgr2=0x7fd7541008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.276+0000 7fd75b0c1700 1 --2- 172.21.15.46:0/2872571225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7541004e0 0x7fd7541008b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd748009910 tx=0x7fd748009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 -- 172.21.15.46:0/2872571225 shutdown_connections 2024-02-19T19:06:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 --2- 172.21.15.46:0/2872571225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd754100e80 0x7fd754104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 --2- 172.21.15.46:0/2872571225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7541004e0 0x7fd7541008b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 -- 172.21.15.46:0/2872571225 >> 172.21.15.46:0/2872571225 conn(0x7fd7540fbda0 msgr2=0x7fd7540fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:18.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 -- 172.21.15.46:0/2872571225 shutdown_connections 2024-02-19T19:06:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 -- 172.21.15.46:0/2872571225 wait complete. 2024-02-19T19:06:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 Processor -- start 2024-02-19T19:06:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 -- start start 2024-02-19T19:06:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7541004e0 0x7fd754195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd754100e80 0x7fd754196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd754196b10 con 0x7fd7541004e0 2024-02-19T19:06:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.277+0000 7fd75b0c1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75419a8a0 con 0x7fd754100e80 2024-02-19T19:06:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd758e5d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7541004e0 0x7fd754195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd758e5d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7541004e0 0x7fd754195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40274/0 (socket says 172.21.15.46:40274) 2024-02-19T19:06:18.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd758e5d700 1 -- 172.21.15.46:0/1562273579 learned_addr learned my addr 172.21.15.46:0/1562273579 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd753fff700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd754100e80 0x7fd754196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd758e5d700 1 -- 172.21.15.46:0/1562273579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd754100e80 msgr2=0x7fd754196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd758e5d700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd754100e80 0x7fd754196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd758e5d700 1 -- 172.21.15.46:0/1562273579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7480095f0 con 0x7fd7541004e0 2024-02-19T19:06:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd758e5d700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7541004e0 0x7fd754195ef0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7480092e0 tx=0x7fd74800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd751ffb700 1 -- 172.21.15.46:0/1562273579 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd74801d070 con 0x7fd7541004e0 2024-02-19T19:06:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd75b0c1700 1 -- 172.21.15.46:0/1562273579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75419ab20 con 0x7fd7541004e0 2024-02-19T19:06:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd751ffb700 1 -- 172.21.15.46:0/1562273579 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd748005e00 con 0x7fd7541004e0 2024-02-19T19:06:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.278+0000 7fd751ffb700 1 -- 172.21.15.46:0/1562273579 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd748017400 con 0x7fd7541004e0 2024-02-19T19:06:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.279+0000 7fd75b0c1700 1 -- 172.21.15.46:0/1562273579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75419b010 con 0x7fd7541004e0 2024-02-19T19:06:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.280+0000 7fd75b0c1700 1 -- 172.21.15.46:0/1562273579 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7541087f0 con 0x7fd7541004e0 2024-02-19T19:06:18.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.280+0000 7fd751ffb700 1 -- 172.21.15.46:0/1562273579 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fd74800f6f0 con 0x7fd7541004e0 2024-02-19T19:06:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.281+0000 7fd751ffb700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd74406d9d0 0x7fd74406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.281+0000 7fd751ffb700 1 -- 172.21.15.46:0/1562273579 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd74808ebd0 con 0x7fd7541004e0 2024-02-19T19:06:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.281+0000 7fd753fff700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd74406d9d0 0x7fd74406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:18.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.281+0000 7fd753fff700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd74406d9d0 0x7fd74406fe80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd754197510 tx=0x7fd74000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.286+0000 7fd751ffb700 1 -- 172.21.15.46:0/1562273579 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd748058210 con 0x7fd7541004e0 2024-02-19T19:06:18.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:18 smithi142 ceph-mon[69118]: Reconfiguring osd.3 (monmap changed)... 2024-02-19T19:06:18.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:18 smithi142 ceph-mon[69118]: Reconfiguring daemon osd.3 on smithi142 2024-02-19T19:06:18.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.513+0000 7fd75b0c1700 1 -- 172.21.15.46:0/1562273579 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd75419b230 con 0x7fd74406d9d0 2024-02-19T19:06:18.534 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:18 smithi046 ceph-mon[88928]: Reconfiguring osd.3 (monmap changed)... 2024-02-19T19:06:18.534 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:18 smithi046 ceph-mon[88928]: Reconfiguring daemon osd.3 on smithi142 2024-02-19T19:06:18.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.514+0000 7fd751ffb700 1 -- 172.21.15.46:0/1562273579 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fd75419b230 con 0x7fd74406d9d0 2024-02-19T19:06:18.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 -- 172.21.15.46:0/1562273579 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd74406d9d0 msgr2=0x7fd74406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd74406d9d0 0x7fd74406fe80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd754197510 tx=0x7fd74000b410 comp rx=0 tx=0).stop 2024-02-19T19:06:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 -- 172.21.15.46:0/1562273579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7541004e0 msgr2=0x7fd754195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7541004e0 0x7fd754195ef0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7480092e0 tx=0x7fd74800bd70 comp rx=0 tx=0).stop 2024-02-19T19:06:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 -- 172.21.15.46:0/1562273579 shutdown_connections 2024-02-19T19:06:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd74406d9d0 0x7fd74406fe80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7541004e0 0x7fd754195ef0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 --2- 172.21.15.46:0/1562273579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd754100e80 0x7fd754196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 -- 172.21.15.46:0/1562273579 >> 172.21.15.46:0/1562273579 conn(0x7fd7540fbda0 msgr2=0x7fd7540fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 -- 172.21.15.46:0/1562273579 shutdown_connections 2024-02-19T19:06:18.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.517+0000 7fd75b0c1700 1 -- 172.21.15.46:0/1562273579 wait complete. 2024-02-19T19:06:18.547 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:06:18.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.623+0000 7fe9bc7be700 1 -- 172.21.15.46:0/1910731958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40ffbd0 msgr2=0x7fe9b4100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:18.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.623+0000 7fe9bc7be700 1 --2- 172.21.15.46:0/1910731958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40ffbd0 0x7fe9b4100040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009910 tx=0x7fe9b0009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:18.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.623+0000 7fe9bc7be700 1 -- 172.21.15.46:0/1910731958 shutdown_connections 2024-02-19T19:06:18.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.623+0000 7fe9bc7be700 1 --2- 172.21.15.46:0/1910731958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40ffbd0 0x7fe9b4100040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.623+0000 7fe9bc7be700 1 --2- 172.21.15.46:0/1910731958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b4104130 0x7fe9b4104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.623+0000 7fe9bc7be700 1 -- 172.21.15.46:0/1910731958 >> 172.21.15.46:0/1910731958 conn(0x7fe9b4075130 msgr2=0x7fe9b4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.623+0000 7fe9bc7be700 1 -- 172.21.15.46:0/1910731958 shutdown_connections 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.623+0000 7fe9bc7be700 1 -- 172.21.15.46:0/1910731958 wait complete. 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9bc7be700 1 Processor -- start 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9bc7be700 1 -- start start 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9bc7be700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40ffbd0 0x7fe9b4196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9bc7be700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b4104130 0x7fe9b41971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9bc7be700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b4197800 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9bc7be700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b4197940 con 0x7fe9b4104130 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9ba55a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40ffbd0 0x7fe9b4196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9ba55a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40ffbd0 0x7fe9b4196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40288/0 (socket says 172.21.15.46:40288) 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9ba55a700 1 -- 172.21.15.46:0/2618437053 learned_addr learned my addr 172.21.15.46:0/2618437053 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9ba55a700 1 -- 172.21.15.46:0/2618437053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b4104130 msgr2=0x7fe9b41971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:18.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9ba55a700 1 --2- 172.21.15.46:0/2618437053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b4104130 0x7fe9b41971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.624+0000 7fe9ba55a700 1 -- 172.21.15.46:0/2618437053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00095f0 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.625+0000 7fe9ba55a700 1 --2- 172.21.15.46:0/2618437053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40ffbd0 0x7fe9b4196ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400d8d0 tx=0x7fe9a400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:18.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.625+0000 7fe9ab7fe700 1 -- 172.21.15.46:0/2618437053 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a4009940 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.625+0000 7fe9ab7fe700 1 -- 172.21.15.46:0/2618437053 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9a4010460 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.625+0000 7fe9bc7be700 1 -- 172.21.15.46:0/2618437053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b419fd10 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.625+0000 7fe9ab7fe700 1 -- 172.21.15.46:0/2618437053 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a400f5f0 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.625+0000 7fe9bc7be700 1 -- 172.21.15.46:0/2618437053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b41a01d0 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.626+0000 7fe9bc7be700 1 -- 172.21.15.46:0/2618437053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b404f2a0 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.626+0000 7fe9ab7fe700 1 -- 172.21.15.46:0/2618437053 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fe9a40105d0 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.627+0000 7fe9ab7fe700 1 --2- 172.21.15.46:0/2618437053 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe9a006d9d0 0x7fe9a006fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:18.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.627+0000 7fe9ab7fe700 1 -- 172.21.15.46:0/2618437053 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe9a408d600 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.627+0000 7fe9b9d59700 1 --2- 172.21.15.46:0/2618437053 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe9a006d9d0 0x7fe9a006fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:18.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.627+0000 7fe9b9d59700 1 --2- 172.21.15.46:0/2618437053 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe9a006d9d0 0x7fe9a006fe80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006010 tx=0x7fe9b000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:18.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.631+0000 7fe9ab7fe700 1 -- 172.21.15.46:0/2618437053 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe9a4056cc0 con 0x7fe9b40ffbd0 2024-02-19T19:06:18.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.860+0000 7fe9bc7be700 1 -- 172.21.15.46:0/2618437053 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9b40ff240 con 0x7fe9a006d9d0 2024-02-19T19:06:18.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.861+0000 7fe9ab7fe700 1 -- 172.21.15.46:0/2618437053 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fe9b40ff240 con 0x7fe9a006d9d0 2024-02-19T19:06:18.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 -- 172.21.15.46:0/2618437053 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe9a006d9d0 msgr2=0x7fe9a006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:18.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 --2- 172.21.15.46:0/2618437053 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe9a006d9d0 0x7fe9a006fe80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006010 tx=0x7fe9b000b540 comp rx=0 tx=0).stop 2024-02-19T19:06:18.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 -- 172.21.15.46:0/2618437053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40ffbd0 msgr2=0x7fe9b4196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:18.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 --2- 172.21.15.46:0/2618437053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40ffbd0 0x7fe9b4196ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400d8d0 tx=0x7fe9a400dc90 comp rx=0 tx=0).stop 2024-02-19T19:06:18.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 -- 172.21.15.46:0/2618437053 shutdown_connections 2024-02-19T19:06:18.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 --2- 172.21.15.46:0/2618437053 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe9a006d9d0 0x7fe9a006fe80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 --2- 172.21.15.46:0/2618437053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9b40ffbd0 0x7fe9b4196ca0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 --2- 172.21.15.46:0/2618437053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b4104130 0x7fe9b41971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 -- 172.21.15.46:0/2618437053 >> 172.21.15.46:0/2618437053 conn(0x7fe9b4075130 msgr2=0x7fe9b40feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:18.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 -- 172.21.15.46:0/2618437053 shutdown_connections 2024-02-19T19:06:18.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.864+0000 7fe9bc7be700 1 -- 172.21.15.46:0/2618437053 wait complete. 2024-02-19T19:06:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.970+0000 7f4c2b59e700 1 -- 172.21.15.46:0/1251590932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c2c0ff2d0 msgr2=0x7f4c2c0ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.970+0000 7f4c2b59e700 1 --2- 172.21.15.46:0/1251590932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c2c0ff2d0 0x7f4c2c0ff6a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009910 tx=0x7f4c20009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.970+0000 7f4c2b59e700 1 -- 172.21.15.46:0/1251590932 shutdown_connections 2024-02-19T19:06:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.970+0000 7f4c2b59e700 1 --2- 172.21.15.46:0/1251590932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c2c100b30 0x7f4c2c100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.970+0000 7f4c2b59e700 1 --2- 172.21.15.46:0/1251590932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c2c0ff2d0 0x7f4c2c0ff6a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.970+0000 7f4c2b59e700 1 -- 172.21.15.46:0/1251590932 >> 172.21.15.46:0/1251590932 conn(0x7f4c2c0faad0 msgr2=0x7f4c2c0fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.970+0000 7f4c2b59e700 1 -- 172.21.15.46:0/1251590932 shutdown_connections 2024-02-19T19:06:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.970+0000 7f4c2b59e700 1 -- 172.21.15.46:0/1251590932 wait complete. 2024-02-19T19:06:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.971+0000 7f4c2b59e700 1 Processor -- start 2024-02-19T19:06:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.971+0000 7f4c2b59e700 1 -- start start 2024-02-19T19:06:18.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.971+0000 7f4c2b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c2c0ff2d0 0x7f4c2c109f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:18.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.971+0000 7f4c2b59e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c2c100b30 0x7f4c2c10a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.971+0000 7f4c2b59e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c10aa10 con 0x7f4c2c100b30 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.971+0000 7f4c2b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c10ab50 con 0x7f4c2c0ff2d0 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.971+0000 7f4c29d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c2c100b30 0x7f4c2c10a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.971+0000 7f4c29d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c2c100b30 0x7f4c2c10a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40302/0 (socket says 172.21.15.46:40302) 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.971+0000 7f4c29d9b700 1 -- 172.21.15.46:0/254655872 learned_addr learned my addr 172.21.15.46:0/254655872 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.972+0000 7f4c2a59c700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c2c0ff2d0 0x7f4c2c109f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.972+0000 7f4c29d9b700 1 -- 172.21.15.46:0/254655872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c2c0ff2d0 msgr2=0x7f4c2c109f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.972+0000 7f4c29d9b700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c2c0ff2d0 0x7f4c2c109f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.972+0000 7f4c29d9b700 1 -- 172.21.15.46:0/254655872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c200095f0 con 0x7f4c2c100b30 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.972+0000 7f4c29d9b700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c2c100b30 0x7f4c2c10a4d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00d8d0 tx=0x7f4c1c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.972+0000 7f4c1b7fe700 1 -- 172.21.15.46:0/254655872 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c1c0098a0 con 0x7f4c2c100b30 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.972+0000 7f4c2b59e700 1 -- 172.21.15.46:0/254655872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c1a1e80 con 0x7f4c2c100b30 2024-02-19T19:06:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.972+0000 7f4c1b7fe700 1 -- 172.21.15.46:0/254655872 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c1c010460 con 0x7f4c2c100b30 2024-02-19T19:06:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.972+0000 7f4c1b7fe700 1 -- 172.21.15.46:0/254655872 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c1c00f5f0 con 0x7f4c2c100b30 2024-02-19T19:06:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.972+0000 7f4c2b59e700 1 -- 172.21.15.46:0/254655872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c1a2310 con 0x7f4c2c100b30 2024-02-19T19:06:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.973+0000 7f4c2b59e700 1 -- 172.21.15.46:0/254655872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c062380 con 0x7f4c2c100b30 2024-02-19T19:06:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.974+0000 7f4c1b7fe700 1 -- 172.21.15.46:0/254655872 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f4c1c009a00 con 0x7f4c2c100b30 2024-02-19T19:06:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.974+0000 7f4c1b7fe700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4c1406d9e0 0x7f4c1406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.974+0000 7f4c1b7fe700 1 -- 172.21.15.46:0/254655872 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4c1c08d5d0 con 0x7f4c2c100b30 2024-02-19T19:06:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.974+0000 7f4c2a59c700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4c1406d9e0 0x7f4c1406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.975+0000 7f4c2a59c700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4c1406d9e0 0x7f4c1406fe90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c20006010 tx=0x7f4c2001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:18.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:18.979+0000 7f4c1b7fe700 1 -- 172.21.15.46:0/254655872 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4c1c056c10 con 0x7f4c2c100b30 2024-02-19T19:06:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.195+0000 7f4c2b59e700 1 -- 172.21.15.46:0/254655872 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c2c0fb9f0 con 0x7f4c1406d9e0 2024-02-19T19:06:19.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.207+0000 7f4c1b7fe700 1 -- 172.21.15.46:0/254655872 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f4c2c0fb9f0 con 0x7f4c1406d9e0 2024-02-19T19:06:19.228 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:06:19.228 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (2m) 45s ago 12m 26.2M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:06:19.228 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (13m) 45s ago 13m 7952k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:06:19.228 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (11m) 29s ago 11m 7894k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:06:19.228 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (13m) 45s ago 13m 6660k - 18.2.0 dc2bc1663786 0a6de29c3a15 2024-02-19T19:06:19.228 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (11m) 29s ago 11m 6669k - 18.2.0 dc2bc1663786 51769a30d151 2024-02-19T19:06:19.228 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (2m) 45s ago 12m 81.0M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:06:19.228 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (6m) 45s ago 6m 26.4M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:06:19.228 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (6m) 45s ago 6m 15.4M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (6m) 29s ago 6m 16.3M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (6m) 29s ago 6m 25.1M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (4m) 45s ago 14m 475M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (3m) 29s ago 11m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (60s) 45s ago 14m 28.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (34s) 29s ago 11m 24.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (3m) 45s ago 13m 16.4M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (3m) 29s ago 11m 14.7M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (10m) 45s ago 10m 51.7M 1217M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (10m) 45s ago 10m 50.7M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (9m) 45s ago 9m 51.9M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (9m) 29s ago 9m 49.5M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (8m) 29s ago 8m 47.5M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:06:19.229 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (8m) 29s ago 8m 48.5M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:06:19.230 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (2m) 45s ago 11m 58.2M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:06:19.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 -- 172.21.15.46:0/254655872 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4c1406d9e0 msgr2=0x7f4c1406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:19.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4c1406d9e0 0x7f4c1406fe90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c20006010 tx=0x7f4c2001a040 comp rx=0 tx=0).stop 2024-02-19T19:06:19.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 -- 172.21.15.46:0/254655872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c2c100b30 msgr2=0x7f4c2c10a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:19.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c2c100b30 0x7f4c2c10a4d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00d8d0 tx=0x7f4c1c00dbe0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 -- 172.21.15.46:0/254655872 shutdown_connections 2024-02-19T19:06:19.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4c1406d9e0 0x7f4c1406fe90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c2c0ff2d0 0x7f4c2c109f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 --2- 172.21.15.46:0/254655872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c2c100b30 0x7f4c2c10a4d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 -- 172.21.15.46:0/254655872 >> 172.21.15.46:0/254655872 conn(0x7f4c2c0faad0 msgr2=0x7f4c2c0fb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:19.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 -- 172.21.15.46:0/254655872 shutdown_connections 2024-02-19T19:06:19.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.210+0000 7f4c2b59e700 1 -- 172.21.15.46:0/254655872 wait complete. 2024-02-19T19:06:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.314+0000 7f8191ffd700 1 -- 172.21.15.46:0/2425982877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f818c0ff350 msgr2=0x7f818c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.314+0000 7f8191ffd700 1 --2- 172.21.15.46:0/2425982877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f818c0ff350 0x7f818c0ff720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f817c009910 tx=0x7f817c009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.314+0000 7f8191ffd700 1 -- 172.21.15.46:0/2425982877 shutdown_connections 2024-02-19T19:06:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.314+0000 7f8191ffd700 1 --2- 172.21.15.46:0/2425982877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818c0ffc60 0x7f818c10a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.314+0000 7f8191ffd700 1 --2- 172.21.15.46:0/2425982877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f818c0ff350 0x7f818c0ff720 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.314+0000 7f8191ffd700 1 -- 172.21.15.46:0/2425982877 >> 172.21.15.46:0/2425982877 conn(0x7f818c0748b0 msgr2=0x7f818c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.314+0000 7f8191ffd700 1 -- 172.21.15.46:0/2425982877 shutdown_connections 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.314+0000 7f8191ffd700 1 -- 172.21.15.46:0/2425982877 wait complete. 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.314+0000 7f8191ffd700 1 Processor -- start 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f8191ffd700 1 -- start start 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f8191ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818c0ff350 0x7f818c195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f8191ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f818c0ffc60 0x7f818c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f8191ffd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c196ac0 con 0x7f818c0ffc60 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f8191ffd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c19a850 con 0x7f818c0ff350 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f818affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f818c0ffc60 0x7f818c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f818affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f818c0ffc60 0x7f818c1963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40324/0 (socket says 172.21.15.46:40324) 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f818affd700 1 -- 172.21.15.46:0/2418026665 learned_addr learned my addr 172.21.15.46:0/2418026665 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f818b7fe700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818c0ff350 0x7f818c195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:19.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f818affd700 1 -- 172.21.15.46:0/2418026665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818c0ff350 msgr2=0x7f818c195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f818affd700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818c0ff350 0x7f818c195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f818affd700 1 -- 172.21.15.46:0/2418026665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0095f0 con 0x7f818c0ffc60 2024-02-19T19:06:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.315+0000 7f818affd700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f818c0ffc60 0x7f818c1963e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f818000d8d0 tx=0x7f818000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.316+0000 7f8188ff9700 1 -- 172.21.15.46:0/2418026665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81800098a0 con 0x7f818c0ffc60 2024-02-19T19:06:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.316+0000 7f8191ffd700 1 -- 172.21.15.46:0/2418026665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c19ab30 con 0x7f818c0ffc60 2024-02-19T19:06:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.316+0000 7f8188ff9700 1 -- 172.21.15.46:0/2418026665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8180010460 con 0x7f818c0ffc60 2024-02-19T19:06:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.316+0000 7f8188ff9700 1 -- 172.21.15.46:0/2418026665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f818000f5f0 con 0x7f818c0ffc60 2024-02-19T19:06:19.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.316+0000 7f8191ffd700 1 -- 172.21.15.46:0/2418026665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c19b080 con 0x7f818c0ffc60 2024-02-19T19:06:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.317+0000 7f8191ffd700 1 -- 172.21.15.46:0/2418026665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c107dd0 con 0x7f818c0ffc60 2024-02-19T19:06:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.317+0000 7f8188ff9700 1 -- 172.21.15.46:0/2418026665 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f8180009a00 con 0x7f818c0ffc60 2024-02-19T19:06:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.317+0000 7f8188ff9700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f817406d9e0 0x7f817406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.318+0000 7f8188ff9700 1 -- 172.21.15.46:0/2418026665 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f818008d5d0 con 0x7f818c0ffc60 2024-02-19T19:06:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.318+0000 7f818b7fe700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f817406d9e0 0x7f817406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:19.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.318+0000 7f818b7fe700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f817406d9e0 0x7f817406fe90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f817c006010 tx=0x7f817c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:19.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.322+0000 7f8188ff9700 1 -- 172.21.15.46:0/2418026665 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8180056c10 con 0x7f818c0ffc60 2024-02-19T19:06:19.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:19 smithi046 ceph-mon[88928]: pgmap v28: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:19.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:19.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:19.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:19 smithi046 ceph-mon[88928]: Reconfiguring osd.4 (monmap changed)... 2024-02-19T19:06:19.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T19:06:19.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:19.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:19 smithi046 ceph-mon[88928]: Reconfiguring daemon osd.4 on smithi142 2024-02-19T19:06:19.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:19 smithi046 ceph-mon[88928]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:19.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.617+0000 7f8191ffd700 1 -- 172.21.15.46:0/2418026665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f818c04f2a0 con 0x7f818c0ffc60 2024-02-19T19:06:19.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.617+0000 7f8188ff9700 1 -- 172.21.15.46:0/2418026665 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f818005a2d0 con 0x7f818c0ffc60 2024-02-19T19:06:19.637 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:06:19.638 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-02-19T19:06:19.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:06:19.639 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:06:19.639 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:06:19.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 -- 172.21.15.46:0/2418026665 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f817406d9e0 msgr2=0x7f817406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f817406d9e0 0x7f817406fe90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f817c006010 tx=0x7f817c00b540 comp rx=0 tx=0).stop 2024-02-19T19:06:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 -- 172.21.15.46:0/2418026665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f818c0ffc60 msgr2=0x7f818c1963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f818c0ffc60 0x7f818c1963e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f818000d8d0 tx=0x7f818000dbe0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 -- 172.21.15.46:0/2418026665 shutdown_connections 2024-02-19T19:06:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f817406d9e0 0x7f817406fe90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f818c0ff350 0x7f818c195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 --2- 172.21.15.46:0/2418026665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f818c0ffc60 0x7f818c1963e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 -- 172.21.15.46:0/2418026665 >> 172.21.15.46:0/2418026665 conn(0x7f818c0748b0 msgr2=0x7f818c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:19.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 -- 172.21.15.46:0/2418026665 shutdown_connections 2024-02-19T19:06:19.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.619+0000 7f8191ffd700 1 -- 172.21.15.46:0/2418026665 wait complete. 2024-02-19T19:06:19.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:19 smithi142 ceph-mon[69118]: pgmap v28: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:19.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:19.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:19.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:19 smithi142 ceph-mon[69118]: Reconfiguring osd.4 (monmap changed)... 2024-02-19T19:06:19.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T19:06:19.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:19.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:19 smithi142 ceph-mon[69118]: Reconfiguring daemon osd.4 on smithi142 2024-02-19T19:06:19.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:19 smithi142 ceph-mon[69118]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:19.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.725+0000 7f0b0207c700 1 -- 172.21.15.46:0/3551038972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc101420 msgr2=0x7f0afc1017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:19.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.725+0000 7f0b0207c700 1 --2- 172.21.15.46:0/3551038972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc101420 0x7f0afc1017f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009910 tx=0x7f0aec009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:19.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.725+0000 7f0b0207c700 1 -- 172.21.15.46:0/3551038972 shutdown_connections 2024-02-19T19:06:19.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.725+0000 7f0b0207c700 1 --2- 172.21.15.46:0/3551038972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc101d30 0x7f0afc10a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.725+0000 7f0b0207c700 1 --2- 172.21.15.46:0/3551038972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc101420 0x7f0afc1017f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.725+0000 7f0b0207c700 1 -- 172.21.15.46:0/3551038972 >> 172.21.15.46:0/3551038972 conn(0x7f0afc0fac80 msgr2=0x7f0afc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:19.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.725+0000 7f0b0207c700 1 -- 172.21.15.46:0/3551038972 shutdown_connections 2024-02-19T19:06:19.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.725+0000 7f0b0207c700 1 -- 172.21.15.46:0/3551038972 wait complete. 2024-02-19T19:06:19.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.726+0000 7f0b0207c700 1 Processor -- start 2024-02-19T19:06:19.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.726+0000 7f0b0207c700 1 -- start start 2024-02-19T19:06:19.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.726+0000 7f0b0207c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc101420 0x7f0afc195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:19.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.726+0000 7f0b0207c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc101d30 0x7f0afc1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:19.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.726+0000 7f0b0207c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc196a90 con 0x7f0afc101d30 2024-02-19T19:06:19.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.726+0000 7f0b0207c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc19a820 con 0x7f0afc101420 2024-02-19T19:06:19.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.726+0000 7f0afaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc101d30 0x7f0afc1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:19.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0afaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc101d30 0x7f0afc1963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40340/0 (socket says 172.21.15.46:40340) 2024-02-19T19:06:19.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0afaffd700 1 -- 172.21.15.46:0/1069265856 learned_addr learned my addr 172.21.15.46:0/1069265856 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:19.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0afb7fe700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc101420 0x7f0afc195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:19.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0afaffd700 1 -- 172.21.15.46:0/1069265856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc101420 msgr2=0x7f0afc195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:19.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0afaffd700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc101420 0x7f0afc195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:19.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0afaffd700 1 -- 172.21.15.46:0/1069265856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0095f0 con 0x7f0afc101d30 2024-02-19T19:06:19.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0afaffd700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc101d30 0x7f0afc1963b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400e920 tx=0x7f0ae400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:19.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0af8ff9700 1 -- 172.21.15.46:0/1069265856 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae400c9d0 con 0x7f0afc101d30 2024-02-19T19:06:19.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0af8ff9700 1 -- 172.21.15.46:0/1069265856 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ae4010430 con 0x7f0afc101d30 2024-02-19T19:06:19.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0af8ff9700 1 -- 172.21.15.46:0/1069265856 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae4018630 con 0x7f0afc101d30 2024-02-19T19:06:19.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0b0207c700 1 -- 172.21.15.46:0/1069265856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc19ab00 con 0x7f0afc101d30 2024-02-19T19:06:19.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.727+0000 7f0b0207c700 1 -- 172.21.15.46:0/1069265856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc19b050 con 0x7f0afc101d30 2024-02-19T19:06:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.728+0000 7f0b0207c700 1 -- 172.21.15.46:0/1069265856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc107900 con 0x7f0afc101d30 2024-02-19T19:06:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.729+0000 7f0af8ff9700 1 -- 172.21.15.46:0/1069265856 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f0ae40105a0 con 0x7f0afc101d30 2024-02-19T19:06:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.729+0000 7f0af8ff9700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0ae806d9e0 0x7f0ae806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.729+0000 7f0af8ff9700 1 -- 172.21.15.46:0/1069265856 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0ae4014070 con 0x7f0afc101d30 2024-02-19T19:06:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.729+0000 7f0afb7fe700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0ae806d9e0 0x7f0ae806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:19.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.730+0000 7f0afb7fe700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0ae806d9e0 0x7f0ae806fe90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0059d0 tx=0x7f0aec005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:19.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.734+0000 7f0af8ff9700 1 -- 172.21.15.46:0/1069265856 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0ae4052d20 con 0x7f0afc101d30 2024-02-19T19:06:20.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.987+0000 7f0b0207c700 1 -- 172.21.15.46:0/1069265856 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0afc19b270 con 0x7f0afc101d30 2024-02-19T19:06:20.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.988+0000 7f0af8ff9700 1 -- 172.21.15.46:0/1069265856 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1856 (secure 0 0 0) 0x7f0ae4057000 con 0x7f0afc101d30 2024-02-19T19:06:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:e17 2024-02-19T19:06:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 17 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T18:59:38.092640+0000 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:06:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:06:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:06:20.011 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:06:20.011 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:06:20.011 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:06:20.011 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:06:20.011 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:06:20.011 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:06:20.011 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:06:20.011 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:06:20.011 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:06:20.011 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:06:20.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.990+0000 7f0b0207c700 1 -- 172.21.15.46:0/1069265856 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0ae806d9e0 msgr2=0x7f0ae806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:20.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.990+0000 7f0b0207c700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0ae806d9e0 0x7f0ae806fe90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0059d0 tx=0x7f0aec005940 comp rx=0 tx=0).stop 2024-02-19T19:06:20.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.991+0000 7f0b0207c700 1 -- 172.21.15.46:0/1069265856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc101d30 msgr2=0x7f0afc1963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:20.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.991+0000 7f0b0207c700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc101d30 0x7f0afc1963b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0ae400e920 tx=0x7f0ae400ec30 comp rx=0 tx=0).stop 2024-02-19T19:06:20.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.991+0000 7f0b0207c700 1 -- 172.21.15.46:0/1069265856 shutdown_connections 2024-02-19T19:06:20.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.991+0000 7f0b0207c700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0ae806d9e0 0x7f0ae806fe90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.991+0000 7f0b0207c700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc101420 0x7f0afc195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.991+0000 7f0b0207c700 1 --2- 172.21.15.46:0/1069265856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc101d30 0x7f0afc1963b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.991+0000 7f0b0207c700 1 -- 172.21.15.46:0/1069265856 >> 172.21.15.46:0/1069265856 conn(0x7f0afc0fac80 msgr2=0x7f0afc104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:20.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.991+0000 7f0b0207c700 1 -- 172.21.15.46:0/1069265856 shutdown_connections 2024-02-19T19:06:20.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:19.991+0000 7f0b0207c700 1 -- 172.21.15.46:0/1069265856 wait complete. 2024-02-19T19:06:20.013 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T19:06:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.098+0000 7efd12058700 1 -- 172.21.15.46:0/3624530101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c0ff3c0 msgr2=0x7efd0c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.098+0000 7efd12058700 1 --2- 172.21.15.46:0/3624530101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c0ff3c0 0x7efd0c0ff790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009910 tx=0x7efcfc009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.098+0000 7efd12058700 1 -- 172.21.15.46:0/3624530101 shutdown_connections 2024-02-19T19:06:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.098+0000 7efd12058700 1 --2- 172.21.15.46:0/3624530101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c0ffd60 0x7efd0c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.098+0000 7efd12058700 1 --2- 172.21.15.46:0/3624530101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c0ff3c0 0x7efd0c0ff790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.098+0000 7efd12058700 1 -- 172.21.15.46:0/3624530101 >> 172.21.15.46:0/3624530101 conn(0x7efd0c0fac80 msgr2=0x7efd0c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.098+0000 7efd12058700 1 -- 172.21.15.46:0/3624530101 shutdown_connections 2024-02-19T19:06:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.098+0000 7efd12058700 1 -- 172.21.15.46:0/3624530101 wait complete. 2024-02-19T19:06:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd12058700 1 Processor -- start 2024-02-19T19:06:20.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd12058700 1 -- start start 2024-02-19T19:06:20.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd12058700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c0ff3c0 0x7efd0c100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd12058700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c0ffd60 0x7efd0c101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd12058700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c101850 con 0x7efd0c0ffd60 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd12058700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c101990 con 0x7efd0c0ff3c0 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd0affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c0ffd60 0x7efd0c101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd0affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c0ffd60 0x7efd0c101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40358/0 (socket says 172.21.15.46:40358) 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd0affd700 1 -- 172.21.15.46:0/3183567362 learned_addr learned my addr 172.21.15.46:0/3183567362 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd0b7fe700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c0ff3c0 0x7efd0c100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd0affd700 1 -- 172.21.15.46:0/3183567362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c0ff3c0 msgr2=0x7efd0c100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd0affd700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c0ff3c0 0x7efd0c100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.099+0000 7efd0affd700 1 -- 172.21.15.46:0/3183567362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc0095f0 con 0x7efd0c0ffd60 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.100+0000 7efd0affd700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c0ffd60 0x7efd0c101310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd0000d900 tx=0x7efd0000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.100+0000 7efd08ff9700 1 -- 172.21.15.46:0/3183567362 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd00009900 con 0x7efd0c0ffd60 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.100+0000 7efd08ff9700 1 -- 172.21.15.46:0/3183567362 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd00010460 con 0x7efd0c0ffd60 2024-02-19T19:06:20.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.100+0000 7efd12058700 1 -- 172.21.15.46:0/3183567362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c1a20f0 con 0x7efd0c0ffd60 2024-02-19T19:06:20.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.100+0000 7efd08ff9700 1 -- 172.21.15.46:0/3183567362 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd0000f5f0 con 0x7efd0c0ffd60 2024-02-19T19:06:20.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.100+0000 7efd12058700 1 -- 172.21.15.46:0/3183567362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c1a2500 con 0x7efd0c0ffd60 2024-02-19T19:06:20.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.101+0000 7efd12058700 1 -- 172.21.15.46:0/3183567362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c1086e0 con 0x7efd0c0ffd60 2024-02-19T19:06:20.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.101+0000 7efd08ff9700 1 -- 172.21.15.46:0/3183567362 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7efd000105d0 con 0x7efd0c0ffd60 2024-02-19T19:06:20.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.102+0000 7efd08ff9700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efcf406d9e0 0x7efcf406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:20.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.102+0000 7efd08ff9700 1 -- 172.21.15.46:0/3183567362 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efd0008d190 con 0x7efd0c0ffd60 2024-02-19T19:06:20.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.102+0000 7efd0b7fe700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efcf406d9e0 0x7efcf406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:20.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.102+0000 7efd0b7fe700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efcf406d9e0 0x7efcf406fe90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efcfc006010 tx=0x7efcfc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:20.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.106+0000 7efd08ff9700 1 -- 172.21.15.46:0/3183567362 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efd00056850 con 0x7efd0c0ffd60 2024-02-19T19:06:20.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.341+0000 7efd12058700 1 -- 172.21.15.46:0/3183567362 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd0c102370 con 0x7efcf406d9e0 2024-02-19T19:06:20.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.342+0000 7efd08ff9700 1 -- 172.21.15.46:0/3183567362 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7efd0c102370 con 0x7efcf406d9e0 2024-02-19T19:06:20.362 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:06:20.362 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:06:20.362 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:06:20.363 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:06:20.363 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:06:20.363 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:06:20.363 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:06:20.363 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:06:20.363 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "4/23 daemons upgraded", 2024-02-19T19:06:20.363 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mon daemons", 2024-02-19T19:06:20.363 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:06:20.363 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:06:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 -- 172.21.15.46:0/3183567362 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efcf406d9e0 msgr2=0x7efcf406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efcf406d9e0 0x7efcf406fe90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efcfc006010 tx=0x7efcfc01a040 comp rx=0 tx=0).stop 2024-02-19T19:06:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 -- 172.21.15.46:0/3183567362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c0ffd60 msgr2=0x7efd0c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c0ffd60 0x7efd0c101310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efd0000d900 tx=0x7efd0000dc10 comp rx=0 tx=0).stop 2024-02-19T19:06:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 -- 172.21.15.46:0/3183567362 shutdown_connections 2024-02-19T19:06:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efcf406d9e0 0x7efcf406fe90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd0c0ff3c0 0x7efd0c100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 --2- 172.21.15.46:0/3183567362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd0c0ffd60 0x7efd0c101310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 -- 172.21.15.46:0/3183567362 >> 172.21.15.46:0/3183567362 conn(0x7efd0c0fac80 msgr2=0x7efd0c069050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 -- 172.21.15.46:0/3183567362 shutdown_connections 2024-02-19T19:06:20.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.344+0000 7efd12058700 1 -- 172.21.15.46:0/3183567362 wait complete. 2024-02-19T19:06:20.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.450+0000 7f9593335700 1 -- 172.21.15.46:0/3388170196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f958c100e80 msgr2=0x7f958c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:20.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.450+0000 7f9593335700 1 --2- 172.21.15.46:0/3388170196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f958c100e80 0x7f958c104e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f957c009910 tx=0x7f957c009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:20.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.450+0000 7f9593335700 1 -- 172.21.15.46:0/3388170196 shutdown_connections 2024-02-19T19:06:20.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.450+0000 7f9593335700 1 --2- 172.21.15.46:0/3388170196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f958c100e80 0x7f958c104e50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.450+0000 7f9593335700 1 --2- 172.21.15.46:0/3388170196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f958c1004e0 0x7f958c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.450+0000 7f9593335700 1 -- 172.21.15.46:0/3388170196 >> 172.21.15.46:0/3388170196 conn(0x7f958c0fbda0 msgr2=0x7f958c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:20.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.450+0000 7f9593335700 1 -- 172.21.15.46:0/3388170196 shutdown_connections 2024-02-19T19:06:20.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.450+0000 7f9593335700 1 -- 172.21.15.46:0/3388170196 wait complete. 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f9593335700 1 Processor -- start 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f9593335700 1 -- start start 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f9593335700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f958c1004e0 0x7f958c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f9593335700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f958c100e80 0x7f958c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f9593335700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c073ad0 con 0x7f958c1004e0 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f9593335700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c073c10 con 0x7f958c100e80 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f95910d1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f958c1004e0 0x7f958c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f95910d1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f958c1004e0 0x7f958c073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40382/0 (socket says 172.21.15.46:40382) 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f95910d1700 1 -- 172.21.15.46:0/4031890987 learned_addr learned my addr 172.21.15.46:0/4031890987 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f95908d0700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f958c100e80 0x7f958c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:20.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f95910d1700 1 -- 172.21.15.46:0/4031890987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f958c100e80 msgr2=0x7f958c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f95910d1700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f958c100e80 0x7f958c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f95910d1700 1 -- 172.21.15.46:0/4031890987 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c0095f0 con 0x7f958c1004e0 2024-02-19T19:06:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.451+0000 7f95910d1700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f958c1004e0 0x7f958c073050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f958800e920 tx=0x7f958800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.452+0000 7f95827fc700 1 -- 172.21.15.46:0/4031890987 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f958800c9d0 con 0x7f958c1004e0 2024-02-19T19:06:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.452+0000 7f95827fc700 1 -- 172.21.15.46:0/4031890987 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9588010430 con 0x7f958c1004e0 2024-02-19T19:06:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.452+0000 7f9593335700 1 -- 172.21.15.46:0/4031890987 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c1a2100 con 0x7f958c1004e0 2024-02-19T19:06:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.452+0000 7f95827fc700 1 -- 172.21.15.46:0/4031890987 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9588018630 con 0x7f958c1004e0 2024-02-19T19:06:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.452+0000 7f9593335700 1 -- 172.21.15.46:0/4031890987 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c1a24b0 con 0x7f958c1004e0 2024-02-19T19:06:20.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.453+0000 7f9593335700 1 -- 172.21.15.46:0/4031890987 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c108850 con 0x7f958c1004e0 2024-02-19T19:06:20.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.453+0000 7f95827fc700 1 -- 172.21.15.46:0/4031890987 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f95880105a0 con 0x7f958c1004e0 2024-02-19T19:06:20.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.454+0000 7f95827fc700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f957806d9e0 0x7f957806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:20.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.454+0000 7f95827fc700 1 -- 172.21.15.46:0/4031890987 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9588014070 con 0x7f958c1004e0 2024-02-19T19:06:20.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.454+0000 7f95908d0700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f957806d9e0 0x7f957806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:20.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.454+0000 7f95908d0700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f957806d9e0 0x7f957806fe90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f957c0059d0 tx=0x7f957c005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:20.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.458+0000 7f95827fc700 1 -- 172.21.15.46:0/4031890987 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9588052d20 con 0x7f958c1004e0 2024-02-19T19:06:20.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:20 smithi142 ceph-mon[69118]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:20.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:20 smithi142 ceph-mon[69118]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:20.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:20 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2418026665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:20.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:20 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1069265856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:06:20.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:20.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:20.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T19:06:20.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:20.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.746+0000 7f9593335700 1 -- 172.21.15.46:0/4031890987 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f958c0746c0 con 0x7f958c1004e0 2024-02-19T19:06:20.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:20 smithi046 ceph-mon[88928]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:20.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:20 smithi046 ceph-mon[88928]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:20.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:20 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2418026665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:20.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:20 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1069265856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:06:20.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:20.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:20.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T19:06:20.767 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:20.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.746+0000 7f95827fc700 1 -- 172.21.15.46:0/4031890987 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9588056fe0 con 0x7f958c1004e0 2024-02-19T19:06:20.768 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_OK 2024-02-19T19:06:20.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.748+0000 7f9593335700 1 -- 172.21.15.46:0/4031890987 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f957806d9e0 msgr2=0x7f957806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:20.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.748+0000 7f9593335700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f957806d9e0 0x7f957806fe90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f957c0059d0 tx=0x7f957c005940 comp rx=0 tx=0).stop 2024-02-19T19:06:20.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.748+0000 7f9593335700 1 -- 172.21.15.46:0/4031890987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f958c1004e0 msgr2=0x7f958c073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:20.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.748+0000 7f9593335700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f958c1004e0 0x7f958c073050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f958800e920 tx=0x7f958800ec30 comp rx=0 tx=0).stop 2024-02-19T19:06:20.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.749+0000 7f9593335700 1 -- 172.21.15.46:0/4031890987 shutdown_connections 2024-02-19T19:06:20.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.749+0000 7f9593335700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f957806d9e0 0x7f957806fe90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.749+0000 7f9593335700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f958c1004e0 0x7f958c073050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.749+0000 7f9593335700 1 --2- 172.21.15.46:0/4031890987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f958c100e80 0x7f958c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:20.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.749+0000 7f9593335700 1 -- 172.21.15.46:0/4031890987 >> 172.21.15.46:0/4031890987 conn(0x7f958c0fbda0 msgr2=0x7f958c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:20.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.749+0000 7f9593335700 1 -- 172.21.15.46:0/4031890987 shutdown_connections 2024-02-19T19:06:20.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:20.749+0000 7f9593335700 1 -- 172.21.15.46:0/4031890987 wait complete. 2024-02-19T19:06:21.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:21 smithi142 ceph-mon[69118]: pgmap v29: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:21.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:21 smithi142 ceph-mon[69118]: Reconfiguring osd.5 (monmap changed)... 2024-02-19T19:06:21.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:21 smithi142 ceph-mon[69118]: Reconfiguring daemon osd.5 on smithi142 2024-02-19T19:06:21.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:21 smithi142 ceph-mon[69118]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:21.767 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:21 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/4031890987' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:06:21.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:21 smithi046 ceph-mon[88928]: pgmap v29: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:21.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:21 smithi046 ceph-mon[88928]: Reconfiguring osd.5 (monmap changed)... 2024-02-19T19:06:21.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:21 smithi046 ceph-mon[88928]: Reconfiguring daemon osd.5 on smithi142 2024-02-19T19:06:21.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:21 smithi046 ceph-mon[88928]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:21.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:21 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/4031890987' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:06:23.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:22 smithi046 ceph-mon[88928]: pgmap v30: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:23.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:22 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:23.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:22 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:23.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:22 smithi046 ceph-mon[88928]: Reconfiguring mds.cephfs.smithi142.maazlq (monmap changed)... 2024-02-19T19:06:23.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:22 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.maazlq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:06:23.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:22 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:23.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:22 smithi046 ceph-mon[88928]: Reconfiguring daemon mds.cephfs.smithi142.maazlq on smithi142 2024-02-19T19:06:23.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:22 smithi142 ceph-mon[69118]: pgmap v30: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:23.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:22 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:23.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:22 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:23.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:22 smithi142 ceph-mon[69118]: Reconfiguring mds.cephfs.smithi142.maazlq (monmap changed)... 2024-02-19T19:06:23.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:22 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.maazlq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:06:23.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:22 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:23.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:22 smithi142 ceph-mon[69118]: Reconfiguring daemon mds.cephfs.smithi142.maazlq on smithi142 2024-02-19T19:06:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:24 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:24 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:24 smithi142 ceph-mon[69118]: Reconfiguring mds.cephfs.smithi142.eqnctx (monmap changed)... 2024-02-19T19:06:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:24 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.eqnctx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:06:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:24 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:24 smithi142 ceph-mon[69118]: Reconfiguring daemon mds.cephfs.smithi142.eqnctx on smithi142 2024-02-19T19:06:24.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:24 smithi142 ceph-mon[69118]: pgmap v31: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:24 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:24 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:24 smithi046 ceph-mon[88928]: Reconfiguring mds.cephfs.smithi142.eqnctx (monmap changed)... 2024-02-19T19:06:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:24 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.eqnctx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:06:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:24 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:24 smithi046 ceph-mon[88928]: Reconfiguring daemon mds.cephfs.smithi142.eqnctx on smithi142 2024-02-19T19:06:25.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:24 smithi046 ceph-mon[88928]: pgmap v31: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:26.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:26.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:26.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:26.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:26.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:26.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: Upgrade: Setting container_image for all mon 2024-02-19T19:06:26.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:26.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"}]: dispatch 2024-02-19T19:06:26.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"}]': finished 2024-02-19T19:06:26.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]: dispatch 2024-02-19T19:06:26.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]': finished 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: Upgrade: Setting container_image for all mon 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"}]: dispatch 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"}]': finished 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]: dispatch 2024-02-19T19:06:26.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]': finished 2024-02-19T19:06:27.446 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:27 smithi046 ceph-mon[88928]: pgmap v32: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:27.446 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:27.447 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:06:27.447 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:27.602 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:27 smithi142 ceph-mon[69118]: pgmap v32: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:27.602 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:27.603 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:06:27.603 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:28.469 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:28 smithi046 ceph-mon[88928]: Upgrade: Updating crash.smithi046 (1/2) 2024-02-19T19:06:28.470 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:28 smithi046 ceph-mon[88928]: Deploying daemon crash.smithi046 on smithi046 2024-02-19T19:06:28.470 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:28.615 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:28 smithi142 ceph-mon[69118]: Upgrade: Updating crash.smithi046 (1/2) 2024-02-19T19:06:28.615 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:28 smithi142 ceph-mon[69118]: Deploying daemon crash.smithi046 on smithi046 2024-02-19T19:06:28.615 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:29.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:29 smithi046 ceph-mon[88928]: pgmap v33: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:29.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:29 smithi142 ceph-mon[69118]: pgmap v33: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:31.532 INFO:tasks.workunit.client.1.smithi142.stderr:Note: switching to '1ce7ea8877c709fa862eac608550374bd96e166e'. 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr:state without impacting any branches by switching back to a branch. 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr: git switch -c 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr:Or undo this operation with: 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr: git switch - 2024-02-19T19:06:31.533 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-02-19T19:06:31.534 INFO:tasks.workunit.client.1.smithi142.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-19T19:06:31.534 INFO:tasks.workunit.client.1.smithi142.stderr: 2024-02-19T19:06:31.534 INFO:tasks.workunit.client.1.smithi142.stderr:HEAD is now at 1ce7ea8877c fix 2024-02-19T19:06:31.538 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-19T19:06:31.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:31 smithi046 ceph-mon[88928]: pgmap v34: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:31.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:31.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:31.593 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:31 smithi142 ceph-mon[69118]: pgmap v34: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:31.593 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:31.593 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:31.596 INFO:tasks.workunit.client.1.smithi142.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-19T19:06:31.598 INFO:tasks.workunit.client.1.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-19T19:06:31.598 INFO:tasks.workunit.client.1.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-19T19:06:33.279 INFO:tasks.workunit.client.1.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-19T19:06:33.332 INFO:tasks.workunit.client.1.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-19T19:06:33.373 INFO:tasks.workunit.client.1.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-19T19:06:33.375 INFO:tasks.workunit.client.1.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-19T19:06:33.375 INFO:tasks.workunit.client.1.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-19T19:06:33.427 INFO:tasks.workunit.client.1.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-19T19:06:33.430 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T19:06:33.430 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-19T19:06:33.445 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-19T19:06:33.447 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-19T19:06:33.447 DEBUG:teuthology.orchestra.run.smithi142:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ce7ea8877c709fa862eac608550374bd96e166e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-19T19:06:33.505 INFO:tasks.workunit.client.1.smithi142.stderr:+ mkdir -p fsstress 2024-02-19T19:06:33.508 INFO:tasks.workunit.client.1.smithi142.stderr:+ pushd fsstress 2024-02-19T19:06:33.508 INFO:tasks.workunit.client.1.smithi142.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-19T19:06:33.508 INFO:tasks.workunit.client.1.smithi142.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-19T19:06:33.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:33 smithi046 ceph-mon[88928]: pgmap v35: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:33.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:33 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:33.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:33 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:06:33.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:33 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:33.655 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:33 smithi142 ceph-mon[69118]: pgmap v35: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:33.655 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:33 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:33.655 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:33 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:06:33.655 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:33 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:34.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:34 smithi142 ceph-mon[69118]: Upgrade: Updating crash.smithi142 (2/2) 2024-02-19T19:06:34.511 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:34 smithi142 ceph-mon[69118]: Deploying daemon crash.smithi142 on smithi142 2024-02-19T19:06:34.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:34 smithi046 ceph-mon[88928]: Upgrade: Updating crash.smithi142 (2/2) 2024-02-19T19:06:34.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:34 smithi046 ceph-mon[88928]: Deploying daemon crash.smithi142 on smithi142 2024-02-19T19:06:35.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:35 smithi046 ceph-mon[88928]: pgmap v36: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:35.666 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:35 smithi142 ceph-mon[69118]: pgmap v36: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:37.659 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:37 smithi142 ceph-mon[69118]: pgmap v37: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:37.659 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:37.659 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:37.659 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:37.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:37 smithi046 ceph-mon[88928]: pgmap v37: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:37.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:37.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:37.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:39.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:39 smithi046 ceph-mon[88928]: pgmap v38: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:39.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:39.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:39.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:39 smithi142 ceph-mon[69118]: pgmap v38: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:06:39.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:39 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:39.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:39 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:41.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:41 smithi142 ceph-mon[69118]: pgmap v39: 65 pgs: 65 active+clean; 602 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-19T19:06:41.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:41 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:41.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:41 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:41.830 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:41 smithi046 ceph-mon[88928]: pgmap v39: 65 pgs: 65 active+clean; 602 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-19T19:06:41.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:41.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:43.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:42 smithi142 ceph-mon[69118]: pgmap v40: 65 pgs: 65 active+clean; 602 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-19T19:06:43.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:43.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:43.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:43.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:42 smithi046 ceph-mon[88928]: pgmap v40: 65 pgs: 65 active+clean; 602 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-19T19:06:43.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:43.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:43.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:44.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:44.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:44.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:44.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:45.168 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:45 smithi046 ceph-mon[88928]: pgmap v41: 65 pgs: 65 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s wr, 0 op/s 2024-02-19T19:06:45.168 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:45.168 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:45.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:45 smithi142 ceph-mon[69118]: pgmap v41: 65 pgs: 65 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s wr, 0 op/s 2024-02-19T19:06:45.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:45.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: pgmap v42: 65 pgs: 65 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s wr, 0 op/s 2024-02-19T19:06:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"}]: dispatch 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"}]': finished 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]: dispatch 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]': finished 2024-02-19T19:06:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-19T19:06:47.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: pgmap v42: 65 pgs: 65 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s wr, 0 op/s 2024-02-19T19:06:47.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:47.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:47.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"}]: dispatch 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"}]': finished 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]: dispatch 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]': finished 2024-02-19T19:06:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-19T19:06:48.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:48 smithi046 ceph-mon[88928]: Upgrade: Setting container_image for all crash 2024-02-19T19:06:48.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:48 smithi046 ceph-mon[88928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-19T19:06:48.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:48 smithi046 ceph-mon[88928]: Upgrade: osd.0 is safe to restart 2024-02-19T19:06:48.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:48 smithi142 ceph-mon[69118]: Upgrade: Setting container_image for all crash 2024-02-19T19:06:48.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:48 smithi142 ceph-mon[69118]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-19T19:06:48.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:48 smithi142 ceph-mon[69118]: Upgrade: osd.0 is safe to restart 2024-02-19T19:06:49.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:49 smithi046 ceph-mon[88928]: pgmap v43: 65 pgs: 65 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s wr, 0 op/s 2024-02-19T19:06:49.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:49 smithi046 ceph-mon[88928]: Upgrade: Updating osd.0 2024-02-19T19:06:49.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:49.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T19:06:49.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:49.823 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:49 smithi046 ceph-mon[88928]: Deploying daemon osd.0 on smithi046 2024-02-19T19:06:49.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:49 smithi142 ceph-mon[69118]: pgmap v43: 65 pgs: 65 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s wr, 0 op/s 2024-02-19T19:06:49.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:49 smithi142 ceph-mon[69118]: Upgrade: Updating osd.0 2024-02-19T19:06:49.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:49.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T19:06:49.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:49.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:49 smithi142 ceph-mon[69118]: Deploying daemon osd.0 on smithi046 2024-02-19T19:06:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.915+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3528860026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b400ff350 msgr2=0x7f4b400ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.915+0000 7f4b44c4c700 1 --2- 172.21.15.46:0/3528860026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b400ff350 0x7f4b400ff720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009910 tx=0x7f4b30009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.915+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3528860026 shutdown_connections 2024-02-19T19:06:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.915+0000 7f4b44c4c700 1 --2- 172.21.15.46:0/3528860026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b400ffc60 0x7f4b4010a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.915+0000 7f4b44c4c700 1 --2- 172.21.15.46:0/3528860026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b400ff350 0x7f4b400ff720 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:50.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.915+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3528860026 >> 172.21.15.46:0/3528860026 conn(0x7f4b400748b0 msgr2=0x7f4b40074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.916+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3528860026 shutdown_connections 2024-02-19T19:06:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.916+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3528860026 wait complete. 2024-02-19T19:06:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.917+0000 7f4b44c4c700 1 Processor -- start 2024-02-19T19:06:50.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.917+0000 7f4b44c4c700 1 -- start start 2024-02-19T19:06:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.917+0000 7f4b44c4c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b400ff350 0x7f4b40195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.917+0000 7f4b3e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b400ff350 0x7f4b40195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.917+0000 7f4b3e59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b400ff350 0x7f4b40195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39036/0 (socket says 172.21.15.46:39036) 2024-02-19T19:06:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.917+0000 7f4b44c4c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b400ffc60 0x7f4b401964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.917+0000 7f4b3e59c700 1 -- 172.21.15.46:0/3516861128 learned_addr learned my addr 172.21.15.46:0/3516861128 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.917+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b40196b80 con 0x7f4b400ff350 2024-02-19T19:06:50.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.917+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4019a910 con 0x7f4b400ffc60 2024-02-19T19:06:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.918+0000 7f4b3dd9b700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b400ffc60 0x7f4b401964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.918+0000 7f4b3e59c700 1 -- 172.21.15.46:0/3516861128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b400ffc60 msgr2=0x7f4b401964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.918+0000 7f4b3e59c700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b400ffc60 0x7f4b401964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.918+0000 7f4b3e59c700 1 -- 172.21.15.46:0/3516861128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300095f0 con 0x7f4b400ff350 2024-02-19T19:06:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.918+0000 7f4b3e59c700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b400ff350 0x7f4b40195f60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009fd0 tx=0x7f4b3000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:50.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.918+0000 7f4b2f7fe700 1 -- 172.21.15.46:0/3516861128 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b3001d070 con 0x7f4b400ff350 2024-02-19T19:06:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.918+0000 7f4b2f7fe700 1 -- 172.21.15.46:0/3516861128 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b30022470 con 0x7f4b400ff350 2024-02-19T19:06:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.918+0000 7f4b2f7fe700 1 -- 172.21.15.46:0/3516861128 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b30017610 con 0x7f4b400ff350 2024-02-19T19:06:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.919+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4019ab90 con 0x7f4b400ff350 2024-02-19T19:06:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.919+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4019afc0 con 0x7f4b400ff350 2024-02-19T19:06:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.920+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b40107dd0 con 0x7f4b400ff350 2024-02-19T19:06:50.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.921+0000 7f4b2f7fe700 1 -- 172.21.15.46:0/3516861128 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f4b30005080 con 0x7f4b400ff350 2024-02-19T19:06:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.922+0000 7f4b2f7fe700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4b28071e30 0x7f4b280742e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.923+0000 7f4b3dd9b700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4b28071e30 0x7f4b280742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.923+0000 7f4b2f7fe700 1 -- 172.21.15.46:0/3516861128 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4b3008ed70 con 0x7f4b400ff350 2024-02-19T19:06:50.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.923+0000 7f4b3dd9b700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4b28071e30 0x7f4b280742e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b40197580 tx=0x7f4b34009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:50.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:50.927+0000 7f4b2f7fe700 1 -- 172.21.15.46:0/3516861128 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4b30093070 con 0x7f4b400ff350 2024-02-19T19:06:51.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.232+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b4019b290 con 0x7f4b28071e30 2024-02-19T19:06:51.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.233+0000 7f4b2f7fe700 1 -- 172.21.15.46:0/3516861128 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4b4019b290 con 0x7f4b28071e30 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4b28071e30 msgr2=0x7f4b280742e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4b28071e30 0x7f4b280742e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b40197580 tx=0x7f4b34009260 comp rx=0 tx=0).stop 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b400ff350 msgr2=0x7f4b40195f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b400ff350 0x7f4b40195f60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009fd0 tx=0x7f4b3000f690 comp rx=0 tx=0).stop 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 shutdown_connections 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4b28071e30 0x7f4b280742e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b400ff350 0x7f4b40195f60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 --2- 172.21.15.46:0/3516861128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b400ffc60 0x7f4b401964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 >> 172.21.15.46:0/3516861128 conn(0x7f4b400748b0 msgr2=0x7f4b40104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 shutdown_connections 2024-02-19T19:06:51.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.236+0000 7f4b44c4c700 1 -- 172.21.15.46:0/3516861128 wait complete. 2024-02-19T19:06:51.268 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:06:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.347+0000 7f8f855dd700 1 -- 172.21.15.46:0/2520866699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f800ffd60 msgr2=0x7f8f80103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.347+0000 7f8f855dd700 1 --2- 172.21.15.46:0/2520866699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f800ffd60 0x7f8f80103d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009910 tx=0x7f8f74009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.347+0000 7f8f855dd700 1 -- 172.21.15.46:0/2520866699 shutdown_connections 2024-02-19T19:06:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.347+0000 7f8f855dd700 1 --2- 172.21.15.46:0/2520866699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f800ffd60 0x7f8f80103d30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.347+0000 7f8f855dd700 1 --2- 172.21.15.46:0/2520866699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f800ff3c0 0x7f8f800ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.347+0000 7f8f855dd700 1 -- 172.21.15.46:0/2520866699 >> 172.21.15.46:0/2520866699 conn(0x7f8f800fac60 msgr2=0x7f8f800fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.348+0000 7f8f855dd700 1 -- 172.21.15.46:0/2520866699 shutdown_connections 2024-02-19T19:06:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.348+0000 7f8f855dd700 1 -- 172.21.15.46:0/2520866699 wait complete. 2024-02-19T19:06:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.348+0000 7f8f855dd700 1 Processor -- start 2024-02-19T19:06:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.349+0000 7f8f855dd700 1 -- start start 2024-02-19T19:06:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.349+0000 7f8f855dd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f800ff3c0 0x7f8f80196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.349+0000 7f8f855dd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f800ffd60 0x7f8f80197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.349+0000 7f8f7e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f800ffd60 0x7f8f80197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.349+0000 7f8f7e7fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f800ffd60 0x7f8f80197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39054/0 (socket says 172.21.15.46:39054) 2024-02-19T19:06:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.349+0000 7f8f7e7fc700 1 -- 172.21.15.46:0/2140968844 learned_addr learned my addr 172.21.15.46:0/2140968844 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.349+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f80197860 con 0x7f8f800ffd60 2024-02-19T19:06:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.349+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f801979d0 con 0x7f8f800ff3c0 2024-02-19T19:06:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.350+0000 7f8f7effd700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f800ff3c0 0x7f8f80196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.350+0000 7f8f7e7fc700 1 -- 172.21.15.46:0/2140968844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f800ff3c0 msgr2=0x7f8f80196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.350+0000 7f8f7e7fc700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f800ff3c0 0x7f8f80196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.350+0000 7f8f7e7fc700 1 -- 172.21.15.46:0/2140968844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f740095f0 con 0x7f8f800ffd60 2024-02-19T19:06:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.350+0000 7f8f7e7fc700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f800ffd60 0x7f8f80197240 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400bda0 tx=0x7f8f7400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.350+0000 7f8f67fff700 1 -- 172.21.15.46:0/2140968844 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f7401d070 con 0x7f8f800ffd60 2024-02-19T19:06:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.350+0000 7f8f67fff700 1 -- 172.21.15.46:0/2140968844 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f7400f460 con 0x7f8f800ffd60 2024-02-19T19:06:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.350+0000 7f8f67fff700 1 -- 172.21.15.46:0/2140968844 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f74017630 con 0x7f8f800ffd60 2024-02-19T19:06:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.350+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8019fd70 con 0x7f8f800ffd60 2024-02-19T19:06:51.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.352+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f801a0120 con 0x7f8f800ffd60 2024-02-19T19:06:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.352+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f80107730 con 0x7f8f800ffd60 2024-02-19T19:06:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.353+0000 7f8f67fff700 1 -- 172.21.15.46:0/2140968844 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f8f7400fa20 con 0x7f8f800ffd60 2024-02-19T19:06:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.353+0000 7f8f67fff700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8f6806d9e0 0x7f8f6806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.354+0000 7f8f7effd700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8f6806d9e0 0x7f8f6806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.354+0000 7f8f67fff700 1 -- 172.21.15.46:0/2140968844 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8f7405be50 con 0x7f8f800ffd60 2024-02-19T19:06:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.354+0000 7f8f7effd700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8f6806d9e0 0x7f8f6806fe90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009b40 tx=0x7f8f700094f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:51.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.362+0000 7f8f67fff700 1 -- 172.21.15.46:0/2140968844 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8f74093060 con 0x7f8f800ffd60 2024-02-19T19:06:51.556 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:51 smithi046 ceph-mon[88928]: pgmap v44: 65 pgs: 65 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s wr, 0 op/s 2024-02-19T19:06:51.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.616+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f80061190 con 0x7f8f6806d9e0 2024-02-19T19:06:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.617+0000 7f8f67fff700 1 -- 172.21.15.46:0/2140968844 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8f80061190 con 0x7f8f6806d9e0 2024-02-19T19:06:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8f6806d9e0 msgr2=0x7f8f6806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8f6806d9e0 0x7f8f6806fe90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009b40 tx=0x7f8f700094f0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f800ffd60 msgr2=0x7f8f80197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:51.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f800ffd60 0x7f8f80197240 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400bda0 tx=0x7f8f7400be80 comp rx=0 tx=0).stop 2024-02-19T19:06:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 shutdown_connections 2024-02-19T19:06:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8f6806d9e0 0x7f8f6806fe90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f800ff3c0 0x7f8f80196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 --2- 172.21.15.46:0/2140968844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f800ffd60 0x7f8f80197240 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 >> 172.21.15.46:0/2140968844 conn(0x7f8f800fac60 msgr2=0x7f8f800fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 shutdown_connections 2024-02-19T19:06:51.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.620+0000 7f8f855dd700 1 -- 172.21.15.46:0/2140968844 wait complete. 2024-02-19T19:06:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.740+0000 7f5d03629700 1 -- 172.21.15.46:0/2203968534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cfc0ffbd0 msgr2=0x7f5cfc100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.740+0000 7f5d03629700 1 --2- 172.21.15.46:0/2203968534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cfc0ffbd0 0x7f5cfc100040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009910 tx=0x7f5cec009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.740+0000 7f5d03629700 1 -- 172.21.15.46:0/2203968534 shutdown_connections 2024-02-19T19:06:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.740+0000 7f5d03629700 1 --2- 172.21.15.46:0/2203968534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cfc0ffbd0 0x7f5cfc100040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.740+0000 7f5d03629700 1 --2- 172.21.15.46:0/2203968534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cfc104130 0x7f5cfc104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.740+0000 7f5d03629700 1 -- 172.21.15.46:0/2203968534 >> 172.21.15.46:0/2203968534 conn(0x7f5cfc075130 msgr2=0x7f5cfc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.741+0000 7f5d03629700 1 -- 172.21.15.46:0/2203968534 shutdown_connections 2024-02-19T19:06:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.741+0000 7f5d03629700 1 -- 172.21.15.46:0/2203968534 wait complete. 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.741+0000 7f5d03629700 1 Processor -- start 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.741+0000 7f5d03629700 1 -- start start 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.741+0000 7f5d03629700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cfc0ffbd0 0x7f5cfc100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.741+0000 7f5d03629700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cfc104130 0x7f5cfc101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.741+0000 7f5d03629700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc1018b0 con 0x7f5cfc104130 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5d03629700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc1019f0 con 0x7f5cfc0ffbd0 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5d00bc4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cfc104130 0x7f5cfc101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5d00bc4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cfc104130 0x7f5cfc101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39064/0 (socket says 172.21.15.46:39064) 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5d00bc4700 1 -- 172.21.15.46:0/3617934041 learned_addr learned my addr 172.21.15.46:0/3617934041 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5d013c5700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cfc0ffbd0 0x7f5cfc100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5d00bc4700 1 -- 172.21.15.46:0/3617934041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cfc0ffbd0 msgr2=0x7f5cfc100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5d00bc4700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cfc0ffbd0 0x7f5cfc100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5d00bc4700 1 -- 172.21.15.46:0/3617934041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec0095f0 con 0x7f5cfc104130 2024-02-19T19:06:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5d00bc4700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cfc104130 0x7f5cfc101370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0092e0 tx=0x7f5cec00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5cf27fc700 1 -- 172.21.15.46:0/3617934041 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cec01d070 con 0x7f5cfc104130 2024-02-19T19:06:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5cf27fc700 1 -- 172.21.15.46:0/3617934041 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cec00f460 con 0x7f5cfc104130 2024-02-19T19:06:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.742+0000 7f5cf27fc700 1 -- 172.21.15.46:0/3617934041 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cec005e20 con 0x7f5cfc104130 2024-02-19T19:06:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.743+0000 7f5d03629700 1 -- 172.21.15.46:0/3617934041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc101c70 con 0x7f5cfc104130 2024-02-19T19:06:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.743+0000 7f5d03629700 1 -- 172.21.15.46:0/3617934041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc1a22d0 con 0x7f5cfc104130 2024-02-19T19:06:51.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.744+0000 7f5d03629700 1 -- 172.21.15.46:0/3617934041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc1086a0 con 0x7f5cfc104130 2024-02-19T19:06:51.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.744+0000 7f5cf27fc700 1 -- 172.21.15.46:0/3617934041 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f5cec00f5d0 con 0x7f5cfc104130 2024-02-19T19:06:51.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.745+0000 7f5cf27fc700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5ce806d9d0 0x7f5ce806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:51.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.745+0000 7f5cf27fc700 1 -- 172.21.15.46:0/3617934041 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5cec08ec40 con 0x7f5cfc104130 2024-02-19T19:06:51.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.745+0000 7f5d013c5700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5ce806d9d0 0x7f5ce806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:51.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.746+0000 7f5d013c5700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5ce806d9d0 0x7f5ce806fe80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8005950 tx=0x7f5cf80058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:51.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:51.750+0000 7f5cf27fc700 1 -- 172.21.15.46:0/3617934041 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5cec058340 con 0x7f5cfc104130 2024-02-19T19:06:51.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:51 smithi142 ceph-mon[69118]: pgmap v44: 65 pgs: 65 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s wr, 0 op/s 2024-02-19T19:06:52.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.143+0000 7f5d03629700 1 -- 172.21.15.46:0/3617934041 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cfc02ccf0 con 0x7f5ce806d9d0 2024-02-19T19:06:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.163+0000 7f5cf27fc700 1 -- 172.21.15.46:0/3617934041 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5cfc02ccf0 con 0x7f5ce806d9d0 2024-02-19T19:06:52.184 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:06:52.184 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (3m) 10s ago 13m 26.2M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:06:52.184 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (13m) 10s ago 13m 8040k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:06:52.184 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (12m) 12s ago 12m 7960k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:06:52.184 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (21s) 10s ago 13m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (16s) 12s ago 12m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (2m) 10s ago 12m 82.7M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (7m) 10s ago 7m 26.5M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (7m) 10s ago 7m 16.2M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (7m) 12s ago 7m 16.6M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (7m) 12s ago 7m 25.4M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (4m) 10s ago 15m 497M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (4m) 12s ago 11m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (93s) 10s ago 15m 42.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (67s) 12s ago 11m 34.1M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (3m) 10s ago 13m 16.5M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (3m) 12s ago 12m 16.8M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (11m) 10s ago 11m 52.4M 1217M 18.2.0 dc2bc1663786 089e315f8d35 2024-02-19T19:06:52.185 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (10m) 10s ago 10m 51.3M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:06:52.186 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (10m) 10s ago 10m 52.7M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:06:52.186 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (9m) 12s ago 9m 49.8M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:06:52.186 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (9m) 12s ago 9m 47.8M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:06:52.186 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (8m) 12s ago 8m 48.8M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:06:52.186 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (3m) 10s ago 12m 62.4M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:06:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 -- 172.21.15.46:0/3617934041 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5ce806d9d0 msgr2=0x7f5ce806fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5ce806d9d0 0x7f5ce806fe80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8005950 tx=0x7f5cf80058e0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 -- 172.21.15.46:0/3617934041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cfc104130 msgr2=0x7f5cfc101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cfc104130 0x7f5cfc101370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0092e0 tx=0x7f5cec00be20 comp rx=0 tx=0).stop 2024-02-19T19:06:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 -- 172.21.15.46:0/3617934041 shutdown_connections 2024-02-19T19:06:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5ce806d9d0 0x7f5ce806fe80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5cfc0ffbd0 0x7f5cfc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 --2- 172.21.15.46:0/3617934041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5cfc104130 0x7f5cfc101370 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 -- 172.21.15.46:0/3617934041 >> 172.21.15.46:0/3617934041 conn(0x7f5cfc075130 msgr2=0x7f5cfc0fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:52.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 -- 172.21.15.46:0/3617934041 shutdown_connections 2024-02-19T19:06:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.166+0000 7f5d03629700 1 -- 172.21.15.46:0/3617934041 wait complete. 2024-02-19T19:06:52.331 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:51 smithi046 systemd[1]: Stopping Ceph osd.0 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:06:52.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.332+0000 7fdaf1018700 1 -- 172.21.15.46:0/1020191805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec0ffd60 msgr2=0x7fdaec103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:52.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.332+0000 7fdaf1018700 1 --2- 172.21.15.46:0/1020191805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec0ffd60 0x7fdaec103d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009910 tx=0x7fdae0009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:52.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.332+0000 7fdaf1018700 1 -- 172.21.15.46:0/1020191805 shutdown_connections 2024-02-19T19:06:52.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.332+0000 7fdaf1018700 1 --2- 172.21.15.46:0/1020191805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec0ffd60 0x7fdaec103d30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.332+0000 7fdaf1018700 1 --2- 172.21.15.46:0/1020191805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaec0ff3c0 0x7fdaec0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.332+0000 7fdaf1018700 1 -- 172.21.15.46:0/1020191805 >> 172.21.15.46:0/1020191805 conn(0x7fdaec0fac80 msgr2=0x7fdaec0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:52.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.332+0000 7fdaf1018700 1 -- 172.21.15.46:0/1020191805 shutdown_connections 2024-02-19T19:06:52.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.332+0000 7fdaf1018700 1 -- 172.21.15.46:0/1020191805 wait complete. 2024-02-19T19:06:52.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.333+0000 7fdaf1018700 1 Processor -- start 2024-02-19T19:06:52.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaf1018700 1 -- start start 2024-02-19T19:06:52.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaf1018700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec0ff3c0 0x7fdaec194b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:52.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaf1018700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaec0ffd60 0x7fdaec195090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:52.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaf1018700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec1956b0 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaf1018700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec195820 con 0x7fdaec0ffd60 2024-02-19T19:06:52.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaead9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec0ff3c0 0x7fdaec194b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:52.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaead9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec0ff3c0 0x7fdaec194b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39090/0 (socket says 172.21.15.46:39090) 2024-02-19T19:06:52.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaead9d700 1 -- 172.21.15.46:0/261226629 learned_addr learned my addr 172.21.15.46:0/261226629 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:52.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaea59c700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaec0ffd60 0x7fdaec195090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:52.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaead9d700 1 -- 172.21.15.46:0/261226629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaec0ffd60 msgr2=0x7fdaec195090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:52.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaead9d700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaec0ffd60 0x7fdaec195090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaead9d700 1 -- 172.21.15.46:0/261226629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00095f0 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.334+0000 7fdaea59c700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaec0ffd60 0x7fdaec195090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:06:52.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.335+0000 7fdaead9d700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec0ff3c0 0x7fdaec194b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00d8d0 tx=0x7fdadc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:52.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.335+0000 7fdad3fff700 1 -- 172.21.15.46:0/261226629 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdadc009940 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.335+0000 7fdaf1018700 1 -- 172.21.15.46:0/261226629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaec199ba0 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.335+0000 7fdaf1018700 1 -- 172.21.15.46:0/261226629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaec19a090 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.335+0000 7fdad3fff700 1 -- 172.21.15.46:0/261226629 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdadc010460 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.335+0000 7fdad3fff700 1 -- 172.21.15.46:0/261226629 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdadc00f5f0 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.337+0000 7fdaf1018700 1 -- 172.21.15.46:0/261226629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaec04f2a0 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.337+0000 7fdad3fff700 1 -- 172.21.15.46:0/261226629 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fdadc0105d0 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.338+0000 7fdad3fff700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdad406d9d0 0x7fdad406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:52.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.338+0000 7fdad3fff700 1 -- 172.21.15.46:0/261226629 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdadc08d660 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.338+0000 7fdaea59c700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdad406d9d0 0x7fdad406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:52.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.339+0000 7fdaea59c700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdad406d9d0 0x7fdad406fe80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdae0005b40 tx=0x7fdae0005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.347+0000 7fdad3fff700 1 -- 172.21.15.46:0/261226629 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdadc056cc0 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.784+0000 7fdaf1018700 1 -- 172.21.15.46:0/261226629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdaec19ab90 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.806 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:52 smithi046 ceph-mon[88928]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:52.806 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:52 smithi046 ceph-mon[88928]: osd.0 marked itself down and dead 2024-02-19T19:06:52.806 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:52 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[44579]: 2024-02-19T19:06:52.317+0000 7f0408d6c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:06:52.806 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:52 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[44579]: 2024-02-19T19:06:52.317+0000 7f0408d6c700 -1 osd.0 49 *** Got signal Terminated *** 2024-02-19T19:06:52.806 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:52 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[44579]: 2024-02-19T19:06:52.317+0000 7f0408d6c700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:06:52.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.785+0000 7fdad3fff700 1 -- 172.21.15.46:0/261226629 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+687 (secure 0 0 0) 0x7fdadc05a380 con 0x7fdaec0ff3c0 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:06:52.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:06:52.808 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:06:52.808 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-02-19T19:06:52.808 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:06:52.808 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:06:52.808 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:06:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.787+0000 7fdaf1018700 1 -- 172.21.15.46:0/261226629 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdad406d9d0 msgr2=0x7fdad406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.787+0000 7fdaf1018700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdad406d9d0 0x7fdad406fe80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdae0005b40 tx=0x7fdae0005ab0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.788+0000 7fdaf1018700 1 -- 172.21.15.46:0/261226629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec0ff3c0 msgr2=0x7fdaec194b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.788+0000 7fdaf1018700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec0ff3c0 0x7fdaec194b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00d8d0 tx=0x7fdadc00dc90 comp rx=0 tx=0).stop 2024-02-19T19:06:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.792+0000 7fdaf1018700 1 -- 172.21.15.46:0/261226629 shutdown_connections 2024-02-19T19:06:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.792+0000 7fdaf1018700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdad406d9d0 0x7fdad406fe80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.792+0000 7fdaf1018700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec0ff3c0 0x7fdaec194b50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.792+0000 7fdaf1018700 1 --2- 172.21.15.46:0/261226629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaec0ffd60 0x7fdaec195090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.792+0000 7fdaf1018700 1 -- 172.21.15.46:0/261226629 >> 172.21.15.46:0/261226629 conn(0x7fdaec0fac80 msgr2=0x7fdaec0fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.792+0000 7fdaf1018700 1 -- 172.21.15.46:0/261226629 shutdown_connections 2024-02-19T19:06:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.793+0000 7fdaf1018700 1 -- 172.21.15.46:0/261226629 wait complete. 2024-02-19T19:06:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.906+0000 7f8a4ffff700 1 -- 172.21.15.46:0/268792433 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a540054b0 con 0x7f8a58101250 2024-02-19T19:06:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.906+0000 7f8a5e39f700 1 -- 172.21.15.46:0/268792433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58101250 msgr2=0x7f8a58101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:52.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.906+0000 7f8a5e39f700 1 --2- 172.21.15.46:0/268792433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58101250 0x7f8a58101620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009910 tx=0x7f8a54009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.906+0000 7f8a5e39f700 1 -- 172.21.15.46:0/268792433 shutdown_connections 2024-02-19T19:06:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.906+0000 7f8a5e39f700 1 --2- 172.21.15.46:0/268792433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a58101bf0 0x7f8a58106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.906+0000 7f8a5e39f700 1 --2- 172.21.15.46:0/268792433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58101250 0x7f8a58101620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.906+0000 7f8a5e39f700 1 -- 172.21.15.46:0/268792433 >> 172.21.15.46:0/268792433 conn(0x7f8a580faad0 msgr2=0x7f8a580fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.907+0000 7f8a5e39f700 1 -- 172.21.15.46:0/268792433 shutdown_connections 2024-02-19T19:06:52.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.907+0000 7f8a5e39f700 1 -- 172.21.15.46:0/268792433 wait complete. 2024-02-19T19:06:52.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.908+0000 7f8a5e39f700 1 Processor -- start 2024-02-19T19:06:52.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.908+0000 7f8a5e39f700 1 -- start start 2024-02-19T19:06:52.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.908+0000 7f8a5e39f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58101250 0x7f8a58197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:52.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.908+0000 7f8a5e39f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a58101bf0 0x7f8a581984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:52.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.908+0000 7f8a5e39f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a58198bc0 con 0x7f8a58101250 2024-02-19T19:06:52.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.908+0000 7f8a5e39f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5819c950 con 0x7f8a58101bf0 2024-02-19T19:06:52.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.908+0000 7f8a5d39d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58101250 0x7f8a58197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:52.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.908+0000 7f8a5d39d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58101250 0x7f8a58197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39112/0 (socket says 172.21.15.46:39112) 2024-02-19T19:06:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.908+0000 7f8a5d39d700 1 -- 172.21.15.46:0/3471664790 learned_addr learned my addr 172.21.15.46:0/3471664790 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.908+0000 7f8a5cb9c700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a58101bf0 0x7f8a581984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.909+0000 7f8a5d39d700 1 -- 172.21.15.46:0/3471664790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a58101bf0 msgr2=0x7f8a581984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.909+0000 7f8a5d39d700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a58101bf0 0x7f8a581984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.909+0000 7f8a5d39d700 1 -- 172.21.15.46:0/3471664790 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540095f0 con 0x7f8a58101250 2024-02-19T19:06:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.909+0000 7f8a5d39d700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58101250 0x7f8a58197fa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009fd0 tx=0x7f8a54005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.909+0000 7f8a4e7fc700 1 -- 172.21.15.46:0/3471664790 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a5401d070 con 0x7f8a58101250 2024-02-19T19:06:52.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.909+0000 7f8a4e7fc700 1 -- 172.21.15.46:0/3471664790 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a54004f40 con 0x7f8a58101250 2024-02-19T19:06:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.909+0000 7f8a5e39f700 1 -- 172.21.15.46:0/3471664790 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5819cbd0 con 0x7f8a58101250 2024-02-19T19:06:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.909+0000 7f8a5e39f700 1 -- 172.21.15.46:0/3471664790 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5819d0c0 con 0x7f8a58101250 2024-02-19T19:06:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.909+0000 7f8a4e7fc700 1 -- 172.21.15.46:0/3471664790 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a540054b0 con 0x7f8a58101250 2024-02-19T19:06:52.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.910+0000 7f8a5e39f700 1 -- 172.21.15.46:0/3471664790 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a58062380 con 0x7f8a58101250 2024-02-19T19:06:52.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.912+0000 7f8a4e7fc700 1 -- 172.21.15.46:0/3471664790 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f8a54022880 con 0x7f8a58101250 2024-02-19T19:06:52.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.912+0000 7f8a4e7fc700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8a4406d9e0 0x7f8a4406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:52.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.913+0000 7f8a4e7fc700 1 -- 172.21.15.46:0/3471664790 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8a5408eda0 con 0x7f8a58101250 2024-02-19T19:06:52.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.913+0000 7f8a5cb9c700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8a4406d9e0 0x7f8a4406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:52.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.913+0000 7f8a5cb9c700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8a4406d9e0 0x7f8a4406fe90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a581995c0 tx=0x7f8a4800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:52.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:52.922+0000 7f8a4e7fc700 1 -- 172.21.15.46:0/3471664790 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8a54058460 con 0x7f8a58101250 2024-02-19T19:06:52.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:52 smithi142 ceph-mon[69118]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:52.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:52 smithi142 ceph-mon[69118]: osd.0 marked itself down and dead 2024-02-19T19:06:53.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.200+0000 7f8a5e39f700 1 -- 172.21.15.46:0/3471664790 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8a5819d330 con 0x7f8a58101250 2024-02-19T19:06:53.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.201+0000 7f8a4e7fc700 1 -- 172.21.15.46:0/3471664790 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1856 (secure 0 0 0) 0x7f8a54027070 con 0x7f8a58101250 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:e17 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 17 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T18:59:38.092640+0000 2024-02-19T19:06:53.222 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:06:53.223 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:06:53.224 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:06:53.225 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:06:53.225 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:06:53.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 -- 172.21.15.46:0/3471664790 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8a4406d9e0 msgr2=0x7f8a4406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:53.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8a4406d9e0 0x7f8a4406fe90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a581995c0 tx=0x7f8a4800b410 comp rx=0 tx=0).stop 2024-02-19T19:06:53.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 -- 172.21.15.46:0/3471664790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58101250 msgr2=0x7f8a58197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:53.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58101250 0x7f8a58197fa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009fd0 tx=0x7f8a54005f10 comp rx=0 tx=0).stop 2024-02-19T19:06:53.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 -- 172.21.15.46:0/3471664790 shutdown_connections 2024-02-19T19:06:53.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8a4406d9e0 0x7f8a4406fe90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a58101250 0x7f8a58197fa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 --2- 172.21.15.46:0/3471664790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a58101bf0 0x7f8a581984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 -- 172.21.15.46:0/3471664790 >> 172.21.15.46:0/3471664790 conn(0x7f8a580faad0 msgr2=0x7f8a580fbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:53.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 -- 172.21.15.46:0/3471664790 shutdown_connections 2024-02-19T19:06:53.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.204+0000 7f8a5e39f700 1 -- 172.21.15.46:0/3471664790 wait complete. 2024-02-19T19:06:53.226 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-02-19T19:06:53.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.318+0000 7f47ae79f700 1 -- 172.21.15.46:0/2775124797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47a80ffbd0 msgr2=0x7f47a8100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.318+0000 7f47ae79f700 1 --2- 172.21.15.46:0/2775124797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47a80ffbd0 0x7f47a8100040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f479c009910 tx=0x7f479c009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.319+0000 7f47ae79f700 1 -- 172.21.15.46:0/2775124797 shutdown_connections 2024-02-19T19:06:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.319+0000 7f47ae79f700 1 --2- 172.21.15.46:0/2775124797 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47a80ffbd0 0x7f47a8100040 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.319+0000 7f47ae79f700 1 --2- 172.21.15.46:0/2775124797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a8104130 0x7f47a8104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.319+0000 7f47ae79f700 1 -- 172.21.15.46:0/2775124797 >> 172.21.15.46:0/2775124797 conn(0x7f47a8075130 msgr2=0x7f47a8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.319+0000 7f47ae79f700 1 -- 172.21.15.46:0/2775124797 shutdown_connections 2024-02-19T19:06:53.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.319+0000 7f47ae79f700 1 -- 172.21.15.46:0/2775124797 wait complete. 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.320+0000 7f47ae79f700 1 Processor -- start 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.320+0000 7f47ae79f700 1 -- start start 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.320+0000 7f47ae79f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a80ffbd0 0x7f47a8195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.320+0000 7f47ae79f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47a8104130 0x7f47a8196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.320+0000 7f47ae79f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8196a70 con 0x7f47a8104130 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.320+0000 7f47ae79f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a819a790 con 0x7f47a80ffbd0 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.320+0000 7f47a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a80ffbd0 0x7f47a8195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.320+0000 7f47a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a80ffbd0 0x7f47a8195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:46328/0 (socket says 172.21.15.46:46328) 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.320+0000 7f47a7fff700 1 -- 172.21.15.46:0/2366087208 learned_addr learned my addr 172.21.15.46:0/2366087208 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.320+0000 7f47a77fe700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47a8104130 0x7f47a8196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.321+0000 7f47a7fff700 1 -- 172.21.15.46:0/2366087208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47a8104130 msgr2=0x7f47a8196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.321+0000 7f47a7fff700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47a8104130 0x7f47a8196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.321+0000 7f47a7fff700 1 -- 172.21.15.46:0/2366087208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0095f0 con 0x7f47a80ffbd0 2024-02-19T19:06:53.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.321+0000 7f47a7fff700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a80ffbd0 0x7f47a8195e50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f479800d8d0 tx=0x7f479800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.321+0000 7f47a57fa700 1 -- 172.21.15.46:0/2366087208 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4798009940 con 0x7f47a80ffbd0 2024-02-19T19:06:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.321+0000 7f47a57fa700 1 -- 172.21.15.46:0/2366087208 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4798010460 con 0x7f47a80ffbd0 2024-02-19T19:06:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.321+0000 7f47a57fa700 1 -- 172.21.15.46:0/2366087208 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f479800f5f0 con 0x7f47a80ffbd0 2024-02-19T19:06:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.321+0000 7f47ae79f700 1 -- 172.21.15.46:0/2366087208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a819aa70 con 0x7f47a80ffbd0 2024-02-19T19:06:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.321+0000 7f47ae79f700 1 -- 172.21.15.46:0/2366087208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a819afc0 con 0x7f47a80ffbd0 2024-02-19T19:06:53.343 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:53 smithi046 podman[100479]: 2024-02-19 19:06:53.074028985 +0000 UTC m=+0.867284705 container died 089e315f8d35092517f36c17658cd9a91cdf982b2dd58f60f3c2dc5416a02665 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:06:53.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.323+0000 7f47a57fa700 1 -- 172.21.15.46:0/2366087208 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f47980105d0 con 0x7f47a80ffbd0 2024-02-19T19:06:53.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.323+0000 7f47ae79f700 1 -- 172.21.15.46:0/2366087208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a81086a0 con 0x7f47a80ffbd0 2024-02-19T19:06:53.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.324+0000 7f47a57fa700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f479006da20 0x7f479006fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:53.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.324+0000 7f47a77fe700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f479006da20 0x7f479006fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:53.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.324+0000 7f47a57fa700 1 -- 172.21.15.46:0/2366087208 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f479808d600 con 0x7f47a80ffbd0 2024-02-19T19:06:53.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.325+0000 7f47a77fe700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f479006da20 0x7f479006fed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f479c00b5c0 tx=0x7f479c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:53.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.329+0000 7f47a57fa700 1 -- 172.21.15.46:0/2366087208 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4798056cc0 con 0x7f47a80ffbd0 2024-02-19T19:06:53.752 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:53 smithi046 podman[100479]: 2024-02-19 19:06:53.447317777 +0000 UTC m=+1.240573503 container cleanup 089e315f8d35092517f36c17658cd9a91cdf982b2dd58f60f3c2dc5416a02665 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD) 2024-02-19T19:06:53.752 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:53 smithi046 bash[100479]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0 2024-02-19T19:06:53.752 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:53 smithi046 ceph-mon[88928]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:53.752 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:53 smithi046 ceph-mon[88928]: pgmap v45: 65 pgs: 65 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s wr, 0 op/s 2024-02-19T19:06:53.753 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:53 smithi046 ceph-mon[88928]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:53.753 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:53 smithi046 ceph-mon[88928]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:06:53.753 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:53 smithi046 ceph-mon[88928]: osdmap e50: 6 total, 5 up, 6 in 2024-02-19T19:06:53.753 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:53 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/261226629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:53.753 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:53 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3471664790' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:06:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.781+0000 7f47ae79f700 1 -- 172.21.15.46:0/2366087208 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47a819b230 con 0x7f479006da20 2024-02-19T19:06:53.804 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:06:53.804 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:06:53.804 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:06:53.804 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:06:53.805 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:06:53.805 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:06:53.805 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-02-19T19:06:53.805 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:06:53.805 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:06:53.805 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "6/23 daemons upgraded", 2024-02-19T19:06:53.805 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:06:53.805 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:06:53.805 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:06:53.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.783+0000 7f47a57fa700 1 -- 172.21.15.46:0/2366087208 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f47a819b230 con 0x7f479006da20 2024-02-19T19:06:53.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.786+0000 7f47ae79f700 1 -- 172.21.15.46:0/2366087208 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f479006da20 msgr2=0x7f479006fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:53.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.786+0000 7f47ae79f700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f479006da20 0x7f479006fed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f479c00b5c0 tx=0x7f479c01a040 comp rx=0 tx=0).stop 2024-02-19T19:06:53.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.786+0000 7f47ae79f700 1 -- 172.21.15.46:0/2366087208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a80ffbd0 msgr2=0x7f47a8195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:53.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.786+0000 7f47ae79f700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a80ffbd0 0x7f47a8195e50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f479800d8d0 tx=0x7f479800dc90 comp rx=0 tx=0).stop 2024-02-19T19:06:53.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.786+0000 7f47ae79f700 1 -- 172.21.15.46:0/2366087208 shutdown_connections 2024-02-19T19:06:53.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.786+0000 7f47ae79f700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f479006da20 0x7f479006fed0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.786+0000 7f47ae79f700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a80ffbd0 0x7f47a8195e50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.786+0000 7f47ae79f700 1 --2- 172.21.15.46:0/2366087208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47a8104130 0x7f47a8196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.786+0000 7f47ae79f700 1 -- 172.21.15.46:0/2366087208 >> 172.21.15.46:0/2366087208 conn(0x7f47a8075130 msgr2=0x7f47a80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.787+0000 7f47ae79f700 1 -- 172.21.15.46:0/2366087208 shutdown_connections 2024-02-19T19:06:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.787+0000 7f47ae79f700 1 -- 172.21.15.46:0/2366087208 wait complete. 2024-02-19T19:06:53.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:53 smithi142 ceph-mon[69118]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:53.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:53 smithi142 ceph-mon[69118]: pgmap v45: 65 pgs: 65 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s wr, 0 op/s 2024-02-19T19:06:53.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:53 smithi142 ceph-mon[69118]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:53.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:53 smithi142 ceph-mon[69118]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:06:53.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:53 smithi142 ceph-mon[69118]: osdmap e50: 6 total, 5 up, 6 in 2024-02-19T19:06:53.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:53 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/261226629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:53.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:53 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3471664790' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:06:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.953+0000 7ff4f451a700 1 -- 172.21.15.46:0/390366869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ec1038b0 msgr2=0x7ff4ec103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.953+0000 7ff4f451a700 1 --2- 172.21.15.46:0/390366869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ec1038b0 0x7ff4ec103c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009910 tx=0x7ff4e8009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.953+0000 7ff4f451a700 1 -- 172.21.15.46:0/390366869 shutdown_connections 2024-02-19T19:06:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.953+0000 7ff4f451a700 1 --2- 172.21.15.46:0/390366869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ec0ff350 0x7ff4ec0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.953+0000 7ff4f451a700 1 --2- 172.21.15.46:0/390366869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ec1038b0 0x7ff4ec103c80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.953+0000 7ff4f451a700 1 -- 172.21.15.46:0/390366869 >> 172.21.15.46:0/390366869 conn(0x7ff4ec0748b0 msgr2=0x7ff4ec074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.953+0000 7ff4f451a700 1 -- 172.21.15.46:0/390366869 shutdown_connections 2024-02-19T19:06:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.953+0000 7ff4f451a700 1 -- 172.21.15.46:0/390366869 wait complete. 2024-02-19T19:06:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.954+0000 7ff4f451a700 1 Processor -- start 2024-02-19T19:06:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.954+0000 7ff4f451a700 1 -- start start 2024-02-19T19:06:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f451a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ec0ff350 0x7ff4ec199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:53.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f451a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ec1038b0 0x7ff4ec199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f451a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec19a400 con 0x7ff4ec0ff350 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f451a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec193ac0 con 0x7ff4ec1038b0 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f22b6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ec0ff350 0x7ff4ec199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f22b6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ec0ff350 0x7ff4ec199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39134/0 (socket says 172.21.15.46:39134) 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f22b6700 1 -- 172.21.15.46:0/2773216144 learned_addr learned my addr 172.21.15.46:0/2773216144 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f1ab5700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ec1038b0 0x7ff4ec199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f22b6700 1 -- 172.21.15.46:0/2773216144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ec1038b0 msgr2=0x7ff4ec199d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f22b6700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ec1038b0 0x7ff4ec199d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f22b6700 1 -- 172.21.15.46:0/2773216144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80095f0 con 0x7ff4ec0ff350 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.955+0000 7ff4f1ab5700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ec1038b0 0x7ff4ec199d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:06:53.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.956+0000 7ff4f22b6700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ec0ff350 0x7ff4ec199830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8005d10 tx=0x7ff4e800e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:53.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.956+0000 7ff4e37fe700 1 -- 172.21.15.46:0/2773216144 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e801c070 con 0x7ff4ec0ff350 2024-02-19T19:06:53.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.956+0000 7ff4f451a700 1 -- 172.21.15.46:0/2773216144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec193d40 con 0x7ff4ec0ff350 2024-02-19T19:06:53.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.956+0000 7ff4f451a700 1 -- 172.21.15.46:0/2773216144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec194230 con 0x7ff4ec0ff350 2024-02-19T19:06:53.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.956+0000 7ff4e37fe700 1 -- 172.21.15.46:0/2773216144 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4e80052a0 con 0x7ff4ec0ff350 2024-02-19T19:06:53.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.956+0000 7ff4e37fe700 1 -- 172.21.15.46:0/2773216144 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e8017610 con 0x7ff4ec0ff350 2024-02-19T19:06:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.958+0000 7ff4f451a700 1 -- 172.21.15.46:0/2773216144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d0005320 con 0x7ff4ec0ff350 2024-02-19T19:06:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.959+0000 7ff4e37fe700 1 -- 172.21.15.46:0/2773216144 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 38) v1 ==== 91595+0+0 (secure 0 0 0) 0x7ff4e8017880 con 0x7ff4ec0ff350 2024-02-19T19:06:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.959+0000 7ff4e37fe700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff4d806da20 0x7ff4d806fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.960+0000 7ff4e37fe700 1 -- 172.21.15.46:0/2773216144 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff4e808e670 con 0x7ff4ec0ff350 2024-02-19T19:06:53.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.960+0000 7ff4f1ab5700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff4d806da20 0x7ff4d806fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:53.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.961+0000 7ff4f1ab5700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff4d806da20 0x7ff4d806fed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00bfd0 tx=0x7ff4dc00d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:53.969+0000 7ff4e37fe700 1 -- 172.21.15.46:0/2773216144 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff4e805b7c0 con 0x7ff4ec0ff350 2024-02-19T19:06:54.081 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:53 smithi046 podman[100536]: 2024-02-19 19:06:53.732171546 +0000 UTC m=+0.657590872 container remove 089e315f8d35092517f36c17658cd9a91cdf982b2dd58f60f3c2dc5416a02665 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0) 2024-02-19T19:06:54.454 INFO:tasks.workunit.client.1.smithi142.stderr:+ tar xzf ltp-full.tgz 2024-02-19T19:06:54.522 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:54 smithi046 podman[100659]: 2024-02-19 19:06:54.086017494 +0000 UTC m=+0.030422383 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:06:54.523 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:54 smithi046 podman[100659]: 2024-02-19 19:06:54.200031142 +0000 UTC m=+0.144436053 container create 55e224009228000e29696e6569af03884f3a8c9e3c4dc7f46949c63174a4fdeb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:06:54.523 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:54 smithi046 podman[100659]: 2024-02-19 19:06:54.419363206 +0000 UTC m=+0.363768098 container init 55e224009228000e29696e6569af03884f3a8c9e3c4dc7f46949c63174a4fdeb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-02-19T19:06:54.523 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:54 smithi046 podman[100659]: 2024-02-19 19:06:54.424504391 +0000 UTC m=+0.368909272 container start 55e224009228000e29696e6569af03884f3a8c9e3c4dc7f46949c63174a4fdeb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:06:54.523 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:54 smithi046 podman[100659]: 2024-02-19 19:06:54.502329636 +0000 UTC m=+0.446734524 container attach 55e224009228000e29696e6569af03884f3a8c9e3c4dc7f46949c63174a4fdeb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-19T19:06:54.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.507+0000 7ff4f451a700 1 -- 172.21.15.46:0/2773216144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff4d0005cc0 con 0x7ff4ec0ff350 2024-02-19T19:06:54.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.508+0000 7ff4e37fe700 1 -- 172.21.15.46:0/2773216144 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7ff4e805b350 con 0x7ff4ec0ff350 2024-02-19T19:06:54.529 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 osds down 2024-02-19T19:06:54.529 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-19T19:06:54.529 INFO:teuthology.orchestra.run.smithi046.stdout: osd.0 (root=default,host=smithi046) is down 2024-02-19T19:06:54.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.511+0000 7ff4f451a700 1 -- 172.21.15.46:0/2773216144 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff4d806da20 msgr2=0x7ff4d806fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.511+0000 7ff4f451a700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff4d806da20 0x7ff4d806fed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00bfd0 tx=0x7ff4dc00d040 comp rx=0 tx=0).stop 2024-02-19T19:06:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.511+0000 7ff4f451a700 1 -- 172.21.15.46:0/2773216144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ec0ff350 msgr2=0x7ff4ec199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.511+0000 7ff4f451a700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ec0ff350 0x7ff4ec199830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8005d10 tx=0x7ff4e800e6b0 comp rx=0 tx=0).stop 2024-02-19T19:06:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.512+0000 7ff4f451a700 1 -- 172.21.15.46:0/2773216144 shutdown_connections 2024-02-19T19:06:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.512+0000 7ff4f451a700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff4d806da20 0x7ff4d806fed0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.512+0000 7ff4f451a700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4ec0ff350 0x7ff4ec199830 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.512+0000 7ff4f451a700 1 --2- 172.21.15.46:0/2773216144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ec1038b0 0x7ff4ec199d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.512+0000 7ff4f451a700 1 -- 172.21.15.46:0/2773216144 >> 172.21.15.46:0/2773216144 conn(0x7ff4ec0748b0 msgr2=0x7ff4ec0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.512+0000 7ff4f451a700 1 -- 172.21.15.46:0/2773216144 shutdown_connections 2024-02-19T19:06:54.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:06:54.512+0000 7ff4f451a700 1 -- 172.21.15.46:0/2773216144 wait complete. 2024-02-19T19:06:54.830 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:54 smithi046 podman[100659]: 2024-02-19 19:06:54.808429522 +0000 UTC m=+0.752834409 container died 55e224009228000e29696e6569af03884f3a8c9e3c4dc7f46949c63174a4fdeb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:06:54.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:54 smithi046 ceph-mon[88928]: osdmap e51: 6 total, 5 up, 6 in 2024-02-19T19:06:54.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:54 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2773216144' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:06:54.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:54 smithi142 ceph-mon[69118]: osdmap e51: 6 total, 5 up, 6 in 2024-02-19T19:06:54.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:54 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2773216144' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:06:55.831 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:55 smithi046 podman[100687]: 2024-02-19 19:06:55.581860037 +0000 UTC m=+0.763875532 container remove 55e224009228000e29696e6569af03884f3a8c9e3c4dc7f46949c63174a4fdeb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5) 2024-02-19T19:06:55.831 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:55 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-19T19:06:55.832 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:55 smithi046 systemd[1]: Stopped Ceph osd.0 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:06:55.832 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:55 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.0.service: Consumed 5.909s CPU time. 2024-02-19T19:06:55.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:55 smithi046 ceph-mon[88928]: pgmap v48: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 0 op/s; 25/132 objects degraded (18.939%) 2024-02-19T19:06:55.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:55 smithi046 ceph-mon[88928]: from='client.44141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:55.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:55 smithi046 ceph-mon[88928]: Health check failed: Degraded data redundancy: 25/132 objects degraded (18.939%), 13 pgs degraded (PG_DEGRADED) 2024-02-19T19:06:55.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:55 smithi142 ceph-mon[69118]: pgmap v48: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 0 op/s; 25/132 objects degraded (18.939%) 2024-02-19T19:06:55.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:55 smithi142 ceph-mon[69118]: from='client.44141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:55.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:55 smithi142 ceph-mon[69118]: Health check failed: Degraded data redundancy: 25/132 objects degraded (18.939%), 13 pgs degraded (PG_DEGRADED) 2024-02-19T19:06:56.194 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:55 smithi046 systemd[1]: Starting Ceph osd.0 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:06:56.581 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:56 smithi046 podman[100777]: 2024-02-19 19:06:56.082258626 +0000 UTC m=+0.032732505 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:06:56.582 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:56 smithi046 podman[100777]: 2024-02-19 19:06:56.207993487 +0000 UTC m=+0.158467405 container create a87afee4438336ee7f40cf2f00746dc205ca8bc1dff3bc2492981860173b267b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214) 2024-02-19T19:06:57.081 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:56 smithi046 podman[100777]: 2024-02-19 19:06:56.590546639 +0000 UTC m=+0.541020518 container init a87afee4438336ee7f40cf2f00746dc205ca8bc1dff3bc2492981860173b267b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-19T19:06:57.081 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:56 smithi046 podman[100777]: 2024-02-19 19:06:56.596938087 +0000 UTC m=+0.547411965 container start a87afee4438336ee7f40cf2f00746dc205ca8bc1dff3bc2492981860173b267b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-19T19:06:57.081 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:56 smithi046 podman[100777]: 2024-02-19 19:06:56.685736837 +0000 UTC m=+0.636210719 container attach a87afee4438336ee7f40cf2f00746dc205ca8bc1dff3bc2492981860173b267b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate[100790]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate[100790]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 bash[100777]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 bash[100777]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 bash[100777]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 bash[100777]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 bash[100777]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 bash[100777]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 bash[100777]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate[100790]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-19T19:06:57.351 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate[100790]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-19T19:06:57.352 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate[100790]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-19T19:06:57.352 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate[100790]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T19:06:57.352 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate[100790]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-19T19:06:57.705 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:57 smithi046 ceph-mon[88928]: pgmap v49: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 0 op/s; 25/132 objects degraded (18.939%) 2024-02-19T19:06:57.705 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:57 smithi046 podman[100915]: 2024-02-19 19:06:57.381499146 +0000 UTC m=+0.039707413 container died a87afee4438336ee7f40cf2f00746dc205ca8bc1dff3bc2492981860173b267b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-19T19:06:57.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:57 smithi142 ceph-mon[69118]: pgmap v49: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 0 op/s; 25/132 objects degraded (18.939%) 2024-02-19T19:06:58.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:58 smithi046 ceph-mon[88928]: pgmap v50: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 25/132 objects degraded (18.939%) 2024-02-19T19:06:58.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:58.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:06:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:58.831 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:58 smithi046 podman[100915]: 2024-02-19 19:06:58.523559539 +0000 UTC m=+1.181767796 container remove a87afee4438336ee7f40cf2f00746dc205ca8bc1dff3bc2492981860173b267b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214) 2024-02-19T19:06:59.198 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:58 smithi046 podman[100974]: 2024-02-19 19:06:58.720856828 +0000 UTC m=+0.036509010 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:06:59.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:58 smithi142 ceph-mon[69118]: pgmap v50: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 2.0 MiB data, 167 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 25/132 objects degraded (18.939%) 2024-02-19T19:06:59.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:06:59.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:06:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:59.456 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:59 smithi046 podman[100974]: 2024-02-19 19:06:59.283094776 +0000 UTC m=+0.598746937 container create 9a17e8a3661e995f0f197e67f408517b7e771f8022c6772e0757cc0f24b26aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2) 2024-02-19T19:06:59.831 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:59 smithi046 podman[100974]: 2024-02-19 19:06:59.536229651 +0000 UTC m=+0.851881820 container init 9a17e8a3661e995f0f197e67f408517b7e771f8022c6772e0757cc0f24b26aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-19T19:06:59.832 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:59 smithi046 podman[100974]: 2024-02-19 19:06:59.541730251 +0000 UTC m=+0.857382417 container start 9a17e8a3661e995f0f197e67f408517b7e771f8022c6772e0757cc0f24b26aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:06:59.832 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:59 smithi046 bash[100974]: 9a17e8a3661e995f0f197e67f408517b7e771f8022c6772e0757cc0f24b26aa0 2024-02-19T19:06:59.832 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:06:59 smithi046 systemd[1]: Started Ceph osd.0 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:07:00.581 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:07:00 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[100989]: 2024-02-19T19:07:00.094+0000 7f5d74ed97c0 -1 Falling back to public interface 2024-02-19T19:07:01.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:00 smithi046 ceph-mon[88928]: pgmap v51: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 16 MiB data, 204 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s wr, 1 op/s; 27/141 objects degraded (19.149%) 2024-02-19T19:07:01.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:01.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:01.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:00 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 27/141 objects degraded (19.149%), 13 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:01.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:01.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:00 smithi142 ceph-mon[69118]: pgmap v51: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 16 MiB data, 204 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s wr, 1 op/s; 27/141 objects degraded (19.149%) 2024-02-19T19:07:01.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:01.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:01.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:00 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 27/141 objects degraded (19.149%), 13 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:01.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:02.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:01 smithi046 ceph-mon[88928]: mgrmap e39: smithi046.qtceex(active, since 93s), standbys: smithi142.fwekwv 2024-02-19T19:07:02.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:01 smithi142 ceph-mon[69118]: mgrmap e39: smithi046.qtceex(active, since 93s), standbys: smithi142.fwekwv 2024-02-19T19:07:02.868 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:02 smithi046 ceph-mon[88928]: pgmap v52: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 16 MiB data, 204 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s wr, 1 op/s; 27/141 objects degraded (19.149%) 2024-02-19T19:07:02.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:02 smithi046 ceph-mon[88928]: from='osd.0 [v2:172.21.15.46:6802/389415197,v1:172.21.15.46:6803/389415197]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T19:07:02.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:02 smithi046 ceph-mon[88928]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T19:07:02.899 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:07:02 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[100989]: 2024-02-19T19:07:02.592+0000 7f5d74ed97c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-19T19:07:02.899 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:07:02 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[100989]: 2024-02-19T19:07:02.667+0000 7f5d74ed97c0 -1 osd.0 49 log_to_monitors true 2024-02-19T19:07:02.899 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 19:07:02 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[100989]: 2024-02-19T19:07:02.768+0000 7f5d66331700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:07:03.151 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:02 smithi142 ceph-mon[69118]: pgmap v52: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 16 MiB data, 204 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s wr, 1 op/s; 27/141 objects degraded (19.149%) 2024-02-19T19:07:03.151 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:02 smithi142 ceph-mon[69118]: from='osd.0 [v2:172.21.15.46:6802/389415197,v1:172.21.15.46:6803/389415197]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T19:07:03.151 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:02 smithi142 ceph-mon[69118]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T19:07:04.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:03 smithi046 ceph-mon[88928]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T19:07:04.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:03 smithi046 ceph-mon[88928]: osdmap e52: 6 total, 5 up, 6 in 2024-02-19T19:07:04.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:03 smithi046 ceph-mon[88928]: from='osd.0 [v2:172.21.15.46:6802/389415197,v1:172.21.15.46:6803/389415197]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T19:07:04.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:03 smithi046 ceph-mon[88928]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T19:07:04.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:03 smithi142 ceph-mon[69118]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T19:07:04.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:03 smithi142 ceph-mon[69118]: osdmap e52: 6 total, 5 up, 6 in 2024-02-19T19:07:04.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:03 smithi142 ceph-mon[69118]: from='osd.0 [v2:172.21.15.46:6802/389415197,v1:172.21.15.46:6803/389415197]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T19:07:04.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:03 smithi142 ceph-mon[69118]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T19:07:04.783 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:04 smithi046 ceph-mon[88928]: pgmap v54: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 25 MiB data, 224 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 2 op/s; 28/147 objects degraded (19.048%) 2024-02-19T19:07:05.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:04 smithi046 ceph-mon[88928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:07:05.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:04 smithi046 ceph-mon[88928]: osd.0 [v2:172.21.15.46:6802/389415197,v1:172.21.15.46:6803/389415197] boot 2024-02-19T19:07:05.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:04 smithi046 ceph-mon[88928]: osdmap e53: 6 total, 6 up, 6 in 2024-02-19T19:07:05.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:04 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:07:05.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:04 smithi142 ceph-mon[69118]: pgmap v54: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 25 MiB data, 224 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 2 op/s; 28/147 objects degraded (19.048%) 2024-02-19T19:07:05.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:04 smithi142 ceph-mon[69118]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:07:05.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:04 smithi142 ceph-mon[69118]: osd.0 [v2:172.21.15.46:6802/389415197,v1:172.21.15.46:6803/389415197] boot 2024-02-19T19:07:05.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:04 smithi142 ceph-mon[69118]: osdmap e53: 6 total, 6 up, 6 in 2024-02-19T19:07:05.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:04 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:07:06.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:05 smithi046 ceph-mon[88928]: osdmap e54: 6 total, 6 up, 6 in 2024-02-19T19:07:06.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:05 smithi046 ceph-mon[88928]: fsmap cephfs:2 {0=cephfs.smithi046.bwvkwa=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T19:07:06.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:05 smithi142 ceph-mon[69118]: osdmap e54: 6 total, 6 up, 6 in 2024-02-19T19:07:06.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:05 smithi142 ceph-mon[69118]: fsmap cephfs:2 {0=cephfs.smithi046.bwvkwa=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T19:07:07.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:07 smithi142 ceph-mon[69118]: pgmap v57: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 25 MiB data, 224 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s wr, 2 op/s; 28/147 objects degraded (19.048%) 2024-02-19T19:07:07.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:07.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:07.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:07 smithi046 ceph-mon[88928]: pgmap v57: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 25 MiB data, 224 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s wr, 2 op/s; 28/147 objects degraded (19.048%) 2024-02-19T19:07:07.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:07.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:09.042 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:08 smithi046 ceph-mon[88928]: pgmap v58: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 25 MiB data, 224 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s wr, 2 op/s; 28/147 objects degraded (19.048%) 2024-02-19T19:07:09.042 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:09.042 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:09.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:08 smithi142 ceph-mon[69118]: pgmap v58: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 25 MiB data, 224 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s wr, 2 op/s; 28/147 objects degraded (19.048%) 2024-02-19T19:07:09.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:09.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:10.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:09 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 28/147 objects degraded (19.048%), 14 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:10.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:09 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 28/147 objects degraded (19.048%), 14 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:11.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:10 smithi046 ceph-mon[88928]: pgmap v59: 65 pgs: 65 active+clean; 32 MiB data, 255 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 17 op/s; 1.5 MiB/s, 0 objects/s recovering 2024-02-19T19:07:11.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:10 smithi046 ceph-mon[88928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/147 objects degraded (19.048%), 14 pgs degraded) 2024-02-19T19:07:11.085 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:10 smithi046 ceph-mon[88928]: Cluster is now healthy 2024-02-19T19:07:11.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:10 smithi142 ceph-mon[69118]: pgmap v59: 65 pgs: 65 active+clean; 32 MiB data, 255 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 17 op/s; 1.5 MiB/s, 0 objects/s recovering 2024-02-19T19:07:11.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:10 smithi142 ceph-mon[69118]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/147 objects degraded (19.048%), 14 pgs degraded) 2024-02-19T19:07:11.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:10 smithi142 ceph-mon[69118]: Cluster is now healthy 2024-02-19T19:07:13.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:12 smithi142 ceph-mon[69118]: pgmap v60: 65 pgs: 65 active+clean; 32 MiB data, 255 MiB used, 536 GiB / 536 GiB avail; 919 KiB/s wr, 13 op/s; 1.3 MiB/s, 0 objects/s recovering 2024-02-19T19:07:13.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:13.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:13.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:12 smithi046 ceph-mon[88928]: pgmap v60: 65 pgs: 65 active+clean; 32 MiB data, 255 MiB used, 536 GiB / 536 GiB avail; 919 KiB/s wr, 13 op/s; 1.3 MiB/s, 0 objects/s recovering 2024-02-19T19:07:13.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:13.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:15.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: pgmap v61: 65 pgs: 65 active+clean; 82 MiB data, 506 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s wr, 955 op/s; 1.0 MiB/s, 0 objects/s recovering 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:07:15.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:07:15.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:15 smithi142 ceph-mon[69118]: Upgrade: osd.1 is safe to restart 2024-02-19T19:07:15.499 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: pgmap v61: 65 pgs: 65 active+clean; 82 MiB data, 506 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s wr, 955 op/s; 1.0 MiB/s, 0 objects/s recovering 2024-02-19T19:07:15.499 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:15.499 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:15.499 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:15.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:07:15.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:15.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:15.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:15.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:15.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:15.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:07:15.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:07:15.500 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:15 smithi046 ceph-mon[88928]: Upgrade: osd.1 is safe to restart 2024-02-19T19:07:17.533 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:17 smithi046 ceph-mon[88928]: pgmap v62: 65 pgs: 65 active+clean; 82 MiB data, 506 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s wr, 868 op/s; 960 KiB/s, 0 objects/s recovering 2024-02-19T19:07:17.533 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:17 smithi046 ceph-mon[88928]: Upgrade: Updating osd.1 2024-02-19T19:07:17.533 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:17.533 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T19:07:17.533 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:17.533 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:17 smithi046 ceph-mon[88928]: Deploying daemon osd.1 on smithi046 2024-02-19T19:07:17.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:17 smithi142 ceph-mon[69118]: pgmap v62: 65 pgs: 65 active+clean; 82 MiB data, 506 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s wr, 868 op/s; 960 KiB/s, 0 objects/s recovering 2024-02-19T19:07:17.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:17 smithi142 ceph-mon[69118]: Upgrade: Updating osd.1 2024-02-19T19:07:17.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:17.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T19:07:17.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:17.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:17 smithi142 ceph-mon[69118]: Deploying daemon osd.1 on smithi046 2024-02-19T19:07:19.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:18 smithi046 ceph-mon[88928]: pgmap v63: 65 pgs: 65 active+clean; 82 MiB data, 506 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s wr, 789 op/s; 874 KiB/s, 0 objects/s recovering 2024-02-19T19:07:19.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:18 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:19.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:18 smithi142 ceph-mon[69118]: pgmap v63: 65 pgs: 65 active+clean; 82 MiB data, 506 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s wr, 789 op/s; 874 KiB/s, 0 objects/s recovering 2024-02-19T19:07:19.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:18 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:19.582 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '1ce7ea8877c709fa862eac608550374bd96e166e'. 2024-02-19T19:07:19.582 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-02-19T19:07:19.582 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-19T19:07:19.582 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-19T19:07:19.582 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-02-19T19:07:19.582 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-02-19T19:07:19.582 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-19T19:07:19.582 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-19T19:07:19.582 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-02-19T19:07:19.583 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-02-19T19:07:19.583 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-02-19T19:07:19.583 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-02-19T19:07:19.583 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-02-19T19:07:19.583 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-02-19T19:07:19.583 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-02-19T19:07:19.583 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-19T19:07:19.583 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-02-19T19:07:19.583 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 1ce7ea8877c fix 2024-02-19T19:07:19.587 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-19T19:07:19.850 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-19T19:07:19.852 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-19T19:07:19.852 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-19T19:07:21.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:20 smithi046 ceph-mon[88928]: pgmap v64: 65 pgs: 65 active+clean; 93 MiB data, 536 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s wr, 793 op/s; 874 KiB/s, 0 objects/s recovering 2024-02-19T19:07:21.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:20 smithi142 ceph-mon[69118]: pgmap v64: 65 pgs: 65 active+clean; 93 MiB data, 536 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s wr, 793 op/s; 874 KiB/s, 0 objects/s recovering 2024-02-19T19:07:22.796 INFO:tasks.workunit.client.1.smithi142.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-19T19:07:22.803 INFO:tasks.workunit.client.1.smithi142.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-19T19:07:22.803 INFO:tasks.workunit.client.1.smithi142.stderr:+ make 2024-02-19T19:07:22.934 INFO:tasks.workunit.client.1.smithi142.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-19T19:07:23.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:22 smithi046 ceph-mon[88928]: pgmap v65: 65 pgs: 65 active+clean; 93 MiB data, 536 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s wr, 784 op/s 2024-02-19T19:07:23.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:22 smithi142 ceph-mon[69118]: pgmap v65: 65 pgs: 65 active+clean; 93 MiB data, 536 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s wr, 784 op/s 2024-02-19T19:07:24.581 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:24 smithi046 systemd[1]: Stopping Ceph osd.1 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:07:24.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.624+0000 7fb434542700 1 -- 172.21.15.46:0/2077481660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c0ffd60 msgr2=0x7fb42c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:24.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.624+0000 7fb434542700 1 --2- 172.21.15.46:0/2077481660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c0ffd60 0x7fb42c103d30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009910 tx=0x7fb41c009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:24.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.625+0000 7fb434542700 1 -- 172.21.15.46:0/2077481660 shutdown_connections 2024-02-19T19:07:24.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.625+0000 7fb434542700 1 --2- 172.21.15.46:0/2077481660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c0ffd60 0x7fb42c103d30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.625+0000 7fb434542700 1 --2- 172.21.15.46:0/2077481660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0ff3c0 0x7fb42c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.625+0000 7fb434542700 1 -- 172.21.15.46:0/2077481660 >> 172.21.15.46:0/2077481660 conn(0x7fb42c0fac80 msgr2=0x7fb42c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:24.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.625+0000 7fb434542700 1 -- 172.21.15.46:0/2077481660 shutdown_connections 2024-02-19T19:07:24.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.625+0000 7fb434542700 1 -- 172.21.15.46:0/2077481660 wait complete. 2024-02-19T19:07:24.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.625+0000 7fb434542700 1 Processor -- start 2024-02-19T19:07:24.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.625+0000 7fb434542700 1 -- start start 2024-02-19T19:07:24.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb434542700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c0ff3c0 0x7fb42c100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb434542700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0ffd60 0x7fb42c101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb434542700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c101850 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb434542700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c101990 con 0x7fb42c0ffd60 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb4322de700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c0ff3c0 0x7fb42c100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb4322de700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c0ff3c0 0x7fb42c100dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39826/0 (socket says 172.21.15.46:39826) 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb4322de700 1 -- 172.21.15.46:0/3799618449 learned_addr learned my addr 172.21.15.46:0/3799618449 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb431add700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0ffd60 0x7fb42c101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb4322de700 1 -- 172.21.15.46:0/3799618449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0ffd60 msgr2=0x7fb42c101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb4322de700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0ffd60 0x7fb42c101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb4322de700 1 -- 172.21.15.46:0/3799618449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c0095f0 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb4322de700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c0ff3c0 0x7fb42c100dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb42800b4b0 tx=0x7fb42800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb4237fe700 1 -- 172.21.15.46:0/3799618449 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb428011800 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb4237fe700 1 -- 172.21.15.46:0/3799618449 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb428011e20 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb434542700 1 -- 172.21.15.46:0/3799618449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c1a21d0 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb4237fe700 1 -- 172.21.15.46:0/3799618449 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb42800f2e0 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.626+0000 7fb434542700 1 -- 172.21.15.46:0/3799618449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c1a2530 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.628+0000 7fb434542700 1 -- 172.21.15.46:0/3799618449 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42c04f2a0 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.628+0000 7fb4237fe700 1 -- 172.21.15.46:0/3799618449 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb428010380 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.629+0000 7fb4237fe700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb41806d8a0 0x7fb41806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.629+0000 7fb4237fe700 1 -- 172.21.15.46:0/3799618449 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb42808d100 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.629+0000 7fb431add700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb41806d8a0 0x7fb41806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.629+0000 7fb431add700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb41806d8a0 0x7fb41806fd50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb42c102550 tx=0x7fb41c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.633+0000 7fb4237fe700 1 -- 172.21.15.46:0/3799618449 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb4280568c0 con 0x7fb42c0ff3c0 2024-02-19T19:07:24.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.871+0000 7fb434542700 1 -- 172.21.15.46:0/3799618449 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb42c101b50 con 0x7fb41806d8a0 2024-02-19T19:07:24.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.872+0000 7fb4237fe700 1 -- 172.21.15.46:0/3799618449 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb42c101b50 con 0x7fb41806d8a0 2024-02-19T19:07:24.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 -- 172.21.15.46:0/3799618449 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb41806d8a0 msgr2=0x7fb41806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:24.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb41806d8a0 0x7fb41806fd50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb42c102550 tx=0x7fb41c01a040 comp rx=0 tx=0).stop 2024-02-19T19:07:24.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 -- 172.21.15.46:0/3799618449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c0ff3c0 msgr2=0x7fb42c100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:24.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c0ff3c0 0x7fb42c100dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb42800b4b0 tx=0x7fb42800b870 comp rx=0 tx=0).stop 2024-02-19T19:07:24.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 -- 172.21.15.46:0/3799618449 shutdown_connections 2024-02-19T19:07:24.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb41806d8a0 0x7fb41806fd50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb42c0ff3c0 0x7fb42c100dd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 --2- 172.21.15.46:0/3799618449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb42c0ffd60 0x7fb42c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 -- 172.21.15.46:0/3799618449 >> 172.21.15.46:0/3799618449 conn(0x7fb42c0fac80 msgr2=0x7fb42c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:24.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:24 smithi046 ceph-mon[88928]: pgmap v66: 65 pgs: 65 active+clean; 106 MiB data, 578 MiB used, 536 GiB / 536 GiB avail; 6.6 MiB/s wr, 792 op/s 2024-02-19T19:07:24.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 -- 172.21.15.46:0/3799618449 shutdown_connections 2024-02-19T19:07:24.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.875+0000 7fb434542700 1 -- 172.21.15.46:0/3799618449 wait complete. 2024-02-19T19:07:24.906 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:07:25.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.983+0000 7f0c76a26700 1 -- 172.21.15.46:0/1459630656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c70101d30 msgr2=0x7f0c7010a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:25.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.983+0000 7f0c76a26700 1 --2- 172.21.15.46:0/1459630656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c70101d30 0x7f0c7010a230 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009910 tx=0x7f0c60009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.983+0000 7f0c76a26700 1 -- 172.21.15.46:0/1459630656 shutdown_connections 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.983+0000 7f0c76a26700 1 --2- 172.21.15.46:0/1459630656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c70101d30 0x7f0c7010a230 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.983+0000 7f0c76a26700 1 --2- 172.21.15.46:0/1459630656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c70101420 0x7f0c701017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.983+0000 7f0c76a26700 1 -- 172.21.15.46:0/1459630656 >> 172.21.15.46:0/1459630656 conn(0x7f0c700fac80 msgr2=0x7f0c700fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.983+0000 7f0c76a26700 1 -- 172.21.15.46:0/1459630656 shutdown_connections 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.983+0000 7f0c76a26700 1 -- 172.21.15.46:0/1459630656 wait complete. 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.983+0000 7f0c76a26700 1 Processor -- start 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.983+0000 7f0c76a26700 1 -- start start 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c76a26700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c70101420 0x7f0c70195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c76a26700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c70101d30 0x7f0c701963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c76a26700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70196a80 con 0x7f0c70101d30 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c76a26700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7019a810 con 0x7f0c70101420 2024-02-19T19:07:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c70101d30 0x7f0c701963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c70101d30 0x7f0c701963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39852/0 (socket says 172.21.15.46:39852) 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6f7fe700 1 -- 172.21.15.46:0/1816366897 learned_addr learned my addr 172.21.15.46:0/1816366897 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6ffff700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c70101420 0x7f0c70195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6f7fe700 1 -- 172.21.15.46:0/1816366897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c70101420 msgr2=0x7f0c70195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6f7fe700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c70101420 0x7f0c70195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6f7fe700 1 -- 172.21.15.46:0/1816366897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600095f0 con 0x7f0c70101d30 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6f7fe700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c70101d30 0x7f0c701963a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c600092e0 tx=0x7f0c6000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6d7fa700 1 -- 172.21.15.46:0/1816366897 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c6001d070 con 0x7f0c70101d30 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6d7fa700 1 -- 172.21.15.46:0/1816366897 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c60005e00 con 0x7f0c70101d30 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c76a26700 1 -- 172.21.15.46:0/1816366897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7019aa90 con 0x7f0c70101d30 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.984+0000 7f0c6d7fa700 1 -- 172.21.15.46:0/1816366897 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c60017400 con 0x7f0c70101d30 2024-02-19T19:07:25.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.985+0000 7f0c76a26700 1 -- 172.21.15.46:0/1816366897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7019af80 con 0x7f0c70101d30 2024-02-19T19:07:25.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.985+0000 7f0c76a26700 1 -- 172.21.15.46:0/1816366897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c701078a0 con 0x7f0c70101d30 2024-02-19T19:07:25.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.986+0000 7f0c6d7fa700 1 -- 172.21.15.46:0/1816366897 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0c6000f6f0 con 0x7f0c70101d30 2024-02-19T19:07:25.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.986+0000 7f0c6d7fa700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0c5c06d8a0 0x7f0c5c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:25.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.986+0000 7f0c6d7fa700 1 -- 172.21.15.46:0/1816366897 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0c6008e860 con 0x7f0c70101d30 2024-02-19T19:07:25.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.987+0000 7f0c6ffff700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0c5c06d8a0 0x7f0c5c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:25.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.987+0000 7f0c6ffff700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0c5c06d8a0 0x7f0c5c06fd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c58005950 tx=0x7f0c5800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:25.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:24.991+0000 7f0c6d7fa700 1 -- 172.21.15.46:0/1816366897 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0c60058140 con 0x7f0c70101d30 2024-02-19T19:07:25.076 INFO:tasks.workunit.client.1.smithi142.stderr:++ readlink -f fsstress 2024-02-19T19:07:25.077 INFO:tasks.workunit.client.1.smithi142.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-19T19:07:25.077 INFO:tasks.workunit.client.1.smithi142.stderr:+ popd 2024-02-19T19:07:25.077 INFO:tasks.workunit.client.1.smithi142.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-19T19:07:25.078 INFO:tasks.workunit.client.1.smithi142.stderr:+ popd 2024-02-19T19:07:25.078 INFO:tasks.workunit.client.1.smithi142.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-19T19:07:25.078 INFO:tasks.workunit.client.1.smithi142.stderr:++ mktemp -d -p . 2024-02-19T19:07:25.079 INFO:tasks.workunit.client.1.smithi142.stderr:+ T=./tmp.xU5MEvGV4m 2024-02-19T19:07:25.079 INFO:tasks.workunit.client.1.smithi142.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.xU5MEvGV4m -l 1 -n 1000 -p 10 -v 2024-02-19T19:07:25.080 INFO:tasks.workunit.client.1.smithi142.stdout:seed = 1708345759 2024-02-19T19:07:25.083 INFO:tasks.workunit.client.1.smithi142.stdout:1/0: chown . 15 1 2024-02-19T19:07:25.083 INFO:tasks.workunit.client.1.smithi142.stdout:1/1: write - no filename 2024-02-19T19:07:25.083 INFO:tasks.workunit.client.1.smithi142.stdout:1/2: write - no filename 2024-02-19T19:07:25.083 INFO:tasks.workunit.client.1.smithi142.stdout:1/3: getdents . 0 2024-02-19T19:07:25.083 INFO:tasks.workunit.client.1.smithi142.stdout:0/0: creat f0 x:0 0 0 2024-02-19T19:07:25.084 INFO:tasks.workunit.client.1.smithi142.stdout:2/0: dread - no filename 2024-02-19T19:07:25.084 INFO:tasks.workunit.client.1.smithi142.stdout:1/4: symlink l0 0 2024-02-19T19:07:25.085 INFO:tasks.workunit.client.1.smithi142.stdout:0/1: symlink l1 0 2024-02-19T19:07:25.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/0: dwrite - no filename 2024-02-19T19:07:25.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/1: fsync - no filename 2024-02-19T19:07:25.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/2: getdents . 0 2024-02-19T19:07:25.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/3: truncate - no filename 2024-02-19T19:07:25.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/4: write - no filename 2024-02-19T19:07:25.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/5: dwrite - no filename 2024-02-19T19:07:25.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/6: rename - no filename 2024-02-19T19:07:25.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/7: chown . 187682848 1 2024-02-19T19:07:25.087 INFO:tasks.workunit.client.1.smithi142.stdout:2/1: creat f0 x:0 0 0 2024-02-19T19:07:25.087 INFO:tasks.workunit.client.1.smithi142.stdout:1/5: creat f1 x:0 0 0 2024-02-19T19:07:25.087 INFO:tasks.workunit.client.1.smithi142.stdout:1/6: stat f1 0 2024-02-19T19:07:25.087 INFO:tasks.workunit.client.1.smithi142.stdout:1/7: truncate f1 253032 0 2024-02-19T19:07:25.088 INFO:tasks.workunit.client.1.smithi142.stdout:0/2: rename l1 to l2 0 2024-02-19T19:07:25.088 INFO:tasks.workunit.client.1.smithi142.stdout:0/3: creat f3 x:0 0 0 2024-02-19T19:07:25.088 INFO:tasks.workunit.client.1.smithi142.stdout:4/0: chown . 0 1 2024-02-19T19:07:25.088 INFO:tasks.workunit.client.1.smithi142.stdout:4/1: write - no filename 2024-02-19T19:07:25.088 INFO:tasks.workunit.client.1.smithi142.stdout:4/2: dwrite - no filename 2024-02-19T19:07:25.088 INFO:tasks.workunit.client.1.smithi142.stdout:4/3: dread - no filename 2024-02-19T19:07:25.089 INFO:tasks.workunit.client.1.smithi142.stdout:4/4: write - no filename 2024-02-19T19:07:25.089 INFO:tasks.workunit.client.1.smithi142.stdout:3/8: creat f0 x:0 0 0 2024-02-19T19:07:25.089 INFO:tasks.workunit.client.1.smithi142.stdout:3/9: write f0 [2135,119910] 0 2024-02-19T19:07:25.089 INFO:tasks.workunit.client.1.smithi142.stdout:1/8: mknod c2 0 2024-02-19T19:07:25.091 INFO:tasks.workunit.client.1.smithi142.stdout:0/4: symlink l4 0 2024-02-19T19:07:25.091 INFO:tasks.workunit.client.1.smithi142.stdout:0/5: creat f5 x:0 0 0 2024-02-19T19:07:25.091 INFO:tasks.workunit.client.1.smithi142.stdout:0/6: truncate f0 108322 0 2024-02-19T19:07:25.091 INFO:tasks.workunit.client.1.smithi142.stdout:0/7: creat f6 x:0 0 0 2024-02-19T19:07:25.091 INFO:tasks.workunit.client.1.smithi142.stdout:0/8: read - f5 zero size 2024-02-19T19:07:25.092 INFO:tasks.workunit.client.1.smithi142.stdout:5/0: truncate - no filename 2024-02-19T19:07:25.092 INFO:tasks.workunit.client.1.smithi142.stdout:5/1: rename - no filename 2024-02-19T19:07:25.093 INFO:tasks.workunit.client.1.smithi142.stdout:4/5: mknod c0 0 2024-02-19T19:07:25.095 INFO:tasks.workunit.client.1.smithi142.stdout:3/10: dread f0 [0,4194304] 0 2024-02-19T19:07:25.097 INFO:tasks.workunit.client.1.smithi142.stdout:5/2: symlink l0 0 2024-02-19T19:07:25.097 INFO:tasks.workunit.client.1.smithi142.stdout:5/3: readlink l0 0 2024-02-19T19:07:25.098 INFO:tasks.workunit.client.1.smithi142.stdout:6/0: dread - no filename 2024-02-19T19:07:25.098 INFO:tasks.workunit.client.1.smithi142.stdout:6/1: truncate - no filename 2024-02-19T19:07:25.098 INFO:tasks.workunit.client.1.smithi142.stdout:6/2: getdents . 0 2024-02-19T19:07:25.098 INFO:tasks.workunit.client.1.smithi142.stdout:6/3: write - no filename 2024-02-19T19:07:25.098 INFO:tasks.workunit.client.1.smithi142.stdout:6/4: readlink - no filename 2024-02-19T19:07:25.098 INFO:tasks.workunit.client.1.smithi142.stdout:6/5: write - no filename 2024-02-19T19:07:25.098 INFO:tasks.workunit.client.1.smithi142.stdout:6/6: dread - no filename 2024-02-19T19:07:25.098 INFO:tasks.workunit.client.1.smithi142.stdout:6/7: dread - no filename 2024-02-19T19:07:25.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/6: mknod c1 0 2024-02-19T19:07:25.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/7: dwrite - no filename 2024-02-19T19:07:25.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/8: write - no filename 2024-02-19T19:07:25.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/9: fsync - no filename 2024-02-19T19:07:25.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/10: dread - no filename 2024-02-19T19:07:25.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/11: read - no filename 2024-02-19T19:07:25.100 INFO:tasks.workunit.client.1.smithi142.stdout:5/4: rename l0 to l1 0 2024-02-19T19:07:25.100 INFO:tasks.workunit.client.1.smithi142.stdout:5/5: fsync - no filename 2024-02-19T19:07:25.100 INFO:tasks.workunit.client.1.smithi142.stdout:5/6: dwrite - no filename 2024-02-19T19:07:25.100 INFO:tasks.workunit.client.1.smithi142.stdout:5/7: readlink l1 0 2024-02-19T19:07:25.122 INFO:tasks.workunit.client.1.smithi142.stdout:4/12: rename c0 to c2 0 2024-02-19T19:07:25.122 INFO:tasks.workunit.client.1.smithi142.stdout:4/13: dwrite - no filename 2024-02-19T19:07:25.122 INFO:tasks.workunit.client.1.smithi142.stdout:4/14: fsync - no filename 2024-02-19T19:07:25.122 INFO:tasks.workunit.client.1.smithi142.stdout:4/15: write - no filename 2024-02-19T19:07:25.122 INFO:tasks.workunit.client.1.smithi142.stdout:4/16: chown c2 3 1 2024-02-19T19:07:25.122 INFO:tasks.workunit.client.1.smithi142.stdout:4/17: rmdir - no directory 2024-02-19T19:07:25.122 INFO:tasks.workunit.client.1.smithi142.stdout:4/18: truncate - no filename 2024-02-19T19:07:25.153 INFO:tasks.workunit.client.1.smithi142.stdout:2/2: dwrite f0 [0,4194304] 0 2024-02-19T19:07:25.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:24 smithi142 ceph-mon[69118]: pgmap v66: 65 pgs: 65 active+clean; 106 MiB data, 578 MiB used, 536 GiB / 536 GiB avail; 6.6 MiB/s wr, 792 op/s 2024-02-19T19:07:25.231 INFO:tasks.workunit.client.1.smithi142.stdout:1/9: dwrite f1 [0,4194304] 0 2024-02-19T19:07:25.231 INFO:tasks.workunit.client.1.smithi142.stdout:1/10: chown l0 246277093 1 2024-02-19T19:07:25.240 INFO:tasks.workunit.client.1.smithi142.stdout:3/11: dwrite f0 [0,4194304] 0 2024-02-19T19:07:25.244 INFO:tasks.workunit.client.1.smithi142.stdout:1/11: symlink l3 0 2024-02-19T19:07:25.299 INFO:tasks.workunit.client.1.smithi142.stdout:1/12: rename f1 to f4 0 2024-02-19T19:07:25.331 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:25 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[50200]: 2024-02-19T19:07:25.023+0000 7fdcd111b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:07:25.331 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:25 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[50200]: 2024-02-19T19:07:25.023+0000 7fdcd111b700 -1 osd.1 54 *** Got signal Terminated *** 2024-02-19T19:07:25.331 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:25 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[50200]: 2024-02-19T19:07:25.023+0000 7fdcd111b700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:07:25.385 INFO:tasks.workunit.client.1.smithi142.stdout:3/12: dread f0 [0,4194304] 0 2024-02-19T19:07:25.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.373+0000 7f0c76a26700 1 -- 172.21.15.46:0/1816366897 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c7002cca0 con 0x7f0c5c06d8a0 2024-02-19T19:07:25.396 INFO:tasks.workunit.client.1.smithi142.stdout:0/9: fsync f0 0 2024-02-19T19:07:25.396 INFO:tasks.workunit.client.1.smithi142.stdout:0/10: write f6 [721108,122269] 0 2024-02-19T19:07:25.396 INFO:tasks.workunit.client.1.smithi142.stdout:0/11: dread - f3 zero size 2024-02-19T19:07:25.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.377+0000 7f0c6d7fa700 1 -- 172.21.15.46:0/1816366897 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0c7002cca0 con 0x7f0c5c06d8a0 2024-02-19T19:07:25.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.381+0000 7f0c76a26700 1 -- 172.21.15.46:0/1816366897 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0c5c06d8a0 msgr2=0x7f0c5c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:25.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.382+0000 7f0c76a26700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0c5c06d8a0 0x7f0c5c06fd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c58005950 tx=0x7f0c5800b410 comp rx=0 tx=0).stop 2024-02-19T19:07:25.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.382+0000 7f0c76a26700 1 -- 172.21.15.46:0/1816366897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c70101d30 msgr2=0x7f0c701963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:25.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.382+0000 7f0c76a26700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c70101d30 0x7f0c701963a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c600092e0 tx=0x7f0c6000bd70 comp rx=0 tx=0).stop 2024-02-19T19:07:25.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.382+0000 7f0c76a26700 1 -- 172.21.15.46:0/1816366897 shutdown_connections 2024-02-19T19:07:25.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.382+0000 7f0c76a26700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0c5c06d8a0 0x7f0c5c06fd50 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c58005950 tx=0x7f0c5800b410 comp rx=0 tx=0).stop 2024-02-19T19:07:25.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.382+0000 7f0c76a26700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c70101420 0x7f0c70195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.382+0000 7f0c76a26700 1 --2- 172.21.15.46:0/1816366897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c70101d30 0x7f0c701963a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.382+0000 7f0c76a26700 1 -- 172.21.15.46:0/1816366897 >> 172.21.15.46:0/1816366897 conn(0x7f0c700fac80 msgr2=0x7f0c701049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:25.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.383+0000 7f0c76a26700 1 -- 172.21.15.46:0/1816366897 shutdown_connections 2024-02-19T19:07:25.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.383+0000 7f0c76a26700 1 -- 172.21.15.46:0/1816366897 wait complete. 2024-02-19T19:07:25.410 INFO:tasks.workunit.client.1.smithi142.stdout:8/0: fsync - no filename 2024-02-19T19:07:25.410 INFO:tasks.workunit.client.1.smithi142.stdout:9/0: fsync - no filename 2024-02-19T19:07:25.410 INFO:tasks.workunit.client.1.smithi142.stdout:7/0: truncate - no filename 2024-02-19T19:07:25.410 INFO:tasks.workunit.client.1.smithi142.stdout:9/1: write - no filename 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:7/1: dread - no filename 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:7/2: dread - no filename 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/2: dread - no filename 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/3: dwrite - no filename 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:7/3: unlink - no file 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:7/4: truncate - no filename 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/4: rmdir - no directory 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:7/5: write - no filename 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/5: dwrite - no filename 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/6: rmdir - no directory 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/7: fdatasync - no filename 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/8: readlink - no filename 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/9: unlink - no file 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/10: chown . 781385 1 2024-02-19T19:07:25.411 INFO:tasks.workunit.client.1.smithi142.stdout:9/11: stat - no entries 2024-02-19T19:07:25.412 INFO:tasks.workunit.client.1.smithi142.stdout:9/12: write - no filename 2024-02-19T19:07:25.412 INFO:tasks.workunit.client.1.smithi142.stdout:9/13: getdents . 0 2024-02-19T19:07:25.412 INFO:tasks.workunit.client.1.smithi142.stdout:9/14: rmdir - no directory 2024-02-19T19:07:25.412 INFO:tasks.workunit.client.1.smithi142.stdout:9/15: truncate - no filename 2024-02-19T19:07:25.412 INFO:tasks.workunit.client.1.smithi142.stdout:8/1: read - no filename 2024-02-19T19:07:25.412 INFO:tasks.workunit.client.1.smithi142.stdout:8/2: chown . 150 1 2024-02-19T19:07:25.412 INFO:tasks.workunit.client.1.smithi142.stdout:8/3: rename - no filename 2024-02-19T19:07:25.412 INFO:tasks.workunit.client.1.smithi142.stdout:8/4: chown . 5917226 1 2024-02-19T19:07:25.412 INFO:tasks.workunit.client.1.smithi142.stdout:8/5: dwrite - no filename 2024-02-19T19:07:25.412 INFO:tasks.workunit.client.1.smithi142.stdout:8/6: chown . 205 1 2024-02-19T19:07:25.413 INFO:tasks.workunit.client.1.smithi142.stdout:0/12: dwrite f0 [0,4194304] 0 2024-02-19T19:07:25.413 INFO:tasks.workunit.client.1.smithi142.stdout:5/8: rename l1 to l2 0 2024-02-19T19:07:25.413 INFO:tasks.workunit.client.1.smithi142.stdout:5/9: dwrite - no filename 2024-02-19T19:07:25.413 INFO:tasks.workunit.client.1.smithi142.stdout:5/10: read - no filename 2024-02-19T19:07:25.413 INFO:tasks.workunit.client.1.smithi142.stdout:5/11: dread - no filename 2024-02-19T19:07:25.413 INFO:tasks.workunit.client.1.smithi142.stdout:5/12: dread - no filename 2024-02-19T19:07:25.413 INFO:tasks.workunit.client.1.smithi142.stdout:5/13: truncate - no filename 2024-02-19T19:07:25.413 INFO:tasks.workunit.client.1.smithi142.stdout:5/14: fdatasync - no filename 2024-02-19T19:07:25.414 INFO:tasks.workunit.client.1.smithi142.stdout:4/19: getdents . 0 2024-02-19T19:07:25.414 INFO:tasks.workunit.client.1.smithi142.stdout:4/20: write - no filename 2024-02-19T19:07:25.414 INFO:tasks.workunit.client.1.smithi142.stdout:4/21: dwrite - no filename 2024-02-19T19:07:25.474 INFO:tasks.workunit.client.1.smithi142.stdout:1/13: fsync f4 0 2024-02-19T19:07:25.500 INFO:tasks.workunit.client.1.smithi142.stdout:1/14: dwrite f4 [0,4194304] 0 2024-02-19T19:07:25.523 INFO:tasks.workunit.client.1.smithi142.stdout:1/15: dwrite f4 [0,4194304] 0 2024-02-19T19:07:25.523 INFO:tasks.workunit.client.1.smithi142.stdout:1/16: stat f4 0 2024-02-19T19:07:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.506+0000 7efd4a639700 1 -- 172.21.15.46:0/3446746503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd44100e60 msgr2=0x7efd44104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.506+0000 7efd4a639700 1 --2- 172.21.15.46:0/3446746503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd44100e60 0x7efd44104e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd38009910 tx=0x7efd38009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.506+0000 7efd4a639700 1 -- 172.21.15.46:0/3446746503 shutdown_connections 2024-02-19T19:07:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.506+0000 7efd4a639700 1 --2- 172.21.15.46:0/3446746503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd44100e60 0x7efd44104e30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.506+0000 7efd4a639700 1 --2- 172.21.15.46:0/3446746503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd441004c0 0x7efd44100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.506+0000 7efd4a639700 1 -- 172.21.15.46:0/3446746503 >> 172.21.15.46:0/3446746503 conn(0x7efd440fbd80 msgr2=0x7efd440fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.506+0000 7efd4a639700 1 -- 172.21.15.46:0/3446746503 shutdown_connections 2024-02-19T19:07:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.506+0000 7efd4a639700 1 -- 172.21.15.46:0/3446746503 wait complete. 2024-02-19T19:07:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.507+0000 7efd4a639700 1 Processor -- start 2024-02-19T19:07:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.507+0000 7efd4a639700 1 -- start start 2024-02-19T19:07:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.507+0000 7efd4a639700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd441004c0 0x7efd44195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.507+0000 7efd4a639700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd44100e60 0x7efd44196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.507+0000 7efd4a639700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd44196b10 con 0x7efd44100e60 2024-02-19T19:07:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.507+0000 7efd4a639700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4419a8a0 con 0x7efd441004c0 2024-02-19T19:07:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.507+0000 7efd437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd44100e60 0x7efd44196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.507+0000 7efd437fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd44100e60 0x7efd44196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39882/0 (socket says 172.21.15.46:39882) 2024-02-19T19:07:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd437fe700 1 -- 172.21.15.46:0/3033768222 learned_addr learned my addr 172.21.15.46:0/3033768222 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd43fff700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd441004c0 0x7efd44195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd437fe700 1 -- 172.21.15.46:0/3033768222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd441004c0 msgr2=0x7efd44195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd437fe700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd441004c0 0x7efd44195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd437fe700 1 -- 172.21.15.46:0/3033768222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd380095f0 con 0x7efd44100e60 2024-02-19T19:07:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd437fe700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd44100e60 0x7efd44196430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd380059d0 tx=0x7efd3800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd417fa700 1 -- 172.21.15.46:0/3033768222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3801d070 con 0x7efd44100e60 2024-02-19T19:07:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd417fa700 1 -- 172.21.15.46:0/3033768222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd3800b610 con 0x7efd44100e60 2024-02-19T19:07:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd4a639700 1 -- 172.21.15.46:0/3033768222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4419ab20 con 0x7efd44100e60 2024-02-19T19:07:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd417fa700 1 -- 172.21.15.46:0/3033768222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd38022470 con 0x7efd44100e60 2024-02-19T19:07:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.508+0000 7efd4a639700 1 -- 172.21.15.46:0/3033768222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4419b010 con 0x7efd44100e60 2024-02-19T19:07:25.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.510+0000 7efd417fa700 1 -- 172.21.15.46:0/3033768222 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7efd3800fac0 con 0x7efd44100e60 2024-02-19T19:07:25.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.510+0000 7efd4a639700 1 -- 172.21.15.46:0/3033768222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd44108830 con 0x7efd44100e60 2024-02-19T19:07:25.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.510+0000 7efd417fa700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efd2c071cb0 0x7efd2c074160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:25.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.510+0000 7efd417fa700 1 -- 172.21.15.46:0/3033768222 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efd3808e910 con 0x7efd44100e60 2024-02-19T19:07:25.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.510+0000 7efd43fff700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efd2c071cb0 0x7efd2c074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:25.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.511+0000 7efd43fff700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efd2c071cb0 0x7efd2c074160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd34009c60 tx=0x7efd34009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:25.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.518+0000 7efd417fa700 1 -- 172.21.15.46:0/3033768222 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efd38058170 con 0x7efd44100e60 2024-02-19T19:07:25.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.762+0000 7efd4a639700 1 -- 172.21.15.46:0/3033768222 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd4419b230 con 0x7efd2c071cb0 2024-02-19T19:07:25.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.774+0000 7efd417fa700 1 -- 172.21.15.46:0/3033768222 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7efd4419b230 con 0x7efd2c071cb0 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (3m) 19s ago 14m 26.2M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (14m) 19s ago 14m 8070k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (12m) 46s ago 12m 7960k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (55s) 19s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (49s) 46s ago 12m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (3m) 19s ago 13m 85.2M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (7m) 19s ago 7m 74.3M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (8m) 19s ago 8m 16.4M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (7m) 46s ago 7m 16.6M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (7m) 46s ago 7m 25.4M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:07:25.795 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (5m) 19s ago 15m 499M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (4m) 46s ago 12m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (2m) 19s ago 15m 45.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (101s) 46s ago 12m 34.1M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (4m) 19s ago 14m 16.9M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (4m) 46s ago 12m 16.8M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (27s) 19s ago 11m 12.2M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (11m) 19s ago 11m 55.9M 1217M 18.2.0 dc2bc1663786 5ffd1526df8c 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (10m) 19s ago 10m 53.9M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (10m) 46s ago 10m 49.8M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (9m) 46s ago 9m 47.8M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (9m) 46s ago 9m 48.8M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:07:25.796 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (4m) 19s ago 13m 63.2M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:07:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 -- 172.21.15.46:0/3033768222 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efd2c071cb0 msgr2=0x7efd2c074160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efd2c071cb0 0x7efd2c074160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd34009c60 tx=0x7efd34009260 comp rx=0 tx=0).stop 2024-02-19T19:07:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 -- 172.21.15.46:0/3033768222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd44100e60 msgr2=0x7efd44196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd44100e60 0x7efd44196430 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd380059d0 tx=0x7efd3800f690 comp rx=0 tx=0).stop 2024-02-19T19:07:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 -- 172.21.15.46:0/3033768222 shutdown_connections 2024-02-19T19:07:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efd2c071cb0 0x7efd2c074160 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd441004c0 0x7efd44195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 --2- 172.21.15.46:0/3033768222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd44100e60 0x7efd44196430 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 -- 172.21.15.46:0/3033768222 >> 172.21.15.46:0/3033768222 conn(0x7efd440fbd80 msgr2=0x7efd440fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 -- 172.21.15.46:0/3033768222 shutdown_connections 2024-02-19T19:07:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.777+0000 7efd4a639700 1 -- 172.21.15.46:0/3033768222 wait complete. 2024-02-19T19:07:25.867 INFO:tasks.workunit.client.1.smithi142.stdout:2/3: symlink l1 0 2024-02-19T19:07:25.867 INFO:tasks.workunit.client.1.smithi142.stdout:2/4: creat f2 x:0 0 0 2024-02-19T19:07:25.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.900+0000 7f07803ae700 1 -- 172.21.15.46:0/2158222125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0778075e60 msgr2=0x7f07780ff350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:25.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.900+0000 7f07803ae700 1 --2- 172.21.15.46:0/2158222125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0778075e60 0x7f07780ff350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0774009940 tx=0x7f0774009c50 comp rx=0 tx=0).stop 2024-02-19T19:07:25.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.900+0000 7f07803ae700 1 -- 172.21.15.46:0/2158222125 shutdown_connections 2024-02-19T19:07:25.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.900+0000 7f07803ae700 1 --2- 172.21.15.46:0/2158222125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07780ff890 0x7f07780ffd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.900+0000 7f07803ae700 1 --2- 172.21.15.46:0/2158222125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0778075e60 0x7f07780ff350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.900+0000 7f07803ae700 1 -- 172.21.15.46:0/2158222125 >> 172.21.15.46:0/2158222125 conn(0x7f07780748b0 msgr2=0x7f0778074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:25.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.900+0000 7f07803ae700 1 -- 172.21.15.46:0/2158222125 shutdown_connections 2024-02-19T19:07:25.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.900+0000 7f07803ae700 1 -- 172.21.15.46:0/2158222125 wait complete. 2024-02-19T19:07:25.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.901+0000 7f07803ae700 1 Processor -- start 2024-02-19T19:07:25.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.901+0000 7f07803ae700 1 -- start start 2024-02-19T19:07:25.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.901+0000 7f07803ae700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0778075e60 0x7f0778198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:25.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.901+0000 7f07803ae700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07780ff890 0x7f07781985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:25.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.901+0000 7f07803ae700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0778198cb0 con 0x7f07780ff890 2024-02-19T19:07:25.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.901+0000 7f07803ae700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077819c9d0 con 0x7f0778075e60 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.901+0000 7f077d949700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07780ff890 0x7f07781985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.901+0000 7f077d949700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07780ff890 0x7f07781985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39898/0 (socket says 172.21.15.46:39898) 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.901+0000 7f077d949700 1 -- 172.21.15.46:0/413469818 learned_addr learned my addr 172.21.15.46:0/413469818 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.901+0000 7f077e14a700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0778075e60 0x7f0778198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.902+0000 7f077d949700 1 -- 172.21.15.46:0/413469818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0778075e60 msgr2=0x7f0778198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.902+0000 7f077d949700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0778075e60 0x7f0778198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.902+0000 7f077d949700 1 -- 172.21.15.46:0/413469818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07740095f0 con 0x7f07780ff890 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.902+0000 7f077d949700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07780ff890 0x7f07781985d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f076800d8d0 tx=0x7f076800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.902+0000 7f076f7fe700 1 -- 172.21.15.46:0/413469818 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07680098a0 con 0x7f07780ff890 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.902+0000 7f076f7fe700 1 -- 172.21.15.46:0/413469818 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0768010460 con 0x7f07780ff890 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.902+0000 7f076f7fe700 1 -- 172.21.15.46:0/413469818 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f076800f5f0 con 0x7f07780ff890 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.902+0000 7f07803ae700 1 -- 172.21.15.46:0/413469818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077819ccb0 con 0x7f07780ff890 2024-02-19T19:07:25.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.902+0000 7f07803ae700 1 -- 172.21.15.46:0/413469818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077819d200 con 0x7f07780ff890 2024-02-19T19:07:25.925 INFO:tasks.workunit.client.1.smithi142.stdout:7/6: mkdir d0 0 2024-02-19T19:07:25.925 INFO:tasks.workunit.client.1.smithi142.stdout:7/7: fsync - no filename 2024-02-19T19:07:25.925 INFO:tasks.workunit.client.1.smithi142.stdout:7/8: dread - no filename 2024-02-19T19:07:25.925 INFO:tasks.workunit.client.1.smithi142.stdout:7/9: write - no filename 2024-02-19T19:07:25.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.903+0000 7f07803ae700 1 -- 172.21.15.46:0/413469818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077810a230 con 0x7f07780ff890 2024-02-19T19:07:25.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.904+0000 7f076f7fe700 1 -- 172.21.15.46:0/413469818 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0768009a00 con 0x7f07780ff890 2024-02-19T19:07:25.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.905+0000 7f076f7fe700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f076406d8a0 0x7f076406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:25.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.905+0000 7f076f7fe700 1 -- 172.21.15.46:0/413469818 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f076808d280 con 0x7f07780ff890 2024-02-19T19:07:25.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.905+0000 7f077e14a700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f076406d8a0 0x7f076406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:25.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.905+0000 7f077e14a700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f076406d8a0 0x7f076406fd50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0774009910 tx=0x7f0774005ad0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:25.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:25.909+0000 7f076f7fe700 1 -- 172.21.15.46:0/413469818 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0768056cb0 con 0x7f07780ff890 2024-02-19T19:07:25.965 INFO:tasks.workunit.client.1.smithi142.stdout:9/16: creat f0 x:0 0 0 2024-02-19T19:07:25.965 INFO:tasks.workunit.client.1.smithi142.stdout:9/17: chown f0 1916931385 1 2024-02-19T19:07:26.034 INFO:tasks.workunit.client.1.smithi142.stdout:8/7: creat f0 x:0 0 0 2024-02-19T19:07:26.034 INFO:tasks.workunit.client.1.smithi142.stdout:8/8: creat f1 x:0 0 0 2024-02-19T19:07:26.035 INFO:tasks.workunit.client.1.smithi142.stdout:8/9: creat f2 x:0 0 0 2024-02-19T19:07:26.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:25 smithi046 ceph-mon[88928]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:26.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:25 smithi046 ceph-mon[88928]: osd.1 marked itself down and dead 2024-02-19T19:07:26.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:25 smithi046 ceph-mon[88928]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:26.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:25 smithi142 ceph-mon[69118]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:26.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:25 smithi142 ceph-mon[69118]: osd.1 marked itself down and dead 2024-02-19T19:07:26.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:25 smithi142 ceph-mon[69118]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:26.207 INFO:tasks.workunit.client.1.smithi142.stdout:0/13: rename l2 to l7 0 2024-02-19T19:07:26.208 INFO:tasks.workunit.client.1.smithi142.stdout:5/15: mkdir d3 0 2024-02-19T19:07:26.210 INFO:tasks.workunit.client.1.smithi142.stdout:4/22: unlink c2 0 2024-02-19T19:07:26.210 INFO:tasks.workunit.client.1.smithi142.stdout:4/23: dwrite - no filename 2024-02-19T19:07:26.211 INFO:tasks.workunit.client.1.smithi142.stdout:3/13: getdents . 0 2024-02-19T19:07:26.215 INFO:tasks.workunit.client.1.smithi142.stdout:2/5: mkdir d3 0 2024-02-19T19:07:26.215 INFO:tasks.workunit.client.1.smithi142.stdout:2/6: truncate f2 631281 0 2024-02-19T19:07:26.215 INFO:tasks.workunit.client.1.smithi142.stdout:2/7: chown l1 37 1 2024-02-19T19:07:26.216 INFO:tasks.workunit.client.1.smithi142.stdout:7/10: creat d0/f1 x:0 0 0 2024-02-19T19:07:26.216 INFO:tasks.workunit.client.1.smithi142.stdout:7/11: write d0/f1 [1034339,61242] 0 2024-02-19T19:07:26.216 INFO:tasks.workunit.client.1.smithi142.stdout:7/12: chown d0/f1 31 1 2024-02-19T19:07:26.216 INFO:tasks.workunit.client.1.smithi142.stdout:7/13: creat d0/f2 x:0 0 0 2024-02-19T19:07:26.221 INFO:tasks.workunit.client.1.smithi142.stdout:0/14: rename f0 to f8 0 2024-02-19T19:07:26.221 INFO:tasks.workunit.client.1.smithi142.stdout:0/15: readlink l7 0 2024-02-19T19:07:26.221 INFO:tasks.workunit.client.1.smithi142.stdout:2/8: dread f0 [0,4194304] 0 2024-02-19T19:07:26.221 INFO:tasks.workunit.client.1.smithi142.stdout:0/16: dread - f5 zero size 2024-02-19T19:07:26.222 INFO:tasks.workunit.client.1.smithi142.stdout:5/16: rmdir d3 0 2024-02-19T19:07:26.222 INFO:tasks.workunit.client.1.smithi142.stdout:5/17: dread - no filename 2024-02-19T19:07:26.222 INFO:tasks.workunit.client.1.smithi142.stdout:5/18: dwrite - no filename 2024-02-19T19:07:26.223 INFO:tasks.workunit.client.1.smithi142.stdout:4/24: creat f3 x:0 0 0 2024-02-19T19:07:26.226 INFO:tasks.workunit.client.1.smithi142.stdout:2/9: dread f0 [0,4194304] 0 2024-02-19T19:07:26.227 INFO:tasks.workunit.client.1.smithi142.stdout:5/19: stat l2 0 2024-02-19T19:07:26.227 INFO:tasks.workunit.client.1.smithi142.stdout:5/20: write - no filename 2024-02-19T19:07:26.228 INFO:tasks.workunit.client.1.smithi142.stdout:0/17: write f8 [149425,113772] 0 2024-02-19T19:07:26.229 INFO:tasks.workunit.client.1.smithi142.stdout:4/25: unlink f3 0 2024-02-19T19:07:26.232 INFO:tasks.workunit.client.1.smithi142.stdout:5/21: creat f4 x:0 0 0 2024-02-19T19:07:26.233 INFO:tasks.workunit.client.1.smithi142.stdout:0/18: mknod c9 0 2024-02-19T19:07:26.234 INFO:tasks.workunit.client.1.smithi142.stdout:4/26: chown c1 40696008 1 2024-02-19T19:07:26.236 INFO:tasks.workunit.client.1.smithi142.stdout:5/22: mkdir d5 0 2024-02-19T19:07:26.239 INFO:tasks.workunit.client.1.smithi142.stdout:5/23: mkdir d5/d6 0 2024-02-19T19:07:26.239 INFO:tasks.workunit.client.1.smithi142.stdout:5/24: truncate f4 588036 0 2024-02-19T19:07:26.243 INFO:tasks.workunit.client.1.smithi142.stdout:2/10: dwrite f0 [0,4194304] 0 2024-02-19T19:07:26.251 INFO:tasks.workunit.client.1.smithi142.stdout:0/19: dwrite f5 [0,4194304] 0 2024-02-19T19:07:26.251 INFO:tasks.workunit.client.1.smithi142.stdout:2/11: dread f0 [0,4194304] 0 2024-02-19T19:07:26.254 INFO:tasks.workunit.client.1.smithi142.stdout:0/20: mknod ca 0 2024-02-19T19:07:26.254 INFO:tasks.workunit.client.1.smithi142.stdout:0/21: dread - f3 zero size 2024-02-19T19:07:26.256 INFO:tasks.workunit.client.1.smithi142.stdout:0/22: link f5 fb 0 2024-02-19T19:07:26.323 INFO:tasks.workunit.client.1.smithi142.stdout:8/10: fsync f0 0 2024-02-19T19:07:26.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.317+0000 7f07803ae700 1 -- 172.21.15.46:0/413469818 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f077804f2a0 con 0x7f07780ff890 2024-02-19T19:07:26.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.318+0000 7f076f7fe700 1 -- 172.21.15.46:0/413469818 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f0768016330 con 0x7f07780ff890 2024-02-19T19:07:26.339 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:07:26.339 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:07:26.339 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:07:26.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:07:26.339 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:07:26.339 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:07:26.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:07:26.340 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:07:26.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 -- 172.21.15.46:0/413469818 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f076406d8a0 msgr2=0x7f076406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:26.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f076406d8a0 0x7f076406fd50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0774009910 tx=0x7f0774005ad0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 -- 172.21.15.46:0/413469818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07780ff890 msgr2=0x7f07781985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:26.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07780ff890 0x7f07781985d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f076800d8d0 tx=0x7f076800dbe0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 -- 172.21.15.46:0/413469818 shutdown_connections 2024-02-19T19:07:26.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f076406d8a0 0x7f076406fd50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0778075e60 0x7f0778198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 --2- 172.21.15.46:0/413469818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07780ff890 0x7f07781985d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 -- 172.21.15.46:0/413469818 >> 172.21.15.46:0/413469818 conn(0x7f07780748b0 msgr2=0x7f07780fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:26.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 -- 172.21.15.46:0/413469818 shutdown_connections 2024-02-19T19:07:26.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.320+0000 7f07803ae700 1 -- 172.21.15.46:0/413469818 wait complete. 2024-02-19T19:07:26.447 INFO:tasks.workunit.client.1.smithi142.stdout:2/12: fsync f2 0 2024-02-19T19:07:26.447 INFO:tasks.workunit.client.1.smithi142.stdout:2/13: truncate f2 1584935 0 2024-02-19T19:07:26.448 INFO:tasks.workunit.client.1.smithi142.stdout:2/14: unlink l1 0 2024-02-19T19:07:26.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.428+0000 7fb7a604c700 1 -- 172.21.15.46:0/673408399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7a0104130 msgr2=0x7fb7a0104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:26.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.428+0000 7fb7a604c700 1 --2- 172.21.15.46:0/673408399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7a0104130 0x7fb7a0104500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb790009910 tx=0x7fb790009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:26.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.428+0000 7fb7a604c700 1 -- 172.21.15.46:0/673408399 shutdown_connections 2024-02-19T19:07:26.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.428+0000 7fb7a604c700 1 --2- 172.21.15.46:0/673408399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a00ffbd0 0x7fb7a0100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.428+0000 7fb7a604c700 1 --2- 172.21.15.46:0/673408399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7a0104130 0x7fb7a0104500 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.428+0000 7fb7a604c700 1 -- 172.21.15.46:0/673408399 >> 172.21.15.46:0/673408399 conn(0x7fb7a0075130 msgr2=0x7fb7a0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:26.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.428+0000 7fb7a604c700 1 -- 172.21.15.46:0/673408399 shutdown_connections 2024-02-19T19:07:26.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.428+0000 7fb7a604c700 1 -- 172.21.15.46:0/673408399 wait complete. 2024-02-19T19:07:26.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.429+0000 7fb7a604c700 1 Processor -- start 2024-02-19T19:07:26.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.429+0000 7fb7a604c700 1 -- start start 2024-02-19T19:07:26.451 INFO:tasks.workunit.client.1.smithi142.stdout:2/15: unlink f2 0 2024-02-19T19:07:26.451 INFO:tasks.workunit.client.1.smithi142.stdout:8/11: fsync f1 0 2024-02-19T19:07:26.451 INFO:tasks.workunit.client.1.smithi142.stdout:8/12: fsync f0 0 2024-02-19T19:07:26.451 INFO:tasks.workunit.client.1.smithi142.stdout:8/13: truncate f1 59604 0 2024-02-19T19:07:26.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.429+0000 7fb7a604c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a00ffbd0 0x7fb7a0199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.429+0000 7fb7a604c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7a0104130 0x7fb7a0199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.429+0000 7fb7a604c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a0193a40 con 0x7fb7a0104130 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.429+0000 7fb7a604c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a0193bb0 con 0x7fb7a00ffbd0 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.429+0000 7fb79effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7a0104130 0x7fb7a0199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.429+0000 7fb79effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7a0104130 0x7fb7a0199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39914/0 (socket says 172.21.15.46:39914) 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.429+0000 7fb79effd700 1 -- 172.21.15.46:0/1014401061 learned_addr learned my addr 172.21.15.46:0/1014401061 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.429+0000 7fb79f7fe700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a00ffbd0 0x7fb7a0199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.430+0000 7fb79effd700 1 -- 172.21.15.46:0/1014401061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a00ffbd0 msgr2=0x7fb7a0199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.430+0000 7fb79effd700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a00ffbd0 0x7fb7a0199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.430+0000 7fb79effd700 1 -- 172.21.15.46:0/1014401061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7900095f0 con 0x7fb7a0104130 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.430+0000 7fb79f7fe700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a00ffbd0 0x7fb7a0199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.430+0000 7fb79effd700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7a0104130 0x7fb7a0199f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb794009a20 tx=0x7fb794009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:26.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.430+0000 7fb79cff9700 1 -- 172.21.15.46:0/1014401061 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb794012070 con 0x7fb7a0104130 2024-02-19T19:07:26.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.430+0000 7fb79cff9700 1 -- 172.21.15.46:0/1014401061 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb794009e50 con 0x7fb7a0104130 2024-02-19T19:07:26.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.430+0000 7fb7a604c700 1 -- 172.21.15.46:0/1014401061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a0193e90 con 0x7fb7a0104130 2024-02-19T19:07:26.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.430+0000 7fb79cff9700 1 -- 172.21.15.46:0/1014401061 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7940153b0 con 0x7fb7a0104130 2024-02-19T19:07:26.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.430+0000 7fb7a604c700 1 -- 172.21.15.46:0/1014401061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a01943e0 con 0x7fb7a0104130 2024-02-19T19:07:26.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.431+0000 7fb7a604c700 1 -- 172.21.15.46:0/1014401061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a01076a0 con 0x7fb7a0104130 2024-02-19T19:07:26.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.432+0000 7fb79cff9700 1 -- 172.21.15.46:0/1014401061 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb794016410 con 0x7fb7a0104130 2024-02-19T19:07:26.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.432+0000 7fb79cff9700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb78806d8a0 0x7fb78806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.432+0000 7fb79cff9700 1 -- 172.21.15.46:0/1014401061 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb79408cb10 con 0x7fb7a0104130 2024-02-19T19:07:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.432+0000 7fb79f7fe700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb78806d8a0 0x7fb78806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:26.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.433+0000 7fb79f7fe700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb78806d8a0 0x7fb78806fd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb790000c00 tx=0x7fb790010ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:26.456 INFO:tasks.workunit.client.1.smithi142.stdout:8/14: dread f1 [0,4194304] 0 2024-02-19T19:07:26.456 INFO:tasks.workunit.client.1.smithi142.stdout:8/15: chown f0 265873865 1 2024-02-19T19:07:26.456 INFO:tasks.workunit.client.1.smithi142.stdout:8/16: mknod c3 0 2024-02-19T19:07:26.456 INFO:tasks.workunit.client.1.smithi142.stdout:8/17: chown f1 114765743 1 2024-02-19T19:07:26.456 INFO:tasks.workunit.client.1.smithi142.stdout:8/18: write f2 [720275,20219] 0 2024-02-19T19:07:26.456 INFO:tasks.workunit.client.1.smithi142.stdout:8/19: dread - f0 zero size 2024-02-19T19:07:26.456 INFO:tasks.workunit.client.1.smithi142.stdout:1/17: truncate f4 1169125 0 2024-02-19T19:07:26.457 INFO:tasks.workunit.client.1.smithi142.stdout:7/14: getdents d0 0 2024-02-19T19:07:26.459 INFO:tasks.workunit.client.1.smithi142.stdout:7/15: symlink d0/l3 0 2024-02-19T19:07:26.459 INFO:tasks.workunit.client.1.smithi142.stdout:4/27: getdents . 0 2024-02-19T19:07:26.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.439+0000 7fb79cff9700 1 -- 172.21.15.46:0/1014401061 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb794056420 con 0x7fb7a0104130 2024-02-19T19:07:26.461 INFO:tasks.workunit.client.1.smithi142.stdout:4/28: mkdir d4 0 2024-02-19T19:07:26.461 INFO:tasks.workunit.client.1.smithi142.stdout:4/29: readlink - no filename 2024-02-19T19:07:26.461 INFO:tasks.workunit.client.1.smithi142.stdout:4/30: truncate - no filename 2024-02-19T19:07:26.462 INFO:tasks.workunit.client.1.smithi142.stdout:4/31: creat d4/f5 x:0 0 0 2024-02-19T19:07:26.463 INFO:tasks.workunit.client.1.smithi142.stdout:4/32: symlink d4/l6 0 2024-02-19T19:07:26.463 INFO:tasks.workunit.client.1.smithi142.stdout:4/33: dread - d4/f5 zero size 2024-02-19T19:07:26.463 INFO:tasks.workunit.client.1.smithi142.stdout:0/23: write fb [5239777,65206] 0 2024-02-19T19:07:26.464 INFO:tasks.workunit.client.1.smithi142.stdout:4/34: mknod d4/c7 0 2024-02-19T19:07:26.464 INFO:tasks.workunit.client.1.smithi142.stdout:4/35: chown d4/c7 396638 1 2024-02-19T19:07:26.466 INFO:tasks.workunit.client.1.smithi142.stdout:2/16: dwrite f0 [0,4194304] 0 2024-02-19T19:07:26.466 INFO:tasks.workunit.client.1.smithi142.stdout:7/16: fsync d0/f1 0 2024-02-19T19:07:26.466 INFO:tasks.workunit.client.1.smithi142.stdout:0/24: unlink f6 0 2024-02-19T19:07:26.467 INFO:tasks.workunit.client.1.smithi142.stdout:7/17: write d0/f1 [760577,8841] 0 2024-02-19T19:07:26.467 INFO:tasks.workunit.client.1.smithi142.stdout:4/36: unlink d4/c7 0 2024-02-19T19:07:26.470 INFO:tasks.workunit.client.1.smithi142.stdout:4/37: mknod d4/c8 0 2024-02-19T19:07:26.473 INFO:tasks.workunit.client.1.smithi142.stdout:2/17: read f0 [1866536,25848] 0 2024-02-19T19:07:26.473 INFO:tasks.workunit.client.1.smithi142.stdout:2/18: chown d3 0 1 2024-02-19T19:07:26.474 INFO:tasks.workunit.client.1.smithi142.stdout:7/18: link d0/l3 d0/l4 0 2024-02-19T19:07:26.474 INFO:tasks.workunit.client.1.smithi142.stdout:7/19: write d0/f1 [902633,39696] 0 2024-02-19T19:07:26.477 INFO:tasks.workunit.client.1.smithi142.stdout:7/20: mknod d0/c5 0 2024-02-19T19:07:26.478 INFO:tasks.workunit.client.1.smithi142.stdout:7/21: unlink d0/l4 0 2024-02-19T19:07:26.480 INFO:tasks.workunit.client.1.smithi142.stdout:7/22: mknod d0/c6 0 2024-02-19T19:07:26.482 INFO:tasks.workunit.client.1.smithi142.stdout:7/23: rename d0 to d0/d7 22 2024-02-19T19:07:26.484 INFO:tasks.workunit.client.1.smithi142.stdout:7/24: link d0/f1 d0/f8 0 2024-02-19T19:07:26.486 INFO:tasks.workunit.client.1.smithi142.stdout:7/25: rename d0/f1 to d0/f9 0 2024-02-19T19:07:26.486 INFO:tasks.workunit.client.1.smithi142.stdout:7/26: stat d0/f9 0 2024-02-19T19:07:26.487 INFO:tasks.workunit.client.1.smithi142.stdout:7/27: creat d0/fa x:0 0 0 2024-02-19T19:07:26.488 INFO:tasks.workunit.client.1.smithi142.stdout:7/28: rename d0/l3 to d0/lb 0 2024-02-19T19:07:26.488 INFO:tasks.workunit.client.1.smithi142.stdout:7/29: dread - d0/fa zero size 2024-02-19T19:07:26.489 INFO:tasks.workunit.client.1.smithi142.stdout:7/30: creat d0/fc x:0 0 0 2024-02-19T19:07:26.506 INFO:tasks.workunit.client.1.smithi142.stdout:4/38: dwrite d4/f5 [0,4194304] 0 2024-02-19T19:07:26.506 INFO:tasks.workunit.client.1.smithi142.stdout:2/19: dwrite f0 [0,4194304] 0 2024-02-19T19:07:26.506 INFO:tasks.workunit.client.1.smithi142.stdout:2/20: stat d3 0 2024-02-19T19:07:26.506 INFO:tasks.workunit.client.1.smithi142.stdout:2/21: chown d3 509 1 2024-02-19T19:07:26.507 INFO:tasks.workunit.client.1.smithi142.stdout:4/39: unlink d4/c8 0 2024-02-19T19:07:26.507 INFO:tasks.workunit.client.1.smithi142.stdout:4/40: creat d4/f9 x:0 0 0 2024-02-19T19:07:26.509 INFO:tasks.workunit.client.1.smithi142.stdout:2/22: symlink d3/l4 0 2024-02-19T19:07:26.512 INFO:tasks.workunit.client.1.smithi142.stdout:2/23: creat d3/f5 x:0 0 0 2024-02-19T19:07:26.512 INFO:tasks.workunit.client.1.smithi142.stdout:2/24: creat d3/f6 x:0 0 0 2024-02-19T19:07:26.514 INFO:tasks.workunit.client.1.smithi142.stdout:2/25: symlink d3/l7 0 2024-02-19T19:07:26.514 INFO:tasks.workunit.client.1.smithi142.stdout:2/26: creat d3/f8 x:0 0 0 2024-02-19T19:07:26.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/27: unlink d3/f6 0 2024-02-19T19:07:26.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/28: truncate d3/f5 497262 0 2024-02-19T19:07:26.518 INFO:tasks.workunit.client.1.smithi142.stdout:7/31: dwrite d0/f9 [0,4194304] 0 2024-02-19T19:07:26.518 INFO:tasks.workunit.client.1.smithi142.stdout:2/29: rename d3/l4 to d3/l9 0 2024-02-19T19:07:26.518 INFO:tasks.workunit.client.1.smithi142.stdout:2/30: chown d3/l9 0 1 2024-02-19T19:07:26.519 INFO:tasks.workunit.client.1.smithi142.stdout:2/31: creat d3/fa x:0 0 0 2024-02-19T19:07:26.519 INFO:tasks.workunit.client.1.smithi142.stdout:2/32: fdatasync d3/fa 0 2024-02-19T19:07:26.519 INFO:tasks.workunit.client.1.smithi142.stdout:2/33: fdatasync d3/fa 0 2024-02-19T19:07:26.521 INFO:tasks.workunit.client.1.smithi142.stdout:6/8: sync 2024-02-19T19:07:26.521 INFO:tasks.workunit.client.1.smithi142.stdout:6/9: truncate - no filename 2024-02-19T19:07:26.523 INFO:tasks.workunit.client.1.smithi142.stdout:2/34: mkdir d3/db 0 2024-02-19T19:07:26.523 INFO:tasks.workunit.client.1.smithi142.stdout:2/35: write f0 [4388036,99290] 0 2024-02-19T19:07:26.523 INFO:tasks.workunit.client.1.smithi142.stdout:2/36: write d3/f8 [657119,49531] 0 2024-02-19T19:07:26.525 INFO:tasks.workunit.client.1.smithi142.stdout:7/32: rename d0/f8 to d0/fd 0 2024-02-19T19:07:26.526 INFO:tasks.workunit.client.1.smithi142.stdout:6/10: creat f0 x:0 0 0 2024-02-19T19:07:26.527 INFO:tasks.workunit.client.1.smithi142.stdout:6/11: creat f1 x:0 0 0 2024-02-19T19:07:26.527 INFO:tasks.workunit.client.1.smithi142.stdout:6/12: chown f0 225 1 2024-02-19T19:07:26.530 INFO:tasks.workunit.client.1.smithi142.stdout:7/33: symlink d0/le 0 2024-02-19T19:07:26.531 INFO:tasks.workunit.client.1.smithi142.stdout:6/13: unlink f1 0 2024-02-19T19:07:26.532 INFO:tasks.workunit.client.1.smithi142.stdout:6/14: fdatasync f0 0 2024-02-19T19:07:26.533 INFO:tasks.workunit.client.1.smithi142.stdout:6/15: mkdir d2 0 2024-02-19T19:07:26.536 INFO:tasks.workunit.client.1.smithi142.stdout:4/41: dwrite d4/f5 [4194304,4194304] 0 2024-02-19T19:07:26.539 INFO:tasks.workunit.client.1.smithi142.stdout:4/42: link c1 d4/ca 0 2024-02-19T19:07:26.539 INFO:tasks.workunit.client.1.smithi142.stdout:4/43: creat d4/fb x:0 0 0 2024-02-19T19:07:26.539 INFO:tasks.workunit.client.1.smithi142.stdout:4/44: stat d4/f5 0 2024-02-19T19:07:26.539 INFO:tasks.workunit.client.1.smithi142.stdout:4/45: write d4/f9 [100528,104217] 0 2024-02-19T19:07:26.540 INFO:tasks.workunit.client.1.smithi142.stdout:6/16: fsync f0 0 2024-02-19T19:07:26.540 INFO:tasks.workunit.client.1.smithi142.stdout:6/17: write f0 [285933,32699] 0 2024-02-19T19:07:26.541 INFO:tasks.workunit.client.1.smithi142.stdout:7/34: getdents d0 0 2024-02-19T19:07:26.542 INFO:tasks.workunit.client.1.smithi142.stdout:7/35: creat d0/ff x:0 0 0 2024-02-19T19:07:26.546 INFO:tasks.workunit.client.1.smithi142.stdout:4/46: dread d4/f5 [0,4194304] 0 2024-02-19T19:07:26.552 INFO:tasks.workunit.client.1.smithi142.stdout:4/47: dread d4/f5 [4194304,4194304] 0 2024-02-19T19:07:26.560 INFO:tasks.workunit.client.1.smithi142.stdout:4/48: getdents d4 0 2024-02-19T19:07:26.561 INFO:tasks.workunit.client.1.smithi142.stdout:4/49: mkdir d4/dc 0 2024-02-19T19:07:26.562 INFO:tasks.workunit.client.1.smithi142.stdout:4/50: stat d4/fb 0 2024-02-19T19:07:26.567 INFO:tasks.workunit.client.1.smithi142.stdout:4/51: read d4/f5 [154672,98500] 0 2024-02-19T19:07:26.567 INFO:tasks.workunit.client.1.smithi142.stdout:4/52: write d4/f5 [3344879,67899] 0 2024-02-19T19:07:26.570 INFO:tasks.workunit.client.1.smithi142.stdout:4/53: write d4/f5 [4275507,10947] 0 2024-02-19T19:07:26.570 INFO:tasks.workunit.client.1.smithi142.stdout:4/54: write d4/f5 [6479736,102442] 0 2024-02-19T19:07:26.571 INFO:tasks.workunit.client.1.smithi142.stdout:4/55: mkdir d4/dc/dd 0 2024-02-19T19:07:26.581 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:26 smithi046 podman[106004]: 2024-02-19 19:07:26.278435173 +0000 UTC m=+1.865884921 container died 5ffd1526df8c406ade75450a6327ab6b200233ece1981bc78a91a3f93581858d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1) 2024-02-19T19:07:26.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.719+0000 7fb7a604c700 1 -- 172.21.15.46:0/1014401061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb7a004f2a0 con 0x7fb7a0104130 2024-02-19T19:07:26.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.719+0000 7fb79cff9700 1 -- 172.21.15.46:0/1014401061 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1873 (secure 0 0 0) 0x7fb794059ae0 con 0x7fb7a0104130 2024-02-19T19:07:26.740 INFO:teuthology.orchestra.run.smithi046.stdout:e18 2024-02-19T19:07:26.740 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:07:26.740 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 18 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T19:07:04.634090+0000 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:07:26.741 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:07:26.742 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:07:26.743 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:07:26.743 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:26.743 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:07:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:07:26.743 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:07:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:07:26.743 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:26.743 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:26.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.721+0000 7fb7a604c700 1 -- 172.21.15.46:0/1014401061 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb78806d8a0 msgr2=0x7fb78806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:26.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.721+0000 7fb7a604c700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb78806d8a0 0x7fb78806fd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb790000c00 tx=0x7fb790010ed0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.721+0000 7fb7a604c700 1 -- 172.21.15.46:0/1014401061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7a0104130 msgr2=0x7fb7a0199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:26.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.721+0000 7fb7a604c700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7a0104130 0x7fb7a0199f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb794009a20 tx=0x7fb794009d30 comp rx=0 tx=0).stop 2024-02-19T19:07:26.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.721+0000 7fb7a604c700 1 -- 172.21.15.46:0/1014401061 shutdown_connections 2024-02-19T19:07:26.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.721+0000 7fb7a604c700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb78806d8a0 0x7fb78806fd50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.721+0000 7fb7a604c700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a00ffbd0 0x7fb7a0199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.721+0000 7fb7a604c700 1 --2- 172.21.15.46:0/1014401061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7a0104130 0x7fb7a0199f90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.721+0000 7fb7a604c700 1 -- 172.21.15.46:0/1014401061 >> 172.21.15.46:0/1014401061 conn(0x7fb7a0075130 msgr2=0x7fb7a00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:26.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.722+0000 7fb7a604c700 1 -- 172.21.15.46:0/1014401061 shutdown_connections 2024-02-19T19:07:26.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.722+0000 7fb7a604c700 1 -- 172.21.15.46:0/1014401061 wait complete. 2024-02-19T19:07:26.745 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-02-19T19:07:26.783 INFO:tasks.workunit.client.1.smithi142.stdout:3/14: dread f0 [0,4194304] 0 2024-02-19T19:07:26.804 INFO:tasks.workunit.client.1.smithi142.stdout:6/18: fsync f0 0 2024-02-19T19:07:26.804 INFO:tasks.workunit.client.1.smithi142.stdout:6/19: chown d2 10 1 2024-02-19T19:07:26.805 INFO:tasks.workunit.client.1.smithi142.stdout:6/20: symlink d2/l3 0 2024-02-19T19:07:26.805 INFO:tasks.workunit.client.1.smithi142.stdout:6/21: fsync f0 0 2024-02-19T19:07:26.814 INFO:tasks.workunit.client.1.smithi142.stdout:1/18: dwrite f4 [0,4194304] 0 2024-02-19T19:07:26.814 INFO:tasks.workunit.client.1.smithi142.stdout:5/25: dwrite f4 [0,4194304] 0 2024-02-19T19:07:26.814 INFO:tasks.workunit.client.1.smithi142.stdout:4/56: dwrite d4/fb [0,4194304] 0 2024-02-19T19:07:26.815 INFO:tasks.workunit.client.1.smithi142.stdout:9/18: dwrite f0 [0,4194304] 0 2024-02-19T19:07:26.816 INFO:tasks.workunit.client.1.smithi142.stdout:6/22: getdents d2 0 2024-02-19T19:07:26.816 INFO:tasks.workunit.client.1.smithi142.stdout:3/15: dwrite f0 [0,4194304] 0 2024-02-19T19:07:26.816 INFO:tasks.workunit.client.1.smithi142.stdout:6/23: readlink d2/l3 0 2024-02-19T19:07:26.823 INFO:tasks.workunit.client.1.smithi142.stdout:9/19: symlink l1 0 2024-02-19T19:07:26.825 INFO:tasks.workunit.client.1.smithi142.stdout:6/24: rename f0 to d2/f4 0 2024-02-19T19:07:26.829 INFO:tasks.workunit.client.1.smithi142.stdout:3/16: read f0 [3722886,40323] 0 2024-02-19T19:07:26.829 INFO:tasks.workunit.client.1.smithi142.stdout:3/17: chown f0 1208 1 2024-02-19T19:07:26.830 INFO:tasks.workunit.client.1.smithi142.stdout:3/18: read f0 [687090,1325] 0 2024-02-19T19:07:26.836 INFO:tasks.workunit.client.1.smithi142.stdout:4/57: dread d4/f5 [0,4194304] 0 2024-02-19T19:07:26.841 INFO:tasks.workunit.client.1.smithi142.stdout:3/19: dread f0 [0,4194304] 0 2024-02-19T19:07:26.841 INFO:tasks.workunit.client.1.smithi142.stdout:3/20: write f0 [4597811,25983] 0 2024-02-19T19:07:26.849 INFO:tasks.workunit.client.1.smithi142.stdout:4/58: write d4/fb [3906583,33029] 0 2024-02-19T19:07:26.854 INFO:tasks.workunit.client.1.smithi142.stdout:2/37: dwrite f0 [0,4194304] 0 2024-02-19T19:07:26.854 INFO:tasks.workunit.client.1.smithi142.stdout:1/19: dwrite f4 [4194304,4194304] 0 2024-02-19T19:07:26.855 INFO:tasks.workunit.client.1.smithi142.stdout:1/20: mkdir d5 0 2024-02-19T19:07:26.855 INFO:tasks.workunit.client.1.smithi142.stdout:1/21: chown d5 5193969 1 2024-02-19T19:07:26.855 INFO:tasks.workunit.client.1.smithi142.stdout:1/22: mknod d5/c6 0 2024-02-19T19:07:26.856 INFO:tasks.workunit.client.1.smithi142.stdout:1/23: mkdir d5/d7 0 2024-02-19T19:07:26.857 INFO:tasks.workunit.client.1.smithi142.stdout:2/38: dread d3/f8 [0,4194304] 0 2024-02-19T19:07:26.857 INFO:tasks.workunit.client.1.smithi142.stdout:2/39: getdents d3/db 0 2024-02-19T19:07:26.857 INFO:tasks.workunit.client.1.smithi142.stdout:1/24: creat d5/d7/f8 x:0 0 0 2024-02-19T19:07:26.857 INFO:tasks.workunit.client.1.smithi142.stdout:1/25: creat d5/d7/f9 x:0 0 0 2024-02-19T19:07:26.857 INFO:tasks.workunit.client.1.smithi142.stdout:1/26: write d5/d7/f8 [174012,4354] 0 2024-02-19T19:07:26.857 INFO:tasks.workunit.client.1.smithi142.stdout:1/27: dread - d5/d7/f9 zero size 2024-02-19T19:07:26.858 INFO:tasks.workunit.client.1.smithi142.stdout:5/26: dwrite f4 [0,4194304] 0 2024-02-19T19:07:26.858 INFO:tasks.workunit.client.1.smithi142.stdout:6/25: dwrite d2/f4 [0,4194304] 0 2024-02-19T19:07:26.858 INFO:tasks.workunit.client.1.smithi142.stdout:8/20: dwrite f2 [0,4194304] 0 2024-02-19T19:07:26.858 INFO:tasks.workunit.client.1.smithi142.stdout:8/21: readlink - no filename 2024-02-19T19:07:26.859 INFO:tasks.workunit.client.1.smithi142.stdout:9/20: dwrite f0 [0,4194304] 0 2024-02-19T19:07:26.865 INFO:tasks.workunit.client.1.smithi142.stdout:3/21: dread f0 [0,4194304] 0 2024-02-19T19:07:26.865 INFO:tasks.workunit.client.1.smithi142.stdout:3/22: chown f0 24 1 2024-02-19T19:07:26.865 INFO:tasks.workunit.client.1.smithi142.stdout:3/23: readlink - no filename 2024-02-19T19:07:26.866 INFO:tasks.workunit.client.1.smithi142.stdout:6/26: write d2/f4 [1360241,119910] 0 2024-02-19T19:07:26.866 INFO:tasks.workunit.client.1.smithi142.stdout:6/27: chown d2/l3 31872031 1 2024-02-19T19:07:26.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.855+0000 7f3ee9719700 1 -- 172.21.15.46:0/2975617568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ee40ff350 msgr2=0x7f3ee40ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:26.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.855+0000 7f3ee9719700 1 --2- 172.21.15.46:0/2975617568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ee40ff350 0x7f3ee40ff720 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009910 tx=0x7f3ed4009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:26.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.855+0000 7f3ee9719700 1 -- 172.21.15.46:0/2975617568 shutdown_connections 2024-02-19T19:07:26.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.855+0000 7f3ee9719700 1 --2- 172.21.15.46:0/2975617568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee40ffc60 0x7f3ee410a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.855+0000 7f3ee9719700 1 --2- 172.21.15.46:0/2975617568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ee40ff350 0x7f3ee40ff720 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.855+0000 7f3ee9719700 1 -- 172.21.15.46:0/2975617568 >> 172.21.15.46:0/2975617568 conn(0x7f3ee40748b0 msgr2=0x7f3ee4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:26.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.855+0000 7f3ee9719700 1 -- 172.21.15.46:0/2975617568 shutdown_connections 2024-02-19T19:07:26.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.855+0000 7f3ee9719700 1 -- 172.21.15.46:0/2975617568 wait complete. 2024-02-19T19:07:26.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.856+0000 7f3ee9719700 1 Processor -- start 2024-02-19T19:07:26.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.856+0000 7f3ee9719700 1 -- start start 2024-02-19T19:07:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.856+0000 7f3ee9719700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee40ff350 0x7f3ee41981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.856+0000 7f3ee9719700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ee40ffc60 0x7f3ee41986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.856+0000 7f3ee9719700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4198dc0 con 0x7f3ee40ffc60 2024-02-19T19:07:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.856+0000 7f3ee9719700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee419cb50 con 0x7f3ee40ff350 2024-02-19T19:07:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee27fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ee40ffc60 0x7f3ee41986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee27fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ee40ffc60 0x7f3ee41986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39926/0 (socket says 172.21.15.46:39926) 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee27fc700 1 -- 172.21.15.46:0/3477563472 learned_addr learned my addr 172.21.15.46:0/3477563472 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee2ffd700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee40ff350 0x7f3ee41981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee27fc700 1 -- 172.21.15.46:0/3477563472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee40ff350 msgr2=0x7f3ee41981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee27fc700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee40ff350 0x7f3ee41981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee27fc700 1 -- 172.21.15.46:0/3477563472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed40095f0 con 0x7f3ee40ffc60 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee2ffd700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee40ff350 0x7f3ee41981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee27fc700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ee40ffc60 0x7f3ee41986e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800b4b0 tx=0x7f3ed800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ecbfff700 1 -- 172.21.15.46:0/3477563472 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ed8011800 con 0x7f3ee40ffc60 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ecbfff700 1 -- 172.21.15.46:0/3477563472 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ed8011e20 con 0x7f3ee40ffc60 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee9719700 1 -- 172.21.15.46:0/3477563472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee419ce30 con 0x7f3ee40ffc60 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ecbfff700 1 -- 172.21.15.46:0/3477563472 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ed800f2e0 con 0x7f3ee40ffc60 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.857+0000 7f3ee9719700 1 -- 172.21.15.46:0/3477563472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee419d380 con 0x7f3ee40ffc60 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.858+0000 7f3ee9719700 1 -- 172.21.15.46:0/3477563472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee410a1d0 con 0x7f3ee40ffc60 2024-02-19T19:07:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.859+0000 7f3ecbfff700 1 -- 172.21.15.46:0/3477563472 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f3ed8010380 con 0x7f3ee40ffc60 2024-02-19T19:07:26.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.859+0000 7f3ecbfff700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3ecc06d8a0 0x7f3ecc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:26.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.859+0000 7f3ee2ffd700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3ecc06d8a0 0x7f3ecc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:26.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.859+0000 7f3ecbfff700 1 -- 172.21.15.46:0/3477563472 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3ed808d040 con 0x7f3ee40ffc60 2024-02-19T19:07:26.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.860+0000 7f3ee2ffd700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3ecc06d8a0 0x7f3ecc06fd50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40059d0 tx=0x7f3ed401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:26.886 INFO:tasks.workunit.client.1.smithi142.stdout:1/28: unlink l0 0 2024-02-19T19:07:26.886 INFO:tasks.workunit.client.1.smithi142.stdout:1/29: fdatasync f4 0 2024-02-19T19:07:26.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:26.866+0000 7f3ecbfff700 1 -- 172.21.15.46:0/3477563472 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3ed80568a0 con 0x7f3ee40ffc60 2024-02-19T19:07:26.887 INFO:tasks.workunit.client.1.smithi142.stdout:9/21: write f0 [2232380,48539] 0 2024-02-19T19:07:26.888 INFO:tasks.workunit.client.1.smithi142.stdout:5/27: link f4 d5/f7 0 2024-02-19T19:07:26.888 INFO:tasks.workunit.client.1.smithi142.stdout:2/40: dwrite d3/f5 [0,4194304] 0 2024-02-19T19:07:26.889 INFO:tasks.workunit.client.1.smithi142.stdout:9/22: fdatasync f0 0 2024-02-19T19:07:26.892 INFO:tasks.workunit.client.1.smithi142.stdout:4/59: truncate d4/f5 1943395 0 2024-02-19T19:07:26.895 INFO:tasks.workunit.client.1.smithi142.stdout:8/22: mknod c4 0 2024-02-19T19:07:26.895 INFO:tasks.workunit.client.1.smithi142.stdout:8/23: chown c3 5 1 2024-02-19T19:07:26.895 INFO:tasks.workunit.client.1.smithi142.stdout:8/24: read f1 [16514,117745] 0 2024-02-19T19:07:26.895 INFO:tasks.workunit.client.1.smithi142.stdout:3/24: creat f1 x:0 0 0 2024-02-19T19:07:26.897 INFO:tasks.workunit.client.1.smithi142.stdout:6/28: rename d2/l3 to d2/l5 0 2024-02-19T19:07:26.897 INFO:tasks.workunit.client.1.smithi142.stdout:9/23: dread f0 [0,4194304] 0 2024-02-19T19:07:26.898 INFO:tasks.workunit.client.1.smithi142.stdout:1/30: symlink d5/la 0 2024-02-19T19:07:26.901 INFO:tasks.workunit.client.1.smithi142.stdout:2/41: creat d3/db/fc x:0 0 0 2024-02-19T19:07:26.903 INFO:tasks.workunit.client.1.smithi142.stdout:2/42: dread d3/f8 [0,4194304] 0 2024-02-19T19:07:26.904 INFO:tasks.workunit.client.1.smithi142.stdout:3/25: mknod c2 0 2024-02-19T19:07:26.904 INFO:tasks.workunit.client.1.smithi142.stdout:5/28: dwrite f4 [0,4194304] 0 2024-02-19T19:07:26.904 INFO:tasks.workunit.client.1.smithi142.stdout:5/29: chown f4 39 1 2024-02-19T19:07:26.906 INFO:tasks.workunit.client.1.smithi142.stdout:9/24: mknod c2 0 2024-02-19T19:07:26.906 INFO:tasks.workunit.client.1.smithi142.stdout:9/25: write f0 [3248184,129892] 0 2024-02-19T19:07:26.908 INFO:tasks.workunit.client.1.smithi142.stdout:3/26: rename f0 to f3 0 2024-02-19T19:07:26.908 INFO:tasks.workunit.client.1.smithi142.stdout:3/27: write f1 [938392,109975] 0 2024-02-19T19:07:26.908 INFO:tasks.workunit.client.1.smithi142.stdout:3/28: write f3 [2815283,558] 0 2024-02-19T19:07:26.908 INFO:tasks.workunit.client.1.smithi142.stdout:3/29: chown f3 43 1 2024-02-19T19:07:26.909 INFO:tasks.workunit.client.1.smithi142.stdout:8/25: getdents . 0 2024-02-19T19:07:26.909 INFO:tasks.workunit.client.1.smithi142.stdout:8/26: write f0 [781762,41441] 0 2024-02-19T19:07:26.911 INFO:tasks.workunit.client.1.smithi142.stdout:5/30: mkdir d5/d6/d8 0 2024-02-19T19:07:26.911 INFO:tasks.workunit.client.1.smithi142.stdout:1/31: read f4 [5220166,2822] 0 2024-02-19T19:07:26.911 INFO:tasks.workunit.client.1.smithi142.stdout:6/29: fsync d2/f4 0 2024-02-19T19:07:26.912 INFO:tasks.workunit.client.1.smithi142.stdout:9/26: unlink f0 0 2024-02-19T19:07:26.912 INFO:tasks.workunit.client.1.smithi142.stdout:9/27: write - no filename 2024-02-19T19:07:26.912 INFO:tasks.workunit.client.1.smithi142.stdout:9/28: chown l1 23 1 2024-02-19T19:07:26.912 INFO:tasks.workunit.client.1.smithi142.stdout:9/29: chown l1 3 1 2024-02-19T19:07:26.912 INFO:tasks.workunit.client.1.smithi142.stdout:9/30: write - no filename 2024-02-19T19:07:26.912 INFO:tasks.workunit.client.1.smithi142.stdout:9/31: truncate - no filename 2024-02-19T19:07:26.912 INFO:tasks.workunit.client.1.smithi142.stdout:9/32: truncate - no filename 2024-02-19T19:07:26.913 INFO:tasks.workunit.client.1.smithi142.stdout:1/32: unlink d5/d7/f9 0 2024-02-19T19:07:26.913 INFO:tasks.workunit.client.1.smithi142.stdout:4/60: dread d4/f5 [0,4194304] 0 2024-02-19T19:07:26.913 INFO:tasks.workunit.client.1.smithi142.stdout:4/61: write d4/fb [2464294,8546] 0 2024-02-19T19:07:26.917 INFO:tasks.workunit.client.1.smithi142.stdout:9/33: unlink c2 0 2024-02-19T19:07:26.918 INFO:tasks.workunit.client.1.smithi142.stdout:1/33: mkdir d5/d7/db 0 2024-02-19T19:07:26.921 INFO:tasks.workunit.client.1.smithi142.stdout:9/34: symlink l3 0 2024-02-19T19:07:26.924 INFO:tasks.workunit.client.1.smithi142.stdout:1/34: rmdir d5/d7/db 0 2024-02-19T19:07:26.925 INFO:tasks.workunit.client.1.smithi142.stdout:9/35: rename l3 to l4 0 2024-02-19T19:07:26.925 INFO:tasks.workunit.client.1.smithi142.stdout:9/36: dwrite - no filename 2024-02-19T19:07:26.925 INFO:tasks.workunit.client.1.smithi142.stdout:5/31: write d5/f7 [2934207,44316] 0 2024-02-19T19:07:26.925 INFO:tasks.workunit.client.1.smithi142.stdout:9/37: creat f5 x:0 0 0 2024-02-19T19:07:26.925 INFO:tasks.workunit.client.1.smithi142.stdout:9/38: read - f5 zero size 2024-02-19T19:07:26.926 INFO:tasks.workunit.client.1.smithi142.stdout:9/39: creat f6 x:0 0 0 2024-02-19T19:07:26.926 INFO:tasks.workunit.client.1.smithi142.stdout:5/32: write f4 [4269187,76573] 0 2024-02-19T19:07:26.926 INFO:tasks.workunit.client.1.smithi142.stdout:1/35: link d5/d7/f8 d5/fc 0 2024-02-19T19:07:26.929 INFO:tasks.workunit.client.1.smithi142.stdout:9/40: mknod c7 0 2024-02-19T19:07:26.929 INFO:tasks.workunit.client.1.smithi142.stdout:5/33: mknod d5/d6/d8/c9 0 2024-02-19T19:07:26.930 INFO:tasks.workunit.client.1.smithi142.stdout:6/30: dread d2/f4 [0,4194304] 0 2024-02-19T19:07:26.931 INFO:tasks.workunit.client.1.smithi142.stdout:1/36: unlink d5/fc 0 2024-02-19T19:07:26.931 INFO:tasks.workunit.client.1.smithi142.stdout:1/37: chown d5/d7 3564 1 2024-02-19T19:07:26.931 INFO:tasks.workunit.client.1.smithi142.stdout:9/41: symlink l8 0 2024-02-19T19:07:26.932 INFO:tasks.workunit.client.1.smithi142.stdout:6/31: mknod d2/c6 0 2024-02-19T19:07:26.932 INFO:tasks.workunit.client.1.smithi142.stdout:6/32: truncate d2/f4 4481182 0 2024-02-19T19:07:26.933 INFO:tasks.workunit.client.1.smithi142.stdout:6/33: creat d2/f7 x:0 0 0 2024-02-19T19:07:26.933 INFO:tasks.workunit.client.1.smithi142.stdout:6/34: write d2/f4 [4061774,117007] 0 2024-02-19T19:07:26.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/35: mknod d2/c8 0 2024-02-19T19:07:26.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/36: chown d2/f4 210775905 1 2024-02-19T19:07:26.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/37: chown d2/f7 23552364 1 2024-02-19T19:07:26.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/38: creat d2/f9 x:0 0 0 2024-02-19T19:07:26.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/39: mknod d2/ca 0 2024-02-19T19:07:26.941 INFO:tasks.workunit.client.1.smithi142.stdout:2/43: dwrite d3/f5 [0,4194304] 0 2024-02-19T19:07:26.946 INFO:tasks.workunit.client.1.smithi142.stdout:1/38: dread f4 [0,4194304] 0 2024-02-19T19:07:26.953 INFO:tasks.workunit.client.1.smithi142.stdout:8/27: dwrite f1 [0,4194304] 0 2024-02-19T19:07:26.956 INFO:tasks.workunit.client.1.smithi142.stdout:8/28: mknod c5 0 2024-02-19T19:07:26.958 INFO:tasks.workunit.client.1.smithi142.stdout:1/39: dread f4 [4194304,4194304] 0 2024-02-19T19:07:26.960 INFO:tasks.workunit.client.1.smithi142.stdout:4/62: dwrite d4/f9 [0,4194304] 0 2024-02-19T19:07:26.960 INFO:tasks.workunit.client.1.smithi142.stdout:3/30: dwrite f3 [0,4194304] 0 2024-02-19T19:07:26.960 INFO:tasks.workunit.client.1.smithi142.stdout:3/31: creat f4 x:0 0 0 2024-02-19T19:07:26.960 INFO:tasks.workunit.client.1.smithi142.stdout:3/32: creat f5 x:0 0 0 2024-02-19T19:07:26.961 INFO:tasks.workunit.client.1.smithi142.stdout:2/44: dwrite d3/f8 [0,4194304] 0 2024-02-19T19:07:26.963 INFO:tasks.workunit.client.1.smithi142.stdout:1/40: dread d5/d7/f8 [0,4194304] 0 2024-02-19T19:07:26.964 INFO:tasks.workunit.client.1.smithi142.stdout:4/63: rename d4 to d4/de 22 2024-02-19T19:07:26.964 INFO:tasks.workunit.client.1.smithi142.stdout:4/64: fsync d4/f5 0 2024-02-19T19:07:26.968 INFO:tasks.workunit.client.1.smithi142.stdout:5/34: dread d5/f7 [0,4194304] 0 2024-02-19T19:07:26.969 INFO:tasks.workunit.client.1.smithi142.stdout:3/33: symlink l6 0 2024-02-19T19:07:26.970 INFO:tasks.workunit.client.1.smithi142.stdout:1/41: fsync d5/d7/f8 0 2024-02-19T19:07:26.970 INFO:tasks.workunit.client.1.smithi142.stdout:1/42: read f4 [4542145,62876] 0 2024-02-19T19:07:26.974 INFO:tasks.workunit.client.1.smithi142.stdout:2/45: dwrite d3/fa [0,4194304] 0 2024-02-19T19:07:26.974 INFO:tasks.workunit.client.1.smithi142.stdout:2/46: stat d3/fa 0 2024-02-19T19:07:26.975 INFO:tasks.workunit.client.1.smithi142.stdout:2/47: creat d3/fd x:0 0 0 2024-02-19T19:07:26.980 INFO:tasks.workunit.client.1.smithi142.stdout:4/65: getdents d4/dc 0 2024-02-19T19:07:26.980 INFO:tasks.workunit.client.1.smithi142.stdout:4/66: stat d4/dc/dd 0 2024-02-19T19:07:26.981 INFO:tasks.workunit.client.1.smithi142.stdout:6/40: fsync d2/f9 0 2024-02-19T19:07:26.982 INFO:tasks.workunit.client.1.smithi142.stdout:5/35: link d5/f7 d5/fa 0 2024-02-19T19:07:26.982 INFO:tasks.workunit.client.1.smithi142.stdout:3/34: dwrite f1 [0,4194304] 0 2024-02-19T19:07:26.983 INFO:tasks.workunit.client.1.smithi142.stdout:1/43: creat d5/fd x:0 0 0 2024-02-19T19:07:26.983 INFO:tasks.workunit.client.1.smithi142.stdout:1/44: creat d5/d7/fe x:0 0 0 2024-02-19T19:07:26.989 INFO:tasks.workunit.client.1.smithi142.stdout:4/67: rename c1 to d4/dc/cf 0 2024-02-19T19:07:26.989 INFO:tasks.workunit.client.1.smithi142.stdout:8/29: truncate f0 133590 0 2024-02-19T19:07:26.990 INFO:tasks.workunit.client.1.smithi142.stdout:1/45: write f4 [2845141,18470] 0 2024-02-19T19:07:26.990 INFO:tasks.workunit.client.1.smithi142.stdout:1/46: stat d5/d7/fe 0 2024-02-19T19:07:26.990 INFO:tasks.workunit.client.1.smithi142.stdout:1/47: chown d5/d7 22635 1 2024-02-19T19:07:26.990 INFO:tasks.workunit.client.1.smithi142.stdout:1/48: creat d5/ff x:0 0 0 2024-02-19T19:07:26.992 INFO:tasks.workunit.client.1.smithi142.stdout:2/48: getdents d3/db 0 2024-02-19T19:07:26.996 INFO:tasks.workunit.client.1.smithi142.stdout:1/49: symlink d5/d7/l10 0 2024-02-19T19:07:26.996 INFO:tasks.workunit.client.1.smithi142.stdout:1/50: creat d5/d7/f11 x:0 0 0 2024-02-19T19:07:26.996 INFO:tasks.workunit.client.1.smithi142.stdout:1/51: chown d5/la 61 1 2024-02-19T19:07:26.997 INFO:tasks.workunit.client.1.smithi142.stdout:2/49: rename d3/fd to d3/fe 0 2024-02-19T19:07:26.998 INFO:tasks.workunit.client.1.smithi142.stdout:5/36: truncate d5/fa 2165358 0 2024-02-19T19:07:26.998 INFO:tasks.workunit.client.1.smithi142.stdout:4/68: mkdir d4/dc/dd/d10 0 2024-02-19T19:07:27.000 INFO:tasks.workunit.client.1.smithi142.stdout:1/52: mknod d5/c12 0 2024-02-19T19:07:27.001 INFO:tasks.workunit.client.1.smithi142.stdout:2/50: mkdir d3/df 0 2024-02-19T19:07:27.002 INFO:tasks.workunit.client.1.smithi142.stdout:5/37: creat d5/d6/d8/fb x:0 0 0 2024-02-19T19:07:27.003 INFO:tasks.workunit.client.1.smithi142.stdout:4/69: truncate d4/f9 1850061 0 2024-02-19T19:07:27.004 INFO:tasks.workunit.client.1.smithi142.stdout:6/41: dwrite d2/f4 [0,4194304] 0 2024-02-19T19:07:27.004 INFO:tasks.workunit.client.1.smithi142.stdout:6/42: stat d2/ca 0 2024-02-19T19:07:27.005 INFO:tasks.workunit.client.1.smithi142.stdout:1/53: mknod d5/d7/c13 0 2024-02-19T19:07:27.005 INFO:tasks.workunit.client.1.smithi142.stdout:3/35: dwrite f4 [0,4194304] 0 2024-02-19T19:07:27.006 INFO:tasks.workunit.client.1.smithi142.stdout:5/38: getdents d5/d6 0 2024-02-19T19:07:27.006 INFO:tasks.workunit.client.1.smithi142.stdout:5/39: rename d5 to d5/dc 22 2024-02-19T19:07:27.008 INFO:tasks.workunit.client.1.smithi142.stdout:4/70: mknod d4/dc/dd/c11 0 2024-02-19T19:07:27.009 INFO:tasks.workunit.client.1.smithi142.stdout:6/43: rename d2/f4 to d2/fb 0 2024-02-19T19:07:27.009 INFO:tasks.workunit.client.1.smithi142.stdout:6/44: readlink d2/l5 0 2024-02-19T19:07:27.010 INFO:tasks.workunit.client.1.smithi142.stdout:6/45: creat d2/fc x:0 0 0 2024-02-19T19:07:27.010 INFO:tasks.workunit.client.1.smithi142.stdout:1/54: symlink d5/d7/l14 0 2024-02-19T19:07:27.015 INFO:tasks.workunit.client.1.smithi142.stdout:3/36: rename c2 to c7 0 2024-02-19T19:07:27.016 INFO:tasks.workunit.client.1.smithi142.stdout:8/30: write f0 [194498,84442] 0 2024-02-19T19:07:27.020 INFO:tasks.workunit.client.1.smithi142.stdout:6/46: symlink d2/ld 0 2024-02-19T19:07:27.021 INFO:tasks.workunit.client.1.smithi142.stdout:1/55: unlink c2 0 2024-02-19T19:07:27.022 INFO:tasks.workunit.client.1.smithi142.stdout:2/51: dwrite d3/f8 [0,4194304] 0 2024-02-19T19:07:27.025 INFO:tasks.workunit.client.1.smithi142.stdout:6/47: symlink d2/le 0 2024-02-19T19:07:27.026 INFO:tasks.workunit.client.1.smithi142.stdout:1/56: mknod d5/d7/c15 0 2024-02-19T19:07:27.026 INFO:tasks.workunit.client.1.smithi142.stdout:1/57: chown d5/d7/c13 9610478 1 2024-02-19T19:07:27.027 INFO:tasks.workunit.client.1.smithi142.stdout:8/31: read f2 [2702505,104570] 0 2024-02-19T19:07:27.027 INFO:tasks.workunit.client.1.smithi142.stdout:1/58: symlink d5/l16 0 2024-02-19T19:07:27.029 INFO:tasks.workunit.client.1.smithi142.stdout:8/32: symlink l6 0 2024-02-19T19:07:27.031 INFO:tasks.workunit.client.1.smithi142.stdout:5/40: rename d5/d6 to d5/dd 0 2024-02-19T19:07:27.033 INFO:tasks.workunit.client.1.smithi142.stdout:5/41: unlink d5/dd/d8/c9 0 2024-02-19T19:07:27.034 INFO:tasks.workunit.client.1.smithi142.stdout:5/42: creat d5/fe x:0 0 0 2024-02-19T19:07:27.036 INFO:tasks.workunit.client.1.smithi142.stdout:5/43: mkdir d5/dd/df 0 2024-02-19T19:07:27.036 INFO:tasks.workunit.client.1.smithi142.stdout:5/44: stat d5/fe 0 2024-02-19T19:07:27.036 INFO:tasks.workunit.client.1.smithi142.stdout:5/45: truncate d5/fe 885421 0 2024-02-19T19:07:27.036 INFO:tasks.workunit.client.1.smithi142.stdout:5/46: dread - d5/dd/d8/fb zero size 2024-02-19T19:07:27.037 INFO:tasks.workunit.client.1.smithi142.stdout:5/47: mknod d5/c10 0 2024-02-19T19:07:27.038 INFO:tasks.workunit.client.1.smithi142.stdout:2/52: dread f0 [0,4194304] 0 2024-02-19T19:07:27.038 INFO:tasks.workunit.client.1.smithi142.stdout:2/53: chown d3 568206508 1 2024-02-19T19:07:27.040 INFO:tasks.workunit.client.1.smithi142.stdout:8/33: write f1 [2141021,103403] 0 2024-02-19T19:07:27.044 INFO:tasks.workunit.client.1.smithi142.stdout:4/71: dwrite d4/f5 [0,4194304] 0 2024-02-19T19:07:27.044 INFO:tasks.workunit.client.1.smithi142.stdout:3/37: dwrite f3 [4194304,4194304] 0 2024-02-19T19:07:27.047 INFO:tasks.workunit.client.1.smithi142.stdout:3/38: rename c7 to c8 0 2024-02-19T19:07:27.047 INFO:tasks.workunit.client.1.smithi142.stdout:8/34: dread f2 [0,4194304] 0 2024-02-19T19:07:27.047 INFO:tasks.workunit.client.1.smithi142.stdout:8/35: readlink l6 0 2024-02-19T19:07:27.047 INFO:tasks.workunit.client.1.smithi142.stdout:4/72: mkdir d4/dc/d12 0 2024-02-19T19:07:27.048 INFO:tasks.workunit.client.1.smithi142.stdout:4/73: fdatasync d4/f5 0 2024-02-19T19:07:27.049 INFO:tasks.workunit.client.1.smithi142.stdout:3/39: link f5 f9 0 2024-02-19T19:07:27.049 INFO:tasks.workunit.client.1.smithi142.stdout:3/40: dread - f5 zero size 2024-02-19T19:07:27.049 INFO:tasks.workunit.client.1.smithi142.stdout:2/54: write d3/fa [1053829,28846] 0 2024-02-19T19:07:27.049 INFO:tasks.workunit.client.1.smithi142.stdout:8/36: creat f7 x:0 0 0 2024-02-19T19:07:27.050 INFO:tasks.workunit.client.1.smithi142.stdout:2/55: creat d3/df/f10 x:0 0 0 2024-02-19T19:07:27.052 INFO:tasks.workunit.client.1.smithi142.stdout:2/56: rename d3/l7 to d3/db/l11 0 2024-02-19T19:07:27.052 INFO:tasks.workunit.client.1.smithi142.stdout:2/57: creat d3/df/f12 x:0 0 0 2024-02-19T19:07:27.052 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:26 smithi046 ceph-mon[88928]: pgmap v67: 65 pgs: 65 active+clean; 106 MiB data, 578 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s wr, 11 op/s 2024-02-19T19:07:27.052 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:26 smithi046 ceph-mon[88928]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:07:27.052 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:26 smithi046 ceph-mon[88928]: osdmap e55: 6 total, 5 up, 6 in 2024-02-19T19:07:27.052 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:26 smithi046 ceph-mon[88928]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:27.052 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:26 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/413469818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:27.052 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:26 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1014401061' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:07:27.054 INFO:tasks.workunit.client.1.smithi142.stdout:2/58: mknod d3/df/c13 0 2024-02-19T19:07:27.054 INFO:tasks.workunit.client.1.smithi142.stdout:4/74: write d4/f9 [363810,73498] 0 2024-02-19T19:07:27.055 INFO:tasks.workunit.client.1.smithi142.stdout:2/59: link d3/df/f12 d3/df/f14 0 2024-02-19T19:07:27.057 INFO:tasks.workunit.client.1.smithi142.stdout:4/75: creat d4/dc/f13 x:0 0 0 2024-02-19T19:07:27.059 INFO:tasks.workunit.client.1.smithi142.stdout:4/76: mkdir d4/d14 0 2024-02-19T19:07:27.059 INFO:tasks.workunit.client.1.smithi142.stdout:4/77: truncate d4/dc/f13 233773 0 2024-02-19T19:07:27.059 INFO:tasks.workunit.client.1.smithi142.stdout:6/48: dwrite d2/f7 [0,4194304] 0 2024-02-19T19:07:27.059 INFO:tasks.workunit.client.1.smithi142.stdout:5/48: dwrite f4 [0,4194304] 0 2024-02-19T19:07:27.060 INFO:tasks.workunit.client.1.smithi142.stdout:1/59: dwrite d5/d7/f11 [0,4194304] 0 2024-02-19T19:07:27.060 INFO:tasks.workunit.client.1.smithi142.stdout:1/60: write d5/d7/fe [608197,41286] 0 2024-02-19T19:07:27.061 INFO:tasks.workunit.client.1.smithi142.stdout:8/37: fsync f1 0 2024-02-19T19:07:27.061 INFO:tasks.workunit.client.1.smithi142.stdout:8/38: write f2 [4050163,16870] 0 2024-02-19T19:07:27.061 INFO:tasks.workunit.client.1.smithi142.stdout:6/49: symlink d2/lf 0 2024-02-19T19:07:27.065 INFO:tasks.workunit.client.1.smithi142.stdout:1/61: link d5/c6 d5/d7/c17 0 2024-02-19T19:07:27.065 INFO:tasks.workunit.client.1.smithi142.stdout:1/62: chown d5/c12 2323240 1 2024-02-19T19:07:27.072 INFO:tasks.workunit.client.1.smithi142.stdout:6/50: symlink d2/l10 0 2024-02-19T19:07:27.073 INFO:tasks.workunit.client.1.smithi142.stdout:1/63: symlink d5/d7/l18 0 2024-02-19T19:07:27.074 INFO:tasks.workunit.client.1.smithi142.stdout:6/51: symlink d2/l11 0 2024-02-19T19:07:27.076 INFO:tasks.workunit.client.1.smithi142.stdout:6/52: rename d2/fb to d2/f12 0 2024-02-19T19:07:27.076 INFO:tasks.workunit.client.1.smithi142.stdout:6/53: truncate d2/f9 571854 0 2024-02-19T19:07:27.077 INFO:tasks.workunit.client.1.smithi142.stdout:6/54: mkdir d2/d13 0 2024-02-19T19:07:27.077 INFO:tasks.workunit.client.1.smithi142.stdout:6/55: creat d2/f14 x:0 0 0 2024-02-19T19:07:27.080 INFO:tasks.workunit.client.1.smithi142.stdout:3/41: unlink c8 0 2024-02-19T19:07:27.081 INFO:tasks.workunit.client.1.smithi142.stdout:6/56: truncate d2/f12 3533096 0 2024-02-19T19:07:27.082 INFO:tasks.workunit.client.1.smithi142.stdout:6/57: rmdir d2/d13 0 2024-02-19T19:07:27.088 INFO:tasks.workunit.client.1.smithi142.stdout:4/78: dwrite d4/dc/f13 [0,4194304] 0 2024-02-19T19:07:27.093 INFO:tasks.workunit.client.1.smithi142.stdout:3/42: dread f1 [0,4194304] 0 2024-02-19T19:07:27.096 INFO:tasks.workunit.client.1.smithi142.stdout:8/39: dwrite f1 [0,4194304] 0 2024-02-19T19:07:27.099 INFO:tasks.workunit.client.1.smithi142.stdout:3/43: unlink l6 0 2024-02-19T19:07:27.099 INFO:tasks.workunit.client.1.smithi142.stdout:3/44: fdatasync f5 0 2024-02-19T19:07:27.099 INFO:tasks.workunit.client.1.smithi142.stdout:3/45: write f5 [458281,127812] 0 2024-02-19T19:07:27.099 INFO:tasks.workunit.client.1.smithi142.stdout:3/46: chown f4 1390797021 1 2024-02-19T19:07:27.099 INFO:tasks.workunit.client.1.smithi142.stdout:3/47: creat fa x:0 0 0 2024-02-19T19:07:27.100 INFO:tasks.workunit.client.1.smithi142.stdout:3/48: rmdir - no directory 2024-02-19T19:07:27.100 INFO:tasks.workunit.client.1.smithi142.stdout:3/49: creat fb x:0 0 0 2024-02-19T19:07:27.100 INFO:tasks.workunit.client.1.smithi142.stdout:4/79: dread d4/f5 [0,4194304] 0 2024-02-19T19:07:27.100 INFO:tasks.workunit.client.1.smithi142.stdout:8/40: rename c4 to c8 0 2024-02-19T19:07:27.107 INFO:tasks.workunit.client.1.smithi142.stdout:1/64: dwrite d5/d7/f11 [0,4194304] 0 2024-02-19T19:07:27.107 INFO:tasks.workunit.client.1.smithi142.stdout:1/65: creat d5/d7/f19 x:0 0 0 2024-02-19T19:07:27.109 INFO:tasks.workunit.client.1.smithi142.stdout:4/80: dread d4/f5 [0,4194304] 0 2024-02-19T19:07:27.111 INFO:tasks.workunit.client.1.smithi142.stdout:3/50: write f4 [2479436,92030] 0 2024-02-19T19:07:27.111 INFO:tasks.workunit.client.1.smithi142.stdout:6/58: dwrite d2/f14 [0,4194304] 0 2024-02-19T19:07:27.111 INFO:tasks.workunit.client.1.smithi142.stdout:6/59: chown d2/fc 121576835 1 2024-02-19T19:07:27.111 INFO:tasks.workunit.client.1.smithi142.stdout:6/60: stat d2/f14 0 2024-02-19T19:07:27.111 INFO:tasks.workunit.client.1.smithi142.stdout:1/66: mkdir d5/d1a 0 2024-02-19T19:07:27.120 INFO:tasks.workunit.client.1.smithi142.stdout:6/61: dread d2/f7 [0,4194304] 0 2024-02-19T19:07:27.121 INFO:tasks.workunit.client.1.smithi142.stdout:6/62: symlink d2/l15 0 2024-02-19T19:07:27.123 INFO:tasks.workunit.client.1.smithi142.stdout:6/63: symlink d2/l16 0 2024-02-19T19:07:27.125 INFO:tasks.workunit.client.1.smithi142.stdout:4/81: truncate d4/f5 2019915 0 2024-02-19T19:07:27.126 INFO:tasks.workunit.client.1.smithi142.stdout:4/82: fdatasync d4/f5 0 2024-02-19T19:07:27.127 INFO:tasks.workunit.client.1.smithi142.stdout:4/83: symlink d4/d14/l15 0 2024-02-19T19:07:27.128 INFO:tasks.workunit.client.1.smithi142.stdout:4/84: unlink d4/fb 0 2024-02-19T19:07:27.130 INFO:tasks.workunit.client.1.smithi142.stdout:8/41: getdents . 0 2024-02-19T19:07:27.130 INFO:tasks.workunit.client.1.smithi142.stdout:8/42: chown f1 776 1 2024-02-19T19:07:27.132 INFO:tasks.workunit.client.1.smithi142.stdout:3/51: dwrite f1 [0,4194304] 0 2024-02-19T19:07:27.132 INFO:tasks.workunit.client.1.smithi142.stdout:3/52: creat fc x:0 0 0 2024-02-19T19:07:27.132 INFO:tasks.workunit.client.1.smithi142.stdout:1/67: dwrite d5/fd [0,4194304] 0 2024-02-19T19:07:27.133 INFO:tasks.workunit.client.1.smithi142.stdout:1/68: chown d5 10606343 1 2024-02-19T19:07:27.133 INFO:tasks.workunit.client.1.smithi142.stdout:1/69: chown d5/d7/c17 62107710 1 2024-02-19T19:07:27.133 INFO:tasks.workunit.client.1.smithi142.stdout:1/70: readlink d5/la 0 2024-02-19T19:07:27.133 INFO:tasks.workunit.client.1.smithi142.stdout:0/25: sync 2024-02-19T19:07:27.133 INFO:tasks.workunit.client.1.smithi142.stdout:7/36: sync 2024-02-19T19:07:27.140 INFO:tasks.workunit.client.1.smithi142.stdout:1/71: link d5/c12 d5/c1b 0 2024-02-19T19:07:27.140 INFO:tasks.workunit.client.1.smithi142.stdout:1/72: chown d5/d7 1540087 1 2024-02-19T19:07:27.141 INFO:tasks.workunit.client.1.smithi142.stdout:1/73: getdents d5/d1a 0 2024-02-19T19:07:27.142 INFO:tasks.workunit.client.1.smithi142.stdout:3/53: write f3 [5463069,45552] 0 2024-02-19T19:07:27.142 INFO:tasks.workunit.client.1.smithi142.stdout:0/26: link l7 lc 0 2024-02-19T19:07:27.143 INFO:tasks.workunit.client.1.smithi142.stdout:0/27: fsync fb 0 2024-02-19T19:07:27.143 INFO:tasks.workunit.client.1.smithi142.stdout:0/28: write f3 [670696,2865] 0 2024-02-19T19:07:27.143 INFO:tasks.workunit.client.1.smithi142.stdout:0/29: write f8 [545802,44105] 0 2024-02-19T19:07:27.145 INFO:tasks.workunit.client.1.smithi142.stdout:1/74: mkdir d5/d1c 0 2024-02-19T19:07:27.147 INFO:tasks.workunit.client.1.smithi142.stdout:3/54: mknod cd 0 2024-02-19T19:07:27.147 INFO:tasks.workunit.client.1.smithi142.stdout:8/43: dwrite f2 [0,4194304] 0 2024-02-19T19:07:27.148 INFO:tasks.workunit.client.1.smithi142.stdout:8/44: rmdir - no directory 2024-02-19T19:07:27.149 INFO:tasks.workunit.client.1.smithi142.stdout:9/42: sync 2024-02-19T19:07:27.150 INFO:tasks.workunit.client.1.smithi142.stdout:9/43: write f5 [230147,121733] 0 2024-02-19T19:07:27.150 INFO:tasks.workunit.client.1.smithi142.stdout:9/44: dread - f6 zero size 2024-02-19T19:07:27.150 INFO:tasks.workunit.client.1.smithi142.stdout:9/45: dread - f6 zero size 2024-02-19T19:07:27.150 INFO:tasks.workunit.client.1.smithi142.stdout:9/46: creat f9 x:0 0 0 2024-02-19T19:07:27.161 INFO:tasks.workunit.client.1.smithi142.stdout:7/37: dread d0/fd [0,4194304] 0 2024-02-19T19:07:27.161 INFO:tasks.workunit.client.1.smithi142.stdout:8/45: dread f1 [0,4194304] 0 2024-02-19T19:07:27.162 INFO:tasks.workunit.client.1.smithi142.stdout:7/38: truncate d0/fc 284085 0 2024-02-19T19:07:27.164 INFO:tasks.workunit.client.1.smithi142.stdout:8/46: mkdir d9 0 2024-02-19T19:07:27.172 INFO:tasks.workunit.client.1.smithi142.stdout:8/47: dread f2 [0,4194304] 0 2024-02-19T19:07:27.174 INFO:tasks.workunit.client.1.smithi142.stdout:7/39: write d0/fd [3479635,130152] 0 2024-02-19T19:07:27.175 INFO:tasks.workunit.client.1.smithi142.stdout:7/40: creat d0/f10 x:0 0 0 2024-02-19T19:07:27.175 INFO:tasks.workunit.client.1.smithi142.stdout:7/41: truncate d0/ff 1041186 0 2024-02-19T19:07:27.176 INFO:tasks.workunit.client.1.smithi142.stdout:0/30: dwrite f8 [0,4194304] 0 2024-02-19T19:07:27.177 INFO:tasks.workunit.client.1.smithi142.stdout:7/42: symlink d0/l11 0 2024-02-19T19:07:27.178 INFO:tasks.workunit.client.1.smithi142.stdout:0/31: mknod cd 0 2024-02-19T19:07:27.179 INFO:tasks.workunit.client.1.smithi142.stdout:7/43: write d0/fa [984556,21509] 0 2024-02-19T19:07:27.181 INFO:tasks.workunit.client.1.smithi142.stdout:7/44: creat d0/f12 x:0 0 0 2024-02-19T19:07:27.183 INFO:tasks.workunit.client.1.smithi142.stdout:1/75: dwrite d5/d7/f8 [0,4194304] 0 2024-02-19T19:07:27.183 INFO:tasks.workunit.client.1.smithi142.stdout:7/45: mkdir d0/d13 0 2024-02-19T19:07:27.187 INFO:tasks.workunit.client.1.smithi142.stdout:1/76: rename d5/d1c to d5/d1d 0 2024-02-19T19:07:27.187 INFO:tasks.workunit.client.1.smithi142.stdout:1/77: stat f4 0 2024-02-19T19:07:27.187 INFO:tasks.workunit.client.1.smithi142.stdout:1/78: write d5/d7/fe [1649063,70389] 0 2024-02-19T19:07:27.187 INFO:tasks.workunit.client.1.smithi142.stdout:1/79: readlink d5/d7/l18 0 2024-02-19T19:07:27.188 INFO:tasks.workunit.client.1.smithi142.stdout:3/55: dwrite f4 [0,4194304] 0 2024-02-19T19:07:27.188 INFO:tasks.workunit.client.1.smithi142.stdout:3/56: stat fa 0 2024-02-19T19:07:27.190 INFO:tasks.workunit.client.1.smithi142.stdout:8/48: dwrite f0 [0,4194304] 0 2024-02-19T19:07:27.191 INFO:tasks.workunit.client.1.smithi142.stdout:1/80: rename d5/l16 to d5/d1a/l1e 0 2024-02-19T19:07:27.193 INFO:tasks.workunit.client.1.smithi142.stdout:3/57: link cd ce 0 2024-02-19T19:07:27.193 INFO:tasks.workunit.client.1.smithi142.stdout:3/58: readlink - no filename 2024-02-19T19:07:27.197 INFO:tasks.workunit.client.1.smithi142.stdout:8/49: symlink d9/la 0 2024-02-19T19:07:27.197 INFO:tasks.workunit.client.1.smithi142.stdout:7/46: dread d0/f9 [0,4194304] 0 2024-02-19T19:07:27.199 INFO:tasks.workunit.client.1.smithi142.stdout:1/81: unlink d5/d7/f8 0 2024-02-19T19:07:27.199 INFO:tasks.workunit.client.1.smithi142.stdout:1/82: write d5/ff [56604,28780] 0 2024-02-19T19:07:27.201 INFO:tasks.workunit.client.1.smithi142.stdout:3/59: unlink cd 0 2024-02-19T19:07:27.201 INFO:tasks.workunit.client.1.smithi142.stdout:3/60: write fb [1007074,89358] 0 2024-02-19T19:07:27.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:26 smithi142 ceph-mon[69118]: pgmap v67: 65 pgs: 65 active+clean; 106 MiB data, 578 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s wr, 11 op/s 2024-02-19T19:07:27.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:26 smithi142 ceph-mon[69118]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:07:27.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:26 smithi142 ceph-mon[69118]: osdmap e55: 6 total, 5 up, 6 in 2024-02-19T19:07:27.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:26 smithi142 ceph-mon[69118]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:27.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:26 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/413469818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:27.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:26 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1014401061' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:07:27.202 INFO:tasks.workunit.client.1.smithi142.stdout:8/50: mknod d9/cb 0 2024-02-19T19:07:27.202 INFO:tasks.workunit.client.1.smithi142.stdout:8/51: readlink d9/la 0 2024-02-19T19:07:27.206 INFO:tasks.workunit.client.1.smithi142.stdout:9/47: dwrite f5 [0,4194304] 0 2024-02-19T19:07:27.206 INFO:tasks.workunit.client.1.smithi142.stdout:9/48: fsync f9 0 2024-02-19T19:07:27.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.189+0000 7f3ee9719700 1 -- 172.21.15.46:0/3477563472 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ee419d600 con 0x7f3ecc06d8a0 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.190+0000 7f3ecbfff700 1 -- 172.21.15.46:0/3477563472 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3ee419d600 con 0x7f3ecc06d8a0 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:07:27.211 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "7/23 daemons upgraded", 2024-02-19T19:07:27.212 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:07:27.212 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:07:27.212 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:07:27.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 -- 172.21.15.46:0/3477563472 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3ecc06d8a0 msgr2=0x7f3ecc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:27.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3ecc06d8a0 0x7f3ecc06fd50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3ed40059d0 tx=0x7f3ed401a040 comp rx=0 tx=0).stop 2024-02-19T19:07:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 -- 172.21.15.46:0/3477563472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ee40ffc60 msgr2=0x7f3ee41986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ee40ffc60 0x7f3ee41986e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800b4b0 tx=0x7f3ed800b870 comp rx=0 tx=0).stop 2024-02-19T19:07:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 -- 172.21.15.46:0/3477563472 shutdown_connections 2024-02-19T19:07:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3ecc06d8a0 0x7f3ecc06fd50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ee40ff350 0x7f3ee41981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 --2- 172.21.15.46:0/3477563472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ee40ffc60 0x7f3ee41986e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 -- 172.21.15.46:0/3477563472 >> 172.21.15.46:0/3477563472 conn(0x7f3ee40748b0 msgr2=0x7f3ee4107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 -- 172.21.15.46:0/3477563472 shutdown_connections 2024-02-19T19:07:27.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.193+0000 7f3ee9719700 1 -- 172.21.15.46:0/3477563472 wait complete. 2024-02-19T19:07:27.243 INFO:tasks.workunit.client.1.smithi142.stdout:7/47: mknod d0/d13/c14 0 2024-02-19T19:07:27.243 INFO:tasks.workunit.client.1.smithi142.stdout:7/48: dread - d0/f10 zero size 2024-02-19T19:07:27.243 INFO:tasks.workunit.client.1.smithi142.stdout:0/32: getdents . 0 2024-02-19T19:07:27.244 INFO:tasks.workunit.client.1.smithi142.stdout:1/83: truncate d5/d7/f11 792847 0 2024-02-19T19:07:27.244 INFO:tasks.workunit.client.1.smithi142.stdout:1/84: readlink d5/d7/l18 0 2024-02-19T19:07:27.244 INFO:tasks.workunit.client.1.smithi142.stdout:1/85: chown d5/d1a 117386526 1 2024-02-19T19:07:27.244 INFO:tasks.workunit.client.1.smithi142.stdout:0/33: write f3 [217450,11867] 0 2024-02-19T19:07:27.245 INFO:tasks.workunit.client.1.smithi142.stdout:3/61: symlink lf 0 2024-02-19T19:07:27.245 INFO:tasks.workunit.client.1.smithi142.stdout:3/62: truncate fa 798171 0 2024-02-19T19:07:27.253 INFO:tasks.workunit.client.1.smithi142.stdout:0/34: dread fb [0,4194304] 0 2024-02-19T19:07:27.260 INFO:tasks.workunit.client.1.smithi142.stdout:9/49: mknod ca 0 2024-02-19T19:07:27.260 INFO:tasks.workunit.client.1.smithi142.stdout:9/50: write f9 [293505,54729] 0 2024-02-19T19:07:27.260 INFO:tasks.workunit.client.1.smithi142.stdout:9/51: write f6 [165385,112046] 0 2024-02-19T19:07:27.265 INFO:tasks.workunit.client.1.smithi142.stdout:0/35: dwrite f3 [0,4194304] 0 2024-02-19T19:07:27.270 INFO:tasks.workunit.client.1.smithi142.stdout:8/52: getdents d9 0 2024-02-19T19:07:27.273 INFO:tasks.workunit.client.1.smithi142.stdout:0/36: dread fb [0,4194304] 0 2024-02-19T19:07:27.278 INFO:tasks.workunit.client.1.smithi142.stdout:7/49: rename d0/ff to d0/d13/f15 0 2024-02-19T19:07:27.279 INFO:tasks.workunit.client.1.smithi142.stdout:1/86: truncate f4 7329115 0 2024-02-19T19:07:27.282 INFO:tasks.workunit.client.1.smithi142.stdout:3/63: truncate f1 2568332 0 2024-02-19T19:07:27.285 INFO:tasks.workunit.client.1.smithi142.stdout:9/52: mkdir db 0 2024-02-19T19:07:27.285 INFO:tasks.workunit.client.1.smithi142.stdout:9/53: write f6 [999629,96071] 0 2024-02-19T19:07:27.285 INFO:tasks.workunit.client.1.smithi142.stdout:9/54: write f9 [997287,41422] 0 2024-02-19T19:07:27.285 INFO:tasks.workunit.client.1.smithi142.stdout:8/53: dwrite f1 [0,4194304] 0 2024-02-19T19:07:27.287 INFO:tasks.workunit.client.1.smithi142.stdout:9/55: fdatasync f6 0 2024-02-19T19:07:27.290 INFO:tasks.workunit.client.1.smithi142.stdout:0/37: rename lc to le 0 2024-02-19T19:07:27.292 INFO:tasks.workunit.client.1.smithi142.stdout:7/50: creat d0/f16 x:0 0 0 2024-02-19T19:07:27.292 INFO:tasks.workunit.client.1.smithi142.stdout:3/64: write f5 [651627,50738] 0 2024-02-19T19:07:27.299 INFO:tasks.workunit.client.1.smithi142.stdout:1/87: write f4 [5186616,107187] 0 2024-02-19T19:07:27.299 INFO:tasks.workunit.client.1.smithi142.stdout:1/88: chown l3 9508037 1 2024-02-19T19:07:27.299 INFO:tasks.workunit.client.1.smithi142.stdout:8/54: creat d9/fc x:0 0 0 2024-02-19T19:07:27.299 INFO:tasks.workunit.client.1.smithi142.stdout:1/89: truncate d5/d7/f19 60907 0 2024-02-19T19:07:27.300 INFO:tasks.workunit.client.1.smithi142.stdout:0/38: write f5 [4145356,129795] 0 2024-02-19T19:07:27.300 INFO:tasks.workunit.client.1.smithi142.stdout:0/39: chown ca 790 1 2024-02-19T19:07:27.300 INFO:tasks.workunit.client.1.smithi142.stdout:0/40: rmdir - no directory 2024-02-19T19:07:27.300 INFO:tasks.workunit.client.1.smithi142.stdout:5/49: sync 2024-02-19T19:07:27.300 INFO:tasks.workunit.client.1.smithi142.stdout:2/60: sync 2024-02-19T19:07:27.301 INFO:tasks.workunit.client.1.smithi142.stdout:2/61: readlink d3/l9 0 2024-02-19T19:07:27.301 INFO:tasks.workunit.client.1.smithi142.stdout:9/56: mknod db/cc 0 2024-02-19T19:07:27.303 INFO:tasks.workunit.client.1.smithi142.stdout:1/90: rmdir d5/d1d 0 2024-02-19T19:07:27.303 INFO:tasks.workunit.client.1.smithi142.stdout:1/91: creat d5/f1f x:0 0 0 2024-02-19T19:07:27.305 INFO:tasks.workunit.client.1.smithi142.stdout:2/62: creat d3/db/f15 x:0 0 0 2024-02-19T19:07:27.306 INFO:tasks.workunit.client.1.smithi142.stdout:9/57: mkdir db/dd 0 2024-02-19T19:07:27.312 INFO:tasks.workunit.client.1.smithi142.stdout:1/92: symlink d5/d1a/l20 0 2024-02-19T19:07:27.313 INFO:tasks.workunit.client.1.smithi142.stdout:9/58: rmdir db 39 2024-02-19T19:07:27.317 INFO:tasks.workunit.client.1.smithi142.stdout:8/55: write f0 [939028,127649] 0 2024-02-19T19:07:27.317 INFO:tasks.workunit.client.1.smithi142.stdout:8/56: truncate d9/fc 233861 0 2024-02-19T19:07:27.317 INFO:tasks.workunit.client.1.smithi142.stdout:8/57: read f0 [1141380,111719] 0 2024-02-19T19:07:27.317 INFO:tasks.workunit.client.1.smithi142.stdout:8/58: write f0 [2113238,76283] 0 2024-02-19T19:07:27.317 INFO:tasks.workunit.client.1.smithi142.stdout:1/93: mkdir d5/d21 0 2024-02-19T19:07:27.318 INFO:tasks.workunit.client.1.smithi142.stdout:9/59: rmdir db 39 2024-02-19T19:07:27.318 INFO:tasks.workunit.client.1.smithi142.stdout:9/60: chown db 953 1 2024-02-19T19:07:27.318 INFO:tasks.workunit.client.1.smithi142.stdout:0/41: dread f3 [0,4194304] 0 2024-02-19T19:07:27.318 INFO:tasks.workunit.client.1.smithi142.stdout:0/42: rmdir - no directory 2024-02-19T19:07:27.320 INFO:tasks.workunit.client.1.smithi142.stdout:8/59: mkdir d9/dd 0 2024-02-19T19:07:27.321 INFO:tasks.workunit.client.1.smithi142.stdout:9/61: link c7 db/dd/ce 0 2024-02-19T19:07:27.322 INFO:tasks.workunit.client.1.smithi142.stdout:8/60: mkdir d9/dd/de 0 2024-02-19T19:07:27.322 INFO:tasks.workunit.client.1.smithi142.stdout:8/61: creat d9/ff x:0 0 0 2024-02-19T19:07:27.323 INFO:tasks.workunit.client.1.smithi142.stdout:6/64: sync 2024-02-19T19:07:27.324 INFO:tasks.workunit.client.1.smithi142.stdout:7/51: dwrite d0/f9 [0,4194304] 0 2024-02-19T19:07:27.324 INFO:tasks.workunit.client.1.smithi142.stdout:6/65: truncate d2/f14 1092756 0 2024-02-19T19:07:27.325 INFO:tasks.workunit.client.1.smithi142.stdout:6/66: fdatasync d2/fc 0 2024-02-19T19:07:27.325 INFO:tasks.workunit.client.1.smithi142.stdout:0/43: write f3 [646071,88934] 0 2024-02-19T19:07:27.334 INFO:tasks.workunit.client.1.smithi142.stdout:6/67: write d2/f7 [1446301,106054] 0 2024-02-19T19:07:27.334 INFO:tasks.workunit.client.1.smithi142.stdout:5/50: dwrite d5/fe [0,4194304] 0 2024-02-19T19:07:27.334 INFO:tasks.workunit.client.1.smithi142.stdout:3/65: dwrite f5 [0,4194304] 0 2024-02-19T19:07:27.334 INFO:tasks.workunit.client.1.smithi142.stdout:2/63: dwrite d3/db/fc [0,4194304] 0 2024-02-19T19:07:27.335 INFO:tasks.workunit.client.1.smithi142.stdout:0/44: fsync fb 0 2024-02-19T19:07:27.337 INFO:tasks.workunit.client.1.smithi142.stdout:7/52: read d0/fd [1905966,55042] 0 2024-02-19T19:07:27.339 INFO:tasks.workunit.client.1.smithi142.stdout:6/68: mkdir d2/d17 0 2024-02-19T19:07:27.342 INFO:tasks.workunit.client.1.smithi142.stdout:2/64: dread f0 [0,4194304] 0 2024-02-19T19:07:27.342 INFO:tasks.workunit.client.1.smithi142.stdout:2/65: write d3/f8 [4844513,72855] 0 2024-02-19T19:07:27.344 INFO:tasks.workunit.client.1.smithi142.stdout:5/51: write d5/fe [3002958,58159] 0 2024-02-19T19:07:27.344 INFO:tasks.workunit.client.1.smithi142.stdout:0/45: rename f8 to ff 0 2024-02-19T19:07:27.349 INFO:tasks.workunit.client.1.smithi142.stdout:3/66: unlink fc 0 2024-02-19T19:07:27.350 INFO:tasks.workunit.client.1.smithi142.stdout:9/62: dwrite f9 [0,4194304] 0 2024-02-19T19:07:27.350 INFO:tasks.workunit.client.1.smithi142.stdout:5/52: unlink d5/f7 0 2024-02-19T19:07:27.351 INFO:tasks.workunit.client.1.smithi142.stdout:7/53: symlink d0/l17 0 2024-02-19T19:07:27.354 INFO:tasks.workunit.client.1.smithi142.stdout:8/62: fsync d9/ff 0 2024-02-19T19:07:27.355 INFO:tasks.workunit.client.1.smithi142.stdout:3/67: creat f10 x:0 0 0 2024-02-19T19:07:27.357 INFO:tasks.workunit.client.1.smithi142.stdout:1/94: truncate f4 1633948 0 2024-02-19T19:07:27.357 INFO:tasks.workunit.client.1.smithi142.stdout:2/66: dwrite d3/fe [0,4194304] 0 2024-02-19T19:07:27.357 INFO:tasks.workunit.client.1.smithi142.stdout:2/67: creat d3/f16 x:0 0 0 2024-02-19T19:07:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.337+0000 7f431a7fc700 1 -- 172.21.15.46:0/1458193560 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f431000baf0 con 0x7f431c0ffc60 2024-02-19T19:07:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.337+0000 7f4321d5c700 1 -- 172.21.15.46:0/1458193560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c0ffc60 msgr2=0x7f431c10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.337+0000 7f4321d5c700 1 --2- 172.21.15.46:0/1458193560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c0ffc60 0x7f431c10a6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4310009910 tx=0x7f4310009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.337+0000 7f4321d5c700 1 -- 172.21.15.46:0/1458193560 shutdown_connections 2024-02-19T19:07:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.337+0000 7f4321d5c700 1 --2- 172.21.15.46:0/1458193560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c0ffc60 0x7f431c10a6d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.337+0000 7f4321d5c700 1 --2- 172.21.15.46:0/1458193560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f431c0ff350 0x7f431c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.337+0000 7f4321d5c700 1 -- 172.21.15.46:0/1458193560 >> 172.21.15.46:0/1458193560 conn(0x7f431c0748b0 msgr2=0x7f431c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.337+0000 7f4321d5c700 1 -- 172.21.15.46:0/1458193560 shutdown_connections 2024-02-19T19:07:27.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.338+0000 7f4321d5c700 1 -- 172.21.15.46:0/1458193560 wait complete. 2024-02-19T19:07:27.359 INFO:tasks.workunit.client.1.smithi142.stdout:9/63: mknod db/dd/cf 0 2024-02-19T19:07:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.338+0000 7f4321d5c700 1 Processor -- start 2024-02-19T19:07:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.338+0000 7f4321d5c700 1 -- start start 2024-02-19T19:07:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.339+0000 7f4321d5c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c0ff350 0x7f431c195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.339+0000 7f4321d5c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f431c0ffc60 0x7f431c1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.339+0000 7f4321d5c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431c196ad0 con 0x7f431c0ff350 2024-02-19T19:07:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.339+0000 7f4321d5c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431c19a860 con 0x7f431c0ffc60 2024-02-19T19:07:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.339+0000 7f431b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c0ff350 0x7f431c195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.339+0000 7f431b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c0ff350 0x7f431c195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39936/0 (socket says 172.21.15.46:39936) 2024-02-19T19:07:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.339+0000 7f431b7fe700 1 -- 172.21.15.46:0/317930673 learned_addr learned my addr 172.21.15.46:0/317930673 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:27.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.339+0000 7f431b7fe700 1 -- 172.21.15.46:0/317930673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f431c0ffc60 msgr2=0x7f431c1963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.339+0000 7f431b7fe700 1 --2- 172.21.15.46:0/317930673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f431c0ffc60 0x7f431c1963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.339+0000 7f431b7fe700 1 -- 172.21.15.46:0/317930673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43100095f0 con 0x7f431c0ff350 2024-02-19T19:07:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.340+0000 7f431b7fe700 1 --2- 172.21.15.46:0/317930673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c0ff350 0x7f431c195eb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f430c00e8f0 tx=0x7f430c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.340+0000 7f4318ff9700 1 -- 172.21.15.46:0/317930673 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430c009790 con 0x7f431c0ff350 2024-02-19T19:07:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.340+0000 7f4318ff9700 1 -- 172.21.15.46:0/317930673 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f430c0044e0 con 0x7f431c0ff350 2024-02-19T19:07:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.340+0000 7f4321d5c700 1 -- 172.21.15.46:0/317930673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431c19ab40 con 0x7f431c0ff350 2024-02-19T19:07:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.340+0000 7f4321d5c700 1 -- 172.21.15.46:0/317930673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431c19b090 con 0x7f431c0ff350 2024-02-19T19:07:27.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.340+0000 7f4318ff9700 1 -- 172.21.15.46:0/317930673 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f430c003e00 con 0x7f431c0ff350 2024-02-19T19:07:27.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.341+0000 7f4321d5c700 1 -- 172.21.15.46:0/317930673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4308005320 con 0x7f431c0ff350 2024-02-19T19:07:27.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.342+0000 7f4318ff9700 1 -- 172.21.15.46:0/317930673 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f430c00cba0 con 0x7f431c0ff350 2024-02-19T19:07:27.363 INFO:tasks.workunit.client.1.smithi142.stdout:7/54: mknod d0/d13/c18 0 2024-02-19T19:07:27.364 INFO:tasks.workunit.client.1.smithi142.stdout:8/63: symlink d9/l10 0 2024-02-19T19:07:27.364 INFO:tasks.workunit.client.1.smithi142.stdout:8/64: chown c8 113 1 2024-02-19T19:07:27.364 INFO:tasks.workunit.client.1.smithi142.stdout:3/68: write f3 [4367503,116885] 0 2024-02-19T19:07:27.364 INFO:tasks.workunit.client.1.smithi142.stdout:3/69: rmdir - no directory 2024-02-19T19:07:27.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.343+0000 7f4318ff9700 1 --2- 172.21.15.46:0/317930673 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f430406d8a0 0x7f430406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:27.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.343+0000 7f4318ff9700 1 -- 172.21.15.46:0/317930673 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f430c014070 con 0x7f431c0ff350 2024-02-19T19:07:27.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.344+0000 7f431affd700 1 --2- 172.21.15.46:0/317930673 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f430406d8a0 0x7f430406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:27.366 INFO:tasks.workunit.client.1.smithi142.stdout:6/69: truncate d2/f7 1559499 0 2024-02-19T19:07:27.366 INFO:tasks.workunit.client.1.smithi142.stdout:6/70: truncate d2/fc 373039 0 2024-02-19T19:07:27.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.345+0000 7f431affd700 1 --2- 172.21.15.46:0/317930673 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f430406d8a0 0x7f430406fd50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4310009fd0 tx=0x7f4310000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:27.367 INFO:tasks.workunit.client.1.smithi142.stdout:1/95: symlink d5/l22 0 2024-02-19T19:07:27.367 INFO:tasks.workunit.client.1.smithi142.stdout:1/96: fdatasync f4 0 2024-02-19T19:07:27.367 INFO:tasks.workunit.client.1.smithi142.stdout:6/71: write d2/f9 [176398,3050] 0 2024-02-19T19:07:27.367 INFO:tasks.workunit.client.1.smithi142.stdout:6/72: chown d2/f9 8190 1 2024-02-19T19:07:27.368 INFO:tasks.workunit.client.1.smithi142.stdout:9/64: read f9 [1566779,54705] 0 2024-02-19T19:07:27.371 INFO:tasks.workunit.client.1.smithi142.stdout:2/68: unlink d3/db/l11 0 2024-02-19T19:07:27.372 INFO:tasks.workunit.client.1.smithi142.stdout:0/46: dwrite f3 [0,4194304] 0 2024-02-19T19:07:27.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.352+0000 7f4318ff9700 1 -- 172.21.15.46:0/317930673 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f430c056fa0 con 0x7f431c0ff350 2024-02-19T19:07:27.374 INFO:tasks.workunit.client.1.smithi142.stdout:7/55: truncate d0/fa 124522 0 2024-02-19T19:07:27.375 INFO:tasks.workunit.client.1.smithi142.stdout:8/65: link d9/cb d9/c11 0 2024-02-19T19:07:27.376 INFO:tasks.workunit.client.1.smithi142.stdout:8/66: stat d9/ff 0 2024-02-19T19:07:27.376 INFO:tasks.workunit.client.1.smithi142.stdout:8/67: chown c3 498 1 2024-02-19T19:07:27.378 INFO:tasks.workunit.client.1.smithi142.stdout:4/85: sync 2024-02-19T19:07:27.378 INFO:tasks.workunit.client.1.smithi142.stdout:1/97: write f4 [1398071,77115] 0 2024-02-19T19:07:27.381 INFO:tasks.workunit.client.1.smithi142.stdout:4/86: dread d4/f9 [0,4194304] 0 2024-02-19T19:07:27.382 INFO:tasks.workunit.client.1.smithi142.stdout:1/98: dread d5/d7/fe [0,4194304] 0 2024-02-19T19:07:27.383 INFO:tasks.workunit.client.1.smithi142.stdout:9/65: stat db/dd/ce 0 2024-02-19T19:07:27.384 INFO:tasks.workunit.client.1.smithi142.stdout:2/69: link f0 d3/f17 0 2024-02-19T19:07:27.386 INFO:tasks.workunit.client.1.smithi142.stdout:0/47: rename ff to f10 0 2024-02-19T19:07:27.386 INFO:tasks.workunit.client.1.smithi142.stdout:9/66: dread f6 [0,4194304] 0 2024-02-19T19:07:27.387 INFO:tasks.workunit.client.1.smithi142.stdout:7/56: creat d0/f19 x:0 0 0 2024-02-19T19:07:27.388 INFO:tasks.workunit.client.1.smithi142.stdout:3/70: symlink l11 0 2024-02-19T19:07:27.390 INFO:tasks.workunit.client.1.smithi142.stdout:4/87: creat d4/d14/f16 x:0 0 0 2024-02-19T19:07:27.390 INFO:tasks.workunit.client.1.smithi142.stdout:4/88: stat d4/dc/d12 0 2024-02-19T19:07:27.392 INFO:tasks.workunit.client.1.smithi142.stdout:1/99: mkdir d5/d7/d23 0 2024-02-19T19:07:27.392 INFO:tasks.workunit.client.1.smithi142.stdout:1/100: readlink d5/d7/l10 0 2024-02-19T19:07:27.392 INFO:tasks.workunit.client.1.smithi142.stdout:1/101: dread - d5/f1f zero size 2024-02-19T19:07:27.392 INFO:tasks.workunit.client.1.smithi142.stdout:8/68: dwrite f0 [0,4194304] 0 2024-02-19T19:07:27.393 INFO:tasks.workunit.client.1.smithi142.stdout:9/67: dread f9 [0,4194304] 0 2024-02-19T19:07:27.395 INFO:tasks.workunit.client.1.smithi142.stdout:7/57: dread d0/fd [0,4194304] 0 2024-02-19T19:07:27.395 INFO:tasks.workunit.client.1.smithi142.stdout:6/73: unlink d2/f7 0 2024-02-19T19:07:27.395 INFO:tasks.workunit.client.1.smithi142.stdout:6/74: readlink d2/l15 0 2024-02-19T19:07:27.397 INFO:tasks.workunit.client.1.smithi142.stdout:3/71: creat f12 x:0 0 0 2024-02-19T19:07:27.399 INFO:tasks.workunit.client.1.smithi142.stdout:4/89: symlink d4/dc/d12/l17 0 2024-02-19T19:07:27.402 INFO:tasks.workunit.client.1.smithi142.stdout:8/69: unlink d9/ff 0 2024-02-19T19:07:27.402 INFO:tasks.workunit.client.1.smithi142.stdout:8/70: fdatasync f0 0 2024-02-19T19:07:27.403 INFO:tasks.workunit.client.1.smithi142.stdout:9/68: truncate f9 2550936 0 2024-02-19T19:07:27.404 INFO:tasks.workunit.client.1.smithi142.stdout:7/58: getdents d0/d13 0 2024-02-19T19:07:27.411 INFO:tasks.workunit.client.1.smithi142.stdout:4/90: rename d4/f9 to d4/dc/d12/f18 0 2024-02-19T19:07:27.412 INFO:tasks.workunit.client.1.smithi142.stdout:7/59: symlink d0/d13/l1a 0 2024-02-19T19:07:27.413 INFO:tasks.workunit.client.1.smithi142.stdout:3/72: write f1 [1694267,96341] 0 2024-02-19T19:07:27.413 INFO:tasks.workunit.client.1.smithi142.stdout:8/71: write f1 [2010640,21761] 0 2024-02-19T19:07:27.413 INFO:tasks.workunit.client.1.smithi142.stdout:8/72: dread - f7 zero size 2024-02-19T19:07:27.414 INFO:tasks.workunit.client.1.smithi142.stdout:1/102: dwrite d5/fd [0,4194304] 0 2024-02-19T19:07:27.414 INFO:tasks.workunit.client.1.smithi142.stdout:0/48: rename f10 to f11 0 2024-02-19T19:07:27.414 INFO:tasks.workunit.client.1.smithi142.stdout:0/49: fdatasync fb 0 2024-02-19T19:07:27.415 INFO:tasks.workunit.client.1.smithi142.stdout:7/60: truncate d0/f9 4082567 0 2024-02-19T19:07:27.417 INFO:tasks.workunit.client.1.smithi142.stdout:8/73: symlink d9/dd/l12 0 2024-02-19T19:07:27.417 INFO:tasks.workunit.client.1.smithi142.stdout:8/74: chown c8 1871850 1 2024-02-19T19:07:27.417 INFO:tasks.workunit.client.1.smithi142.stdout:8/75: creat d9/f13 x:0 0 0 2024-02-19T19:07:27.419 INFO:tasks.workunit.client.1.smithi142.stdout:0/50: creat f12 x:0 0 0 2024-02-19T19:07:27.419 INFO:tasks.workunit.client.1.smithi142.stdout:0/51: creat f13 x:0 0 0 2024-02-19T19:07:27.422 INFO:tasks.workunit.client.1.smithi142.stdout:6/75: rmdir d2 39 2024-02-19T19:07:27.423 INFO:tasks.workunit.client.1.smithi142.stdout:1/103: getdents d5 0 2024-02-19T19:07:27.426 INFO:tasks.workunit.client.1.smithi142.stdout:7/61: mkdir d0/d1b 0 2024-02-19T19:07:27.427 INFO:tasks.workunit.client.1.smithi142.stdout:8/76: dread f2 [0,4194304] 0 2024-02-19T19:07:27.429 INFO:tasks.workunit.client.1.smithi142.stdout:1/104: dread d5/ff [0,4194304] 0 2024-02-19T19:07:27.431 INFO:tasks.workunit.client.1.smithi142.stdout:8/77: mkdir d9/dd/de/d14 0 2024-02-19T19:07:27.431 INFO:tasks.workunit.client.1.smithi142.stdout:8/78: fdatasync f7 0 2024-02-19T19:07:27.431 INFO:tasks.workunit.client.1.smithi142.stdout:9/69: write f9 [1993031,124233] 0 2024-02-19T19:07:27.431 INFO:tasks.workunit.client.1.smithi142.stdout:9/70: fsync f6 0 2024-02-19T19:07:27.432 INFO:tasks.workunit.client.1.smithi142.stdout:9/71: readlink l1 0 2024-02-19T19:07:27.434 INFO:tasks.workunit.client.1.smithi142.stdout:9/72: truncate f5 1301941 0 2024-02-19T19:07:27.436 INFO:tasks.workunit.client.1.smithi142.stdout:4/91: dwrite d4/dc/f13 [0,4194304] 0 2024-02-19T19:07:27.436 INFO:tasks.workunit.client.1.smithi142.stdout:6/76: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:27.436 INFO:tasks.workunit.client.1.smithi142.stdout:3/73: dwrite f3 [4194304,4194304] 0 2024-02-19T19:07:27.437 INFO:tasks.workunit.client.1.smithi142.stdout:9/73: rename db/dd to db/d10 0 2024-02-19T19:07:27.438 INFO:tasks.workunit.client.1.smithi142.stdout:4/92: symlink d4/d14/l19 0 2024-02-19T19:07:27.440 INFO:tasks.workunit.client.1.smithi142.stdout:6/77: creat d2/f18 x:0 0 0 2024-02-19T19:07:27.440 INFO:tasks.workunit.client.1.smithi142.stdout:6/78: fdatasync d2/f12 0 2024-02-19T19:07:27.440 INFO:tasks.workunit.client.1.smithi142.stdout:6/79: fdatasync d2/f12 0 2024-02-19T19:07:27.440 INFO:tasks.workunit.client.1.smithi142.stdout:6/80: write d2/f18 [318249,16226] 0 2024-02-19T19:07:27.440 INFO:tasks.workunit.client.1.smithi142.stdout:6/81: truncate d2/f18 1083038 0 2024-02-19T19:07:27.441 INFO:tasks.workunit.client.1.smithi142.stdout:3/74: creat f13 x:0 0 0 2024-02-19T19:07:27.443 INFO:tasks.workunit.client.1.smithi142.stdout:9/74: rename db/cc to db/c11 0 2024-02-19T19:07:27.444 INFO:tasks.workunit.client.1.smithi142.stdout:4/93: creat d4/dc/dd/f1a x:0 0 0 2024-02-19T19:07:27.444 INFO:tasks.workunit.client.1.smithi142.stdout:3/75: creat f14 x:0 0 0 2024-02-19T19:07:27.445 INFO:tasks.workunit.client.1.smithi142.stdout:6/82: dread d2/f14 [0,4194304] 0 2024-02-19T19:07:27.446 INFO:tasks.workunit.client.1.smithi142.stdout:4/94: mknod d4/dc/dd/d10/c1b 0 2024-02-19T19:07:27.446 INFO:tasks.workunit.client.1.smithi142.stdout:6/83: write d2/f14 [993224,111495] 0 2024-02-19T19:07:27.446 INFO:tasks.workunit.client.1.smithi142.stdout:6/84: write d2/f12 [3818140,41832] 0 2024-02-19T19:07:27.446 INFO:tasks.workunit.client.1.smithi142.stdout:6/85: read d2/f9 [165372,77101] 0 2024-02-19T19:07:27.446 INFO:tasks.workunit.client.1.smithi142.stdout:6/86: truncate d2/fc 1136236 0 2024-02-19T19:07:27.448 INFO:tasks.workunit.client.1.smithi142.stdout:3/76: rename f3 to f15 0 2024-02-19T19:07:27.448 INFO:tasks.workunit.client.1.smithi142.stdout:4/95: dread d4/dc/d12/f18 [0,4194304] 0 2024-02-19T19:07:27.448 INFO:tasks.workunit.client.1.smithi142.stdout:4/96: write d4/d14/f16 [250197,116752] 0 2024-02-19T19:07:27.448 INFO:tasks.workunit.client.1.smithi142.stdout:4/97: write d4/dc/f13 [4888008,79706] 0 2024-02-19T19:07:27.449 INFO:tasks.workunit.client.1.smithi142.stdout:3/77: truncate fa 1080296 0 2024-02-19T19:07:27.450 INFO:tasks.workunit.client.1.smithi142.stdout:1/105: dwrite d5/d7/f19 [0,4194304] 0 2024-02-19T19:07:27.450 INFO:tasks.workunit.client.1.smithi142.stdout:0/52: dwrite f5 [0,4194304] 0 2024-02-19T19:07:27.450 INFO:tasks.workunit.client.1.smithi142.stdout:0/53: chown l4 10889 1 2024-02-19T19:07:27.450 INFO:tasks.workunit.client.1.smithi142.stdout:0/54: truncate f13 494332 0 2024-02-19T19:07:27.451 INFO:tasks.workunit.client.1.smithi142.stdout:1/106: read d5/d7/fe [885030,117945] 0 2024-02-19T19:07:27.455 INFO:tasks.workunit.client.1.smithi142.stdout:4/98: mkdir d4/d1c 0 2024-02-19T19:07:27.456 INFO:tasks.workunit.client.1.smithi142.stdout:8/79: rmdir d9 39 2024-02-19T19:07:27.457 INFO:tasks.workunit.client.1.smithi142.stdout:3/78: symlink l16 0 2024-02-19T19:07:27.459 INFO:tasks.workunit.client.1.smithi142.stdout:1/107: mkdir d5/d1a/d24 0 2024-02-19T19:07:27.459 INFO:tasks.workunit.client.1.smithi142.stdout:1/108: creat d5/d7/f25 x:0 0 0 2024-02-19T19:07:27.460 INFO:tasks.workunit.client.1.smithi142.stdout:4/99: dread d4/d14/f16 [0,4194304] 0 2024-02-19T19:07:27.463 INFO:tasks.workunit.client.1.smithi142.stdout:8/80: write f2 [3802263,89862] 0 2024-02-19T19:07:27.464 INFO:tasks.workunit.client.1.smithi142.stdout:0/55: dread f3 [0,4194304] 0 2024-02-19T19:07:27.464 INFO:tasks.workunit.client.1.smithi142.stdout:4/100: dread d4/dc/d12/f18 [0,4194304] 0 2024-02-19T19:07:27.464 INFO:tasks.workunit.client.1.smithi142.stdout:4/101: truncate d4/d14/f16 678586 0 2024-02-19T19:07:27.464 INFO:tasks.workunit.client.1.smithi142.stdout:8/81: rmdir d9/dd/de 39 2024-02-19T19:07:27.465 INFO:tasks.workunit.client.1.smithi142.stdout:9/75: unlink db/c11 0 2024-02-19T19:07:27.466 INFO:tasks.workunit.client.1.smithi142.stdout:3/79: dread fb [0,4194304] 0 2024-02-19T19:07:27.466 INFO:tasks.workunit.client.1.smithi142.stdout:0/56: link c9 c14 0 2024-02-19T19:07:27.469 INFO:tasks.workunit.client.1.smithi142.stdout:8/82: mkdir d9/dd/d15 0 2024-02-19T19:07:27.469 INFO:tasks.workunit.client.1.smithi142.stdout:8/83: write d9/f13 [623481,108102] 0 2024-02-19T19:07:27.469 INFO:tasks.workunit.client.1.smithi142.stdout:8/84: readlink d9/l10 0 2024-02-19T19:07:27.471 INFO:tasks.workunit.client.1.smithi142.stdout:0/57: rename f12 to f15 0 2024-02-19T19:07:27.473 INFO:tasks.workunit.client.1.smithi142.stdout:4/102: truncate d4/dc/f13 996296 0 2024-02-19T19:07:27.476 INFO:tasks.workunit.client.1.smithi142.stdout:8/85: symlink d9/dd/de/d14/l16 0 2024-02-19T19:07:27.476 INFO:tasks.workunit.client.1.smithi142.stdout:8/86: fdatasync f2 0 2024-02-19T19:07:27.476 INFO:tasks.workunit.client.1.smithi142.stdout:8/87: fsync f1 0 2024-02-19T19:07:27.476 INFO:tasks.workunit.client.1.smithi142.stdout:8/88: stat d9/dd/d15 0 2024-02-19T19:07:27.476 INFO:tasks.workunit.client.1.smithi142.stdout:8/89: chown d9 22020 1 2024-02-19T19:07:27.476 INFO:tasks.workunit.client.1.smithi142.stdout:8/90: stat d9/dd/de/d14 0 2024-02-19T19:07:27.476 INFO:tasks.workunit.client.1.smithi142.stdout:8/91: write d9/fc [758782,87664] 0 2024-02-19T19:07:27.478 INFO:tasks.workunit.client.1.smithi142.stdout:8/92: creat d9/dd/f17 x:0 0 0 2024-02-19T19:07:27.479 INFO:tasks.workunit.client.1.smithi142.stdout:8/93: write d9/dd/f17 [915943,12003] 0 2024-02-19T19:07:27.479 INFO:tasks.workunit.client.1.smithi142.stdout:8/94: chown d9/l10 236 1 2024-02-19T19:07:27.479 INFO:tasks.workunit.client.1.smithi142.stdout:1/109: dwrite d5/fd [4194304,4194304] 0 2024-02-19T19:07:27.479 INFO:tasks.workunit.client.1.smithi142.stdout:1/110: chown d5/c6 1172706 1 2024-02-19T19:07:27.480 INFO:tasks.workunit.client.1.smithi142.stdout:4/103: mkdir d4/d1d 0 2024-02-19T19:07:27.480 INFO:tasks.workunit.client.1.smithi142.stdout:4/104: truncate d4/dc/dd/f1a 215667 0 2024-02-19T19:07:27.481 INFO:tasks.workunit.client.1.smithi142.stdout:0/58: write f5 [786816,62884] 0 2024-02-19T19:07:27.481 INFO:tasks.workunit.client.1.smithi142.stdout:0/59: write f13 [1173971,79624] 0 2024-02-19T19:07:27.481 INFO:tasks.workunit.client.1.smithi142.stdout:0/60: creat f16 x:0 0 0 2024-02-19T19:07:27.481 INFO:tasks.workunit.client.1.smithi142.stdout:0/61: rmdir - no directory 2024-02-19T19:07:27.481 INFO:tasks.workunit.client.1.smithi142.stdout:0/62: creat f17 x:0 0 0 2024-02-19T19:07:27.481 INFO:tasks.workunit.client.1.smithi142.stdout:0/63: creat f18 x:0 0 0 2024-02-19T19:07:27.481 INFO:tasks.workunit.client.1.smithi142.stdout:8/95: mkdir d9/dd/d18 0 2024-02-19T19:07:27.482 INFO:tasks.workunit.client.1.smithi142.stdout:8/96: fdatasync d9/dd/f17 0 2024-02-19T19:07:27.484 INFO:tasks.workunit.client.1.smithi142.stdout:3/80: getdents . 0 2024-02-19T19:07:27.490 INFO:tasks.workunit.client.1.smithi142.stdout:1/111: creat d5/d1a/d24/f26 x:0 0 0 2024-02-19T19:07:27.490 INFO:tasks.workunit.client.1.smithi142.stdout:1/112: dread - d5/d7/f25 zero size 2024-02-19T19:07:27.492 INFO:tasks.workunit.client.1.smithi142.stdout:4/105: unlink d4/dc/dd/c11 0 2024-02-19T19:07:27.493 INFO:tasks.workunit.client.1.smithi142.stdout:1/113: write d5/d7/f11 [80068,37885] 0 2024-02-19T19:07:27.496 INFO:tasks.workunit.client.1.smithi142.stdout:0/64: mkdir d19 0 2024-02-19T19:07:27.496 INFO:tasks.workunit.client.1.smithi142.stdout:0/65: truncate f15 177621 0 2024-02-19T19:07:27.497 INFO:tasks.workunit.client.1.smithi142.stdout:1/114: symlink d5/l27 0 2024-02-19T19:07:27.500 INFO:tasks.workunit.client.1.smithi142.stdout:2/70: sync 2024-02-19T19:07:27.501 INFO:tasks.workunit.client.1.smithi142.stdout:5/53: sync 2024-02-19T19:07:27.502 INFO:tasks.workunit.client.1.smithi142.stdout:2/71: symlink d3/l18 0 2024-02-19T19:07:27.503 INFO:tasks.workunit.client.1.smithi142.stdout:5/54: symlink d5/dd/df/l11 0 2024-02-19T19:07:27.512 INFO:tasks.workunit.client.1.smithi142.stdout:5/55: dread d5/fe [0,4194304] 0 2024-02-19T19:07:27.512 INFO:tasks.workunit.client.1.smithi142.stdout:5/56: fdatasync d5/fe 0 2024-02-19T19:07:27.512 INFO:tasks.workunit.client.1.smithi142.stdout:5/57: stat d5/dd/d8 0 2024-02-19T19:07:27.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/58: creat d5/dd/df/f12 x:0 0 0 2024-02-19T19:07:27.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/59: creat d5/f13 x:0 0 0 2024-02-19T19:07:27.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/60: chown d5/dd/df/f12 524595721 1 2024-02-19T19:07:27.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/61: write d5/f13 [697032,94471] 0 2024-02-19T19:07:27.525 INFO:tasks.workunit.client.1.smithi142.stdout:3/81: dwrite fa [0,4194304] 0 2024-02-19T19:07:27.527 INFO:tasks.workunit.client.1.smithi142.stdout:3/82: rename l16 to l17 0 2024-02-19T19:07:27.530 INFO:tasks.workunit.client.1.smithi142.stdout:5/62: write f4 [2575756,37737] 0 2024-02-19T19:07:27.533 INFO:tasks.workunit.client.1.smithi142.stdout:4/106: dwrite d4/dc/dd/f1a [0,4194304] 0 2024-02-19T19:07:27.533 INFO:tasks.workunit.client.1.smithi142.stdout:0/66: dwrite f11 [0,4194304] 0 2024-02-19T19:07:27.533 INFO:tasks.workunit.client.1.smithi142.stdout:2/72: dwrite d3/db/fc [4194304,4194304] 0 2024-02-19T19:07:27.535 INFO:tasks.workunit.client.1.smithi142.stdout:3/83: dread f15 [0,4194304] 0 2024-02-19T19:07:27.535 INFO:tasks.workunit.client.1.smithi142.stdout:3/84: readlink l11 0 2024-02-19T19:07:27.535 INFO:tasks.workunit.client.1.smithi142.stdout:3/85: fdatasync f9 0 2024-02-19T19:07:27.535 INFO:tasks.workunit.client.1.smithi142.stdout:3/86: chown f14 809 1 2024-02-19T19:07:27.535 INFO:tasks.workunit.client.1.smithi142.stdout:3/87: chown l11 31455 1 2024-02-19T19:07:27.535 INFO:tasks.workunit.client.1.smithi142.stdout:8/97: dwrite d9/f13 [0,4194304] 0 2024-02-19T19:07:27.537 INFO:tasks.workunit.client.1.smithi142.stdout:4/107: dread d4/dc/f13 [0,4194304] 0 2024-02-19T19:07:27.542 INFO:tasks.workunit.client.1.smithi142.stdout:5/63: dread d5/fa [0,4194304] 0 2024-02-19T19:07:27.542 INFO:tasks.workunit.client.1.smithi142.stdout:5/64: dread - d5/dd/df/f12 zero size 2024-02-19T19:07:27.542 INFO:tasks.workunit.client.1.smithi142.stdout:5/65: write d5/fe [822634,3157] 0 2024-02-19T19:07:27.558 INFO:tasks.workunit.client.1.smithi142.stdout:4/108: dread d4/d14/f16 [0,4194304] 0 2024-02-19T19:07:27.560 INFO:tasks.workunit.client.1.smithi142.stdout:0/67: rmdir d19 0 2024-02-19T19:07:27.560 INFO:tasks.workunit.client.1.smithi142.stdout:0/68: read f15 [150222,63322] 0 2024-02-19T19:07:27.560 INFO:tasks.workunit.client.1.smithi142.stdout:0/69: chown le 3 1 2024-02-19T19:07:27.562 INFO:tasks.workunit.client.1.smithi142.stdout:2/73: truncate d3/f5 567743 0 2024-02-19T19:07:27.571 INFO:tasks.workunit.client.1.smithi142.stdout:3/88: creat f18 x:0 0 0 2024-02-19T19:07:27.571 INFO:tasks.workunit.client.1.smithi142.stdout:8/98: truncate d9/dd/f17 600082 0 2024-02-19T19:07:27.573 INFO:tasks.workunit.client.1.smithi142.stdout:5/66: rename d5/fa to d5/dd/df/f14 0 2024-02-19T19:07:27.575 INFO:tasks.workunit.client.1.smithi142.stdout:4/109: readlink d4/l6 0 2024-02-19T19:07:27.576 INFO:tasks.workunit.client.1.smithi142.stdout:0/70: rename f5 to f1a 0 2024-02-19T19:07:27.577 INFO:tasks.workunit.client.1.smithi142.stdout:2/74: symlink d3/df/l19 0 2024-02-19T19:07:27.577 INFO:tasks.workunit.client.1.smithi142.stdout:3/89: write f5 [965703,74914] 0 2024-02-19T19:07:27.577 INFO:tasks.workunit.client.1.smithi142.stdout:3/90: dread - f14 zero size 2024-02-19T19:07:27.579 INFO:tasks.workunit.client.1.smithi142.stdout:8/99: symlink d9/dd/d15/l19 0 2024-02-19T19:07:27.580 INFO:tasks.workunit.client.1.smithi142.stdout:5/67: mkdir d5/dd/df/d15 0 2024-02-19T19:07:27.580 INFO:tasks.workunit.client.1.smithi142.stdout:3/91: dread fb [0,4194304] 0 2024-02-19T19:07:27.581 INFO:tasks.workunit.client.1.smithi142.stdout:4/110: truncate d4/dc/d12/f18 1282812 0 2024-02-19T19:07:27.582 INFO:tasks.workunit.client.1.smithi142.stdout:2/75: mknod d3/df/c1a 0 2024-02-19T19:07:27.583 INFO:tasks.workunit.client.1.smithi142.stdout:5/68: mknod d5/dd/d8/c16 0 2024-02-19T19:07:27.586 INFO:tasks.workunit.client.1.smithi142.stdout:4/111: mkdir d4/dc/d1e 0 2024-02-19T19:07:27.586 INFO:tasks.workunit.client.1.smithi142.stdout:4/112: chown d4/dc/f13 1 1 2024-02-19T19:07:27.586 INFO:tasks.workunit.client.1.smithi142.stdout:4/113: stat d4/d1d 0 2024-02-19T19:07:27.586 INFO:tasks.workunit.client.1.smithi142.stdout:7/62: sync 2024-02-19T19:07:27.586 INFO:tasks.workunit.client.1.smithi142.stdout:7/63: chown d0/d1b 2506656 1 2024-02-19T19:07:27.587 INFO:tasks.workunit.client.1.smithi142.stdout:4/114: creat d4/dc/dd/d10/f1f x:0 0 0 2024-02-19T19:07:27.587 INFO:tasks.workunit.client.1.smithi142.stdout:7/64: readlink d0/le 0 2024-02-19T19:07:27.592 INFO:tasks.workunit.client.1.smithi142.stdout:5/69: dread f4 [0,4194304] 0 2024-02-19T19:07:27.592 INFO:tasks.workunit.client.1.smithi142.stdout:6/87: sync 2024-02-19T19:07:27.592 INFO:tasks.workunit.client.1.smithi142.stdout:6/88: truncate d2/f9 1495128 0 2024-02-19T19:07:27.594 INFO:tasks.workunit.client.1.smithi142.stdout:6/89: creat d2/d17/f19 x:0 0 0 2024-02-19T19:07:27.594 INFO:tasks.workunit.client.1.smithi142.stdout:6/90: read d2/f9 [419312,111152] 0 2024-02-19T19:07:27.597 INFO:tasks.workunit.client.1.smithi142.stdout:6/91: rename d2/fc to d2/d17/f1a 0 2024-02-19T19:07:27.597 INFO:tasks.workunit.client.1.smithi142.stdout:2/76: read d3/fe [580453,104234] 0 2024-02-19T19:07:27.597 INFO:tasks.workunit.client.1.smithi142.stdout:0/71: dwrite f18 [0,4194304] 0 2024-02-19T19:07:27.597 INFO:tasks.workunit.client.1.smithi142.stdout:0/72: fdatasync f3 0 2024-02-19T19:07:27.598 INFO:tasks.workunit.client.1.smithi142.stdout:0/73: creat f1b x:0 0 0 2024-02-19T19:07:27.601 INFO:tasks.workunit.client.1.smithi142.stdout:0/74: mknod c1c 0 2024-02-19T19:07:27.601 INFO:tasks.workunit.client.1.smithi142.stdout:0/75: creat f1d x:0 0 0 2024-02-19T19:07:27.602 INFO:tasks.workunit.client.1.smithi142.stdout:0/76: readlink le 0 2024-02-19T19:07:27.603 INFO:tasks.workunit.client.1.smithi142.stdout:3/92: truncate f9 2403885 0 2024-02-19T19:07:27.604 INFO:tasks.workunit.client.1.smithi142.stdout:0/77: symlink l1e 0 2024-02-19T19:07:27.604 INFO:tasks.workunit.client.1.smithi142.stdout:0/78: chown f15 437544 1 2024-02-19T19:07:27.604 INFO:tasks.workunit.client.1.smithi142.stdout:2/77: dread d3/f5 [0,4194304] 0 2024-02-19T19:07:27.605 INFO:tasks.workunit.client.1.smithi142.stdout:2/78: mknod d3/df/c1b 0 2024-02-19T19:07:27.605 INFO:tasks.workunit.client.1.smithi142.stdout:2/79: creat d3/f1c x:0 0 0 2024-02-19T19:07:27.606 INFO:tasks.workunit.client.1.smithi142.stdout:2/80: dread - d3/df/f14 zero size 2024-02-19T19:07:27.606 INFO:tasks.workunit.client.1.smithi142.stdout:2/81: read - d3/f16 zero size 2024-02-19T19:07:27.613 INFO:tasks.workunit.client.1.smithi142.stdout:0/79: dread f3 [0,4194304] 0 2024-02-19T19:07:27.614 INFO:tasks.workunit.client.1.smithi142.stdout:0/80: mknod c1f 0 2024-02-19T19:07:27.614 INFO:tasks.workunit.client.1.smithi142.stdout:0/81: fsync f3 0 2024-02-19T19:07:27.618 INFO:tasks.workunit.client.1.smithi142.stdout:2/82: dread d3/f17 [0,4194304] 0 2024-02-19T19:07:27.618 INFO:tasks.workunit.client.1.smithi142.stdout:2/83: chown d3/df 140628746 1 2024-02-19T19:07:27.618 INFO:tasks.workunit.client.1.smithi142.stdout:2/84: symlink d3/db/l1d 0 2024-02-19T19:07:27.623 INFO:tasks.workunit.client.1.smithi142.stdout:4/115: dwrite d4/dc/f13 [0,4194304] 0 2024-02-19T19:07:27.624 INFO:tasks.workunit.client.1.smithi142.stdout:3/93: dwrite fb [0,4194304] 0 2024-02-19T19:07:27.624 INFO:tasks.workunit.client.1.smithi142.stdout:4/116: read d4/d14/f16 [426680,128677] 0 2024-02-19T19:07:27.625 INFO:tasks.workunit.client.1.smithi142.stdout:7/65: dwrite d0/f19 [0,4194304] 0 2024-02-19T19:07:27.625 INFO:tasks.workunit.client.1.smithi142.stdout:7/66: write d0/f9 [4100883,92100] 0 2024-02-19T19:07:27.626 INFO:tasks.workunit.client.1.smithi142.stdout:8/100: dwrite d9/dd/f17 [0,4194304] 0 2024-02-19T19:07:27.630 INFO:tasks.workunit.client.1.smithi142.stdout:0/82: write f11 [1563375,103484] 0 2024-02-19T19:07:27.631 INFO:tasks.workunit.client.1.smithi142.stdout:6/92: getdents d2 0 2024-02-19T19:07:27.631 INFO:tasks.workunit.client.1.smithi142.stdout:8/101: write d9/fc [181722,80954] 0 2024-02-19T19:07:27.634 INFO:tasks.workunit.client.1.smithi142.stdout:7/67: unlink d0/f12 0 2024-02-19T19:07:27.634 INFO:tasks.workunit.client.1.smithi142.stdout:3/94: write f15 [4123077,48139] 0 2024-02-19T19:07:27.637 INFO:tasks.workunit.client.1.smithi142.stdout:4/117: mknod d4/dc/c20 0 2024-02-19T19:07:27.638 INFO:tasks.workunit.client.1.smithi142.stdout:2/85: dwrite d3/f8 [0,4194304] 0 2024-02-19T19:07:27.639 INFO:tasks.workunit.client.1.smithi142.stdout:6/93: link d2/ca d2/c1b 0 2024-02-19T19:07:27.642 INFO:tasks.workunit.client.1.smithi142.stdout:5/70: dwrite d5/fe [0,4194304] 0 2024-02-19T19:07:27.642 INFO:tasks.workunit.client.1.smithi142.stdout:5/71: stat d5/fe 0 2024-02-19T19:07:27.642 INFO:tasks.workunit.client.1.smithi142.stdout:8/102: unlink c8 0 2024-02-19T19:07:27.642 INFO:tasks.workunit.client.1.smithi142.stdout:1/115: sync 2024-02-19T19:07:27.642 INFO:tasks.workunit.client.1.smithi142.stdout:9/76: sync 2024-02-19T19:07:27.644 INFO:tasks.workunit.client.1.smithi142.stdout:6/94: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:27.645 INFO:tasks.workunit.client.1.smithi142.stdout:3/95: creat f19 x:0 0 0 2024-02-19T19:07:27.645 INFO:tasks.workunit.client.1.smithi142.stdout:3/96: chown fa 68 1 2024-02-19T19:07:27.646 INFO:tasks.workunit.client.1.smithi142.stdout:4/118: mknod d4/dc/d1e/c21 0 2024-02-19T19:07:27.646 INFO:tasks.workunit.client.1.smithi142.stdout:4/119: truncate d4/dc/d12/f18 2314645 0 2024-02-19T19:07:27.646 INFO:tasks.workunit.client.1.smithi142.stdout:4/120: fdatasync d4/dc/d12/f18 0 2024-02-19T19:07:27.646 INFO:tasks.workunit.client.1.smithi142.stdout:4/121: write d4/d14/f16 [355874,92396] 0 2024-02-19T19:07:27.646 INFO:tasks.workunit.client.1.smithi142.stdout:4/122: readlink d4/l6 0 2024-02-19T19:07:27.649 INFO:tasks.workunit.client.1.smithi142.stdout:8/103: rmdir d9/dd/de 39 2024-02-19T19:07:27.650 INFO:tasks.workunit.client.1.smithi142.stdout:0/83: dwrite f15 [0,4194304] 0 2024-02-19T19:07:27.651 INFO:tasks.workunit.client.1.smithi142.stdout:9/77: unlink f9 0 2024-02-19T19:07:27.654 INFO:tasks.workunit.client.1.smithi142.stdout:1/116: unlink d5/c12 0 2024-02-19T19:07:27.656 INFO:tasks.workunit.client.1.smithi142.stdout:6/95: symlink d2/l1c 0 2024-02-19T19:07:27.657 INFO:tasks.workunit.client.1.smithi142.stdout:7/68: dwrite d0/d13/f15 [0,4194304] 0 2024-02-19T19:07:27.658 INFO:tasks.workunit.client.1.smithi142.stdout:4/123: link d4/dc/dd/d10/f1f d4/d1c/f22 0 2024-02-19T19:07:27.662 INFO:tasks.workunit.client.1.smithi142.stdout:2/86: rmdir d3/df 39 2024-02-19T19:07:27.662 INFO:tasks.workunit.client.1.smithi142.stdout:8/104: write d9/f13 [3887674,88390] 0 2024-02-19T19:07:27.662 INFO:tasks.workunit.client.1.smithi142.stdout:2/87: chown d3/f8 46 1 2024-02-19T19:07:27.663 INFO:tasks.workunit.client.1.smithi142.stdout:5/72: rmdir d5 39 2024-02-19T19:07:27.667 INFO:tasks.workunit.client.1.smithi142.stdout:0/84: rename f1b to f20 0 2024-02-19T19:07:27.670 INFO:tasks.workunit.client.1.smithi142.stdout:9/78: symlink db/l12 0 2024-02-19T19:07:27.670 INFO:tasks.workunit.client.1.smithi142.stdout:9/79: write f6 [1617265,67455] 0 2024-02-19T19:07:27.670 INFO:tasks.workunit.client.1.smithi142.stdout:9/80: chown l4 3206342 1 2024-02-19T19:07:27.672 INFO:tasks.workunit.client.1.smithi142.stdout:6/96: dwrite d2/f9 [0,4194304] 0 2024-02-19T19:07:27.672 INFO:tasks.workunit.client.1.smithi142.stdout:1/117: creat d5/f28 x:0 0 0 2024-02-19T19:07:27.673 INFO:tasks.workunit.client.1.smithi142.stdout:1/118: chown d5/d1a/d24 1346 1 2024-02-19T19:07:27.673 INFO:tasks.workunit.client.1.smithi142.stdout:3/97: dwrite f10 [0,4194304] 0 2024-02-19T19:07:27.673 INFO:tasks.workunit.client.1.smithi142.stdout:3/98: write f5 [1351794,17259] 0 2024-02-19T19:07:27.673 INFO:tasks.workunit.client.1.smithi142.stdout:3/99: write f9 [812358,120670] 0 2024-02-19T19:07:27.679 INFO:tasks.workunit.client.1.smithi142.stdout:7/69: creat d0/d13/f1c x:0 0 0 2024-02-19T19:07:27.681 INFO:tasks.workunit.client.1.smithi142.stdout:7/70: dread d0/fc [0,4194304] 0 2024-02-19T19:07:27.681 INFO:tasks.workunit.client.1.smithi142.stdout:7/71: truncate d0/f16 461694 0 2024-02-19T19:07:27.681 INFO:tasks.workunit.client.1.smithi142.stdout:7/72: getdents d0/d1b 0 2024-02-19T19:07:27.681 INFO:tasks.workunit.client.1.smithi142.stdout:4/124: mknod d4/dc/d1e/c23 0 2024-02-19T19:07:27.682 INFO:tasks.workunit.client.1.smithi142.stdout:5/73: dwrite d5/dd/d8/fb [0,4194304] 0 2024-02-19T19:07:27.683 INFO:tasks.workunit.client.1.smithi142.stdout:2/88: unlink d3/db/l1d 0 2024-02-19T19:07:27.683 INFO:tasks.workunit.client.1.smithi142.stdout:2/89: dread - d3/f1c zero size 2024-02-19T19:07:27.684 INFO:tasks.workunit.client.1.smithi142.stdout:8/105: creat d9/dd/de/d14/f1a x:0 0 0 2024-02-19T19:07:27.685 INFO:tasks.workunit.client.1.smithi142.stdout:9/81: unlink ca 0 2024-02-19T19:07:27.686 INFO:tasks.workunit.client.1.smithi142.stdout:1/119: write d5/fd [7744353,120461] 0 2024-02-19T19:07:27.687 INFO:tasks.workunit.client.1.smithi142.stdout:0/85: dwrite f16 [0,4194304] 0 2024-02-19T19:07:27.687 INFO:tasks.workunit.client.1.smithi142.stdout:0/86: dread - f17 zero size 2024-02-19T19:07:27.691 INFO:tasks.workunit.client.1.smithi142.stdout:6/97: truncate d2/d17/f1a 924479 0 2024-02-19T19:07:27.695 INFO:tasks.workunit.client.1.smithi142.stdout:6/98: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:27.696 INFO:tasks.workunit.client.1.smithi142.stdout:5/74: dwrite d5/f13 [0,4194304] 0 2024-02-19T19:07:27.699 INFO:tasks.workunit.client.1.smithi142.stdout:8/106: getdents d9 0 2024-02-19T19:07:27.702 INFO:tasks.workunit.client.1.smithi142.stdout:5/75: dread d5/dd/df/f14 [0,4194304] 0 2024-02-19T19:07:27.702 INFO:tasks.workunit.client.1.smithi142.stdout:9/82: creat db/f13 x:0 0 0 2024-02-19T19:07:27.702 INFO:tasks.workunit.client.1.smithi142.stdout:9/83: creat db/f14 x:0 0 0 2024-02-19T19:07:27.702 INFO:tasks.workunit.client.1.smithi142.stdout:1/120: symlink d5/d7/d23/l29 0 2024-02-19T19:07:27.708 INFO:tasks.workunit.client.1.smithi142.stdout:0/87: symlink l21 0 2024-02-19T19:07:27.710 INFO:tasks.workunit.client.1.smithi142.stdout:5/76: dread d5/f13 [0,4194304] 0 2024-02-19T19:07:27.715 INFO:tasks.workunit.client.1.smithi142.stdout:4/125: dwrite d4/d14/f16 [0,4194304] 0 2024-02-19T19:07:27.715 INFO:tasks.workunit.client.1.smithi142.stdout:7/73: mknod d0/d13/c1d 0 2024-02-19T19:07:27.716 INFO:tasks.workunit.client.1.smithi142.stdout:6/99: dwrite d2/f14 [0,4194304] 0 2024-02-19T19:07:27.718 INFO:tasks.workunit.client.1.smithi142.stdout:2/90: getdents d3/db 0 2024-02-19T19:07:27.718 INFO:tasks.workunit.client.1.smithi142.stdout:2/91: read d3/fa [1029997,4998] 0 2024-02-19T19:07:27.719 INFO:tasks.workunit.client.1.smithi142.stdout:2/92: write d3/fa [4659162,46019] 0 2024-02-19T19:07:27.720 INFO:tasks.workunit.client.1.smithi142.stdout:8/107: creat d9/dd/d18/f1b x:0 0 0 2024-02-19T19:07:27.724 INFO:tasks.workunit.client.1.smithi142.stdout:4/126: mknod d4/dc/dd/c24 0 2024-02-19T19:07:27.724 INFO:tasks.workunit.client.1.smithi142.stdout:2/93: write d3/f17 [2329568,64846] 0 2024-02-19T19:07:27.724 INFO:tasks.workunit.client.1.smithi142.stdout:2/94: chown d3/l9 451016 1 2024-02-19T19:07:27.737 INFO:tasks.workunit.client.1.smithi142.stdout:6/100: dwrite d2/f18 [0,4194304] 0 2024-02-19T19:07:27.737 INFO:tasks.workunit.client.1.smithi142.stdout:6/101: dread - d2/d17/f19 zero size 2024-02-19T19:07:27.737 INFO:tasks.workunit.client.1.smithi142.stdout:6/102: chown d2/d17/f1a 341 1 2024-02-19T19:07:27.737 INFO:tasks.workunit.client.1.smithi142.stdout:0/88: dwrite f16 [4194304,4194304] 0 2024-02-19T19:07:27.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.751+0000 7f4321d5c700 1 -- 172.21.15.46:0/317930673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4308005190 con 0x7f431c0ff350 2024-02-19T19:07:27.789 INFO:tasks.workunit.client.1.smithi142.stdout:8/108: unlink d9/dd/de/d14/l16 0 2024-02-19T19:07:27.791 INFO:tasks.workunit.client.1.smithi142.stdout:9/84: rename db/f14 to db/d10/f15 0 2024-02-19T19:07:27.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.772+0000 7f4318ff9700 1 -- 172.21.15.46:0/317930673 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7f430c05a660 con 0x7f431c0ff350 2024-02-19T19:07:27.793 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 osds down 2024-02-19T19:07:27.793 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-19T19:07:27.793 INFO:teuthology.orchestra.run.smithi046.stdout: osd.1 (root=default,host=smithi046) is down 2024-02-19T19:07:27.794 INFO:tasks.workunit.client.1.smithi142.stdout:4/127: symlink d4/d14/l25 0 2024-02-19T19:07:27.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.775+0000 7f4321d5c700 1 -- 172.21.15.46:0/317930673 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f430406d8a0 msgr2=0x7f430406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:27.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.775+0000 7f4321d5c700 1 --2- 172.21.15.46:0/317930673 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f430406d8a0 0x7f430406fd50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4310009fd0 tx=0x7f4310000bc0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.775+0000 7f4321d5c700 1 -- 172.21.15.46:0/317930673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c0ff350 msgr2=0x7f431c195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:27.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.775+0000 7f4321d5c700 1 --2- 172.21.15.46:0/317930673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c0ff350 0x7f431c195eb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f430c00e8f0 tx=0x7f430c00ecb0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.775+0000 7f4321d5c700 1 -- 172.21.15.46:0/317930673 shutdown_connections 2024-02-19T19:07:27.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.775+0000 7f4321d5c700 1 --2- 172.21.15.46:0/317930673 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f430406d8a0 0x7f430406fd50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.775+0000 7f4321d5c700 1 --2- 172.21.15.46:0/317930673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f431c0ff350 0x7f431c195eb0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f430c00e8f0 tx=0x7f430c00ecb0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.775+0000 7f4321d5c700 1 --2- 172.21.15.46:0/317930673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f431c0ffc60 0x7f431c1963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.775+0000 7f4321d5c700 1 -- 172.21.15.46:0/317930673 >> 172.21.15.46:0/317930673 conn(0x7f431c0748b0 msgr2=0x7f431c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:27.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.776+0000 7f4321d5c700 1 -- 172.21.15.46:0/317930673 shutdown_connections 2024-02-19T19:07:27.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:27.776+0000 7f4321d5c700 1 -- 172.21.15.46:0/317930673 wait complete. 2024-02-19T19:07:27.798 INFO:tasks.workunit.client.1.smithi142.stdout:2/95: creat d3/db/f1e x:0 0 0 2024-02-19T19:07:27.801 INFO:tasks.workunit.client.1.smithi142.stdout:7/74: mkdir d0/d13/d1e 0 2024-02-19T19:07:27.801 INFO:tasks.workunit.client.1.smithi142.stdout:7/75: fsync d0/f10 0 2024-02-19T19:07:27.803 INFO:tasks.workunit.client.1.smithi142.stdout:5/77: write d5/f13 [4873416,125364] 0 2024-02-19T19:07:27.806 INFO:tasks.workunit.client.1.smithi142.stdout:6/103: link d2/l10 d2/d17/l1d 0 2024-02-19T19:07:27.806 INFO:tasks.workunit.client.1.smithi142.stdout:6/104: dread - d2/d17/f19 zero size 2024-02-19T19:07:27.806 INFO:tasks.workunit.client.1.smithi142.stdout:6/105: dread - d2/d17/f19 zero size 2024-02-19T19:07:27.809 INFO:tasks.workunit.client.1.smithi142.stdout:6/106: read d2/f12 [1399812,111261] 0 2024-02-19T19:07:27.813 INFO:tasks.workunit.client.1.smithi142.stdout:9/85: rename db/f13 to db/f16 0 2024-02-19T19:07:27.814 INFO:tasks.workunit.client.1.smithi142.stdout:1/121: getdents d5/d7 0 2024-02-19T19:07:27.814 INFO:tasks.workunit.client.1.smithi142.stdout:1/122: write f4 [793803,37262] 0 2024-02-19T19:07:27.815 INFO:tasks.workunit.client.1.smithi142.stdout:4/128: mkdir d4/dc/dd/d10/d26 0 2024-02-19T19:07:27.815 INFO:tasks.workunit.client.1.smithi142.stdout:4/129: readlink d4/dc/d12/l17 0 2024-02-19T19:07:27.816 INFO:tasks.workunit.client.1.smithi142.stdout:2/96: unlink d3/df/c1b 0 2024-02-19T19:07:27.817 INFO:tasks.workunit.client.1.smithi142.stdout:7/76: dwrite d0/f16 [0,4194304] 0 2024-02-19T19:07:27.819 INFO:tasks.workunit.client.1.smithi142.stdout:5/78: symlink d5/dd/df/l17 0 2024-02-19T19:07:27.820 INFO:tasks.workunit.client.1.smithi142.stdout:8/109: unlink d9/dd/d18/f1b 0 2024-02-19T19:07:27.820 INFO:tasks.workunit.client.1.smithi142.stdout:8/110: creat d9/dd/f1c x:0 0 0 2024-02-19T19:07:27.822 INFO:tasks.workunit.client.1.smithi142.stdout:9/86: link l8 db/l17 0 2024-02-19T19:07:27.822 INFO:tasks.workunit.client.1.smithi142.stdout:9/87: dread - db/d10/f15 zero size 2024-02-19T19:07:27.827 INFO:tasks.workunit.client.1.smithi142.stdout:5/79: link d5/fe d5/f18 0 2024-02-19T19:07:27.827 INFO:tasks.workunit.client.1.smithi142.stdout:5/80: truncate d5/dd/df/f12 1001186 0 2024-02-19T19:07:27.828 INFO:tasks.workunit.client.1.smithi142.stdout:3/100: sync 2024-02-19T19:07:27.829 INFO:tasks.workunit.client.1.smithi142.stdout:6/107: rmdir d2/d17 39 2024-02-19T19:07:27.830 INFO:tasks.workunit.client.1.smithi142.stdout:1/123: rmdir d5/d21 0 2024-02-19T19:07:27.831 INFO:tasks.workunit.client.1.smithi142.stdout:0/89: sync 2024-02-19T19:07:27.833 INFO:tasks.workunit.client.1.smithi142.stdout:7/77: rename d0/f2 to d0/d13/f1f 0 2024-02-19T19:07:27.833 INFO:tasks.workunit.client.1.smithi142.stdout:7/78: read d0/f9 [20657,116764] 0 2024-02-19T19:07:27.833 INFO:tasks.workunit.client.1.smithi142.stdout:7/79: dread - d0/d13/f1c zero size 2024-02-19T19:07:27.834 INFO:tasks.workunit.client.1.smithi142.stdout:7/80: creat d0/d13/d1e/f20 x:0 0 0 2024-02-19T19:07:27.836 INFO:tasks.workunit.client.1.smithi142.stdout:8/111: rmdir d9/dd/d18 0 2024-02-19T19:07:27.838 INFO:tasks.workunit.client.1.smithi142.stdout:2/97: dwrite d3/db/fc [4194304,4194304] 0 2024-02-19T19:07:27.838 INFO:tasks.workunit.client.1.smithi142.stdout:2/98: chown f0 117126 1 2024-02-19T19:07:27.840 INFO:tasks.workunit.client.1.smithi142.stdout:2/99: getdents d3 0 2024-02-19T19:07:27.840 INFO:tasks.workunit.client.1.smithi142.stdout:2/100: dread - d3/f1c zero size 2024-02-19T19:07:27.841 INFO:tasks.workunit.client.1.smithi142.stdout:0/90: write f16 [3709494,25839] 0 2024-02-19T19:07:27.841 INFO:tasks.workunit.client.1.smithi142.stdout:2/101: link d3/f1c d3/f1f 0 2024-02-19T19:07:27.842 INFO:tasks.workunit.client.1.smithi142.stdout:0/91: rename f1d to f22 0 2024-02-19T19:07:27.842 INFO:tasks.workunit.client.1.smithi142.stdout:0/92: rmdir - no directory 2024-02-19T19:07:27.843 INFO:tasks.workunit.client.1.smithi142.stdout:3/101: write f15 [7280643,8644] 0 2024-02-19T19:07:27.843 INFO:tasks.workunit.client.1.smithi142.stdout:3/102: write f19 [32091,91758] 0 2024-02-19T19:07:27.847 INFO:tasks.workunit.client.1.smithi142.stdout:8/112: dread d9/f13 [0,4194304] 0 2024-02-19T19:07:27.847 INFO:tasks.workunit.client.1.smithi142.stdout:8/113: creat d9/dd/f1d x:0 0 0 2024-02-19T19:07:27.852 INFO:tasks.workunit.client.1.smithi142.stdout:9/88: dwrite f5 [0,4194304] 0 2024-02-19T19:07:27.852 INFO:tasks.workunit.client.1.smithi142.stdout:9/89: write db/f16 [226477,79702] 0 2024-02-19T19:07:27.852 INFO:tasks.workunit.client.1.smithi142.stdout:9/90: creat db/f18 x:0 0 0 2024-02-19T19:07:27.857 INFO:tasks.workunit.client.1.smithi142.stdout:7/81: dwrite d0/fc [0,4194304] 0 2024-02-19T19:07:27.857 INFO:tasks.workunit.client.1.smithi142.stdout:7/82: write d0/d13/f1f [756961,100443] 0 2024-02-19T19:07:27.859 INFO:tasks.workunit.client.1.smithi142.stdout:7/83: mkdir d0/d1b/d21 0 2024-02-19T19:07:27.860 INFO:tasks.workunit.client.1.smithi142.stdout:0/93: fdatasync f16 0 2024-02-19T19:07:27.862 INFO:tasks.workunit.client.1.smithi142.stdout:0/94: mkdir d23 0 2024-02-19T19:07:27.864 INFO:tasks.workunit.client.1.smithi142.stdout:9/91: write f5 [2818419,93772] 0 2024-02-19T19:07:27.864 INFO:tasks.workunit.client.1.smithi142.stdout:9/92: readlink db/l17 0 2024-02-19T19:07:27.864 INFO:tasks.workunit.client.1.smithi142.stdout:3/103: dread f19 [0,4194304] 0 2024-02-19T19:07:27.866 INFO:tasks.workunit.client.1.smithi142.stdout:9/93: mknod db/d10/c19 0 2024-02-19T19:07:27.866 INFO:tasks.workunit.client.1.smithi142.stdout:9/94: read - db/f18 zero size 2024-02-19T19:07:27.867 INFO:tasks.workunit.client.1.smithi142.stdout:2/102: dwrite d3/f5 [0,4194304] 0 2024-02-19T19:07:27.867 INFO:tasks.workunit.client.1.smithi142.stdout:2/103: dread - d3/db/f15 zero size 2024-02-19T19:07:27.869 INFO:tasks.workunit.client.1.smithi142.stdout:8/114: dwrite d9/dd/de/d14/f1a [0,4194304] 0 2024-02-19T19:07:27.869 INFO:tasks.workunit.client.1.smithi142.stdout:7/84: dread d0/d13/f15 [0,4194304] 0 2024-02-19T19:07:27.869 INFO:tasks.workunit.client.1.smithi142.stdout:7/85: readlink d0/l17 0 2024-02-19T19:07:27.869 INFO:tasks.workunit.client.1.smithi142.stdout:8/115: rename d9/dd/de to d9/dd/de/d14/d1e 22 2024-02-19T19:07:27.869 INFO:tasks.workunit.client.1.smithi142.stdout:8/116: write d9/dd/f1d [379719,67910] 0 2024-02-19T19:07:27.869 INFO:tasks.workunit.client.1.smithi142.stdout:8/117: dread - f7 zero size 2024-02-19T19:07:27.869 INFO:tasks.workunit.client.1.smithi142.stdout:8/118: fsync d9/dd/de/d14/f1a 0 2024-02-19T19:07:27.869 INFO:tasks.workunit.client.1.smithi142.stdout:8/119: truncate f7 818182 0 2024-02-19T19:07:27.869 INFO:tasks.workunit.client.1.smithi142.stdout:9/95: rmdir db/d10 39 2024-02-19T19:07:27.870 INFO:tasks.workunit.client.1.smithi142.stdout:2/104: truncate d3/fe 4217 0 2024-02-19T19:07:27.870 INFO:tasks.workunit.client.1.smithi142.stdout:7/86: mkdir d0/d13/d1e/d22 0 2024-02-19T19:07:27.871 INFO:tasks.workunit.client.1.smithi142.stdout:7/87: truncate d0/f10 125887 0 2024-02-19T19:07:27.871 INFO:tasks.workunit.client.1.smithi142.stdout:8/120: truncate d9/fc 730953 0 2024-02-19T19:07:27.871 INFO:tasks.workunit.client.1.smithi142.stdout:8/121: chown f1 79 1 2024-02-19T19:07:27.872 INFO:tasks.workunit.client.1.smithi142.stdout:9/96: mknod db/c1a 0 2024-02-19T19:07:27.872 INFO:tasks.workunit.client.1.smithi142.stdout:7/88: dread d0/fa [0,4194304] 0 2024-02-19T19:07:27.873 INFO:tasks.workunit.client.1.smithi142.stdout:8/122: creat d9/dd/d15/f1f x:0 0 0 2024-02-19T19:07:27.873 INFO:tasks.workunit.client.1.smithi142.stdout:8/123: creat d9/dd/de/d14/f20 x:0 0 0 2024-02-19T19:07:27.874 INFO:tasks.workunit.client.1.smithi142.stdout:9/97: unlink l8 0 2024-02-19T19:07:27.875 INFO:tasks.workunit.client.1.smithi142.stdout:9/98: creat db/f1b x:0 0 0 2024-02-19T19:07:27.875 INFO:tasks.workunit.client.1.smithi142.stdout:9/99: dread - db/f1b zero size 2024-02-19T19:07:27.876 INFO:tasks.workunit.client.1.smithi142.stdout:7/89: rename d0/d13/c1d to d0/d13/d1e/c23 0 2024-02-19T19:07:27.876 INFO:tasks.workunit.client.1.smithi142.stdout:2/105: rmdir d3/df 39 2024-02-19T19:07:27.879 INFO:tasks.workunit.client.1.smithi142.stdout:7/90: mkdir d0/d1b/d21/d24 0 2024-02-19T19:07:27.880 INFO:tasks.workunit.client.1.smithi142.stdout:7/91: creat d0/d1b/d21/f25 x:0 0 0 2024-02-19T19:07:27.885 INFO:tasks.workunit.client.1.smithi142.stdout:8/124: dread f0 [0,4194304] 0 2024-02-19T19:07:27.887 INFO:tasks.workunit.client.1.smithi142.stdout:8/125: mkdir d9/dd/de/d14/d21 0 2024-02-19T19:07:27.887 INFO:tasks.workunit.client.1.smithi142.stdout:2/106: dread d3/f8 [0,4194304] 0 2024-02-19T19:07:27.888 INFO:tasks.workunit.client.1.smithi142.stdout:2/107: creat d3/db/f20 x:0 0 0 2024-02-19T19:07:27.890 INFO:tasks.workunit.client.1.smithi142.stdout:2/108: creat d3/df/f21 x:0 0 0 2024-02-19T19:07:27.890 INFO:tasks.workunit.client.1.smithi142.stdout:3/104: dwrite f19 [0,4194304] 0 2024-02-19T19:07:27.890 INFO:tasks.workunit.client.1.smithi142.stdout:3/105: fdatasync f10 0 2024-02-19T19:07:27.892 INFO:tasks.workunit.client.1.smithi142.stdout:0/95: dwrite f11 [4194304,4194304] 0 2024-02-19T19:07:27.898 INFO:tasks.workunit.client.1.smithi142.stdout:0/96: symlink d23/l24 0 2024-02-19T19:07:27.898 INFO:tasks.workunit.client.1.smithi142.stdout:3/106: dread f10 [0,4194304] 0 2024-02-19T19:07:27.901 INFO:tasks.workunit.client.1.smithi142.stdout:9/100: getdents db 0 2024-02-19T19:07:27.901 INFO:tasks.workunit.client.1.smithi142.stdout:9/101: dread - db/f18 zero size 2024-02-19T19:07:27.904 INFO:tasks.workunit.client.1.smithi142.stdout:2/109: dwrite d3/fe [0,4194304] 0 2024-02-19T19:07:27.908 INFO:tasks.workunit.client.1.smithi142.stdout:3/107: creat f1a x:0 0 0 2024-02-19T19:07:27.909 INFO:tasks.workunit.client.1.smithi142.stdout:9/102: truncate f6 1272060 0 2024-02-19T19:07:27.914 INFO:tasks.workunit.client.1.smithi142.stdout:9/103: creat db/d10/f1c x:0 0 0 2024-02-19T19:07:27.915 INFO:tasks.workunit.client.1.smithi142.stdout:9/104: creat db/f1d x:0 0 0 2024-02-19T19:07:27.916 INFO:tasks.workunit.client.1.smithi142.stdout:9/105: truncate db/f16 1062792 0 2024-02-19T19:07:27.920 INFO:tasks.workunit.client.1.smithi142.stdout:2/110: dwrite d3/f1c [0,4194304] 0 2024-02-19T19:07:27.920 INFO:tasks.workunit.client.1.smithi142.stdout:2/111: dread - d3/df/f14 zero size 2024-02-19T19:07:27.923 INFO:tasks.workunit.client.1.smithi142.stdout:2/112: rmdir d3 39 2024-02-19T19:07:27.925 INFO:tasks.workunit.client.1.smithi142.stdout:9/106: symlink db/l1e 0 2024-02-19T19:07:27.925 INFO:tasks.workunit.client.1.smithi142.stdout:9/107: fdatasync f6 0 2024-02-19T19:07:27.925 INFO:tasks.workunit.client.1.smithi142.stdout:9/108: creat db/d10/f1f x:0 0 0 2024-02-19T19:07:27.931 INFO:tasks.workunit.client.1.smithi142.stdout:9/109: rename db/f1b to db/d10/f20 0 2024-02-19T19:07:27.931 INFO:tasks.workunit.client.1.smithi142.stdout:9/110: write db/f1d [689092,100805] 0 2024-02-19T19:07:27.932 INFO:tasks.workunit.client.1.smithi142.stdout:9/111: stat db/l1e 0 2024-02-19T19:07:27.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/112: truncate db/f16 566835 0 2024-02-19T19:07:27.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/113: truncate db/f1d 1657574 0 2024-02-19T19:07:27.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/114: truncate db/f1d 2377456 0 2024-02-19T19:07:27.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/115: write f6 [568502,65501] 0 2024-02-19T19:07:27.936 INFO:tasks.workunit.client.1.smithi142.stdout:9/116: rename db/l17 to db/l21 0 2024-02-19T19:07:27.939 INFO:tasks.workunit.client.1.smithi142.stdout:9/117: dread f6 [0,4194304] 0 2024-02-19T19:07:27.948 INFO:tasks.workunit.client.1.smithi142.stdout:2/113: dwrite d3/f16 [0,4194304] 0 2024-02-19T19:07:27.953 INFO:tasks.workunit.client.1.smithi142.stdout:2/114: rename d3/l18 to d3/l22 0 2024-02-19T19:07:27.957 INFO:tasks.workunit.client.1.smithi142.stdout:2/115: write d3/f8 [2639919,116679] 0 2024-02-19T19:07:27.958 INFO:tasks.workunit.client.1.smithi142.stdout:9/118: dwrite db/d10/f20 [0,4194304] 0 2024-02-19T19:07:27.961 INFO:tasks.workunit.client.1.smithi142.stdout:9/119: truncate f5 3175242 0 2024-02-19T19:07:27.966 INFO:tasks.workunit.client.1.smithi142.stdout:2/116: write d3/f1c [4065418,60027] 0 2024-02-19T19:07:27.966 INFO:tasks.workunit.client.1.smithi142.stdout:2/117: creat d3/db/f23 x:0 0 0 2024-02-19T19:07:27.974 INFO:tasks.workunit.client.1.smithi142.stdout:9/120: dwrite db/d10/f1c [0,4194304] 0 2024-02-19T19:07:27.993 INFO:tasks.workunit.client.1.smithi142.stdout:9/121: dwrite db/d10/f1f [0,4194304] 0 2024-02-19T19:07:27.993 INFO:tasks.workunit.client.1.smithi142.stdout:2/118: dwrite d3/df/f14 [0,4194304] 0 2024-02-19T19:07:27.995 INFO:tasks.workunit.client.1.smithi142.stdout:9/122: mkdir db/d10/d22 0 2024-02-19T19:07:27.997 INFO:tasks.workunit.client.1.smithi142.stdout:2/119: symlink d3/db/l24 0 2024-02-19T19:07:27.998 INFO:tasks.workunit.client.1.smithi142.stdout:9/123: unlink c7 0 2024-02-19T19:07:28.000 INFO:tasks.workunit.client.1.smithi142.stdout:2/120: unlink d3/db/f1e 0 2024-02-19T19:07:28.000 INFO:tasks.workunit.client.1.smithi142.stdout:2/121: creat d3/db/f25 x:0 0 0 2024-02-19T19:07:28.001 INFO:tasks.workunit.client.1.smithi142.stdout:9/124: chown db/c1a 238972118 1 2024-02-19T19:07:28.002 INFO:tasks.workunit.client.1.smithi142.stdout:4/130: sync 2024-02-19T19:07:28.002 INFO:tasks.workunit.client.1.smithi142.stdout:7/92: sync 2024-02-19T19:07:28.002 INFO:tasks.workunit.client.1.smithi142.stdout:4/131: getdents d4/dc/dd/d10/d26 0 2024-02-19T19:07:28.002 INFO:tasks.workunit.client.1.smithi142.stdout:4/132: write d4/dc/dd/d10/f1f [1026831,79728] 0 2024-02-19T19:07:28.004 INFO:tasks.workunit.client.1.smithi142.stdout:2/122: symlink d3/l26 0 2024-02-19T19:07:28.004 INFO:tasks.workunit.client.1.smithi142.stdout:2/123: write d3/db/f23 [563324,15933] 0 2024-02-19T19:07:28.005 INFO:tasks.workunit.client.1.smithi142.stdout:9/125: mknod db/d10/d22/c23 0 2024-02-19T19:07:28.006 INFO:tasks.workunit.client.1.smithi142.stdout:0/97: sync 2024-02-19T19:07:28.006 INFO:tasks.workunit.client.1.smithi142.stdout:3/108: sync 2024-02-19T19:07:28.007 INFO:tasks.workunit.client.1.smithi142.stdout:0/98: read f1a [244913,125488] 0 2024-02-19T19:07:28.007 INFO:tasks.workunit.client.1.smithi142.stdout:0/99: write f17 [275349,40400] 0 2024-02-19T19:07:28.007 INFO:tasks.workunit.client.1.smithi142.stdout:7/93: mknod d0/d1b/c26 0 2024-02-19T19:07:28.008 INFO:tasks.workunit.client.1.smithi142.stdout:4/133: truncate d4/d14/f16 2010272 0 2024-02-19T19:07:28.012 INFO:tasks.workunit.client.1.smithi142.stdout:4/134: creat d4/dc/f27 x:0 0 0 2024-02-19T19:07:28.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/109: getdents . 0 2024-02-19T19:07:28.014 INFO:tasks.workunit.client.1.smithi142.stdout:0/100: dread f18 [0,4194304] 0 2024-02-19T19:07:28.014 INFO:tasks.workunit.client.1.smithi142.stdout:0/101: stat f22 0 2024-02-19T19:07:28.016 INFO:tasks.workunit.client.1.smithi142.stdout:7/94: rename d0/d1b/d21/f25 to d0/d13/f27 0 2024-02-19T19:07:28.016 INFO:tasks.workunit.client.1.smithi142.stdout:7/95: chown d0/f10 67024023 1 2024-02-19T19:07:28.017 INFO:tasks.workunit.client.1.smithi142.stdout:2/124: dread d3/f1f [0,4194304] 0 2024-02-19T19:07:28.017 INFO:tasks.workunit.client.1.smithi142.stdout:2/125: write d3/f8 [2164519,130212] 0 2024-02-19T19:07:28.017 INFO:tasks.workunit.client.1.smithi142.stdout:2/126: chown d3/f1c 703018 1 2024-02-19T19:07:28.019 INFO:tasks.workunit.client.1.smithi142.stdout:4/135: mknod d4/d14/c28 0 2024-02-19T19:07:28.020 INFO:tasks.workunit.client.1.smithi142.stdout:9/126: write db/d10/f20 [2428280,3179] 0 2024-02-19T19:07:28.020 INFO:tasks.workunit.client.1.smithi142.stdout:9/127: stat db/f16 0 2024-02-19T19:07:28.020 INFO:tasks.workunit.client.1.smithi142.stdout:0/102: dread f18 [0,4194304] 0 2024-02-19T19:07:28.020 INFO:tasks.workunit.client.1.smithi142.stdout:2/127: creat d3/f27 x:0 0 0 2024-02-19T19:07:28.024 INFO:tasks.workunit.client.1.smithi142.stdout:3/110: symlink l1b 0 2024-02-19T19:07:28.024 INFO:tasks.workunit.client.1.smithi142.stdout:3/111: fdatasync f12 0 2024-02-19T19:07:28.025 INFO:tasks.workunit.client.1.smithi142.stdout:7/96: unlink d0/d13/c14 0 2024-02-19T19:07:28.025 INFO:tasks.workunit.client.1.smithi142.stdout:4/136: dread d4/dc/dd/f1a [0,4194304] 0 2024-02-19T19:07:28.026 INFO:tasks.workunit.client.1.smithi142.stdout:4/137: read d4/dc/d12/f18 [566687,120499] 0 2024-02-19T19:07:28.026 INFO:tasks.workunit.client.1.smithi142.stdout:9/128: mkdir db/d10/d22/d24 0 2024-02-19T19:07:28.027 INFO:tasks.workunit.client.1.smithi142.stdout:0/103: write f11 [5683416,7658] 0 2024-02-19T19:07:28.028 INFO:tasks.workunit.client.1.smithi142.stdout:0/104: stat c1f 0 2024-02-19T19:07:28.028 INFO:tasks.workunit.client.1.smithi142.stdout:7/97: rename d0/fa to d0/d1b/d21/d24/f28 0 2024-02-19T19:07:28.028 INFO:tasks.workunit.client.1.smithi142.stdout:2/128: write d3/f5 [1860318,35285] 0 2024-02-19T19:07:28.028 INFO:tasks.workunit.client.1.smithi142.stdout:4/138: link d4/dc/cf d4/d1c/c29 0 2024-02-19T19:07:28.029 INFO:tasks.workunit.client.1.smithi142.stdout:9/129: creat db/d10/d22/d24/f25 x:0 0 0 2024-02-19T19:07:28.031 INFO:tasks.workunit.client.1.smithi142.stdout:3/112: link f10 f1c 0 2024-02-19T19:07:28.034 INFO:tasks.workunit.client.1.smithi142.stdout:0/105: unlink f20 0 2024-02-19T19:07:28.036 INFO:tasks.workunit.client.1.smithi142.stdout:7/98: mkdir d0/d1b/d21/d24/d29 0 2024-02-19T19:07:28.037 INFO:tasks.workunit.client.1.smithi142.stdout:4/139: mkdir d4/dc/d1e/d2a 0 2024-02-19T19:07:28.037 INFO:tasks.workunit.client.1.smithi142.stdout:9/130: mknod db/d10/d22/d24/c26 0 2024-02-19T19:07:28.038 INFO:tasks.workunit.client.1.smithi142.stdout:4/140: truncate d4/dc/d12/f18 1157103 0 2024-02-19T19:07:28.038 INFO:tasks.workunit.client.1.smithi142.stdout:4/141: stat d4/d14/c28 0 2024-02-19T19:07:28.039 INFO:tasks.workunit.client.1.smithi142.stdout:2/129: dwrite d3/f27 [0,4194304] 0 2024-02-19T19:07:28.040 INFO:tasks.workunit.client.1.smithi142.stdout:9/131: mkdir db/d10/d27 0 2024-02-19T19:07:28.042 INFO:tasks.workunit.client.1.smithi142.stdout:4/142: rmdir d4/dc/dd 39 2024-02-19T19:07:28.045 INFO:tasks.workunit.client.1.smithi142.stdout:4/143: rename d4/dc/d12/l17 to d4/d1d/l2b 0 2024-02-19T19:07:28.045 INFO:tasks.workunit.client.1.smithi142.stdout:7/99: write d0/f16 [851414,115942] 0 2024-02-19T19:07:28.047 INFO:tasks.workunit.client.1.smithi142.stdout:7/100: unlink d0/d13/d1e/c23 0 2024-02-19T19:07:28.055 INFO:tasks.workunit.client.1.smithi142.stdout:3/113: dwrite f14 [0,4194304] 0 2024-02-19T19:07:28.063 INFO:tasks.workunit.client.1.smithi142.stdout:9/132: dwrite db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:28.063 INFO:tasks.workunit.client.1.smithi142.stdout:9/133: readlink l1 0 2024-02-19T19:07:28.063 INFO:tasks.workunit.client.1.smithi142.stdout:7/101: dwrite d0/f19 [0,4194304] 0 2024-02-19T19:07:28.068 INFO:tasks.workunit.client.1.smithi142.stdout:7/102: creat d0/f2a x:0 0 0 2024-02-19T19:07:28.071 INFO:tasks.workunit.client.1.smithi142.stdout:9/134: rename f6 to db/d10/f28 0 2024-02-19T19:07:28.071 INFO:tasks.workunit.client.1.smithi142.stdout:7/103: mknod d0/d1b/c2b 0 2024-02-19T19:07:28.071 INFO:tasks.workunit.client.1.smithi142.stdout:7/104: fdatasync d0/d13/f1f 0 2024-02-19T19:07:28.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: osdmap e56: 6 total, 5 up, 6 in 2024-02-19T19:07:28.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:28.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 5]}]: dispatch 2024-02-19T19:07:28.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 1]}]: dispatch 2024-02-19T19:07:28.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 1]}]: dispatch 2024-02-19T19:07:28.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 1]}]: dispatch 2024-02-19T19:07:28.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 1, 3, 2]}]: dispatch 2024-02-19T19:07:28.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [3, 0]}]: dispatch 2024-02-19T19:07:28.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]}]: dispatch 2024-02-19T19:07:28.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [3, 1]}]: dispatch 2024-02-19T19:07:28.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 2]}]: dispatch 2024-02-19T19:07:28.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:28.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:28.095 INFO:tasks.workunit.client.1.smithi142.stdout:3/114: dwrite fa [0,4194304] 0 2024-02-19T19:07:28.098 INFO:tasks.workunit.client.1.smithi142.stdout:9/135: dwrite db/d10/f1f [4194304,4194304] 0 2024-02-19T19:07:28.098 INFO:tasks.workunit.client.1.smithi142.stdout:4/144: dwrite d4/dc/dd/d10/f1f [0,4194304] 0 2024-02-19T19:07:28.098 INFO:tasks.workunit.client.1.smithi142.stdout:4/145: write d4/d14/f16 [2891419,80725] 0 2024-02-19T19:07:28.099 INFO:tasks.workunit.client.1.smithi142.stdout:9/136: stat db/d10/f1c 0 2024-02-19T19:07:28.099 INFO:tasks.workunit.client.1.smithi142.stdout:9/137: chown db/l21 893887 1 2024-02-19T19:07:28.101 INFO:tasks.workunit.client.1.smithi142.stdout:4/146: mkdir d4/dc/d2c 0 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: osdmap e56: 6 total, 5 up, 6 in 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 5]}]: dispatch 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 1]}]: dispatch 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 1]}]: dispatch 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 1]}]: dispatch 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 1, 3, 2]}]: dispatch 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [3, 0]}]: dispatch 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]}]: dispatch 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [3, 1]}]: dispatch 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 2]}]: dispatch 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:28.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:28.103 INFO:tasks.workunit.client.1.smithi142.stdout:4/147: rename d4/dc/d1e to d4/dc/d12/d2d 0 2024-02-19T19:07:28.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/148: creat d4/d1c/f2e x:0 0 0 2024-02-19T19:07:28.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/149: chown d4/dc/dd/c24 6 1 2024-02-19T19:07:28.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/150: stat d4/dc/dd/d10/d26 0 2024-02-19T19:07:28.105 INFO:tasks.workunit.client.1.smithi142.stdout:4/151: creat d4/d14/f2f x:0 0 0 2024-02-19T19:07:28.106 INFO:tasks.workunit.client.1.smithi142.stdout:3/115: dread f15 [4194304,4194304] 0 2024-02-19T19:07:28.109 INFO:tasks.workunit.client.1.smithi142.stdout:9/138: write db/d10/d22/d24/f25 [1997142,43934] 0 2024-02-19T19:07:28.112 INFO:tasks.workunit.client.1.smithi142.stdout:2/130: sync 2024-02-19T19:07:28.114 INFO:tasks.workunit.client.1.smithi142.stdout:2/131: rename d3/df/c13 to d3/df/c28 0 2024-02-19T19:07:28.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/132: truncate d3/f5 1362464 0 2024-02-19T19:07:28.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/133: readlink d3/l22 0 2024-02-19T19:07:28.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/134: stat d3/db/f23 0 2024-02-19T19:07:28.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/135: mkdir d3/db/d29 0 2024-02-19T19:07:28.120 INFO:tasks.workunit.client.1.smithi142.stdout:9/139: dread db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:28.120 INFO:tasks.workunit.client.1.smithi142.stdout:9/140: dread - db/d10/f15 zero size 2024-02-19T19:07:28.121 INFO:tasks.workunit.client.1.smithi142.stdout:9/141: mkdir db/d29 0 2024-02-19T19:07:28.124 INFO:tasks.workunit.client.1.smithi142.stdout:4/152: dwrite d4/d14/f2f [0,4194304] 0 2024-02-19T19:07:28.124 INFO:tasks.workunit.client.1.smithi142.stdout:9/142: dread db/d10/f28 [0,4194304] 0 2024-02-19T19:07:28.126 INFO:tasks.workunit.client.1.smithi142.stdout:4/153: symlink d4/dc/dd/d10/l30 0 2024-02-19T19:07:28.127 INFO:tasks.workunit.client.1.smithi142.stdout:9/143: link db/l21 db/d10/d22/d24/l2a 0 2024-02-19T19:07:28.128 INFO:tasks.workunit.client.1.smithi142.stdout:2/136: write d3/db/fc [4746109,32639] 0 2024-02-19T19:07:28.128 INFO:tasks.workunit.client.1.smithi142.stdout:2/137: write d3/df/f12 [4288162,53845] 0 2024-02-19T19:07:28.128 INFO:tasks.workunit.client.1.smithi142.stdout:2/138: readlink d3/df/l19 0 2024-02-19T19:07:28.128 INFO:tasks.workunit.client.1.smithi142.stdout:2/139: truncate d3/db/f15 633588 0 2024-02-19T19:07:28.128 INFO:tasks.workunit.client.1.smithi142.stdout:4/154: mkdir d4/d14/d31 0 2024-02-19T19:07:28.129 INFO:tasks.workunit.client.1.smithi142.stdout:4/155: link d4/dc/d12/d2d/c23 d4/dc/d12/d2d/c32 0 2024-02-19T19:07:28.130 INFO:tasks.workunit.client.1.smithi142.stdout:4/156: creat d4/dc/d12/d2d/f33 x:0 0 0 2024-02-19T19:07:28.130 INFO:tasks.workunit.client.1.smithi142.stdout:4/157: chown d4/dc/d12/d2d/f33 414 1 2024-02-19T19:07:28.131 INFO:tasks.workunit.client.1.smithi142.stdout:4/158: mkdir d4/d34 0 2024-02-19T19:07:28.137 INFO:tasks.workunit.client.1.smithi142.stdout:4/159: dread d4/d14/f16 [0,4194304] 0 2024-02-19T19:07:28.138 INFO:tasks.workunit.client.1.smithi142.stdout:4/160: chown d4/d14/l25 0 1 2024-02-19T19:07:28.138 INFO:tasks.workunit.client.1.smithi142.stdout:4/161: creat d4/d1d/f35 x:0 0 0 2024-02-19T19:07:28.143 INFO:tasks.workunit.client.1.smithi142.stdout:2/140: dwrite f0 [0,4194304] 0 2024-02-19T19:07:28.143 INFO:tasks.workunit.client.1.smithi142.stdout:2/141: dread - d3/db/f20 zero size 2024-02-19T19:07:28.145 INFO:tasks.workunit.client.1.smithi142.stdout:4/162: read d4/dc/dd/f1a [2841501,53243] 0 2024-02-19T19:07:28.148 INFO:tasks.workunit.client.1.smithi142.stdout:2/142: dread d3/f8 [0,4194304] 0 2024-02-19T19:07:28.151 INFO:tasks.workunit.client.1.smithi142.stdout:2/143: link d3/f27 d3/df/f2a 0 2024-02-19T19:07:28.151 INFO:tasks.workunit.client.1.smithi142.stdout:2/144: creat d3/df/f2b x:0 0 0 2024-02-19T19:07:28.155 INFO:tasks.workunit.client.1.smithi142.stdout:2/145: getdents d3 0 2024-02-19T19:07:28.155 INFO:tasks.workunit.client.1.smithi142.stdout:2/146: chown d3/df/f2a 0 1 2024-02-19T19:07:28.155 INFO:tasks.workunit.client.1.smithi142.stdout:2/147: creat d3/df/f2c x:0 0 0 2024-02-19T19:07:28.160 INFO:tasks.workunit.client.1.smithi142.stdout:4/163: dwrite d4/d1c/f22 [0,4194304] 0 2024-02-19T19:07:28.160 INFO:tasks.workunit.client.1.smithi142.stdout:4/164: chown d4/dc/d12/f18 1083 1 2024-02-19T19:07:28.160 INFO:tasks.workunit.client.1.smithi142.stdout:4/165: fdatasync d4/dc/d12/f18 0 2024-02-19T19:07:28.163 INFO:tasks.workunit.client.1.smithi142.stdout:4/166: creat d4/dc/dd/d10/f36 x:0 0 0 2024-02-19T19:07:28.163 INFO:tasks.workunit.client.1.smithi142.stdout:4/167: chown d4 1037 1 2024-02-19T19:07:28.163 INFO:tasks.workunit.client.1.smithi142.stdout:4/168: write d4/dc/d12/d2d/f33 [728510,57572] 0 2024-02-19T19:07:28.165 INFO:tasks.workunit.client.1.smithi142.stdout:4/169: rename d4/dc/d12/d2d/c32 to d4/dc/d2c/c37 0 2024-02-19T19:07:28.165 INFO:tasks.workunit.client.1.smithi142.stdout:4/170: creat d4/d14/d31/f38 x:0 0 0 2024-02-19T19:07:28.167 INFO:tasks.workunit.client.1.smithi142.stdout:4/171: rename d4/d1d/l2b to d4/dc/dd/d10/d26/l39 0 2024-02-19T19:07:28.168 INFO:tasks.workunit.client.1.smithi142.stdout:4/172: symlink d4/dc/d12/l3a 0 2024-02-19T19:07:28.171 INFO:tasks.workunit.client.1.smithi142.stdout:2/148: dwrite d3/db/f23 [0,4194304] 0 2024-02-19T19:07:28.171 INFO:tasks.workunit.client.1.smithi142.stdout:2/149: read - d3/df/f2b zero size 2024-02-19T19:07:28.177 INFO:tasks.workunit.client.1.smithi142.stdout:2/150: write d3/df/f2a [1595962,39128] 0 2024-02-19T19:07:28.179 INFO:tasks.workunit.client.1.smithi142.stdout:2/151: symlink d3/db/l2d 0 2024-02-19T19:07:28.193 INFO:tasks.workunit.client.1.smithi142.stdout:4/173: dwrite d4/dc/dd/d10/f36 [0,4194304] 0 2024-02-19T19:07:28.193 INFO:tasks.workunit.client.1.smithi142.stdout:4/174: fsync d4/d14/d31/f38 0 2024-02-19T19:07:28.194 INFO:tasks.workunit.client.1.smithi142.stdout:2/152: dwrite d3/f16 [0,4194304] 0 2024-02-19T19:07:28.197 INFO:tasks.workunit.client.1.smithi142.stdout:2/153: link d3/df/c1a d3/df/c2e 0 2024-02-19T19:07:28.197 INFO:tasks.workunit.client.1.smithi142.stdout:2/154: write d3/f8 [1787474,92245] 0 2024-02-19T19:07:28.197 INFO:tasks.workunit.client.1.smithi142.stdout:2/155: fsync d3/f1f 0 2024-02-19T19:07:28.197 INFO:tasks.workunit.client.1.smithi142.stdout:2/156: write d3/db/f23 [4440146,83965] 0 2024-02-19T19:07:28.198 INFO:tasks.workunit.client.1.smithi142.stdout:4/175: dread d4/dc/d12/f18 [0,4194304] 0 2024-02-19T19:07:28.198 INFO:tasks.workunit.client.1.smithi142.stdout:4/176: truncate d4/d14/f2f 5109144 0 2024-02-19T19:07:28.198 INFO:tasks.workunit.client.1.smithi142.stdout:4/177: dread - d4/d1d/f35 zero size 2024-02-19T19:07:28.199 INFO:tasks.workunit.client.1.smithi142.stdout:2/157: mknod d3/db/c2f 0 2024-02-19T19:07:28.200 INFO:tasks.workunit.client.1.smithi142.stdout:4/178: mkdir d4/dc/dd/d10/d3b 0 2024-02-19T19:07:28.200 INFO:tasks.workunit.client.1.smithi142.stdout:4/179: write d4/dc/d12/d2d/f33 [1485063,47745] 0 2024-02-19T19:07:28.201 INFO:tasks.workunit.client.1.smithi142.stdout:2/158: symlink d3/df/l30 0 2024-02-19T19:07:28.201 INFO:tasks.workunit.client.1.smithi142.stdout:2/159: chown d3/f27 2 1 2024-02-19T19:07:28.202 INFO:tasks.workunit.client.1.smithi142.stdout:4/180: mkdir d4/dc/dd/d3c 0 2024-02-19T19:07:28.202 INFO:tasks.workunit.client.1.smithi142.stdout:4/181: truncate d4/dc/d12/d2d/f33 1640637 0 2024-02-19T19:07:28.202 INFO:tasks.workunit.client.1.smithi142.stdout:4/182: fdatasync d4/dc/dd/f1a 0 2024-02-19T19:07:28.203 INFO:tasks.workunit.client.1.smithi142.stdout:4/183: creat d4/dc/d2c/f3d x:0 0 0 2024-02-19T19:07:28.204 INFO:tasks.workunit.client.1.smithi142.stdout:7/105: sync 2024-02-19T19:07:28.204 INFO:tasks.workunit.client.1.smithi142.stdout:7/106: write d0/fd [1499581,37430] 0 2024-02-19T19:07:28.206 INFO:tasks.workunit.client.1.smithi142.stdout:4/184: rename d4/dc/dd/d3c to d4/dc/dd/d10/d3e 0 2024-02-19T19:07:28.207 INFO:tasks.workunit.client.1.smithi142.stdout:7/107: stat d0/lb 0 2024-02-19T19:07:28.207 INFO:tasks.workunit.client.1.smithi142.stdout:7/108: write d0/d13/f1f [900029,63450] 0 2024-02-19T19:07:28.208 INFO:tasks.workunit.client.1.smithi142.stdout:4/185: truncate d4/dc/dd/f1a 1977539 0 2024-02-19T19:07:28.208 INFO:tasks.workunit.client.1.smithi142.stdout:4/186: dread - d4/dc/f27 zero size 2024-02-19T19:07:28.210 INFO:tasks.workunit.client.1.smithi142.stdout:7/109: creat d0/d1b/d21/d24/d29/f2c x:0 0 0 2024-02-19T19:07:28.210 INFO:tasks.workunit.client.1.smithi142.stdout:7/110: write d0/f16 [5122937,28664] 0 2024-02-19T19:07:28.210 INFO:tasks.workunit.client.1.smithi142.stdout:7/111: chown d0/d13/d1e/d22 2 1 2024-02-19T19:07:28.211 INFO:tasks.workunit.client.1.smithi142.stdout:4/187: truncate d4/d14/f16 2775882 0 2024-02-19T19:07:28.212 INFO:tasks.workunit.client.1.smithi142.stdout:4/188: mkdir d4/dc/dd/d10/d3b/d3f 0 2024-02-19T19:07:28.213 INFO:tasks.workunit.client.1.smithi142.stdout:4/189: chown d4/d1c 3894 1 2024-02-19T19:07:28.216 INFO:tasks.workunit.client.1.smithi142.stdout:7/112: write d0/d13/f15 [1287639,22652] 0 2024-02-19T19:07:28.223 INFO:tasks.workunit.client.1.smithi142.stdout:4/190: write d4/d1c/f22 [2346661,49438] 0 2024-02-19T19:07:28.225 INFO:tasks.workunit.client.1.smithi142.stdout:4/191: creat d4/dc/d12/f40 x:0 0 0 2024-02-19T19:07:28.241 INFO:tasks.workunit.client.1.smithi142.stdout:7/113: dwrite d0/d13/f27 [0,4194304] 0 2024-02-19T19:07:28.241 INFO:tasks.workunit.client.1.smithi142.stdout:4/192: dwrite d4/dc/f27 [0,4194304] 0 2024-02-19T19:07:28.244 INFO:tasks.workunit.client.1.smithi142.stdout:7/114: mkdir d0/d1b/d21/d24/d29/d2d 0 2024-02-19T19:07:28.246 INFO:tasks.workunit.client.1.smithi142.stdout:4/193: mknod d4/d34/c41 0 2024-02-19T19:07:28.249 INFO:tasks.workunit.client.1.smithi142.stdout:4/194: mkdir d4/d1d/d42 0 2024-02-19T19:07:28.249 INFO:tasks.workunit.client.1.smithi142.stdout:4/195: write d4/f5 [2641832,120048] 0 2024-02-19T19:07:28.249 INFO:tasks.workunit.client.1.smithi142.stdout:7/115: truncate d0/d13/f27 126478 0 2024-02-19T19:07:28.250 INFO:tasks.workunit.client.1.smithi142.stdout:4/196: mkdir d4/d14/d31/d43 0 2024-02-19T19:07:28.251 INFO:tasks.workunit.client.1.smithi142.stdout:4/197: chown d4/dc/d12 466714 1 2024-02-19T19:07:28.251 INFO:tasks.workunit.client.1.smithi142.stdout:4/198: chown d4/d14/d31 27850 1 2024-02-19T19:07:28.251 INFO:tasks.workunit.client.1.smithi142.stdout:7/116: creat d0/d1b/d21/d24/d29/d2d/f2e x:0 0 0 2024-02-19T19:07:28.252 INFO:tasks.workunit.client.1.smithi142.stdout:7/117: chown d0/fc 2 1 2024-02-19T19:07:28.253 INFO:tasks.workunit.client.1.smithi142.stdout:4/199: mkdir d4/d34/d44 0 2024-02-19T19:07:28.291 INFO:tasks.workunit.client.1.smithi142.stdout:7/118: symlink d0/d1b/d21/d24/d29/l2f 0 2024-02-19T19:07:28.293 INFO:tasks.workunit.client.1.smithi142.stdout:4/200: link d4/d14/l25 d4/d1c/l45 0 2024-02-19T19:07:28.295 INFO:tasks.workunit.client.1.smithi142.stdout:7/119: rename d0/f10 to d0/d1b/d21/d24/f30 0 2024-02-19T19:07:28.296 INFO:tasks.workunit.client.1.smithi142.stdout:7/120: mkdir d0/d1b/d21/d24/d31 0 2024-02-19T19:07:28.305 INFO:tasks.workunit.client.1.smithi142.stdout:4/201: dwrite d4/dc/f27 [4194304,4194304] 0 2024-02-19T19:07:28.305 INFO:tasks.workunit.client.1.smithi142.stdout:4/202: write d4/dc/d2c/f3d [545870,41282] 0 2024-02-19T19:07:28.309 INFO:tasks.workunit.client.1.smithi142.stdout:7/121: truncate d0/d13/f15 2614534 0 2024-02-19T19:07:28.309 INFO:tasks.workunit.client.1.smithi142.stdout:7/122: readlink d0/l17 0 2024-02-19T19:07:28.310 INFO:tasks.workunit.client.1.smithi142.stdout:4/203: mknod d4/dc/d12/c46 0 2024-02-19T19:07:28.312 INFO:tasks.workunit.client.1.smithi142.stdout:7/123: mkdir d0/d1b/d21/d32 0 2024-02-19T19:07:28.314 INFO:tasks.workunit.client.1.smithi142.stdout:4/204: unlink d4/dc/dd/d10/c1b 0 2024-02-19T19:07:28.316 INFO:tasks.workunit.client.1.smithi142.stdout:4/205: mknod d4/d14/d31/c47 0 2024-02-19T19:07:28.316 INFO:tasks.workunit.client.1.smithi142.stdout:4/206: fsync d4/dc/d12/f18 0 2024-02-19T19:07:28.325 INFO:tasks.workunit.client.1.smithi142.stdout:7/124: dwrite d0/d1b/d21/d24/f30 [0,4194304] 0 2024-02-19T19:07:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: pgmap v70: 65 pgs: 12 stale+active+clean, 53 active+clean; 106 MiB data, 578 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s wr, 11 op/s 2024-02-19T19:07:28.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/317930673' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:07:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 5]}]': finished 2024-02-19T19:07:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 1]}]': finished 2024-02-19T19:07:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 1]}]': finished 2024-02-19T19:07:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 1]}]': finished 2024-02-19T19:07:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 1, 3, 2]}]': finished 2024-02-19T19:07:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [3, 0]}]': finished 2024-02-19T19:07:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]}]': finished 2024-02-19T19:07:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [3, 1]}]': finished 2024-02-19T19:07:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 2]}]': finished 2024-02-19T19:07:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:28 smithi046 ceph-mon[88928]: osdmap e57: 6 total, 5 up, 6 in 2024-02-19T19:07:29.102 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-19T19:07:29.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: pgmap v70: 65 pgs: 12 stale+active+clean, 53 active+clean; 106 MiB data, 578 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s wr, 11 op/s 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/317930673' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [0, 5]}]': finished 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 1]}]': finished 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [0, 1]}]': finished 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [3, 1]}]': finished 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [0, 1, 3, 2]}]': finished 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [3, 0]}]': finished 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]}]': finished 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [3, 1]}]': finished 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 2]}]': finished 2024-02-19T19:07:29.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:28 smithi142 ceph-mon[69118]: osdmap e57: 6 total, 5 up, 6 in 2024-02-19T19:07:29.530 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-19T19:07:29.573 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-19T19:07:29.575 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-19T19:07:29.575 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-19T19:07:29.615 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-19T19:07:29.618 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T19:07:29.619 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-19T19:07:29.637 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-19T19:07:29.638 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-19T19:07:29.638 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ce7ea8877c709fa862eac608550374bd96e166e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-19T19:07:29.696 INFO:tasks.workunit.client.0.smithi046.stderr:+ mkdir -p fsstress 2024-02-19T19:07:29.698 INFO:tasks.workunit.client.0.smithi046.stderr:+ pushd fsstress 2024-02-19T19:07:29.699 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-19T19:07:29.699 INFO:tasks.workunit.client.0.smithi046.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-19T19:07:29.799 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:29 smithi046 podman[106004]: 2024-02-19 19:07:29.498442414 +0000 UTC m=+5.085892154 container cleanup 5ffd1526df8c406ade75450a6327ab6b200233ece1981bc78a91a3f93581858d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD) 2024-02-19T19:07:29.799 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:29 smithi046 bash[106004]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1 2024-02-19T19:07:29.816 INFO:tasks.workunit.client.1.smithi142.stdout:6/108: write d2/f18 [2139146,26177] 0 2024-02-19T19:07:29.818 INFO:tasks.workunit.client.1.smithi142.stdout:6/109: rmdir d2/d17 39 2024-02-19T19:07:29.820 INFO:tasks.workunit.client.1.smithi142.stdout:5/81: write d5/dd/df/f12 [918641,81575] 0 2024-02-19T19:07:29.822 INFO:tasks.workunit.client.1.smithi142.stdout:8/126: dread d9/dd/f17 [0,4194304] 0 2024-02-19T19:07:29.822 INFO:tasks.workunit.client.1.smithi142.stdout:8/127: creat d9/dd/d15/f22 x:0 0 0 2024-02-19T19:07:29.822 INFO:tasks.workunit.client.1.smithi142.stdout:8/128: readlink d9/l10 0 2024-02-19T19:07:29.822 INFO:tasks.workunit.client.1.smithi142.stdout:8/129: truncate d9/dd/de/d14/f1a 4606793 0 2024-02-19T19:07:29.822 INFO:tasks.workunit.client.1.smithi142.stdout:8/130: creat d9/dd/d15/f23 x:0 0 0 2024-02-19T19:07:29.823 INFO:tasks.workunit.client.1.smithi142.stdout:5/82: mknod d5/dd/d8/c19 0 2024-02-19T19:07:29.823 INFO:tasks.workunit.client.1.smithi142.stdout:6/110: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:29.823 INFO:tasks.workunit.client.1.smithi142.stdout:6/111: write d2/d17/f1a [947413,63075] 0 2024-02-19T19:07:29.826 INFO:tasks.workunit.client.1.smithi142.stdout:8/131: link f2 d9/dd/de/f24 0 2024-02-19T19:07:29.827 INFO:tasks.workunit.client.1.smithi142.stdout:6/112: mkdir d2/d1e 0 2024-02-19T19:07:29.827 INFO:tasks.workunit.client.1.smithi142.stdout:6/113: chown d2/l10 0 1 2024-02-19T19:07:29.828 INFO:tasks.workunit.client.1.smithi142.stdout:0/106: write f15 [2804985,15457] 0 2024-02-19T19:07:29.829 INFO:tasks.workunit.client.1.smithi142.stdout:8/132: creat d9/dd/de/d14/d21/f25 x:0 0 0 2024-02-19T19:07:29.829 INFO:tasks.workunit.client.1.smithi142.stdout:6/114: mkdir d2/d1f 0 2024-02-19T19:07:29.830 INFO:tasks.workunit.client.1.smithi142.stdout:1/124: dread d5/d7/f19 [0,4194304] 0 2024-02-19T19:07:29.835 INFO:tasks.workunit.client.1.smithi142.stdout:5/83: dread d5/fe [0,4194304] 0 2024-02-19T19:07:29.836 INFO:tasks.workunit.client.1.smithi142.stdout:1/125: unlink d5/d7/l18 0 2024-02-19T19:07:29.837 INFO:tasks.workunit.client.1.smithi142.stdout:1/126: dread - d5/f1f zero size 2024-02-19T19:07:29.838 INFO:tasks.workunit.client.1.smithi142.stdout:6/115: read d2/f14 [2109562,68545] 0 2024-02-19T19:07:29.838 INFO:tasks.workunit.client.1.smithi142.stdout:1/127: truncate d5/fd 8433522 0 2024-02-19T19:07:29.841 INFO:tasks.workunit.client.1.smithi142.stdout:1/128: creat d5/d7/d23/f2a x:0 0 0 2024-02-19T19:07:29.841 INFO:tasks.workunit.client.1.smithi142.stdout:1/129: chown d5/d7/fe 106 1 2024-02-19T19:07:29.844 INFO:tasks.workunit.client.1.smithi142.stdout:5/84: dread d5/f18 [0,4194304] 0 2024-02-19T19:07:29.844 INFO:tasks.workunit.client.1.smithi142.stdout:5/85: getdents d5/dd/df/d15 0 2024-02-19T19:07:29.849 INFO:tasks.workunit.client.1.smithi142.stdout:6/116: dread d2/d17/f1a [0,4194304] 0 2024-02-19T19:07:29.849 INFO:tasks.workunit.client.1.smithi142.stdout:6/117: chown d2/c1b 216 1 2024-02-19T19:07:29.852 INFO:tasks.workunit.client.1.smithi142.stdout:8/133: dwrite f7 [0,4194304] 0 2024-02-19T19:07:29.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/134: rename d9 to d9/dd/de/d26 22 2024-02-19T19:07:29.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/135: write d9/dd/d15/f22 [312384,38536] 0 2024-02-19T19:07:29.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/136: write d9/fc [1564246,102419] 0 2024-02-19T19:07:29.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/137: stat d9/dd/de 0 2024-02-19T19:07:29.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/138: write d9/dd/f1d [1436792,105809] 0 2024-02-19T19:07:29.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/139: creat d9/dd/de/d14/d21/f27 x:0 0 0 2024-02-19T19:07:29.856 INFO:tasks.workunit.client.1.smithi142.stdout:8/140: write d9/dd/f1d [1432600,94675] 0 2024-02-19T19:07:29.856 INFO:tasks.workunit.client.1.smithi142.stdout:8/141: read f1 [3614345,16513] 0 2024-02-19T19:07:29.858 INFO:tasks.workunit.client.1.smithi142.stdout:0/107: dwrite fb [0,4194304] 0 2024-02-19T19:07:29.861 INFO:tasks.workunit.client.1.smithi142.stdout:0/108: rmdir d23 39 2024-02-19T19:07:29.862 INFO:tasks.workunit.client.1.smithi142.stdout:6/118: dread d2/f18 [0,4194304] 0 2024-02-19T19:07:29.863 INFO:tasks.workunit.client.1.smithi142.stdout:0/109: getdents d23 0 2024-02-19T19:07:29.863 INFO:tasks.workunit.client.1.smithi142.stdout:0/110: stat f3 0 2024-02-19T19:07:29.865 INFO:tasks.workunit.client.1.smithi142.stdout:0/111: rename f3 to d23/f25 0 2024-02-19T19:07:29.867 INFO:tasks.workunit.client.1.smithi142.stdout:8/142: dread f2 [0,4194304] 0 2024-02-19T19:07:29.867 INFO:tasks.workunit.client.1.smithi142.stdout:8/143: write d9/dd/f1d [2212634,6813] 0 2024-02-19T19:07:29.867 INFO:tasks.workunit.client.1.smithi142.stdout:0/112: truncate f16 6414867 0 2024-02-19T19:07:29.867 INFO:tasks.workunit.client.1.smithi142.stdout:0/113: chown c1c 1519950572 1 2024-02-19T19:07:29.867 INFO:tasks.workunit.client.1.smithi142.stdout:8/144: truncate f1 3821416 0 2024-02-19T19:07:29.870 INFO:tasks.workunit.client.1.smithi142.stdout:8/145: rename d9/f13 to d9/dd/d15/f28 0 2024-02-19T19:07:29.870 INFO:tasks.workunit.client.1.smithi142.stdout:8/146: write d9/dd/de/d14/d21/f25 [236133,84649] 0 2024-02-19T19:07:29.870 INFO:tasks.workunit.client.1.smithi142.stdout:6/119: dread d2/f14 [0,4194304] 0 2024-02-19T19:07:29.870 INFO:tasks.workunit.client.1.smithi142.stdout:1/130: dwrite d5/d7/fe [0,4194304] 0 2024-02-19T19:07:29.871 INFO:tasks.workunit.client.1.smithi142.stdout:8/147: symlink d9/dd/de/l29 0 2024-02-19T19:07:29.871 INFO:tasks.workunit.client.1.smithi142.stdout:8/148: chown d9/dd/de/f24 4077 1 2024-02-19T19:07:29.872 INFO:tasks.workunit.client.1.smithi142.stdout:5/86: dwrite d5/dd/df/f12 [0,4194304] 0 2024-02-19T19:07:29.881 INFO:tasks.workunit.client.1.smithi142.stdout:8/149: dread d9/dd/de/d14/f1a [0,4194304] 0 2024-02-19T19:07:29.883 INFO:tasks.workunit.client.1.smithi142.stdout:1/131: rename d5/f1f to d5/f2b 0 2024-02-19T19:07:29.883 INFO:tasks.workunit.client.1.smithi142.stdout:1/132: dread - d5/d7/f25 zero size 2024-02-19T19:07:29.883 INFO:tasks.workunit.client.1.smithi142.stdout:1/133: write d5/d7/d23/f2a [543471,99345] 0 2024-02-19T19:07:29.883 INFO:tasks.workunit.client.1.smithi142.stdout:1/134: chown d5/fd 18108 1 2024-02-19T19:07:29.884 INFO:tasks.workunit.client.1.smithi142.stdout:1/135: mkdir d5/d7/d23/d2c 0 2024-02-19T19:07:29.912 INFO:tasks.workunit.client.1.smithi142.stdout:3/116: sync 2024-02-19T19:07:29.914 INFO:tasks.workunit.client.1.smithi142.stdout:3/117: mkdir d1d 0 2024-02-19T19:07:29.914 INFO:tasks.workunit.client.1.smithi142.stdout:3/118: truncate f1a 735296 0 2024-02-19T19:07:29.915 INFO:tasks.workunit.client.1.smithi142.stdout:3/119: mkdir d1d/d1e 0 2024-02-19T19:07:29.915 INFO:tasks.workunit.client.1.smithi142.stdout:3/120: stat fa 0 2024-02-19T19:07:29.916 INFO:tasks.workunit.client.1.smithi142.stdout:3/121: truncate f4 664360 0 2024-02-19T19:07:29.921 INFO:tasks.workunit.client.1.smithi142.stdout:8/150: dread f0 [0,4194304] 0 2024-02-19T19:07:29.924 INFO:tasks.workunit.client.1.smithi142.stdout:9/144: sync 2024-02-19T19:07:29.927 INFO:tasks.workunit.client.1.smithi142.stdout:5/87: write d5/dd/df/f12 [5222701,106996] 0 2024-02-19T19:07:29.928 INFO:tasks.workunit.client.1.smithi142.stdout:6/120: dwrite d2/d17/f19 [0,4194304] 0 2024-02-19T19:07:29.930 INFO:tasks.workunit.client.1.smithi142.stdout:5/88: rmdir d5 39 2024-02-19T19:07:29.930 INFO:tasks.workunit.client.1.smithi142.stdout:5/89: readlink l2 0 2024-02-19T19:07:29.933 INFO:tasks.workunit.client.1.smithi142.stdout:6/121: mkdir d2/d1f/d20 0 2024-02-19T19:07:29.934 INFO:tasks.workunit.client.1.smithi142.stdout:5/90: mkdir d5/dd/df/d15/d1a 0 2024-02-19T19:07:29.935 INFO:tasks.workunit.client.1.smithi142.stdout:5/91: symlink d5/dd/df/d15/d1a/l1b 0 2024-02-19T19:07:29.935 INFO:tasks.workunit.client.1.smithi142.stdout:5/92: chown d5 114126 1 2024-02-19T19:07:29.935 INFO:tasks.workunit.client.1.smithi142.stdout:1/136: truncate d5/d7/d23/f2a 30353 0 2024-02-19T19:07:29.936 INFO:tasks.workunit.client.1.smithi142.stdout:1/137: readlink d5/d7/l14 0 2024-02-19T19:07:29.936 INFO:tasks.workunit.client.1.smithi142.stdout:8/151: dwrite d9/dd/d15/f1f [0,4194304] 0 2024-02-19T19:07:29.937 INFO:tasks.workunit.client.1.smithi142.stdout:5/93: mkdir d5/dd/d8/d1c 0 2024-02-19T19:07:29.937 INFO:tasks.workunit.client.1.smithi142.stdout:5/94: fsync d5/dd/df/f12 0 2024-02-19T19:07:29.937 INFO:tasks.workunit.client.1.smithi142.stdout:5/95: fsync f4 0 2024-02-19T19:07:29.941 INFO:tasks.workunit.client.1.smithi142.stdout:3/122: dwrite f10 [0,4194304] 0 2024-02-19T19:07:29.941 INFO:tasks.workunit.client.1.smithi142.stdout:5/96: dread d5/f13 [4194304,4194304] 0 2024-02-19T19:07:29.941 INFO:tasks.workunit.client.1.smithi142.stdout:1/138: creat d5/f2d x:0 0 0 2024-02-19T19:07:29.942 INFO:tasks.workunit.client.1.smithi142.stdout:8/152: symlink d9/l2a 0 2024-02-19T19:07:29.944 INFO:tasks.workunit.client.1.smithi142.stdout:7/125: sync 2024-02-19T19:07:29.944 INFO:tasks.workunit.client.1.smithi142.stdout:4/207: sync 2024-02-19T19:07:29.944 INFO:tasks.workunit.client.1.smithi142.stdout:7/126: stat d0/d13/d1e 0 2024-02-19T19:07:29.944 INFO:tasks.workunit.client.1.smithi142.stdout:3/123: rmdir d1d 39 2024-02-19T19:07:29.946 INFO:tasks.workunit.client.1.smithi142.stdout:5/97: link f4 d5/dd/f1d 0 2024-02-19T19:07:29.948 INFO:tasks.workunit.client.1.smithi142.stdout:1/139: symlink d5/d7/l2e 0 2024-02-19T19:07:29.948 INFO:tasks.workunit.client.1.smithi142.stdout:1/140: chown d5/f2d 4808408 1 2024-02-19T19:07:29.948 INFO:tasks.workunit.client.1.smithi142.stdout:1/141: fsync d5/d7/fe 0 2024-02-19T19:07:29.948 INFO:tasks.workunit.client.1.smithi142.stdout:1/142: getdents d5/d7/d23/d2c 0 2024-02-19T19:07:29.950 INFO:tasks.workunit.client.1.smithi142.stdout:2/160: sync 2024-02-19T19:07:29.951 INFO:tasks.workunit.client.1.smithi142.stdout:4/208: creat d4/d14/d31/d43/f48 x:0 0 0 2024-02-19T19:07:29.952 INFO:tasks.workunit.client.1.smithi142.stdout:3/124: mknod d1d/d1e/c1f 0 2024-02-19T19:07:29.954 INFO:tasks.workunit.client.1.smithi142.stdout:5/98: creat d5/dd/f1e x:0 0 0 2024-02-19T19:07:29.954 INFO:tasks.workunit.client.1.smithi142.stdout:5/99: readlink d5/dd/df/l11 0 2024-02-19T19:07:29.954 INFO:tasks.workunit.client.1.smithi142.stdout:5/100: chown d5/dd/d8 18340 1 2024-02-19T19:07:29.955 INFO:tasks.workunit.client.1.smithi142.stdout:1/143: truncate d5/f28 13942 0 2024-02-19T19:07:29.957 INFO:tasks.workunit.client.1.smithi142.stdout:8/153: getdents d9 0 2024-02-19T19:07:29.957 INFO:tasks.workunit.client.1.smithi142.stdout:8/154: readlink d9/dd/de/l29 0 2024-02-19T19:07:29.958 INFO:tasks.workunit.client.1.smithi142.stdout:7/127: rmdir d0/d13 39 2024-02-19T19:07:29.958 INFO:tasks.workunit.client.1.smithi142.stdout:7/128: write d0/d1b/d21/d24/d29/f2c [252075,78607] 0 2024-02-19T19:07:29.958 INFO:tasks.workunit.client.1.smithi142.stdout:8/155: write d9/fc [736923,42093] 0 2024-02-19T19:07:29.959 INFO:tasks.workunit.client.1.smithi142.stdout:6/122: dwrite d2/f18 [0,4194304] 0 2024-02-19T19:07:29.959 INFO:tasks.workunit.client.1.smithi142.stdout:4/209: dread d4/dc/d2c/f3d [0,4194304] 0 2024-02-19T19:07:29.960 INFO:tasks.workunit.client.1.smithi142.stdout:2/161: unlink d3/fe 0 2024-02-19T19:07:29.960 INFO:tasks.workunit.client.1.smithi142.stdout:2/162: chown d3/db/f25 37 1 2024-02-19T19:07:29.961 INFO:tasks.workunit.client.1.smithi142.stdout:3/125: rmdir d1d 39 2024-02-19T19:07:29.961 INFO:tasks.workunit.client.1.smithi142.stdout:3/126: write f1a [1579087,12426] 0 2024-02-19T19:07:29.962 INFO:tasks.workunit.client.1.smithi142.stdout:5/101: getdents d5/dd/df/d15 0 2024-02-19T19:07:29.963 INFO:tasks.workunit.client.1.smithi142.stdout:1/144: write d5/d1a/d24/f26 [501006,97753] 0 2024-02-19T19:07:29.963 INFO:tasks.workunit.client.1.smithi142.stdout:1/145: fsync d5/d7/f19 0 2024-02-19T19:07:29.964 INFO:tasks.workunit.client.1.smithi142.stdout:7/129: dread d0/fd [0,4194304] 0 2024-02-19T19:07:29.965 INFO:tasks.workunit.client.1.smithi142.stdout:8/156: link d9/dd/de/d14/f20 d9/dd/de/f2b 0 2024-02-19T19:07:29.966 INFO:tasks.workunit.client.1.smithi142.stdout:6/123: mknod d2/d1e/c21 0 2024-02-19T19:07:29.966 INFO:tasks.workunit.client.1.smithi142.stdout:6/124: chown d2/ld 8303 1 2024-02-19T19:07:29.967 INFO:tasks.workunit.client.1.smithi142.stdout:4/210: mknod d4/dc/dd/d10/d3b/d3f/c49 0 2024-02-19T19:07:29.967 INFO:tasks.workunit.client.1.smithi142.stdout:4/211: write d4/d1d/f35 [406824,77503] 0 2024-02-19T19:07:29.969 INFO:tasks.workunit.client.1.smithi142.stdout:5/102: rename d5/dd/d8/c16 to d5/dd/d8/c1f 0 2024-02-19T19:07:29.969 INFO:tasks.workunit.client.1.smithi142.stdout:5/103: fdatasync d5/dd/d8/fb 0 2024-02-19T19:07:29.969 INFO:tasks.workunit.client.1.smithi142.stdout:5/104: fsync d5/dd/df/f12 0 2024-02-19T19:07:29.969 INFO:tasks.workunit.client.1.smithi142.stdout:5/105: stat d5/fe 0 2024-02-19T19:07:29.969 INFO:tasks.workunit.client.1.smithi142.stdout:1/146: symlink d5/d7/l2f 0 2024-02-19T19:07:29.971 INFO:tasks.workunit.client.1.smithi142.stdout:7/130: creat d0/d1b/d21/d24/d31/f33 x:0 0 0 2024-02-19T19:07:29.972 INFO:tasks.workunit.client.1.smithi142.stdout:8/157: creat d9/dd/de/f2c x:0 0 0 2024-02-19T19:07:29.973 INFO:tasks.workunit.client.1.smithi142.stdout:6/125: symlink d2/d1f/d20/l22 0 2024-02-19T19:07:29.974 INFO:tasks.workunit.client.1.smithi142.stdout:3/127: dread f1c [0,4194304] 0 2024-02-19T19:07:29.974 INFO:tasks.workunit.client.1.smithi142.stdout:4/212: rename d4/dc/dd/f1a to d4/dc/dd/f4a 0 2024-02-19T19:07:29.974 INFO:tasks.workunit.client.1.smithi142.stdout:4/213: creat d4/d1c/f4b x:0 0 0 2024-02-19T19:07:29.976 INFO:tasks.workunit.client.1.smithi142.stdout:5/106: creat d5/f20 x:0 0 0 2024-02-19T19:07:29.976 INFO:tasks.workunit.client.1.smithi142.stdout:1/147: mknod d5/d7/d23/d2c/c30 0 2024-02-19T19:07:29.977 INFO:tasks.workunit.client.1.smithi142.stdout:8/158: mkdir d9/dd/de/d2d 0 2024-02-19T19:07:29.977 INFO:tasks.workunit.client.1.smithi142.stdout:6/126: rmdir d2/d1f 39 2024-02-19T19:07:29.978 INFO:tasks.workunit.client.1.smithi142.stdout:7/131: getdents d0/d1b/d21 0 2024-02-19T19:07:29.978 INFO:tasks.workunit.client.1.smithi142.stdout:7/132: fdatasync d0/f2a 0 2024-02-19T19:07:29.979 INFO:tasks.workunit.client.1.smithi142.stdout:7/133: write d0/f9 [499555,14009] 0 2024-02-19T19:07:29.979 INFO:tasks.workunit.client.1.smithi142.stdout:2/163: dwrite d3/df/f2b [0,4194304] 0 2024-02-19T19:07:29.979 INFO:tasks.workunit.client.1.smithi142.stdout:2/164: creat d3/df/f31 x:0 0 0 2024-02-19T19:07:29.979 INFO:tasks.workunit.client.1.smithi142.stdout:1/148: mknod d5/d7/c31 0 2024-02-19T19:07:29.980 INFO:tasks.workunit.client.1.smithi142.stdout:8/159: mkdir d9/dd/de/d2d/d2e 0 2024-02-19T19:07:29.981 INFO:tasks.workunit.client.1.smithi142.stdout:7/134: chown d0/c6 20303 1 2024-02-19T19:07:29.982 INFO:tasks.workunit.client.1.smithi142.stdout:7/135: stat d0/l11 0 2024-02-19T19:07:29.986 INFO:tasks.workunit.client.1.smithi142.stdout:5/107: dread d5/f18 [0,4194304] 0 2024-02-19T19:07:29.992 INFO:tasks.workunit.client.1.smithi142.stdout:1/149: mknod d5/c32 0 2024-02-19T19:07:29.996 INFO:tasks.workunit.client.1.smithi142.stdout:5/108: write d5/fe [351103,71636] 0 2024-02-19T19:07:29.997 INFO:tasks.workunit.client.1.smithi142.stdout:5/109: symlink d5/dd/d8/l21 0 2024-02-19T19:07:29.999 INFO:tasks.workunit.client.1.smithi142.stdout:5/110: mkdir d5/dd/df/d22 0 2024-02-19T19:07:29.999 INFO:tasks.workunit.client.1.smithi142.stdout:5/111: symlink d5/dd/d8/d1c/l23 0 2024-02-19T19:07:30.002 INFO:tasks.workunit.client.1.smithi142.stdout:7/136: dread d0/f19 [0,4194304] 0 2024-02-19T19:07:30.003 INFO:tasks.workunit.client.1.smithi142.stdout:7/137: creat d0/d1b/d21/d24/f34 x:0 0 0 2024-02-19T19:07:30.003 INFO:tasks.workunit.client.1.smithi142.stdout:7/138: rename d0/d13/d1e to d0/d13/d1e/d22/d35 22 2024-02-19T19:07:30.006 INFO:tasks.workunit.client.1.smithi142.stdout:5/112: dread d5/f13 [0,4194304] 0 2024-02-19T19:07:30.007 INFO:tasks.workunit.client.1.smithi142.stdout:5/113: readlink d5/dd/d8/l21 0 2024-02-19T19:07:30.007 INFO:tasks.workunit.client.1.smithi142.stdout:5/114: creat d5/f24 x:0 0 0 2024-02-19T19:07:30.008 INFO:tasks.workunit.client.1.smithi142.stdout:5/115: unlink d5/dd/df/f14 0 2024-02-19T19:07:30.008 INFO:tasks.workunit.client.1.smithi142.stdout:5/116: fdatasync d5/dd/f1d 0 2024-02-19T19:07:30.008 INFO:tasks.workunit.client.1.smithi142.stdout:5/117: fdatasync d5/f13 0 2024-02-19T19:07:30.009 INFO:tasks.workunit.client.1.smithi142.stdout:5/118: creat d5/dd/df/d15/d1a/f25 x:0 0 0 2024-02-19T19:07:30.010 INFO:tasks.workunit.client.1.smithi142.stdout:5/119: readlink d5/dd/df/l11 0 2024-02-19T19:07:30.010 INFO:tasks.workunit.client.1.smithi142.stdout:5/120: creat d5/dd/df/d15/d1a/f26 x:0 0 0 2024-02-19T19:07:30.011 INFO:tasks.workunit.client.1.smithi142.stdout:3/128: dwrite f19 [0,4194304] 0 2024-02-19T19:07:30.011 INFO:tasks.workunit.client.1.smithi142.stdout:5/121: symlink d5/dd/df/d22/l27 0 2024-02-19T19:07:30.011 INFO:tasks.workunit.client.1.smithi142.stdout:5/122: write d5/fe [2628810,78157] 0 2024-02-19T19:07:30.012 INFO:tasks.workunit.client.1.smithi142.stdout:3/129: creat d1d/f20 x:0 0 0 2024-02-19T19:07:30.012 INFO:tasks.workunit.client.1.smithi142.stdout:5/123: truncate d5/dd/df/f12 5172006 0 2024-02-19T19:07:30.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/130: creat d1d/d1e/f21 x:0 0 0 2024-02-19T19:07:30.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/131: creat d1d/f22 x:0 0 0 2024-02-19T19:07:30.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/132: creat d1d/d1e/f23 x:0 0 0 2024-02-19T19:07:30.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/133: fsync fb 0 2024-02-19T19:07:30.015 INFO:tasks.workunit.client.1.smithi142.stdout:5/124: symlink d5/dd/d8/d1c/l28 0 2024-02-19T19:07:30.017 INFO:tasks.workunit.client.1.smithi142.stdout:3/134: link f18 d1d/f24 0 2024-02-19T19:07:30.018 INFO:tasks.workunit.client.1.smithi142.stdout:3/135: mknod d1d/c25 0 2024-02-19T19:07:30.023 INFO:tasks.workunit.client.1.smithi142.stdout:4/214: dwrite d4/dc/f13 [0,4194304] 0 2024-02-19T19:07:30.025 INFO:tasks.workunit.client.1.smithi142.stdout:8/160: dwrite d9/dd/f1c [0,4194304] 0 2024-02-19T19:07:30.025 INFO:tasks.workunit.client.1.smithi142.stdout:6/127: dwrite d2/f14 [0,4194304] 0 2024-02-19T19:07:30.025 INFO:tasks.workunit.client.1.smithi142.stdout:1/150: dwrite d5/d7/d23/f2a [0,4194304] 0 2024-02-19T19:07:30.034 INFO:tasks.workunit.client.1.smithi142.stdout:4/215: dread d4/d1c/f22 [0,4194304] 0 2024-02-19T19:07:30.034 INFO:tasks.workunit.client.1.smithi142.stdout:3/136: dwrite d1d/f24 [0,4194304] 0 2024-02-19T19:07:30.035 INFO:tasks.workunit.client.1.smithi142.stdout:2/165: rmdir d3 39 2024-02-19T19:07:30.035 INFO:tasks.workunit.client.1.smithi142.stdout:2/166: fsync d3/df/f31 0 2024-02-19T19:07:30.035 INFO:tasks.workunit.client.1.smithi142.stdout:3/137: truncate f4 1589862 0 2024-02-19T19:07:30.037 INFO:tasks.workunit.client.1.smithi142.stdout:7/139: dread d0/fd [0,4194304] 0 2024-02-19T19:07:30.038 INFO:tasks.workunit.client.1.smithi142.stdout:2/167: creat d3/df/f32 x:0 0 0 2024-02-19T19:07:30.039 INFO:tasks.workunit.client.1.smithi142.stdout:7/140: creat d0/d1b/d21/f36 x:0 0 0 2024-02-19T19:07:30.039 INFO:tasks.workunit.client.1.smithi142.stdout:7/141: truncate d0/d1b/d21/d24/d29/f2c 368210 0 2024-02-19T19:07:30.039 INFO:tasks.workunit.client.1.smithi142.stdout:7/142: chown d0/d1b/d21/d24/d29/f2c 35 1 2024-02-19T19:07:30.040 INFO:tasks.workunit.client.1.smithi142.stdout:2/168: mknod d3/db/d29/c33 0 2024-02-19T19:07:30.043 INFO:tasks.workunit.client.1.smithi142.stdout:7/143: rmdir d0/d1b/d21/d32 0 2024-02-19T19:07:30.048 INFO:tasks.workunit.client.1.smithi142.stdout:2/169: dread d3/f1f [0,4194304] 0 2024-02-19T19:07:30.048 INFO:tasks.workunit.client.1.smithi142.stdout:2/170: fdatasync d3/df/f2b 0 2024-02-19T19:07:30.050 INFO:tasks.workunit.client.1.smithi142.stdout:2/171: rename d3/fa to d3/db/f34 0 2024-02-19T19:07:30.053 INFO:tasks.workunit.client.1.smithi142.stdout:4/216: dread d4/dc/f27 [0,4194304] 0 2024-02-19T19:07:30.053 INFO:tasks.workunit.client.1.smithi142.stdout:4/217: fsync d4/dc/dd/f4a 0 2024-02-19T19:07:30.054 INFO:tasks.workunit.client.1.smithi142.stdout:4/218: creat d4/dc/d12/d2d/d2a/f4c x:0 0 0 2024-02-19T19:07:30.054 INFO:tasks.workunit.client.1.smithi142.stdout:4/219: write d4/d14/f16 [3683109,97786] 0 2024-02-19T19:07:30.059 INFO:tasks.workunit.client.1.smithi142.stdout:2/172: dread d3/db/f34 [0,4194304] 0 2024-02-19T19:07:30.060 INFO:tasks.workunit.client.1.smithi142.stdout:2/173: write d3/f1c [3854203,99918] 0 2024-02-19T19:07:30.060 INFO:tasks.workunit.client.1.smithi142.stdout:2/174: fdatasync d3/f5 0 2024-02-19T19:07:30.061 INFO:tasks.workunit.client.1.smithi142.stdout:2/175: mkdir d3/d35 0 2024-02-19T19:07:30.069 INFO:tasks.workunit.client.1.smithi142.stdout:8/161: dwrite d9/dd/f17 [4194304,4194304] 0 2024-02-19T19:07:30.069 INFO:tasks.workunit.client.1.smithi142.stdout:4/220: write d4/dc/f27 [6208688,44488] 0 2024-02-19T19:07:30.069 INFO:tasks.workunit.client.1.smithi142.stdout:1/151: dwrite d5/f28 [0,4194304] 0 2024-02-19T19:07:30.069 INFO:tasks.workunit.client.1.smithi142.stdout:1/152: fsync d5/d7/fe 0 2024-02-19T19:07:30.069 INFO:tasks.workunit.client.1.smithi142.stdout:5/125: dwrite d5/fe [4194304,4194304] 0 2024-02-19T19:07:30.070 INFO:tasks.workunit.client.1.smithi142.stdout:5/126: write d5/dd/df/d15/d1a/f25 [739415,12947] 0 2024-02-19T19:07:30.070 INFO:tasks.workunit.client.1.smithi142.stdout:5/127: dread - d5/dd/f1e zero size 2024-02-19T19:07:30.071 INFO:tasks.workunit.client.1.smithi142.stdout:8/162: symlink d9/dd/de/d2d/d2e/l2f 0 2024-02-19T19:07:30.071 INFO:tasks.workunit.client.1.smithi142.stdout:8/163: write f2 [3529356,90323] 0 2024-02-19T19:07:30.071 INFO:tasks.workunit.client.1.smithi142.stdout:8/164: stat d9/dd/de/f24 0 2024-02-19T19:07:30.071 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:29 smithi046 ceph-mon[88928]: osdmap e58: 6 total, 5 up, 6 in 2024-02-19T19:07:30.073 INFO:tasks.workunit.client.1.smithi142.stdout:1/153: truncate d5/d7/fe 4071013 0 2024-02-19T19:07:30.077 INFO:tasks.workunit.client.1.smithi142.stdout:2/176: dwrite f0 [0,4194304] 0 2024-02-19T19:07:30.079 INFO:tasks.workunit.client.1.smithi142.stdout:5/128: mkdir d5/dd/d8/d29 0 2024-02-19T19:07:30.080 INFO:tasks.workunit.client.1.smithi142.stdout:4/221: getdents d4/d1c 0 2024-02-19T19:07:30.082 INFO:tasks.workunit.client.1.smithi142.stdout:1/154: chown d5/c6 883 1 2024-02-19T19:07:30.082 INFO:tasks.workunit.client.1.smithi142.stdout:1/155: chown d5/d7/l14 2409836 1 2024-02-19T19:07:30.085 INFO:tasks.workunit.client.1.smithi142.stdout:1/156: mkdir d5/d1a/d33 0 2024-02-19T19:07:30.088 INFO:tasks.workunit.client.1.smithi142.stdout:4/222: symlink d4/dc/l4d 0 2024-02-19T19:07:30.089 INFO:tasks.workunit.client.1.smithi142.stdout:4/223: getdents d4/d1c 0 2024-02-19T19:07:30.089 INFO:tasks.workunit.client.1.smithi142.stdout:2/177: dread d3/f27 [0,4194304] 0 2024-02-19T19:07:30.091 INFO:tasks.workunit.client.1.smithi142.stdout:1/157: getdents d5/d7 0 2024-02-19T19:07:30.093 INFO:tasks.workunit.client.1.smithi142.stdout:8/165: dwrite d9/dd/f1c [4194304,4194304] 0 2024-02-19T19:07:30.093 INFO:tasks.workunit.client.1.smithi142.stdout:8/166: write d9/dd/de/d14/f20 [316699,113483] 0 2024-02-19T19:07:30.094 INFO:tasks.workunit.client.1.smithi142.stdout:2/178: rename d3/df/c1a to d3/d35/c36 0 2024-02-19T19:07:30.094 INFO:tasks.workunit.client.1.smithi142.stdout:5/129: dwrite d5/f13 [0,4194304] 0 2024-02-19T19:07:30.096 INFO:tasks.workunit.client.1.smithi142.stdout:4/224: dread d4/f5 [0,4194304] 0 2024-02-19T19:07:30.096 INFO:tasks.workunit.client.1.smithi142.stdout:3/138: dwrite d1d/f24 [4194304,4194304] 0 2024-02-19T19:07:30.097 INFO:tasks.workunit.client.1.smithi142.stdout:4/225: dread d4/dc/d12/f18 [0,4194304] 0 2024-02-19T19:07:30.098 INFO:tasks.workunit.client.1.smithi142.stdout:8/167: mkdir d9/dd/d15/d30 0 2024-02-19T19:07:30.101 INFO:tasks.workunit.client.1.smithi142.stdout:2/179: unlink d3/f27 0 2024-02-19T19:07:30.103 INFO:tasks.workunit.client.1.smithi142.stdout:5/130: mkdir d5/dd/d8/d2a 0 2024-02-19T19:07:30.107 INFO:tasks.workunit.client.1.smithi142.stdout:4/226: dread d4/d14/f2f [0,4194304] 0 2024-02-19T19:07:30.107 INFO:tasks.workunit.client.1.smithi142.stdout:4/227: stat d4/d34/d44 0 2024-02-19T19:07:30.107 INFO:tasks.workunit.client.1.smithi142.stdout:4/228: write d4/dc/d12/d2d/d2a/f4c [502439,106039] 0 2024-02-19T19:07:30.109 INFO:tasks.workunit.client.1.smithi142.stdout:3/139: getdents d1d/d1e 0 2024-02-19T19:07:30.113 INFO:tasks.workunit.client.1.smithi142.stdout:1/158: rename d5/d1a/d24 to d5/d7/d34 0 2024-02-19T19:07:30.113 INFO:tasks.workunit.client.1.smithi142.stdout:1/159: chown d5/d7/d23/d2c/c30 66367 1 2024-02-19T19:07:30.115 INFO:tasks.workunit.client.1.smithi142.stdout:5/131: dread d5/dd/d8/fb [0,4194304] 0 2024-02-19T19:07:30.115 INFO:tasks.workunit.client.1.smithi142.stdout:5/132: creat d5/dd/df/d15/d1a/f2b x:0 0 0 2024-02-19T19:07:30.115 INFO:tasks.workunit.client.1.smithi142.stdout:5/133: chown d5/dd/d8/c19 5740 1 2024-02-19T19:07:30.116 INFO:tasks.workunit.client.1.smithi142.stdout:2/180: rename d3/df/f2a to d3/d35/f37 0 2024-02-19T19:07:30.116 INFO:tasks.workunit.client.1.smithi142.stdout:3/140: rename d1d to d1d/d26 22 2024-02-19T19:07:30.116 INFO:tasks.workunit.client.1.smithi142.stdout:3/141: dread - f13 zero size 2024-02-19T19:07:30.116 INFO:tasks.workunit.client.1.smithi142.stdout:3/142: rename d1d to d1d/d27 22 2024-02-19T19:07:30.116 INFO:tasks.workunit.client.1.smithi142.stdout:3/143: chown d1d/f24 11937324 1 2024-02-19T19:07:30.120 INFO:tasks.workunit.client.1.smithi142.stdout:2/181: symlink d3/df/l38 0 2024-02-19T19:07:30.120 INFO:tasks.workunit.client.1.smithi142.stdout:2/182: chown d3/db/fc 0 1 2024-02-19T19:07:30.120 INFO:tasks.workunit.client.1.smithi142.stdout:2/183: chown d3/df/c2e 6712567 1 2024-02-19T19:07:30.121 INFO:tasks.workunit.client.1.smithi142.stdout:0/114: sync 2024-02-19T19:07:30.121 INFO:tasks.workunit.client.1.smithi142.stdout:0/115: stat fb 0 2024-02-19T19:07:30.122 INFO:tasks.workunit.client.1.smithi142.stdout:0/116: readlink l7 0 2024-02-19T19:07:30.122 INFO:tasks.workunit.client.1.smithi142.stdout:9/145: sync 2024-02-19T19:07:30.126 INFO:tasks.workunit.client.1.smithi142.stdout:4/229: dwrite d4/dc/d2c/f3d [0,4194304] 0 2024-02-19T19:07:30.126 INFO:tasks.workunit.client.1.smithi142.stdout:4/230: fdatasync d4/dc/d12/d2d/d2a/f4c 0 2024-02-19T19:07:30.126 INFO:tasks.workunit.client.1.smithi142.stdout:4/231: truncate d4/d14/f2f 6051386 0 2024-02-19T19:07:30.127 INFO:tasks.workunit.client.1.smithi142.stdout:0/117: mkdir d23/d26 0 2024-02-19T19:07:30.127 INFO:tasks.workunit.client.1.smithi142.stdout:0/118: fdatasync f1a 0 2024-02-19T19:07:30.127 INFO:tasks.workunit.client.1.smithi142.stdout:0/119: readlink l1e 0 2024-02-19T19:07:30.131 INFO:tasks.workunit.client.1.smithi142.stdout:0/120: write fb [4647332,31448] 0 2024-02-19T19:07:30.133 INFO:tasks.workunit.client.1.smithi142.stdout:8/168: truncate f2 3419713 0 2024-02-19T19:07:30.138 INFO:tasks.workunit.client.1.smithi142.stdout:4/232: unlink d4/d34/c41 0 2024-02-19T19:07:30.140 INFO:tasks.workunit.client.1.smithi142.stdout:9/146: rename db/d10/f20 to db/f2b 0 2024-02-19T19:07:30.140 INFO:tasks.workunit.client.1.smithi142.stdout:0/121: write d23/f25 [2984285,81082] 0 2024-02-19T19:07:30.141 INFO:tasks.workunit.client.1.smithi142.stdout:0/122: write f11 [2208590,80135] 0 2024-02-19T19:07:30.141 INFO:tasks.workunit.client.1.smithi142.stdout:9/147: truncate db/f2b 548909 0 2024-02-19T19:07:30.142 INFO:tasks.workunit.client.1.smithi142.stdout:9/148: getdents db/d10/d27 0 2024-02-19T19:07:30.142 INFO:tasks.workunit.client.1.smithi142.stdout:9/149: write db/f16 [51004,52805] 0 2024-02-19T19:07:30.142 INFO:tasks.workunit.client.1.smithi142.stdout:9/150: read - db/f18 zero size 2024-02-19T19:07:30.143 INFO:tasks.workunit.client.1.smithi142.stdout:1/160: dwrite d5/f2d [0,4194304] 0 2024-02-19T19:07:30.143 INFO:tasks.workunit.client.1.smithi142.stdout:3/144: dwrite fa [0,4194304] 0 2024-02-19T19:07:30.144 INFO:tasks.workunit.client.1.smithi142.stdout:3/145: write f9 [375424,16851] 0 2024-02-19T19:07:30.144 INFO:tasks.workunit.client.1.smithi142.stdout:9/151: rmdir db 39 2024-02-19T19:07:30.144 INFO:tasks.workunit.client.1.smithi142.stdout:5/134: dwrite d5/dd/f1e [0,4194304] 0 2024-02-19T19:07:30.149 INFO:tasks.workunit.client.1.smithi142.stdout:0/123: fsync f1a 0 2024-02-19T19:07:30.149 INFO:tasks.workunit.client.1.smithi142.stdout:3/146: truncate f10 2035608 0 2024-02-19T19:07:30.152 INFO:tasks.workunit.client.1.smithi142.stdout:1/161: write d5/d7/fe [3656995,37359] 0 2024-02-19T19:07:30.153 INFO:tasks.workunit.client.1.smithi142.stdout:0/124: dread f17 [0,4194304] 0 2024-02-19T19:07:30.156 INFO:tasks.workunit.client.1.smithi142.stdout:8/169: read f2 [1585172,118857] 0 2024-02-19T19:07:30.157 INFO:tasks.workunit.client.1.smithi142.stdout:8/170: write d9/dd/d15/f28 [801591,111219] 0 2024-02-19T19:07:30.157 INFO:tasks.workunit.client.1.smithi142.stdout:9/152: mknod db/d10/d27/c2c 0 2024-02-19T19:07:30.157 INFO:tasks.workunit.client.1.smithi142.stdout:4/233: dwrite d4/dc/d12/f40 [0,4194304] 0 2024-02-19T19:07:30.157 INFO:tasks.workunit.client.1.smithi142.stdout:4/234: readlink d4/dc/dd/d10/l30 0 2024-02-19T19:07:30.158 INFO:tasks.workunit.client.1.smithi142.stdout:7/144: sync 2024-02-19T19:07:30.158 INFO:tasks.workunit.client.1.smithi142.stdout:6/128: sync 2024-02-19T19:07:30.161 INFO:tasks.workunit.client.1.smithi142.stdout:5/135: rename d5/f18 to d5/f2c 0 2024-02-19T19:07:30.161 INFO:tasks.workunit.client.1.smithi142.stdout:5/136: dread - d5/dd/df/d15/d1a/f2b zero size 2024-02-19T19:07:30.162 INFO:tasks.workunit.client.1.smithi142.stdout:5/137: fsync d5/dd/f1d 0 2024-02-19T19:07:30.162 INFO:tasks.workunit.client.1.smithi142.stdout:5/138: dread - d5/f24 zero size 2024-02-19T19:07:30.164 INFO:tasks.workunit.client.1.smithi142.stdout:3/147: rename f4 to d1d/f28 0 2024-02-19T19:07:30.164 INFO:tasks.workunit.client.1.smithi142.stdout:3/148: creat d1d/f29 x:0 0 0 2024-02-19T19:07:30.165 INFO:tasks.workunit.client.1.smithi142.stdout:1/162: dread d5/f2d [0,4194304] 0 2024-02-19T19:07:30.165 INFO:tasks.workunit.client.1.smithi142.stdout:1/163: chown d5/d7/d23/d2c 29454847 1 2024-02-19T19:07:30.168 INFO:tasks.workunit.client.1.smithi142.stdout:9/153: write db/d10/f1c [3890783,104795] 0 2024-02-19T19:07:30.169 INFO:tasks.workunit.client.1.smithi142.stdout:9/154: write db/f18 [196659,56431] 0 2024-02-19T19:07:30.169 INFO:tasks.workunit.client.1.smithi142.stdout:9/155: write db/f18 [1130395,32185] 0 2024-02-19T19:07:30.169 INFO:tasks.workunit.client.1.smithi142.stdout:9/156: chown db/d10/f28 1 1 2024-02-19T19:07:30.169 INFO:tasks.workunit.client.1.smithi142.stdout:9/157: fsync db/d10/f1f 0 2024-02-19T19:07:30.175 INFO:tasks.workunit.client.1.smithi142.stdout:7/145: dwrite d0/fc [0,4194304] 0 2024-02-19T19:07:30.175 INFO:tasks.workunit.client.1.smithi142.stdout:7/146: stat d0/d13/d1e/d22 0 2024-02-19T19:07:30.175 INFO:tasks.workunit.client.1.smithi142.stdout:8/171: mkdir d9/dd/d15/d31 0 2024-02-19T19:07:30.175 INFO:tasks.workunit.client.1.smithi142.stdout:8/172: write d9/dd/de/f2c [417643,91958] 0 2024-02-19T19:07:30.179 INFO:tasks.workunit.client.1.smithi142.stdout:4/235: creat d4/dc/dd/d10/d3e/f4e x:0 0 0 2024-02-19T19:07:30.179 INFO:tasks.workunit.client.1.smithi142.stdout:4/236: write d4/dc/dd/d10/d3e/f4e [260425,5766] 0 2024-02-19T19:07:30.180 INFO:tasks.workunit.client.1.smithi142.stdout:4/237: read d4/dc/dd/d10/d3e/f4e [189139,23838] 0 2024-02-19T19:07:30.180 INFO:tasks.workunit.client.1.smithi142.stdout:4/238: readlink d4/dc/dd/d10/l30 0 2024-02-19T19:07:30.184 INFO:tasks.workunit.client.1.smithi142.stdout:3/149: rename f1a to d1d/f2a 0 2024-02-19T19:07:30.186 INFO:tasks.workunit.client.1.smithi142.stdout:1/164: creat d5/d1a/f35 x:0 0 0 2024-02-19T19:07:30.193 INFO:tasks.workunit.client.1.smithi142.stdout:9/158: unlink db/l1e 0 2024-02-19T19:07:30.198 INFO:tasks.workunit.client.1.smithi142.stdout:8/173: mknod d9/dd/d15/d31/c32 0 2024-02-19T19:07:30.198 INFO:tasks.workunit.client.1.smithi142.stdout:8/174: fdatasync d9/dd/de/f2b 0 2024-02-19T19:07:30.198 INFO:tasks.workunit.client.1.smithi142.stdout:8/175: write d9/dd/d15/f23 [831333,13680] 0 2024-02-19T19:07:30.200 INFO:tasks.workunit.client.1.smithi142.stdout:4/239: creat d4/d1c/f4f x:0 0 0 2024-02-19T19:07:30.200 INFO:tasks.workunit.client.1.smithi142.stdout:4/240: write d4/dc/dd/d10/d3e/f4e [1113259,60041] 0 2024-02-19T19:07:30.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:29 smithi142 ceph-mon[69118]: osdmap e58: 6 total, 5 up, 6 in 2024-02-19T19:07:30.201 INFO:tasks.workunit.client.1.smithi142.stdout:3/150: rename d1d/f20 to d1d/f2b 0 2024-02-19T19:07:30.201 INFO:tasks.workunit.client.1.smithi142.stdout:3/151: stat d1d/f28 0 2024-02-19T19:07:30.202 INFO:tasks.workunit.client.1.smithi142.stdout:3/152: creat d1d/f2c x:0 0 0 2024-02-19T19:07:30.202 INFO:tasks.workunit.client.1.smithi142.stdout:7/147: symlink d0/l37 0 2024-02-19T19:07:30.205 INFO:tasks.workunit.client.1.smithi142.stdout:0/125: dwrite d23/f25 [0,4194304] 0 2024-02-19T19:07:30.205 INFO:tasks.workunit.client.1.smithi142.stdout:8/176: truncate d9/fc 514879 0 2024-02-19T19:07:30.207 INFO:tasks.workunit.client.1.smithi142.stdout:4/241: unlink d4/dc/f13 0 2024-02-19T19:07:30.210 INFO:tasks.workunit.client.1.smithi142.stdout:7/148: truncate d0/f9 2225946 0 2024-02-19T19:07:30.210 INFO:tasks.workunit.client.1.smithi142.stdout:7/149: chown d0/d13/d1e/d22 1507 1 2024-02-19T19:07:30.210 INFO:tasks.workunit.client.1.smithi142.stdout:7/150: chown d0/d13/f15 571816 1 2024-02-19T19:07:30.210 INFO:tasks.workunit.client.1.smithi142.stdout:7/151: write d0/f16 [965153,25085] 0 2024-02-19T19:07:30.211 INFO:tasks.workunit.client.1.smithi142.stdout:0/126: rename cd to d23/d26/c27 0 2024-02-19T19:07:30.213 INFO:tasks.workunit.client.1.smithi142.stdout:4/242: mkdir d4/dc/dd/d10/d26/d50 0 2024-02-19T19:07:30.213 INFO:tasks.workunit.client.1.smithi142.stdout:4/243: chown d4/d14/d31 24 1 2024-02-19T19:07:30.213 INFO:tasks.workunit.client.1.smithi142.stdout:4/244: chown d4/d14/d31/d43/f48 129909 1 2024-02-19T19:07:30.216 INFO:tasks.workunit.client.1.smithi142.stdout:4/245: creat d4/d34/f51 x:0 0 0 2024-02-19T19:07:30.216 INFO:tasks.workunit.client.1.smithi142.stdout:4/246: chown d4/dc/f27 835554805 1 2024-02-19T19:07:30.216 INFO:tasks.workunit.client.1.smithi142.stdout:8/177: dread f0 [0,4194304] 0 2024-02-19T19:07:30.216 INFO:tasks.workunit.client.1.smithi142.stdout:8/178: chown c5 7043367 1 2024-02-19T19:07:30.216 INFO:tasks.workunit.client.1.smithi142.stdout:7/152: getdents d0/d1b/d21/d24/d29 0 2024-02-19T19:07:30.217 INFO:tasks.workunit.client.1.smithi142.stdout:7/153: truncate d0/d1b/d21/d24/d29/d2d/f2e 963399 0 2024-02-19T19:07:30.218 INFO:tasks.workunit.client.1.smithi142.stdout:0/127: mkdir d23/d28 0 2024-02-19T19:07:30.219 INFO:tasks.workunit.client.1.smithi142.stdout:4/247: mkdir d4/d14/d31/d43/d52 0 2024-02-19T19:07:30.219 INFO:tasks.workunit.client.1.smithi142.stdout:5/139: dwrite d5/dd/f1d [4194304,4194304] 0 2024-02-19T19:07:30.220 INFO:tasks.workunit.client.1.smithi142.stdout:8/179: truncate d9/dd/de/d14/f20 236517 0 2024-02-19T19:07:30.220 INFO:tasks.workunit.client.1.smithi142.stdout:1/165: dwrite d5/f28 [0,4194304] 0 2024-02-19T19:07:30.220 INFO:tasks.workunit.client.1.smithi142.stdout:3/153: dwrite fb [4194304,4194304] 0 2024-02-19T19:07:30.222 INFO:tasks.workunit.client.1.smithi142.stdout:4/248: symlink d4/d1d/l53 0 2024-02-19T19:07:30.225 INFO:tasks.workunit.client.1.smithi142.stdout:5/140: creat d5/dd/d8/d2a/f2d x:0 0 0 2024-02-19T19:07:30.226 INFO:tasks.workunit.client.1.smithi142.stdout:9/159: dread db/f18 [0,4194304] 0 2024-02-19T19:07:30.227 INFO:tasks.workunit.client.1.smithi142.stdout:1/166: creat d5/d1a/d33/f36 x:0 0 0 2024-02-19T19:07:30.227 INFO:tasks.workunit.client.1.smithi142.stdout:1/167: readlink d5/d1a/l1e 0 2024-02-19T19:07:30.230 INFO:tasks.workunit.client.1.smithi142.stdout:3/154: symlink d1d/l2d 0 2024-02-19T19:07:30.231 INFO:tasks.workunit.client.1.smithi142.stdout:6/129: dwrite d2/f14 [4194304,4194304] 0 2024-02-19T19:07:30.231 INFO:tasks.workunit.client.1.smithi142.stdout:0/128: dread fb [0,4194304] 0 2024-02-19T19:07:30.232 INFO:tasks.workunit.client.1.smithi142.stdout:5/141: mkdir d5/dd/df/d15/d1a/d2e 0 2024-02-19T19:07:30.232 INFO:tasks.workunit.client.1.smithi142.stdout:8/180: dread f2 [0,4194304] 0 2024-02-19T19:07:30.236 INFO:tasks.workunit.client.1.smithi142.stdout:3/155: read f1c [639033,86842] 0 2024-02-19T19:07:30.240 INFO:tasks.workunit.client.1.smithi142.stdout:0/129: dread fb [0,4194304] 0 2024-02-19T19:07:30.240 INFO:tasks.workunit.client.1.smithi142.stdout:0/130: dread - f22 zero size 2024-02-19T19:07:30.245 INFO:tasks.workunit.client.1.smithi142.stdout:4/249: dwrite d4/dc/d12/f40 [0,4194304] 0 2024-02-19T19:07:30.245 INFO:tasks.workunit.client.1.smithi142.stdout:4/250: dread - d4/d1c/f4f zero size 2024-02-19T19:07:30.245 INFO:tasks.workunit.client.1.smithi142.stdout:4/251: read - d4/d1c/f4b zero size 2024-02-19T19:07:30.245 INFO:tasks.workunit.client.1.smithi142.stdout:4/252: dread - d4/d14/d31/f38 zero size 2024-02-19T19:07:30.245 INFO:tasks.workunit.client.1.smithi142.stdout:4/253: stat d4/dc/d12/l3a 0 2024-02-19T19:07:30.258 INFO:tasks.workunit.client.1.smithi142.stdout:6/130: symlink d2/d1f/l23 0 2024-02-19T19:07:30.258 INFO:tasks.workunit.client.1.smithi142.stdout:7/154: dread d0/f9 [0,4194304] 0 2024-02-19T19:07:30.259 INFO:tasks.workunit.client.1.smithi142.stdout:8/181: creat d9/dd/d15/d30/f33 x:0 0 0 2024-02-19T19:07:30.259 INFO:tasks.workunit.client.1.smithi142.stdout:8/182: fdatasync d9/dd/de/d14/d21/f27 0 2024-02-19T19:07:30.259 INFO:tasks.workunit.client.1.smithi142.stdout:8/183: readlink d9/l10 0 2024-02-19T19:07:30.262 INFO:tasks.workunit.client.1.smithi142.stdout:9/160: rename db/d10/d22/c23 to db/d10/c2d 0 2024-02-19T19:07:30.264 INFO:tasks.workunit.client.1.smithi142.stdout:1/168: mkdir d5/d37 0 2024-02-19T19:07:30.265 INFO:tasks.workunit.client.1.smithi142.stdout:3/156: mkdir d1d/d1e/d2e 0 2024-02-19T19:07:30.265 INFO:tasks.workunit.client.1.smithi142.stdout:3/157: write d1d/d1e/f21 [647646,130236] 0 2024-02-19T19:07:30.269 INFO:tasks.workunit.client.1.smithi142.stdout:4/254: mkdir d4/dc/dd/d10/d26/d50/d54 0 2024-02-19T19:07:30.271 INFO:tasks.workunit.client.1.smithi142.stdout:8/184: link d9/dd/de/l29 d9/dd/de/d14/l34 0 2024-02-19T19:07:30.271 INFO:tasks.workunit.client.1.smithi142.stdout:8/185: chown d9/dd/d15/f1f 63137401 1 2024-02-19T19:07:30.271 INFO:tasks.workunit.client.1.smithi142.stdout:8/186: creat d9/dd/de/d14/d21/f35 x:0 0 0 2024-02-19T19:07:30.271 INFO:tasks.workunit.client.1.smithi142.stdout:8/187: write d9/dd/de/f24 [889093,91011] 0 2024-02-19T19:07:30.271 INFO:tasks.workunit.client.1.smithi142.stdout:8/188: fsync d9/dd/f1c 0 2024-02-19T19:07:30.275 INFO:tasks.workunit.client.1.smithi142.stdout:5/142: rename d5/c10 to d5/dd/d8/d29/c2f 0 2024-02-19T19:07:30.275 INFO:tasks.workunit.client.1.smithi142.stdout:7/155: rename d0/d13/d1e to d0/d13/d1e/d38 22 2024-02-19T19:07:30.275 INFO:tasks.workunit.client.1.smithi142.stdout:9/161: mknod db/d29/c2e 0 2024-02-19T19:07:30.276 INFO:tasks.workunit.client.1.smithi142.stdout:7/156: dread d0/d13/f1f [0,4194304] 0 2024-02-19T19:07:30.276 INFO:tasks.workunit.client.1.smithi142.stdout:7/157: dread - d0/d13/d1e/f20 zero size 2024-02-19T19:07:30.277 INFO:tasks.workunit.client.1.smithi142.stdout:3/158: symlink d1d/d1e/l2f 0 2024-02-19T19:07:30.277 INFO:tasks.workunit.client.1.smithi142.stdout:3/159: write f19 [4781552,14631] 0 2024-02-19T19:07:30.279 INFO:tasks.workunit.client.1.smithi142.stdout:0/131: mknod d23/c29 0 2024-02-19T19:07:30.286 INFO:tasks.workunit.client.1.smithi142.stdout:2/184: sync 2024-02-19T19:07:30.286 INFO:tasks.workunit.client.1.smithi142.stdout:2/185: dread - d3/df/f31 zero size 2024-02-19T19:07:30.286 INFO:tasks.workunit.client.1.smithi142.stdout:2/186: stat d3/f5 0 2024-02-19T19:07:30.286 INFO:tasks.workunit.client.1.smithi142.stdout:2/187: chown d3/db/l24 1886864424 1 2024-02-19T19:07:30.286 INFO:tasks.workunit.client.1.smithi142.stdout:2/188: dread - d3/db/f25 zero size 2024-02-19T19:07:30.291 INFO:tasks.workunit.client.1.smithi142.stdout:8/189: rename d9/l2a to d9/dd/l36 0 2024-02-19T19:07:30.291 INFO:tasks.workunit.client.1.smithi142.stdout:3/160: rename d1d/d1e to d1d/d1e/d30 22 2024-02-19T19:07:30.291 INFO:tasks.workunit.client.1.smithi142.stdout:3/161: write f9 [2929152,12186] 0 2024-02-19T19:07:30.291 INFO:tasks.workunit.client.1.smithi142.stdout:9/162: rmdir db/d10/d22 39 2024-02-19T19:07:30.294 INFO:tasks.workunit.client.1.smithi142.stdout:7/158: symlink d0/d1b/d21/d24/l39 0 2024-02-19T19:07:30.295 INFO:tasks.workunit.client.1.smithi142.stdout:0/132: dwrite f22 [0,4194304] 0 2024-02-19T19:07:30.296 INFO:tasks.workunit.client.1.smithi142.stdout:1/169: rename d5/f28 to d5/f38 0 2024-02-19T19:07:30.296 INFO:tasks.workunit.client.1.smithi142.stdout:1/170: creat d5/d1a/f39 x:0 0 0 2024-02-19T19:07:30.296 INFO:tasks.workunit.client.1.smithi142.stdout:1/171: creat d5/d1a/f3a x:0 0 0 2024-02-19T19:07:30.297 INFO:tasks.workunit.client.1.smithi142.stdout:2/189: write d3/df/f12 [4028617,16524] 0 2024-02-19T19:07:30.297 INFO:tasks.workunit.client.1.smithi142.stdout:4/255: link d4/dc/dd/d10/d26/l39 d4/dc/l55 0 2024-02-19T19:07:30.297 INFO:tasks.workunit.client.1.smithi142.stdout:4/256: dread - d4/d14/d31/d43/f48 zero size 2024-02-19T19:07:30.301 INFO:tasks.workunit.client.1.smithi142.stdout:3/162: link l1b d1d/l31 0 2024-02-19T19:07:30.301 INFO:tasks.workunit.client.1.smithi142.stdout:3/163: chown f9 7482 1 2024-02-19T19:07:30.302 INFO:tasks.workunit.client.1.smithi142.stdout:7/159: write d0/fc [426690,40222] 0 2024-02-19T19:07:30.302 INFO:tasks.workunit.client.1.smithi142.stdout:7/160: rename d0/d1b/d21/d24 to d0/d1b/d21/d24/d29/d2d/d3a 22 2024-02-19T19:07:30.303 INFO:tasks.workunit.client.1.smithi142.stdout:9/163: mkdir db/d10/d27/d2f 0 2024-02-19T19:07:30.307 INFO:tasks.workunit.client.1.smithi142.stdout:0/133: symlink d23/d28/l2a 0 2024-02-19T19:07:30.307 INFO:tasks.workunit.client.1.smithi142.stdout:0/134: chown c1c 1 1 2024-02-19T19:07:30.309 INFO:tasks.workunit.client.1.smithi142.stdout:3/164: dread f14 [0,4194304] 0 2024-02-19T19:07:30.309 INFO:tasks.workunit.client.1.smithi142.stdout:3/165: truncate d1d/f29 628622 0 2024-02-19T19:07:30.309 INFO:tasks.workunit.client.1.smithi142.stdout:0/135: dread f17 [0,4194304] 0 2024-02-19T19:07:30.311 INFO:tasks.workunit.client.1.smithi142.stdout:1/172: creat d5/d7/d23/d2c/f3b x:0 0 0 2024-02-19T19:07:30.312 INFO:tasks.workunit.client.1.smithi142.stdout:9/164: write db/d10/f1f [4083733,96107] 0 2024-02-19T19:07:30.313 INFO:tasks.workunit.client.1.smithi142.stdout:2/190: mknod d3/df/c39 0 2024-02-19T19:07:30.313 INFO:tasks.workunit.client.1.smithi142.stdout:8/190: rmdir d9/dd/d15/d30 39 2024-02-19T19:07:30.315 INFO:tasks.workunit.client.1.smithi142.stdout:7/161: unlink d0/d13/f1c 0 2024-02-19T19:07:30.315 INFO:tasks.workunit.client.1.smithi142.stdout:7/162: stat d0/l17 0 2024-02-19T19:07:30.315 INFO:tasks.workunit.client.1.smithi142.stdout:4/257: dwrite d4/d14/f2f [0,4194304] 0 2024-02-19T19:07:30.319 INFO:tasks.workunit.client.1.smithi142.stdout:0/136: dread f18 [0,4194304] 0 2024-02-19T19:07:30.320 INFO:tasks.workunit.client.1.smithi142.stdout:3/166: creat d1d/d1e/f32 x:0 0 0 2024-02-19T19:07:30.320 INFO:tasks.workunit.client.1.smithi142.stdout:1/173: chown d5/l22 3687 1 2024-02-19T19:07:30.320 INFO:tasks.workunit.client.1.smithi142.stdout:1/174: creat d5/d7/d23/d2c/f3c x:0 0 0 2024-02-19T19:07:30.320 INFO:tasks.workunit.client.1.smithi142.stdout:1/175: write d5/d1a/f39 [435289,124952] 0 2024-02-19T19:07:30.320 INFO:tasks.workunit.client.1.smithi142.stdout:8/191: symlink d9/dd/de/l37 0 2024-02-19T19:07:30.323 INFO:tasks.workunit.client.1.smithi142.stdout:3/167: dread d1d/d1e/f21 [0,4194304] 0 2024-02-19T19:07:30.323 INFO:tasks.workunit.client.1.smithi142.stdout:3/168: write f10 [3063734,48205] 0 2024-02-19T19:07:30.324 INFO:tasks.workunit.client.1.smithi142.stdout:3/169: chown d1d/d1e/f32 101 1 2024-02-19T19:07:30.324 INFO:tasks.workunit.client.1.smithi142.stdout:0/137: mknod d23/d28/c2b 0 2024-02-19T19:07:30.324 INFO:tasks.workunit.client.1.smithi142.stdout:0/138: fsync f1a 0 2024-02-19T19:07:30.324 INFO:tasks.workunit.client.1.smithi142.stdout:0/139: fsync f16 0 2024-02-19T19:07:30.329 INFO:tasks.workunit.client.1.smithi142.stdout:1/176: unlink l3 0 2024-02-19T19:07:30.331 INFO:tasks.workunit.client.1.smithi142.stdout:8/192: symlink d9/dd/d15/d31/l38 0 2024-02-19T19:07:30.331 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:30 smithi046 podman[106118]: 2024-02-19 19:07:30.052115558 +0000 UTC m=+3.767226795 container remove 5ffd1526df8c406ade75450a6327ab6b200233ece1981bc78a91a3f93581858d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212) 2024-02-19T19:07:30.333 INFO:tasks.workunit.client.1.smithi142.stdout:1/177: symlink d5/d7/d34/l3d 0 2024-02-19T19:07:30.333 INFO:tasks.workunit.client.1.smithi142.stdout:1/178: read f4 [1375598,59961] 0 2024-02-19T19:07:30.336 INFO:tasks.workunit.client.1.smithi142.stdout:9/165: dwrite db/d10/f28 [0,4194304] 0 2024-02-19T19:07:30.337 INFO:tasks.workunit.client.1.smithi142.stdout:1/179: dread d5/ff [0,4194304] 0 2024-02-19T19:07:30.337 INFO:tasks.workunit.client.1.smithi142.stdout:7/163: dwrite d0/d1b/d21/d24/f28 [0,4194304] 0 2024-02-19T19:07:30.343 INFO:tasks.workunit.client.1.smithi142.stdout:8/193: dread d9/dd/de/f24 [0,4194304] 0 2024-02-19T19:07:30.343 INFO:tasks.workunit.client.1.smithi142.stdout:8/194: write f0 [4852055,56145] 0 2024-02-19T19:07:30.344 INFO:tasks.workunit.client.1.smithi142.stdout:7/164: mknod d0/d1b/d21/d24/d29/d2d/c3b 0 2024-02-19T19:07:30.344 INFO:tasks.workunit.client.1.smithi142.stdout:7/165: readlink d0/d13/l1a 0 2024-02-19T19:07:30.344 INFO:tasks.workunit.client.1.smithi142.stdout:7/166: creat d0/d1b/d21/d24/d29/d2d/f3c x:0 0 0 2024-02-19T19:07:30.345 INFO:tasks.workunit.client.1.smithi142.stdout:7/167: read d0/d13/f1f [148457,104406] 0 2024-02-19T19:07:30.345 INFO:tasks.workunit.client.1.smithi142.stdout:7/168: chown d0/l37 33889204 1 2024-02-19T19:07:30.345 INFO:tasks.workunit.client.1.smithi142.stdout:7/169: creat d0/d1b/d21/d24/d29/d2d/f3d x:0 0 0 2024-02-19T19:07:30.346 INFO:tasks.workunit.client.1.smithi142.stdout:9/166: mknod db/d10/d22/c30 0 2024-02-19T19:07:30.346 INFO:tasks.workunit.client.1.smithi142.stdout:9/167: stat db 0 2024-02-19T19:07:30.346 INFO:tasks.workunit.client.1.smithi142.stdout:9/168: stat db/f1d 0 2024-02-19T19:07:30.346 INFO:tasks.workunit.client.1.smithi142.stdout:9/169: write f5 [1784014,109908] 0 2024-02-19T19:07:30.347 INFO:tasks.workunit.client.1.smithi142.stdout:8/195: truncate d9/dd/f1c 6222850 0 2024-02-19T19:07:30.348 INFO:tasks.workunit.client.1.smithi142.stdout:1/180: dread d5/f2d [0,4194304] 0 2024-02-19T19:07:30.352 INFO:tasks.workunit.client.1.smithi142.stdout:3/170: dwrite d1d/f22 [0,4194304] 0 2024-02-19T19:07:30.352 INFO:tasks.workunit.client.1.smithi142.stdout:0/140: dwrite f1a [4194304,4194304] 0 2024-02-19T19:07:30.352 INFO:tasks.workunit.client.1.smithi142.stdout:7/170: unlink d0/d13/d1e/f20 0 2024-02-19T19:07:30.354 INFO:tasks.workunit.client.1.smithi142.stdout:9/170: symlink db/d29/l31 0 2024-02-19T19:07:30.357 INFO:tasks.workunit.client.1.smithi142.stdout:1/181: creat d5/d7/f3e x:0 0 0 2024-02-19T19:07:30.357 INFO:tasks.workunit.client.1.smithi142.stdout:1/182: chown d5/c6 0 1 2024-02-19T19:07:30.357 INFO:tasks.workunit.client.1.smithi142.stdout:1/183: write d5/d1a/f39 [126367,50166] 0 2024-02-19T19:07:30.357 INFO:tasks.workunit.client.1.smithi142.stdout:1/184: stat d5/d7/d23/d2c 0 2024-02-19T19:07:30.357 INFO:tasks.workunit.client.1.smithi142.stdout:1/185: read - d5/d1a/f35 zero size 2024-02-19T19:07:30.361 INFO:tasks.workunit.client.1.smithi142.stdout:3/171: rename f14 to d1d/d1e/d2e/f33 0 2024-02-19T19:07:30.362 INFO:tasks.workunit.client.1.smithi142.stdout:4/258: truncate d4/d14/f2f 739627 0 2024-02-19T19:07:30.362 INFO:tasks.workunit.client.1.smithi142.stdout:4/259: write d4/dc/dd/d10/f1f [3971010,15840] 0 2024-02-19T19:07:30.364 INFO:tasks.workunit.client.1.smithi142.stdout:7/171: truncate d0/fd 18528 0 2024-02-19T19:07:30.366 INFO:tasks.workunit.client.1.smithi142.stdout:8/196: getdents d9/dd/de 0 2024-02-19T19:07:30.366 INFO:tasks.workunit.client.1.smithi142.stdout:8/197: creat d9/dd/de/d14/d21/f39 x:0 0 0 2024-02-19T19:07:30.370 INFO:tasks.workunit.client.1.smithi142.stdout:4/260: rename d4/d1c/f4f to d4/dc/dd/f56 0 2024-02-19T19:07:30.372 INFO:tasks.workunit.client.1.smithi142.stdout:0/141: symlink d23/l2c 0 2024-02-19T19:07:30.374 INFO:tasks.workunit.client.1.smithi142.stdout:1/186: dwrite d5/f38 [0,4194304] 0 2024-02-19T19:07:30.376 INFO:tasks.workunit.client.1.smithi142.stdout:9/171: mkdir db/d10/d32 0 2024-02-19T19:07:30.377 INFO:tasks.workunit.client.1.smithi142.stdout:8/198: stat d9/dd/de/l29 0 2024-02-19T19:07:30.381 INFO:tasks.workunit.client.1.smithi142.stdout:7/172: mknod d0/d13/c3e 0 2024-02-19T19:07:30.386 INFO:tasks.workunit.client.1.smithi142.stdout:0/142: dread f22 [0,4194304] 0 2024-02-19T19:07:30.388 INFO:tasks.workunit.client.1.smithi142.stdout:3/172: rmdir d1d/d1e 39 2024-02-19T19:07:30.392 INFO:tasks.workunit.client.1.smithi142.stdout:4/261: dwrite d4/dc/dd/f56 [0,4194304] 0 2024-02-19T19:07:30.393 INFO:tasks.workunit.client.1.smithi142.stdout:9/172: mkdir db/d10/d32/d33 0 2024-02-19T19:07:30.394 INFO:tasks.workunit.client.1.smithi142.stdout:9/173: write db/f16 [925087,102583] 0 2024-02-19T19:07:30.395 INFO:tasks.workunit.client.1.smithi142.stdout:0/143: rmdir d23/d26 39 2024-02-19T19:07:30.395 INFO:tasks.workunit.client.1.smithi142.stdout:0/144: chown f13 1953777 1 2024-02-19T19:07:30.401 INFO:tasks.workunit.client.1.smithi142.stdout:1/187: dwrite d5/f2b [0,4194304] 0 2024-02-19T19:07:30.401 INFO:tasks.workunit.client.1.smithi142.stdout:1/188: dread - d5/d7/d23/d2c/f3b zero size 2024-02-19T19:07:30.405 INFO:tasks.workunit.client.1.smithi142.stdout:4/262: creat d4/dc/dd/d10/d3b/d3f/f57 x:0 0 0 2024-02-19T19:07:30.406 INFO:tasks.workunit.client.1.smithi142.stdout:4/263: chown d4/dc/dd 13756 1 2024-02-19T19:07:30.406 INFO:tasks.workunit.client.1.smithi142.stdout:1/189: dread d5/ff [0,4194304] 0 2024-02-19T19:07:30.406 INFO:tasks.workunit.client.1.smithi142.stdout:1/190: fsync d5/d1a/f3a 0 2024-02-19T19:07:30.411 INFO:tasks.workunit.client.1.smithi142.stdout:4/264: rename d4/d14/l15 to d4/dc/dd/d10/d26/d50/d54/l58 0 2024-02-19T19:07:30.411 INFO:tasks.workunit.client.1.smithi142.stdout:4/265: chown d4/dc 2953152 1 2024-02-19T19:07:30.412 INFO:tasks.workunit.client.1.smithi142.stdout:3/173: dwrite d1d/d1e/f21 [0,4194304] 0 2024-02-19T19:07:30.412 INFO:tasks.workunit.client.1.smithi142.stdout:3/174: truncate d1d/f2a 2056671 0 2024-02-19T19:07:30.412 INFO:tasks.workunit.client.1.smithi142.stdout:3/175: chown fb 134084026 1 2024-02-19T19:07:30.415 INFO:tasks.workunit.client.1.smithi142.stdout:3/176: getdents d1d/d1e/d2e 0 2024-02-19T19:07:30.416 INFO:tasks.workunit.client.1.smithi142.stdout:4/266: dread d4/dc/dd/d10/d3e/f4e [0,4194304] 0 2024-02-19T19:07:30.416 INFO:tasks.workunit.client.1.smithi142.stdout:4/267: dread - d4/d34/f51 zero size 2024-02-19T19:07:30.416 INFO:tasks.workunit.client.1.smithi142.stdout:1/191: getdents d5/d7/d23/d2c 0 2024-02-19T19:07:30.416 INFO:tasks.workunit.client.1.smithi142.stdout:1/192: chown d5/d7/l2f 2603 1 2024-02-19T19:07:30.418 INFO:tasks.workunit.client.1.smithi142.stdout:4/268: creat d4/dc/dd/d10/d26/d50/d54/f59 x:0 0 0 2024-02-19T19:07:30.419 INFO:tasks.workunit.client.1.smithi142.stdout:1/193: link d5/d7/c13 d5/d37/c3f 0 2024-02-19T19:07:30.421 INFO:tasks.workunit.client.1.smithi142.stdout:4/269: rmdir d4/dc/d12/d2d/d2a 39 2024-02-19T19:07:30.422 INFO:tasks.workunit.client.1.smithi142.stdout:1/194: mknod d5/c40 0 2024-02-19T19:07:30.423 INFO:tasks.workunit.client.1.smithi142.stdout:4/270: getdents d4/dc/dd/d10/d26/d50 0 2024-02-19T19:07:30.423 INFO:tasks.workunit.client.1.smithi142.stdout:4/271: truncate d4/dc/d12/f18 2016146 0 2024-02-19T19:07:30.423 INFO:tasks.workunit.client.1.smithi142.stdout:4/272: write d4/d14/f16 [4415423,102347] 0 2024-02-19T19:07:30.423 INFO:tasks.workunit.client.1.smithi142.stdout:4/273: chown d4/d14/f2f 8 1 2024-02-19T19:07:30.425 INFO:tasks.workunit.client.1.smithi142.stdout:4/274: mknod d4/d1d/d42/c5a 0 2024-02-19T19:07:30.425 INFO:tasks.workunit.client.1.smithi142.stdout:4/275: creat d4/d1d/f5b x:0 0 0 2024-02-19T19:07:30.425 INFO:tasks.workunit.client.1.smithi142.stdout:4/276: stat d4/dc/d12/f40 0 2024-02-19T19:07:30.425 INFO:tasks.workunit.client.1.smithi142.stdout:4/277: truncate d4/d1c/f2e 92831 0 2024-02-19T19:07:30.425 INFO:tasks.workunit.client.1.smithi142.stdout:6/131: sync 2024-02-19T19:07:30.425 INFO:tasks.workunit.client.1.smithi142.stdout:3/177: dread d1d/f24 [4194304,4194304] 0 2024-02-19T19:07:30.426 INFO:tasks.workunit.client.1.smithi142.stdout:7/173: dwrite d0/d13/f27 [0,4194304] 0 2024-02-19T19:07:30.426 INFO:tasks.workunit.client.1.smithi142.stdout:7/174: fsync d0/d1b/d21/d24/f34 0 2024-02-19T19:07:30.429 INFO:tasks.workunit.client.1.smithi142.stdout:9/174: dwrite db/d10/f1f [0,4194304] 0 2024-02-19T19:07:30.429 INFO:tasks.workunit.client.1.smithi142.stdout:9/175: chown db/d10/d32/d33 1087786 1 2024-02-19T19:07:30.430 INFO:tasks.workunit.client.1.smithi142.stdout:8/199: dwrite d9/dd/de/d14/d21/f35 [0,4194304] 0 2024-02-19T19:07:30.430 INFO:tasks.workunit.client.1.smithi142.stdout:6/132: rename d2/d17/f1a to d2/d17/f24 0 2024-02-19T19:07:30.430 INFO:tasks.workunit.client.1.smithi142.stdout:3/178: unlink d1d/f29 0 2024-02-19T19:07:30.431 INFO:tasks.workunit.client.1.smithi142.stdout:0/145: dwrite f1a [0,4194304] 0 2024-02-19T19:07:30.433 INFO:tasks.workunit.client.1.smithi142.stdout:8/200: dread d9/dd/de/f2c [0,4194304] 0 2024-02-19T19:07:30.434 INFO:tasks.workunit.client.1.smithi142.stdout:0/146: truncate f16 2871738 0 2024-02-19T19:07:30.435 INFO:tasks.workunit.client.1.smithi142.stdout:0/147: chown c1f 330251558 1 2024-02-19T19:07:30.435 INFO:tasks.workunit.client.1.smithi142.stdout:3/179: symlink d1d/l34 0 2024-02-19T19:07:30.435 INFO:tasks.workunit.client.1.smithi142.stdout:3/180: write d1d/f2c [903940,32903] 0 2024-02-19T19:07:30.435 INFO:tasks.workunit.client.1.smithi142.stdout:3/181: creat d1d/f35 x:0 0 0 2024-02-19T19:07:30.437 INFO:tasks.workunit.client.1.smithi142.stdout:8/201: creat d9/dd/d15/d30/f3a x:0 0 0 2024-02-19T19:07:30.437 INFO:tasks.workunit.client.1.smithi142.stdout:8/202: chown d9/dd/d15/d30/f3a 7122919 1 2024-02-19T19:07:30.438 INFO:tasks.workunit.client.1.smithi142.stdout:0/148: mkdir d23/d28/d2d 0 2024-02-19T19:07:30.441 INFO:tasks.workunit.client.1.smithi142.stdout:8/203: mknod d9/dd/d15/d30/c3b 0 2024-02-19T19:07:30.442 INFO:tasks.workunit.client.1.smithi142.stdout:8/204: mknod d9/dd/de/d2d/c3c 0 2024-02-19T19:07:30.443 INFO:tasks.workunit.client.1.smithi142.stdout:8/205: readlink d9/dd/de/l29 0 2024-02-19T19:07:30.443 INFO:tasks.workunit.client.1.smithi142.stdout:0/149: symlink d23/l2e 0 2024-02-19T19:07:30.444 INFO:tasks.workunit.client.1.smithi142.stdout:8/206: creat d9/dd/de/d2d/d2e/f3d x:0 0 0 2024-02-19T19:07:30.445 INFO:tasks.workunit.client.1.smithi142.stdout:0/150: symlink d23/d28/l2f 0 2024-02-19T19:07:30.446 INFO:tasks.workunit.client.1.smithi142.stdout:8/207: mknod d9/dd/c3e 0 2024-02-19T19:07:30.447 INFO:tasks.workunit.client.1.smithi142.stdout:0/151: creat d23/d26/f30 x:0 0 0 2024-02-19T19:07:30.448 INFO:tasks.workunit.client.1.smithi142.stdout:0/152: write d23/d26/f30 [271727,88444] 0 2024-02-19T19:07:30.448 INFO:tasks.workunit.client.1.smithi142.stdout:0/153: chown f1a 3670928 1 2024-02-19T19:07:30.449 INFO:tasks.workunit.client.1.smithi142.stdout:8/208: dread d9/dd/de/f2c [0,4194304] 0 2024-02-19T19:07:30.449 INFO:tasks.workunit.client.1.smithi142.stdout:3/182: dread f9 [0,4194304] 0 2024-02-19T19:07:30.449 INFO:tasks.workunit.client.1.smithi142.stdout:0/154: creat d23/f31 x:0 0 0 2024-02-19T19:07:30.450 INFO:tasks.workunit.client.1.smithi142.stdout:3/183: unlink l11 0 2024-02-19T19:07:30.451 INFO:tasks.workunit.client.1.smithi142.stdout:3/184: mkdir d1d/d36 0 2024-02-19T19:07:30.452 INFO:tasks.workunit.client.1.smithi142.stdout:6/133: dread d2/d17/f19 [0,4194304] 0 2024-02-19T19:07:30.452 INFO:tasks.workunit.client.1.smithi142.stdout:6/134: chown d2/d17/l1d 98324 1 2024-02-19T19:07:30.453 INFO:tasks.workunit.client.1.smithi142.stdout:6/135: rmdir d2 39 2024-02-19T19:07:30.458 INFO:tasks.workunit.client.1.smithi142.stdout:0/155: write d23/f25 [369209,54064] 0 2024-02-19T19:07:30.464 INFO:tasks.workunit.client.1.smithi142.stdout:3/185: write d1d/d1e/d2e/f33 [3877137,33748] 0 2024-02-19T19:07:30.464 INFO:tasks.workunit.client.1.smithi142.stdout:1/195: dwrite d5/d7/f11 [0,4194304] 0 2024-02-19T19:07:30.464 INFO:tasks.workunit.client.1.smithi142.stdout:6/136: write d2/f14 [2751075,61715] 0 2024-02-19T19:07:30.466 INFO:tasks.workunit.client.1.smithi142.stdout:1/196: mkdir d5/d7/d23/d41 0 2024-02-19T19:07:30.466 INFO:tasks.workunit.client.1.smithi142.stdout:1/197: write d5/d7/d23/d2c/f3b [533845,82739] 0 2024-02-19T19:07:30.466 INFO:tasks.workunit.client.1.smithi142.stdout:1/198: chown d5/d7/l2e 15705225 1 2024-02-19T19:07:30.466 INFO:tasks.workunit.client.1.smithi142.stdout:1/199: write d5/ff [365646,69668] 0 2024-02-19T19:07:30.467 INFO:tasks.workunit.client.1.smithi142.stdout:3/186: mkdir d1d/d1e/d2e/d37 0 2024-02-19T19:07:30.468 INFO:tasks.workunit.client.1.smithi142.stdout:6/137: creat d2/d1f/d20/f25 x:0 0 0 2024-02-19T19:07:30.469 INFO:tasks.workunit.client.1.smithi142.stdout:1/200: creat d5/f42 x:0 0 0 2024-02-19T19:07:30.471 INFO:tasks.workunit.client.1.smithi142.stdout:3/187: rename d1d/f28 to d1d/f38 0 2024-02-19T19:07:30.472 INFO:tasks.workunit.client.1.smithi142.stdout:7/175: dwrite d0/d1b/d21/d24/f34 [0,4194304] 0 2024-02-19T19:07:30.472 INFO:tasks.workunit.client.1.smithi142.stdout:4/278: dwrite d4/dc/dd/d10/f1f [0,4194304] 0 2024-02-19T19:07:30.472 INFO:tasks.workunit.client.1.smithi142.stdout:4/279: creat d4/dc/d12/f5c x:0 0 0 2024-02-19T19:07:30.472 INFO:tasks.workunit.client.1.smithi142.stdout:4/280: truncate d4/d1c/f4b 652161 0 2024-02-19T19:07:30.473 INFO:tasks.workunit.client.1.smithi142.stdout:4/281: creat d4/d14/d31/d43/f5d x:0 0 0 2024-02-19T19:07:30.473 INFO:tasks.workunit.client.1.smithi142.stdout:9/176: dwrite db/f16 [0,4194304] 0 2024-02-19T19:07:30.473 INFO:tasks.workunit.client.1.smithi142.stdout:9/177: chown l1 62689 1 2024-02-19T19:07:30.473 INFO:tasks.workunit.client.1.smithi142.stdout:9/178: fdatasync f5 0 2024-02-19T19:07:30.475 INFO:tasks.workunit.client.1.smithi142.stdout:3/188: mknod d1d/d36/c39 0 2024-02-19T19:07:30.475 INFO:tasks.workunit.client.1.smithi142.stdout:1/201: mknod d5/d7/d23/d41/c43 0 2024-02-19T19:07:30.475 INFO:tasks.workunit.client.1.smithi142.stdout:1/202: write d5/ff [908013,37278] 0 2024-02-19T19:07:30.479 INFO:tasks.workunit.client.1.smithi142.stdout:8/209: dwrite d9/dd/d15/d30/f3a [0,4194304] 0 2024-02-19T19:07:30.481 INFO:tasks.workunit.client.1.smithi142.stdout:6/138: read d2/f18 [776667,65785] 0 2024-02-19T19:07:30.482 INFO:tasks.workunit.client.1.smithi142.stdout:3/189: dread f5 [0,4194304] 0 2024-02-19T19:07:30.483 INFO:tasks.workunit.client.1.smithi142.stdout:3/190: write f13 [912853,10112] 0 2024-02-19T19:07:30.483 INFO:tasks.workunit.client.1.smithi142.stdout:1/203: symlink d5/d1a/d33/l44 0 2024-02-19T19:07:30.483 INFO:tasks.workunit.client.1.smithi142.stdout:1/204: chown d5/d1a/f3a 126534 1 2024-02-19T19:07:30.493 INFO:tasks.workunit.client.1.smithi142.stdout:6/139: truncate d2/f9 855782 0 2024-02-19T19:07:30.495 INFO:tasks.workunit.client.1.smithi142.stdout:9/179: rename db/d10/d27/c2c to db/c34 0 2024-02-19T19:07:30.495 INFO:tasks.workunit.client.1.smithi142.stdout:9/180: fdatasync db/d10/f28 0 2024-02-19T19:07:30.495 INFO:tasks.workunit.client.1.smithi142.stdout:3/191: mkdir d1d/d36/d3a 0 2024-02-19T19:07:30.497 INFO:tasks.workunit.client.1.smithi142.stdout:1/205: rename d5/d7/f19 to d5/d7/d23/f45 0 2024-02-19T19:07:30.498 INFO:tasks.workunit.client.1.smithi142.stdout:7/176: dwrite d0/fd [0,4194304] 0 2024-02-19T19:07:30.498 INFO:tasks.workunit.client.1.smithi142.stdout:7/177: fdatasync d0/d13/f15 0 2024-02-19T19:07:30.499 INFO:tasks.workunit.client.1.smithi142.stdout:8/210: dwrite d9/dd/f1d [0,4194304] 0 2024-02-19T19:07:30.499 INFO:tasks.workunit.client.1.smithi142.stdout:8/211: write d9/dd/de/f2c [1019185,23178] 0 2024-02-19T19:07:30.500 INFO:tasks.workunit.client.1.smithi142.stdout:1/206: rename d5/f2b to d5/d7/d34/f46 0 2024-02-19T19:07:30.500 INFO:tasks.workunit.client.1.smithi142.stdout:1/207: fsync d5/d7/d23/d2c/f3b 0 2024-02-19T19:07:30.500 INFO:tasks.workunit.client.1.smithi142.stdout:1/208: dread - d5/d1a/d33/f36 zero size 2024-02-19T19:07:30.503 INFO:tasks.workunit.client.1.smithi142.stdout:7/178: link d0/d1b/d21/f36 d0/d1b/d21/f3f 0 2024-02-19T19:07:30.503 INFO:tasks.workunit.client.1.smithi142.stdout:7/179: fdatasync d0/d1b/d21/f3f 0 2024-02-19T19:07:30.505 INFO:tasks.workunit.client.1.smithi142.stdout:8/212: link d9/dd/l12 d9/dd/de/l3f 0 2024-02-19T19:07:30.509 INFO:tasks.workunit.client.1.smithi142.stdout:9/181: rename db/f1d to db/d29/f35 0 2024-02-19T19:07:30.511 INFO:tasks.workunit.client.1.smithi142.stdout:8/213: symlink d9/dd/d15/l40 0 2024-02-19T19:07:30.511 INFO:tasks.workunit.client.1.smithi142.stdout:7/180: dread d0/d1b/d21/d24/d29/d2d/f2e [0,4194304] 0 2024-02-19T19:07:30.511 INFO:tasks.workunit.client.1.smithi142.stdout:7/181: stat d0/d1b/d21/d24/d31 0 2024-02-19T19:07:30.512 INFO:tasks.workunit.client.1.smithi142.stdout:9/182: rename db/d10 to db/d10/d36 22 2024-02-19T19:07:30.512 INFO:tasks.workunit.client.1.smithi142.stdout:9/183: write db/f18 [2196824,69687] 0 2024-02-19T19:07:30.512 INFO:tasks.workunit.client.1.smithi142.stdout:3/192: dwrite f1 [0,4194304] 0 2024-02-19T19:07:30.512 INFO:tasks.workunit.client.1.smithi142.stdout:3/193: write d1d/f2b [489375,119966] 0 2024-02-19T19:07:30.512 INFO:tasks.workunit.client.1.smithi142.stdout:3/194: write f5 [964607,32512] 0 2024-02-19T19:07:30.515 INFO:tasks.workunit.client.1.smithi142.stdout:9/184: creat db/d10/d22/f37 x:0 0 0 2024-02-19T19:07:30.517 INFO:tasks.workunit.client.1.smithi142.stdout:9/185: symlink db/d10/d27/l38 0 2024-02-19T19:07:30.525 INFO:tasks.workunit.client.1.smithi142.stdout:0/156: rename d23/d26 to d23/d32 0 2024-02-19T19:07:30.525 INFO:tasks.workunit.client.1.smithi142.stdout:1/209: dwrite d5/f42 [0,4194304] 0 2024-02-19T19:07:30.525 INFO:tasks.workunit.client.1.smithi142.stdout:1/210: fdatasync d5/d7/f25 0 2024-02-19T19:07:30.528 INFO:tasks.workunit.client.1.smithi142.stdout:0/157: write f13 [718630,68062] 0 2024-02-19T19:07:30.530 INFO:tasks.workunit.client.1.smithi142.stdout:0/158: creat d23/d28/f33 x:0 0 0 2024-02-19T19:07:30.530 INFO:tasks.workunit.client.1.smithi142.stdout:0/159: truncate f17 460799 0 2024-02-19T19:07:30.530 INFO:tasks.workunit.client.1.smithi142.stdout:0/160: write f16 [3308809,3220] 0 2024-02-19T19:07:30.535 INFO:tasks.workunit.client.1.smithi142.stdout:6/140: fsync d2/d1f/d20/f25 0 2024-02-19T19:07:30.543 INFO:tasks.workunit.client.1.smithi142.stdout:6/141: fsync d2/f9 0 2024-02-19T19:07:30.543 INFO:tasks.workunit.client.1.smithi142.stdout:6/142: write d2/f12 [3808461,111369] 0 2024-02-19T19:07:30.545 INFO:tasks.workunit.client.1.smithi142.stdout:6/143: mknod d2/d1f/c26 0 2024-02-19T19:07:30.546 INFO:tasks.workunit.client.1.smithi142.stdout:3/195: dwrite d1d/f2b [0,4194304] 0 2024-02-19T19:07:30.546 INFO:tasks.workunit.client.1.smithi142.stdout:9/186: dwrite db/d10/f28 [0,4194304] 0 2024-02-19T19:07:30.547 INFO:tasks.workunit.client.1.smithi142.stdout:6/144: link d2/d1f/c26 d2/d1f/d20/c27 0 2024-02-19T19:07:30.547 INFO:tasks.workunit.client.1.smithi142.stdout:1/211: dwrite d5/d7/f11 [0,4194304] 0 2024-02-19T19:07:30.547 INFO:tasks.workunit.client.1.smithi142.stdout:1/212: stat d5/d1a/d33 0 2024-02-19T19:07:30.547 INFO:tasks.workunit.client.1.smithi142.stdout:1/213: creat d5/d1a/f47 x:0 0 0 2024-02-19T19:07:30.551 INFO:tasks.workunit.client.1.smithi142.stdout:3/196: rename fb to d1d/d36/f3b 0 2024-02-19T19:07:30.551 INFO:tasks.workunit.client.1.smithi142.stdout:3/197: chown d1d/l31 10894268 1 2024-02-19T19:07:30.551 INFO:tasks.workunit.client.1.smithi142.stdout:3/198: dread - d1d/f35 zero size 2024-02-19T19:07:30.551 INFO:tasks.workunit.client.1.smithi142.stdout:3/199: dread - f12 zero size 2024-02-19T19:07:30.552 INFO:tasks.workunit.client.1.smithi142.stdout:3/200: chown d1d/f2c 9139529 1 2024-02-19T19:07:30.552 INFO:tasks.workunit.client.1.smithi142.stdout:9/187: rmdir db/d10/d32 39 2024-02-19T19:07:30.554 INFO:tasks.workunit.client.1.smithi142.stdout:6/145: rmdir d2/d1e 39 2024-02-19T19:07:30.555 INFO:tasks.workunit.client.1.smithi142.stdout:8/214: truncate d9/dd/de/f2c 246645 0 2024-02-19T19:07:30.555 INFO:tasks.workunit.client.1.smithi142.stdout:8/215: fsync f7 0 2024-02-19T19:07:30.556 INFO:tasks.workunit.client.1.smithi142.stdout:1/214: write d5/f42 [915212,7711] 0 2024-02-19T19:07:30.556 INFO:tasks.workunit.client.1.smithi142.stdout:1/215: chown d5/d7/d34/l3d 936069013 1 2024-02-19T19:07:30.557 INFO:tasks.workunit.client.1.smithi142.stdout:3/201: link d1d/d36/c39 d1d/d36/d3a/c3c 0 2024-02-19T19:07:30.560 INFO:tasks.workunit.client.1.smithi142.stdout:6/146: rmdir d2/d17 39 2024-02-19T19:07:30.561 INFO:tasks.workunit.client.1.smithi142.stdout:8/216: mknod d9/dd/c41 0 2024-02-19T19:07:30.561 INFO:tasks.workunit.client.1.smithi142.stdout:8/217: write d9/dd/d15/f22 [880276,25420] 0 2024-02-19T19:07:30.561 INFO:tasks.workunit.client.1.smithi142.stdout:8/218: creat d9/dd/de/d14/f42 x:0 0 0 2024-02-19T19:07:30.563 INFO:tasks.workunit.client.1.smithi142.stdout:1/216: link d5/d7/l2e d5/d37/l48 0 2024-02-19T19:07:30.563 INFO:tasks.workunit.client.1.smithi142.stdout:1/217: truncate f4 2235579 0 2024-02-19T19:07:30.564 INFO:tasks.workunit.client.1.smithi142.stdout:3/202: dread f5 [0,4194304] 0 2024-02-19T19:07:30.564 INFO:tasks.workunit.client.1.smithi142.stdout:3/203: chown d1d/d36 69 1 2024-02-19T19:07:30.564 INFO:tasks.workunit.client.1.smithi142.stdout:3/204: write d1d/d1e/f32 [34568,103176] 0 2024-02-19T19:07:30.565 INFO:tasks.workunit.client.1.smithi142.stdout:9/188: getdents db/d10/d32 0 2024-02-19T19:07:30.565 INFO:tasks.workunit.client.1.smithi142.stdout:9/189: write db/d10/d22/d24/f25 [3126286,50448] 0 2024-02-19T19:07:30.567 INFO:tasks.workunit.client.1.smithi142.stdout:0/161: rmdir d23/d32 39 2024-02-19T19:07:30.568 INFO:tasks.workunit.client.1.smithi142.stdout:2/191: sync 2024-02-19T19:07:30.568 INFO:tasks.workunit.client.1.smithi142.stdout:5/143: sync 2024-02-19T19:07:30.568 INFO:tasks.workunit.client.1.smithi142.stdout:6/147: rmdir d2 39 2024-02-19T19:07:30.569 INFO:tasks.workunit.client.1.smithi142.stdout:6/148: chown d2/c1b 16524581 1 2024-02-19T19:07:30.569 INFO:tasks.workunit.client.1.smithi142.stdout:6/149: chown d2/d17 18510769 1 2024-02-19T19:07:30.571 INFO:tasks.workunit.client.1.smithi142.stdout:1/218: mkdir d5/d37/d49 0 2024-02-19T19:07:30.571 INFO:tasks.workunit.client.1.smithi142.stdout:8/219: write d9/dd/de/d14/f1a [4184574,96540] 0 2024-02-19T19:07:30.572 INFO:tasks.workunit.client.1.smithi142.stdout:9/190: mknod db/d10/d32/c39 0 2024-02-19T19:07:30.575 INFO:tasks.workunit.client.1.smithi142.stdout:0/162: dread f22 [0,4194304] 0 2024-02-19T19:07:30.578 INFO:tasks.workunit.client.1.smithi142.stdout:5/144: rename d5/dd/df/l17 to d5/dd/d8/d29/l30 0 2024-02-19T19:07:30.579 INFO:tasks.workunit.client.1.smithi142.stdout:5/145: write d5/dd/df/d15/d1a/f2b [999964,113138] 0 2024-02-19T19:07:30.579 INFO:tasks.workunit.client.1.smithi142.stdout:2/192: dread d3/df/f2b [0,4194304] 0 2024-02-19T19:07:30.579 INFO:tasks.workunit.client.1.smithi142.stdout:6/150: mknod d2/d1f/c28 0 2024-02-19T19:07:30.582 INFO:tasks.workunit.client.1.smithi142.stdout:1/219: mkdir d5/d7/d4a 0 2024-02-19T19:07:30.585 INFO:tasks.workunit.client.1.smithi142.stdout:8/220: mknod d9/dd/d15/d30/c43 0 2024-02-19T19:07:30.585 INFO:tasks.workunit.client.1.smithi142.stdout:0/163: rmdir d23/d32 39 2024-02-19T19:07:30.586 INFO:tasks.workunit.client.1.smithi142.stdout:5/146: mkdir d5/dd/d8/d31 0 2024-02-19T19:07:30.587 INFO:tasks.workunit.client.1.smithi142.stdout:2/193: unlink d3/df/f2c 0 2024-02-19T19:07:30.590 INFO:tasks.workunit.client.1.smithi142.stdout:8/221: mkdir d9/dd/d44 0 2024-02-19T19:07:30.591 INFO:tasks.workunit.client.1.smithi142.stdout:0/164: truncate f1a 60462 0 2024-02-19T19:07:30.592 INFO:tasks.workunit.client.1.smithi142.stdout:5/147: rename d5/dd/df/d15/d1a/d2e to d5/dd/df/d15/d1a/d32 0 2024-02-19T19:07:30.593 INFO:tasks.workunit.client.1.smithi142.stdout:8/222: dread d9/fc [0,4194304] 0 2024-02-19T19:07:30.594 INFO:tasks.workunit.client.1.smithi142.stdout:9/191: dwrite db/d10/f1f [0,4194304] 0 2024-02-19T19:07:30.594 INFO:tasks.workunit.client.1.smithi142.stdout:1/220: rename d5/la to d5/d1a/l4b 0 2024-02-19T19:07:30.594 INFO:tasks.workunit.client.1.smithi142.stdout:6/151: dwrite d2/f9 [0,4194304] 0 2024-02-19T19:07:30.599 INFO:tasks.workunit.client.1.smithi142.stdout:1/221: symlink d5/d37/d49/l4c 0 2024-02-19T19:07:30.600 INFO:tasks.workunit.client.1.smithi142.stdout:1/222: creat d5/d1a/d33/f4d x:0 0 0 2024-02-19T19:07:30.602 INFO:tasks.workunit.client.1.smithi142.stdout:6/152: mkdir d2/d29 0 2024-02-19T19:07:30.603 INFO:tasks.workunit.client.1.smithi142.stdout:0/165: getdents d23/d28 0 2024-02-19T19:07:30.604 INFO:tasks.workunit.client.1.smithi142.stdout:2/194: dwrite d3/f16 [0,4194304] 0 2024-02-19T19:07:30.604 INFO:tasks.workunit.client.1.smithi142.stdout:2/195: fdatasync d3/df/f21 0 2024-02-19T19:07:30.610 INFO:tasks.workunit.client.1.smithi142.stdout:0/166: dread f18 [0,4194304] 0 2024-02-19T19:07:30.614 INFO:tasks.workunit.client.1.smithi142.stdout:8/223: rmdir d9/dd/d15 39 2024-02-19T19:07:30.615 INFO:tasks.workunit.client.1.smithi142.stdout:0/167: dread f18 [0,4194304] 0 2024-02-19T19:07:30.615 INFO:tasks.workunit.client.1.smithi142.stdout:0/168: write d23/d28/f33 [588650,684] 0 2024-02-19T19:07:30.616 INFO:tasks.workunit.client.1.smithi142.stdout:9/192: symlink db/d10/l3a 0 2024-02-19T19:07:30.616 INFO:tasks.workunit.client.1.smithi142.stdout:9/193: chown db/d10/f15 7 1 2024-02-19T19:07:30.616 INFO:tasks.workunit.client.1.smithi142.stdout:9/194: chown db/d10 328474 1 2024-02-19T19:07:30.619 INFO:tasks.workunit.client.1.smithi142.stdout:1/223: creat d5/f4e x:0 0 0 2024-02-19T19:07:30.619 INFO:tasks.workunit.client.1.smithi142.stdout:1/224: write d5/d1a/f3a [277703,125947] 0 2024-02-19T19:07:30.620 INFO:tasks.workunit.client.1.smithi142.stdout:6/153: creat d2/d1e/f2a x:0 0 0 2024-02-19T19:07:30.620 INFO:tasks.workunit.client.1.smithi142.stdout:6/154: chown d2/d1e 126616729 1 2024-02-19T19:07:30.622 INFO:tasks.workunit.client.1.smithi142.stdout:2/196: creat d3/db/f3a x:0 0 0 2024-02-19T19:07:30.623 INFO:tasks.workunit.client.1.smithi142.stdout:0/169: creat d23/d28/f34 x:0 0 0 2024-02-19T19:07:30.625 INFO:tasks.workunit.client.1.smithi142.stdout:6/155: creat d2/d1f/f2b x:0 0 0 2024-02-19T19:07:30.626 INFO:tasks.workunit.client.1.smithi142.stdout:6/156: creat d2/d1f/d20/f2c x:0 0 0 2024-02-19T19:07:30.626 INFO:tasks.workunit.client.1.smithi142.stdout:6/157: dread - d2/d1f/d20/f2c zero size 2024-02-19T19:07:30.626 INFO:tasks.workunit.client.1.smithi142.stdout:9/195: rmdir db/d10/d22 39 2024-02-19T19:07:30.629 INFO:tasks.workunit.client.1.smithi142.stdout:9/196: unlink db/d10/f1f 0 2024-02-19T19:07:30.631 INFO:tasks.workunit.client.1.smithi142.stdout:9/197: symlink db/l3b 0 2024-02-19T19:07:30.637 INFO:tasks.workunit.client.1.smithi142.stdout:6/158: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:30.639 INFO:tasks.workunit.client.1.smithi142.stdout:6/159: mknod d2/d17/c2d 0 2024-02-19T19:07:30.639 INFO:tasks.workunit.client.1.smithi142.stdout:6/160: rename d2/d1e to d2/d1e/d2e 22 2024-02-19T19:07:30.639 INFO:tasks.workunit.client.1.smithi142.stdout:6/161: write d2/d1f/f2b [983309,18645] 0 2024-02-19T19:07:30.642 INFO:tasks.workunit.client.1.smithi142.stdout:6/162: getdents d2/d1e 0 2024-02-19T19:07:30.642 INFO:tasks.workunit.client.1.smithi142.stdout:6/163: write d2/d1f/d20/f2c [771307,47407] 0 2024-02-19T19:07:30.642 INFO:tasks.workunit.client.1.smithi142.stdout:6/164: readlink d2/l5 0 2024-02-19T19:07:30.642 INFO:tasks.workunit.client.1.smithi142.stdout:8/224: dwrite f1 [0,4194304] 0 2024-02-19T19:07:30.643 INFO:tasks.workunit.client.1.smithi142.stdout:6/165: symlink d2/d1f/d20/l2f 0 2024-02-19T19:07:30.643 INFO:tasks.workunit.client.1.smithi142.stdout:6/166: write d2/d1f/f2b [1099024,102940] 0 2024-02-19T19:07:30.644 INFO:tasks.workunit.client.1.smithi142.stdout:6/167: write d2/d1f/d20/f2c [96630,126788] 0 2024-02-19T19:07:30.644 INFO:tasks.workunit.client.1.smithi142.stdout:6/168: chown d2/f18 20 1 2024-02-19T19:07:30.645 INFO:tasks.workunit.client.1.smithi142.stdout:9/198: read db/d10/f28 [3657063,22070] 0 2024-02-19T19:07:30.645 INFO:tasks.workunit.client.1.smithi142.stdout:8/225: truncate d9/dd/d15/f22 388846 0 2024-02-19T19:07:30.647 INFO:tasks.workunit.client.1.smithi142.stdout:2/197: dwrite d3/db/f15 [0,4194304] 0 2024-02-19T19:07:30.647 INFO:tasks.workunit.client.1.smithi142.stdout:1/225: dwrite d5/d7/f11 [0,4194304] 0 2024-02-19T19:07:30.647 INFO:tasks.workunit.client.1.smithi142.stdout:9/199: creat db/d10/d22/d24/f3c x:0 0 0 2024-02-19T19:07:30.647 INFO:tasks.workunit.client.1.smithi142.stdout:9/200: chown db/d10/d32 94588395 1 2024-02-19T19:07:30.652 INFO:tasks.workunit.client.1.smithi142.stdout:2/198: symlink d3/db/d29/l3b 0 2024-02-19T19:07:30.659 INFO:tasks.workunit.client.1.smithi142.stdout:9/201: dread f5 [0,4194304] 0 2024-02-19T19:07:30.687 INFO:tasks.workunit.client.1.smithi142.stdout:1/226: dwrite d5/d7/d23/f45 [0,4194304] 0 2024-02-19T19:07:30.687 INFO:tasks.workunit.client.1.smithi142.stdout:2/199: dwrite d3/df/f32 [0,4194304] 0 2024-02-19T19:07:30.687 INFO:tasks.workunit.client.1.smithi142.stdout:6/169: dwrite d2/d1f/d20/f2c [0,4194304] 0 2024-02-19T19:07:30.687 INFO:tasks.workunit.client.1.smithi142.stdout:6/170: creat d2/d1f/f30 x:0 0 0 2024-02-19T19:07:30.688 INFO:tasks.workunit.client.1.smithi142.stdout:6/171: chown d2/le 1 1 2024-02-19T19:07:30.689 INFO:tasks.workunit.client.1.smithi142.stdout:8/226: read d9/dd/d15/f22 [159037,122320] 0 2024-02-19T19:07:30.689 INFO:tasks.workunit.client.1.smithi142.stdout:8/227: chown d9/dd/de/l3f 10295385 1 2024-02-19T19:07:30.690 INFO:tasks.workunit.client.1.smithi142.stdout:6/172: mkdir d2/d1f/d20/d31 0 2024-02-19T19:07:30.699 INFO:tasks.workunit.client.1.smithi142.stdout:8/228: write d9/dd/f1d [3464823,77725] 0 2024-02-19T19:07:30.700 INFO:tasks.workunit.client.1.smithi142.stdout:1/227: dwrite d5/d1a/d33/f36 [0,4194304] 0 2024-02-19T19:07:30.700 INFO:tasks.workunit.client.1.smithi142.stdout:1/228: chown d5/d1a/f3a 47 1 2024-02-19T19:07:30.700 INFO:tasks.workunit.client.1.smithi142.stdout:1/229: fdatasync d5/f38 0 2024-02-19T19:07:30.700 INFO:tasks.workunit.client.1.smithi142.stdout:1/230: creat d5/d7/f4f x:0 0 0 2024-02-19T19:07:30.701 INFO:tasks.workunit.client.1.smithi142.stdout:1/231: stat d5/d7 0 2024-02-19T19:07:30.703 INFO:tasks.workunit.client.1.smithi142.stdout:6/173: symlink d2/d17/l32 0 2024-02-19T19:07:30.703 INFO:tasks.workunit.client.1.smithi142.stdout:6/174: stat d2/d17 0 2024-02-19T19:07:30.704 INFO:tasks.workunit.client.1.smithi142.stdout:6/175: chown d2/d1f/f30 743581 1 2024-02-19T19:07:30.704 INFO:tasks.workunit.client.1.smithi142.stdout:8/229: creat d9/dd/de/f45 x:0 0 0 2024-02-19T19:07:30.709 INFO:tasks.workunit.client.1.smithi142.stdout:9/202: dwrite db/d10/d22/f37 [0,4194304] 0 2024-02-19T19:07:30.711 INFO:tasks.workunit.client.1.smithi142.stdout:8/230: rename d9/dd/de/f2b to d9/f46 0 2024-02-19T19:07:30.711 INFO:tasks.workunit.client.1.smithi142.stdout:8/231: creat d9/dd/f47 x:0 0 0 2024-02-19T19:07:30.715 INFO:tasks.workunit.client.1.smithi142.stdout:1/232: dwrite d5/d7/f11 [0,4194304] 0 2024-02-19T19:07:30.716 INFO:tasks.workunit.client.1.smithi142.stdout:1/233: chown d5/d1a/l4b 6317 1 2024-02-19T19:07:30.716 INFO:tasks.workunit.client.1.smithi142.stdout:1/234: creat d5/d1a/d33/f50 x:0 0 0 2024-02-19T19:07:30.719 INFO:tasks.workunit.client.1.smithi142.stdout:9/203: dread db/d10/f28 [0,4194304] 0 2024-02-19T19:07:30.719 INFO:tasks.workunit.client.1.smithi142.stdout:9/204: read db/d10/d22/d24/f25 [1141300,24706] 0 2024-02-19T19:07:30.722 INFO:tasks.workunit.client.1.smithi142.stdout:8/232: symlink d9/dd/de/d2d/l48 0 2024-02-19T19:07:30.725 INFO:tasks.workunit.client.1.smithi142.stdout:6/176: dread d2/d1f/d20/f2c [0,4194304] 0 2024-02-19T19:07:30.725 INFO:tasks.workunit.client.1.smithi142.stdout:1/235: truncate d5/ff 717710 0 2024-02-19T19:07:30.727 INFO:tasks.workunit.client.1.smithi142.stdout:9/205: mkdir db/d10/d22/d24/d3d 0 2024-02-19T19:07:30.729 INFO:tasks.workunit.client.1.smithi142.stdout:1/236: creat d5/d7/d23/d2c/f51 x:0 0 0 2024-02-19T19:07:30.730 INFO:tasks.workunit.client.1.smithi142.stdout:1/237: creat d5/d37/f52 x:0 0 0 2024-02-19T19:07:30.733 INFO:tasks.workunit.client.1.smithi142.stdout:9/206: dread db/d10/f28 [0,4194304] 0 2024-02-19T19:07:30.734 INFO:tasks.workunit.client.1.smithi142.stdout:1/238: getdents d5 0 2024-02-19T19:07:30.736 INFO:tasks.workunit.client.1.smithi142.stdout:6/177: dread d2/d1f/f2b [0,4194304] 0 2024-02-19T19:07:30.736 INFO:tasks.workunit.client.1.smithi142.stdout:6/178: write d2/d1f/d20/f25 [374570,124230] 0 2024-02-19T19:07:30.736 INFO:tasks.workunit.client.1.smithi142.stdout:9/207: dread db/d29/f35 [0,4194304] 0 2024-02-19T19:07:30.737 INFO:tasks.workunit.client.1.smithi142.stdout:4/282: sync 2024-02-19T19:07:30.737 INFO:tasks.workunit.client.1.smithi142.stdout:4/283: chown d4/d14/l25 5107 1 2024-02-19T19:07:30.737 INFO:tasks.workunit.client.1.smithi142.stdout:6/179: mkdir d2/d17/d33 0 2024-02-19T19:07:30.738 INFO:tasks.workunit.client.1.smithi142.stdout:4/284: mknod d4/dc/dd/d10/d3b/d3f/c5e 0 2024-02-19T19:07:30.739 INFO:tasks.workunit.client.1.smithi142.stdout:6/180: symlink d2/d1e/l34 0 2024-02-19T19:07:30.742 INFO:tasks.workunit.client.1.smithi142.stdout:4/285: dread d4/d14/f2f [0,4194304] 0 2024-02-19T19:07:30.744 INFO:tasks.workunit.client.1.smithi142.stdout:4/286: dread d4/d14/f2f [0,4194304] 0 2024-02-19T19:07:30.744 INFO:tasks.workunit.client.1.smithi142.stdout:2/200: dwrite d3/db/f3a [0,4194304] 0 2024-02-19T19:07:30.744 INFO:tasks.workunit.client.1.smithi142.stdout:4/287: fsync d4/d1c/f22 0 2024-02-19T19:07:30.746 INFO:tasks.workunit.client.1.smithi142.stdout:6/181: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:30.746 INFO:tasks.workunit.client.1.smithi142.stdout:6/182: chown d2/d17/d33 0 1 2024-02-19T19:07:30.746 INFO:tasks.workunit.client.1.smithi142.stdout:2/201: rmdir d3/db/d29 39 2024-02-19T19:07:30.747 INFO:tasks.workunit.client.1.smithi142.stdout:4/288: mkdir d4/dc/d5f 0 2024-02-19T19:07:30.748 INFO:tasks.workunit.client.1.smithi142.stdout:1/239: write d5/f2d [1672713,123609] 0 2024-02-19T19:07:30.751 INFO:tasks.workunit.client.1.smithi142.stdout:4/289: creat d4/d14/d31/d43/d52/f60 x:0 0 0 2024-02-19T19:07:30.752 INFO:tasks.workunit.client.1.smithi142.stdout:4/290: creat d4/d14/d31/f61 x:0 0 0 2024-02-19T19:07:30.752 INFO:tasks.workunit.client.1.smithi142.stdout:4/291: write d4/dc/dd/d10/d3e/f4e [2122126,81908] 0 2024-02-19T19:07:30.752 INFO:tasks.workunit.client.1.smithi142.stdout:4/292: readlink d4/dc/dd/d10/d26/d50/d54/l58 0 2024-02-19T19:07:30.752 INFO:tasks.workunit.client.1.smithi142.stdout:4/293: chown d4/dc/d12/f40 106742 1 2024-02-19T19:07:30.752 INFO:tasks.workunit.client.1.smithi142.stdout:1/240: mkdir d5/d7/d4a/d53 0 2024-02-19T19:07:30.752 INFO:tasks.workunit.client.1.smithi142.stdout:1/241: readlink d5/d7/l2e 0 2024-02-19T19:07:30.756 INFO:tasks.workunit.client.1.smithi142.stdout:9/208: dwrite db/d10/f15 [0,4194304] 0 2024-02-19T19:07:30.758 INFO:tasks.workunit.client.1.smithi142.stdout:8/233: dwrite d9/dd/de/d2d/d2e/f3d [0,4194304] 0 2024-02-19T19:07:30.762 INFO:tasks.workunit.client.1.smithi142.stdout:5/148: sync 2024-02-19T19:07:30.762 INFO:tasks.workunit.client.1.smithi142.stdout:5/149: getdents d5/dd/d8/d31 0 2024-02-19T19:07:30.763 INFO:tasks.workunit.client.1.smithi142.stdout:8/234: mkdir d9/dd/de/d2d/d2e/d49 0 2024-02-19T19:07:30.763 INFO:tasks.workunit.client.1.smithi142.stdout:8/235: fsync d9/dd/de/f24 0 2024-02-19T19:07:30.763 INFO:tasks.workunit.client.1.smithi142.stdout:4/294: dread d4/dc/d12/f40 [0,4194304] 0 2024-02-19T19:07:30.765 INFO:tasks.workunit.client.1.smithi142.stdout:7/182: sync 2024-02-19T19:07:30.765 INFO:tasks.workunit.client.1.smithi142.stdout:3/205: sync 2024-02-19T19:07:30.765 INFO:tasks.workunit.client.1.smithi142.stdout:3/206: fdatasync f19 0 2024-02-19T19:07:30.765 INFO:tasks.workunit.client.1.smithi142.stdout:3/207: chown d1d/f38 7057 1 2024-02-19T19:07:30.765 INFO:tasks.workunit.client.1.smithi142.stdout:7/183: creat d0/d1b/d21/d24/d29/d2d/f40 x:0 0 0 2024-02-19T19:07:30.766 INFO:tasks.workunit.client.1.smithi142.stdout:7/184: symlink d0/d13/d1e/d22/l41 0 2024-02-19T19:07:30.768 INFO:tasks.workunit.client.1.smithi142.stdout:3/208: rename d1d/f24 to d1d/d36/f3d 0 2024-02-19T19:07:30.768 INFO:tasks.workunit.client.1.smithi142.stdout:2/202: dwrite d3/db/f20 [0,4194304] 0 2024-02-19T19:07:30.769 INFO:tasks.workunit.client.1.smithi142.stdout:6/183: dwrite d2/d1f/d20/f2c [0,4194304] 0 2024-02-19T19:07:30.771 INFO:tasks.workunit.client.1.smithi142.stdout:6/184: mkdir d2/d1e/d35 0 2024-02-19T19:07:30.774 INFO:tasks.workunit.client.1.smithi142.stdout:3/209: write d1d/f2a [947673,124008] 0 2024-02-19T19:07:30.774 INFO:tasks.workunit.client.1.smithi142.stdout:2/203: rename d3/d35/c36 to d3/c3c 0 2024-02-19T19:07:30.776 INFO:tasks.workunit.client.1.smithi142.stdout:6/185: rename d2/d17/l1d to d2/d17/l36 0 2024-02-19T19:07:30.778 INFO:tasks.workunit.client.1.smithi142.stdout:2/204: rename d3/db/d29/l3b to d3/db/l3d 0 2024-02-19T19:07:30.778 INFO:tasks.workunit.client.1.smithi142.stdout:2/205: write d3/df/f21 [641984,8156] 0 2024-02-19T19:07:30.785 INFO:tasks.workunit.client.1.smithi142.stdout:3/210: dread d1d/d1e/f21 [0,4194304] 0 2024-02-19T19:07:30.785 INFO:tasks.workunit.client.1.smithi142.stdout:0/170: sync 2024-02-19T19:07:30.786 INFO:tasks.workunit.client.1.smithi142.stdout:0/171: fsync d23/d32/f30 0 2024-02-19T19:07:30.786 INFO:tasks.workunit.client.1.smithi142.stdout:3/211: creat d1d/f3e x:0 0 0 2024-02-19T19:07:30.788 INFO:tasks.workunit.client.1.smithi142.stdout:3/212: getdents d1d/d1e/d2e 0 2024-02-19T19:07:30.789 INFO:tasks.workunit.client.1.smithi142.stdout:0/172: getdents d23 0 2024-02-19T19:07:30.798 INFO:tasks.workunit.client.1.smithi142.stdout:0/173: dread f22 [0,4194304] 0 2024-02-19T19:07:30.798 INFO:tasks.workunit.client.1.smithi142.stdout:0/174: fdatasync f17 0 2024-02-19T19:07:30.798 INFO:tasks.workunit.client.1.smithi142.stdout:0/175: write fb [323935,84593] 0 2024-02-19T19:07:30.799 INFO:tasks.workunit.client.1.smithi142.stdout:0/176: mknod d23/d32/c35 0 2024-02-19T19:07:30.800 INFO:tasks.workunit.client.1.smithi142.stdout:3/213: write f19 [2617028,92573] 0 2024-02-19T19:07:30.800 INFO:tasks.workunit.client.1.smithi142.stdout:0/177: truncate f15 2778242 0 2024-02-19T19:07:30.800 INFO:tasks.workunit.client.1.smithi142.stdout:0/178: truncate d23/d32/f30 1315128 0 2024-02-19T19:07:30.801 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:30 smithi046 podman[106345]: 2024-02-19 19:07:30.375222308 +0000 UTC m=+0.032633619 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:07:30.801 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:30 smithi046 podman[106345]: 2024-02-19 19:07:30.503309976 +0000 UTC m=+0.160721285 container create a259c02271024bd9e28537b744f5a9f99a50e58c34f5bb78480e6ae1444ae017 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-19T19:07:30.802 INFO:tasks.workunit.client.1.smithi142.stdout:3/214: rename d1d/f3e to d1d/d1e/d2e/f3f 0 2024-02-19T19:07:30.802 INFO:tasks.workunit.client.1.smithi142.stdout:3/215: chown d1d 5831 1 2024-02-19T19:07:30.803 INFO:tasks.workunit.client.1.smithi142.stdout:5/150: dwrite f4 [4194304,4194304] 0 2024-02-19T19:07:30.803 INFO:tasks.workunit.client.1.smithi142.stdout:0/179: mkdir d23/d32/d36 0 2024-02-19T19:07:30.804 INFO:tasks.workunit.client.1.smithi142.stdout:8/236: dwrite d9/dd/de/f2c [0,4194304] 0 2024-02-19T19:07:30.804 INFO:tasks.workunit.client.1.smithi142.stdout:3/216: mknod d1d/d1e/d2e/c40 0 2024-02-19T19:07:30.804 INFO:tasks.workunit.client.1.smithi142.stdout:3/217: creat d1d/f41 x:0 0 0 2024-02-19T19:07:30.804 INFO:tasks.workunit.client.1.smithi142.stdout:6/186: dwrite d2/d1f/f30 [0,4194304] 0 2024-02-19T19:07:30.805 INFO:tasks.workunit.client.1.smithi142.stdout:2/206: dwrite d3/df/f2b [0,4194304] 0 2024-02-19T19:07:30.806 INFO:tasks.workunit.client.1.smithi142.stdout:2/207: chown d3/db/l3d 67 1 2024-02-19T19:07:30.806 INFO:tasks.workunit.client.1.smithi142.stdout:4/295: dwrite d4/d1c/f22 [0,4194304] 0 2024-02-19T19:07:30.809 INFO:tasks.workunit.client.1.smithi142.stdout:5/151: creat d5/dd/d8/d31/f33 x:0 0 0 2024-02-19T19:07:30.817 INFO:tasks.workunit.client.1.smithi142.stdout:8/237: getdents d9/dd/d15 0 2024-02-19T19:07:30.818 INFO:tasks.workunit.client.1.smithi142.stdout:8/238: dread d9/f46 [0,4194304] 0 2024-02-19T19:07:30.818 INFO:tasks.workunit.client.1.smithi142.stdout:8/239: write d9/dd/de/d14/f20 [311388,125408] 0 2024-02-19T19:07:30.818 INFO:tasks.workunit.client.1.smithi142.stdout:5/152: write d5/f2c [4596318,108413] 0 2024-02-19T19:07:30.818 INFO:tasks.workunit.client.1.smithi142.stdout:5/153: creat d5/dd/d8/d31/f34 x:0 0 0 2024-02-19T19:07:30.820 INFO:tasks.workunit.client.1.smithi142.stdout:3/218: link f15 d1d/f42 0 2024-02-19T19:07:30.824 INFO:tasks.workunit.client.1.smithi142.stdout:6/187: rename d2/lf to d2/d1f/d20/d31/l37 0 2024-02-19T19:07:30.827 INFO:tasks.workunit.client.1.smithi142.stdout:2/208: rename d3/db/l2d to d3/db/l3e 0 2024-02-19T19:07:30.827 INFO:tasks.workunit.client.1.smithi142.stdout:2/209: chown d3/df 6245 1 2024-02-19T19:07:30.827 INFO:tasks.workunit.client.1.smithi142.stdout:2/210: readlink d3/l9 0 2024-02-19T19:07:30.827 INFO:tasks.workunit.client.1.smithi142.stdout:3/219: write f1 [920316,32420] 0 2024-02-19T19:07:30.827 INFO:tasks.workunit.client.1.smithi142.stdout:3/220: write f10 [1366373,19792] 0 2024-02-19T19:07:30.828 INFO:tasks.workunit.client.1.smithi142.stdout:3/221: chown d1d/f38 10718109 1 2024-02-19T19:07:30.828 INFO:tasks.workunit.client.1.smithi142.stdout:4/296: mkdir d4/dc/d12/d2d/d62 0 2024-02-19T19:07:30.828 INFO:tasks.workunit.client.1.smithi142.stdout:4/297: write d4/dc/d12/d2d/d2a/f4c [1219441,77844] 0 2024-02-19T19:07:30.829 INFO:tasks.workunit.client.1.smithi142.stdout:4/298: write d4/d1c/f2e [162367,78048] 0 2024-02-19T19:07:30.829 INFO:tasks.workunit.client.1.smithi142.stdout:4/299: truncate d4/d14/d31/d43/d52/f60 361292 0 2024-02-19T19:07:30.832 INFO:tasks.workunit.client.1.smithi142.stdout:8/240: symlink d9/dd/de/d2d/d2e/d49/l4a 0 2024-02-19T19:07:30.832 INFO:tasks.workunit.client.1.smithi142.stdout:8/241: write d9/dd/de/d14/f20 [511499,69752] 0 2024-02-19T19:07:30.834 INFO:tasks.workunit.client.1.smithi142.stdout:5/154: creat d5/dd/df/d15/d1a/d32/f35 x:0 0 0 2024-02-19T19:07:30.836 INFO:tasks.workunit.client.1.smithi142.stdout:6/188: link d2/le d2/d17/l38 0 2024-02-19T19:07:30.836 INFO:tasks.workunit.client.1.smithi142.stdout:6/189: read d2/f18 [418454,70137] 0 2024-02-19T19:07:30.836 INFO:tasks.workunit.client.1.smithi142.stdout:6/190: chown d2/d17/f24 207419689 1 2024-02-19T19:07:30.836 INFO:tasks.workunit.client.1.smithi142.stdout:5/155: write d5/dd/df/d15/d1a/f2b [896541,111157] 0 2024-02-19T19:07:30.837 INFO:tasks.workunit.client.1.smithi142.stdout:2/211: creat d3/d35/f3f x:0 0 0 2024-02-19T19:07:30.837 INFO:tasks.workunit.client.1.smithi142.stdout:4/300: rename d4/dc/d12/f40 to d4/d14/d31/d43/d52/f63 0 2024-02-19T19:07:30.838 INFO:tasks.workunit.client.1.smithi142.stdout:8/242: mknod d9/dd/c4b 0 2024-02-19T19:07:30.841 INFO:tasks.workunit.client.1.smithi142.stdout:6/191: mkdir d2/d17/d33/d39 0 2024-02-19T19:07:30.841 INFO:tasks.workunit.client.1.smithi142.stdout:6/192: write d2/f12 [3993378,73435] 0 2024-02-19T19:07:30.841 INFO:tasks.workunit.client.1.smithi142.stdout:6/193: truncate d2/d1e/f2a 121539 0 2024-02-19T19:07:30.842 INFO:tasks.workunit.client.1.smithi142.stdout:5/156: symlink d5/dd/d8/d2a/l36 0 2024-02-19T19:07:30.842 INFO:tasks.workunit.client.1.smithi142.stdout:3/222: dwrite f19 [0,4194304] 0 2024-02-19T19:07:30.843 INFO:tasks.workunit.client.1.smithi142.stdout:2/212: mknod d3/c40 0 2024-02-19T19:07:30.843 INFO:tasks.workunit.client.1.smithi142.stdout:4/301: mknod d4/d34/d44/c64 0 2024-02-19T19:07:30.843 INFO:tasks.workunit.client.1.smithi142.stdout:4/302: fsync d4/dc/f27 0 2024-02-19T19:07:30.843 INFO:tasks.workunit.client.1.smithi142.stdout:4/303: stat d4/d1d/d42/c5a 0 2024-02-19T19:07:30.844 INFO:tasks.workunit.client.1.smithi142.stdout:6/194: dread d2/d1f/d20/f25 [0,4194304] 0 2024-02-19T19:07:30.844 INFO:tasks.workunit.client.1.smithi142.stdout:6/195: readlink d2/d17/l38 0 2024-02-19T19:07:30.844 INFO:tasks.workunit.client.1.smithi142.stdout:8/243: mknod d9/dd/de/d14/d21/c4c 0 2024-02-19T19:07:30.845 INFO:tasks.workunit.client.1.smithi142.stdout:5/157: creat d5/dd/df/d22/f37 x:0 0 0 2024-02-19T19:07:30.845 INFO:tasks.workunit.client.1.smithi142.stdout:5/158: write d5/dd/d8/d31/f34 [914062,78299] 0 2024-02-19T19:07:30.847 INFO:tasks.workunit.client.1.smithi142.stdout:5/159: dread d5/dd/df/f12 [4194304,4194304] 0 2024-02-19T19:07:30.850 INFO:tasks.workunit.client.1.smithi142.stdout:3/223: dread d1d/d1e/d2e/f33 [0,4194304] 0 2024-02-19T19:07:30.850 INFO:tasks.workunit.client.1.smithi142.stdout:3/224: chown d1d/d1e/d2e/f3f 34714 1 2024-02-19T19:07:30.850 INFO:tasks.workunit.client.1.smithi142.stdout:2/213: link d3/df/f12 d3/db/d29/f41 0 2024-02-19T19:07:30.851 INFO:tasks.workunit.client.1.smithi142.stdout:2/214: write d3/db/f23 [5134417,124550] 0 2024-02-19T19:07:30.851 INFO:tasks.workunit.client.1.smithi142.stdout:4/304: symlink d4/dc/dd/l65 0 2024-02-19T19:07:30.851 INFO:tasks.workunit.client.1.smithi142.stdout:6/196: dread d2/d1f/f30 [0,4194304] 0 2024-02-19T19:07:30.852 INFO:tasks.workunit.client.1.smithi142.stdout:8/244: mkdir d9/dd/d15/d4d 0 2024-02-19T19:07:30.852 INFO:tasks.workunit.client.1.smithi142.stdout:8/245: chown c5 1540 1 2024-02-19T19:07:30.853 INFO:tasks.workunit.client.1.smithi142.stdout:3/225: creat d1d/d1e/d2e/f43 x:0 0 0 2024-02-19T19:07:30.857 INFO:tasks.workunit.client.1.smithi142.stdout:4/305: rmdir d4/dc/d12/d2d/d62 0 2024-02-19T19:07:30.859 INFO:tasks.workunit.client.1.smithi142.stdout:6/197: link d2/c8 d2/d17/d33/d39/c3a 0 2024-02-19T19:07:30.859 INFO:tasks.workunit.client.1.smithi142.stdout:6/198: stat d2/d1f/f30 0 2024-02-19T19:07:30.860 INFO:tasks.workunit.client.1.smithi142.stdout:8/246: creat d9/f4e x:0 0 0 2024-02-19T19:07:30.864 INFO:tasks.workunit.client.1.smithi142.stdout:3/226: getdents d1d/d1e 0 2024-02-19T19:07:30.867 INFO:tasks.workunit.client.1.smithi142.stdout:5/160: getdents d5/dd/d8/d31 0 2024-02-19T19:07:30.867 INFO:tasks.workunit.client.1.smithi142.stdout:5/161: creat d5/f38 x:0 0 0 2024-02-19T19:07:30.867 INFO:tasks.workunit.client.1.smithi142.stdout:5/162: truncate d5/dd/d8/d31/f33 43312 0 2024-02-19T19:07:30.869 INFO:tasks.workunit.client.1.smithi142.stdout:6/199: mkdir d2/d29/d3b 0 2024-02-19T19:07:30.871 INFO:tasks.workunit.client.1.smithi142.stdout:8/247: symlink d9/dd/d15/d4d/l4f 0 2024-02-19T19:07:30.871 INFO:tasks.workunit.client.1.smithi142.stdout:8/248: readlink d9/la 0 2024-02-19T19:07:30.872 INFO:tasks.workunit.client.1.smithi142.stdout:4/306: rmdir d4/dc/dd/d10/d3b/d3f 39 2024-02-19T19:07:30.872 INFO:tasks.workunit.client.1.smithi142.stdout:4/307: truncate d4/dc/dd/d10/d26/d50/d54/f59 476898 0 2024-02-19T19:07:30.873 INFO:tasks.workunit.client.1.smithi142.stdout:3/227: dread d1d/d1e/f21 [0,4194304] 0 2024-02-19T19:07:30.873 INFO:tasks.workunit.client.1.smithi142.stdout:3/228: readlink l1b 0 2024-02-19T19:07:30.873 INFO:tasks.workunit.client.1.smithi142.stdout:3/229: readlink l17 0 2024-02-19T19:07:30.874 INFO:tasks.workunit.client.1.smithi142.stdout:5/163: creat d5/dd/df/d15/d1a/d32/f39 x:0 0 0 2024-02-19T19:07:30.874 INFO:tasks.workunit.client.1.smithi142.stdout:5/164: creat d5/dd/df/d15/d1a/f3a x:0 0 0 2024-02-19T19:07:30.877 INFO:tasks.workunit.client.1.smithi142.stdout:6/200: mkdir d2/d17/d33/d3c 0 2024-02-19T19:07:30.879 INFO:tasks.workunit.client.1.smithi142.stdout:8/249: mkdir d9/dd/de/d2d/d2e/d49/d50 0 2024-02-19T19:07:30.881 INFO:tasks.workunit.client.1.smithi142.stdout:3/230: symlink d1d/d1e/d2e/d37/l44 0 2024-02-19T19:07:30.881 INFO:tasks.workunit.client.1.smithi142.stdout:3/231: readlink d1d/l34 0 2024-02-19T19:07:30.894 INFO:tasks.workunit.client.1.smithi142.stdout:2/215: rmdir d3/db 39 2024-02-19T19:07:30.896 INFO:tasks.workunit.client.1.smithi142.stdout:2/216: truncate d3/f17 2888725 0 2024-02-19T19:07:30.898 INFO:tasks.workunit.client.1.smithi142.stdout:2/217: rmdir d3/d35 39 2024-02-19T19:07:30.898 INFO:tasks.workunit.client.1.smithi142.stdout:3/232: dwrite f5 [0,4194304] 0 2024-02-19T19:07:30.899 INFO:tasks.workunit.client.1.smithi142.stdout:6/201: dwrite d2/d1f/f2b [0,4194304] 0 2024-02-19T19:07:30.904 INFO:tasks.workunit.client.1.smithi142.stdout:6/202: stat d2/c8 0 2024-02-19T19:07:30.905 INFO:tasks.workunit.client.1.smithi142.stdout:1/242: sync 2024-02-19T19:07:30.905 INFO:tasks.workunit.client.1.smithi142.stdout:7/185: sync 2024-02-19T19:07:30.905 INFO:tasks.workunit.client.1.smithi142.stdout:1/243: chown d5/d1a/d33/f50 37 1 2024-02-19T19:07:30.905 INFO:tasks.workunit.client.1.smithi142.stdout:9/209: sync 2024-02-19T19:07:30.906 INFO:tasks.workunit.client.1.smithi142.stdout:6/203: dread d2/d17/f24 [0,4194304] 0 2024-02-19T19:07:30.906 INFO:tasks.workunit.client.1.smithi142.stdout:4/308: rename d4/dc to d4/d1d/d42/d66 0 2024-02-19T19:07:30.906 INFO:tasks.workunit.client.1.smithi142.stdout:4/309: chown d4/d1d/d42/d66/l4d 14837 1 2024-02-19T19:07:30.908 INFO:tasks.workunit.client.1.smithi142.stdout:9/210: chown db/d10/ce 25 1 2024-02-19T19:07:30.908 INFO:tasks.workunit.client.1.smithi142.stdout:9/211: creat db/d10/d22/d24/f3e x:0 0 0 2024-02-19T19:07:30.908 INFO:tasks.workunit.client.1.smithi142.stdout:9/212: dread - db/d10/d22/d24/f3e zero size 2024-02-19T19:07:30.909 INFO:tasks.workunit.client.1.smithi142.stdout:2/218: write d3/db/f15 [709933,28428] 0 2024-02-19T19:07:30.910 INFO:tasks.workunit.client.1.smithi142.stdout:8/250: dwrite d9/dd/d15/f28 [0,4194304] 0 2024-02-19T19:07:30.910 INFO:tasks.workunit.client.1.smithi142.stdout:8/251: creat d9/dd/de/d14/f51 x:0 0 0 2024-02-19T19:07:30.910 INFO:tasks.workunit.client.1.smithi142.stdout:8/252: truncate d9/dd/de/d14/f1a 4643694 0 2024-02-19T19:07:30.910 INFO:tasks.workunit.client.1.smithi142.stdout:8/253: chown d9/dd/de/d14/d21/f35 413777909 1 2024-02-19T19:07:30.910 INFO:tasks.workunit.client.1.smithi142.stdout:6/204: mkdir d2/d1f/d20/d31/d3d 0 2024-02-19T19:07:30.911 INFO:tasks.workunit.client.1.smithi142.stdout:6/205: stat d2/d1f 0 2024-02-19T19:07:30.913 INFO:tasks.workunit.client.1.smithi142.stdout:4/310: creat d4/d1d/d42/d66/d2c/f67 x:0 0 0 2024-02-19T19:07:30.913 INFO:tasks.workunit.client.1.smithi142.stdout:4/311: chown d4 58909405 1 2024-02-19T19:07:30.914 INFO:tasks.workunit.client.1.smithi142.stdout:0/180: sync 2024-02-19T19:07:30.914 INFO:tasks.workunit.client.1.smithi142.stdout:0/181: write f1a [616887,49383] 0 2024-02-19T19:07:30.915 INFO:tasks.workunit.client.1.smithi142.stdout:7/186: write d0/d1b/d21/d24/f28 [2183242,40014] 0 2024-02-19T19:07:30.918 INFO:tasks.workunit.client.1.smithi142.stdout:2/219: link d3/f5 d3/df/f42 0 2024-02-19T19:07:30.919 INFO:tasks.workunit.client.1.smithi142.stdout:3/233: dwrite d1d/d1e/f21 [0,4194304] 0 2024-02-19T19:07:30.922 INFO:tasks.workunit.client.1.smithi142.stdout:8/254: rename d9/dd/de/f2c to d9/dd/de/d2d/d2e/f52 0 2024-02-19T19:07:30.924 INFO:tasks.workunit.client.1.smithi142.stdout:6/206: mkdir d2/d1f/d20/d31/d3d/d3e 0 2024-02-19T19:07:30.924 INFO:tasks.workunit.client.1.smithi142.stdout:0/182: truncate f16 1362811 0 2024-02-19T19:07:30.925 INFO:tasks.workunit.client.1.smithi142.stdout:9/213: mkdir db/d10/d32/d3f 0 2024-02-19T19:07:30.925 INFO:tasks.workunit.client.1.smithi142.stdout:9/214: read f5 [3122692,4401] 0 2024-02-19T19:07:30.928 INFO:tasks.workunit.client.1.smithi142.stdout:1/244: dwrite d5/fd [0,4194304] 0 2024-02-19T19:07:30.928 INFO:tasks.workunit.client.1.smithi142.stdout:3/234: read d1d/f38 [1038490,40535] 0 2024-02-19T19:07:30.928 INFO:tasks.workunit.client.1.smithi142.stdout:9/215: creat db/d10/d27/f40 x:0 0 0 2024-02-19T19:07:30.928 INFO:tasks.workunit.client.1.smithi142.stdout:9/216: write db/d10/f15 [4234446,123107] 0 2024-02-19T19:07:30.929 INFO:tasks.workunit.client.1.smithi142.stdout:1/245: symlink d5/d7/d4a/d53/l54 0 2024-02-19T19:07:30.930 INFO:tasks.workunit.client.1.smithi142.stdout:6/207: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:30.931 INFO:tasks.workunit.client.1.smithi142.stdout:3/235: creat d1d/d1e/f45 x:0 0 0 2024-02-19T19:07:30.931 INFO:tasks.workunit.client.1.smithi142.stdout:3/236: write d1d/d1e/f32 [1108523,91779] 0 2024-02-19T19:07:30.931 INFO:tasks.workunit.client.1.smithi142.stdout:2/220: dread d3/df/f32 [0,4194304] 0 2024-02-19T19:07:30.933 INFO:tasks.workunit.client.1.smithi142.stdout:4/312: getdents d4/d1d/d42 0 2024-02-19T19:07:30.936 INFO:tasks.workunit.client.1.smithi142.stdout:9/217: mkdir db/d10/d22/d24/d41 0 2024-02-19T19:07:30.936 INFO:tasks.workunit.client.1.smithi142.stdout:9/218: getdents db/d10/d22/d24/d41 0 2024-02-19T19:07:30.936 INFO:tasks.workunit.client.1.smithi142.stdout:9/219: creat db/d10/d27/f42 x:0 0 0 2024-02-19T19:07:30.938 INFO:tasks.workunit.client.1.smithi142.stdout:1/246: rename d5/d7/l10 to d5/d7/d23/l55 0 2024-02-19T19:07:30.939 INFO:tasks.workunit.client.1.smithi142.stdout:1/247: read f4 [1961261,123948] 0 2024-02-19T19:07:30.939 INFO:tasks.workunit.client.1.smithi142.stdout:1/248: fsync d5/d1a/f39 0 2024-02-19T19:07:30.939 INFO:tasks.workunit.client.1.smithi142.stdout:1/249: readlink d5/d7/l2f 0 2024-02-19T19:07:30.939 INFO:tasks.workunit.client.1.smithi142.stdout:1/250: write d5/d7/f4f [466908,115835] 0 2024-02-19T19:07:30.939 INFO:tasks.workunit.client.1.smithi142.stdout:4/313: truncate d4/d14/d31/d43/d52/f63 1378909 0 2024-02-19T19:07:30.941 INFO:tasks.workunit.client.1.smithi142.stdout:8/255: dwrite d9/f4e [0,4194304] 0 2024-02-19T19:07:30.943 INFO:tasks.workunit.client.1.smithi142.stdout:1/251: mkdir d5/d7/d23/d56 0 2024-02-19T19:07:30.944 INFO:tasks.workunit.client.1.smithi142.stdout:3/237: write fa [3560158,7469] 0 2024-02-19T19:07:30.945 INFO:tasks.workunit.client.1.smithi142.stdout:4/314: mkdir d4/d1d/d42/d66/dd/d10/d3e/d68 0 2024-02-19T19:07:30.945 INFO:tasks.workunit.client.1.smithi142.stdout:4/315: chown d4/d1d/d42/d66/d2c 88648 1 2024-02-19T19:07:30.946 INFO:tasks.workunit.client.1.smithi142.stdout:2/221: dread d3/d35/f37 [0,4194304] 0 2024-02-19T19:07:30.947 INFO:tasks.workunit.client.1.smithi142.stdout:0/183: dwrite d23/d28/f33 [0,4194304] 0 2024-02-19T19:07:30.948 INFO:tasks.workunit.client.1.smithi142.stdout:8/256: truncate f7 769906 0 2024-02-19T19:07:30.950 INFO:tasks.workunit.client.1.smithi142.stdout:1/252: link d5/d37/l48 d5/d7/d34/l57 0 2024-02-19T19:07:30.952 INFO:tasks.workunit.client.1.smithi142.stdout:3/238: rename f12 to d1d/d1e/d2e/f46 0 2024-02-19T19:07:30.954 INFO:tasks.workunit.client.1.smithi142.stdout:4/316: creat d4/d1d/d42/d66/d12/d2d/f69 x:0 0 0 2024-02-19T19:07:30.960 INFO:tasks.workunit.client.1.smithi142.stdout:0/184: creat d23/d32/d36/f37 x:0 0 0 2024-02-19T19:07:30.960 INFO:tasks.workunit.client.1.smithi142.stdout:0/185: creat d23/d28/f38 x:0 0 0 2024-02-19T19:07:30.960 INFO:tasks.workunit.client.1.smithi142.stdout:0/186: fdatasync f16 0 2024-02-19T19:07:30.960 INFO:tasks.workunit.client.1.smithi142.stdout:1/253: mknod d5/d7/d23/d2c/c58 0 2024-02-19T19:07:30.960 INFO:tasks.workunit.client.1.smithi142.stdout:1/254: fsync d5/f42 0 2024-02-19T19:07:30.963 INFO:tasks.workunit.client.1.smithi142.stdout:2/222: rmdir d3/df 39 2024-02-19T19:07:30.963 INFO:tasks.workunit.client.1.smithi142.stdout:2/223: fdatasync d3/f8 0 2024-02-19T19:07:30.967 INFO:tasks.workunit.client.1.smithi142.stdout:0/187: mknod d23/d28/c39 0 2024-02-19T19:07:30.970 INFO:tasks.workunit.client.1.smithi142.stdout:9/220: write db/f2b [321366,25361] 0 2024-02-19T19:07:30.970 INFO:tasks.workunit.client.1.smithi142.stdout:9/221: chown db/d10/d27/l38 11191 1 2024-02-19T19:07:30.970 INFO:tasks.workunit.client.1.smithi142.stdout:9/222: write db/d10/d22/d24/f3e [308703,45899] 0 2024-02-19T19:07:30.970 INFO:tasks.workunit.client.1.smithi142.stdout:1/255: rename d5/d7/d23/d56 to d5/d1a/d59 0 2024-02-19T19:07:30.970 INFO:tasks.workunit.client.1.smithi142.stdout:1/256: chown d5/d7/d23/d2c/f3c 1285 1 2024-02-19T19:07:30.970 INFO:tasks.workunit.client.1.smithi142.stdout:1/257: write d5/d7/d23/f45 [5006785,120605] 0 2024-02-19T19:07:30.972 INFO:tasks.workunit.client.1.smithi142.stdout:9/223: symlink db/d10/d22/d24/d3d/l43 0 2024-02-19T19:07:30.972 INFO:tasks.workunit.client.1.smithi142.stdout:0/188: dread d23/d32/f30 [0,4194304] 0 2024-02-19T19:07:30.973 INFO:tasks.workunit.client.1.smithi142.stdout:0/189: truncate f17 660699 0 2024-02-19T19:07:30.973 INFO:tasks.workunit.client.1.smithi142.stdout:1/258: mknod d5/d37/c5a 0 2024-02-19T19:07:30.974 INFO:tasks.workunit.client.1.smithi142.stdout:0/190: rmdir d23 39 2024-02-19T19:07:30.975 INFO:tasks.workunit.client.1.smithi142.stdout:0/191: fsync f22 0 2024-02-19T19:07:30.976 INFO:tasks.workunit.client.1.smithi142.stdout:1/259: stat d5/c1b 0 2024-02-19T19:07:30.976 INFO:tasks.workunit.client.1.smithi142.stdout:1/260: rename d5 to d5/d1a/d5b 22 2024-02-19T19:07:30.977 INFO:tasks.workunit.client.1.smithi142.stdout:0/192: unlink l4 0 2024-02-19T19:07:30.978 INFO:tasks.workunit.client.1.smithi142.stdout:0/193: chown c1c 9693167 1 2024-02-19T19:07:30.978 INFO:tasks.workunit.client.1.smithi142.stdout:2/224: dread d3/db/fc [4194304,4194304] 0 2024-02-19T19:07:30.978 INFO:tasks.workunit.client.1.smithi142.stdout:2/225: chown d3/d35/f37 24 1 2024-02-19T19:07:30.979 INFO:tasks.workunit.client.1.smithi142.stdout:3/239: dwrite f15 [4194304,4194304] 0 2024-02-19T19:07:30.979 INFO:tasks.workunit.client.1.smithi142.stdout:0/194: creat d23/f3a x:0 0 0 2024-02-19T19:07:30.980 INFO:tasks.workunit.client.1.smithi142.stdout:2/226: truncate d3/f1f 1837734 0 2024-02-19T19:07:30.980 INFO:tasks.workunit.client.1.smithi142.stdout:2/227: fsync d3/db/f25 0 2024-02-19T19:07:30.982 INFO:tasks.workunit.client.1.smithi142.stdout:0/195: creat d23/d28/d2d/f3b x:0 0 0 2024-02-19T19:07:30.984 INFO:tasks.workunit.client.1.smithi142.stdout:2/228: rename d3/df/f42 to d3/db/f43 0 2024-02-19T19:07:30.985 INFO:tasks.workunit.client.1.smithi142.stdout:8/257: dwrite f2 [0,4194304] 0 2024-02-19T19:07:30.989 INFO:tasks.workunit.client.1.smithi142.stdout:0/196: link ca d23/c3c 0 2024-02-19T19:07:30.990 INFO:tasks.workunit.client.1.smithi142.stdout:0/197: creat d23/f3d x:0 0 0 2024-02-19T19:07:30.990 INFO:tasks.workunit.client.1.smithi142.stdout:0/198: creat d23/d28/f3e x:0 0 0 2024-02-19T19:07:30.990 INFO:tasks.workunit.client.1.smithi142.stdout:0/199: dread - d23/f31 zero size 2024-02-19T19:07:30.991 INFO:tasks.workunit.client.1.smithi142.stdout:4/317: dwrite d4/d14/d31/f61 [0,4194304] 0 2024-02-19T19:07:30.991 INFO:tasks.workunit.client.1.smithi142.stdout:2/229: symlink d3/db/d29/l44 0 2024-02-19T19:07:30.991 INFO:tasks.workunit.client.1.smithi142.stdout:2/230: chown d3/df/c28 84 1 2024-02-19T19:07:30.991 INFO:tasks.workunit.client.1.smithi142.stdout:9/224: dwrite db/d10/f1c [0,4194304] 0 2024-02-19T19:07:30.991 INFO:tasks.workunit.client.1.smithi142.stdout:9/225: readlink db/d29/l31 0 2024-02-19T19:07:30.991 INFO:tasks.workunit.client.1.smithi142.stdout:9/226: write db/d10/d22/d24/f3e [128239,23637] 0 2024-02-19T19:07:30.992 INFO:tasks.workunit.client.1.smithi142.stdout:9/227: write db/d10/d22/d24/f3e [539218,103744] 0 2024-02-19T19:07:30.992 INFO:tasks.workunit.client.1.smithi142.stdout:8/258: dread d9/fc [0,4194304] 0 2024-02-19T19:07:30.992 INFO:tasks.workunit.client.1.smithi142.stdout:8/259: creat d9/dd/de/d14/d21/f53 x:0 0 0 2024-02-19T19:07:30.992 INFO:tasks.workunit.client.1.smithi142.stdout:8/260: readlink d9/dd/d15/d4d/l4f 0 2024-02-19T19:07:30.993 INFO:tasks.workunit.client.1.smithi142.stdout:0/200: mknod d23/d28/d2d/c3f 0 2024-02-19T19:07:30.993 INFO:tasks.workunit.client.1.smithi142.stdout:0/201: write f1a [1272367,20550] 0 2024-02-19T19:07:30.999 INFO:tasks.workunit.client.1.smithi142.stdout:1/261: dwrite d5/d7/f25 [0,4194304] 0 2024-02-19T19:07:30.999 INFO:tasks.workunit.client.1.smithi142.stdout:1/262: fdatasync d5/f4e 0 2024-02-19T19:07:30.999 INFO:tasks.workunit.client.1.smithi142.stdout:3/240: dwrite f15 [0,4194304] 0 2024-02-19T19:07:31.006 INFO:tasks.workunit.client.1.smithi142.stdout:4/318: creat d4/d1d/d42/d66/dd/f6a x:0 0 0 2024-02-19T19:07:31.007 INFO:tasks.workunit.client.1.smithi142.stdout:2/231: rmdir d3/df 39 2024-02-19T19:07:31.009 INFO:tasks.workunit.client.1.smithi142.stdout:9/228: rename l1 to db/d10/d22/d24/d41/l44 0 2024-02-19T19:07:31.011 INFO:tasks.workunit.client.1.smithi142.stdout:8/261: truncate d9/dd/d15/f1f 1592213 0 2024-02-19T19:07:31.011 INFO:tasks.workunit.client.1.smithi142.stdout:8/262: write d9/dd/de/d14/f42 [112851,3446] 0 2024-02-19T19:07:31.012 INFO:tasks.workunit.client.1.smithi142.stdout:8/263: write d9/dd/de/d14/f1a [1848034,109938] 0 2024-02-19T19:07:31.012 INFO:tasks.workunit.client.1.smithi142.stdout:1/263: dwrite d5/d7/f3e [0,4194304] 0 2024-02-19T19:07:31.013 INFO:tasks.workunit.client.1.smithi142.stdout:9/229: fdatasync db/d10/d22/d24/f3e 0 2024-02-19T19:07:31.013 INFO:tasks.workunit.client.1.smithi142.stdout:1/264: write d5/d1a/f47 [808125,98352] 0 2024-02-19T19:07:31.013 INFO:tasks.workunit.client.1.smithi142.stdout:0/202: rmdir d23/d32 39 2024-02-19T19:07:31.013 INFO:tasks.workunit.client.1.smithi142.stdout:0/203: truncate d23/d32/f30 2274250 0 2024-02-19T19:07:31.013 INFO:tasks.workunit.client.1.smithi142.stdout:0/204: creat d23/d28/f40 x:0 0 0 2024-02-19T19:07:31.018 INFO:tasks.workunit.client.1.smithi142.stdout:3/241: symlink d1d/l47 0 2024-02-19T19:07:31.018 INFO:tasks.workunit.client.1.smithi142.stdout:3/242: creat d1d/d1e/d2e/f48 x:0 0 0 2024-02-19T19:07:31.020 INFO:tasks.workunit.client.1.smithi142.stdout:2/232: getdents d3/db/d29 0 2024-02-19T19:07:31.021 INFO:tasks.workunit.client.1.smithi142.stdout:8/264: rmdir d9/dd/de/d2d/d2e/d49 39 2024-02-19T19:07:31.021 INFO:tasks.workunit.client.1.smithi142.stdout:8/265: chown d9/f4e 114927112 1 2024-02-19T19:07:31.024 INFO:tasks.workunit.client.1.smithi142.stdout:1/265: getdents d5/d7/d34 0 2024-02-19T19:07:31.027 INFO:tasks.workunit.client.1.smithi142.stdout:0/205: mkdir d23/d28/d41 0 2024-02-19T19:07:31.029 INFO:tasks.workunit.client.1.smithi142.stdout:9/230: dwrite db/d10/d22/d24/f3c [0,4194304] 0 2024-02-19T19:07:31.029 INFO:tasks.workunit.client.1.smithi142.stdout:4/319: unlink d4/ca 0 2024-02-19T19:07:31.030 INFO:tasks.workunit.client.1.smithi142.stdout:8/266: mknod d9/dd/d44/c54 0 2024-02-19T19:07:31.031 INFO:tasks.workunit.client.1.smithi142.stdout:1/266: creat d5/d37/d49/f5c x:0 0 0 2024-02-19T19:07:31.033 INFO:tasks.workunit.client.1.smithi142.stdout:0/206: mknod d23/d28/d41/c42 0 2024-02-19T19:07:31.033 INFO:tasks.workunit.client.1.smithi142.stdout:0/207: fsync f22 0 2024-02-19T19:07:31.033 INFO:tasks.workunit.client.1.smithi142.stdout:2/233: dread d3/f8 [0,4194304] 0 2024-02-19T19:07:31.033 INFO:tasks.workunit.client.1.smithi142.stdout:2/234: dread - d3/df/f10 zero size 2024-02-19T19:07:31.033 INFO:tasks.workunit.client.1.smithi142.stdout:2/235: readlink d3/l22 0 2024-02-19T19:07:31.034 INFO:tasks.workunit.client.1.smithi142.stdout:3/243: dwrite d1d/d1e/d2e/f43 [0,4194304] 0 2024-02-19T19:07:31.037 INFO:tasks.workunit.client.1.smithi142.stdout:9/231: symlink db/d10/d22/d24/d3d/l45 0 2024-02-19T19:07:31.038 INFO:tasks.workunit.client.1.smithi142.stdout:4/320: unlink d4/d1d/d42/d66/dd/d10/f36 0 2024-02-19T19:07:31.038 INFO:tasks.workunit.client.1.smithi142.stdout:4/321: dread - d4/d1d/d42/d66/dd/f6a zero size 2024-02-19T19:07:31.039 INFO:tasks.workunit.client.1.smithi142.stdout:4/322: chown d4/d34/f51 87632 1 2024-02-19T19:07:31.039 INFO:tasks.workunit.client.1.smithi142.stdout:4/323: fdatasync d4/d1c/f4b 0 2024-02-19T19:07:31.039 INFO:tasks.workunit.client.1.smithi142.stdout:4/324: fdatasync d4/d1d/d42/d66/d12/d2d/f69 0 2024-02-19T19:07:31.039 INFO:tasks.workunit.client.1.smithi142.stdout:5/165: sync 2024-02-19T19:07:31.039 INFO:tasks.workunit.client.1.smithi142.stdout:5/166: readlink d5/dd/d8/d1c/l23 0 2024-02-19T19:07:31.040 INFO:tasks.workunit.client.1.smithi142.stdout:1/267: mkdir d5/d37/d5d 0 2024-02-19T19:07:31.041 INFO:tasks.workunit.client.1.smithi142.stdout:5/167: read d5/dd/df/d15/d1a/f25 [57287,92874] 0 2024-02-19T19:07:31.041 INFO:tasks.workunit.client.1.smithi142.stdout:2/236: truncate d3/df/f21 359041 0 2024-02-19T19:07:31.041 INFO:tasks.workunit.client.1.smithi142.stdout:2/237: stat d3/df/l19 0 2024-02-19T19:07:31.044 INFO:tasks.workunit.client.1.smithi142.stdout:0/208: dwrite f22 [4194304,4194304] 0 2024-02-19T19:07:31.050 INFO:tasks.workunit.client.1.smithi142.stdout:8/267: dwrite d9/dd/de/d14/f1a [4194304,4194304] 0 2024-02-19T19:07:31.051 INFO:tasks.workunit.client.1.smithi142.stdout:4/325: mknod d4/d1d/d42/d66/d12/d2d/d2a/c6b 0 2024-02-19T19:07:31.051 INFO:tasks.workunit.client.1.smithi142.stdout:4/326: dread - d4/d1d/d42/d66/d2c/f67 zero size 2024-02-19T19:07:31.052 INFO:tasks.workunit.client.1.smithi142.stdout:1/268: symlink d5/l5e 0 2024-02-19T19:07:31.053 INFO:tasks.workunit.client.1.smithi142.stdout:5/168: mknod d5/dd/c3b 0 2024-02-19T19:07:31.053 INFO:tasks.workunit.client.1.smithi142.stdout:5/169: read d5/dd/f1d [3660074,59834] 0 2024-02-19T19:07:31.053 INFO:tasks.workunit.client.1.smithi142.stdout:9/232: getdents db/d10/d22/d24/d3d 0 2024-02-19T19:07:31.053 INFO:tasks.workunit.client.1.smithi142.stdout:9/233: write db/f2b [37960,96974] 0 2024-02-19T19:07:31.055 INFO:tasks.workunit.client.1.smithi142.stdout:0/209: symlink d23/d28/d41/l43 0 2024-02-19T19:07:31.055 INFO:tasks.workunit.client.1.smithi142.stdout:3/244: dwrite f15 [0,4194304] 0 2024-02-19T19:07:31.056 INFO:tasks.workunit.client.1.smithi142.stdout:4/327: link d4/d1d/d42/d66/d12/l3a d4/d34/d44/l6c 0 2024-02-19T19:07:31.057 INFO:tasks.workunit.client.1.smithi142.stdout:5/170: mknod d5/dd/d8/d31/c3c 0 2024-02-19T19:07:31.057 INFO:tasks.workunit.client.1.smithi142.stdout:2/238: write d3/df/f21 [1178234,48999] 0 2024-02-19T19:07:31.058 INFO:tasks.workunit.client.1.smithi142.stdout:9/234: truncate db/d10/d22/d24/f25 1234215 0 2024-02-19T19:07:31.059 INFO:tasks.workunit.client.1.smithi142.stdout:0/210: stat le 0 2024-02-19T19:07:31.060 INFO:tasks.workunit.client.1.smithi142.stdout:1/269: dread f4 [0,4194304] 0 2024-02-19T19:07:31.060 INFO:tasks.workunit.client.1.smithi142.stdout:1/270: creat d5/d37/f5f x:0 0 0 2024-02-19T19:07:31.060 INFO:tasks.workunit.client.1.smithi142.stdout:1/271: readlink d5/d7/d34/l57 0 2024-02-19T19:07:31.060 INFO:tasks.workunit.client.1.smithi142.stdout:1/272: creat d5/d1a/d33/f60 x:0 0 0 2024-02-19T19:07:31.062 INFO:tasks.workunit.client.1.smithi142.stdout:4/328: write d4/f5 [2004274,100832] 0 2024-02-19T19:07:31.062 INFO:tasks.workunit.client.1.smithi142.stdout:3/245: link f10 d1d/d1e/f49 0 2024-02-19T19:07:31.063 INFO:tasks.workunit.client.1.smithi142.stdout:5/171: creat d5/dd/d8/f3d x:0 0 0 2024-02-19T19:07:31.064 INFO:tasks.workunit.client.1.smithi142.stdout:2/239: mkdir d3/db/d29/d45 0 2024-02-19T19:07:31.064 INFO:tasks.workunit.client.1.smithi142.stdout:2/240: write d3/db/f15 [3326829,93490] 0 2024-02-19T19:07:31.065 INFO:tasks.workunit.client.1.smithi142.stdout:9/235: creat db/d10/d22/f46 x:0 0 0 2024-02-19T19:07:31.067 INFO:tasks.workunit.client.1.smithi142.stdout:7/187: sync 2024-02-19T19:07:31.067 INFO:tasks.workunit.client.1.smithi142.stdout:0/211: mkdir d23/d32/d36/d44 0 2024-02-19T19:07:31.068 INFO:tasks.workunit.client.1.smithi142.stdout:8/268: dwrite d9/dd/d15/d30/f33 [0,4194304] 0 2024-02-19T19:07:31.068 INFO:tasks.workunit.client.1.smithi142.stdout:8/269: write d9/dd/de/d14/f51 [978655,80010] 0 2024-02-19T19:07:31.068 INFO:tasks.workunit.client.1.smithi142.stdout:8/270: chown d9/dd/d15/d30/c43 17918 1 2024-02-19T19:07:31.071 INFO:tasks.workunit.client.1.smithi142.stdout:1/273: mknod d5/d1a/d59/c61 0 2024-02-19T19:07:31.071 INFO:tasks.workunit.client.1.smithi142.stdout:1/274: write f4 [3051,34930] 0 2024-02-19T19:07:31.073 INFO:tasks.workunit.client.1.smithi142.stdout:4/329: creat d4/d1d/d42/d66/dd/d10/d26/f6d x:0 0 0 2024-02-19T19:07:31.073 INFO:tasks.workunit.client.1.smithi142.stdout:5/172: write d5/dd/f1e [1388337,11181] 0 2024-02-19T19:07:31.076 INFO:tasks.workunit.client.1.smithi142.stdout:3/246: truncate f1c 801967 0 2024-02-19T19:07:31.077 INFO:tasks.workunit.client.1.smithi142.stdout:9/236: mknod db/d10/d22/c47 0 2024-02-19T19:07:31.077 INFO:tasks.workunit.client.1.smithi142.stdout:9/237: write db/f18 [2592922,109579] 0 2024-02-19T19:07:31.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:30 smithi046 ceph-mon[88928]: pgmap v73: 65 pgs: 6 unknown, 3 peering, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 387 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 103 MiB/s rd, 122 MiB/s wr, 494 op/s; 5474/32340 objects degraded (16.926%) 2024-02-19T19:07:31.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:30 smithi046 ceph-mon[88928]: Health check failed: Degraded data redundancy: 5474/32340 objects degraded (16.926%), 29 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:31.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:30 smithi046 ceph-mon[88928]: osdmap e59: 6 total, 5 up, 6 in 2024-02-19T19:07:31.081 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:30 smithi046 podman[106345]: 2024-02-19 19:07:30.781352398 +0000 UTC m=+0.438763698 container init a259c02271024bd9e28537b744f5a9f99a50e58c34f5bb78480e6ae1444ae017 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214) 2024-02-19T19:07:31.082 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:30 smithi046 podman[106345]: 2024-02-19 19:07:30.78676243 +0000 UTC m=+0.444173734 container start a259c02271024bd9e28537b744f5a9f99a50e58c34f5bb78480e6ae1444ae017 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-19T19:07:31.082 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:30 smithi046 podman[106345]: 2024-02-19 19:07:30.889877615 +0000 UTC m=+0.547288939 container attach a259c02271024bd9e28537b744f5a9f99a50e58c34f5bb78480e6ae1444ae017 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-19T19:07:31.085 INFO:tasks.workunit.client.1.smithi142.stdout:8/271: creat d9/dd/d15/d31/f55 x:0 0 0 2024-02-19T19:07:31.086 INFO:tasks.workunit.client.1.smithi142.stdout:1/275: creat d5/d7/d34/f62 x:0 0 0 2024-02-19T19:07:31.087 INFO:tasks.workunit.client.1.smithi142.stdout:4/330: rmdir d4/d1d/d42/d66/d2c 39 2024-02-19T19:07:31.089 INFO:tasks.workunit.client.1.smithi142.stdout:0/212: dwrite d23/d28/f38 [0,4194304] 0 2024-02-19T19:07:31.091 INFO:tasks.workunit.client.1.smithi142.stdout:9/238: rename db/d10/d22/d24/d3d/l45 to db/d29/l48 0 2024-02-19T19:07:31.096 INFO:tasks.workunit.client.1.smithi142.stdout:8/272: dread d9/dd/de/d14/f1a [0,4194304] 0 2024-02-19T19:07:31.096 INFO:tasks.workunit.client.1.smithi142.stdout:8/273: write f1 [4342877,55455] 0 2024-02-19T19:07:31.097 INFO:tasks.workunit.client.1.smithi142.stdout:4/331: mkdir d4/d14/d31/d43/d52/d6e 0 2024-02-19T19:07:31.098 INFO:tasks.workunit.client.1.smithi142.stdout:4/332: chown d4/d1d/d42/d66/d2c/c37 2663 1 2024-02-19T19:07:31.098 INFO:tasks.workunit.client.1.smithi142.stdout:7/188: getdents d0/d1b/d21 0 2024-02-19T19:07:31.098 INFO:tasks.workunit.client.1.smithi142.stdout:7/189: chown d0/d1b/d21/d24/d29/d2d/f3d 4913 1 2024-02-19T19:07:31.098 INFO:tasks.workunit.client.1.smithi142.stdout:7/190: chown d0/f2a 17 1 2024-02-19T19:07:31.100 INFO:tasks.workunit.client.1.smithi142.stdout:9/239: rename db/d10/f28 to db/d10/d27/f49 0 2024-02-19T19:07:31.104 INFO:tasks.workunit.client.1.smithi142.stdout:8/274: creat d9/dd/d15/f56 x:0 0 0 2024-02-19T19:07:31.104 INFO:tasks.workunit.client.1.smithi142.stdout:8/275: chown d9/dd/de/f45 12629241 1 2024-02-19T19:07:31.104 INFO:tasks.workunit.client.1.smithi142.stdout:8/276: creat d9/dd/f57 x:0 0 0 2024-02-19T19:07:31.104 INFO:tasks.workunit.client.1.smithi142.stdout:8/277: chown d9/dd/d15/d30/c43 1113 1 2024-02-19T19:07:31.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/333: creat d4/d1d/d42/d66/d12/d2d/d2a/f6f x:0 0 0 2024-02-19T19:07:31.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/334: dread - d4/d1d/f5b zero size 2024-02-19T19:07:31.105 INFO:tasks.workunit.client.1.smithi142.stdout:8/278: mkdir d9/dd/de/d2d/d2e/d49/d58 0 2024-02-19T19:07:31.106 INFO:tasks.workunit.client.1.smithi142.stdout:8/279: mkdir d9/dd/de/d2d/d2e/d49/d50/d59 0 2024-02-19T19:07:31.107 INFO:tasks.workunit.client.1.smithi142.stdout:4/335: symlink d4/l70 0 2024-02-19T19:07:31.108 INFO:tasks.workunit.client.1.smithi142.stdout:8/280: unlink d9/dd/d15/d4d/l4f 0 2024-02-19T19:07:31.108 INFO:tasks.workunit.client.1.smithi142.stdout:8/281: write d9/dd/de/d14/d21/f25 [236248,44376] 0 2024-02-19T19:07:31.110 INFO:tasks.workunit.client.1.smithi142.stdout:4/336: unlink d4/d1d/d42/d66/d12/d2d/c21 0 2024-02-19T19:07:31.110 INFO:tasks.workunit.client.1.smithi142.stdout:7/191: dread d0/fd [0,4194304] 0 2024-02-19T19:07:31.110 INFO:tasks.workunit.client.1.smithi142.stdout:7/192: write d0/d13/f1f [1927760,107237] 0 2024-02-19T19:07:31.110 INFO:tasks.workunit.client.1.smithi142.stdout:7/193: read - d0/d1b/d21/f3f zero size 2024-02-19T19:07:31.110 INFO:tasks.workunit.client.1.smithi142.stdout:7/194: dread - d0/d1b/d21/f3f zero size 2024-02-19T19:07:31.110 INFO:tasks.workunit.client.1.smithi142.stdout:8/282: symlink d9/l5a 0 2024-02-19T19:07:31.110 INFO:tasks.workunit.client.1.smithi142.stdout:8/283: fsync f2 0 2024-02-19T19:07:31.110 INFO:tasks.workunit.client.1.smithi142.stdout:4/337: mknod d4/d1d/d42/d66/dd/d10/d26/d50/d54/c71 0 2024-02-19T19:07:31.111 INFO:tasks.workunit.client.1.smithi142.stdout:7/195: creat d0/d13/d1e/f42 x:0 0 0 2024-02-19T19:07:31.112 INFO:tasks.workunit.client.1.smithi142.stdout:2/241: dwrite d3/df/f2b [0,4194304] 0 2024-02-19T19:07:31.112 INFO:tasks.workunit.client.1.smithi142.stdout:4/338: mknod d4/d34/d44/c72 0 2024-02-19T19:07:31.113 INFO:tasks.workunit.client.1.smithi142.stdout:7/196: chown d0/d13/c18 0 1 2024-02-19T19:07:31.114 INFO:tasks.workunit.client.1.smithi142.stdout:9/240: read db/d10/f15 [2705138,84169] 0 2024-02-19T19:07:31.114 INFO:tasks.workunit.client.1.smithi142.stdout:9/241: truncate db/d10/d27/f42 813294 0 2024-02-19T19:07:31.114 INFO:tasks.workunit.client.1.smithi142.stdout:9/242: write db/d10/d27/f49 [2932543,58495] 0 2024-02-19T19:07:31.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/242: mkdir d3/db/d29/d45/d46 0 2024-02-19T19:07:31.115 INFO:tasks.workunit.client.1.smithi142.stdout:2/243: fsync d3/df/f2b 0 2024-02-19T19:07:31.116 INFO:tasks.workunit.client.1.smithi142.stdout:2/244: chown d3/f1f 201 1 2024-02-19T19:07:31.116 INFO:tasks.workunit.client.1.smithi142.stdout:4/339: symlink d4/d14/d31/d43/d52/l73 0 2024-02-19T19:07:31.117 INFO:tasks.workunit.client.1.smithi142.stdout:7/197: mknod d0/d1b/d21/d24/d31/c43 0 2024-02-19T19:07:31.117 INFO:tasks.workunit.client.1.smithi142.stdout:7/198: stat d0 0 2024-02-19T19:07:31.118 INFO:tasks.workunit.client.1.smithi142.stdout:9/243: symlink db/d10/d32/d3f/l4a 0 2024-02-19T19:07:31.118 INFO:tasks.workunit.client.1.smithi142.stdout:8/284: write d9/dd/d15/f28 [2109661,54913] 0 2024-02-19T19:07:31.119 INFO:tasks.workunit.client.1.smithi142.stdout:1/276: dwrite d5/d7/f3e [0,4194304] 0 2024-02-19T19:07:31.119 INFO:tasks.workunit.client.1.smithi142.stdout:1/277: read d5/d7/fe [314003,5741] 0 2024-02-19T19:07:31.119 INFO:tasks.workunit.client.1.smithi142.stdout:5/173: dwrite d5/dd/df/d15/d1a/d32/f39 [0,4194304] 0 2024-02-19T19:07:31.119 INFO:tasks.workunit.client.1.smithi142.stdout:2/245: rename f0 to d3/db/f47 0 2024-02-19T19:07:31.121 INFO:tasks.workunit.client.1.smithi142.stdout:4/340: link d4/d14/d31/f38 d4/d1d/f74 0 2024-02-19T19:07:31.123 INFO:tasks.workunit.client.1.smithi142.stdout:8/285: creat d9/dd/de/d2d/d2e/d49/d58/f5b x:0 0 0 2024-02-19T19:07:31.126 INFO:tasks.workunit.client.1.smithi142.stdout:7/199: dread d0/d13/f27 [0,4194304] 0 2024-02-19T19:07:31.127 INFO:tasks.workunit.client.1.smithi142.stdout:4/341: dread d4/d14/f2f [0,4194304] 0 2024-02-19T19:07:31.127 INFO:tasks.workunit.client.1.smithi142.stdout:0/213: dwrite f17 [0,4194304] 0 2024-02-19T19:07:31.127 INFO:tasks.workunit.client.1.smithi142.stdout:4/342: chown d4/d34/d44 1591 1 2024-02-19T19:07:31.128 INFO:tasks.workunit.client.1.smithi142.stdout:8/286: dread d9/fc [0,4194304] 0 2024-02-19T19:07:31.128 INFO:tasks.workunit.client.1.smithi142.stdout:8/287: fsync d9/dd/de/d2d/d2e/f52 0 2024-02-19T19:07:31.128 INFO:tasks.workunit.client.1.smithi142.stdout:8/288: truncate d9/dd/de/d14/d21/f39 127751 0 2024-02-19T19:07:31.128 INFO:tasks.workunit.client.1.smithi142.stdout:8/289: creat d9/dd/f5c x:0 0 0 2024-02-19T19:07:31.130 INFO:tasks.workunit.client.1.smithi142.stdout:9/244: write db/d10/f1c [2793163,74007] 0 2024-02-19T19:07:31.132 INFO:tasks.workunit.client.1.smithi142.stdout:1/278: write d5/d7/f11 [2590178,88636] 0 2024-02-19T19:07:31.136 INFO:tasks.workunit.client.1.smithi142.stdout:5/174: truncate d5/dd/d8/d31/f34 667221 0 2024-02-19T19:07:31.136 INFO:tasks.workunit.client.1.smithi142.stdout:5/175: write d5/dd/df/d15/d1a/f25 [1640404,22354] 0 2024-02-19T19:07:31.136 INFO:tasks.workunit.client.1.smithi142.stdout:5/176: readlink d5/dd/df/d15/d1a/l1b 0 2024-02-19T19:07:31.137 INFO:tasks.workunit.client.1.smithi142.stdout:2/246: creat d3/d35/f48 x:0 0 0 2024-02-19T19:07:31.137 INFO:tasks.workunit.client.1.smithi142.stdout:2/247: write d3/db/f20 [4776772,76530] 0 2024-02-19T19:07:31.138 INFO:tasks.workunit.client.1.smithi142.stdout:0/214: write f22 [29979,126534] 0 2024-02-19T19:07:31.138 INFO:tasks.workunit.client.1.smithi142.stdout:0/215: read d23/d32/f30 [1859420,86334] 0 2024-02-19T19:07:31.139 INFO:tasks.workunit.client.1.smithi142.stdout:7/200: unlink d0/le 0 2024-02-19T19:07:31.144 INFO:tasks.workunit.client.1.smithi142.stdout:8/290: mknod d9/dd/de/d2d/d2e/d49/c5d 0 2024-02-19T19:07:31.146 INFO:tasks.workunit.client.1.smithi142.stdout:9/245: creat db/d10/f4b x:0 0 0 2024-02-19T19:07:31.148 INFO:tasks.workunit.client.1.smithi142.stdout:4/343: dwrite d4/d1d/d42/d66/d12/f5c [0,4194304] 0 2024-02-19T19:07:31.150 INFO:tasks.workunit.client.1.smithi142.stdout:7/201: mkdir d0/d1b/d21/d24/d29/d44 0 2024-02-19T19:07:31.150 INFO:tasks.workunit.client.1.smithi142.stdout:7/202: creat d0/d1b/d21/d24/d31/f45 x:0 0 0 2024-02-19T19:07:31.150 INFO:tasks.workunit.client.1.smithi142.stdout:7/203: write d0/fc [2812816,41590] 0 2024-02-19T19:07:31.154 INFO:tasks.workunit.client.1.smithi142.stdout:9/246: rename db/d29 to db/d10/d27/d2f/d4c 0 2024-02-19T19:07:31.158 INFO:tasks.workunit.client.1.smithi142.stdout:4/344: stat d4/d1d/d42/d66/dd/d10/d26/d50/d54/l58 0 2024-02-19T19:07:31.158 INFO:tasks.workunit.client.1.smithi142.stdout:4/345: dread - d4/d1d/f74 zero size 2024-02-19T19:07:31.158 INFO:tasks.workunit.client.1.smithi142.stdout:4/346: dread - d4/d1d/d42/d66/dd/d10/d26/f6d zero size 2024-02-19T19:07:31.158 INFO:tasks.workunit.client.1.smithi142.stdout:4/347: fdatasync d4/d1d/d42/d66/d12/f5c 0 2024-02-19T19:07:31.159 INFO:tasks.workunit.client.1.smithi142.stdout:8/291: rmdir d9/dd/de/d14/d21 39 2024-02-19T19:07:31.159 INFO:tasks.workunit.client.1.smithi142.stdout:8/292: fdatasync d9/dd/de/d2d/d2e/f52 0 2024-02-19T19:07:31.162 INFO:tasks.workunit.client.1.smithi142.stdout:8/293: truncate d9/dd/de/d2d/d2e/f52 1216251 0 2024-02-19T19:07:31.164 INFO:tasks.workunit.client.1.smithi142.stdout:9/247: creat db/d10/d32/d33/f4d x:0 0 0 2024-02-19T19:07:31.165 INFO:tasks.workunit.client.1.smithi142.stdout:9/248: mkdir db/d10/d32/d3f/d4e 0 2024-02-19T19:07:31.165 INFO:tasks.workunit.client.1.smithi142.stdout:9/249: stat f5 0 2024-02-19T19:07:31.167 INFO:tasks.workunit.client.1.smithi142.stdout:9/250: rmdir db/d10/d22/d24 39 2024-02-19T19:07:31.192 INFO:tasks.workunit.client.1.smithi142.stdout:9/251: dwrite db/d10/d32/d33/f4d [0,4194304] 0 2024-02-19T19:07:31.192 INFO:tasks.workunit.client.1.smithi142.stdout:0/216: dwrite f13 [0,4194304] 0 2024-02-19T19:07:31.192 INFO:tasks.workunit.client.1.smithi142.stdout:1/279: dwrite d5/d7/f11 [0,4194304] 0 2024-02-19T19:07:31.192 INFO:tasks.workunit.client.1.smithi142.stdout:8/294: dwrite d9/dd/de/d14/d21/f25 [0,4194304] 0 2024-02-19T19:07:31.192 INFO:tasks.workunit.client.1.smithi142.stdout:5/177: dwrite d5/dd/df/d15/d1a/f26 [0,4194304] 0 2024-02-19T19:07:31.192 INFO:tasks.workunit.client.1.smithi142.stdout:8/295: readlink d9/dd/d15/l19 0 2024-02-19T19:07:31.192 INFO:tasks.workunit.client.1.smithi142.stdout:8/296: fsync d9/dd/f57 0 2024-02-19T19:07:31.192 INFO:tasks.workunit.client.1.smithi142.stdout:7/204: dwrite d0/d1b/d21/d24/f34 [0,4194304] 0 2024-02-19T19:07:31.196 INFO:tasks.workunit.client.1.smithi142.stdout:1/280: rmdir d5 39 2024-02-19T19:07:31.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:30 smithi142 ceph-mon[69118]: pgmap v73: 65 pgs: 6 unknown, 3 peering, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 387 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 103 MiB/s rd, 122 MiB/s wr, 494 op/s; 5474/32340 objects degraded (16.926%) 2024-02-19T19:07:31.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:30 smithi142 ceph-mon[69118]: Health check failed: Degraded data redundancy: 5474/32340 objects degraded (16.926%), 29 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:31.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:30 smithi142 ceph-mon[69118]: osdmap e59: 6 total, 5 up, 6 in 2024-02-19T19:07:31.202 INFO:tasks.workunit.client.1.smithi142.stdout:5/178: creat d5/dd/d8/d1c/f3e x:0 0 0 2024-02-19T19:07:31.202 INFO:tasks.workunit.client.1.smithi142.stdout:0/217: dread f11 [0,4194304] 0 2024-02-19T19:07:31.202 INFO:tasks.workunit.client.1.smithi142.stdout:8/297: mkdir d9/dd/d15/d31/d5e 0 2024-02-19T19:07:31.205 INFO:tasks.workunit.client.1.smithi142.stdout:9/252: link db/l12 db/d10/d32/d3f/d4e/l4f 0 2024-02-19T19:07:31.209 INFO:tasks.workunit.client.1.smithi142.stdout:5/179: symlink d5/dd/d8/l3f 0 2024-02-19T19:07:31.209 INFO:tasks.workunit.client.1.smithi142.stdout:5/180: stat d5/dd/df/d15/d1a/f26 0 2024-02-19T19:07:31.210 INFO:tasks.workunit.client.1.smithi142.stdout:9/253: write db/f18 [1799932,70287] 0 2024-02-19T19:07:31.211 INFO:tasks.workunit.client.1.smithi142.stdout:9/254: chown l4 245 1 2024-02-19T19:07:31.211 INFO:tasks.workunit.client.1.smithi142.stdout:8/298: rmdir d9/dd/de/d14/d21 39 2024-02-19T19:07:31.213 INFO:tasks.workunit.client.1.smithi142.stdout:7/205: rename d0/c5 to d0/d1b/d21/c46 0 2024-02-19T19:07:31.213 INFO:tasks.workunit.client.1.smithi142.stdout:7/206: truncate d0/d1b/d21/d24/d29/f2c 1025577 0 2024-02-19T19:07:31.213 INFO:tasks.workunit.client.1.smithi142.stdout:7/207: dread - d0/d1b/d21/d24/d29/d2d/f40 zero size 2024-02-19T19:07:31.214 INFO:tasks.workunit.client.1.smithi142.stdout:7/208: stat d0/d1b/d21 0 2024-02-19T19:07:31.214 INFO:tasks.workunit.client.1.smithi142.stdout:7/209: fsync d0/d1b/d21/d24/d29/d2d/f40 0 2024-02-19T19:07:31.214 INFO:tasks.workunit.client.1.smithi142.stdout:7/210: chown d0/d1b 59912 1 2024-02-19T19:07:31.214 INFO:tasks.workunit.client.1.smithi142.stdout:7/211: dread - d0/d1b/d21/d24/d31/f45 zero size 2024-02-19T19:07:31.214 INFO:tasks.workunit.client.1.smithi142.stdout:1/281: rmdir d5/d1a/d33 39 2024-02-19T19:07:31.217 INFO:tasks.workunit.client.1.smithi142.stdout:8/299: link d9/dd/de/l29 d9/dd/de/d14/d21/l5f 0 2024-02-19T19:07:31.217 INFO:tasks.workunit.client.1.smithi142.stdout:8/300: fdatasync f0 0 2024-02-19T19:07:31.217 INFO:tasks.workunit.client.1.smithi142.stdout:8/301: creat d9/dd/de/d14/f60 x:0 0 0 2024-02-19T19:07:31.218 INFO:tasks.workunit.client.1.smithi142.stdout:1/282: rename d5/d37/f5f to d5/d37/d5d/f63 0 2024-02-19T19:07:31.220 INFO:tasks.workunit.client.1.smithi142.stdout:1/283: dread d5/d1a/f3a [0,4194304] 0 2024-02-19T19:07:31.221 INFO:tasks.workunit.client.1.smithi142.stdout:1/284: mknod d5/d7/d4a/c64 0 2024-02-19T19:07:31.222 INFO:tasks.workunit.client.1.smithi142.stdout:1/285: write d5/d7/f4f [713836,62409] 0 2024-02-19T19:07:31.232 INFO:tasks.workunit.client.1.smithi142.stdout:8/302: read d9/dd/d15/d30/f3a [96184,52112] 0 2024-02-19T19:07:31.232 INFO:tasks.workunit.client.1.smithi142.stdout:8/303: dread - d9/dd/de/d14/d21/f53 zero size 2024-02-19T19:07:31.232 INFO:tasks.workunit.client.1.smithi142.stdout:8/304: readlink d9/dd/de/d2d/d2e/d49/l4a 0 2024-02-19T19:07:31.232 INFO:tasks.workunit.client.1.smithi142.stdout:8/305: stat d9/dd/d15/d31/f55 0 2024-02-19T19:07:31.234 INFO:tasks.workunit.client.1.smithi142.stdout:8/306: dread d9/fc [0,4194304] 0 2024-02-19T19:07:31.235 INFO:tasks.workunit.client.1.smithi142.stdout:8/307: mknod d9/dd/de/d2d/d2e/d49/c61 0 2024-02-19T19:07:31.235 INFO:tasks.workunit.client.1.smithi142.stdout:8/308: fsync d9/fc 0 2024-02-19T19:07:31.235 INFO:tasks.workunit.client.1.smithi142.stdout:8/309: creat d9/dd/d15/d31/d5e/f62 x:0 0 0 2024-02-19T19:07:31.236 INFO:tasks.workunit.client.1.smithi142.stdout:8/310: mkdir d9/dd/de/d14/d21/d63 0 2024-02-19T19:07:31.236 INFO:tasks.workunit.client.1.smithi142.stdout:8/311: dread - d9/dd/f5c zero size 2024-02-19T19:07:31.238 INFO:tasks.workunit.client.1.smithi142.stdout:8/312: rename d9/fc to d9/dd/de/d2d/d2e/d49/d50/f64 0 2024-02-19T19:07:31.238 INFO:tasks.workunit.client.1.smithi142.stdout:8/313: mkdir d9/dd/de/d14/d65 0 2024-02-19T19:07:31.239 INFO:tasks.workunit.client.1.smithi142.stdout:1/286: write d5/d7/f11 [239534,92083] 0 2024-02-19T19:07:31.239 INFO:tasks.workunit.client.1.smithi142.stdout:1/287: fdatasync d5/d7/d34/f26 0 2024-02-19T19:07:31.239 INFO:tasks.workunit.client.1.smithi142.stdout:1/288: dread - d5/f4e zero size 2024-02-19T19:07:31.239 INFO:tasks.workunit.client.1.smithi142.stdout:8/314: creat d9/dd/de/d2d/d2e/d49/d50/d59/f66 x:0 0 0 2024-02-19T19:07:31.241 INFO:tasks.workunit.client.1.smithi142.stdout:8/315: creat d9/dd/d15/d4d/f67 x:0 0 0 2024-02-19T19:07:31.241 INFO:tasks.workunit.client.1.smithi142.stdout:8/316: fsync f0 0 2024-02-19T19:07:31.241 INFO:tasks.workunit.client.1.smithi142.stdout:8/317: write d9/dd/de/d14/d21/f53 [206471,29027] 0 2024-02-19T19:07:31.241 INFO:tasks.workunit.client.1.smithi142.stdout:8/318: creat d9/dd/f68 x:0 0 0 2024-02-19T19:07:31.241 INFO:tasks.workunit.client.1.smithi142.stdout:8/319: write d9/dd/d15/f56 [771052,111315] 0 2024-02-19T19:07:31.241 INFO:tasks.workunit.client.1.smithi142.stdout:8/320: chown d9/dd/de/d14/f1a 13929 1 2024-02-19T19:07:31.242 INFO:tasks.workunit.client.1.smithi142.stdout:0/218: dwrite d23/d28/f33 [0,4194304] 0 2024-02-19T19:07:31.242 INFO:tasks.workunit.client.1.smithi142.stdout:5/181: dwrite d5/dd/f1d [0,4194304] 0 2024-02-19T19:07:31.242 INFO:tasks.workunit.client.1.smithi142.stdout:5/182: truncate d5/dd/d8/d31/f33 152444 0 2024-02-19T19:07:31.243 INFO:tasks.workunit.client.1.smithi142.stdout:8/321: truncate d9/dd/de/d14/d21/f25 1489477 0 2024-02-19T19:07:31.244 INFO:tasks.workunit.client.1.smithi142.stdout:0/219: symlink d23/d32/d36/d44/l45 0 2024-02-19T19:07:31.244 INFO:tasks.workunit.client.1.smithi142.stdout:0/220: dread - d23/d28/d2d/f3b zero size 2024-02-19T19:07:31.244 INFO:tasks.workunit.client.1.smithi142.stdout:0/221: creat d23/f46 x:0 0 0 2024-02-19T19:07:31.245 INFO:tasks.workunit.client.1.smithi142.stdout:0/222: write d23/d28/d2d/f3b [1046511,124444] 0 2024-02-19T19:07:31.245 INFO:tasks.workunit.client.1.smithi142.stdout:9/255: dwrite db/d10/d27/f49 [0,4194304] 0 2024-02-19T19:07:31.245 INFO:tasks.workunit.client.1.smithi142.stdout:9/256: write db/f2b [504266,14207] 0 2024-02-19T19:07:31.246 INFO:tasks.workunit.client.1.smithi142.stdout:8/322: creat d9/dd/de/d14/d21/f69 x:0 0 0 2024-02-19T19:07:31.247 INFO:tasks.workunit.client.1.smithi142.stdout:0/223: getdents d23/d32 0 2024-02-19T19:07:31.249 INFO:tasks.workunit.client.1.smithi142.stdout:8/323: write f7 [584798,29412] 0 2024-02-19T19:07:31.249 INFO:tasks.workunit.client.1.smithi142.stdout:8/324: write d9/dd/de/d14/f20 [1233309,648] 0 2024-02-19T19:07:31.249 INFO:tasks.workunit.client.1.smithi142.stdout:8/325: truncate d9/dd/de/d14/f60 992857 0 2024-02-19T19:07:31.251 INFO:tasks.workunit.client.1.smithi142.stdout:0/224: symlink d23/d32/d36/l47 0 2024-02-19T19:07:31.255 INFO:tasks.workunit.client.1.smithi142.stdout:8/326: rmdir d9/dd/de/d14/d21/d63 0 2024-02-19T19:07:31.255 INFO:tasks.workunit.client.1.smithi142.stdout:8/327: write d9/dd/d15/d31/f55 [137349,10004] 0 2024-02-19T19:07:31.260 INFO:tasks.workunit.client.1.smithi142.stdout:8/328: getdents d9/dd/de/d14 0 2024-02-19T19:07:31.263 INFO:tasks.workunit.client.1.smithi142.stdout:0/225: dread f11 [4194304,4194304] 0 2024-02-19T19:07:31.264 INFO:tasks.workunit.client.1.smithi142.stdout:1/289: dwrite d5/f38 [0,4194304] 0 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/290: creat d5/d37/d5d/f65 x:0 0 0 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/291: dread - d5/d1a/d33/f4d zero size 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/292: stat d5/fd 0 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/293: dread - d5/d37/d5d/f65 zero size 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/294: write d5/d1a/f47 [1454444,107909] 0 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/295: truncate d5/d7/d23/d2c/f3b 1145570 0 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/296: dread - d5/d37/f52 zero size 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/297: fdatasync d5/d37/f52 0 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/298: creat d5/d7/d34/f66 x:0 0 0 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/299: dread - d5/f4e zero size 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/300: truncate d5/d1a/d33/f36 5209912 0 2024-02-19T19:07:31.267 INFO:tasks.workunit.client.1.smithi142.stdout:1/301: write d5/d37/d5d/f65 [342794,73909] 0 2024-02-19T19:07:31.271 INFO:tasks.workunit.client.1.smithi142.stdout:0/226: dread d23/d28/f33 [0,4194304] 0 2024-02-19T19:07:31.273 INFO:tasks.workunit.client.1.smithi142.stdout:9/257: dwrite db/d10/d32/d33/f4d [0,4194304] 0 2024-02-19T19:07:31.274 INFO:tasks.workunit.client.1.smithi142.stdout:8/329: dread f0 [0,4194304] 0 2024-02-19T19:07:31.274 INFO:tasks.workunit.client.1.smithi142.stdout:9/258: dread db/d10/d27/f42 [0,4194304] 0 2024-02-19T19:07:31.274 INFO:tasks.workunit.client.1.smithi142.stdout:9/259: creat db/d10/d22/f50 x:0 0 0 2024-02-19T19:07:31.274 INFO:tasks.workunit.client.1.smithi142.stdout:9/260: stat db/d10/d22/d24/d41 0 2024-02-19T19:07:31.275 INFO:tasks.workunit.client.1.smithi142.stdout:5/183: dwrite d5/dd/df/d15/d1a/f26 [4194304,4194304] 0 2024-02-19T19:07:31.276 INFO:tasks.workunit.client.1.smithi142.stdout:5/184: stat d5/dd/df/d15/d1a/f25 0 2024-02-19T19:07:31.276 INFO:tasks.workunit.client.1.smithi142.stdout:5/185: fdatasync d5/dd/d8/fb 0 2024-02-19T19:07:31.276 INFO:tasks.workunit.client.1.smithi142.stdout:8/330: link d9/dd/de/d2d/d2e/d49/d58/f5b d9/dd/de/d2d/d2e/d49/d50/d59/f6a 0 2024-02-19T19:07:31.278 INFO:tasks.workunit.client.1.smithi142.stdout:9/261: symlink db/d10/d27/d2f/l51 0 2024-02-19T19:07:31.280 INFO:tasks.workunit.client.1.smithi142.stdout:0/227: dread d23/f25 [0,4194304] 0 2024-02-19T19:07:31.280 INFO:tasks.workunit.client.1.smithi142.stdout:0/228: creat d23/d28/d2d/f48 x:0 0 0 2024-02-19T19:07:31.280 INFO:tasks.workunit.client.1.smithi142.stdout:0/229: stat d23/d32 0 2024-02-19T19:07:31.280 INFO:tasks.workunit.client.1.smithi142.stdout:5/186: mknod d5/dd/d8/d29/c40 0 2024-02-19T19:07:31.281 INFO:tasks.workunit.client.1.smithi142.stdout:9/262: mknod db/d10/d32/d3f/d4e/c52 0 2024-02-19T19:07:31.282 INFO:tasks.workunit.client.1.smithi142.stdout:1/302: dwrite d5/d1a/d33/f4d [0,4194304] 0 2024-02-19T19:07:31.283 INFO:tasks.workunit.client.1.smithi142.stdout:8/331: fsync f7 0 2024-02-19T19:07:31.284 INFO:tasks.workunit.client.1.smithi142.stdout:9/263: dread db/d10/d27/d2f/d4c/f35 [0,4194304] 0 2024-02-19T19:07:31.286 INFO:tasks.workunit.client.1.smithi142.stdout:1/303: symlink d5/d7/d23/d2c/l67 0 2024-02-19T19:07:31.286 INFO:tasks.workunit.client.1.smithi142.stdout:1/304: write d5/d37/d5d/f63 [701492,88397] 0 2024-02-19T19:07:31.288 INFO:tasks.workunit.client.1.smithi142.stdout:8/332: unlink d9/dd/d15/f23 0 2024-02-19T19:07:31.288 INFO:tasks.workunit.client.1.smithi142.stdout:8/333: truncate d9/dd/d15/d31/f55 917722 0 2024-02-19T19:07:31.292 INFO:tasks.workunit.client.1.smithi142.stdout:5/187: write d5/dd/f1d [6717198,40706] 0 2024-02-19T19:07:31.292 INFO:tasks.workunit.client.1.smithi142.stdout:5/188: truncate d5/dd/d8/d31/f33 948315 0 2024-02-19T19:07:31.292 INFO:tasks.workunit.client.1.smithi142.stdout:8/334: dread d9/dd/de/d14/d21/f25 [0,4194304] 0 2024-02-19T19:07:31.292 INFO:tasks.workunit.client.1.smithi142.stdout:8/335: fsync d9/dd/de/d2d/d2e/d49/d50/f64 0 2024-02-19T19:07:31.293 INFO:tasks.workunit.client.1.smithi142.stdout:8/336: mknod d9/dd/d15/d4d/c6b 0 2024-02-19T19:07:31.294 INFO:tasks.workunit.client.1.smithi142.stdout:9/264: fsync db/f2b 0 2024-02-19T19:07:31.295 INFO:tasks.workunit.client.1.smithi142.stdout:5/189: rename d5/dd/df/d15/d1a to d5/dd/df/d22/d41 0 2024-02-19T19:07:31.295 INFO:tasks.workunit.client.1.smithi142.stdout:0/230: dwrite d23/d28/f3e [0,4194304] 0 2024-02-19T19:07:31.297 INFO:tasks.workunit.client.1.smithi142.stdout:9/265: creat db/f53 x:0 0 0 2024-02-19T19:07:31.297 INFO:tasks.workunit.client.1.smithi142.stdout:9/266: chown db/d10/l3a 4425200 1 2024-02-19T19:07:31.298 INFO:tasks.workunit.client.1.smithi142.stdout:1/305: dread d5/d1a/d33/f4d [0,4194304] 0 2024-02-19T19:07:31.298 INFO:tasks.workunit.client.1.smithi142.stdout:1/306: chown d5/d37/d5d 7862495 1 2024-02-19T19:07:31.299 INFO:tasks.workunit.client.1.smithi142.stdout:8/337: rename d9/dd/d15/d30 to d9/dd/de/d14/d65/d6c 0 2024-02-19T19:07:31.299 INFO:tasks.workunit.client.1.smithi142.stdout:8/338: truncate d9/dd/de/d14/d21/f27 914476 0 2024-02-19T19:07:31.300 INFO:tasks.workunit.client.1.smithi142.stdout:8/339: fdatasync d9/dd/de/d14/d21/f39 0 2024-02-19T19:07:31.301 INFO:tasks.workunit.client.1.smithi142.stdout:5/190: mknod d5/dd/c42 0 2024-02-19T19:07:31.301 INFO:tasks.workunit.client.1.smithi142.stdout:5/191: dread - d5/dd/d8/d2a/f2d zero size 2024-02-19T19:07:31.305 INFO:tasks.workunit.client.1.smithi142.stdout:0/231: dread f13 [0,4194304] 0 2024-02-19T19:07:31.305 INFO:tasks.workunit.client.1.smithi142.stdout:1/307: rmdir d5/d1a/d59 39 2024-02-19T19:07:31.313 INFO:tasks.workunit.client.1.smithi142.stdout:9/267: getdents db/d10/d22 0 2024-02-19T19:07:31.315 INFO:tasks.workunit.client.1.smithi142.stdout:0/232: rename f15 to d23/d32/d36/d44/f49 0 2024-02-19T19:07:31.315 INFO:tasks.workunit.client.1.smithi142.stdout:0/233: readlink d23/d32/d36/l47 0 2024-02-19T19:07:31.315 INFO:tasks.workunit.client.1.smithi142.stdout:5/192: dwrite d5/f13 [0,4194304] 0 2024-02-19T19:07:31.315 INFO:tasks.workunit.client.1.smithi142.stdout:0/234: write d23/f31 [274173,17958] 0 2024-02-19T19:07:31.315 INFO:tasks.workunit.client.1.smithi142.stdout:5/193: creat d5/dd/f43 x:0 0 0 2024-02-19T19:07:31.322 INFO:tasks.workunit.client.1.smithi142.stdout:9/268: unlink db/d10/d32/d3f/d4e/c52 0 2024-02-19T19:07:31.324 INFO:tasks.workunit.client.1.smithi142.stdout:1/308: rename d5/d1a/f35 to d5/f68 0 2024-02-19T19:07:31.325 INFO:tasks.workunit.client.1.smithi142.stdout:5/194: dread d5/dd/df/d22/d41/d32/f39 [0,4194304] 0 2024-02-19T19:07:31.325 INFO:tasks.workunit.client.1.smithi142.stdout:5/195: truncate d5/f24 1018344 0 2024-02-19T19:07:31.326 INFO:tasks.workunit.client.1.smithi142.stdout:5/196: write d5/fe [8569393,124001] 0 2024-02-19T19:07:31.327 INFO:tasks.workunit.client.1.smithi142.stdout:1/309: unlink d5/d7/c13 0 2024-02-19T19:07:31.328 INFO:tasks.workunit.client.1.smithi142.stdout:5/197: symlink d5/l44 0 2024-02-19T19:07:31.328 INFO:tasks.workunit.client.1.smithi142.stdout:5/198: fsync d5/dd/df/d22/d41/f3a 0 2024-02-19T19:07:31.330 INFO:tasks.workunit.client.1.smithi142.stdout:1/310: rename d5/c32 to d5/d7/d23/d41/c69 0 2024-02-19T19:07:31.332 INFO:tasks.workunit.client.1.smithi142.stdout:5/199: mkdir d5/d45 0 2024-02-19T19:07:31.332 INFO:tasks.workunit.client.1.smithi142.stdout:5/200: dread - d5/dd/df/d22/d41/d32/f35 zero size 2024-02-19T19:07:31.335 INFO:tasks.workunit.client.1.smithi142.stdout:0/235: dwrite d23/f31 [0,4194304] 0 2024-02-19T19:07:31.335 INFO:tasks.workunit.client.1.smithi142.stdout:0/236: fsync d23/d28/f38 0 2024-02-19T19:07:31.336 INFO:tasks.workunit.client.1.smithi142.stdout:1/311: rename d5/d37/d5d to d5/d7/d4a/d53/d6a 0 2024-02-19T19:07:31.336 INFO:tasks.workunit.client.1.smithi142.stdout:1/312: creat d5/d7/d23/d2c/f6b x:0 0 0 2024-02-19T19:07:31.336 INFO:tasks.workunit.client.1.smithi142.stdout:1/313: fsync d5/d7/d23/d2c/f51 0 2024-02-19T19:07:31.338 INFO:tasks.workunit.client.1.smithi142.stdout:1/314: mkdir d5/d37/d6c 0 2024-02-19T19:07:31.340 INFO:tasks.workunit.client.1.smithi142.stdout:1/315: link d5/d37/l48 d5/d7/l6d 0 2024-02-19T19:07:31.342 INFO:tasks.workunit.client.1.smithi142.stdout:1/316: symlink d5/d1a/d33/l6e 0 2024-02-19T19:07:31.342 INFO:tasks.workunit.client.1.smithi142.stdout:1/317: fsync d5/d7/f4f 0 2024-02-19T19:07:31.342 INFO:tasks.workunit.client.1.smithi142.stdout:1/318: stat d5/l22 0 2024-02-19T19:07:31.342 INFO:tasks.workunit.client.1.smithi142.stdout:1/319: fdatasync d5/d7/d23/d2c/f3b 0 2024-02-19T19:07:31.342 INFO:tasks.workunit.client.1.smithi142.stdout:1/320: chown d5/d7/d23/f2a 6 1 2024-02-19T19:07:31.342 INFO:tasks.workunit.client.1.smithi142.stdout:1/321: fsync d5/d7/d23/f45 0 2024-02-19T19:07:31.342 INFO:tasks.workunit.client.1.smithi142.stdout:1/322: write d5/d7/fe [1719844,97209] 0 2024-02-19T19:07:31.343 INFO:tasks.workunit.client.1.smithi142.stdout:1/323: unlink d5/d1a/d33/f60 0 2024-02-19T19:07:31.344 INFO:tasks.workunit.client.1.smithi142.stdout:0/237: dread f17 [0,4194304] 0 2024-02-19T19:07:31.344 INFO:tasks.workunit.client.1.smithi142.stdout:1/324: mkdir d5/d7/d34/d6f 0 2024-02-19T19:07:31.350 INFO:tasks.workunit.client.1.smithi142.stdout:9/269: dwrite db/f53 [0,4194304] 0 2024-02-19T19:07:31.351 INFO:tasks.workunit.client.1.smithi142.stdout:5/201: dwrite d5/dd/df/d22/d41/d32/f35 [0,4194304] 0 2024-02-19T19:07:31.351 INFO:tasks.workunit.client.1.smithi142.stdout:5/202: fsync d5/dd/df/d22/d41/d32/f35 0 2024-02-19T19:07:31.360 INFO:tasks.workunit.client.1.smithi142.stdout:5/203: getdents d5/dd/d8 0 2024-02-19T19:07:31.360 INFO:tasks.workunit.client.1.smithi142.stdout:5/204: write d5/dd/d8/d31/f33 [973925,20572] 0 2024-02-19T19:07:31.361 INFO:tasks.workunit.client.1.smithi142.stdout:5/205: dread - d5/dd/d8/d1c/f3e zero size 2024-02-19T19:07:31.361 INFO:tasks.workunit.client.1.smithi142.stdout:5/206: fdatasync d5/dd/d8/f3d 0 2024-02-19T19:07:31.361 INFO:tasks.workunit.client.1.smithi142.stdout:5/207: chown d5/dd/d8/d2a/f2d 58758 1 2024-02-19T19:07:31.361 INFO:tasks.workunit.client.1.smithi142.stdout:5/208: creat d5/dd/d8/d2a/f46 x:0 0 0 2024-02-19T19:07:31.362 INFO:tasks.workunit.client.1.smithi142.stdout:1/325: dwrite d5/d1a/f3a [0,4194304] 0 2024-02-19T19:07:31.362 INFO:tasks.workunit.client.1.smithi142.stdout:9/270: rename db/d10/d32/d3f/d4e to db/d10/d27/d2f/d4c/d54 0 2024-02-19T19:07:31.362 INFO:tasks.workunit.client.1.smithi142.stdout:9/271: chown db/d10/d27/d2f/d4c/f35 5 1 2024-02-19T19:07:31.370 INFO:tasks.workunit.client.1.smithi142.stdout:9/272: dread db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:31.371 INFO:tasks.workunit.client.1.smithi142.stdout:9/273: symlink db/d10/d27/d2f/d4c/l55 0 2024-02-19T19:07:31.372 INFO:tasks.workunit.client.1.smithi142.stdout:9/274: unlink db/d10/d22/c47 0 2024-02-19T19:07:31.372 INFO:tasks.workunit.client.1.smithi142.stdout:9/275: fsync db/f2b 0 2024-02-19T19:07:31.372 INFO:tasks.workunit.client.1.smithi142.stdout:9/276: read - db/d10/d22/f50 zero size 2024-02-19T19:07:31.373 INFO:tasks.workunit.client.1.smithi142.stdout:5/209: write d5/dd/df/d22/d41/d32/f35 [2009786,94961] 0 2024-02-19T19:07:31.373 INFO:tasks.workunit.client.1.smithi142.stdout:9/277: rename db/d10/d32/c39 to db/d10/d22/d24/d41/c56 0 2024-02-19T19:07:31.375 INFO:tasks.workunit.client.1.smithi142.stdout:0/238: dwrite d23/d32/d36/f37 [0,4194304] 0 2024-02-19T19:07:31.375 INFO:tasks.workunit.client.1.smithi142.stdout:5/210: link d5/dd/d8/d29/c2f d5/dd/c47 0 2024-02-19T19:07:31.376 INFO:tasks.workunit.client.1.smithi142.stdout:9/278: mknod db/d10/d22/c57 0 2024-02-19T19:07:31.376 INFO:tasks.workunit.client.1.smithi142.stdout:1/326: dwrite d5/d37/f52 [0,4194304] 0 2024-02-19T19:07:31.377 INFO:tasks.workunit.client.1.smithi142.stdout:5/211: symlink d5/l48 0 2024-02-19T19:07:31.380 INFO:tasks.workunit.client.1.smithi142.stdout:9/279: truncate db/f53 1543779 0 2024-02-19T19:07:31.383 INFO:tasks.workunit.client.1.smithi142.stdout:1/327: mknod d5/d7/c70 0 2024-02-19T19:07:31.384 INFO:tasks.workunit.client.1.smithi142.stdout:1/328: truncate d5/d7/d23/d2c/f3c 332848 0 2024-02-19T19:07:31.385 INFO:tasks.workunit.client.1.smithi142.stdout:5/212: truncate d5/f13 2267037 0 2024-02-19T19:07:31.387 INFO:tasks.workunit.client.1.smithi142.stdout:5/213: mkdir d5/dd/df/d22/d49 0 2024-02-19T19:07:31.387 INFO:tasks.workunit.client.1.smithi142.stdout:5/214: write d5/dd/d8/d2a/f2d [301399,24997] 0 2024-02-19T19:07:31.388 INFO:tasks.workunit.client.1.smithi142.stdout:0/239: dwrite d23/d28/f3e [0,4194304] 0 2024-02-19T19:07:31.389 INFO:tasks.workunit.client.1.smithi142.stdout:0/240: fdatasync d23/d28/f40 0 2024-02-19T19:07:31.389 INFO:tasks.workunit.client.1.smithi142.stdout:0/241: chown f16 2594 1 2024-02-19T19:07:31.389 INFO:tasks.workunit.client.1.smithi142.stdout:0/242: write f16 [192669,108296] 0 2024-02-19T19:07:31.389 INFO:tasks.workunit.client.1.smithi142.stdout:9/280: rename db/d10/cf to db/d10/d27/c58 0 2024-02-19T19:07:31.389 INFO:tasks.workunit.client.1.smithi142.stdout:5/215: symlink d5/dd/d8/d1c/l4a 0 2024-02-19T19:07:31.391 INFO:tasks.workunit.client.1.smithi142.stdout:5/216: symlink d5/dd/df/d15/l4b 0 2024-02-19T19:07:31.416 INFO:tasks.workunit.client.1.smithi142.stdout:0/243: dwrite d23/d28/f40 [0,4194304] 0 2024-02-19T19:07:31.416 INFO:tasks.workunit.client.1.smithi142.stdout:1/329: dwrite d5/d7/d23/d2c/f3b [0,4194304] 0 2024-02-19T19:07:31.417 INFO:tasks.workunit.client.1.smithi142.stdout:9/281: dwrite db/d10/d27/d2f/d4c/f35 [0,4194304] 0 2024-02-19T19:07:31.418 INFO:tasks.workunit.client.1.smithi142.stdout:5/217: dwrite d5/dd/d8/d2a/f46 [0,4194304] 0 2024-02-19T19:07:31.421 INFO:tasks.workunit.client.1.smithi142.stdout:5/218: dread d5/dd/df/d22/d41/f25 [0,4194304] 0 2024-02-19T19:07:31.421 INFO:tasks.workunit.client.1.smithi142.stdout:5/219: dread - d5/dd/f43 zero size 2024-02-19T19:07:31.422 INFO:tasks.workunit.client.1.smithi142.stdout:9/282: rmdir db/d10/d22/d24 39 2024-02-19T19:07:31.422 INFO:tasks.workunit.client.1.smithi142.stdout:9/283: write db/d10/f1c [4471375,5045] 0 2024-02-19T19:07:31.426 INFO:tasks.workunit.client.1.smithi142.stdout:5/220: symlink d5/d45/l4c 0 2024-02-19T19:07:31.426 INFO:tasks.workunit.client.1.smithi142.stdout:5/221: readlink d5/l48 0 2024-02-19T19:07:31.427 INFO:tasks.workunit.client.1.smithi142.stdout:9/284: getdents db/d10/d27/d2f/d4c/d54 0 2024-02-19T19:07:31.428 INFO:tasks.workunit.client.1.smithi142.stdout:9/285: dread db/d10/d27/f42 [0,4194304] 0 2024-02-19T19:07:31.428 INFO:tasks.workunit.client.1.smithi142.stdout:9/286: readlink db/l12 0 2024-02-19T19:07:31.428 INFO:tasks.workunit.client.1.smithi142.stdout:9/287: truncate db/d10/d22/f50 349251 0 2024-02-19T19:07:31.429 INFO:tasks.workunit.client.1.smithi142.stdout:9/288: readlink db/d10/d27/d2f/d4c/l31 0 2024-02-19T19:07:31.429 INFO:tasks.workunit.client.1.smithi142.stdout:9/289: write db/d10/d22/f46 [541687,76753] 0 2024-02-19T19:07:31.429 INFO:tasks.workunit.client.1.smithi142.stdout:5/222: mkdir d5/dd/d8/d31/d4d 0 2024-02-19T19:07:31.430 INFO:tasks.workunit.client.1.smithi142.stdout:9/290: mkdir db/d10/d27/d2f/d4c/d59 0 2024-02-19T19:07:31.430 INFO:tasks.workunit.client.1.smithi142.stdout:9/291: write db/d10/d32/d33/f4d [5187252,34139] 0 2024-02-19T19:07:31.434 INFO:tasks.workunit.client.1.smithi142.stdout:9/292: dread db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:31.434 INFO:tasks.workunit.client.1.smithi142.stdout:9/293: chown db/c1a 723939430 1 2024-02-19T19:07:31.435 INFO:tasks.workunit.client.1.smithi142.stdout:9/294: write db/d10/d27/f42 [274124,3158] 0 2024-02-19T19:07:31.447 INFO:tasks.workunit.client.1.smithi142.stdout:9/295: dread db/d10/d22/d24/f3c [0,4194304] 0 2024-02-19T19:07:31.448 INFO:tasks.workunit.client.1.smithi142.stdout:9/296: chown db/d10/d27/d2f/d4c/l48 1527468 1 2024-02-19T19:07:31.448 INFO:tasks.workunit.client.1.smithi142.stdout:0/244: dwrite f17 [0,4194304] 0 2024-02-19T19:07:31.448 INFO:tasks.workunit.client.1.smithi142.stdout:0/245: write f11 [3747431,56711] 0 2024-02-19T19:07:31.448 INFO:tasks.workunit.client.1.smithi142.stdout:0/246: chown d23/d32/d36/d44/l45 1733791 1 2024-02-19T19:07:31.449 INFO:tasks.workunit.client.1.smithi142.stdout:9/297: rename db/l3b to db/d10/d27/d2f/l5a 0 2024-02-19T19:07:31.449 INFO:tasks.workunit.client.1.smithi142.stdout:9/298: readlink db/d10/d27/d2f/d4c/l48 0 2024-02-19T19:07:31.449 INFO:tasks.workunit.client.1.smithi142.stdout:9/299: truncate db/d10/d22/f46 1575817 0 2024-02-19T19:07:31.455 INFO:tasks.workunit.client.1.smithi142.stdout:0/247: write d23/d28/f33 [1026885,56327] 0 2024-02-19T19:07:31.455 INFO:tasks.workunit.client.1.smithi142.stdout:1/330: dwrite d5/d7/fe [0,4194304] 0 2024-02-19T19:07:31.455 INFO:tasks.workunit.client.1.smithi142.stdout:1/331: write d5/d7/d34/f66 [645217,53502] 0 2024-02-19T19:07:31.455 INFO:tasks.workunit.client.1.smithi142.stdout:5/223: dwrite d5/dd/df/d22/d41/f25 [0,4194304] 0 2024-02-19T19:07:31.455 INFO:tasks.workunit.client.1.smithi142.stdout:1/332: fdatasync d5/d1a/d33/f4d 0 2024-02-19T19:07:31.455 INFO:tasks.workunit.client.1.smithi142.stdout:1/333: chown d5/d7/d34/f46 9650 1 2024-02-19T19:07:31.456 INFO:tasks.workunit.client.1.smithi142.stdout:1/334: write d5/d1a/f47 [2289549,100273] 0 2024-02-19T19:07:31.458 INFO:tasks.workunit.client.1.smithi142.stdout:1/335: symlink d5/d37/d6c/l71 0 2024-02-19T19:07:31.458 INFO:tasks.workunit.client.1.smithi142.stdout:1/336: write d5/f2d [992119,32535] 0 2024-02-19T19:07:31.460 INFO:tasks.workunit.client.1.smithi142.stdout:9/300: dread db/d10/d27/f49 [0,4194304] 0 2024-02-19T19:07:31.461 INFO:tasks.workunit.client.1.smithi142.stdout:5/224: read d5/f13 [1714367,21344] 0 2024-02-19T19:07:31.461 INFO:tasks.workunit.client.1.smithi142.stdout:5/225: creat d5/dd/d8/d2a/f4e x:0 0 0 2024-02-19T19:07:31.461 INFO:tasks.workunit.client.1.smithi142.stdout:5/226: fsync d5/dd/df/f12 0 2024-02-19T19:07:31.468 INFO:tasks.workunit.client.1.smithi142.stdout:9/301: dread db/f18 [0,4194304] 0 2024-02-19T19:07:31.476 INFO:tasks.workunit.client.1.smithi142.stdout:0/248: dwrite f17 [0,4194304] 0 2024-02-19T19:07:31.478 INFO:tasks.workunit.client.1.smithi142.stdout:0/249: mknod d23/d32/c4a 0 2024-02-19T19:07:31.482 INFO:tasks.workunit.client.1.smithi142.stdout:0/250: dread d23/d28/d2d/f3b [0,4194304] 0 2024-02-19T19:07:31.483 INFO:tasks.workunit.client.1.smithi142.stdout:0/251: symlink d23/d32/d36/l4b 0 2024-02-19T19:07:31.484 INFO:tasks.workunit.client.1.smithi142.stdout:0/252: mknod d23/c4c 0 2024-02-19T19:07:31.484 INFO:tasks.workunit.client.1.smithi142.stdout:0/253: chown l21 433588 1 2024-02-19T19:07:31.484 INFO:tasks.workunit.client.1.smithi142.stdout:0/254: creat d23/d32/d36/d44/f4d x:0 0 0 2024-02-19T19:07:31.486 INFO:tasks.workunit.client.1.smithi142.stdout:0/255: link d23/c3c d23/d32/d36/d44/c4e 0 2024-02-19T19:07:31.486 INFO:tasks.workunit.client.1.smithi142.stdout:0/256: creat d23/d32/d36/f4f x:0 0 0 2024-02-19T19:07:31.487 INFO:tasks.workunit.client.1.smithi142.stdout:0/257: creat d23/d32/f50 x:0 0 0 2024-02-19T19:07:31.495 INFO:tasks.workunit.client.1.smithi142.stdout:1/337: dwrite d5/f68 [0,4194304] 0 2024-02-19T19:07:31.495 INFO:tasks.workunit.client.1.smithi142.stdout:9/302: dwrite f5 [0,4194304] 0 2024-02-19T19:07:31.497 INFO:tasks.workunit.client.1.smithi142.stdout:5/227: dwrite d5/dd/df/d22/d41/d32/f35 [4194304,4194304] 0 2024-02-19T19:07:31.498 INFO:tasks.workunit.client.1.smithi142.stdout:1/338: unlink d5/d1a/l4b 0 2024-02-19T19:07:31.500 INFO:tasks.workunit.client.1.smithi142.stdout:5/228: mknod d5/dd/d8/d31/c4f 0 2024-02-19T19:07:31.502 INFO:tasks.workunit.client.1.smithi142.stdout:1/339: rename d5/d7/d23/d2c/c30 to d5/d7/d23/d2c/c72 0 2024-02-19T19:07:31.503 INFO:tasks.workunit.client.1.smithi142.stdout:9/303: mknod db/d10/c5b 0 2024-02-19T19:07:31.504 INFO:tasks.workunit.client.1.smithi142.stdout:1/340: mkdir d5/d73 0 2024-02-19T19:07:31.506 INFO:tasks.workunit.client.1.smithi142.stdout:9/304: creat db/d10/d22/f5c x:0 0 0 2024-02-19T19:07:31.508 INFO:tasks.workunit.client.1.smithi142.stdout:9/305: creat db/d10/d27/d2f/f5d x:0 0 0 2024-02-19T19:07:31.510 INFO:tasks.workunit.client.1.smithi142.stdout:9/306: mknod db/d10/d22/c5e 0 2024-02-19T19:07:31.511 INFO:tasks.workunit.client.1.smithi142.stdout:0/258: rename d23/d32/d36 to d23/d28/d2d/d51 0 2024-02-19T19:07:31.511 INFO:tasks.workunit.client.1.smithi142.stdout:0/259: dread - d23/d28/d2d/f48 zero size 2024-02-19T19:07:31.512 INFO:tasks.workunit.client.1.smithi142.stdout:9/307: mkdir db/d10/d32/d3f/d5f 0 2024-02-19T19:07:31.512 INFO:tasks.workunit.client.1.smithi142.stdout:9/308: fsync db/d10/d27/f40 0 2024-02-19T19:07:31.514 INFO:tasks.workunit.client.1.smithi142.stdout:0/260: mknod d23/d32/c52 0 2024-02-19T19:07:31.514 INFO:tasks.workunit.client.1.smithi142.stdout:0/261: creat d23/d28/d2d/f53 x:0 0 0 2024-02-19T19:07:31.523 INFO:tasks.workunit.client.1.smithi142.stdout:1/341: dwrite f4 [0,4194304] 0 2024-02-19T19:07:31.524 INFO:tasks.workunit.client.1.smithi142.stdout:1/342: mknod d5/d7/d4a/d53/c74 0 2024-02-19T19:07:31.524 INFO:tasks.workunit.client.1.smithi142.stdout:5/229: dwrite d5/dd/df/d22/d41/f2b [0,4194304] 0 2024-02-19T19:07:31.525 INFO:tasks.workunit.client.1.smithi142.stdout:1/343: mkdir d5/d37/d6c/d75 0 2024-02-19T19:07:31.525 INFO:tasks.workunit.client.1.smithi142.stdout:1/344: readlink d5/d37/d6c/l71 0 2024-02-19T19:07:31.525 INFO:tasks.workunit.client.1.smithi142.stdout:5/230: write d5/dd/d8/d31/f33 [450014,8335] 0 2024-02-19T19:07:31.525 INFO:tasks.workunit.client.1.smithi142.stdout:5/231: read - d5/dd/d8/d2a/f4e zero size 2024-02-19T19:07:31.525 INFO:tasks.workunit.client.1.smithi142.stdout:0/262: read d23/f31 [41702,69268] 0 2024-02-19T19:07:31.526 INFO:tasks.workunit.client.1.smithi142.stdout:0/263: mkdir d23/d28/d2d/d54 0 2024-02-19T19:07:31.527 INFO:tasks.workunit.client.1.smithi142.stdout:0/264: write d23/d28/d2d/d51/d44/f4d [767648,4601] 0 2024-02-19T19:07:31.528 INFO:tasks.workunit.client.1.smithi142.stdout:1/345: dread d5/d7/f4f [0,4194304] 0 2024-02-19T19:07:31.528 INFO:tasks.workunit.client.1.smithi142.stdout:1/346: rename d5 to d5/d7/d34/d76 22 2024-02-19T19:07:31.536 INFO:tasks.workunit.client.1.smithi142.stdout:0/265: dread d23/f25 [0,4194304] 0 2024-02-19T19:07:31.536 INFO:tasks.workunit.client.1.smithi142.stdout:0/266: write f1a [1381190,5431] 0 2024-02-19T19:07:31.538 INFO:tasks.workunit.client.1.smithi142.stdout:1/347: write d5/d1a/f3a [1463967,79392] 0 2024-02-19T19:07:31.538 INFO:tasks.workunit.client.1.smithi142.stdout:1/348: stat d5/d7/d23/d2c/f3b 0 2024-02-19T19:07:31.539 INFO:tasks.workunit.client.1.smithi142.stdout:1/349: mkdir d5/d77 0 2024-02-19T19:07:31.540 INFO:tasks.workunit.client.1.smithi142.stdout:1/350: mknod d5/d7/d4a/d53/d6a/c78 0 2024-02-19T19:07:31.542 INFO:tasks.workunit.client.1.smithi142.stdout:1/351: unlink d5/d7/fe 0 2024-02-19T19:07:31.547 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:31 smithi046 podman[106345]: 2024-02-19 19:07:31.218717132 +0000 UTC m=+0.876128441 container died a259c02271024bd9e28537b744f5a9f99a50e58c34f5bb78480e6ae1444ae017 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-19T19:07:31.564 INFO:tasks.workunit.client.1.smithi142.stdout:9/309: dwrite db/d10/f1c [0,4194304] 0 2024-02-19T19:07:31.564 INFO:tasks.workunit.client.1.smithi142.stdout:9/310: chown db/c34 225 1 2024-02-19T19:07:31.568 INFO:tasks.workunit.client.1.smithi142.stdout:5/232: dwrite d5/fe [4194304,4194304] 0 2024-02-19T19:07:31.568 INFO:tasks.workunit.client.1.smithi142.stdout:0/267: dwrite d23/f3a [0,4194304] 0 2024-02-19T19:07:31.568 INFO:tasks.workunit.client.1.smithi142.stdout:1/352: dwrite d5/d7/d23/d2c/f3b [0,4194304] 0 2024-02-19T19:07:31.568 INFO:tasks.workunit.client.1.smithi142.stdout:1/353: stat d5/d7/f11 0 2024-02-19T19:07:31.569 INFO:tasks.workunit.client.1.smithi142.stdout:9/311: read db/d10/d22/d24/f3c [1697600,102498] 0 2024-02-19T19:07:31.570 INFO:tasks.workunit.client.1.smithi142.stdout:0/268: unlink d23/d28/d2d/d51/l47 0 2024-02-19T19:07:31.570 INFO:tasks.workunit.client.1.smithi142.stdout:9/312: chown db/d10/c19 363 1 2024-02-19T19:07:31.570 INFO:tasks.workunit.client.1.smithi142.stdout:9/313: chown db/d10/d27/d2f/d4c/d59 276798778 1 2024-02-19T19:07:31.571 INFO:tasks.workunit.client.1.smithi142.stdout:0/269: symlink d23/d28/d2d/d51/l55 0 2024-02-19T19:07:31.579 INFO:tasks.workunit.client.1.smithi142.stdout:9/314: dread db/d10/f15 [0,4194304] 0 2024-02-19T19:07:31.581 INFO:tasks.workunit.client.1.smithi142.stdout:5/233: write f4 [660666,36400] 0 2024-02-19T19:07:31.581 INFO:tasks.workunit.client.1.smithi142.stdout:5/234: stat d5/dd/df/d22/l27 0 2024-02-19T19:07:31.581 INFO:tasks.workunit.client.1.smithi142.stdout:5/235: truncate d5/dd/df/d22/d41/f3a 40351 0 2024-02-19T19:07:31.581 INFO:tasks.workunit.client.1.smithi142.stdout:5/236: fdatasync d5/dd/df/d22/d41/d32/f39 0 2024-02-19T19:07:31.582 INFO:tasks.workunit.client.1.smithi142.stdout:9/315: dread db/d10/d22/d24/f3e [0,4194304] 0 2024-02-19T19:07:31.583 INFO:tasks.workunit.client.1.smithi142.stdout:9/316: getdents db/d10/d32 0 2024-02-19T19:07:31.583 INFO:tasks.workunit.client.1.smithi142.stdout:9/317: write db/d10/d22/f37 [4621006,51981] 0 2024-02-19T19:07:31.584 INFO:tasks.workunit.client.1.smithi142.stdout:9/318: mknod db/d10/d32/d3f/d5f/c60 0 2024-02-19T19:07:31.585 INFO:tasks.workunit.client.1.smithi142.stdout:0/270: dwrite d23/d28/d2d/f48 [0,4194304] 0 2024-02-19T19:07:31.588 INFO:tasks.workunit.client.1.smithi142.stdout:9/319: dread db/d10/d22/d24/f3e [0,4194304] 0 2024-02-19T19:07:31.588 INFO:tasks.workunit.client.1.smithi142.stdout:9/320: fdatasync db/d10/d22/f5c 0 2024-02-19T19:07:31.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/321: creat db/f61 x:0 0 0 2024-02-19T19:07:31.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/322: chown db/d10/d27/d2f 1 1 2024-02-19T19:07:31.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/323: fdatasync db/f16 0 2024-02-19T19:07:31.591 INFO:tasks.workunit.client.1.smithi142.stdout:9/324: rename db/d10/d22/c5e to db/d10/d32/d3f/c62 0 2024-02-19T19:07:31.594 INFO:tasks.workunit.client.1.smithi142.stdout:1/354: dwrite d5/f68 [0,4194304] 0 2024-02-19T19:07:31.600 INFO:tasks.workunit.client.1.smithi142.stdout:9/325: unlink db/d10/d22/d24/d41/c56 0 2024-02-19T19:07:31.600 INFO:tasks.workunit.client.1.smithi142.stdout:9/326: readlink db/d10/l3a 0 2024-02-19T19:07:31.600 INFO:tasks.workunit.client.1.smithi142.stdout:5/237: dwrite f4 [0,4194304] 0 2024-02-19T19:07:31.601 INFO:tasks.workunit.client.1.smithi142.stdout:5/238: stat f4 0 2024-02-19T19:07:31.603 INFO:tasks.workunit.client.1.smithi142.stdout:1/355: write d5/d7/d34/f46 [2029670,76336] 0 2024-02-19T19:07:31.612 INFO:tasks.workunit.client.1.smithi142.stdout:9/327: getdents db/d10/d32/d3f 0 2024-02-19T19:07:31.613 INFO:tasks.workunit.client.1.smithi142.stdout:5/239: symlink d5/dd/d8/d1c/l50 0 2024-02-19T19:07:31.614 INFO:tasks.workunit.client.1.smithi142.stdout:9/328: creat db/d10/d32/d3f/f63 x:0 0 0 2024-02-19T19:07:31.615 INFO:tasks.workunit.client.1.smithi142.stdout:5/240: rmdir d5/dd/df 39 2024-02-19T19:07:31.616 INFO:tasks.workunit.client.1.smithi142.stdout:1/356: getdents d5/d1a/d33 0 2024-02-19T19:07:31.616 INFO:tasks.workunit.client.1.smithi142.stdout:1/357: readlink d5/d7/d34/l3d 0 2024-02-19T19:07:31.616 INFO:tasks.workunit.client.1.smithi142.stdout:9/329: symlink db/d10/d22/d24/l64 0 2024-02-19T19:07:31.617 INFO:tasks.workunit.client.1.smithi142.stdout:9/330: chown db/f53 71907 1 2024-02-19T19:07:31.617 INFO:tasks.workunit.client.1.smithi142.stdout:9/331: dread - db/d10/d32/d3f/f63 zero size 2024-02-19T19:07:31.618 INFO:tasks.workunit.client.1.smithi142.stdout:1/358: creat d5/d7/d4a/d53/d6a/f79 x:0 0 0 2024-02-19T19:07:31.618 INFO:tasks.workunit.client.1.smithi142.stdout:1/359: chown d5/d1a/f47 0 1 2024-02-19T19:07:31.620 INFO:tasks.workunit.client.1.smithi142.stdout:9/332: symlink db/d10/d32/d3f/d5f/l65 0 2024-02-19T19:07:31.622 INFO:tasks.workunit.client.1.smithi142.stdout:9/333: mknod db/d10/d32/d3f/d5f/c66 0 2024-02-19T19:07:31.623 INFO:tasks.workunit.client.1.smithi142.stdout:9/334: dread db/d10/d27/f42 [0,4194304] 0 2024-02-19T19:07:31.625 INFO:tasks.workunit.client.1.smithi142.stdout:5/241: truncate f4 3002909 0 2024-02-19T19:07:31.625 INFO:tasks.workunit.client.1.smithi142.stdout:5/242: readlink d5/dd/df/d22/d41/l1b 0 2024-02-19T19:07:31.631 INFO:tasks.workunit.client.1.smithi142.stdout:1/360: dwrite d5/d7/f4f [0,4194304] 0 2024-02-19T19:07:31.632 INFO:tasks.workunit.client.1.smithi142.stdout:9/335: read db/d10/d22/f37 [1522840,68443] 0 2024-02-19T19:07:31.632 INFO:tasks.workunit.client.1.smithi142.stdout:5/243: dread d5/dd/d8/d2a/f46 [0,4194304] 0 2024-02-19T19:07:31.633 INFO:tasks.workunit.client.1.smithi142.stdout:1/361: getdents d5/d37/d6c 0 2024-02-19T19:07:31.633 INFO:tasks.workunit.client.1.smithi142.stdout:1/362: chown d5/c6 1005978 1 2024-02-19T19:07:31.634 INFO:tasks.workunit.client.1.smithi142.stdout:5/244: symlink d5/dd/df/l51 0 2024-02-19T19:07:31.634 INFO:tasks.workunit.client.1.smithi142.stdout:5/245: readlink d5/dd/d8/d29/l30 0 2024-02-19T19:07:31.635 INFO:tasks.workunit.client.1.smithi142.stdout:5/246: truncate d5/dd/d8/d2a/f2d 63396 0 2024-02-19T19:07:31.635 INFO:tasks.workunit.client.1.smithi142.stdout:5/247: fsync d5/dd/df/d22/f37 0 2024-02-19T19:07:31.635 INFO:tasks.workunit.client.1.smithi142.stdout:5/248: fdatasync d5/dd/df/d22/d41/d32/f39 0 2024-02-19T19:07:31.636 INFO:tasks.workunit.client.1.smithi142.stdout:5/249: mkdir d5/dd/df/d22/d52 0 2024-02-19T19:07:31.639 INFO:tasks.workunit.client.1.smithi142.stdout:9/336: dread db/d10/d22/d24/f3c [0,4194304] 0 2024-02-19T19:07:31.639 INFO:tasks.workunit.client.1.smithi142.stdout:9/337: readlink db/d10/d27/d2f/d4c/l55 0 2024-02-19T19:07:31.641 INFO:tasks.workunit.client.1.smithi142.stdout:9/338: unlink db/d10/c2d 0 2024-02-19T19:07:31.641 INFO:tasks.workunit.client.1.smithi142.stdout:9/339: fdatasync db/d10/d22/d24/f25 0 2024-02-19T19:07:31.643 INFO:tasks.workunit.client.1.smithi142.stdout:9/340: truncate db/f2b 294960 0 2024-02-19T19:07:31.644 INFO:tasks.workunit.client.1.smithi142.stdout:9/341: rmdir db/d10/d32/d3f/d5f 39 2024-02-19T19:07:31.644 INFO:tasks.workunit.client.1.smithi142.stdout:9/342: readlink db/d10/d27/d2f/l5a 0 2024-02-19T19:07:31.644 INFO:tasks.workunit.client.1.smithi142.stdout:9/343: fsync db/d10/d22/d24/f25 0 2024-02-19T19:07:31.646 INFO:tasks.workunit.client.1.smithi142.stdout:9/344: dread db/d10/d22/d24/f3e [0,4194304] 0 2024-02-19T19:07:31.646 INFO:tasks.workunit.client.1.smithi142.stdout:9/345: dread - db/d10/d32/d3f/f63 zero size 2024-02-19T19:07:31.648 INFO:tasks.workunit.client.1.smithi142.stdout:9/346: symlink db/d10/d22/d24/d41/l67 0 2024-02-19T19:07:31.648 INFO:tasks.workunit.client.1.smithi142.stdout:9/347: chown db/d10/d22/c30 5270 1 2024-02-19T19:07:31.648 INFO:tasks.workunit.client.1.smithi142.stdout:9/348: chown db/d10/d22/d24/f25 0 1 2024-02-19T19:07:31.648 INFO:tasks.workunit.client.1.smithi142.stdout:9/349: write db/f18 [3089233,39512] 0 2024-02-19T19:07:31.648 INFO:tasks.workunit.client.1.smithi142.stdout:9/350: readlink db/d10/d27/l38 0 2024-02-19T19:07:31.649 INFO:tasks.workunit.client.1.smithi142.stdout:9/351: creat db/f68 x:0 0 0 2024-02-19T19:07:31.650 INFO:tasks.workunit.client.1.smithi142.stdout:9/352: creat db/d10/d32/f69 x:0 0 0 2024-02-19T19:07:31.651 INFO:tasks.workunit.client.1.smithi142.stdout:9/353: unlink db/d10/d22/d24/c26 0 2024-02-19T19:07:31.657 INFO:tasks.workunit.client.1.smithi142.stdout:1/363: dwrite d5/f42 [0,4194304] 0 2024-02-19T19:07:31.657 INFO:tasks.workunit.client.1.smithi142.stdout:1/364: chown d5/d7/d23/l29 17164954 1 2024-02-19T19:07:31.657 INFO:tasks.workunit.client.1.smithi142.stdout:1/365: write d5/f2d [4892188,8367] 0 2024-02-19T19:07:31.657 INFO:tasks.workunit.client.1.smithi142.stdout:5/250: dwrite d5/dd/df/d22/d41/f3a [0,4194304] 0 2024-02-19T19:07:31.658 INFO:tasks.workunit.client.1.smithi142.stdout:1/366: getdents d5/d7/d23/d41 0 2024-02-19T19:07:31.658 INFO:tasks.workunit.client.1.smithi142.stdout:1/367: creat d5/d7/d34/f7a x:0 0 0 2024-02-19T19:07:31.660 INFO:tasks.workunit.client.1.smithi142.stdout:5/251: mkdir d5/dd/df/d22/d41/d32/d53 0 2024-02-19T19:07:31.661 INFO:tasks.workunit.client.1.smithi142.stdout:1/368: creat d5/d7/d34/d6f/f7b x:0 0 0 2024-02-19T19:07:31.662 INFO:tasks.workunit.client.1.smithi142.stdout:5/252: creat d5/dd/df/d22/d41/f54 x:0 0 0 2024-02-19T19:07:31.662 INFO:tasks.workunit.client.1.smithi142.stdout:5/253: fdatasync d5/dd/df/f12 0 2024-02-19T19:07:31.663 INFO:tasks.workunit.client.1.smithi142.stdout:5/254: symlink d5/dd/df/d22/l55 0 2024-02-19T19:07:31.670 INFO:tasks.workunit.client.1.smithi142.stdout:1/369: dread d5/d7/d34/f46 [0,4194304] 0 2024-02-19T19:07:31.670 INFO:tasks.workunit.client.1.smithi142.stdout:9/354: dwrite db/d10/d32/d33/f4d [4194304,4194304] 0 2024-02-19T19:07:31.670 INFO:tasks.workunit.client.1.smithi142.stdout:9/355: fdatasync f5 0 2024-02-19T19:07:31.671 INFO:tasks.workunit.client.1.smithi142.stdout:1/370: creat d5/d37/d6c/f7c x:0 0 0 2024-02-19T19:07:31.671 INFO:tasks.workunit.client.1.smithi142.stdout:1/371: creat d5/d1a/f7d x:0 0 0 2024-02-19T19:07:31.673 INFO:tasks.workunit.client.1.smithi142.stdout:5/255: dread d5/fe [4194304,4194304] 0 2024-02-19T19:07:31.673 INFO:tasks.workunit.client.1.smithi142.stdout:5/256: chown d5/dd/c47 46513827 1 2024-02-19T19:07:31.673 INFO:tasks.workunit.client.1.smithi142.stdout:5/257: dread - d5/f20 zero size 2024-02-19T19:07:31.673 INFO:tasks.workunit.client.1.smithi142.stdout:5/258: dread - d5/dd/d8/d1c/f3e zero size 2024-02-19T19:07:31.673 INFO:tasks.workunit.client.1.smithi142.stdout:1/372: rename d5/d7/d23/f2a to d5/d7/d4a/d53/d6a/f7e 0 2024-02-19T19:07:31.674 INFO:tasks.workunit.client.1.smithi142.stdout:1/373: dread - d5/d7/d4a/d53/d6a/f79 zero size 2024-02-19T19:07:31.674 INFO:tasks.workunit.client.1.smithi142.stdout:9/356: link db/d10/c5b db/c6a 0 2024-02-19T19:07:31.674 INFO:tasks.workunit.client.1.smithi142.stdout:5/259: mknod d5/dd/d8/d31/c56 0 2024-02-19T19:07:31.675 INFO:tasks.workunit.client.1.smithi142.stdout:9/357: dread db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:31.676 INFO:tasks.workunit.client.1.smithi142.stdout:9/358: read db/d10/d22/f50 [284807,85713] 0 2024-02-19T19:07:31.684 INFO:tasks.workunit.client.1.smithi142.stdout:1/374: write d5/f68 [244409,15395] 0 2024-02-19T19:07:31.684 INFO:tasks.workunit.client.1.smithi142.stdout:1/375: dread - d5/d7/d23/d2c/f6b zero size 2024-02-19T19:07:31.685 INFO:tasks.workunit.client.1.smithi142.stdout:5/260: dread d5/dd/f1e [0,4194304] 0 2024-02-19T19:07:31.685 INFO:tasks.workunit.client.1.smithi142.stdout:5/261: fsync d5/f38 0 2024-02-19T19:07:31.687 INFO:tasks.workunit.client.1.smithi142.stdout:5/262: rmdir d5/dd/df/d22/d52 0 2024-02-19T19:07:31.693 INFO:tasks.workunit.client.1.smithi142.stdout:9/359: dwrite db/d10/d22/f5c [0,4194304] 0 2024-02-19T19:07:31.695 INFO:tasks.workunit.client.1.smithi142.stdout:5/263: dread f4 [0,4194304] 0 2024-02-19T19:07:31.708 INFO:tasks.workunit.client.1.smithi142.stdout:1/376: dwrite d5/f42 [0,4194304] 0 2024-02-19T19:07:31.708 INFO:tasks.workunit.client.1.smithi142.stdout:1/377: chown d5/d7/d23/d2c/f6b 8051481 1 2024-02-19T19:07:31.708 INFO:tasks.workunit.client.1.smithi142.stdout:1/378: fsync d5/f68 0 2024-02-19T19:07:31.708 INFO:tasks.workunit.client.1.smithi142.stdout:1/379: chown d5/d7/d4a/d53/d6a/f65 291 1 2024-02-19T19:07:31.708 INFO:tasks.workunit.client.1.smithi142.stdout:1/380: creat d5/d7/d34/d6f/f7f x:0 0 0 2024-02-19T19:07:31.711 INFO:tasks.workunit.client.1.smithi142.stdout:1/381: creat d5/d7/d23/d41/f80 x:0 0 0 2024-02-19T19:07:31.711 INFO:tasks.workunit.client.1.smithi142.stdout:5/264: dwrite d5/dd/d8/d31/f34 [0,4194304] 0 2024-02-19T19:07:31.714 INFO:tasks.workunit.client.1.smithi142.stdout:5/265: mkdir d5/dd/d8/d2a/d57 0 2024-02-19T19:07:31.715 INFO:tasks.workunit.client.1.smithi142.stdout:5/266: unlink d5/dd/df/d22/l55 0 2024-02-19T19:07:31.717 INFO:tasks.workunit.client.1.smithi142.stdout:5/267: dread d5/dd/d8/d31/f33 [0,4194304] 0 2024-02-19T19:07:31.718 INFO:tasks.workunit.client.1.smithi142.stdout:5/268: symlink d5/dd/d8/d2a/d57/l58 0 2024-02-19T19:07:31.719 INFO:tasks.workunit.client.1.smithi142.stdout:5/269: rmdir d5/dd/df/d22/d41 39 2024-02-19T19:07:31.720 INFO:tasks.workunit.client.1.smithi142.stdout:5/270: stat d5/dd/d8/d2a/f46 0 2024-02-19T19:07:31.726 INFO:tasks.workunit.client.1.smithi142.stdout:1/382: dwrite d5/d1a/f3a [0,4194304] 0 2024-02-19T19:07:31.732 INFO:tasks.workunit.client.1.smithi142.stdout:5/271: read d5/dd/d8/d2a/f46 [2159903,62210] 0 2024-02-19T19:07:31.733 INFO:tasks.workunit.client.1.smithi142.stdout:5/272: creat d5/dd/df/f59 x:0 0 0 2024-02-19T19:07:31.733 INFO:tasks.workunit.client.1.smithi142.stdout:5/273: chown d5/dd/d8/d2a/d57/l58 49153 1 2024-02-19T19:07:31.733 INFO:tasks.workunit.client.1.smithi142.stdout:5/274: chown f4 182864 1 2024-02-19T19:07:31.734 INFO:tasks.workunit.client.1.smithi142.stdout:5/275: symlink d5/dd/d8/d2a/d57/l5a 0 2024-02-19T19:07:31.735 INFO:tasks.workunit.client.1.smithi142.stdout:5/276: mkdir d5/dd/df/d15/d5b 0 2024-02-19T19:07:31.735 INFO:tasks.workunit.client.1.smithi142.stdout:5/277: truncate d5/dd/df/d22/d41/f2b 358243 0 2024-02-19T19:07:31.736 INFO:tasks.workunit.client.1.smithi142.stdout:5/278: rmdir d5/dd/df/d22/d49 0 2024-02-19T19:07:31.737 INFO:tasks.workunit.client.1.smithi142.stdout:5/279: symlink d5/dd/d8/d29/l5c 0 2024-02-19T19:07:31.738 INFO:tasks.workunit.client.1.smithi142.stdout:5/280: mkdir d5/dd/d8/d5d 0 2024-02-19T19:07:31.739 INFO:tasks.workunit.client.1.smithi142.stdout:5/281: rmdir d5/dd/d8/d29 39 2024-02-19T19:07:31.739 INFO:tasks.workunit.client.1.smithi142.stdout:5/282: write d5/dd/df/d22/d41/f3a [4701664,21125] 0 2024-02-19T19:07:31.739 INFO:tasks.workunit.client.1.smithi142.stdout:1/383: dwrite d5/ff [0,4194304] 0 2024-02-19T19:07:31.740 INFO:tasks.workunit.client.1.smithi142.stdout:5/283: mknod d5/dd/d8/d31/c5e 0 2024-02-19T19:07:31.743 INFO:tasks.workunit.client.1.smithi142.stdout:1/384: unlink d5/d7/d34/d6f/f7f 0 2024-02-19T19:07:31.745 INFO:tasks.workunit.client.1.smithi142.stdout:5/284: mkdir d5/dd/d5f 0 2024-02-19T19:07:31.746 INFO:tasks.workunit.client.1.smithi142.stdout:1/385: rename d5/d7/d34/f26 to d5/d7/d4a/f81 0 2024-02-19T19:07:31.747 INFO:tasks.workunit.client.1.smithi142.stdout:5/285: truncate d5/dd/d8/d31/f34 1099382 0 2024-02-19T19:07:31.748 INFO:tasks.workunit.client.1.smithi142.stdout:1/386: creat d5/d7/d4a/f82 x:0 0 0 2024-02-19T19:07:31.749 INFO:tasks.workunit.client.1.smithi142.stdout:1/387: truncate d5/d7/f25 172649 0 2024-02-19T19:07:31.758 INFO:tasks.workunit.client.1.smithi142.stdout:1/388: read d5/d7/f3e [2638014,66289] 0 2024-02-19T19:07:31.759 INFO:tasks.workunit.client.1.smithi142.stdout:1/389: link d5/d7/d34/l3d d5/d1a/l83 0 2024-02-19T19:07:31.766 INFO:tasks.workunit.client.1.smithi142.stdout:5/286: dwrite d5/dd/d8/d31/f34 [0,4194304] 0 2024-02-19T19:07:31.766 INFO:tasks.workunit.client.1.smithi142.stdout:5/287: fsync d5/dd/f43 0 2024-02-19T19:07:31.768 INFO:tasks.workunit.client.1.smithi142.stdout:5/288: mkdir d5/dd/d8/d31/d4d/d60 0 2024-02-19T19:07:31.778 INFO:tasks.workunit.client.1.smithi142.stdout:5/289: dread d5/dd/d8/fb [0,4194304] 0 2024-02-19T19:07:31.778 INFO:tasks.workunit.client.1.smithi142.stdout:1/390: dwrite d5/d7/d34/f46 [0,4194304] 0 2024-02-19T19:07:31.778 INFO:tasks.workunit.client.1.smithi142.stdout:1/391: dread - d5/d7/d34/d6f/f7b zero size 2024-02-19T19:07:31.779 INFO:tasks.workunit.client.1.smithi142.stdout:1/392: write d5/d7/d34/f66 [419958,85162] 0 2024-02-19T19:07:31.779 INFO:tasks.workunit.client.1.smithi142.stdout:1/393: creat d5/d7/d4a/d53/d6a/f84 x:0 0 0 2024-02-19T19:07:31.779 INFO:tasks.workunit.client.1.smithi142.stdout:5/290: mknod d5/dd/df/c61 0 2024-02-19T19:07:31.779 INFO:tasks.workunit.client.1.smithi142.stdout:1/394: chown d5/d7/d23/d41/c43 856 1 2024-02-19T19:07:31.779 INFO:tasks.workunit.client.1.smithi142.stdout:5/291: chown d5/dd/d8/d31/c4f 953782803 1 2024-02-19T19:07:31.779 INFO:tasks.workunit.client.1.smithi142.stdout:5/292: fdatasync d5/dd/df/d22/d41/d32/f39 0 2024-02-19T19:07:31.779 INFO:tasks.workunit.client.1.smithi142.stdout:1/395: creat d5/d37/d6c/f85 x:0 0 0 2024-02-19T19:07:31.779 INFO:tasks.workunit.client.1.smithi142.stdout:1/396: chown d5/d7/d23/d2c 4627 1 2024-02-19T19:07:31.782 INFO:tasks.workunit.client.1.smithi142.stdout:5/293: rename d5/dd/f1d to d5/dd/df/d22/d41/d32/f62 0 2024-02-19T19:07:31.783 INFO:tasks.workunit.client.1.smithi142.stdout:1/397: rmdir d5/d1a 39 2024-02-19T19:07:31.783 INFO:tasks.workunit.client.1.smithi142.stdout:1/398: chown d5/d7/d23/d41/c43 79 1 2024-02-19T19:07:31.784 INFO:tasks.workunit.client.1.smithi142.stdout:5/294: creat d5/dd/d8/d29/f63 x:0 0 0 2024-02-19T19:07:31.784 INFO:tasks.workunit.client.1.smithi142.stdout:1/399: mknod d5/d7/c86 0 2024-02-19T19:07:31.785 INFO:tasks.workunit.client.1.smithi142.stdout:5/295: mkdir d5/dd/d8/d1c/d64 0 2024-02-19T19:07:31.785 INFO:tasks.workunit.client.1.smithi142.stdout:5/296: getdents d5/dd/df/d15/d5b 0 2024-02-19T19:07:31.786 INFO:tasks.workunit.client.1.smithi142.stdout:1/400: symlink d5/d7/d23/d2c/l87 0 2024-02-19T19:07:31.787 INFO:tasks.workunit.client.1.smithi142.stdout:5/297: rmdir d5/dd/df/d22/d41 39 2024-02-19T19:07:31.787 INFO:tasks.workunit.client.1.smithi142.stdout:5/298: write d5/f2c [2905327,102951] 0 2024-02-19T19:07:31.788 INFO:tasks.workunit.client.1.smithi142.stdout:5/299: link d5/dd/d8/d2a/f2d d5/dd/d5f/f65 0 2024-02-19T19:07:31.790 INFO:tasks.workunit.client.1.smithi142.stdout:5/300: rename d5/dd/df/d22/d41/f54 to d5/dd/d8/d31/d4d/d60/f66 0 2024-02-19T19:07:31.790 INFO:tasks.workunit.client.1.smithi142.stdout:5/301: dread - d5/dd/df/d22/f37 zero size 2024-02-19T19:07:31.790 INFO:tasks.workunit.client.1.smithi142.stdout:5/302: readlink d5/dd/d8/d29/l30 0 2024-02-19T19:07:31.790 INFO:tasks.workunit.client.1.smithi142.stdout:5/303: truncate d5/f24 1716258 0 2024-02-19T19:07:31.800 INFO:tasks.workunit.client.1.smithi142.stdout:1/401: dwrite d5/d7/d23/f45 [0,4194304] 0 2024-02-19T19:07:31.800 INFO:tasks.workunit.client.1.smithi142.stdout:1/402: write d5/d1a/d33/f4d [4835575,117843] 0 2024-02-19T19:07:31.800 INFO:tasks.workunit.client.1.smithi142.stdout:1/403: creat d5/d7/d34/d6f/f88 x:0 0 0 2024-02-19T19:07:31.800 INFO:tasks.workunit.client.1.smithi142.stdout:1/404: dread - d5/f4e zero size 2024-02-19T19:07:31.803 INFO:tasks.workunit.client.1.smithi142.stdout:1/405: creat d5/d37/d49/f89 x:0 0 0 2024-02-19T19:07:31.803 INFO:tasks.workunit.client.1.smithi142.stdout:1/406: stat d5/d37/f52 0 2024-02-19T19:07:31.803 INFO:tasks.workunit.client.1.smithi142.stdout:1/407: chown d5/d7/d23/d2c/f51 2 1 2024-02-19T19:07:31.803 INFO:tasks.workunit.client.1.smithi142.stdout:1/408: creat d5/d7/f8a x:0 0 0 2024-02-19T19:07:31.830 INFO:tasks.workunit.client.1.smithi142.stdout:6/208: dread d2/d1f/d20/f2c [0,4194304] 0 2024-02-19T19:07:31.837 INFO:tasks.workunit.client.1.smithi142.stdout:6/209: dread d2/d17/f19 [0,4194304] 0 2024-02-19T19:07:31.840 INFO:tasks.workunit.client.1.smithi142.stdout:4/348: dwrite d4/d1d/d42/d66/d12/d2d/f33 [0,4194304] 0 2024-02-19T19:07:31.840 INFO:tasks.workunit.client.1.smithi142.stdout:4/349: creat d4/d1d/d42/d66/d12/d2d/f75 x:0 0 0 2024-02-19T19:07:31.840 INFO:tasks.workunit.client.1.smithi142.stdout:6/210: rename d2/l1c to d2/d1e/d35/l3f 0 2024-02-19T19:07:31.844 INFO:tasks.workunit.client.1.smithi142.stdout:4/350: mknod d4/d1d/d42/d66/dd/c76 0 2024-02-19T19:07:31.845 INFO:tasks.workunit.client.1.smithi142.stdout:4/351: mknod d4/d1d/d42/d66/dd/d10/d3e/c77 0 2024-02-19T19:07:31.847 INFO:tasks.workunit.client.1.smithi142.stdout:4/352: link d4/d14/d31/d43/f48 d4/d1d/d42/d66/dd/d10/d3e/d68/f78 0 2024-02-19T19:07:31.847 INFO:tasks.workunit.client.1.smithi142.stdout:8/340: sync 2024-02-19T19:07:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:3/247: sync 2024-02-19T19:07:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:9/360: sync 2024-02-19T19:07:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:2/248: sync 2024-02-19T19:07:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:0/271: sync 2024-02-19T19:07:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:3/248: readlink d1d/l34 0 2024-02-19T19:07:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:8/341: fsync d9/dd/f5c 0 2024-02-19T19:07:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:7/212: sync 2024-02-19T19:07:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:8/342: read - d9/dd/f47 zero size 2024-02-19T19:07:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:7/213: chown d0/l37 278 1 2024-02-19T19:07:31.848 INFO:tasks.workunit.client.1.smithi142.stdout:3/249: write d1d/d1e/f23 [109562,61925] 0 2024-02-19T19:07:31.849 INFO:tasks.workunit.client.1.smithi142.stdout:4/353: mkdir d4/d1d/d42/d66/d12/d79 0 2024-02-19T19:07:31.851 INFO:tasks.workunit.client.1.smithi142.stdout:2/249: rename d3/l9 to d3/db/d29/d45/d46/l49 0 2024-02-19T19:07:31.852 INFO:tasks.workunit.client.1.smithi142.stdout:9/361: mknod db/d10/d27/d2f/d4c/c6b 0 2024-02-19T19:07:31.852 INFO:tasks.workunit.client.1.smithi142.stdout:9/362: chown db/d10/d32 358839 1 2024-02-19T19:07:31.852 INFO:tasks.workunit.client.1.smithi142.stdout:7/214: unlink d0/d1b/d21/f3f 0 2024-02-19T19:07:31.854 INFO:tasks.workunit.client.1.smithi142.stdout:4/354: creat d4/d1d/d42/f7a x:0 0 0 2024-02-19T19:07:31.854 INFO:tasks.workunit.client.1.smithi142.stdout:4/355: chown d4/d1d/d42/d66/d2c/f67 109492 1 2024-02-19T19:07:31.854 INFO:tasks.workunit.client.1.smithi142.stdout:4/356: fdatasync d4/d1d/d42/d66/d12/d2d/d2a/f4c 0 2024-02-19T19:07:31.856 INFO:tasks.workunit.client.1.smithi142.stdout:7/215: mkdir d0/d1b/d21/d24/d31/d47 0 2024-02-19T19:07:31.856 INFO:tasks.workunit.client.1.smithi142.stdout:9/363: mknod db/d10/c6c 0 2024-02-19T19:07:31.857 INFO:tasks.workunit.client.1.smithi142.stdout:9/364: readlink db/d10/d32/d3f/d5f/l65 0 2024-02-19T19:07:31.857 INFO:tasks.workunit.client.1.smithi142.stdout:9/365: creat db/d10/d27/f6d x:0 0 0 2024-02-19T19:07:31.857 INFO:tasks.workunit.client.1.smithi142.stdout:9/366: read - db/f68 zero size 2024-02-19T19:07:31.857 INFO:tasks.workunit.client.1.smithi142.stdout:9/367: chown db/d10/d27/d2f/d4c/f35 17076726 1 2024-02-19T19:07:31.861 INFO:tasks.workunit.client.1.smithi142.stdout:9/368: mknod db/d10/c6e 0 2024-02-19T19:07:31.861 INFO:tasks.workunit.client.1.smithi142.stdout:9/369: fdatasync db/d10/d27/f40 0 2024-02-19T19:07:31.861 INFO:tasks.workunit.client.1.smithi142.stdout:9/370: mknod db/d10/d27/c6f 0 2024-02-19T19:07:31.863 INFO:tasks.workunit.client.1.smithi142.stdout:8/343: dread d9/dd/de/d14/d65/d6c/f3a [0,4194304] 0 2024-02-19T19:07:31.863 INFO:tasks.workunit.client.1.smithi142.stdout:9/371: rmdir db/d10/d32/d33 39 2024-02-19T19:07:31.863 INFO:tasks.workunit.client.1.smithi142.stdout:3/250: dread f1 [0,4194304] 0 2024-02-19T19:07:31.864 INFO:tasks.workunit.client.1.smithi142.stdout:3/251: stat d1d/d1e/f32 0 2024-02-19T19:07:31.864 INFO:tasks.workunit.client.1.smithi142.stdout:9/372: write db/d10/d27/f40 [970617,120946] 0 2024-02-19T19:07:31.864 INFO:tasks.workunit.client.1.smithi142.stdout:9/373: chown db/d10/d22/d24/f3e 62939 1 2024-02-19T19:07:31.868 INFO:tasks.workunit.client.1.smithi142.stdout:6/211: dwrite d2/d1e/f2a [0,4194304] 0 2024-02-19T19:07:31.868 INFO:tasks.workunit.client.1.smithi142.stdout:6/212: truncate d2/d1e/f2a 4542036 0 2024-02-19T19:07:31.868 INFO:tasks.workunit.client.1.smithi142.stdout:2/250: dwrite d3/df/f10 [0,4194304] 0 2024-02-19T19:07:31.871 INFO:tasks.workunit.client.1.smithi142.stdout:6/213: mknod d2/d17/d33/d3c/c40 0 2024-02-19T19:07:31.872 INFO:tasks.workunit.client.1.smithi142.stdout:7/216: dread d0/d1b/d21/d24/f28 [0,4194304] 0 2024-02-19T19:07:31.874 INFO:tasks.workunit.client.1.smithi142.stdout:2/251: mkdir d3/db/d29/d45/d4a 0 2024-02-19T19:07:31.874 INFO:tasks.workunit.client.1.smithi142.stdout:2/252: chown d3 31028 1 2024-02-19T19:07:31.875 INFO:tasks.workunit.client.1.smithi142.stdout:6/214: symlink d2/d1f/d20/l41 0 2024-02-19T19:07:31.877 INFO:tasks.workunit.client.1.smithi142.stdout:7/217: mknod d0/d13/d1e/d22/c48 0 2024-02-19T19:07:31.883 INFO:tasks.workunit.client.1.smithi142.stdout:2/253: mkdir d3/d4b 0 2024-02-19T19:07:31.883 INFO:tasks.workunit.client.1.smithi142.stdout:2/254: chown d3/df/f32 174901088 1 2024-02-19T19:07:31.884 INFO:tasks.workunit.client.1.smithi142.stdout:6/215: mkdir d2/d17/d33/d42 0 2024-02-19T19:07:31.892 INFO:tasks.workunit.client.1.smithi142.stdout:2/255: dread d3/db/f3a [0,4194304] 0 2024-02-19T19:07:31.892 INFO:tasks.workunit.client.1.smithi142.stdout:2/256: readlink d3/df/l30 0 2024-02-19T19:07:31.892 INFO:tasks.workunit.client.1.smithi142.stdout:2/257: chown d3/db/f43 6739 1 2024-02-19T19:07:31.892 INFO:tasks.workunit.client.1.smithi142.stdout:2/258: write d3/df/f14 [565471,2860] 0 2024-02-19T19:07:31.899 INFO:tasks.workunit.client.1.smithi142.stdout:3/252: dwrite d1d/d36/f3b [0,4194304] 0 2024-02-19T19:07:31.900 INFO:tasks.workunit.client.1.smithi142.stdout:4/357: dwrite d4/d1d/d42/d66/dd/d10/f1f [0,4194304] 0 2024-02-19T19:07:31.900 INFO:tasks.workunit.client.1.smithi142.stdout:4/358: chown d4/d1c 53 1 2024-02-19T19:07:31.900 INFO:tasks.workunit.client.1.smithi142.stdout:4/359: chown d4/d1d/d42/d66/dd/d10/d26/d50/d54/c71 353501 1 2024-02-19T19:07:31.900 INFO:tasks.workunit.client.1.smithi142.stdout:8/344: dwrite d9/dd/d15/d31/f55 [0,4194304] 0 2024-02-19T19:07:31.900 INFO:tasks.workunit.client.1.smithi142.stdout:4/360: read - d4/d1d/d42/d66/d12/d2d/d2a/f6f zero size 2024-02-19T19:07:31.901 INFO:tasks.workunit.client.1.smithi142.stdout:3/253: rename f15 to d1d/d1e/d2e/d37/f4a 0 2024-02-19T19:07:31.902 INFO:tasks.workunit.client.1.smithi142.stdout:9/374: dwrite db/f18 [0,4194304] 0 2024-02-19T19:07:31.902 INFO:tasks.workunit.client.1.smithi142.stdout:9/375: write db/d10/d22/d24/f3c [2008401,102274] 0 2024-02-19T19:07:31.906 INFO:tasks.workunit.client.1.smithi142.stdout:3/254: truncate f19 4404557 0 2024-02-19T19:07:31.906 INFO:tasks.workunit.client.1.smithi142.stdout:3/255: write fa [4981817,7545] 0 2024-02-19T19:07:31.908 INFO:tasks.workunit.client.1.smithi142.stdout:7/218: dwrite d0/f16 [4194304,4194304] 0 2024-02-19T19:07:31.911 INFO:tasks.workunit.client.1.smithi142.stdout:8/345: read d9/dd/de/d2d/d2e/f3d [85900,73866] 0 2024-02-19T19:07:31.911 INFO:tasks.workunit.client.1.smithi142.stdout:8/346: readlink d9/dd/de/d14/d21/l5f 0 2024-02-19T19:07:31.911 INFO:tasks.workunit.client.1.smithi142.stdout:2/259: dwrite d3/db/f15 [0,4194304] 0 2024-02-19T19:07:31.911 INFO:tasks.workunit.client.1.smithi142.stdout:3/256: dread d1d/f2a [0,4194304] 0 2024-02-19T19:07:31.911 INFO:tasks.workunit.client.1.smithi142.stdout:3/257: truncate d1d/f2a 2743813 0 2024-02-19T19:07:31.911 INFO:tasks.workunit.client.1.smithi142.stdout:7/219: getdents d0/d13/d1e/d22 0 2024-02-19T19:07:31.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/216: getdents d2/d17/d33 0 2024-02-19T19:07:31.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/217: fdatasync d2/d1f/f30 0 2024-02-19T19:07:31.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/218: fdatasync d2/d17/f19 0 2024-02-19T19:07:31.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/219: write d2/f12 [3686781,16493] 0 2024-02-19T19:07:31.916 INFO:tasks.workunit.client.1.smithi142.stdout:8/347: mknod d9/dd/d15/d31/c6d 0 2024-02-19T19:07:31.916 INFO:tasks.workunit.client.1.smithi142.stdout:8/348: fdatasync d9/dd/d15/f22 0 2024-02-19T19:07:31.919 INFO:tasks.workunit.client.1.smithi142.stdout:2/260: unlink d3/db/f43 0 2024-02-19T19:07:31.920 INFO:tasks.workunit.client.1.smithi142.stdout:3/258: rmdir d1d/d1e/d2e/d37 39 2024-02-19T19:07:31.920 INFO:tasks.workunit.client.1.smithi142.stdout:3/259: chown l17 455 1 2024-02-19T19:07:31.920 INFO:tasks.workunit.client.1.smithi142.stdout:3/260: write d1d/d1e/f45 [131982,52563] 0 2024-02-19T19:07:31.920 INFO:tasks.workunit.client.1.smithi142.stdout:3/261: readlink d1d/l47 0 2024-02-19T19:07:31.921 INFO:tasks.workunit.client.1.smithi142.stdout:3/262: chown d1d/d1e/d2e/d37 7384 1 2024-02-19T19:07:31.923 INFO:tasks.workunit.client.1.smithi142.stdout:7/220: truncate d0/d1b/d21/d24/f30 915544 0 2024-02-19T19:07:31.924 INFO:tasks.workunit.client.1.smithi142.stdout:9/376: dwrite db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:31.925 INFO:tasks.workunit.client.1.smithi142.stdout:4/361: dwrite d4/f5 [0,4194304] 0 2024-02-19T19:07:31.925 INFO:tasks.workunit.client.1.smithi142.stdout:4/362: write d4/d1d/d42/d66/d12/f18 [781645,37388] 0 2024-02-19T19:07:31.926 INFO:tasks.workunit.client.1.smithi142.stdout:6/220: rename d2/d1f/d20/d31/l37 to d2/d1e/d35/l43 0 2024-02-19T19:07:31.926 INFO:tasks.workunit.client.1.smithi142.stdout:8/349: rmdir d9/dd/de/d2d/d2e/d49/d50 39 2024-02-19T19:07:31.936 INFO:tasks.workunit.client.1.smithi142.stdout:2/261: rename d3/db/d29/d45 to d3/db/d29/d4c 0 2024-02-19T19:07:31.936 INFO:tasks.workunit.client.1.smithi142.stdout:2/262: chown d3/db/f47 100291689 1 2024-02-19T19:07:31.938 INFO:tasks.workunit.client.1.smithi142.stdout:4/363: read d4/f5 [1394196,97065] 0 2024-02-19T19:07:31.938 INFO:tasks.workunit.client.1.smithi142.stdout:7/221: write d0/d13/f27 [4037813,59906] 0 2024-02-19T19:07:31.938 INFO:tasks.workunit.client.1.smithi142.stdout:7/222: dread - d0/d1b/d21/d24/d29/d2d/f3c zero size 2024-02-19T19:07:31.940 INFO:tasks.workunit.client.1.smithi142.stdout:3/263: dwrite d1d/f42 [4194304,4194304] 0 2024-02-19T19:07:31.940 INFO:tasks.workunit.client.1.smithi142.stdout:6/221: dread d2/f18 [0,4194304] 0 2024-02-19T19:07:31.942 INFO:tasks.workunit.client.1.smithi142.stdout:9/377: creat db/d10/d27/d2f/d4c/f70 x:0 0 0 2024-02-19T19:07:31.942 INFO:tasks.workunit.client.1.smithi142.stdout:9/378: chown db/d10/d27/d2f/d4c/d54/l4f 14420462 1 2024-02-19T19:07:31.944 INFO:tasks.workunit.client.1.smithi142.stdout:2/263: mkdir d3/d4d 0 2024-02-19T19:07:31.944 INFO:tasks.workunit.client.1.smithi142.stdout:5/304: sync 2024-02-19T19:07:31.947 INFO:tasks.workunit.client.1.smithi142.stdout:2/264: write d3/df/f21 [950998,112247] 0 2024-02-19T19:07:31.947 INFO:tasks.workunit.client.1.smithi142.stdout:2/265: write d3/f1f [1959069,52753] 0 2024-02-19T19:07:31.947 INFO:tasks.workunit.client.1.smithi142.stdout:6/222: mknod d2/d17/d33/c44 0 2024-02-19T19:07:31.949 INFO:tasks.workunit.client.1.smithi142.stdout:5/305: unlink d5/dd/d8/d1c/f3e 0 2024-02-19T19:07:31.950 INFO:tasks.workunit.client.1.smithi142.stdout:7/223: dread d0/f9 [0,4194304] 0 2024-02-19T19:07:31.951 INFO:tasks.workunit.client.1.smithi142.stdout:3/264: getdents d1d/d1e 0 2024-02-19T19:07:31.952 INFO:tasks.workunit.client.1.smithi142.stdout:7/224: dread d0/d1b/d21/d24/d29/f2c [0,4194304] 0 2024-02-19T19:07:31.952 INFO:tasks.workunit.client.1.smithi142.stdout:7/225: stat d0/d1b/d21/d24/d31/d47 0 2024-02-19T19:07:31.953 INFO:tasks.workunit.client.1.smithi142.stdout:2/266: mkdir d3/db/d29/d4c/d4e 0 2024-02-19T19:07:31.955 INFO:tasks.workunit.client.1.smithi142.stdout:3/265: creat d1d/d36/d3a/f4b x:0 0 0 2024-02-19T19:07:31.956 INFO:tasks.workunit.client.1.smithi142.stdout:3/266: truncate d1d/d1e/d2e/f43 4696018 0 2024-02-19T19:07:31.956 INFO:tasks.workunit.client.1.smithi142.stdout:3/267: readlink d1d/l34 0 2024-02-19T19:07:31.956 INFO:tasks.workunit.client.1.smithi142.stdout:4/364: dwrite d4/d1d/f35 [0,4194304] 0 2024-02-19T19:07:31.957 INFO:tasks.workunit.client.1.smithi142.stdout:7/226: mkdir d0/d1b/d21/d24/d29/d44/d49 0 2024-02-19T19:07:31.957 INFO:tasks.workunit.client.1.smithi142.stdout:6/223: write d2/d1f/f2b [14478,34301] 0 2024-02-19T19:07:31.959 INFO:tasks.workunit.client.1.smithi142.stdout:8/350: dwrite d9/dd/f17 [0,4194304] 0 2024-02-19T19:07:31.959 INFO:tasks.workunit.client.1.smithi142.stdout:8/351: chown d9/dd/de/d2d/d2e/d49/d50/d59/f6a 54836 1 2024-02-19T19:07:31.959 INFO:tasks.workunit.client.1.smithi142.stdout:2/267: rename d3/df/c2e to d3/db/d29/c4f 0 2024-02-19T19:07:31.962 INFO:tasks.workunit.client.1.smithi142.stdout:1/409: sync 2024-02-19T19:07:31.963 INFO:tasks.workunit.client.1.smithi142.stdout:5/306: dread d5/dd/d8/d31/f34 [0,4194304] 0 2024-02-19T19:07:31.963 INFO:tasks.workunit.client.1.smithi142.stdout:5/307: chown d5/dd/df/d22/d41/d32/d53 20890567 1 2024-02-19T19:07:31.965 INFO:tasks.workunit.client.1.smithi142.stdout:7/227: dread d0/d1b/d21/d24/f28 [0,4194304] 0 2024-02-19T19:07:31.965 INFO:tasks.workunit.client.1.smithi142.stdout:7/228: chown d0/d13/c3e 28 1 2024-02-19T19:07:31.965 INFO:tasks.workunit.client.1.smithi142.stdout:7/229: read d0/f16 [1430402,96881] 0 2024-02-19T19:07:31.966 INFO:tasks.workunit.client.1.smithi142.stdout:6/224: mkdir d2/d1f/d45 0 2024-02-19T19:07:31.973 INFO:tasks.workunit.client.1.smithi142.stdout:8/352: rename d9/dd/de/d14/f1a to d9/dd/de/d14/f6e 0 2024-02-19T19:07:31.973 INFO:tasks.workunit.client.1.smithi142.stdout:8/353: creat d9/dd/de/f6f x:0 0 0 2024-02-19T19:07:31.975 INFO:tasks.workunit.client.1.smithi142.stdout:2/268: rename d3/db/f25 to d3/d4d/f50 0 2024-02-19T19:07:31.976 INFO:tasks.workunit.client.1.smithi142.stdout:2/269: write d3/db/d29/f41 [3439056,89663] 0 2024-02-19T19:07:31.976 INFO:tasks.workunit.client.1.smithi142.stdout:4/365: dwrite d4/f5 [0,4194304] 0 2024-02-19T19:07:31.977 INFO:tasks.workunit.client.1.smithi142.stdout:4/366: write d4/d1d/d42/d66/dd/d10/d3b/d3f/f57 [33918,9715] 0 2024-02-19T19:07:31.977 INFO:tasks.workunit.client.1.smithi142.stdout:4/367: creat d4/d1d/d42/d66/dd/f7b x:0 0 0 2024-02-19T19:07:31.977 INFO:tasks.workunit.client.1.smithi142.stdout:4/368: truncate d4/d1d/d42/d66/d2c/f67 139491 0 2024-02-19T19:07:31.977 INFO:tasks.workunit.client.1.smithi142.stdout:4/369: fsync d4/d1d/d42/d66/dd/d10/d3e/d68/f78 0 2024-02-19T19:07:31.977 INFO:tasks.workunit.client.1.smithi142.stdout:4/370: creat d4/d1d/d42/d66/dd/f7c x:0 0 0 2024-02-19T19:07:31.977 INFO:tasks.workunit.client.1.smithi142.stdout:3/268: getdents d1d/d36/d3a 0 2024-02-19T19:07:31.979 INFO:tasks.workunit.client.1.smithi142.stdout:1/410: creat d5/d73/f8b x:0 0 0 2024-02-19T19:07:31.979 INFO:tasks.workunit.client.1.smithi142.stdout:1/411: creat d5/d7/d23/d2c/f8c x:0 0 0 2024-02-19T19:07:31.980 INFO:tasks.workunit.client.1.smithi142.stdout:1/412: stat d5/d7/d4a/d53/d6a 0 2024-02-19T19:07:31.981 INFO:tasks.workunit.client.1.smithi142.stdout:5/308: mkdir d5/dd/df/d67 0 2024-02-19T19:07:31.981 INFO:tasks.workunit.client.1.smithi142.stdout:5/309: creat d5/dd/f68 x:0 0 0 2024-02-19T19:07:31.981 INFO:tasks.workunit.client.1.smithi142.stdout:5/310: stat d5/dd/d8/d31/d4d/d60 0 2024-02-19T19:07:31.981 INFO:tasks.workunit.client.1.smithi142.stdout:5/311: write d5/dd/df/d22/d41/d32/f62 [3081003,16807] 0 2024-02-19T19:07:31.982 INFO:tasks.workunit.client.1.smithi142.stdout:7/230: unlink d0/d1b/c26 0 2024-02-19T19:07:31.984 INFO:tasks.workunit.client.1.smithi142.stdout:6/225: creat d2/d1f/d20/d31/d3d/d3e/f46 x:0 0 0 2024-02-19T19:07:31.984 INFO:tasks.workunit.client.1.smithi142.stdout:6/226: read d2/f12 [3580209,45890] 0 2024-02-19T19:07:31.986 INFO:tasks.workunit.client.1.smithi142.stdout:8/354: rename d9/dd/de/d14/f42 to d9/dd/de/d2d/d2e/d49/f70 0 2024-02-19T19:07:31.988 INFO:tasks.workunit.client.1.smithi142.stdout:2/270: creat d3/d4b/f51 x:0 0 0 2024-02-19T19:07:31.990 INFO:tasks.workunit.client.1.smithi142.stdout:3/269: dwrite d1d/d1e/d2e/f33 [0,4194304] 0 2024-02-19T19:07:31.991 INFO:tasks.workunit.client.1.smithi142.stdout:3/270: truncate d1d/d36/d3a/f4b 922017 0 2024-02-19T19:07:31.993 INFO:tasks.workunit.client.1.smithi142.stdout:7/231: mknod d0/d1b/d21/d24/d29/c4a 0 2024-02-19T19:07:31.994 INFO:tasks.workunit.client.1.smithi142.stdout:6/227: mkdir d2/d29/d47 0 2024-02-19T19:07:31.994 INFO:tasks.workunit.client.1.smithi142.stdout:6/228: read d2/f18 [2762775,48585] 0 2024-02-19T19:07:31.996 INFO:tasks.workunit.client.1.smithi142.stdout:5/312: rename d5/dd/df/d67 to d5/dd/df/d22/d41/d32/d53/d69 0 2024-02-19T19:07:31.997 INFO:tasks.workunit.client.1.smithi142.stdout:8/355: mknod d9/dd/d15/d31/c71 0 2024-02-19T19:07:31.998 INFO:tasks.workunit.client.1.smithi142.stdout:2/271: mkdir d3/db/d52 0 2024-02-19T19:07:31.999 INFO:tasks.workunit.client.1.smithi142.stdout:3/271: rmdir d1d/d1e 39 2024-02-19T19:07:32.001 INFO:tasks.workunit.client.1.smithi142.stdout:6/229: truncate d2/d1f/f30 2797816 0 2024-02-19T19:07:32.001 INFO:tasks.workunit.client.1.smithi142.stdout:7/232: write d0/f16 [4735565,74398] 0 2024-02-19T19:07:32.001 INFO:tasks.workunit.client.1.smithi142.stdout:7/233: readlink d0/d1b/d21/d24/d29/l2f 0 2024-02-19T19:07:32.002 INFO:tasks.workunit.client.1.smithi142.stdout:1/413: rmdir d5/d7/d23/d2c 39 2024-02-19T19:07:32.003 INFO:tasks.workunit.client.1.smithi142.stdout:1/414: fdatasync d5/d7/f4f 0 2024-02-19T19:07:32.003 INFO:tasks.workunit.client.1.smithi142.stdout:1/415: chown d5/c40 10 1 2024-02-19T19:07:32.004 INFO:tasks.workunit.client.1.smithi142.stdout:5/313: mkdir d5/dd/d5f/d6a 0 2024-02-19T19:07:32.004 INFO:tasks.workunit.client.1.smithi142.stdout:5/314: chown d5/dd/d8/d31/d4d/d60/f66 1261878 1 2024-02-19T19:07:32.010 INFO:tasks.workunit.client.1.smithi142.stdout:2/272: dread d3/db/f34 [0,4194304] 0 2024-02-19T19:07:32.010 INFO:tasks.workunit.client.1.smithi142.stdout:8/356: creat d9/dd/de/d2d/d2e/d49/d50/f72 x:0 0 0 2024-02-19T19:07:32.010 INFO:tasks.workunit.client.1.smithi142.stdout:6/230: link d2/d1f/c28 d2/d1f/d45/c48 0 2024-02-19T19:07:32.011 INFO:tasks.workunit.client.1.smithi142.stdout:6/231: dread - d2/d1f/d20/d31/d3d/d3e/f46 zero size 2024-02-19T19:07:32.011 INFO:tasks.workunit.client.1.smithi142.stdout:3/272: link f19 d1d/d1e/d2e/d37/f4c 0 2024-02-19T19:07:32.013 INFO:tasks.workunit.client.1.smithi142.stdout:6/232: creat d2/d17/d33/d39/f49 x:0 0 0 2024-02-19T19:07:32.013 INFO:tasks.workunit.client.1.smithi142.stdout:3/273: symlink d1d/d1e/l4d 0 2024-02-19T19:07:32.013 INFO:tasks.workunit.client.1.smithi142.stdout:2/273: mkdir d3/d35/d53 0 2024-02-19T19:07:32.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/274: mknod d1d/d36/d3a/c4e 0 2024-02-19T19:07:32.020 INFO:tasks.workunit.client.1.smithi142.stdout:2/274: rename d3/df/l38 to d3/d35/d53/l54 0 2024-02-19T19:07:32.020 INFO:tasks.workunit.client.1.smithi142.stdout:3/275: mknod d1d/d1e/d2e/c4f 0 2024-02-19T19:07:32.020 INFO:tasks.workunit.client.1.smithi142.stdout:3/276: chown d1d/d1e/d2e 29079676 1 2024-02-19T19:07:32.020 INFO:tasks.workunit.client.1.smithi142.stdout:6/233: write d2/d1f/d20/f2c [3171310,32477] 0 2024-02-19T19:07:32.021 INFO:tasks.workunit.client.1.smithi142.stdout:2/275: unlink d3/db/f23 0 2024-02-19T19:07:32.021 INFO:tasks.workunit.client.1.smithi142.stdout:3/277: mkdir d1d/d1e/d2e/d50 0 2024-02-19T19:07:32.022 INFO:tasks.workunit.client.1.smithi142.stdout:6/234: creat d2/d29/d47/f4a x:0 0 0 2024-02-19T19:07:32.022 INFO:tasks.workunit.client.1.smithi142.stdout:2/276: rmdir d3/d4d 39 2024-02-19T19:07:32.022 INFO:tasks.workunit.client.1.smithi142.stdout:2/277: chown d3/df/c39 3668119 1 2024-02-19T19:07:32.024 INFO:tasks.workunit.client.1.smithi142.stdout:3/278: symlink d1d/d36/l51 0 2024-02-19T19:07:32.024 INFO:tasks.workunit.client.1.smithi142.stdout:3/279: fsync d1d/d1e/d2e/f48 0 2024-02-19T19:07:32.025 INFO:tasks.workunit.client.1.smithi142.stdout:3/280: readlink lf 0 2024-02-19T19:07:32.026 INFO:tasks.workunit.client.1.smithi142.stdout:3/281: fsync f10 0 2024-02-19T19:07:32.027 INFO:tasks.workunit.client.1.smithi142.stdout:3/282: mkdir d1d/d36/d52 0 2024-02-19T19:07:32.051 INFO:tasks.workunit.client.1.smithi142.stdout:7/234: dwrite d0/fc [4194304,4194304] 0 2024-02-19T19:07:32.051 INFO:tasks.workunit.client.1.smithi142.stdout:8/357: dwrite d9/dd/d15/f56 [0,4194304] 0 2024-02-19T19:07:32.051 INFO:tasks.workunit.client.1.smithi142.stdout:1/416: dwrite d5/d37/d6c/f85 [0,4194304] 0 2024-02-19T19:07:32.051 INFO:tasks.workunit.client.1.smithi142.stdout:1/417: write d5/d37/d6c/f7c [462118,32335] 0 2024-02-19T19:07:32.053 INFO:tasks.workunit.client.1.smithi142.stdout:2/278: dwrite d3/f8 [0,4194304] 0 2024-02-19T19:07:32.053 INFO:tasks.workunit.client.1.smithi142.stdout:3/283: dwrite d1d/f2b [0,4194304] 0 2024-02-19T19:07:32.053 INFO:tasks.workunit.client.1.smithi142.stdout:3/284: truncate d1d/f41 870281 0 2024-02-19T19:07:32.058 INFO:tasks.workunit.client.1.smithi142.stdout:1/418: symlink d5/d73/l8d 0 2024-02-19T19:07:32.061 INFO:tasks.workunit.client.1.smithi142.stdout:2/279: rename d3/df/f21 to d3/db/d29/f55 0 2024-02-19T19:07:32.063 INFO:tasks.workunit.client.1.smithi142.stdout:3/285: creat d1d/d1e/f53 x:0 0 0 2024-02-19T19:07:32.070 INFO:tasks.workunit.client.1.smithi142.stdout:1/419: mknod d5/d37/d6c/c8e 0 2024-02-19T19:07:32.071 INFO:tasks.workunit.client.1.smithi142.stdout:8/358: dwrite d9/dd/f1d [0,4194304] 0 2024-02-19T19:07:32.071 INFO:tasks.workunit.client.1.smithi142.stdout:2/280: creat d3/db/d29/d4c/d46/f56 x:0 0 0 2024-02-19T19:07:32.072 INFO:tasks.workunit.client.1.smithi142.stdout:7/235: dwrite d0/d1b/d21/d24/d29/d2d/f3c [0,4194304] 0 2024-02-19T19:07:32.073 INFO:tasks.workunit.client.1.smithi142.stdout:7/236: stat d0/d1b/d21/d24/l39 0 2024-02-19T19:07:32.073 INFO:tasks.workunit.client.1.smithi142.stdout:7/237: write d0/d13/f15 [1609934,130175] 0 2024-02-19T19:07:32.073 INFO:tasks.workunit.client.1.smithi142.stdout:7/238: write d0/f2a [613461,53370] 0 2024-02-19T19:07:32.073 INFO:tasks.workunit.client.1.smithi142.stdout:7/239: readlink d0/l11 0 2024-02-19T19:07:32.073 INFO:tasks.workunit.client.1.smithi142.stdout:3/286: truncate d1d/d1e/f21 3554765 0 2024-02-19T19:07:32.074 INFO:tasks.workunit.client.1.smithi142.stdout:1/420: symlink d5/d37/d6c/l8f 0 2024-02-19T19:07:32.074 INFO:tasks.workunit.client.1.smithi142.stdout:8/359: dread d9/f46 [0,4194304] 0 2024-02-19T19:07:32.074 INFO:tasks.workunit.client.1.smithi142.stdout:2/281: truncate d3/db/d29/f55 1004454 0 2024-02-19T19:07:32.077 INFO:tasks.workunit.client.1.smithi142.stdout:7/240: getdents d0/d1b/d21 0 2024-02-19T19:07:32.078 INFO:tasks.workunit.client.1.smithi142.stdout:3/287: link d1d/d1e/d2e/f3f d1d/d36/d52/f54 0 2024-02-19T19:07:32.079 INFO:tasks.workunit.client.1.smithi142.stdout:1/421: rmdir d5/d1a 39 2024-02-19T19:07:32.080 INFO:tasks.workunit.client.1.smithi142.stdout:2/282: creat d3/d4d/f57 x:0 0 0 2024-02-19T19:07:32.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:31 smithi046 ceph-mon[88928]: osdmap e60: 6 total, 5 up, 6 in 2024-02-19T19:07:32.081 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:31 smithi046 podman[106371]: 2024-02-19 19:07:31.819091467 +0000 UTC m=+0.594853571 container remove a259c02271024bd9e28537b744f5a9f99a50e58c34f5bb78480e6ae1444ae017 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2) 2024-02-19T19:07:32.081 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:31 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-19T19:07:32.081 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:31 smithi046 systemd[1]: Stopped Ceph osd.1 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:07:32.081 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:31 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.1.service: Consumed 11.208s CPU time. 2024-02-19T19:07:32.082 INFO:tasks.workunit.client.1.smithi142.stdout:7/241: creat d0/d1b/d21/d24/d31/d47/f4b x:0 0 0 2024-02-19T19:07:32.083 INFO:tasks.workunit.client.1.smithi142.stdout:1/422: creat d5/d1a/d59/f90 x:0 0 0 2024-02-19T19:07:32.083 INFO:tasks.workunit.client.1.smithi142.stdout:1/423: creat d5/d73/f91 x:0 0 0 2024-02-19T19:07:32.084 INFO:tasks.workunit.client.1.smithi142.stdout:2/283: stat d3/db/l3e 0 2024-02-19T19:07:32.084 INFO:tasks.workunit.client.1.smithi142.stdout:2/284: stat d3/f8 0 2024-02-19T19:07:32.086 INFO:tasks.workunit.client.1.smithi142.stdout:3/288: write f19 [3243309,15078] 0 2024-02-19T19:07:32.086 INFO:tasks.workunit.client.1.smithi142.stdout:7/242: creat d0/d1b/d21/f4c x:0 0 0 2024-02-19T19:07:32.088 INFO:tasks.workunit.client.1.smithi142.stdout:7/243: symlink d0/d1b/d21/d24/l4d 0 2024-02-19T19:07:32.090 INFO:tasks.workunit.client.1.smithi142.stdout:2/285: write d3/f17 [1992693,32476] 0 2024-02-19T19:07:32.090 INFO:tasks.workunit.client.1.smithi142.stdout:2/286: creat d3/d4b/f58 x:0 0 0 2024-02-19T19:07:32.092 INFO:tasks.workunit.client.1.smithi142.stdout:8/360: dwrite d9/dd/f1c [4194304,4194304] 0 2024-02-19T19:07:32.093 INFO:tasks.workunit.client.1.smithi142.stdout:2/287: mkdir d3/db/d29/d4c/d46/d59 0 2024-02-19T19:07:32.093 INFO:tasks.workunit.client.1.smithi142.stdout:2/288: chown d3/db/d29/c33 8236835 1 2024-02-19T19:07:32.093 INFO:tasks.workunit.client.1.smithi142.stdout:2/289: readlink d3/db/d29/d4c/d46/l49 0 2024-02-19T19:07:32.098 INFO:tasks.workunit.client.1.smithi142.stdout:3/289: dread fa [0,4194304] 0 2024-02-19T19:07:32.098 INFO:tasks.workunit.client.1.smithi142.stdout:3/290: creat d1d/d1e/f55 x:0 0 0 2024-02-19T19:07:32.110 INFO:tasks.workunit.client.1.smithi142.stdout:2/290: write d3/f8 [1795942,111556] 0 2024-02-19T19:07:32.113 INFO:tasks.workunit.client.1.smithi142.stdout:3/291: read d1d/d36/f3b [7508344,107907] 0 2024-02-19T19:07:32.114 INFO:tasks.workunit.client.1.smithi142.stdout:3/292: readlink d1d/d1e/l4d 0 2024-02-19T19:07:32.114 INFO:tasks.workunit.client.1.smithi142.stdout:3/293: write f1c [723032,125870] 0 2024-02-19T19:07:32.114 INFO:tasks.workunit.client.1.smithi142.stdout:2/291: fsync d3/d4d/f57 0 2024-02-19T19:07:32.115 INFO:tasks.workunit.client.1.smithi142.stdout:1/424: dwrite d5/d7/d4a/f81 [0,4194304] 0 2024-02-19T19:07:32.115 INFO:tasks.workunit.client.1.smithi142.stdout:7/244: dwrite d0/f19 [0,4194304] 0 2024-02-19T19:07:32.118 INFO:tasks.workunit.client.1.smithi142.stdout:3/294: dread d1d/f38 [0,4194304] 0 2024-02-19T19:07:32.119 INFO:tasks.workunit.client.1.smithi142.stdout:1/425: unlink d5/d7/d23/d2c/l87 0 2024-02-19T19:07:32.124 INFO:tasks.workunit.client.1.smithi142.stdout:3/295: write f18 [5363114,93086] 0 2024-02-19T19:07:32.126 INFO:tasks.workunit.client.1.smithi142.stdout:2/292: link d3/db/l24 d3/d35/l5a 0 2024-02-19T19:07:32.128 INFO:tasks.workunit.client.1.smithi142.stdout:7/245: symlink d0/d1b/d21/d24/d29/d44/d49/l4e 0 2024-02-19T19:07:32.131 INFO:tasks.workunit.client.1.smithi142.stdout:1/426: rename d5/d7/d34/l3d to d5/d37/d49/l92 0 2024-02-19T19:07:32.132 INFO:tasks.workunit.client.1.smithi142.stdout:3/296: creat d1d/d36/d52/f56 x:0 0 0 2024-02-19T19:07:32.134 INFO:tasks.workunit.client.1.smithi142.stdout:1/427: rmdir d5/d1a 39 2024-02-19T19:07:32.134 INFO:tasks.workunit.client.1.smithi142.stdout:7/246: dread d0/d1b/d21/d24/f28 [0,4194304] 0 2024-02-19T19:07:32.136 INFO:tasks.workunit.client.1.smithi142.stdout:3/297: mkdir d1d/d36/d3a/d57 0 2024-02-19T19:07:32.136 INFO:tasks.workunit.client.1.smithi142.stdout:3/298: creat d1d/d1e/f58 x:0 0 0 2024-02-19T19:07:32.136 INFO:tasks.workunit.client.1.smithi142.stdout:3/299: write d1d/d1e/f58 [848047,78315] 0 2024-02-19T19:07:32.138 INFO:tasks.workunit.client.1.smithi142.stdout:3/300: creat d1d/d36/d3a/d57/f59 x:0 0 0 2024-02-19T19:07:32.147 INFO:tasks.workunit.client.1.smithi142.stdout:1/428: dread d5/d1a/f3a [0,4194304] 0 2024-02-19T19:07:32.147 INFO:tasks.workunit.client.1.smithi142.stdout:1/429: fdatasync d5/d73/f91 0 2024-02-19T19:07:32.148 INFO:tasks.workunit.client.1.smithi142.stdout:1/430: creat d5/d37/f93 x:0 0 0 2024-02-19T19:07:32.148 INFO:tasks.workunit.client.1.smithi142.stdout:1/431: creat d5/d7/d4a/f94 x:0 0 0 2024-02-19T19:07:32.149 INFO:tasks.workunit.client.1.smithi142.stdout:1/432: mknod d5/d37/d6c/c95 0 2024-02-19T19:07:32.149 INFO:tasks.workunit.client.1.smithi142.stdout:1/433: chown d5/d7/l6d 30189 1 2024-02-19T19:07:32.151 INFO:tasks.workunit.client.1.smithi142.stdout:2/293: dwrite d3/f16 [0,4194304] 0 2024-02-19T19:07:32.152 INFO:tasks.workunit.client.1.smithi142.stdout:2/294: truncate d3/db/d29/d4c/d46/f56 887300 0 2024-02-19T19:07:32.152 INFO:tasks.workunit.client.1.smithi142.stdout:7/247: dwrite d0/fc [8388608,4194304] 0 2024-02-19T19:07:32.153 INFO:tasks.workunit.client.1.smithi142.stdout:2/295: mknod d3/db/d29/d4c/d4e/c5b 0 2024-02-19T19:07:32.155 INFO:tasks.workunit.client.1.smithi142.stdout:3/301: dread d1d/d1e/f49 [0,4194304] 0 2024-02-19T19:07:32.155 INFO:tasks.workunit.client.1.smithi142.stdout:3/302: write d1d/f35 [951136,64497] 0 2024-02-19T19:07:32.155 INFO:tasks.workunit.client.1.smithi142.stdout:1/434: rename d5/d37/d49/l92 to d5/d7/l96 0 2024-02-19T19:07:32.157 INFO:tasks.workunit.client.1.smithi142.stdout:1/435: unlink d5/d7/c70 0 2024-02-19T19:07:32.157 INFO:tasks.workunit.client.1.smithi142.stdout:3/303: dread f10 [0,4194304] 0 2024-02-19T19:07:32.159 INFO:tasks.workunit.client.1.smithi142.stdout:2/296: dread d3/db/f47 [0,4194304] 0 2024-02-19T19:07:32.159 INFO:tasks.workunit.client.1.smithi142.stdout:2/297: dread - d3/df/f31 zero size 2024-02-19T19:07:32.160 INFO:tasks.workunit.client.1.smithi142.stdout:2/298: creat d3/d35/f5c x:0 0 0 2024-02-19T19:07:32.161 INFO:tasks.workunit.client.1.smithi142.stdout:1/436: dread d5/d7/d4a/d53/d6a/f63 [0,4194304] 0 2024-02-19T19:07:32.161 INFO:tasks.workunit.client.1.smithi142.stdout:2/299: creat d3/db/d29/f5d x:0 0 0 2024-02-19T19:07:32.162 INFO:tasks.workunit.client.1.smithi142.stdout:2/300: mkdir d3/db/d5e 0 2024-02-19T19:07:32.175 INFO:tasks.workunit.client.1.smithi142.stdout:2/301: dread d3/db/fc [4194304,4194304] 0 2024-02-19T19:07:32.175 INFO:tasks.workunit.client.1.smithi142.stdout:7/248: dwrite d0/fd [0,4194304] 0 2024-02-19T19:07:32.179 INFO:tasks.workunit.client.1.smithi142.stdout:3/304: dwrite d1d/d36/d52/f54 [0,4194304] 0 2024-02-19T19:07:32.179 INFO:tasks.workunit.client.1.smithi142.stdout:3/305: write d1d/d1e/f23 [608142,115144] 0 2024-02-19T19:07:32.182 INFO:tasks.workunit.client.1.smithi142.stdout:7/249: dread d0/d13/f15 [0,4194304] 0 2024-02-19T19:07:32.182 INFO:tasks.workunit.client.1.smithi142.stdout:7/250: creat d0/d1b/d21/d24/d31/f4f x:0 0 0 2024-02-19T19:07:32.183 INFO:tasks.workunit.client.1.smithi142.stdout:3/306: mkdir d1d/d36/d52/d5a 0 2024-02-19T19:07:32.186 INFO:tasks.workunit.client.1.smithi142.stdout:7/251: mkdir d0/d1b/d21/d24/d50 0 2024-02-19T19:07:32.188 INFO:tasks.workunit.client.1.smithi142.stdout:2/302: dwrite d3/df/f12 [4194304,4194304] 0 2024-02-19T19:07:32.188 INFO:tasks.workunit.client.1.smithi142.stdout:3/307: dread fa [0,4194304] 0 2024-02-19T19:07:32.189 INFO:tasks.workunit.client.1.smithi142.stdout:2/303: mkdir d3/d4d/d5f 0 2024-02-19T19:07:32.190 INFO:tasks.workunit.client.1.smithi142.stdout:2/304: symlink d3/d4d/d5f/l60 0 2024-02-19T19:07:32.200 INFO:tasks.workunit.client.1.smithi142.stdout:7/252: dwrite d0/f19 [0,4194304] 0 2024-02-19T19:07:32.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:31 smithi142 ceph-mon[69118]: osdmap e60: 6 total, 5 up, 6 in 2024-02-19T19:07:32.202 INFO:tasks.workunit.client.1.smithi142.stdout:7/253: mkdir d0/d13/d51 0 2024-02-19T19:07:32.202 INFO:tasks.workunit.client.1.smithi142.stdout:7/254: chown d0/d1b/d21/d24/d31 28678724 1 2024-02-19T19:07:32.211 INFO:tasks.workunit.client.1.smithi142.stdout:3/308: dwrite d1d/f41 [0,4194304] 0 2024-02-19T19:07:32.211 INFO:tasks.workunit.client.1.smithi142.stdout:3/309: fdatasync d1d/f2b 0 2024-02-19T19:07:32.212 INFO:tasks.workunit.client.1.smithi142.stdout:3/310: mknod d1d/d1e/d2e/d50/c5b 0 2024-02-19T19:07:32.214 INFO:tasks.workunit.client.1.smithi142.stdout:3/311: dread d1d/f38 [0,4194304] 0 2024-02-19T19:07:32.214 INFO:tasks.workunit.client.1.smithi142.stdout:3/312: readlink d1d/l2d 0 2024-02-19T19:07:32.214 INFO:tasks.workunit.client.1.smithi142.stdout:3/313: write f10 [727156,122940] 0 2024-02-19T19:07:32.238 INFO:tasks.workunit.client.1.smithi142.stdout:3/314: dwrite d1d/f41 [0,4194304] 0 2024-02-19T19:07:32.239 INFO:tasks.workunit.client.1.smithi142.stdout:3/315: unlink d1d/d1e/f45 0 2024-02-19T19:07:32.240 INFO:tasks.workunit.client.1.smithi142.stdout:3/316: write fa [1210455,28] 0 2024-02-19T19:07:32.253 INFO:tasks.workunit.client.1.smithi142.stdout:3/317: dwrite d1d/f2a [0,4194304] 0 2024-02-19T19:07:32.254 INFO:tasks.workunit.client.1.smithi142.stdout:3/318: creat d1d/d36/f5c x:0 0 0 2024-02-19T19:07:32.254 INFO:tasks.workunit.client.1.smithi142.stdout:3/319: creat d1d/d1e/f5d x:0 0 0 2024-02-19T19:07:32.257 INFO:tasks.workunit.client.1.smithi142.stdout:3/320: symlink d1d/d1e/d2e/l5e 0 2024-02-19T19:07:32.257 INFO:tasks.workunit.client.1.smithi142.stdout:3/321: fdatasync d1d/f2b 0 2024-02-19T19:07:32.258 INFO:tasks.workunit.client.1.smithi142.stdout:3/322: unlink d1d/f38 0 2024-02-19T19:07:32.258 INFO:tasks.workunit.client.1.smithi142.stdout:3/323: readlink d1d/l2d 0 2024-02-19T19:07:32.270 INFO:tasks.workunit.client.1.smithi142.stdout:3/324: dwrite d1d/f2c [0,4194304] 0 2024-02-19T19:07:32.272 INFO:tasks.workunit.client.1.smithi142.stdout:3/325: mknod d1d/d36/c5f 0 2024-02-19T19:07:32.273 INFO:tasks.workunit.client.1.smithi142.stdout:3/326: rename d1d/l34 to d1d/d1e/d2e/d50/l60 0 2024-02-19T19:07:32.273 INFO:tasks.workunit.client.1.smithi142.stdout:3/327: chown d1d/l31 30 1 2024-02-19T19:07:32.274 INFO:tasks.workunit.client.1.smithi142.stdout:3/328: symlink d1d/l61 0 2024-02-19T19:07:32.274 INFO:tasks.workunit.client.1.smithi142.stdout:3/329: read f10 [212173,118155] 0 2024-02-19T19:07:32.276 INFO:tasks.workunit.client.1.smithi142.stdout:3/330: mkdir d1d/d36/d3a/d62 0 2024-02-19T19:07:32.276 INFO:tasks.workunit.client.1.smithi142.stdout:3/331: read fa [4098624,41586] 0 2024-02-19T19:07:32.276 INFO:tasks.workunit.client.1.smithi142.stdout:3/332: fsync d1d/d36/d52/f54 0 2024-02-19T19:07:32.276 INFO:tasks.workunit.client.1.smithi142.stdout:3/333: creat d1d/d1e/d2e/f63 x:0 0 0 2024-02-19T19:07:32.276 INFO:tasks.workunit.client.1.smithi142.stdout:3/334: truncate d1d/d36/d3a/f4b 1274145 0 2024-02-19T19:07:32.276 INFO:tasks.workunit.client.1.smithi142.stdout:3/335: readlink l17 0 2024-02-19T19:07:32.287 INFO:tasks.workunit.client.1.smithi142.stdout:3/336: dwrite d1d/d1e/f5d [0,4194304] 0 2024-02-19T19:07:32.289 INFO:tasks.workunit.client.1.smithi142.stdout:3/337: unlink d1d/f2a 0 2024-02-19T19:07:32.309 INFO:tasks.workunit.client.1.smithi142.stdout:3/338: dwrite fa [0,4194304] 0 2024-02-19T19:07:32.325 INFO:tasks.workunit.client.1.smithi142.stdout:3/339: dwrite d1d/d1e/d2e/f63 [0,4194304] 0 2024-02-19T19:07:32.327 INFO:tasks.workunit.client.1.smithi142.stdout:3/340: creat d1d/d1e/d2e/d37/f64 x:0 0 0 2024-02-19T19:07:32.328 INFO:tasks.workunit.client.1.smithi142.stdout:3/341: mknod d1d/d1e/c65 0 2024-02-19T19:07:32.329 INFO:tasks.workunit.client.1.smithi142.stdout:3/342: creat d1d/d36/d3a/f66 x:0 0 0 2024-02-19T19:07:32.330 INFO:tasks.workunit.client.1.smithi142.stdout:3/343: chown f1 104925552 1 2024-02-19T19:07:32.343 INFO:tasks.workunit.client.1.smithi142.stdout:3/344: dwrite f19 [0,4194304] 0 2024-02-19T19:07:32.353 INFO:tasks.workunit.client.1.smithi142.stdout:3/345: write f9 [2769805,90768] 0 2024-02-19T19:07:32.355 INFO:tasks.workunit.client.1.smithi142.stdout:3/346: creat d1d/d1e/d2e/d50/f67 x:0 0 0 2024-02-19T19:07:32.357 INFO:tasks.workunit.client.1.smithi142.stdout:3/347: read f13 [479362,73102] 0 2024-02-19T19:07:32.357 INFO:tasks.workunit.client.1.smithi142.stdout:3/348: creat d1d/d36/d3a/f68 x:0 0 0 2024-02-19T19:07:32.357 INFO:tasks.workunit.client.1.smithi142.stdout:3/349: fsync d1d/d1e/d2e/d37/f4c 0 2024-02-19T19:07:32.357 INFO:tasks.workunit.client.1.smithi142.stdout:3/350: creat d1d/d1e/d2e/d50/f69 x:0 0 0 2024-02-19T19:07:32.358 INFO:tasks.workunit.client.1.smithi142.stdout:3/351: symlink d1d/d36/d3a/d62/l6a 0 2024-02-19T19:07:32.360 INFO:tasks.workunit.client.1.smithi142.stdout:3/352: rmdir d1d/d36/d3a/d57 39 2024-02-19T19:07:32.360 INFO:tasks.workunit.client.1.smithi142.stdout:3/353: creat d1d/d1e/f6b x:0 0 0 2024-02-19T19:07:32.362 INFO:tasks.workunit.client.1.smithi142.stdout:3/354: mkdir d1d/d1e/d2e/d37/d6c 0 2024-02-19T19:07:32.363 INFO:tasks.workunit.client.1.smithi142.stdout:3/355: creat d1d/d36/d52/d5a/f6d x:0 0 0 2024-02-19T19:07:32.364 INFO:tasks.workunit.client.1.smithi142.stdout:3/356: mkdir d1d/d1e/d6e 0 2024-02-19T19:07:32.380 INFO:tasks.workunit.client.1.smithi142.stdout:3/357: dwrite f13 [0,4194304] 0 2024-02-19T19:07:32.395 INFO:tasks.workunit.client.1.smithi142.stdout:3/358: dwrite f5 [0,4194304] 0 2024-02-19T19:07:32.396 INFO:tasks.workunit.client.1.smithi142.stdout:3/359: creat d1d/d1e/d6e/f6f x:0 0 0 2024-02-19T19:07:32.412 INFO:tasks.workunit.client.1.smithi142.stdout:3/360: dwrite d1d/d1e/d2e/d37/f4c [4194304,4194304] 0 2024-02-19T19:07:32.412 INFO:tasks.workunit.client.1.smithi142.stdout:3/361: write d1d/d1e/f53 [898586,15706] 0 2024-02-19T19:07:32.426 INFO:tasks.workunit.client.1.smithi142.stdout:3/362: dwrite d1d/d1e/d2e/d50/f67 [0,4194304] 0 2024-02-19T19:07:32.440 INFO:tasks.workunit.client.1.smithi142.stdout:3/363: dwrite d1d/d1e/f53 [0,4194304] 0 2024-02-19T19:07:32.440 INFO:tasks.workunit.client.1.smithi142.stdout:3/364: chown d1d/d36/d3a/f66 555 1 2024-02-19T19:07:32.441 INFO:tasks.workunit.client.1.smithi142.stdout:3/365: truncate d1d/d1e/d2e/f63 3833057 0 2024-02-19T19:07:32.442 INFO:tasks.workunit.client.1.smithi142.stdout:3/366: getdents d1d/d1e/d2e/d37/d6c 0 2024-02-19T19:07:32.442 INFO:tasks.workunit.client.1.smithi142.stdout:3/367: chown d1d/d1e/d2e/c4f 12 1 2024-02-19T19:07:32.449 INFO:tasks.workunit.client.1.smithi142.stdout:3/368: write d1d/d1e/d2e/d37/f4a [7772568,105743] 0 2024-02-19T19:07:32.450 INFO:tasks.workunit.client.1.smithi142.stdout:3/369: mknod d1d/d1e/d6e/c70 0 2024-02-19T19:07:32.450 INFO:tasks.workunit.client.1.smithi142.stdout:3/370: truncate d1d/d1e/f58 49821 0 2024-02-19T19:07:32.450 INFO:tasks.workunit.client.1.smithi142.stdout:3/371: truncate d1d/d36/d3a/f4b 1769969 0 2024-02-19T19:07:32.459 INFO:tasks.workunit.client.1.smithi142.stdout:3/372: dread d1d/f2b [0,4194304] 0 2024-02-19T19:07:32.470 INFO:tasks.workunit.client.1.smithi142.stdout:3/373: dwrite d1d/d36/d3a/d57/f59 [0,4194304] 0 2024-02-19T19:07:32.472 INFO:tasks.workunit.client.1.smithi142.stdout:3/374: mkdir d1d/d36/d52/d71 0 2024-02-19T19:07:32.472 INFO:tasks.workunit.client.1.smithi142.stdout:3/375: creat d1d/d1e/d6e/f72 x:0 0 0 2024-02-19T19:07:32.474 INFO:tasks.workunit.client.1.smithi142.stdout:3/376: unlink d1d/d36/d3a/f66 0 2024-02-19T19:07:32.481 INFO:tasks.workunit.client.1.smithi142.stdout:3/377: write d1d/d1e/d2e/d50/f67 [360044,117769] 0 2024-02-19T19:07:32.481 INFO:tasks.workunit.client.1.smithi142.stdout:3/378: stat d1d/d1e/l2f 0 2024-02-19T19:07:32.481 INFO:tasks.workunit.client.1.smithi142.stdout:3/379: read d1d/d36/f3d [4967392,25748] 0 2024-02-19T19:07:32.481 INFO:tasks.workunit.client.1.smithi142.stdout:3/380: stat d1d/d1e/f5d 0 2024-02-19T19:07:32.481 INFO:tasks.workunit.client.1.smithi142.stdout:3/381: write d1d/d1e/d2e/f46 [588212,52458] 0 2024-02-19T19:07:32.482 INFO:tasks.workunit.client.1.smithi142.stdout:3/382: mknod d1d/d1e/d2e/c73 0 2024-02-19T19:07:32.482 INFO:tasks.workunit.client.1.smithi142.stdout:3/383: symlink d1d/d1e/l74 0 2024-02-19T19:07:32.484 INFO:tasks.workunit.client.1.smithi142.stdout:3/384: unlink d1d/d1e/d2e/d50/l60 0 2024-02-19T19:07:32.484 INFO:tasks.workunit.client.1.smithi142.stdout:3/385: truncate d1d/d1e/d2e/d37/f64 313081 0 2024-02-19T19:07:32.485 INFO:tasks.workunit.client.1.smithi142.stdout:3/386: symlink d1d/d36/d52/l75 0 2024-02-19T19:07:32.493 INFO:tasks.workunit.client.1.smithi142.stdout:3/387: write d1d/d36/d52/f54 [1730772,51973] 0 2024-02-19T19:07:32.507 INFO:tasks.workunit.client.1.smithi142.stdout:3/388: dwrite f19 [0,4194304] 0 2024-02-19T19:07:32.507 INFO:tasks.workunit.client.1.smithi142.stdout:3/389: mknod d1d/c76 0 2024-02-19T19:07:32.508 INFO:tasks.workunit.client.1.smithi142.stdout:3/390: fsync d1d/d1e/d2e/d50/f69 0 2024-02-19T19:07:32.508 INFO:tasks.workunit.client.1.smithi142.stdout:3/391: symlink d1d/d36/d3a/d62/l77 0 2024-02-19T19:07:32.508 INFO:tasks.workunit.client.1.smithi142.stdout:3/392: chown d1d/d1e/d2e/d37/f64 705 1 2024-02-19T19:07:32.510 INFO:tasks.workunit.client.1.smithi142.stdout:3/393: dread f1c [0,4194304] 0 2024-02-19T19:07:32.511 INFO:tasks.workunit.client.1.smithi142.stdout:3/394: creat d1d/d1e/d2e/f78 x:0 0 0 2024-02-19T19:07:32.518 INFO:tasks.workunit.client.1.smithi142.stdout:3/395: read d1d/d1e/f21 [1232283,43590] 0 2024-02-19T19:07:32.518 INFO:tasks.workunit.client.1.smithi142.stdout:3/396: fsync d1d/f22 0 2024-02-19T19:07:32.519 INFO:tasks.workunit.client.1.smithi142.stdout:3/397: rename d1d/d36/d3a/c3c to d1d/d36/c79 0 2024-02-19T19:07:32.520 INFO:tasks.workunit.client.1.smithi142.stdout:3/398: link lf d1d/d1e/d6e/l7a 0 2024-02-19T19:07:32.520 INFO:tasks.workunit.client.1.smithi142.stdout:3/399: chown d1d/d1e/d2e/d37/f4a 9014 1 2024-02-19T19:07:32.527 INFO:tasks.workunit.client.1.smithi142.stdout:3/400: write f9 [1353099,68135] 0 2024-02-19T19:07:32.528 INFO:tasks.workunit.client.1.smithi142.stdout:3/401: creat d1d/d1e/d2e/d37/d6c/f7b x:0 0 0 2024-02-19T19:07:32.528 INFO:tasks.workunit.client.1.smithi142.stdout:3/402: chown d1d/d1e/d2e/f63 848 1 2024-02-19T19:07:32.528 INFO:tasks.workunit.client.1.smithi142.stdout:3/403: chown d1d/d1e/d2e/d37/d6c 3642 1 2024-02-19T19:07:32.531 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:32 smithi046 systemd[1]: Starting Ceph osd.1 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:07:32.532 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:32 smithi046 podman[106474]: 2024-02-19 19:07:32.245015633 +0000 UTC m=+0.023092735 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:07:32.532 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:32 smithi046 podman[106474]: 2024-02-19 19:07:32.511980178 +0000 UTC m=+0.290057272 container create acb7edc764a05788532b11ffa80f7655937e7d178c7852901d96880340fd3c2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:07:32.552 INFO:tasks.workunit.client.1.smithi142.stdout:3/404: dwrite d1d/d1e/d2e/f33 [4194304,4194304] 0 2024-02-19T19:07:32.561 INFO:tasks.workunit.client.1.smithi142.stdout:3/405: write d1d/d1e/f53 [2786663,112293] 0 2024-02-19T19:07:32.562 INFO:tasks.workunit.client.1.smithi142.stdout:3/406: mkdir d1d/d1e/d2e/d50/d7c 0 2024-02-19T19:07:32.562 INFO:tasks.workunit.client.1.smithi142.stdout:3/407: chown d1d 95601788 1 2024-02-19T19:07:32.562 INFO:tasks.workunit.client.1.smithi142.stdout:3/408: read - d1d/d1e/d2e/d37/d6c/f7b zero size 2024-02-19T19:07:32.574 INFO:tasks.workunit.client.1.smithi142.stdout:3/409: dwrite d1d/d1e/d2e/d37/f4c [0,4194304] 0 2024-02-19T19:07:32.575 INFO:tasks.workunit.client.1.smithi142.stdout:3/410: truncate d1d/f22 3289282 0 2024-02-19T19:07:32.576 INFO:tasks.workunit.client.1.smithi142.stdout:3/411: fsync d1d/d1e/d6e/f72 0 2024-02-19T19:07:32.584 INFO:tasks.workunit.client.1.smithi142.stdout:3/412: write d1d/f2c [883289,87750] 0 2024-02-19T19:07:32.586 INFO:tasks.workunit.client.1.smithi142.stdout:3/413: dread d1d/d1e/f58 [0,4194304] 0 2024-02-19T19:07:32.587 INFO:tasks.workunit.client.1.smithi142.stdout:3/414: symlink d1d/d36/d3a/d62/l7d 0 2024-02-19T19:07:32.587 INFO:tasks.workunit.client.1.smithi142.stdout:3/415: chown d1d/d1e/d2e/d50 77453 1 2024-02-19T19:07:32.587 INFO:tasks.workunit.client.1.smithi142.stdout:3/416: creat d1d/d1e/d2e/f7e x:0 0 0 2024-02-19T19:07:32.606 INFO:tasks.workunit.client.1.smithi142.stdout:3/417: dwrite fa [0,4194304] 0 2024-02-19T19:07:32.614 INFO:tasks.workunit.client.1.smithi142.stdout:3/418: write d1d/f42 [422394,69622] 0 2024-02-19T19:07:32.619 INFO:tasks.workunit.client.1.smithi142.stdout:3/419: truncate f5 1854215 0 2024-02-19T19:07:32.620 INFO:tasks.workunit.client.1.smithi142.stdout:3/420: link l17 d1d/d36/d3a/d62/l7f 0 2024-02-19T19:07:32.622 INFO:tasks.workunit.client.1.smithi142.stdout:3/421: rmdir d1d/d1e/d6e 39 2024-02-19T19:07:32.623 INFO:tasks.workunit.client.1.smithi142.stdout:3/422: creat d1d/d36/d52/d71/f80 x:0 0 0 2024-02-19T19:07:32.624 INFO:tasks.workunit.client.1.smithi142.stdout:3/423: fsync d1d/d36/d3a/d57/f59 0 2024-02-19T19:07:32.624 INFO:tasks.workunit.client.1.smithi142.stdout:3/424: write d1d/d1e/d2e/f78 [524486,41730] 0 2024-02-19T19:07:32.624 INFO:tasks.workunit.client.1.smithi142.stdout:3/425: write d1d/d1e/f55 [341581,81206] 0 2024-02-19T19:07:32.624 INFO:tasks.workunit.client.1.smithi142.stdout:3/426: write d1d/d1e/f6b [459227,51963] 0 2024-02-19T19:07:32.625 INFO:tasks.workunit.client.1.smithi142.stdout:3/427: mkdir d1d/d1e/d2e/d37/d81 0 2024-02-19T19:07:32.625 INFO:tasks.workunit.client.1.smithi142.stdout:3/428: write d1d/f35 [998271,69263] 0 2024-02-19T19:07:32.626 INFO:tasks.workunit.client.1.smithi142.stdout:3/429: dread - d1d/d36/d52/f56 zero size 2024-02-19T19:07:32.626 INFO:tasks.workunit.client.1.smithi142.stdout:3/430: rmdir d1d/d1e/d2e/d50 39 2024-02-19T19:07:32.627 INFO:tasks.workunit.client.1.smithi142.stdout:3/431: unlink d1d/d1e/d6e/c70 0 2024-02-19T19:07:32.629 INFO:tasks.workunit.client.1.smithi142.stdout:3/432: dread d1d/d1e/f49 [0,4194304] 0 2024-02-19T19:07:32.629 INFO:tasks.workunit.client.1.smithi142.stdout:3/433: truncate f1c 431848 0 2024-02-19T19:07:32.631 INFO:tasks.workunit.client.1.smithi142.stdout:3/434: link d1d/d1e/d2e/c73 d1d/d1e/d2e/d50/c82 0 2024-02-19T19:07:32.631 INFO:tasks.workunit.client.1.smithi142.stdout:3/435: write d1d/f41 [4691067,95788] 0 2024-02-19T19:07:32.832 INFO:tasks.workunit.client.1.smithi142.stdout:0/272: write d23/d28/f3e [989509,70782] 0 2024-02-19T19:07:32.834 INFO:tasks.workunit.client.1.smithi142.stdout:0/273: link l7 d23/d28/d2d/l56 0 2024-02-19T19:07:32.834 INFO:tasks.workunit.client.1.smithi142.stdout:0/274: chown d23/d28/d2d/d51/f37 745637023 1 2024-02-19T19:07:32.835 INFO:tasks.workunit.client.1.smithi142.stdout:0/275: rename d23/d28/f3e to d23/d28/d2d/f57 0 2024-02-19T19:07:32.836 INFO:tasks.workunit.client.1.smithi142.stdout:0/276: mkdir d23/d28/d2d/d51/d44/d58 0 2024-02-19T19:07:32.838 INFO:tasks.workunit.client.1.smithi142.stdout:0/277: rename d23/l24 to d23/d28/d2d/l59 0 2024-02-19T19:07:32.839 INFO:tasks.workunit.client.1.smithi142.stdout:0/278: creat d23/d28/d41/f5a x:0 0 0 2024-02-19T19:07:32.840 INFO:tasks.workunit.client.1.smithi142.stdout:0/279: chown c14 33515 1 2024-02-19T19:07:32.840 INFO:tasks.workunit.client.1.smithi142.stdout:0/280: creat d23/d32/f5b x:0 0 0 2024-02-19T19:07:32.840 INFO:tasks.workunit.client.1.smithi142.stdout:0/281: read - d23/d32/f5b zero size 2024-02-19T19:07:32.840 INFO:tasks.workunit.client.1.smithi142.stdout:0/282: symlink d23/d32/l5c 0 2024-02-19T19:07:32.848 INFO:tasks.workunit.client.1.smithi142.stdout:4/371: dwrite d4/d14/d31/f38 [0,4194304] 0 2024-02-19T19:07:32.848 INFO:tasks.workunit.client.1.smithi142.stdout:5/315: dwrite d5/dd/d8/d31/f33 [0,4194304] 0 2024-02-19T19:07:32.849 INFO:tasks.workunit.client.1.smithi142.stdout:5/316: creat d5/dd/df/f6b x:0 0 0 2024-02-19T19:07:32.849 INFO:tasks.workunit.client.1.smithi142.stdout:5/317: chown d5/dd/d8/l21 4 1 2024-02-19T19:07:32.849 INFO:tasks.workunit.client.1.smithi142.stdout:5/318: readlink d5/dd/d8/d2a/d57/l58 0 2024-02-19T19:07:32.853 INFO:tasks.workunit.client.1.smithi142.stdout:4/372: dread d4/d1d/d42/d66/dd/d10/d3e/f4e [0,4194304] 0 2024-02-19T19:07:32.853 INFO:tasks.workunit.client.1.smithi142.stdout:4/373: read - d4/d1d/d42/d66/dd/f7c zero size 2024-02-19T19:07:32.853 INFO:tasks.workunit.client.1.smithi142.stdout:5/319: creat d5/dd/d8/d1c/d64/f6c x:0 0 0 2024-02-19T19:07:32.857 INFO:tasks.workunit.client.1.smithi142.stdout:0/283: dread d23/f31 [0,4194304] 0 2024-02-19T19:07:32.859 INFO:tasks.workunit.client.1.smithi142.stdout:8/361: sync 2024-02-19T19:07:32.859 INFO:tasks.workunit.client.1.smithi142.stdout:6/235: sync 2024-02-19T19:07:32.859 INFO:tasks.workunit.client.1.smithi142.stdout:7/255: sync 2024-02-19T19:07:32.859 INFO:tasks.workunit.client.1.smithi142.stdout:3/436: sync 2024-02-19T19:07:32.860 INFO:tasks.workunit.client.1.smithi142.stdout:1/437: sync 2024-02-19T19:07:32.860 INFO:tasks.workunit.client.1.smithi142.stdout:9/379: sync 2024-02-19T19:07:32.860 INFO:tasks.workunit.client.1.smithi142.stdout:2/305: sync 2024-02-19T19:07:32.860 INFO:tasks.workunit.client.1.smithi142.stdout:2/306: stat d3/d4d/d5f 0 2024-02-19T19:07:32.861 INFO:tasks.workunit.client.1.smithi142.stdout:3/437: mkdir d1d/d1e/d2e/d50/d83 0 2024-02-19T19:07:32.861 INFO:tasks.workunit.client.1.smithi142.stdout:3/438: dread - d1d/d36/d3a/f68 zero size 2024-02-19T19:07:32.861 INFO:tasks.workunit.client.1.smithi142.stdout:8/362: write d9/f46 [346578,112908] 0 2024-02-19T19:07:32.861 INFO:tasks.workunit.client.1.smithi142.stdout:8/363: dread - d9/dd/de/d2d/d2e/d49/d50/d59/f66 zero size 2024-02-19T19:07:32.861 INFO:tasks.workunit.client.1.smithi142.stdout:5/320: dread d5/dd/d8/fb [0,4194304] 0 2024-02-19T19:07:32.862 INFO:tasks.workunit.client.1.smithi142.stdout:4/374: write d4/d1d/d42/d66/d12/f5c [2740760,100801] 0 2024-02-19T19:07:32.864 INFO:tasks.workunit.client.1.smithi142.stdout:1/438: mknod d5/d7/c97 0 2024-02-19T19:07:32.864 INFO:tasks.workunit.client.1.smithi142.stdout:9/380: creat db/d10/d27/d2f/d4c/d59/f71 x:0 0 0 2024-02-19T19:07:32.864 INFO:tasks.workunit.client.1.smithi142.stdout:2/307: mknod d3/db/d29/d4c/d4e/c61 0 2024-02-19T19:07:32.864 INFO:tasks.workunit.client.1.smithi142.stdout:9/381: fsync db/d10/d27/d2f/d4c/f35 0 2024-02-19T19:07:32.864 INFO:tasks.workunit.client.1.smithi142.stdout:2/308: chown d3/db/d29 78554 1 2024-02-19T19:07:32.868 INFO:tasks.workunit.client.1.smithi142.stdout:8/364: mkdir d9/dd/de/d2d/d2e/d73 0 2024-02-19T19:07:32.880 INFO:tasks.workunit.client.1.smithi142.stdout:1/439: dread d5/d1a/d33/f4d [0,4194304] 0 2024-02-19T19:07:32.880 INFO:tasks.workunit.client.1.smithi142.stdout:1/440: truncate d5/d7/d23/d41/f80 597353 0 2024-02-19T19:07:32.881 INFO:tasks.workunit.client.1.smithi142.stdout:9/382: dread db/f16 [0,4194304] 0 2024-02-19T19:07:32.881 INFO:tasks.workunit.client.1.smithi142.stdout:1/441: creat d5/d37/d6c/d75/f98 x:0 0 0 2024-02-19T19:07:32.881 INFO:tasks.workunit.client.1.smithi142.stdout:1/442: chown d5/d7/d4a/d53/d6a/f63 47336683 1 2024-02-19T19:07:32.883 INFO:tasks.workunit.client.1.smithi142.stdout:9/383: mknod db/d10/d32/d3f/d5f/c72 0 2024-02-19T19:07:32.885 INFO:tasks.workunit.client.1.smithi142.stdout:1/443: rename d5/f42 to d5/d7/d4a/d53/f99 0 2024-02-19T19:07:32.885 INFO:tasks.workunit.client.1.smithi142.stdout:1/444: write d5/d7/f25 [1020878,17188] 0 2024-02-19T19:07:32.887 INFO:tasks.workunit.client.1.smithi142.stdout:1/445: symlink d5/d1a/d59/l9a 0 2024-02-19T19:07:32.894 INFO:tasks.workunit.client.1.smithi142.stdout:2/309: write d3/f16 [3927159,112722] 0 2024-02-19T19:07:32.894 INFO:tasks.workunit.client.1.smithi142.stdout:2/310: read - d3/d4d/f50 zero size 2024-02-19T19:07:32.894 INFO:tasks.workunit.client.1.smithi142.stdout:2/311: write d3/db/d29/d4c/d46/f56 [838755,128798] 0 2024-02-19T19:07:32.896 INFO:tasks.workunit.client.1.smithi142.stdout:3/439: dwrite f18 [4194304,4194304] 0 2024-02-19T19:07:32.896 INFO:tasks.workunit.client.1.smithi142.stdout:2/312: creat d3/f62 x:0 0 0 2024-02-19T19:07:32.898 INFO:tasks.workunit.client.1.smithi142.stdout:3/440: rmdir d1d/d36/d3a/d62 39 2024-02-19T19:07:32.898 INFO:tasks.workunit.client.1.smithi142.stdout:3/441: dread - d1d/d36/d52/d5a/f6d zero size 2024-02-19T19:07:32.898 INFO:tasks.workunit.client.1.smithi142.stdout:3/442: write d1d/d1e/d2e/d37/f4a [4004709,55149] 0 2024-02-19T19:07:32.905 INFO:tasks.workunit.client.1.smithi142.stdout:0/284: dwrite d23/d28/d41/f5a [0,4194304] 0 2024-02-19T19:07:32.912 INFO:tasks.workunit.client.1.smithi142.stdout:3/443: dread f18 [4194304,4194304] 0 2024-02-19T19:07:32.912 INFO:tasks.workunit.client.1.smithi142.stdout:3/444: write d1d/d1e/d2e/f7e [370872,32114] 0 2024-02-19T19:07:32.912 INFO:tasks.workunit.client.1.smithi142.stdout:3/445: stat d1d/d36/d3a/d57 0 2024-02-19T19:07:32.913 INFO:tasks.workunit.client.1.smithi142.stdout:3/446: fsync d1d/d1e/d2e/d37/f4c 0 2024-02-19T19:07:32.913 INFO:tasks.workunit.client.1.smithi142.stdout:3/447: stat d1d/d36/d3a 0 2024-02-19T19:07:32.913 INFO:tasks.workunit.client.1.smithi142.stdout:3/448: chown d1d/l31 2 1 2024-02-19T19:07:32.913 INFO:tasks.workunit.client.1.smithi142.stdout:3/449: creat d1d/d36/f84 x:0 0 0 2024-02-19T19:07:32.913 INFO:tasks.workunit.client.1.smithi142.stdout:3/450: write d1d/d1e/f55 [269400,98814] 0 2024-02-19T19:07:32.915 INFO:tasks.workunit.client.1.smithi142.stdout:3/451: write f18 [6575656,24482] 0 2024-02-19T19:07:32.917 INFO:tasks.workunit.client.1.smithi142.stdout:3/452: write d1d/d1e/f32 [604741,111673] 0 2024-02-19T19:07:32.929 INFO:tasks.workunit.client.1.smithi142.stdout:3/453: write f19 [3782256,21379] 0 2024-02-19T19:07:32.929 INFO:tasks.workunit.client.1.smithi142.stdout:4/375: dwrite d4/d1d/f5b [0,4194304] 0 2024-02-19T19:07:32.933 INFO:tasks.workunit.client.1.smithi142.stdout:8/365: dwrite f7 [0,4194304] 0 2024-02-19T19:07:32.934 INFO:tasks.workunit.client.1.smithi142.stdout:4/376: link d4/d1d/d42/d66/dd/f56 d4/d14/d31/f7d 0 2024-02-19T19:07:32.934 INFO:tasks.workunit.client.1.smithi142.stdout:8/366: readlink d9/dd/de/l3f 0 2024-02-19T19:07:32.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/236: dwrite d2/d1e/f2a [0,4194304] 0 2024-02-19T19:07:32.934 INFO:tasks.workunit.client.1.smithi142.stdout:7/256: dwrite d0/d1b/d21/d24/d29/d2d/f3c [0,4194304] 0 2024-02-19T19:07:32.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/384: dwrite db/d10/f4b [0,4194304] 0 2024-02-19T19:07:32.935 INFO:tasks.workunit.client.1.smithi142.stdout:2/313: dwrite d3/db/f15 [0,4194304] 0 2024-02-19T19:07:32.935 INFO:tasks.workunit.client.1.smithi142.stdout:1/446: dwrite d5/fd [0,4194304] 0 2024-02-19T19:07:32.935 INFO:tasks.workunit.client.1.smithi142.stdout:1/447: write d5/f68 [362842,60770] 0 2024-02-19T19:07:32.935 INFO:tasks.workunit.client.1.smithi142.stdout:2/314: creat d3/d4d/f63 x:0 0 0 2024-02-19T19:07:32.935 INFO:tasks.workunit.client.1.smithi142.stdout:2/315: readlink d3/df/l30 0 2024-02-19T19:07:32.935 INFO:tasks.workunit.client.1.smithi142.stdout:2/316: write d3/db/d29/f41 [2817011,55511] 0 2024-02-19T19:07:32.935 INFO:tasks.workunit.client.1.smithi142.stdout:4/377: mkdir d4/d1d/d7e 0 2024-02-19T19:07:32.937 INFO:tasks.workunit.client.1.smithi142.stdout:8/367: mkdir d9/dd/de/d2d/d2e/d49/d74 0 2024-02-19T19:07:32.939 INFO:tasks.workunit.client.1.smithi142.stdout:6/237: truncate d2/d1f/d20/f25 451421 0 2024-02-19T19:07:32.945 INFO:tasks.workunit.client.1.smithi142.stdout:7/257: mkdir d0/d1b/d21/d24/d29/d52 0 2024-02-19T19:07:32.947 INFO:tasks.workunit.client.1.smithi142.stdout:3/454: dwrite d1d/d36/d52/f54 [0,4194304] 0 2024-02-19T19:07:32.947 INFO:tasks.workunit.client.1.smithi142.stdout:3/455: chown d1d/d1e/d6e 271689 1 2024-02-19T19:07:32.947 INFO:tasks.workunit.client.1.smithi142.stdout:3/456: fdatasync d1d/d1e/f6b 0 2024-02-19T19:07:32.947 INFO:tasks.workunit.client.1.smithi142.stdout:3/457: chown d1d/d36/d3a/c4e 258146198 1 2024-02-19T19:07:32.958 INFO:tasks.workunit.client.1.smithi142.stdout:1/448: symlink d5/d73/l9b 0 2024-02-19T19:07:32.958 INFO:tasks.workunit.client.1.smithi142.stdout:1/449: write d5/d1a/d33/f50 [391074,30971] 0 2024-02-19T19:07:32.959 INFO:tasks.workunit.client.1.smithi142.stdout:2/317: mkdir d3/db/d29/d4c/d46/d59/d64 0 2024-02-19T19:07:32.961 INFO:tasks.workunit.client.1.smithi142.stdout:4/378: rename d4/d1d/d42/d66/dd/f56 to d4/d1d/d42/d66/d12/f7f 0 2024-02-19T19:07:32.962 INFO:tasks.workunit.client.1.smithi142.stdout:8/368: symlink d9/dd/de/d2d/d2e/d49/d50/l75 0 2024-02-19T19:07:32.962 INFO:tasks.workunit.client.1.smithi142.stdout:8/369: stat f2 0 2024-02-19T19:07:32.963 INFO:tasks.workunit.client.1.smithi142.stdout:6/238: creat d2/d17/d33/d42/f4b x:0 0 0 2024-02-19T19:07:32.964 INFO:tasks.workunit.client.1.smithi142.stdout:7/258: link d0/d1b/c2b d0/d1b/d21/d24/c53 0 2024-02-19T19:07:32.965 INFO:tasks.workunit.client.1.smithi142.stdout:9/385: getdents db/d10 0 2024-02-19T19:07:32.966 INFO:tasks.workunit.client.1.smithi142.stdout:9/386: chown db/d10/ce 6108198 1 2024-02-19T19:07:32.967 INFO:tasks.workunit.client.1.smithi142.stdout:3/458: mknod d1d/c85 0 2024-02-19T19:07:32.967 INFO:tasks.workunit.client.1.smithi142.stdout:3/459: write d1d/d36/f3b [5196080,35538] 0 2024-02-19T19:07:32.970 INFO:tasks.workunit.client.1.smithi142.stdout:8/370: dread d9/dd/d15/f28 [0,4194304] 0 2024-02-19T19:07:32.970 INFO:tasks.workunit.client.1.smithi142.stdout:2/318: creat d3/d35/d53/f65 x:0 0 0 2024-02-19T19:07:32.971 INFO:tasks.workunit.client.1.smithi142.stdout:4/379: mknod d4/d1d/d42/d66/d5f/c80 0 2024-02-19T19:07:32.972 INFO:tasks.workunit.client.1.smithi142.stdout:1/450: dwrite d5/d37/d6c/d75/f98 [0,4194304] 0 2024-02-19T19:07:32.972 INFO:tasks.workunit.client.1.smithi142.stdout:1/451: chown d5/d37/d6c/f85 39313 1 2024-02-19T19:07:32.973 INFO:tasks.workunit.client.1.smithi142.stdout:6/239: symlink d2/d1e/l4c 0 2024-02-19T19:07:32.977 INFO:tasks.workunit.client.1.smithi142.stdout:8/371: link d9/dd/de/d14/d21/f69 d9/dd/de/d2d/d2e/d49/d50/d59/f76 0 2024-02-19T19:07:32.977 INFO:tasks.workunit.client.1.smithi142.stdout:8/372: fdatasync d9/dd/de/f45 0 2024-02-19T19:07:32.977 INFO:tasks.workunit.client.1.smithi142.stdout:9/387: dread db/d10/d32/d33/f4d [0,4194304] 0 2024-02-19T19:07:32.978 INFO:tasks.workunit.client.1.smithi142.stdout:4/380: creat d4/d1d/d42/d66/dd/d10/d3e/f81 x:0 0 0 2024-02-19T19:07:32.981 INFO:tasks.workunit.client.1.smithi142.stdout:1/452: dread d5/d7/d23/d2c/f3b [0,4194304] 0 2024-02-19T19:07:32.981 INFO:tasks.workunit.client.1.smithi142.stdout:1/453: creat d5/d7/d4a/d53/d6a/f9c x:0 0 0 2024-02-19T19:07:32.986 INFO:tasks.workunit.client.1.smithi142.stdout:8/373: dread d9/dd/de/d14/f6e [0,4194304] 0 2024-02-19T19:07:32.987 INFO:tasks.workunit.client.1.smithi142.stdout:7/259: rmdir d0/d1b/d21 39 2024-02-19T19:07:32.988 INFO:tasks.workunit.client.1.smithi142.stdout:3/460: getdents d1d/d1e/d6e 0 2024-02-19T19:07:32.988 INFO:tasks.workunit.client.1.smithi142.stdout:3/461: stat d1d/d36/f3d 0 2024-02-19T19:07:32.989 INFO:tasks.workunit.client.1.smithi142.stdout:9/388: symlink db/d10/d32/d3f/d5f/l73 0 2024-02-19T19:07:32.989 INFO:tasks.workunit.client.1.smithi142.stdout:9/389: fsync db/d10/f4b 0 2024-02-19T19:07:32.989 INFO:tasks.workunit.client.1.smithi142.stdout:5/321: sync 2024-02-19T19:07:32.990 INFO:tasks.workunit.client.1.smithi142.stdout:2/319: link d3/db/d29/f5d d3/d35/f66 0 2024-02-19T19:07:32.991 INFO:tasks.workunit.client.1.smithi142.stdout:4/381: rmdir d4/d1d/d7e 0 2024-02-19T19:07:32.994 INFO:tasks.workunit.client.1.smithi142.stdout:1/454: dwrite d5/d37/d6c/f85 [0,4194304] 0 2024-02-19T19:07:32.994 INFO:tasks.workunit.client.1.smithi142.stdout:3/462: creat d1d/d36/d3a/d57/f86 x:0 0 0 2024-02-19T19:07:32.996 INFO:tasks.workunit.client.1.smithi142.stdout:9/390: creat db/d10/d22/d24/d41/f74 x:0 0 0 2024-02-19T19:07:32.998 INFO:tasks.workunit.client.1.smithi142.stdout:2/320: symlink d3/d35/d53/l67 0 2024-02-19T19:07:32.998 INFO:tasks.workunit.client.1.smithi142.stdout:0/285: sync 2024-02-19T19:07:33.000 INFO:tasks.workunit.client.1.smithi142.stdout:4/382: dread d4/d1d/d42/d66/dd/d10/f1f [0,4194304] 0 2024-02-19T19:07:33.001 INFO:tasks.workunit.client.1.smithi142.stdout:3/463: mkdir d1d/d87 0 2024-02-19T19:07:33.001 INFO:tasks.workunit.client.1.smithi142.stdout:3/464: fsync f10 0 2024-02-19T19:07:33.001 INFO:tasks.workunit.client.1.smithi142.stdout:4/383: write d4/d1d/d42/d66/d12/f18 [1969491,117540] 0 2024-02-19T19:07:33.002 INFO:tasks.workunit.client.1.smithi142.stdout:4/384: chown d4/d1d/d42/d66/d12/d2d/d2a/f6f 3240 1 2024-02-19T19:07:33.002 INFO:tasks.workunit.client.1.smithi142.stdout:9/391: creat db/d10/d32/d3f/f75 x:0 0 0 2024-02-19T19:07:33.005 INFO:tasks.workunit.client.1.smithi142.stdout:8/374: rename d9/dd/d15/d4d to d9/dd/de/d2d/d2e/d73/d77 0 2024-02-19T19:07:33.006 INFO:tasks.workunit.client.1.smithi142.stdout:7/260: rename d0/d1b to d0/d1b/d21/d24/d54 22 2024-02-19T19:07:33.006 INFO:tasks.workunit.client.1.smithi142.stdout:7/261: write d0/d13/f1f [2798714,43695] 0 2024-02-19T19:07:33.011 INFO:tasks.workunit.client.1.smithi142.stdout:5/322: rename d5/dd/c47 to d5/dd/d8/d2a/d57/c6d 0 2024-02-19T19:07:33.013 INFO:tasks.workunit.client.1.smithi142.stdout:1/455: dwrite d5/d7/f25 [0,4194304] 0 2024-02-19T19:07:33.013 INFO:tasks.workunit.client.1.smithi142.stdout:5/323: dread d5/dd/d5f/f65 [0,4194304] 0 2024-02-19T19:07:33.013 INFO:tasks.workunit.client.1.smithi142.stdout:7/262: creat d0/d1b/d21/d24/d29/d44/f55 x:0 0 0 2024-02-19T19:07:33.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/465: write d1d/f22 [1002839,2035] 0 2024-02-19T19:07:33.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/466: write d1d/d1e/d2e/f7e [933470,101881] 0 2024-02-19T19:07:33.014 INFO:tasks.workunit.client.1.smithi142.stdout:3/467: dread - d1d/d36/d52/f56 zero size 2024-02-19T19:07:33.015 INFO:tasks.workunit.client.1.smithi142.stdout:4/385: getdents d4/d1d/d42/d66/dd/d10/d26 0 2024-02-19T19:07:33.016 INFO:tasks.workunit.client.1.smithi142.stdout:2/321: rename d3/db/d52 to d3/d68 0 2024-02-19T19:07:33.016 INFO:tasks.workunit.client.1.smithi142.stdout:2/322: creat d3/d4d/f69 x:0 0 0 2024-02-19T19:07:33.018 INFO:tasks.workunit.client.1.smithi142.stdout:1/456: symlink d5/d7/l9d 0 2024-02-19T19:07:33.020 INFO:tasks.workunit.client.1.smithi142.stdout:5/324: creat d5/dd/d8/d31/f6e x:0 0 0 2024-02-19T19:07:33.020 INFO:tasks.workunit.client.1.smithi142.stdout:5/325: fdatasync d5/dd/df/d22/d41/d32/f39 0 2024-02-19T19:07:33.020 INFO:tasks.workunit.client.1.smithi142.stdout:5/326: write d5/dd/d8/fb [5127466,4881] 0 2024-02-19T19:07:33.020 INFO:tasks.workunit.client.1.smithi142.stdout:5/327: dread - d5/f38 zero size 2024-02-19T19:07:33.021 INFO:tasks.workunit.client.1.smithi142.stdout:7/263: rmdir d0/d13/d51 0 2024-02-19T19:07:33.022 INFO:tasks.workunit.client.1.smithi142.stdout:7/264: truncate d0/d1b/d21/d24/d31/f45 655582 0 2024-02-19T19:07:33.027 INFO:tasks.workunit.client.1.smithi142.stdout:4/386: rename d4/d1d/d42/d66/dd/d10/d26/d50/d54/c71 to d4/d1d/d42/d66/d12/d2d/c82 0 2024-02-19T19:07:33.027 INFO:tasks.workunit.client.1.smithi142.stdout:4/387: readlink d4/d1c/l45 0 2024-02-19T19:07:33.030 INFO:tasks.workunit.client.1.smithi142.stdout:1/457: mknod d5/c9e 0 2024-02-19T19:07:33.030 INFO:tasks.workunit.client.1.smithi142.stdout:0/286: dwrite f16 [0,4194304] 0 2024-02-19T19:07:33.031 INFO:tasks.workunit.client.1.smithi142.stdout:7/265: symlink d0/d13/d1e/d22/l56 0 2024-02-19T19:07:33.032 INFO:tasks.workunit.client.1.smithi142.stdout:5/328: getdents d5/dd/d8/d1c 0 2024-02-19T19:07:33.034 INFO:tasks.workunit.client.1.smithi142.stdout:0/287: creat d23/d28/d2d/d51/d44/d58/f5d x:0 0 0 2024-02-19T19:07:33.034 INFO:tasks.workunit.client.1.smithi142.stdout:0/288: creat d23/d28/d41/f5e x:0 0 0 2024-02-19T19:07:33.035 INFO:tasks.workunit.client.1.smithi142.stdout:7/266: creat d0/d13/d1e/d22/f57 x:0 0 0 2024-02-19T19:07:33.035 INFO:tasks.workunit.client.1.smithi142.stdout:7/267: readlink d0/d13/d1e/d22/l41 0 2024-02-19T19:07:33.035 INFO:tasks.workunit.client.1.smithi142.stdout:1/458: rmdir d5/d7/d34/d6f 39 2024-02-19T19:07:33.037 INFO:tasks.workunit.client.1.smithi142.stdout:5/329: mkdir d5/dd/df/d22/d41/d6f 0 2024-02-19T19:07:33.037 INFO:tasks.workunit.client.1.smithi142.stdout:5/330: creat d5/dd/f70 x:0 0 0 2024-02-19T19:07:33.037 INFO:tasks.workunit.client.1.smithi142.stdout:5/331: truncate d5/dd/df/d22/f37 690476 0 2024-02-19T19:07:33.040 INFO:tasks.workunit.client.1.smithi142.stdout:5/332: unlink d5/dd/d8/d31/c3c 0 2024-02-19T19:07:33.042 INFO:tasks.workunit.client.1.smithi142.stdout:1/459: mknod d5/d37/c9f 0 2024-02-19T19:07:33.042 INFO:tasks.workunit.client.1.smithi142.stdout:1/460: readlink d5/d1a/d33/l44 0 2024-02-19T19:07:33.043 INFO:tasks.workunit.client.1.smithi142.stdout:5/333: link d5/dd/df/c61 d5/d45/c71 0 2024-02-19T19:07:33.044 INFO:tasks.workunit.client.1.smithi142.stdout:3/468: dwrite d1d/d36/f3d [8388608,4194304] 0 2024-02-19T19:07:33.045 INFO:tasks.workunit.client.1.smithi142.stdout:5/334: rename d5/dd/d8/d2a/d57/c6d to d5/dd/d8/d31/d4d/d60/c72 0 2024-02-19T19:07:33.045 INFO:tasks.workunit.client.1.smithi142.stdout:5/335: chown d5/dd/d8/d31 3681711 1 2024-02-19T19:07:33.046 INFO:tasks.workunit.client.1.smithi142.stdout:5/336: creat d5/dd/d8/d31/d4d/d60/f73 x:0 0 0 2024-02-19T19:07:33.076 INFO:tasks.workunit.client.1.smithi142.stdout:2/323: dwrite d3/d35/f5c [0,4194304] 0 2024-02-19T19:07:33.076 INFO:tasks.workunit.client.1.smithi142.stdout:8/375: dwrite f2 [0,4194304] 0 2024-02-19T19:07:33.077 INFO:tasks.workunit.client.1.smithi142.stdout:9/392: dwrite db/f16 [4194304,4194304] 0 2024-02-19T19:07:33.077 INFO:tasks.workunit.client.1.smithi142.stdout:3/469: dwrite d1d/d1e/d2e/d50/f67 [0,4194304] 0 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:3/470: chown d1d/f22 165 1 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:3/471: readlink d1d/l61 0 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:7/268: dwrite d0/f19 [0,4194304] 0 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:7/269: chown d0/d1b/d21/d24/d29/c4a 32153143 1 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:3/472: creat d1d/d36/d3a/d57/f88 x:0 0 0 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:3/473: dread - d1d/d1e/d2e/f48 zero size 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:3/474: dread - d1d/d1e/d2e/f48 zero size 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:3/475: dread - d1d/d36/f84 zero size 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:5/337: dwrite d5/dd/df/d22/d41/d32/f62 [0,4194304] 0 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:4/388: dwrite d4/d1d/d42/d66/dd/d10/d26/d50/d54/f59 [0,4194304] 0 2024-02-19T19:07:33.078 INFO:tasks.workunit.client.1.smithi142.stdout:5/338: read d5/dd/d5f/f65 [5196,121983] 0 2024-02-19T19:07:33.079 INFO:tasks.workunit.client.1.smithi142.stdout:3/476: dread d1d/d1e/d2e/f46 [0,4194304] 0 2024-02-19T19:07:33.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:32 smithi046 ceph-mon[88928]: pgmap v76: 65 pgs: 6 unknown, 3 peering, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 387 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 103 MiB/s rd, 122 MiB/s wr, 494 op/s; 5474/32340 objects degraded (16.926%) 2024-02-19T19:07:33.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:32 smithi046 ceph-mon[88928]: osdmap e61: 6 total, 5 up, 6 in 2024-02-19T19:07:33.081 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:32 smithi046 podman[106474]: 2024-02-19 19:07:32.767020257 +0000 UTC m=+0.545097352 container init acb7edc764a05788532b11ffa80f7655937e7d178c7852901d96880340fd3c2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-19T19:07:33.081 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:32 smithi046 podman[106474]: 2024-02-19 19:07:32.770350184 +0000 UTC m=+0.548427288 container start acb7edc764a05788532b11ffa80f7655937e7d178c7852901d96880340fd3c2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:07:33.082 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:32 smithi046 podman[106474]: 2024-02-19 19:07:32.8755666 +0000 UTC m=+0.653643703 container attach acb7edc764a05788532b11ffa80f7655937e7d178c7852901d96880340fd3c2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214) 2024-02-19T19:07:33.083 INFO:tasks.workunit.client.1.smithi142.stdout:0/289: rmdir d23 39 2024-02-19T19:07:33.085 INFO:tasks.workunit.client.1.smithi142.stdout:2/324: dread d3/db/fc [0,4194304] 0 2024-02-19T19:07:33.086 INFO:tasks.workunit.client.1.smithi142.stdout:2/325: chown d3/df 5609 1 2024-02-19T19:07:33.093 INFO:tasks.workunit.client.1.smithi142.stdout:2/326: write d3/db/f15 [2887710,80167] 0 2024-02-19T19:07:33.102 INFO:tasks.workunit.client.1.smithi142.stdout:4/389: mknod d4/d14/d31/d43/c83 0 2024-02-19T19:07:33.103 INFO:tasks.workunit.client.1.smithi142.stdout:5/339: creat d5/dd/df/d22/d41/d32/f74 x:0 0 0 2024-02-19T19:07:33.104 INFO:tasks.workunit.client.1.smithi142.stdout:8/376: getdents d9 0 2024-02-19T19:07:33.104 INFO:tasks.workunit.client.1.smithi142.stdout:8/377: readlink d9/dd/d15/d31/l38 0 2024-02-19T19:07:33.104 INFO:tasks.workunit.client.1.smithi142.stdout:7/270: dwrite d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:33.104 INFO:tasks.workunit.client.1.smithi142.stdout:7/271: fsync d0/f2a 0 2024-02-19T19:07:33.104 INFO:tasks.workunit.client.1.smithi142.stdout:7/272: chown d0/d1b/d21/d24 4582 1 2024-02-19T19:07:33.104 INFO:tasks.workunit.client.1.smithi142.stdout:3/477: mknod d1d/d1e/d2e/d50/d83/c89 0 2024-02-19T19:07:33.105 INFO:tasks.workunit.client.1.smithi142.stdout:9/393: rmdir db/d10/d27/d2f/d4c/d59 39 2024-02-19T19:07:33.106 INFO:tasks.workunit.client.1.smithi142.stdout:0/290: mknod d23/d32/c5f 0 2024-02-19T19:07:33.108 INFO:tasks.workunit.client.1.smithi142.stdout:2/327: unlink d3/d4b/f51 0 2024-02-19T19:07:33.108 INFO:tasks.workunit.client.1.smithi142.stdout:2/328: chown d3/df 486543 1 2024-02-19T19:07:33.109 INFO:tasks.workunit.client.1.smithi142.stdout:4/390: mkdir d4/d1d/d42/d66/d12/d2d/d2a/d84 0 2024-02-19T19:07:33.111 INFO:tasks.workunit.client.1.smithi142.stdout:5/340: dread f4 [0,4194304] 0 2024-02-19T19:07:33.111 INFO:tasks.workunit.client.1.smithi142.stdout:5/341: chown d5/dd/df/d22/d41 118603108 1 2024-02-19T19:07:33.112 INFO:tasks.workunit.client.1.smithi142.stdout:5/342: truncate d5/dd/d8/d31/d4d/d60/f66 996582 0 2024-02-19T19:07:33.112 INFO:tasks.workunit.client.1.smithi142.stdout:6/240: sync 2024-02-19T19:07:33.114 INFO:tasks.workunit.client.1.smithi142.stdout:8/378: mknod d9/dd/c78 0 2024-02-19T19:07:33.115 INFO:tasks.workunit.client.1.smithi142.stdout:7/273: truncate d0/d1b/d21/d24/d29/d2d/f2e 757202 0 2024-02-19T19:07:33.115 INFO:tasks.workunit.client.1.smithi142.stdout:7/274: readlink d0/lb 0 2024-02-19T19:07:33.115 INFO:tasks.workunit.client.1.smithi142.stdout:3/478: dread f13 [0,4194304] 0 2024-02-19T19:07:33.116 INFO:tasks.workunit.client.1.smithi142.stdout:9/394: truncate db/f53 42463 0 2024-02-19T19:07:33.116 INFO:tasks.workunit.client.1.smithi142.stdout:9/395: chown db/d10/d22/f46 126509348 1 2024-02-19T19:07:33.116 INFO:tasks.workunit.client.1.smithi142.stdout:2/329: getdents d3/d4d/d5f 0 2024-02-19T19:07:33.118 INFO:tasks.workunit.client.1.smithi142.stdout:0/291: dread d23/f25 [0,4194304] 0 2024-02-19T19:07:33.119 INFO:tasks.workunit.client.1.smithi142.stdout:6/241: rename d2/d29/d3b to d2/d1f/d4d 0 2024-02-19T19:07:33.119 INFO:tasks.workunit.client.1.smithi142.stdout:6/242: chown d2/d17/c2d 786976 1 2024-02-19T19:07:33.120 INFO:tasks.workunit.client.1.smithi142.stdout:3/479: creat d1d/d1e/d2e/d50/f8a x:0 0 0 2024-02-19T19:07:33.120 INFO:tasks.workunit.client.1.smithi142.stdout:3/480: chown d1d/d36/d52/d71 34123151 1 2024-02-19T19:07:33.121 INFO:tasks.workunit.client.1.smithi142.stdout:4/391: write d4/d1d/f35 [2622748,17848] 0 2024-02-19T19:07:33.122 INFO:tasks.workunit.client.1.smithi142.stdout:0/292: creat d23/d28/d2d/f60 x:0 0 0 2024-02-19T19:07:33.122 INFO:tasks.workunit.client.1.smithi142.stdout:0/293: write f11 [6832436,64377] 0 2024-02-19T19:07:33.125 INFO:tasks.workunit.client.1.smithi142.stdout:7/275: dread d0/d13/f27 [0,4194304] 0 2024-02-19T19:07:33.125 INFO:tasks.workunit.client.1.smithi142.stdout:9/396: dread db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:33.126 INFO:tasks.workunit.client.1.smithi142.stdout:3/481: mkdir d1d/d1e/d2e/d8b 0 2024-02-19T19:07:33.126 INFO:tasks.workunit.client.1.smithi142.stdout:9/397: fsync db/d10/d27/f42 0 2024-02-19T19:07:33.126 INFO:tasks.workunit.client.1.smithi142.stdout:9/398: creat db/d10/d32/f76 x:0 0 0 2024-02-19T19:07:33.126 INFO:tasks.workunit.client.1.smithi142.stdout:1/461: sync 2024-02-19T19:07:33.126 INFO:tasks.workunit.client.1.smithi142.stdout:1/462: fsync d5/d1a/f3a 0 2024-02-19T19:07:33.126 INFO:tasks.workunit.client.1.smithi142.stdout:0/294: symlink d23/d28/l61 0 2024-02-19T19:07:33.128 INFO:tasks.workunit.client.1.smithi142.stdout:5/343: dwrite d5/dd/d8/d2a/f4e [0,4194304] 0 2024-02-19T19:07:33.130 INFO:tasks.workunit.client.1.smithi142.stdout:7/276: symlink d0/d13/d1e/l58 0 2024-02-19T19:07:33.130 INFO:tasks.workunit.client.1.smithi142.stdout:7/277: chown d0/l37 32 1 2024-02-19T19:07:33.133 INFO:tasks.workunit.client.1.smithi142.stdout:9/399: link db/d10/c19 db/d10/d32/d33/c77 0 2024-02-19T19:07:33.133 INFO:tasks.workunit.client.1.smithi142.stdout:6/243: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:33.133 INFO:tasks.workunit.client.1.smithi142.stdout:6/244: readlink d2/l11 0 2024-02-19T19:07:33.133 INFO:tasks.workunit.client.1.smithi142.stdout:9/400: read - db/d10/d32/f76 zero size 2024-02-19T19:07:33.137 INFO:tasks.workunit.client.1.smithi142.stdout:2/330: dwrite d3/d35/d53/f65 [0,4194304] 0 2024-02-19T19:07:33.137 INFO:tasks.workunit.client.1.smithi142.stdout:2/331: stat d3/d4d/f69 0 2024-02-19T19:07:33.137 INFO:tasks.workunit.client.1.smithi142.stdout:2/332: dread - d3/d4d/f57 zero size 2024-02-19T19:07:33.137 INFO:tasks.workunit.client.1.smithi142.stdout:1/463: truncate d5/d1a/f47 1291251 0 2024-02-19T19:07:33.137 INFO:tasks.workunit.client.1.smithi142.stdout:1/464: chown d5/d7/d34/l57 3860954 1 2024-02-19T19:07:33.137 INFO:tasks.workunit.client.1.smithi142.stdout:1/465: dread - d5/d7/d4a/d53/d6a/f9c zero size 2024-02-19T19:07:33.137 INFO:tasks.workunit.client.1.smithi142.stdout:1/466: creat d5/d37/d6c/fa0 x:0 0 0 2024-02-19T19:07:33.139 INFO:tasks.workunit.client.1.smithi142.stdout:5/344: unlink d5/dd/f43 0 2024-02-19T19:07:33.139 INFO:tasks.workunit.client.1.smithi142.stdout:5/345: chown d5/d45/l4c 134858091 1 2024-02-19T19:07:33.144 INFO:tasks.workunit.client.1.smithi142.stdout:8/379: rename d9/dd/de/d14/d21 to d9/dd/d44/d79 0 2024-02-19T19:07:33.145 INFO:tasks.workunit.client.1.smithi142.stdout:8/380: fdatasync d9/dd/d44/d79/f53 0 2024-02-19T19:07:33.145 INFO:tasks.workunit.client.1.smithi142.stdout:8/381: readlink d9/dd/de/l3f 0 2024-02-19T19:07:33.145 INFO:tasks.workunit.client.1.smithi142.stdout:0/295: dwrite d23/d28/d2d/f48 [0,4194304] 0 2024-02-19T19:07:33.146 INFO:tasks.workunit.client.1.smithi142.stdout:7/278: creat d0/d1b/f59 x:0 0 0 2024-02-19T19:07:33.146 INFO:tasks.workunit.client.1.smithi142.stdout:9/401: creat db/d10/d32/d33/f78 x:0 0 0 2024-02-19T19:07:33.146 INFO:tasks.workunit.client.1.smithi142.stdout:6/245: symlink d2/d17/d33/d42/l4e 0 2024-02-19T19:07:33.146 INFO:tasks.workunit.client.1.smithi142.stdout:6/246: write d2/f18 [1065119,128360] 0 2024-02-19T19:07:33.146 INFO:tasks.workunit.client.1.smithi142.stdout:6/247: readlink d2/d1f/d20/l22 0 2024-02-19T19:07:33.148 INFO:tasks.workunit.client.1.smithi142.stdout:2/333: truncate d3/d35/f37 2443607 0 2024-02-19T19:07:33.150 INFO:tasks.workunit.client.1.smithi142.stdout:1/467: mknod d5/d7/d23/d2c/ca1 0 2024-02-19T19:07:33.151 INFO:tasks.workunit.client.1.smithi142.stdout:5/346: mkdir d5/dd/d8/d31/d4d/d75 0 2024-02-19T19:07:33.153 INFO:tasks.workunit.client.1.smithi142.stdout:4/392: rename d4/d1d/d42/d66/dd/d10/f1f to d4/d1d/d42/d66/d12/d79/f85 0 2024-02-19T19:07:33.156 INFO:tasks.workunit.client.1.smithi142.stdout:0/296: creat d23/d28/d2d/d51/d44/d58/f62 x:0 0 0 2024-02-19T19:07:33.157 INFO:tasks.workunit.client.1.smithi142.stdout:7/279: dwrite d0/d1b/d21/d24/f34 [0,4194304] 0 2024-02-19T19:07:33.157 INFO:tasks.workunit.client.1.smithi142.stdout:7/280: creat d0/d1b/f5a x:0 0 0 2024-02-19T19:07:33.158 INFO:tasks.workunit.client.1.smithi142.stdout:5/347: dread d5/dd/f1e [0,4194304] 0 2024-02-19T19:07:33.161 INFO:tasks.workunit.client.1.smithi142.stdout:9/402: creat db/d10/d22/d24/f79 x:0 0 0 2024-02-19T19:07:33.161 INFO:tasks.workunit.client.1.smithi142.stdout:9/403: write db/d10/d32/f69 [626148,88100] 0 2024-02-19T19:07:33.161 INFO:tasks.workunit.client.1.smithi142.stdout:9/404: chown db/f18 217 1 2024-02-19T19:07:33.162 INFO:tasks.workunit.client.1.smithi142.stdout:6/248: symlink d2/d1f/l4f 0 2024-02-19T19:07:33.163 INFO:tasks.workunit.client.1.smithi142.stdout:6/249: truncate d2/d1f/f30 2999669 0 2024-02-19T19:07:33.163 INFO:tasks.workunit.client.1.smithi142.stdout:2/334: stat d3/c3c 0 2024-02-19T19:07:33.165 INFO:tasks.workunit.client.1.smithi142.stdout:1/468: mkdir d5/d37/d6c/d75/da2 0 2024-02-19T19:07:33.165 INFO:tasks.workunit.client.1.smithi142.stdout:1/469: fsync d5/f4e 0 2024-02-19T19:07:33.168 INFO:tasks.workunit.client.1.smithi142.stdout:3/482: rename d1d/d36/d3a/d57/f88 to d1d/d1e/d2e/d50/f8c 0 2024-02-19T19:07:33.172 INFO:tasks.workunit.client.1.smithi142.stdout:0/297: link d23/d32/l5c d23/d28/d2d/d54/l63 0 2024-02-19T19:07:33.177 INFO:tasks.workunit.client.1.smithi142.stdout:5/348: mknod d5/dd/df/d15/c76 0 2024-02-19T19:07:33.177 INFO:tasks.workunit.client.1.smithi142.stdout:5/349: write d5/f13 [2690963,117220] 0 2024-02-19T19:07:33.180 INFO:tasks.workunit.client.1.smithi142.stdout:6/250: link d2/f12 d2/d1f/d20/d31/d3d/f50 0 2024-02-19T19:07:33.182 INFO:tasks.workunit.client.1.smithi142.stdout:2/335: symlink d3/db/d29/d4c/d4e/l6a 0 2024-02-19T19:07:33.182 INFO:tasks.workunit.client.1.smithi142.stdout:0/298: dread d23/f3a [0,4194304] 0 2024-02-19T19:07:33.183 INFO:tasks.workunit.client.1.smithi142.stdout:0/299: fdatasync d23/d28/d2d/d51/f4f 0 2024-02-19T19:07:33.183 INFO:tasks.workunit.client.1.smithi142.stdout:3/483: mkdir d1d/d36/d3a/d62/d8d 0 2024-02-19T19:07:33.183 INFO:tasks.workunit.client.1.smithi142.stdout:3/484: write d1d/d1e/d6e/f6f [993227,124734] 0 2024-02-19T19:07:33.184 INFO:tasks.workunit.client.1.smithi142.stdout:9/405: dwrite db/d10/d32/f69 [0,4194304] 0 2024-02-19T19:07:33.184 INFO:tasks.workunit.client.1.smithi142.stdout:4/393: symlink d4/l86 0 2024-02-19T19:07:33.186 INFO:tasks.workunit.client.1.smithi142.stdout:1/470: dwrite d5/d7/d4a/f82 [0,4194304] 0 2024-02-19T19:07:33.188 INFO:tasks.workunit.client.1.smithi142.stdout:6/251: mkdir d2/d17/d51 0 2024-02-19T19:07:33.191 INFO:tasks.workunit.client.1.smithi142.stdout:2/336: symlink d3/db/d29/d4c/d4a/l6b 0 2024-02-19T19:07:33.191 INFO:tasks.workunit.client.1.smithi142.stdout:2/337: creat d3/d4d/f6c x:0 0 0 2024-02-19T19:07:33.192 INFO:tasks.workunit.client.1.smithi142.stdout:0/300: dread f16 [0,4194304] 0 2024-02-19T19:07:33.192 INFO:tasks.workunit.client.1.smithi142.stdout:0/301: write f11 [5819289,102280] 0 2024-02-19T19:07:33.192 INFO:tasks.workunit.client.1.smithi142.stdout:0/302: chown f18 107 1 2024-02-19T19:07:33.192 INFO:tasks.workunit.client.1.smithi142.stdout:4/394: mkdir d4/d1d/d42/d66/dd/d10/d3e/d68/d87 0 2024-02-19T19:07:33.195 INFO:tasks.workunit.client.1.smithi142.stdout:5/350: dwrite d5/f24 [0,4194304] 0 2024-02-19T19:07:33.196 INFO:tasks.workunit.client.1.smithi142.stdout:1/471: link d5/d37/d6c/c8e d5/d7/d23/ca3 0 2024-02-19T19:07:33.196 INFO:tasks.workunit.client.1.smithi142.stdout:5/351: dread d5/dd/d8/d31/d4d/d60/f66 [0,4194304] 0 2024-02-19T19:07:33.196 INFO:tasks.workunit.client.1.smithi142.stdout:5/352: stat d5/dd/d8/d1c 0 2024-02-19T19:07:33.199 INFO:tasks.workunit.client.1.smithi142.stdout:3/485: dread d1d/d36/f3b [4194304,4194304] 0 2024-02-19T19:07:33.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:32 smithi142 ceph-mon[69118]: pgmap v76: 65 pgs: 6 unknown, 3 peering, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 387 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 103 MiB/s rd, 122 MiB/s wr, 494 op/s; 5474/32340 objects degraded (16.926%) 2024-02-19T19:07:33.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:32 smithi142 ceph-mon[69118]: osdmap e61: 6 total, 5 up, 6 in 2024-02-19T19:07:33.202 INFO:tasks.workunit.client.1.smithi142.stdout:0/303: creat d23/f64 x:0 0 0 2024-02-19T19:07:33.202 INFO:tasks.workunit.client.1.smithi142.stdout:0/304: write d23/d28/f33 [406350,66581] 0 2024-02-19T19:07:33.204 INFO:tasks.workunit.client.1.smithi142.stdout:4/395: unlink d4/d1d/d42/d66/d12/d2d/c82 0 2024-02-19T19:07:33.205 INFO:tasks.workunit.client.1.smithi142.stdout:6/252: dwrite d2/d17/d33/d39/f49 [0,4194304] 0 2024-02-19T19:07:33.205 INFO:tasks.workunit.client.1.smithi142.stdout:6/253: write d2/d1f/f2b [3608931,110799] 0 2024-02-19T19:07:33.209 INFO:tasks.workunit.client.1.smithi142.stdout:3/486: rename f10 to d1d/d87/f8e 0 2024-02-19T19:07:33.209 INFO:tasks.workunit.client.1.smithi142.stdout:3/487: truncate d1d/d36/d3a/d57/f86 424383 0 2024-02-19T19:07:33.210 INFO:tasks.workunit.client.1.smithi142.stdout:2/338: rmdir d3/db/d29/d4c/d46 39 2024-02-19T19:07:33.211 INFO:tasks.workunit.client.1.smithi142.stdout:0/305: creat d23/d32/f65 x:0 0 0 2024-02-19T19:07:33.212 INFO:tasks.workunit.client.1.smithi142.stdout:0/306: truncate d23/d28/d41/f5e 361515 0 2024-02-19T19:07:33.212 INFO:tasks.workunit.client.1.smithi142.stdout:0/307: chown d23/d32 59620476 1 2024-02-19T19:07:33.213 INFO:tasks.workunit.client.1.smithi142.stdout:5/353: read d5/dd/d8/d31/f33 [3864292,121314] 0 2024-02-19T19:07:33.213 INFO:tasks.workunit.client.1.smithi142.stdout:5/354: chown d5/dd/d8/c19 1 1 2024-02-19T19:07:33.213 INFO:tasks.workunit.client.1.smithi142.stdout:5/355: chown d5/dd/df/l11 13 1 2024-02-19T19:07:33.213 INFO:tasks.workunit.client.1.smithi142.stdout:5/356: dread - d5/dd/d8/f3d zero size 2024-02-19T19:07:33.219 INFO:tasks.workunit.client.1.smithi142.stdout:3/488: dread d1d/d1e/d2e/d50/f67 [0,4194304] 0 2024-02-19T19:07:33.219 INFO:tasks.workunit.client.1.smithi142.stdout:6/254: link d2/d1f/f30 d2/d1f/d20/f52 0 2024-02-19T19:07:33.221 INFO:tasks.workunit.client.1.smithi142.stdout:0/308: mknod d23/d28/d2d/d51/c66 0 2024-02-19T19:07:33.225 INFO:tasks.workunit.client.1.smithi142.stdout:6/255: truncate d2/d1f/d20/f52 2985500 0 2024-02-19T19:07:33.227 INFO:tasks.workunit.client.1.smithi142.stdout:6/256: creat d2/d17/d33/f53 x:0 0 0 2024-02-19T19:07:33.227 INFO:tasks.workunit.client.1.smithi142.stdout:6/257: chown d2/d1f/d20/l2f 48 1 2024-02-19T19:07:33.228 INFO:tasks.workunit.client.1.smithi142.stdout:4/396: dwrite d4/d1d/d42/d66/d12/d2d/f69 [0,4194304] 0 2024-02-19T19:07:33.228 INFO:tasks.workunit.client.1.smithi142.stdout:4/397: fsync d4/f5 0 2024-02-19T19:07:33.228 INFO:tasks.workunit.client.1.smithi142.stdout:6/258: getdents d2/d1e 0 2024-02-19T19:07:33.230 INFO:tasks.workunit.client.1.smithi142.stdout:4/398: dread d4/d1c/f4b [0,4194304] 0 2024-02-19T19:07:33.230 INFO:tasks.workunit.client.1.smithi142.stdout:4/399: stat d4/d14/d31/d43/d52/d6e 0 2024-02-19T19:07:33.233 INFO:tasks.workunit.client.1.smithi142.stdout:5/357: dwrite d5/dd/df/d22/f37 [0,4194304] 0 2024-02-19T19:07:33.233 INFO:tasks.workunit.client.1.smithi142.stdout:4/400: rmdir d4/d1d/d42/d66/d12/d79 39 2024-02-19T19:07:33.235 INFO:tasks.workunit.client.1.smithi142.stdout:8/382: sync 2024-02-19T19:07:33.235 INFO:tasks.workunit.client.1.smithi142.stdout:8/383: write d9/dd/f5c [705655,77443] 0 2024-02-19T19:07:33.235 INFO:tasks.workunit.client.1.smithi142.stdout:8/384: write d9/dd/de/d2d/d2e/d49/d50/d59/f6a [57760,94970] 0 2024-02-19T19:07:33.235 INFO:tasks.workunit.client.1.smithi142.stdout:8/385: truncate d9/dd/d44/d79/f25 1755508 0 2024-02-19T19:07:33.236 INFO:tasks.workunit.client.1.smithi142.stdout:8/386: dread d9/dd/d44/d79/f27 [0,4194304] 0 2024-02-19T19:07:33.237 INFO:tasks.workunit.client.1.smithi142.stdout:2/339: dwrite d3/d4d/f6c [0,4194304] 0 2024-02-19T19:07:33.238 INFO:tasks.workunit.client.1.smithi142.stdout:5/358: unlink d5/dd/df/c61 0 2024-02-19T19:07:33.240 INFO:tasks.workunit.client.1.smithi142.stdout:4/401: mknod d4/d1d/d42/d66/d12/d2d/c88 0 2024-02-19T19:07:33.242 INFO:tasks.workunit.client.1.smithi142.stdout:8/387: creat d9/dd/de/d2d/d2e/d49/d74/f7a x:0 0 0 2024-02-19T19:07:33.245 INFO:tasks.workunit.client.1.smithi142.stdout:6/259: dread d2/f14 [4194304,4194304] 0 2024-02-19T19:07:33.245 INFO:tasks.workunit.client.1.smithi142.stdout:0/309: dwrite fb [0,4194304] 0 2024-02-19T19:07:33.248 INFO:tasks.workunit.client.1.smithi142.stdout:6/260: unlink d2/d1f/l4f 0 2024-02-19T19:07:33.250 INFO:tasks.workunit.client.1.smithi142.stdout:0/310: mkdir d23/d28/d2d/d51/d67 0 2024-02-19T19:07:33.250 INFO:tasks.workunit.client.1.smithi142.stdout:0/311: write d23/d28/d2d/d51/d44/f4d [1183248,119926] 0 2024-02-19T19:07:33.250 INFO:tasks.workunit.client.1.smithi142.stdout:2/340: write d3/df/f14 [6899868,92285] 0 2024-02-19T19:07:33.250 INFO:tasks.workunit.client.1.smithi142.stdout:2/341: fsync d3/d4d/f69 0 2024-02-19T19:07:33.250 INFO:tasks.workunit.client.1.smithi142.stdout:2/342: dread - d3/df/f31 zero size 2024-02-19T19:07:33.251 INFO:tasks.workunit.client.1.smithi142.stdout:4/402: truncate d4/d1d/d42/d66/d12/d2d/f69 2999394 0 2024-02-19T19:07:33.251 INFO:tasks.workunit.client.1.smithi142.stdout:8/388: dread d9/dd/f1d [0,4194304] 0 2024-02-19T19:07:33.251 INFO:tasks.workunit.client.1.smithi142.stdout:8/389: truncate d9/dd/f1c 8530493 0 2024-02-19T19:07:33.251 INFO:tasks.workunit.client.1.smithi142.stdout:8/390: readlink d9/dd/de/l3f 0 2024-02-19T19:07:33.252 INFO:tasks.workunit.client.1.smithi142.stdout:6/261: symlink d2/d17/d33/l54 0 2024-02-19T19:07:33.254 INFO:tasks.workunit.client.1.smithi142.stdout:0/312: rmdir d23/d28/d2d/d51/d67 0 2024-02-19T19:07:33.254 INFO:tasks.workunit.client.1.smithi142.stdout:0/313: write d23/f46 [779171,71405] 0 2024-02-19T19:07:33.255 INFO:tasks.workunit.client.1.smithi142.stdout:0/314: dread - d23/d32/f5b zero size 2024-02-19T19:07:33.258 INFO:tasks.workunit.client.1.smithi142.stdout:8/391: dread d9/dd/d15/f1f [0,4194304] 0 2024-02-19T19:07:33.258 INFO:tasks.workunit.client.1.smithi142.stdout:8/392: dread - d9/dd/f68 zero size 2024-02-19T19:07:33.258 INFO:tasks.workunit.client.1.smithi142.stdout:8/393: creat d9/dd/de/d2d/d2e/d49/d50/f7b x:0 0 0 2024-02-19T19:07:33.258 INFO:tasks.workunit.client.1.smithi142.stdout:2/343: rename d3/db/d29/d4c/d46 to d3/db/d29/d6d 0 2024-02-19T19:07:33.258 INFO:tasks.workunit.client.1.smithi142.stdout:0/315: stat d23/d28/d2d/l59 0 2024-02-19T19:07:33.263 INFO:tasks.workunit.client.1.smithi142.stdout:6/262: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:33.263 INFO:tasks.workunit.client.1.smithi142.stdout:8/394: symlink d9/dd/de/d14/d65/l7c 0 2024-02-19T19:07:33.264 INFO:tasks.workunit.client.1.smithi142.stdout:6/263: mkdir d2/d17/d51/d55 0 2024-02-19T19:07:33.266 INFO:tasks.workunit.client.1.smithi142.stdout:8/395: symlink d9/dd/de/d2d/d2e/d49/d50/d59/l7d 0 2024-02-19T19:07:33.266 INFO:tasks.workunit.client.1.smithi142.stdout:8/396: write d9/dd/de/d2d/d2e/d49/d50/d59/f6a [851668,90452] 0 2024-02-19T19:07:33.268 INFO:tasks.workunit.client.1.smithi142.stdout:2/344: dread d3/df/f2b [0,4194304] 0 2024-02-19T19:07:33.268 INFO:tasks.workunit.client.1.smithi142.stdout:5/359: dwrite d5/dd/f70 [0,4194304] 0 2024-02-19T19:07:33.269 INFO:tasks.workunit.client.1.smithi142.stdout:4/403: dwrite d4/d1d/d42/d66/d2c/f3d [0,4194304] 0 2024-02-19T19:07:33.269 INFO:tasks.workunit.client.1.smithi142.stdout:6/264: mkdir d2/d1f/d56 0 2024-02-19T19:07:33.276 INFO:tasks.workunit.client.1.smithi142.stdout:4/404: dread d4/d1d/d42/d66/d12/d79/f85 [0,4194304] 0 2024-02-19T19:07:33.276 INFO:tasks.workunit.client.1.smithi142.stdout:4/405: fdatasync d4/d1d/d42/d66/d12/f7f 0 2024-02-19T19:07:33.276 INFO:tasks.workunit.client.1.smithi142.stdout:4/406: write d4/d1c/f2e [910486,78579] 0 2024-02-19T19:07:33.276 INFO:tasks.workunit.client.1.smithi142.stdout:2/345: unlink d3/db/l3e 0 2024-02-19T19:07:33.278 INFO:tasks.workunit.client.1.smithi142.stdout:5/360: rename d5/dd/d8/d2a/d57/l58 to d5/dd/df/d22/d41/d32/d53/l77 0 2024-02-19T19:07:33.282 INFO:tasks.workunit.client.1.smithi142.stdout:6/265: creat d2/d1f/d45/f57 x:0 0 0 2024-02-19T19:07:33.282 INFO:tasks.workunit.client.1.smithi142.stdout:6/266: read - d2/d17/d33/f53 zero size 2024-02-19T19:07:33.285 INFO:tasks.workunit.client.1.smithi142.stdout:2/346: rmdir d3/db/d5e 0 2024-02-19T19:07:33.285 INFO:tasks.workunit.client.1.smithi142.stdout:5/361: dread d5/dd/df/f12 [0,4194304] 0 2024-02-19T19:07:33.285 INFO:tasks.workunit.client.1.smithi142.stdout:2/347: fdatasync d3/db/f15 0 2024-02-19T19:07:33.285 INFO:tasks.workunit.client.1.smithi142.stdout:2/348: chown d3/db/d29/d6d/d59 380 1 2024-02-19T19:07:33.286 INFO:tasks.workunit.client.1.smithi142.stdout:2/349: readlink d3/d35/d53/l67 0 2024-02-19T19:07:33.287 INFO:tasks.workunit.client.1.smithi142.stdout:4/407: rename d4/d1d/f35 to d4/d1d/d42/d66/dd/d10/d3b/f89 0 2024-02-19T19:07:33.288 INFO:tasks.workunit.client.1.smithi142.stdout:4/408: read - d4/d1d/d42/d66/d12/d2d/f75 zero size 2024-02-19T19:07:33.289 INFO:tasks.workunit.client.1.smithi142.stdout:4/409: dread d4/d1c/f4b [0,4194304] 0 2024-02-19T19:07:33.289 INFO:tasks.workunit.client.1.smithi142.stdout:4/410: write d4/d1d/d42/d66/dd/d10/d3e/d68/f78 [940968,64874] 0 2024-02-19T19:07:33.289 INFO:tasks.workunit.client.1.smithi142.stdout:2/350: creat d3/db/d29/d6d/d59/f6e x:0 0 0 2024-02-19T19:07:33.290 INFO:tasks.workunit.client.1.smithi142.stdout:2/351: creat d3/d35/d53/f6f x:0 0 0 2024-02-19T19:07:33.293 INFO:tasks.workunit.client.1.smithi142.stdout:5/362: write d5/dd/d8/d31/f34 [4022891,13465] 0 2024-02-19T19:07:33.293 INFO:tasks.workunit.client.1.smithi142.stdout:5/363: fdatasync d5/dd/f70 0 2024-02-19T19:07:33.294 INFO:tasks.workunit.client.1.smithi142.stdout:5/364: fsync d5/f2c 0 2024-02-19T19:07:33.294 INFO:tasks.workunit.client.1.smithi142.stdout:5/365: creat d5/dd/d8/d29/f78 x:0 0 0 2024-02-19T19:07:33.294 INFO:tasks.workunit.client.1.smithi142.stdout:5/366: stat f4 0 2024-02-19T19:07:33.294 INFO:tasks.workunit.client.1.smithi142.stdout:4/411: creat d4/d1d/d42/d66/f8a x:0 0 0 2024-02-19T19:07:33.296 INFO:tasks.workunit.client.1.smithi142.stdout:2/352: creat d3/db/f70 x:0 0 0 2024-02-19T19:07:33.297 INFO:tasks.workunit.client.1.smithi142.stdout:8/397: truncate d9/dd/f1c 764628 0 2024-02-19T19:07:33.297 INFO:tasks.workunit.client.1.smithi142.stdout:6/267: dwrite d2/d1f/d20/f25 [0,4194304] 0 2024-02-19T19:07:33.298 INFO:tasks.workunit.client.1.smithi142.stdout:5/367: creat d5/dd/df/d15/d5b/f79 x:0 0 0 2024-02-19T19:07:33.299 INFO:tasks.workunit.client.1.smithi142.stdout:5/368: dread - d5/dd/d8/d31/d4d/d60/f73 zero size 2024-02-19T19:07:33.300 INFO:tasks.workunit.client.1.smithi142.stdout:4/412: creat d4/d1d/d42/d66/f8b x:0 0 0 2024-02-19T19:07:33.302 INFO:tasks.workunit.client.1.smithi142.stdout:2/353: symlink d3/db/d29/d6d/d59/d64/l71 0 2024-02-19T19:07:33.303 INFO:tasks.workunit.client.1.smithi142.stdout:8/398: getdents d9/dd/de/d2d 0 2024-02-19T19:07:33.305 INFO:tasks.workunit.client.1.smithi142.stdout:6/268: dread d2/d1f/d20/f25 [0,4194304] 0 2024-02-19T19:07:33.308 INFO:tasks.workunit.client.1.smithi142.stdout:4/413: mkdir d4/d1d/d42/d66/d12/d79/d8c 0 2024-02-19T19:07:33.308 INFO:tasks.workunit.client.1.smithi142.stdout:4/414: fsync d4/d14/d31/d43/f5d 0 2024-02-19T19:07:33.308 INFO:tasks.workunit.client.1.smithi142.stdout:4/415: chown d4/d1d/f5b 29135755 1 2024-02-19T19:07:33.310 INFO:tasks.workunit.client.1.smithi142.stdout:2/354: rename d3/df/f14 to d3/d4d/d5f/f72 0 2024-02-19T19:07:33.310 INFO:tasks.workunit.client.1.smithi142.stdout:2/355: creat d3/f73 x:0 0 0 2024-02-19T19:07:33.311 INFO:tasks.workunit.client.1.smithi142.stdout:4/416: read d4/d14/d31/d43/d52/f63 [659720,2545] 0 2024-02-19T19:07:33.311 INFO:tasks.workunit.client.1.smithi142.stdout:4/417: creat d4/d14/d31/f8d x:0 0 0 2024-02-19T19:07:33.311 INFO:tasks.workunit.client.1.smithi142.stdout:4/418: dread - d4/d14/d31/f8d zero size 2024-02-19T19:07:33.312 INFO:tasks.workunit.client.1.smithi142.stdout:2/356: symlink d3/d4b/l74 0 2024-02-19T19:07:33.312 INFO:tasks.workunit.client.1.smithi142.stdout:8/399: getdents d9/dd/de/d2d/d2e/d49/d50 0 2024-02-19T19:07:33.313 INFO:tasks.workunit.client.1.smithi142.stdout:4/419: creat d4/d1d/d42/d66/f8e x:0 0 0 2024-02-19T19:07:33.314 INFO:tasks.workunit.client.1.smithi142.stdout:5/369: dwrite d5/dd/df/d22/d41/d32/f74 [0,4194304] 0 2024-02-19T19:07:33.315 INFO:tasks.workunit.client.1.smithi142.stdout:8/400: creat d9/f7e x:0 0 0 2024-02-19T19:07:33.317 INFO:tasks.workunit.client.1.smithi142.stdout:7/281: sync 2024-02-19T19:07:33.317 INFO:tasks.workunit.client.1.smithi142.stdout:6/269: read d2/d17/d33/d39/f49 [393610,13354] 0 2024-02-19T19:07:33.318 INFO:tasks.workunit.client.1.smithi142.stdout:6/270: creat d2/d1f/d20/d31/d3d/d3e/f58 x:0 0 0 2024-02-19T19:07:33.319 INFO:tasks.workunit.client.1.smithi142.stdout:7/282: symlink d0/d13/d1e/l5b 0 2024-02-19T19:07:33.319 INFO:tasks.workunit.client.1.smithi142.stdout:7/283: write d0/d1b/d21/d24/d29/d2d/f40 [759728,83341] 0 2024-02-19T19:07:33.322 INFO:tasks.workunit.client.1.smithi142.stdout:6/271: mknod d2/d29/c59 0 2024-02-19T19:07:33.322 INFO:tasks.workunit.client.1.smithi142.stdout:6/272: creat d2/d17/d33/f5a x:0 0 0 2024-02-19T19:07:33.322 INFO:tasks.workunit.client.1.smithi142.stdout:6/273: creat d2/d29/d47/f5b x:0 0 0 2024-02-19T19:07:33.323 INFO:tasks.workunit.client.1.smithi142.stdout:2/357: fsync d3/db/d29/f41 0 2024-02-19T19:07:33.324 INFO:tasks.workunit.client.1.smithi142.stdout:4/420: write d4/d1d/d42/d66/d12/d2d/f33 [2044175,12449] 0 2024-02-19T19:07:33.328 INFO:tasks.workunit.client.1.smithi142.stdout:2/358: creat d3/db/d29/d4c/d4a/f75 x:0 0 0 2024-02-19T19:07:33.331 INFO:tasks.workunit.client.1.smithi142.stdout:4/421: symlink d4/d1d/d42/d66/d12/d2d/d2a/d84/l8f 0 2024-02-19T19:07:33.331 INFO:tasks.workunit.client.1.smithi142.stdout:4/422: readlink d4/d14/d31/d43/d52/l73 0 2024-02-19T19:07:33.331 INFO:tasks.workunit.client.1.smithi142.stdout:4/423: chown d4/d1d/d42/d66/d12/d2d/c23 0 1 2024-02-19T19:07:33.331 INFO:tasks.workunit.client.1.smithi142.stdout:4/424: read - d4/d1d/d42/d66/f8a zero size 2024-02-19T19:07:33.332 INFO:tasks.workunit.client.1.smithi142.stdout:4/425: truncate d4/d1d/d42/d66/d12/f18 1664051 0 2024-02-19T19:07:33.333 INFO:tasks.workunit.client.1.smithi142.stdout:4/426: getdents d4/d1d/d42/d66/d12/d79 0 2024-02-19T19:07:33.333 INFO:tasks.workunit.client.1.smithi142.stdout:4/427: fsync d4/d1c/f2e 0 2024-02-19T19:07:33.338 INFO:tasks.workunit.client.1.smithi142.stdout:6/274: write d2/f9 [369239,34341] 0 2024-02-19T19:07:33.338 INFO:tasks.workunit.client.1.smithi142.stdout:8/401: dwrite d9/dd/d15/f1f [0,4194304] 0 2024-02-19T19:07:33.338 INFO:tasks.workunit.client.1.smithi142.stdout:8/402: readlink d9/la 0 2024-02-19T19:07:33.338 INFO:tasks.workunit.client.1.smithi142.stdout:5/370: dwrite d5/dd/f1e [0,4194304] 0 2024-02-19T19:07:33.338 INFO:tasks.workunit.client.1.smithi142.stdout:5/371: chown d5/dd/df/d22/d41/d32/d53/l77 3 1 2024-02-19T19:07:33.338 INFO:tasks.workunit.client.1.smithi142.stdout:5/372: write d5/dd/df/f6b [287748,126289] 0 2024-02-19T19:07:33.339 INFO:tasks.workunit.client.1.smithi142.stdout:7/284: dread d0/d1b/d21/d24/d29/d2d/f40 [0,4194304] 0 2024-02-19T19:07:33.339 INFO:tasks.workunit.client.1.smithi142.stdout:7/285: chown d0/d1b/d21/d24/d29/d2d/c3b 1520977564 1 2024-02-19T19:07:33.339 INFO:tasks.workunit.client.1.smithi142.stdout:7/286: write d0/d13/f1f [477168,37659] 0 2024-02-19T19:07:33.339 INFO:tasks.workunit.client.1.smithi142.stdout:7/287: creat d0/d13/d1e/f5c x:0 0 0 2024-02-19T19:07:33.339 INFO:tasks.workunit.client.1.smithi142.stdout:7/288: readlink d0/l37 0 2024-02-19T19:07:33.339 INFO:tasks.workunit.client.1.smithi142.stdout:7/289: readlink d0/d13/l1a 0 2024-02-19T19:07:33.341 INFO:tasks.workunit.client.1.smithi142.stdout:6/275: rename d2/d17/d33/d3c to d2/d1f/d5c 0 2024-02-19T19:07:33.342 INFO:tasks.workunit.client.1.smithi142.stdout:4/428: dread d4/d1d/d42/d66/d12/d79/f85 [0,4194304] 0 2024-02-19T19:07:33.343 INFO:tasks.workunit.client.1.smithi142.stdout:8/403: dread d9/dd/de/d14/f20 [0,4194304] 0 2024-02-19T19:07:33.343 INFO:tasks.workunit.client.1.smithi142.stdout:5/373: creat d5/dd/df/d15/f7a x:0 0 0 2024-02-19T19:07:33.343 INFO:tasks.workunit.client.1.smithi142.stdout:8/404: truncate d9/dd/f57 606252 0 2024-02-19T19:07:33.344 INFO:tasks.workunit.client.1.smithi142.stdout:8/405: creat d9/dd/de/d2d/d2e/d49/d50/d59/f7f x:0 0 0 2024-02-19T19:07:33.349 INFO:tasks.workunit.client.1.smithi142.stdout:2/359: dwrite d3/d4d/f6c [0,4194304] 0 2024-02-19T19:07:33.349 INFO:tasks.workunit.client.1.smithi142.stdout:7/290: unlink d0/l11 0 2024-02-19T19:07:33.349 INFO:tasks.workunit.client.1.smithi142.stdout:6/276: rmdir d2/d1e/d35 39 2024-02-19T19:07:33.349 INFO:tasks.workunit.client.1.smithi142.stdout:6/277: creat d2/d1f/f5d x:0 0 0 2024-02-19T19:07:33.355 INFO:tasks.workunit.client.1.smithi142.stdout:4/429: symlink d4/d1d/d42/d66/d12/d79/l90 0 2024-02-19T19:07:33.355 INFO:tasks.workunit.client.1.smithi142.stdout:4/430: creat d4/d1d/d42/d66/d12/d2d/f91 x:0 0 0 2024-02-19T19:07:33.355 INFO:tasks.workunit.client.1.smithi142.stdout:9/406: sync 2024-02-19T19:07:33.355 INFO:tasks.workunit.client.1.smithi142.stdout:9/407: write db/f68 [96579,106833] 0 2024-02-19T19:07:33.359 INFO:tasks.workunit.client.1.smithi142.stdout:7/291: mknod d0/d1b/d21/d24/d29/d2d/c5d 0 2024-02-19T19:07:33.359 INFO:tasks.workunit.client.1.smithi142.stdout:7/292: write d0/d1b/f5a [298626,43754] 0 2024-02-19T19:07:33.359 INFO:tasks.workunit.client.1.smithi142.stdout:7/293: readlink d0/l37 0 2024-02-19T19:07:33.362 INFO:tasks.workunit.client.1.smithi142.stdout:4/431: symlink d4/l92 0 2024-02-19T19:07:33.362 INFO:tasks.workunit.client.1.smithi142.stdout:5/374: dread d5/dd/df/d22/d41/f26 [4194304,4194304] 0 2024-02-19T19:07:33.363 INFO:tasks.workunit.client.1.smithi142.stdout:8/406: dread d9/dd/d44/d79/f35 [0,4194304] 0 2024-02-19T19:07:33.364 INFO:tasks.workunit.client.1.smithi142.stdout:4/432: dread d4/d1c/f4b [0,4194304] 0 2024-02-19T19:07:33.364 INFO:tasks.workunit.client.1.smithi142.stdout:4/433: chown d4/d14/d31/d43/f5d 128574050 1 2024-02-19T19:07:33.364 INFO:tasks.workunit.client.1.smithi142.stdout:5/375: creat d5/dd/d5f/f7b x:0 0 0 2024-02-19T19:07:33.366 INFO:tasks.workunit.client.1.smithi142.stdout:6/278: dwrite d2/d29/d47/f4a [0,4194304] 0 2024-02-19T19:07:33.366 INFO:tasks.workunit.client.1.smithi142.stdout:9/408: write db/f18 [1710830,37918] 0 2024-02-19T19:07:33.366 INFO:tasks.workunit.client.1.smithi142.stdout:4/434: symlink d4/d1d/d42/d66/d12/d2d/d2a/d84/l93 0 2024-02-19T19:07:33.366 INFO:tasks.workunit.client.1.smithi142.stdout:4/435: dread - d4/d1d/d42/d66/d12/d2d/f91 zero size 2024-02-19T19:07:33.366 INFO:tasks.workunit.client.1.smithi142.stdout:9/409: write db/d10/d32/d3f/f63 [516433,79857] 0 2024-02-19T19:07:33.370 INFO:tasks.workunit.client.1.smithi142.stdout:2/360: dwrite d3/db/f3a [0,4194304] 0 2024-02-19T19:07:33.370 INFO:tasks.workunit.client.1.smithi142.stdout:2/361: truncate d3/d4d/f57 483633 0 2024-02-19T19:07:33.370 INFO:tasks.workunit.client.1.smithi142.stdout:2/362: fdatasync d3/db/d29/d6d/f56 0 2024-02-19T19:07:33.370 INFO:tasks.workunit.client.1.smithi142.stdout:2/363: truncate d3/d35/f66 634115 0 2024-02-19T19:07:33.371 INFO:tasks.workunit.client.1.smithi142.stdout:2/364: write d3/d35/f48 [443539,49713] 0 2024-02-19T19:07:33.371 INFO:tasks.workunit.client.1.smithi142.stdout:2/365: chown d3/db/d29/d4c/d4e/c5b 231 1 2024-02-19T19:07:33.371 INFO:tasks.workunit.client.1.smithi142.stdout:1/472: sync 2024-02-19T19:07:33.371 INFO:tasks.workunit.client.1.smithi142.stdout:3/489: sync 2024-02-19T19:07:33.371 INFO:tasks.workunit.client.1.smithi142.stdout:0/316: sync 2024-02-19T19:07:33.371 INFO:tasks.workunit.client.1.smithi142.stdout:0/317: fdatasync f11 0 2024-02-19T19:07:33.372 INFO:tasks.workunit.client.1.smithi142.stdout:3/490: chown d1d/d1e/f32 691 1 2024-02-19T19:07:33.372 INFO:tasks.workunit.client.1.smithi142.stdout:6/279: getdents d2/d1e/d35 0 2024-02-19T19:07:33.372 INFO:tasks.workunit.client.1.smithi142.stdout:6/280: stat d2/d1f/d20/l2f 0 2024-02-19T19:07:33.374 INFO:tasks.workunit.client.1.smithi142.stdout:9/410: link db/d10/d22/d24/f3e db/d10/d27/d2f/d4c/f7a 0 2024-02-19T19:07:33.374 INFO:tasks.workunit.client.1.smithi142.stdout:9/411: truncate db/d10/d22/f50 403867 0 2024-02-19T19:07:33.377 INFO:tasks.workunit.client.1.smithi142.stdout:1/473: unlink d5/d7/d34/l57 0 2024-02-19T19:07:33.379 INFO:tasks.workunit.client.1.smithi142.stdout:3/491: truncate f19 6815360 0 2024-02-19T19:07:33.379 INFO:tasks.workunit.client.1.smithi142.stdout:0/318: rmdir d23/d28/d2d/d51/d44 39 2024-02-19T19:07:33.381 INFO:tasks.workunit.client.1.smithi142.stdout:6/281: mkdir d2/d17/d33/d42/d5e 0 2024-02-19T19:07:33.381 INFO:tasks.workunit.client.1.smithi142.stdout:6/282: readlink d2/d1f/l23 0 2024-02-19T19:07:33.383 INFO:tasks.workunit.client.1.smithi142.stdout:9/412: link db/d10/d32/d3f/d5f/c66 db/d10/d32/c7b 0 2024-02-19T19:07:33.383 INFO:tasks.workunit.client.1.smithi142.stdout:9/413: dread - db/d10/d27/f6d zero size 2024-02-19T19:07:33.383 INFO:tasks.workunit.client.1.smithi142.stdout:8/407: dwrite d9/dd/d44/d79/f39 [0,4194304] 0 2024-02-19T19:07:33.383 INFO:tasks.workunit.client.1.smithi142.stdout:8/408: chown d9/dd/f1d 30707 1 2024-02-19T19:07:33.384 INFO:tasks.workunit.client.1.smithi142.stdout:2/366: dread d3/df/f10 [0,4194304] 0 2024-02-19T19:07:33.385 INFO:tasks.workunit.client.1.smithi142.stdout:3/492: truncate d1d/d1e/f21 1705453 0 2024-02-19T19:07:33.388 INFO:tasks.workunit.client.1.smithi142.stdout:4/436: dwrite d4/d1d/d42/d66/d12/d79/f85 [0,4194304] 0 2024-02-19T19:07:33.388 INFO:tasks.workunit.client.1.smithi142.stdout:4/437: read d4/d1d/d42/d66/d12/d2d/f33 [185625,26356] 0 2024-02-19T19:07:33.388 INFO:tasks.workunit.client.1.smithi142.stdout:0/319: rename d23/d32/c27 to d23/d28/c68 0 2024-02-19T19:07:33.389 INFO:tasks.workunit.client.1.smithi142.stdout:1/474: dread d5/d7/d4a/d53/f99 [0,4194304] 0 2024-02-19T19:07:33.389 INFO:tasks.workunit.client.1.smithi142.stdout:6/283: unlink d2/d17/l32 0 2024-02-19T19:07:33.398 INFO:tasks.workunit.client.1.smithi142.stdout:8/409: getdents d9/dd/d44 0 2024-02-19T19:07:33.399 INFO:tasks.workunit.client.1.smithi142.stdout:2/367: symlink d3/l76 0 2024-02-19T19:07:33.401 INFO:tasks.workunit.client.1.smithi142.stdout:3/493: symlink d1d/d36/d3a/d62/d8d/l8f 0 2024-02-19T19:07:33.402 INFO:tasks.workunit.client.1.smithi142.stdout:4/438: symlink d4/d1d/d42/d66/dd/d10/l94 0 2024-02-19T19:07:33.402 INFO:tasks.workunit.client.1.smithi142.stdout:4/439: dread - d4/d1d/d42/d66/dd/f7b zero size 2024-02-19T19:07:33.404 INFO:tasks.workunit.client.1.smithi142.stdout:1/475: mkdir d5/d7/d23/da4 0 2024-02-19T19:07:33.404 INFO:tasks.workunit.client.1.smithi142.stdout:9/414: rename db/d10/d27/l38 to db/d10/l7c 0 2024-02-19T19:07:33.405 INFO:tasks.workunit.client.1.smithi142.stdout:1/476: dread - d5/d7/d4a/d53/d6a/f9c zero size 2024-02-19T19:07:33.405 INFO:tasks.workunit.client.1.smithi142.stdout:9/415: getdents db/d10/d27/d2f/d4c/d54 0 2024-02-19T19:07:33.405 INFO:tasks.workunit.client.1.smithi142.stdout:8/410: read d9/dd/d44/d79/f25 [1518602,76067] 0 2024-02-19T19:07:33.406 INFO:tasks.workunit.client.1.smithi142.stdout:4/440: rename d4/d1d/d42/c5a to d4/d1d/d42/d66/d12/d79/d8c/c95 0 2024-02-19T19:07:33.407 INFO:tasks.workunit.client.1.smithi142.stdout:8/411: symlink d9/dd/d15/d31/l80 0 2024-02-19T19:07:33.408 INFO:tasks.workunit.client.1.smithi142.stdout:8/412: write d9/dd/de/d14/f6e [1514267,38533] 0 2024-02-19T19:07:33.408 INFO:tasks.workunit.client.1.smithi142.stdout:8/413: getdents d9/dd/de/d2d 0 2024-02-19T19:07:33.408 INFO:tasks.workunit.client.1.smithi142.stdout:8/414: fdatasync d9/dd/de/d2d/d2e/d49/d50/f64 0 2024-02-19T19:07:33.408 INFO:tasks.workunit.client.1.smithi142.stdout:8/415: symlink d9/dd/de/d2d/d2e/d49/l81 0 2024-02-19T19:07:33.415 INFO:tasks.workunit.client.1.smithi142.stdout:3/494: dread d1d/d1e/f5d [0,4194304] 0 2024-02-19T19:07:33.416 INFO:tasks.workunit.client.1.smithi142.stdout:3/495: readlink d1d/d1e/d2e/d37/l44 0 2024-02-19T19:07:33.417 INFO:tasks.workunit.client.1.smithi142.stdout:3/496: rmdir d1d/d36/d3a/d62/d8d 39 2024-02-19T19:07:33.418 INFO:tasks.workunit.client.1.smithi142.stdout:3/497: fsync d1d/d1e/d2e/f3f 0 2024-02-19T19:07:33.418 INFO:tasks.workunit.client.1.smithi142.stdout:3/498: creat d1d/d1e/d2e/d50/f90 x:0 0 0 2024-02-19T19:07:33.418 INFO:tasks.workunit.client.1.smithi142.stdout:1/477: dread d5/d37/d6c/f85 [0,4194304] 0 2024-02-19T19:07:33.418 INFO:tasks.workunit.client.1.smithi142.stdout:1/478: chown d5/d7/d34/f7a 0 1 2024-02-19T19:07:33.419 INFO:tasks.workunit.client.1.smithi142.stdout:3/499: mkdir d1d/d36/d3a/d62/d91 0 2024-02-19T19:07:33.419 INFO:tasks.workunit.client.1.smithi142.stdout:3/500: truncate d1d/d1e/f6b 1142406 0 2024-02-19T19:07:33.420 INFO:tasks.workunit.client.1.smithi142.stdout:1/479: rename d5/d7/d4a/f82 to d5/d7/d4a/d53/d6a/fa5 0 2024-02-19T19:07:33.421 INFO:tasks.workunit.client.1.smithi142.stdout:1/480: mknod d5/d7/ca6 0 2024-02-19T19:07:33.422 INFO:tasks.workunit.client.1.smithi142.stdout:3/501: getdents d1d/d36 0 2024-02-19T19:07:33.422 INFO:tasks.workunit.client.1.smithi142.stdout:3/502: write d1d/d1e/d2e/d37/f4a [197796,20106] 0 2024-02-19T19:07:33.430 INFO:tasks.workunit.client.1.smithi142.stdout:0/320: dwrite f16 [4194304,4194304] 0 2024-02-19T19:07:33.432 INFO:tasks.workunit.client.1.smithi142.stdout:0/321: getdents d23/d28/d2d/d51/d44/d58 0 2024-02-19T19:07:33.433 INFO:tasks.workunit.client.1.smithi142.stdout:0/322: creat d23/d28/d41/f69 x:0 0 0 2024-02-19T19:07:33.436 INFO:tasks.workunit.client.1.smithi142.stdout:6/284: dwrite d2/d1f/f30 [0,4194304] 0 2024-02-19T19:07:33.438 INFO:tasks.workunit.client.1.smithi142.stdout:6/285: unlink d2/d17/d33/l54 0 2024-02-19T19:07:33.438 INFO:tasks.workunit.client.1.smithi142.stdout:6/286: write d2/d17/d33/d42/f4b [279811,68895] 0 2024-02-19T19:07:33.449 INFO:tasks.workunit.client.1.smithi142.stdout:0/323: write d23/f3a [3399218,70626] 0 2024-02-19T19:07:33.450 INFO:tasks.workunit.client.1.smithi142.stdout:2/368: dwrite d3/df/f10 [0,4194304] 0 2024-02-19T19:07:33.456 INFO:tasks.workunit.client.1.smithi142.stdout:4/441: dwrite d4/d1d/d42/d66/f8a [0,4194304] 0 2024-02-19T19:07:33.456 INFO:tasks.workunit.client.1.smithi142.stdout:9/416: dwrite db/f16 [4194304,4194304] 0 2024-02-19T19:07:33.458 INFO:tasks.workunit.client.1.smithi142.stdout:0/324: rename fb to d23/d32/f6a 0 2024-02-19T19:07:33.459 INFO:tasks.workunit.client.1.smithi142.stdout:6/287: dwrite d2/d1f/d20/d31/d3d/d3e/f58 [0,4194304] 0 2024-02-19T19:07:33.464 INFO:tasks.workunit.client.1.smithi142.stdout:1/481: dwrite d5/d37/d6c/f7c [0,4194304] 0 2024-02-19T19:07:33.464 INFO:tasks.workunit.client.1.smithi142.stdout:3/503: dwrite f5 [0,4194304] 0 2024-02-19T19:07:33.465 INFO:tasks.workunit.client.1.smithi142.stdout:3/504: readlink d1d/d36/d3a/d62/l7d 0 2024-02-19T19:07:33.465 INFO:tasks.workunit.client.1.smithi142.stdout:6/288: creat d2/f5f x:0 0 0 2024-02-19T19:07:33.467 INFO:tasks.workunit.client.1.smithi142.stdout:2/369: getdents d3/d35/d53 0 2024-02-19T19:07:33.473 INFO:tasks.workunit.client.1.smithi142.stdout:3/505: mkdir d1d/d36/d3a/d62/d8d/d92 0 2024-02-19T19:07:33.473 INFO:tasks.workunit.client.1.smithi142.stdout:3/506: read - d1d/d36/f84 zero size 2024-02-19T19:07:33.473 INFO:tasks.workunit.client.1.smithi142.stdout:3/507: truncate d1d/d1e/d2e/d50/f69 734845 0 2024-02-19T19:07:33.473 INFO:tasks.workunit.client.1.smithi142.stdout:3/508: stat d1d/f41 0 2024-02-19T19:07:33.473 INFO:tasks.workunit.client.1.smithi142.stdout:3/509: creat d1d/d1e/d2e/d50/f93 x:0 0 0 2024-02-19T19:07:33.473 INFO:tasks.workunit.client.1.smithi142.stdout:6/289: mkdir d2/d1f/d4d/d60 0 2024-02-19T19:07:33.475 INFO:tasks.workunit.client.1.smithi142.stdout:3/510: truncate d1d/f41 1517767 0 2024-02-19T19:07:33.477 INFO:tasks.workunit.client.1.smithi142.stdout:1/482: dread d5/d37/f52 [0,4194304] 0 2024-02-19T19:07:33.477 INFO:tasks.workunit.client.1.smithi142.stdout:1/483: write d5/d7/d4a/d53/d6a/f84 [31662,58621] 0 2024-02-19T19:07:33.477 INFO:tasks.workunit.client.1.smithi142.stdout:6/290: mknod d2/d1f/d20/d31/d3d/d3e/c61 0 2024-02-19T19:07:33.477 INFO:tasks.workunit.client.1.smithi142.stdout:6/291: dread - d2/d17/d33/f53 zero size 2024-02-19T19:07:33.477 INFO:tasks.workunit.client.1.smithi142.stdout:6/292: chown d2/d17/d33/d42/l4e 167639 1 2024-02-19T19:07:33.478 INFO:tasks.workunit.client.1.smithi142.stdout:6/293: fsync d2/d1f/d20/d31/d3d/f50 0 2024-02-19T19:07:33.478 INFO:tasks.workunit.client.1.smithi142.stdout:6/294: read d2/d17/f24 [1006730,126511] 0 2024-02-19T19:07:33.478 INFO:tasks.workunit.client.1.smithi142.stdout:2/370: dread d3/db/f3a [0,4194304] 0 2024-02-19T19:07:33.479 INFO:tasks.workunit.client.1.smithi142.stdout:6/295: mkdir d2/d1f/d20/d31/d62 0 2024-02-19T19:07:33.481 INFO:tasks.workunit.client.1.smithi142.stdout:2/371: creat d3/db/d29/d4c/f77 x:0 0 0 2024-02-19T19:07:33.481 INFO:tasks.workunit.client.1.smithi142.stdout:2/372: fsync d3/d4d/d5f/f72 0 2024-02-19T19:07:33.481 INFO:tasks.workunit.client.1.smithi142.stdout:2/373: creat d3/db/d29/d6d/d59/f78 x:0 0 0 2024-02-19T19:07:33.481 INFO:tasks.workunit.client.1.smithi142.stdout:2/374: write d3/d4d/f69 [512342,94581] 0 2024-02-19T19:07:33.481 INFO:tasks.workunit.client.1.smithi142.stdout:2/375: chown d3/d35/f48 2603589 1 2024-02-19T19:07:33.482 INFO:tasks.workunit.client.1.smithi142.stdout:1/484: getdents d5/d37 0 2024-02-19T19:07:33.482 INFO:tasks.workunit.client.1.smithi142.stdout:1/485: chown d5/d7/d23/l29 786473 1 2024-02-19T19:07:33.484 INFO:tasks.workunit.client.1.smithi142.stdout:1/486: mkdir d5/d37/d6c/d75/da7 0 2024-02-19T19:07:33.484 INFO:tasks.workunit.client.1.smithi142.stdout:1/487: truncate d5/d1a/f47 2131593 0 2024-02-19T19:07:33.488 INFO:tasks.workunit.client.1.smithi142.stdout:9/417: dwrite db/d10/d22/f46 [0,4194304] 0 2024-02-19T19:07:33.488 INFO:tasks.workunit.client.1.smithi142.stdout:9/418: truncate db/d10/d32/f69 4436778 0 2024-02-19T19:07:33.488 INFO:tasks.workunit.client.1.smithi142.stdout:9/419: chown db/d10/d27/d2f/d4c/l31 77314930 1 2024-02-19T19:07:33.489 INFO:tasks.workunit.client.1.smithi142.stdout:4/442: dwrite d4/d1d/d42/d66/d12/f5c [4194304,4194304] 0 2024-02-19T19:07:33.489 INFO:tasks.workunit.client.1.smithi142.stdout:0/325: dwrite d23/d32/f65 [0,4194304] 0 2024-02-19T19:07:33.489 INFO:tasks.workunit.client.1.smithi142.stdout:1/488: rmdir d5/d7/d4a 39 2024-02-19T19:07:33.489 INFO:tasks.workunit.client.1.smithi142.stdout:1/489: stat d5/d37/d49/f89 0 2024-02-19T19:07:33.489 INFO:tasks.workunit.client.1.smithi142.stdout:1/490: creat d5/d37/d6c/fa8 x:0 0 0 2024-02-19T19:07:33.492 INFO:tasks.workunit.client.1.smithi142.stdout:6/296: dread d2/d1f/d20/f2c [0,4194304] 0 2024-02-19T19:07:33.492 INFO:tasks.workunit.client.1.smithi142.stdout:5/376: sync 2024-02-19T19:07:33.493 INFO:tasks.workunit.client.1.smithi142.stdout:9/420: write db/d10/d27/f40 [729654,114145] 0 2024-02-19T19:07:33.495 INFO:tasks.workunit.client.1.smithi142.stdout:7/294: sync 2024-02-19T19:07:33.497 INFO:tasks.workunit.client.1.smithi142.stdout:4/443: write d4/d1d/d42/d66/d12/f5c [4273145,7920] 0 2024-02-19T19:07:33.501 INFO:tasks.workunit.client.1.smithi142.stdout:0/326: link d23/d28/c68 d23/c6b 0 2024-02-19T19:07:33.502 INFO:tasks.workunit.client.1.smithi142.stdout:2/376: dwrite d3/df/f32 [4194304,4194304] 0 2024-02-19T19:07:33.503 INFO:tasks.workunit.client.1.smithi142.stdout:1/491: mkdir d5/d77/da9 0 2024-02-19T19:07:33.503 INFO:tasks.workunit.client.1.smithi142.stdout:6/297: mkdir d2/d1f/d5c/d63 0 2024-02-19T19:07:33.504 INFO:tasks.workunit.client.1.smithi142.stdout:6/298: fsync d2/f14 0 2024-02-19T19:07:33.504 INFO:tasks.workunit.client.1.smithi142.stdout:3/511: dwrite d1d/d1e/d2e/f78 [0,4194304] 0 2024-02-19T19:07:33.506 INFO:tasks.workunit.client.1.smithi142.stdout:9/421: truncate db/f16 4543720 0 2024-02-19T19:07:33.507 INFO:tasks.workunit.client.1.smithi142.stdout:7/295: rename d0/d1b/d21/d24/d29/d52 to d0/d1b/d21/d24/d5e 0 2024-02-19T19:07:33.507 INFO:tasks.workunit.client.1.smithi142.stdout:7/296: fdatasync d0/d13/d1e/f5c 0 2024-02-19T19:07:33.508 INFO:tasks.workunit.client.1.smithi142.stdout:4/444: symlink d4/d1d/d42/d66/d12/d2d/d2a/d84/l96 0 2024-02-19T19:07:33.511 INFO:tasks.workunit.client.1.smithi142.stdout:2/377: dread d3/db/f3a [0,4194304] 0 2024-02-19T19:07:33.513 INFO:tasks.workunit.client.1.smithi142.stdout:6/299: symlink d2/d29/d47/l64 0 2024-02-19T19:07:33.513 INFO:tasks.workunit.client.1.smithi142.stdout:0/327: mknod d23/d32/c6c 0 2024-02-19T19:07:33.514 INFO:tasks.workunit.client.1.smithi142.stdout:0/328: truncate d23/f31 4482070 0 2024-02-19T19:07:33.514 INFO:tasks.workunit.client.1.smithi142.stdout:6/300: write d2/f5f [792119,86819] 0 2024-02-19T19:07:33.516 INFO:tasks.workunit.client.1.smithi142.stdout:8/416: sync 2024-02-19T19:07:33.523 INFO:tasks.workunit.client.1.smithi142.stdout:1/492: rmdir d5/d7 39 2024-02-19T19:07:33.526 INFO:tasks.workunit.client.1.smithi142.stdout:2/378: rename d3/d4d/f63 to d3/db/f79 0 2024-02-19T19:07:33.528 INFO:tasks.workunit.client.1.smithi142.stdout:9/422: rmdir db/d10/d22/d24 39 2024-02-19T19:07:33.528 INFO:tasks.workunit.client.1.smithi142.stdout:8/417: dread f7 [0,4194304] 0 2024-02-19T19:07:33.528 INFO:tasks.workunit.client.1.smithi142.stdout:8/418: creat d9/dd/de/d2d/d2e/d49/d50/d59/f82 x:0 0 0 2024-02-19T19:07:33.528 INFO:tasks.workunit.client.1.smithi142.stdout:3/512: dwrite d1d/d1e/d2e/d37/f64 [0,4194304] 0 2024-02-19T19:07:33.529 INFO:tasks.workunit.client.1.smithi142.stdout:3/513: creat d1d/d36/d52/d5a/f94 x:0 0 0 2024-02-19T19:07:33.530 INFO:tasks.workunit.client.1.smithi142.stdout:2/379: symlink d3/db/d29/d4c/l7a 0 2024-02-19T19:07:33.532 INFO:tasks.workunit.client.1.smithi142.stdout:3/514: dread f1c [0,4194304] 0 2024-02-19T19:07:33.532 INFO:tasks.workunit.client.1.smithi142.stdout:8/419: unlink d9/dd/c3e 0 2024-02-19T19:07:33.533 INFO:tasks.workunit.client.1.smithi142.stdout:8/420: fdatasync d9/dd/de/d2d/d2e/d49/d50/d59/f82 0 2024-02-19T19:07:33.533 INFO:tasks.workunit.client.1.smithi142.stdout:8/421: write d9/dd/de/f45 [69923,10212] 0 2024-02-19T19:07:33.536 INFO:tasks.workunit.client.1.smithi142.stdout:2/380: truncate d3/d4d/f57 384972 0 2024-02-19T19:07:33.536 INFO:tasks.workunit.client.1.smithi142.stdout:2/381: fdatasync d3/db/d29/f5d 0 2024-02-19T19:07:33.536 INFO:tasks.workunit.client.1.smithi142.stdout:3/515: creat d1d/d36/f95 x:0 0 0 2024-02-19T19:07:33.536 INFO:tasks.workunit.client.1.smithi142.stdout:3/516: readlink lf 0 2024-02-19T19:07:33.538 INFO:tasks.workunit.client.1.smithi142.stdout:8/422: unlink d9/dd/de/d14/f6e 0 2024-02-19T19:07:33.538 INFO:tasks.workunit.client.1.smithi142.stdout:9/423: rename db/d10/d32/d33 to db/d10/d7d 0 2024-02-19T19:07:33.540 INFO:tasks.workunit.client.1.smithi142.stdout:3/517: symlink d1d/d36/d3a/d62/l96 0 2024-02-19T19:07:33.542 INFO:tasks.workunit.client.1.smithi142.stdout:9/424: dread db/d10/d22/f50 [0,4194304] 0 2024-02-19T19:07:33.544 INFO:tasks.workunit.client.1.smithi142.stdout:9/425: creat db/d10/d32/d3f/f7e x:0 0 0 2024-02-19T19:07:33.544 INFO:tasks.workunit.client.1.smithi142.stdout:9/426: creat db/d10/d32/f7f x:0 0 0 2024-02-19T19:07:33.555 INFO:tasks.workunit.client.1.smithi142.stdout:9/427: write db/d10/d27/d2f/d4c/f35 [3670848,52015] 0 2024-02-19T19:07:33.556 INFO:tasks.workunit.client.1.smithi142.stdout:9/428: mkdir db/d10/d80 0 2024-02-19T19:07:33.556 INFO:tasks.workunit.client.1.smithi142.stdout:9/429: dread - db/d10/d27/d2f/f5d zero size 2024-02-19T19:07:33.567 INFO:tasks.workunit.client.1.smithi142.stdout:9/430: dread db/d10/d27/d2f/d4c/f7a [0,4194304] 0 2024-02-19T19:07:33.567 INFO:tasks.workunit.client.1.smithi142.stdout:9/431: write db/d10/d27/d2f/d4c/d59/f71 [11336,113215] 0 2024-02-19T19:07:33.579 INFO:tasks.workunit.client.1.smithi142.stdout:0/329: dwrite f22 [4194304,4194304] 0 2024-02-19T19:07:33.579 INFO:tasks.workunit.client.1.smithi142.stdout:4/445: dwrite d4/d1d/d42/d66/d2c/f3d [4194304,4194304] 0 2024-02-19T19:07:33.580 INFO:tasks.workunit.client.1.smithi142.stdout:7/297: dwrite d0/d13/f15 [0,4194304] 0 2024-02-19T19:07:33.582 INFO:tasks.workunit.client.1.smithi142.stdout:0/330: unlink d23/d28/d2d/d51/d44/c4e 0 2024-02-19T19:07:33.584 INFO:tasks.workunit.client.1.smithi142.stdout:0/331: getdents d23 0 2024-02-19T19:07:33.588 INFO:tasks.workunit.client.1.smithi142.stdout:6/301: dwrite d2/d1f/f30 [0,4194304] 0 2024-02-19T19:07:33.588 INFO:tasks.workunit.client.1.smithi142.stdout:6/302: write d2/d1f/d20/d31/d3d/f50 [1354670,36848] 0 2024-02-19T19:07:33.588 INFO:tasks.workunit.client.1.smithi142.stdout:6/303: dread - d2/d1f/d45/f57 zero size 2024-02-19T19:07:33.589 INFO:tasks.workunit.client.1.smithi142.stdout:3/518: rmdir d1d/d36/d3a 39 2024-02-19T19:07:33.590 INFO:tasks.workunit.client.1.smithi142.stdout:1/493: dwrite d5/d7/d4a/f94 [0,4194304] 0 2024-02-19T19:07:33.591 INFO:tasks.workunit.client.1.smithi142.stdout:3/519: mknod d1d/d36/d3a/d62/d8d/d92/c97 0 2024-02-19T19:07:33.591 INFO:tasks.workunit.client.1.smithi142.stdout:3/520: chown d1d/d1e/d2e/d50/f69 24136 1 2024-02-19T19:07:33.591 INFO:tasks.workunit.client.1.smithi142.stdout:3/521: creat d1d/d36/d52/f98 x:0 0 0 2024-02-19T19:07:33.592 INFO:tasks.workunit.client.1.smithi142.stdout:6/304: rmdir d2/d17/d33 39 2024-02-19T19:07:33.592 INFO:tasks.workunit.client.1.smithi142.stdout:6/305: fdatasync d2/d1f/d20/d31/d3d/f50 0 2024-02-19T19:07:33.592 INFO:tasks.workunit.client.1.smithi142.stdout:8/423: dwrite d9/dd/de/d2d/d2e/d49/d50/d59/f6a [0,4194304] 0 2024-02-19T19:07:33.593 INFO:tasks.workunit.client.1.smithi142.stdout:8/424: chown d9/dd/de/d2d/d2e/d49/l81 11041297 1 2024-02-19T19:07:33.593 INFO:tasks.workunit.client.1.smithi142.stdout:9/432: dwrite db/d10/d32/f69 [0,4194304] 0 2024-02-19T19:07:33.593 INFO:tasks.workunit.client.1.smithi142.stdout:4/446: read d4/d1d/f5b [2565590,95032] 0 2024-02-19T19:07:33.593 INFO:tasks.workunit.client.1.smithi142.stdout:2/382: dwrite d3/f8 [0,4194304] 0 2024-02-19T19:07:33.594 INFO:tasks.workunit.client.1.smithi142.stdout:1/494: creat d5/d7/d4a/d53/d6a/faa x:0 0 0 2024-02-19T19:07:33.594 INFO:tasks.workunit.client.1.smithi142.stdout:1/495: write d5/f4e [631761,12352] 0 2024-02-19T19:07:33.595 INFO:tasks.workunit.client.1.smithi142.stdout:7/298: read d0/fc [7668243,103095] 0 2024-02-19T19:07:33.595 INFO:tasks.workunit.client.1.smithi142.stdout:3/522: creat d1d/d1e/d6e/f99 x:0 0 0 2024-02-19T19:07:33.596 INFO:tasks.workunit.client.1.smithi142.stdout:3/523: readlink d1d/d1e/l74 0 2024-02-19T19:07:33.596 INFO:tasks.workunit.client.1.smithi142.stdout:6/306: mkdir d2/d1f/d56/d65 0 2024-02-19T19:07:33.601 INFO:tasks.workunit.client.1.smithi142.stdout:8/425: truncate d9/dd/d15/f28 1013762 0 2024-02-19T19:07:33.601 INFO:tasks.workunit.client.1.smithi142.stdout:8/426: write d9/dd/de/d2d/d2e/d49/d50/f64 [374440,40066] 0 2024-02-19T19:07:33.602 INFO:tasks.workunit.client.1.smithi142.stdout:1/496: dread d5/f68 [0,4194304] 0 2024-02-19T19:07:33.603 INFO:tasks.workunit.client.1.smithi142.stdout:9/433: mkdir db/d10/d22/d81 0 2024-02-19T19:07:33.603 INFO:tasks.workunit.client.1.smithi142.stdout:9/434: dread - db/d10/d27/d2f/d4c/f70 zero size 2024-02-19T19:07:33.605 INFO:tasks.workunit.client.1.smithi142.stdout:3/524: dread f19 [0,4194304] 0 2024-02-19T19:07:33.610 INFO:tasks.workunit.client.1.smithi142.stdout:4/447: rename d4/d1d/d42/d66/dd/d10/d3e/d68/f78 to d4/d34/f97 0 2024-02-19T19:07:33.610 INFO:tasks.workunit.client.1.smithi142.stdout:4/448: stat d4/d1d/d42/d66/dd/d10/d3e/d68 0 2024-02-19T19:07:33.610 INFO:tasks.workunit.client.1.smithi142.stdout:4/449: fdatasync d4/d1c/f2e 0 2024-02-19T19:07:33.610 INFO:tasks.workunit.client.1.smithi142.stdout:4/450: chown d4/d1d/d42/d66/dd/d10/d3e/d68/d87 20136 1 2024-02-19T19:07:33.611 INFO:tasks.workunit.client.1.smithi142.stdout:2/383: link d3/db/d29/d6d/d59/d64/l71 d3/db/d29/d6d/d59/d64/l7b 0 2024-02-19T19:07:33.612 INFO:tasks.workunit.client.1.smithi142.stdout:7/299: creat d0/d1b/d21/d24/f5f x:0 0 0 2024-02-19T19:07:33.613 INFO:tasks.workunit.client.1.smithi142.stdout:8/427: symlink d9/dd/d15/d31/d5e/l83 0 2024-02-19T19:07:33.613 INFO:tasks.workunit.client.1.smithi142.stdout:8/428: chown f7 17 1 2024-02-19T19:07:33.613 INFO:tasks.workunit.client.1.smithi142.stdout:8/429: readlink d9/dd/d15/d31/l38 0 2024-02-19T19:07:33.613 INFO:tasks.workunit.client.1.smithi142.stdout:1/497: mkdir d5/d7/d23/dab 0 2024-02-19T19:07:33.614 INFO:tasks.workunit.client.1.smithi142.stdout:3/525: mknod d1d/d1e/d2e/d8b/c9a 0 2024-02-19T19:07:33.614 INFO:tasks.workunit.client.1.smithi142.stdout:3/526: write d1d/f42 [3231665,54229] 0 2024-02-19T19:07:33.615 INFO:tasks.workunit.client.1.smithi142.stdout:3/527: write d1d/d1e/d6e/f6f [1732856,33094] 0 2024-02-19T19:07:33.615 INFO:tasks.workunit.client.1.smithi142.stdout:3/528: write d1d/d1e/d2e/d50/f8c [681690,67922] 0 2024-02-19T19:07:33.615 INFO:tasks.workunit.client.1.smithi142.stdout:4/451: mkdir d4/d1d/d42/d66/d2c/d98 0 2024-02-19T19:07:33.616 INFO:tasks.workunit.client.1.smithi142.stdout:6/307: dwrite d2/d1f/d20/f52 [0,4194304] 0 2024-02-19T19:07:33.618 INFO:tasks.workunit.client.1.smithi142.stdout:7/300: link d0/d1b/d21/d24/d29/f2c d0/d1b/d21/d24/d29/d2d/f60 0 2024-02-19T19:07:33.618 INFO:tasks.workunit.client.1.smithi142.stdout:7/301: chown d0/d1b/d21/d24/l39 71011 1 2024-02-19T19:07:33.618 INFO:tasks.workunit.client.1.smithi142.stdout:9/435: dread db/d10/d22/f37 [0,4194304] 0 2024-02-19T19:07:33.619 INFO:tasks.workunit.client.1.smithi142.stdout:3/529: symlink d1d/d36/d3a/d62/d8d/d92/l9b 0 2024-02-19T19:07:33.619 INFO:tasks.workunit.client.1.smithi142.stdout:3/530: write d1d/d1e/d2e/d50/f90 [346965,43454] 0 2024-02-19T19:07:33.619 INFO:tasks.workunit.client.1.smithi142.stdout:3/531: write d1d/f35 [217987,55642] 0 2024-02-19T19:07:33.621 INFO:tasks.workunit.client.1.smithi142.stdout:4/452: symlink d4/d1d/d42/d66/d5f/l99 0 2024-02-19T19:07:33.621 INFO:tasks.workunit.client.1.smithi142.stdout:4/453: chown d4/d1d/d42/d66/dd/d10/d26/d50 255502721 1 2024-02-19T19:07:33.621 INFO:tasks.workunit.client.1.smithi142.stdout:4/454: fdatasync d4/d1d/d42/d66/dd/f4a 0 2024-02-19T19:07:33.621 INFO:tasks.workunit.client.1.smithi142.stdout:4/455: write d4/d14/f2f [839108,129170] 0 2024-02-19T19:07:33.622 INFO:tasks.workunit.client.1.smithi142.stdout:2/384: getdents d3/db/d29/d6d/d59 0 2024-02-19T19:07:33.622 INFO:tasks.workunit.client.1.smithi142.stdout:2/385: write d3/db/d29/d6d/d59/f6e [921066,34093] 0 2024-02-19T19:07:33.623 INFO:tasks.workunit.client.1.smithi142.stdout:6/308: mkdir d2/d1e/d35/d66 0 2024-02-19T19:07:33.626 INFO:tasks.workunit.client.1.smithi142.stdout:7/302: rmdir d0/d1b/d21/d24/d50 0 2024-02-19T19:07:33.628 INFO:tasks.workunit.client.1.smithi142.stdout:9/436: rename db/d10/ce to db/d10/d32/d3f/d5f/c82 0 2024-02-19T19:07:33.629 INFO:tasks.workunit.client.1.smithi142.stdout:2/386: dread d3/d4d/f6c [0,4194304] 0 2024-02-19T19:07:33.630 INFO:tasks.workunit.client.1.smithi142.stdout:4/456: link d4/d1c/c29 d4/d1d/d42/d66/dd/d10/d3e/d68/c9a 0 2024-02-19T19:07:33.630 INFO:tasks.workunit.client.1.smithi142.stdout:4/457: dread - d4/d34/f51 zero size 2024-02-19T19:07:33.632 INFO:tasks.workunit.client.1.smithi142.stdout:6/309: symlink d2/d29/l67 0 2024-02-19T19:07:33.632 INFO:tasks.workunit.client.1.smithi142.stdout:5/377: sync 2024-02-19T19:07:33.632 INFO:tasks.workunit.client.1.smithi142.stdout:6/310: creat d2/d29/d47/f68 x:0 0 0 2024-02-19T19:07:33.632 INFO:tasks.workunit.client.1.smithi142.stdout:7/303: mknod d0/d1b/d21/d24/d29/d44/c61 0 2024-02-19T19:07:33.634 INFO:tasks.workunit.client.1.smithi142.stdout:9/437: truncate db/d10/f4b 3968257 0 2024-02-19T19:07:33.635 INFO:tasks.workunit.client.1.smithi142.stdout:3/532: write f13 [3268182,73723] 0 2024-02-19T19:07:33.636 INFO:tasks.workunit.client.1.smithi142.stdout:4/458: symlink d4/d1d/d42/d66/dd/d10/l9b 0 2024-02-19T19:07:33.636 INFO:tasks.workunit.client.1.smithi142.stdout:4/459: creat d4/d1d/d42/f9c x:0 0 0 2024-02-19T19:07:33.636 INFO:tasks.workunit.client.1.smithi142.stdout:8/430: dwrite d9/dd/f5c [0,4194304] 0 2024-02-19T19:07:33.639 INFO:tasks.workunit.client.1.smithi142.stdout:5/378: mknod d5/c7c 0 2024-02-19T19:07:33.640 INFO:tasks.workunit.client.1.smithi142.stdout:5/379: creat d5/dd/d8/d31/d4d/d60/f7d x:0 0 0 2024-02-19T19:07:33.641 INFO:tasks.workunit.client.1.smithi142.stdout:6/311: mkdir d2/d17/d51/d55/d69 0 2024-02-19T19:07:33.641 INFO:tasks.workunit.client.1.smithi142.stdout:6/312: fsync d2/d17/d33/d39/f49 0 2024-02-19T19:07:33.641 INFO:tasks.workunit.client.1.smithi142.stdout:6/313: dread - d2/d17/d33/f5a zero size 2024-02-19T19:07:33.643 INFO:tasks.workunit.client.1.smithi142.stdout:3/533: symlink d1d/d36/d52/d71/l9c 0 2024-02-19T19:07:33.643 INFO:tasks.workunit.client.1.smithi142.stdout:3/534: fdatasync d1d/d36/d3a/f68 0 2024-02-19T19:07:33.646 INFO:tasks.workunit.client.1.smithi142.stdout:8/431: getdents d9/dd/de/d2d/d2e/d49 0 2024-02-19T19:07:33.647 INFO:tasks.workunit.client.1.smithi142.stdout:5/380: creat d5/dd/d8/d5d/f7e x:0 0 0 2024-02-19T19:07:33.648 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate[106489]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-19T19:07:33.648 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate[106489]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-19T19:07:33.648 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 bash[106474]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-19T19:07:33.648 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 bash[106474]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-19T19:07:33.648 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 bash[106474]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-19T19:07:33.648 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 bash[106474]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-19T19:07:33.648 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 bash[106474]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-19T19:07:33.648 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 bash[106474]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-19T19:07:33.649 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 bash[106474]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-19T19:07:33.649 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate[106489]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-19T19:07:33.649 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate[106489]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-19T19:07:33.649 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate[106489]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-19T19:07:33.649 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate[106489]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-19T19:07:33.649 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate[106489]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-19T19:07:33.649 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:33 smithi046 podman[106474]: 2024-02-19 19:07:33.409695962 +0000 UTC m=+1.187773060 container died acb7edc764a05788532b11ffa80f7655937e7d178c7852901d96880340fd3c2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux ) 2024-02-19T19:07:33.650 INFO:tasks.workunit.client.1.smithi142.stdout:6/314: rename d2/d1e/d35/l3f to d2/d1f/d20/d31/d62/l6a 0 2024-02-19T19:07:33.651 INFO:tasks.workunit.client.1.smithi142.stdout:6/315: truncate d2/d17/d33/f5a 352388 0 2024-02-19T19:07:33.651 INFO:tasks.workunit.client.1.smithi142.stdout:6/316: fsync d2/d17/d33/d42/f4b 0 2024-02-19T19:07:33.652 INFO:tasks.workunit.client.1.smithi142.stdout:2/387: dwrite d3/db/d29/f55 [0,4194304] 0 2024-02-19T19:07:33.652 INFO:tasks.workunit.client.1.smithi142.stdout:7/304: mkdir d0/d62 0 2024-02-19T19:07:33.652 INFO:tasks.workunit.client.1.smithi142.stdout:7/305: fsync d0/d13/f1f 0 2024-02-19T19:07:33.652 INFO:tasks.workunit.client.1.smithi142.stdout:3/535: symlink d1d/d1e/d2e/d50/l9d 0 2024-02-19T19:07:33.653 INFO:tasks.workunit.client.1.smithi142.stdout:1/498: dwrite d5/d7/f4f [4194304,4194304] 0 2024-02-19T19:07:33.653 INFO:tasks.workunit.client.1.smithi142.stdout:1/499: truncate d5/d37/f52 4499559 0 2024-02-19T19:07:33.655 INFO:tasks.workunit.client.1.smithi142.stdout:6/317: creat d2/d1f/d56/f6b x:0 0 0 2024-02-19T19:07:33.657 INFO:tasks.workunit.client.1.smithi142.stdout:4/460: dwrite d4/d1d/d42/d66/f8a [0,4194304] 0 2024-02-19T19:07:33.661 INFO:tasks.workunit.client.1.smithi142.stdout:2/388: mkdir d3/d4d/d5f/d7c 0 2024-02-19T19:07:33.661 INFO:tasks.workunit.client.1.smithi142.stdout:2/389: creat d3/d4b/f7d x:0 0 0 2024-02-19T19:07:33.661 INFO:tasks.workunit.client.1.smithi142.stdout:2/390: dread - d3/d35/f3f zero size 2024-02-19T19:07:33.662 INFO:tasks.workunit.client.1.smithi142.stdout:7/306: creat d0/d1b/d21/d24/d5e/f63 x:0 0 0 2024-02-19T19:07:33.664 INFO:tasks.workunit.client.1.smithi142.stdout:8/432: dwrite d9/dd/d44/d79/f69 [0,4194304] 0 2024-02-19T19:07:33.669 INFO:tasks.workunit.client.1.smithi142.stdout:3/536: rename d1d/d1e/d2e/d50/f90 to d1d/f9e 0 2024-02-19T19:07:33.673 INFO:tasks.workunit.client.1.smithi142.stdout:1/500: link d5/f38 d5/d37/d6c/d75/da7/fac 0 2024-02-19T19:07:33.679 INFO:tasks.workunit.client.1.smithi142.stdout:4/461: getdents d4/d1d/d42/d66/dd/d10/d3b/d3f 0 2024-02-19T19:07:33.680 INFO:tasks.workunit.client.1.smithi142.stdout:2/391: rmdir d3/db/d29/d6d/d59/d64 39 2024-02-19T19:07:33.682 INFO:tasks.workunit.client.1.smithi142.stdout:1/501: symlink d5/d1a/lad 0 2024-02-19T19:07:33.684 INFO:tasks.workunit.client.1.smithi142.stdout:4/462: rename d4/d14/l25 to d4/d1d/d42/d66/d12/d79/d8c/l9d 0 2024-02-19T19:07:33.684 INFO:tasks.workunit.client.1.smithi142.stdout:4/463: stat d4/d14/d31/d43/d52 0 2024-02-19T19:07:33.684 INFO:tasks.workunit.client.1.smithi142.stdout:4/464: write d4/d1d/d42/f9c [220088,77222] 0 2024-02-19T19:07:33.684 INFO:tasks.workunit.client.1.smithi142.stdout:4/465: write d4/d1d/d42/d66/dd/d10/d3e/f81 [186404,33288] 0 2024-02-19T19:07:33.685 INFO:tasks.workunit.client.1.smithi142.stdout:4/466: chown d4/d1d/d42/d66/d12/c46 89556 1 2024-02-19T19:07:33.685 INFO:tasks.workunit.client.1.smithi142.stdout:4/467: chown d4 115 1 2024-02-19T19:07:33.685 INFO:tasks.workunit.client.1.smithi142.stdout:2/392: creat d3/d4d/d5f/d7c/f7e x:0 0 0 2024-02-19T19:07:33.685 INFO:tasks.workunit.client.1.smithi142.stdout:2/393: creat d3/db/f7f x:0 0 0 2024-02-19T19:07:33.685 INFO:tasks.workunit.client.1.smithi142.stdout:2/394: fdatasync d3/db/f34 0 2024-02-19T19:07:33.685 INFO:tasks.workunit.client.1.smithi142.stdout:2/395: creat d3/d4b/f80 x:0 0 0 2024-02-19T19:07:33.686 INFO:tasks.workunit.client.1.smithi142.stdout:4/468: unlink d4/d1d/d42/f7a 0 2024-02-19T19:07:33.689 INFO:tasks.workunit.client.1.smithi142.stdout:2/396: unlink d3/d35/l5a 0 2024-02-19T19:07:33.691 INFO:tasks.workunit.client.1.smithi142.stdout:2/397: mkdir d3/d4d/d81 0 2024-02-19T19:07:33.691 INFO:tasks.workunit.client.1.smithi142.stdout:2/398: chown d3/d35 0 1 2024-02-19T19:07:33.692 INFO:tasks.workunit.client.1.smithi142.stdout:6/318: dwrite d2/d1f/d45/f57 [0,4194304] 0 2024-02-19T19:07:33.693 INFO:tasks.workunit.client.1.smithi142.stdout:5/381: dwrite d5/dd/f1e [0,4194304] 0 2024-02-19T19:07:33.693 INFO:tasks.workunit.client.1.smithi142.stdout:5/382: write d5/dd/d8/d29/f78 [341995,74900] 0 2024-02-19T19:07:33.695 INFO:tasks.workunit.client.1.smithi142.stdout:5/383: symlink d5/dd/d8/d1c/l7f 0 2024-02-19T19:07:33.696 INFO:tasks.workunit.client.1.smithi142.stdout:1/502: read d5/d7/d4a/d53/d6a/f7e [2446138,58965] 0 2024-02-19T19:07:33.696 INFO:tasks.workunit.client.1.smithi142.stdout:1/503: stat d5/d1a/d33/f36 0 2024-02-19T19:07:33.696 INFO:tasks.workunit.client.1.smithi142.stdout:1/504: chown d5/d1a/d33/f50 319968138 1 2024-02-19T19:07:33.696 INFO:tasks.workunit.client.1.smithi142.stdout:1/505: readlink d5/d7/d4a/d53/l54 0 2024-02-19T19:07:33.697 INFO:tasks.workunit.client.1.smithi142.stdout:5/384: mkdir d5/dd/df/d22/d80 0 2024-02-19T19:07:33.697 INFO:tasks.workunit.client.1.smithi142.stdout:5/385: creat d5/dd/d5f/f81 x:0 0 0 2024-02-19T19:07:33.697 INFO:tasks.workunit.client.1.smithi142.stdout:1/506: mkdir d5/d77/da9/dae 0 2024-02-19T19:07:33.698 INFO:tasks.workunit.client.1.smithi142.stdout:4/469: write d4/d14/d31/f38 [1324137,47726] 0 2024-02-19T19:07:33.700 INFO:tasks.workunit.client.1.smithi142.stdout:2/399: dread d3/db/fc [0,4194304] 0 2024-02-19T19:07:33.701 INFO:tasks.workunit.client.1.smithi142.stdout:8/433: dwrite d9/dd/de/f6f [0,4194304] 0 2024-02-19T19:07:33.701 INFO:tasks.workunit.client.1.smithi142.stdout:7/307: dwrite d0/f19 [0,4194304] 0 2024-02-19T19:07:33.702 INFO:tasks.workunit.client.1.smithi142.stdout:5/386: rename d5/dd/df/d22/d41/d32/d53/d69 to d5/dd/df/d22/d41/d6f/d82 0 2024-02-19T19:07:33.702 INFO:tasks.workunit.client.1.smithi142.stdout:5/387: fsync d5/f24 0 2024-02-19T19:07:33.702 INFO:tasks.workunit.client.1.smithi142.stdout:4/470: truncate d4/d14/d31/f61 3912049 0 2024-02-19T19:07:33.704 INFO:tasks.workunit.client.1.smithi142.stdout:6/319: dread d2/d1f/d20/f52 [0,4194304] 0 2024-02-19T19:07:33.710 INFO:tasks.workunit.client.1.smithi142.stdout:7/308: creat d0/d1b/d21/d24/d29/d44/d49/f64 x:0 0 0 2024-02-19T19:07:33.710 INFO:tasks.workunit.client.1.smithi142.stdout:7/309: truncate d0/d1b/d21/d24/d29/d2d/f2e 920133 0 2024-02-19T19:07:33.713 INFO:tasks.workunit.client.1.smithi142.stdout:8/434: rename d9/dd/d44/d79/f27 to d9/dd/de/d2d/d2e/d49/d74/f84 0 2024-02-19T19:07:33.713 INFO:tasks.workunit.client.1.smithi142.stdout:8/435: readlink d9/dd/de/d2d/d2e/d49/d50/d59/l7d 0 2024-02-19T19:07:33.713 INFO:tasks.workunit.client.1.smithi142.stdout:8/436: chown d9/dd/d44/d79/f39 154016969 1 2024-02-19T19:07:33.713 INFO:tasks.workunit.client.1.smithi142.stdout:8/437: dread - d9/dd/de/d2d/d2e/d49/d50/f72 zero size 2024-02-19T19:07:33.715 INFO:tasks.workunit.client.1.smithi142.stdout:7/310: unlink d0/d1b/d21/d24/d29/d2d/f3d 0 2024-02-19T19:07:33.715 INFO:tasks.workunit.client.1.smithi142.stdout:6/320: dread d2/d1f/d20/d31/d3d/d3e/f58 [0,4194304] 0 2024-02-19T19:07:33.717 INFO:tasks.workunit.client.1.smithi142.stdout:4/471: rename d4/d1d/d42/d66/d12/d2d/f91 to d4/d1d/d42/d66/dd/d10/d3e/d68/d87/f9e 0 2024-02-19T19:07:33.718 INFO:tasks.workunit.client.1.smithi142.stdout:7/311: mkdir d0/d1b/d21/d24/d5e/d65 0 2024-02-19T19:07:33.719 INFO:tasks.workunit.client.1.smithi142.stdout:6/321: dread d2/d1f/f30 [0,4194304] 0 2024-02-19T19:07:33.721 INFO:tasks.workunit.client.1.smithi142.stdout:4/472: unlink d4/d1d/d42/d66/dd/d10/d26/f6d 0 2024-02-19T19:07:33.723 INFO:tasks.workunit.client.1.smithi142.stdout:7/312: rename d0/d13/f1f to d0/d1b/d21/d24/d29/d44/f66 0 2024-02-19T19:07:33.723 INFO:tasks.workunit.client.1.smithi142.stdout:7/313: chown d0/d1b/d21 24299 1 2024-02-19T19:07:33.725 INFO:tasks.workunit.client.1.smithi142.stdout:4/473: mkdir d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f 0 2024-02-19T19:07:33.727 INFO:tasks.workunit.client.1.smithi142.stdout:8/438: write d9/dd/d44/d79/f39 [1621802,17112] 0 2024-02-19T19:07:33.727 INFO:tasks.workunit.client.1.smithi142.stdout:4/474: getdents d4/d1d/d42/d66/dd 0 2024-02-19T19:07:33.728 INFO:tasks.workunit.client.1.smithi142.stdout:4/475: chown d4/d1d/d42/d66/d5f/l99 1 1 2024-02-19T19:07:33.728 INFO:tasks.workunit.client.1.smithi142.stdout:4/476: write d4/d1d/d42/d66/dd/d10/d3b/d3f/f57 [765775,44338] 0 2024-02-19T19:07:33.730 INFO:tasks.workunit.client.1.smithi142.stdout:4/477: creat d4/d1d/d42/d66/d2c/fa0 x:0 0 0 2024-02-19T19:07:33.732 INFO:tasks.workunit.client.1.smithi142.stdout:4/478: rename d4/d1d/d42/d66/dd/c24 to d4/d1d/d42/d66/dd/d10/d3e/d68/ca1 0 2024-02-19T19:07:33.740 INFO:tasks.workunit.client.1.smithi142.stdout:8/439: read d9/dd/de/f6f [3870308,39289] 0 2024-02-19T19:07:33.741 INFO:tasks.workunit.client.1.smithi142.stdout:8/440: write d9/dd/de/d2d/d2e/d49/d50/d59/f76 [4282989,41797] 0 2024-02-19T19:07:33.741 INFO:tasks.workunit.client.1.smithi142.stdout:2/400: dwrite d3/d35/f66 [0,4194304] 0 2024-02-19T19:07:33.744 INFO:tasks.workunit.client.1.smithi142.stdout:2/401: truncate d3/df/f10 2650857 0 2024-02-19T19:07:33.744 INFO:tasks.workunit.client.1.smithi142.stdout:2/402: fdatasync d3/df/f12 0 2024-02-19T19:07:33.744 INFO:tasks.workunit.client.1.smithi142.stdout:2/403: readlink d3/db/d29/d4c/d4e/l6a 0 2024-02-19T19:07:33.745 INFO:tasks.workunit.client.1.smithi142.stdout:2/404: mknod d3/db/d29/d4c/d4a/c82 0 2024-02-19T19:07:33.748 INFO:tasks.workunit.client.1.smithi142.stdout:4/479: getdents d4/d1d/d42/d66/dd/d10/d3e/d68/d87 0 2024-02-19T19:07:33.750 INFO:tasks.workunit.client.1.smithi142.stdout:0/332: sync 2024-02-19T19:07:33.750 INFO:tasks.workunit.client.1.smithi142.stdout:4/480: mkdir d4/d14/d31/d43/d52/da2 0 2024-02-19T19:07:33.750 INFO:tasks.workunit.client.1.smithi142.stdout:5/388: dwrite d5/dd/df/d22/d41/d32/f74 [0,4194304] 0 2024-02-19T19:07:33.751 INFO:tasks.workunit.client.1.smithi142.stdout:1/507: dwrite d5/d7/f4f [4194304,4194304] 0 2024-02-19T19:07:33.751 INFO:tasks.workunit.client.1.smithi142.stdout:4/481: creat d4/d1d/d42/d66/d12/d79/fa3 x:0 0 0 2024-02-19T19:07:33.755 INFO:tasks.workunit.client.1.smithi142.stdout:5/389: mknod d5/dd/df/d15/c83 0 2024-02-19T19:07:33.755 INFO:tasks.workunit.client.1.smithi142.stdout:5/390: chown d5/dd/df/d22/d41/f2b 0 1 2024-02-19T19:07:33.756 INFO:tasks.workunit.client.1.smithi142.stdout:2/405: dread d3/d35/f5c [0,4194304] 0 2024-02-19T19:07:33.757 INFO:tasks.workunit.client.1.smithi142.stdout:0/333: dread d23/d28/d2d/d51/d44/f49 [0,4194304] 0 2024-02-19T19:07:33.758 INFO:tasks.workunit.client.1.smithi142.stdout:0/334: write d23/f46 [117311,4011] 0 2024-02-19T19:07:33.758 INFO:tasks.workunit.client.1.smithi142.stdout:0/335: write d23/f25 [669367,40633] 0 2024-02-19T19:07:33.759 INFO:tasks.workunit.client.1.smithi142.stdout:0/336: read d23/f46 [539230,124221] 0 2024-02-19T19:07:33.759 INFO:tasks.workunit.client.1.smithi142.stdout:7/314: dwrite d0/d1b/d21/d24/d29/d2d/f2e [0,4194304] 0 2024-02-19T19:07:33.760 INFO:tasks.workunit.client.1.smithi142.stdout:5/391: creat d5/dd/df/d22/d41/d32/f84 x:0 0 0 2024-02-19T19:07:33.760 INFO:tasks.workunit.client.1.smithi142.stdout:5/392: creat d5/dd/d5f/f85 x:0 0 0 2024-02-19T19:07:33.760 INFO:tasks.workunit.client.1.smithi142.stdout:5/393: dread - d5/dd/d5f/f85 zero size 2024-02-19T19:07:33.761 INFO:tasks.workunit.client.1.smithi142.stdout:2/406: rename d3/d4b/f80 to d3/d35/d53/f83 0 2024-02-19T19:07:33.761 INFO:tasks.workunit.client.1.smithi142.stdout:2/407: truncate d3/db/f79 185254 0 2024-02-19T19:07:33.761 INFO:tasks.workunit.client.1.smithi142.stdout:2/408: write d3/db/d29/d4c/d4a/f75 [566893,97791] 0 2024-02-19T19:07:33.762 INFO:tasks.workunit.client.1.smithi142.stdout:6/322: dwrite d2/d1f/d56/f6b [0,4194304] 0 2024-02-19T19:07:33.763 INFO:tasks.workunit.client.1.smithi142.stdout:0/337: mknod d23/d28/d2d/d51/d44/c6d 0 2024-02-19T19:07:33.763 INFO:tasks.workunit.client.1.smithi142.stdout:8/441: dwrite d9/dd/de/d2d/d2e/d49/d50/d59/f66 [0,4194304] 0 2024-02-19T19:07:33.766 INFO:tasks.workunit.client.1.smithi142.stdout:1/508: write d5/d37/d6c/f7c [1026307,114675] 0 2024-02-19T19:07:33.766 INFO:tasks.workunit.client.1.smithi142.stdout:1/509: chown d5/d7/d34/d6f/f88 7 1 2024-02-19T19:07:33.768 INFO:tasks.workunit.client.1.smithi142.stdout:8/442: dread d9/f46 [0,4194304] 0 2024-02-19T19:07:33.771 INFO:tasks.workunit.client.1.smithi142.stdout:7/315: read d0/fd [2752198,120693] 0 2024-02-19T19:07:33.771 INFO:tasks.workunit.client.1.smithi142.stdout:7/316: chown d0/d1b/d21/d24/d31/f45 188203 1 2024-02-19T19:07:33.771 INFO:tasks.workunit.client.1.smithi142.stdout:7/317: dread d0/d1b/d21/d24/d31/f45 [0,4194304] 0 2024-02-19T19:07:33.772 INFO:tasks.workunit.client.1.smithi142.stdout:2/409: write d3/df/f2b [131012,130371] 0 2024-02-19T19:07:33.773 INFO:tasks.workunit.client.1.smithi142.stdout:6/323: link d2/c6 d2/d1e/d35/d66/c6c 0 2024-02-19T19:07:33.774 INFO:tasks.workunit.client.1.smithi142.stdout:0/338: symlink d23/d28/d2d/d51/l6e 0 2024-02-19T19:07:33.775 INFO:tasks.workunit.client.1.smithi142.stdout:9/438: sync 2024-02-19T19:07:33.777 INFO:tasks.workunit.client.1.smithi142.stdout:7/318: mknod d0/d1b/c67 0 2024-02-19T19:07:33.778 INFO:tasks.workunit.client.1.smithi142.stdout:2/410: symlink d3/d4d/d5f/d7c/l84 0 2024-02-19T19:07:33.778 INFO:tasks.workunit.client.1.smithi142.stdout:2/411: creat d3/db/d29/f85 x:0 0 0 2024-02-19T19:07:33.779 INFO:tasks.workunit.client.1.smithi142.stdout:6/324: mknod d2/d1f/d20/d31/d3d/c6d 0 2024-02-19T19:07:33.779 INFO:tasks.workunit.client.1.smithi142.stdout:1/510: dread d5/d7/d4a/d53/d6a/fa5 [0,4194304] 0 2024-02-19T19:07:33.780 INFO:tasks.workunit.client.1.smithi142.stdout:4/482: dwrite d4/d1c/f22 [0,4194304] 0 2024-02-19T19:07:33.780 INFO:tasks.workunit.client.1.smithi142.stdout:4/483: stat d4/d1d/d42/d66/d12/f18 0 2024-02-19T19:07:33.780 INFO:tasks.workunit.client.1.smithi142.stdout:1/511: dread d5/d7/d23/d2c/f3c [0,4194304] 0 2024-02-19T19:07:33.780 INFO:tasks.workunit.client.1.smithi142.stdout:1/512: dread - d5/d7/d23/d2c/f6b zero size 2024-02-19T19:07:33.781 INFO:tasks.workunit.client.1.smithi142.stdout:2/412: link d3/d35/d53/l54 d3/db/d29/l86 0 2024-02-19T19:07:33.782 INFO:tasks.workunit.client.1.smithi142.stdout:2/413: dread - d3/db/f7f zero size 2024-02-19T19:07:33.783 INFO:tasks.workunit.client.1.smithi142.stdout:6/325: link d2/d1e/d35/d66/c6c d2/d17/d33/c6e 0 2024-02-19T19:07:33.784 INFO:tasks.workunit.client.1.smithi142.stdout:8/443: dread d9/dd/de/d2d/d2e/d49/d50/d59/f76 [0,4194304] 0 2024-02-19T19:07:33.784 INFO:tasks.workunit.client.1.smithi142.stdout:7/319: getdents d0/d1b/d21/d24/d29/d44/d49 0 2024-02-19T19:07:33.784 INFO:tasks.workunit.client.1.smithi142.stdout:7/320: chown d0/d1b/d21/d24/d31/d47/f4b 55053 1 2024-02-19T19:07:33.785 INFO:tasks.workunit.client.1.smithi142.stdout:4/484: creat d4/d1d/d42/d66/d12/fa4 x:0 0 0 2024-02-19T19:07:33.786 INFO:tasks.workunit.client.1.smithi142.stdout:4/485: write d4/d1d/f74 [4407123,99951] 0 2024-02-19T19:07:33.786 INFO:tasks.workunit.client.1.smithi142.stdout:9/439: dread db/d10/d32/f69 [0,4194304] 0 2024-02-19T19:07:33.786 INFO:tasks.workunit.client.1.smithi142.stdout:9/440: chown db/d10/d32/d3f/d5f/c82 0 1 2024-02-19T19:07:33.787 INFO:tasks.workunit.client.1.smithi142.stdout:9/441: fdatasync db/f53 0 2024-02-19T19:07:33.787 INFO:tasks.workunit.client.1.smithi142.stdout:9/442: stat db/f61 0 2024-02-19T19:07:33.787 INFO:tasks.workunit.client.1.smithi142.stdout:1/513: unlink d5/f2d 0 2024-02-19T19:07:33.788 INFO:tasks.workunit.client.1.smithi142.stdout:2/414: creat d3/d68/f87 x:0 0 0 2024-02-19T19:07:33.788 INFO:tasks.workunit.client.1.smithi142.stdout:6/326: write d2/f5f [424931,89512] 0 2024-02-19T19:07:33.788 INFO:tasks.workunit.client.1.smithi142.stdout:6/327: dread - d2/d17/d33/f53 zero size 2024-02-19T19:07:33.788 INFO:tasks.workunit.client.1.smithi142.stdout:6/328: chown d2/f14 38058186 1 2024-02-19T19:07:33.788 INFO:tasks.workunit.client.1.smithi142.stdout:6/329: dread - d2/d29/d47/f68 zero size 2024-02-19T19:07:33.788 INFO:tasks.workunit.client.1.smithi142.stdout:6/330: write d2/d1f/d20/f2c [2215382,108435] 0 2024-02-19T19:07:33.789 INFO:tasks.workunit.client.1.smithi142.stdout:8/444: link d9/dd/c4b d9/dd/de/c85 0 2024-02-19T19:07:33.790 INFO:tasks.workunit.client.1.smithi142.stdout:7/321: mknod d0/d1b/c68 0 2024-02-19T19:07:33.791 INFO:tasks.workunit.client.1.smithi142.stdout:1/514: creat d5/d7/d23/faf x:0 0 0 2024-02-19T19:07:33.791 INFO:tasks.workunit.client.1.smithi142.stdout:0/339: dwrite d23/d28/d2d/d51/d44/d58/f5d [0,4194304] 0 2024-02-19T19:07:33.793 INFO:tasks.workunit.client.1.smithi142.stdout:2/415: unlink d3/db/d29/d6d/d59/d64/l71 0 2024-02-19T19:07:33.793 INFO:tasks.workunit.client.1.smithi142.stdout:2/416: chown d3/db/d29/d6d/d59/f6e 62490 1 2024-02-19T19:07:33.795 INFO:tasks.workunit.client.1.smithi142.stdout:3/537: sync 2024-02-19T19:07:33.799 INFO:tasks.workunit.client.1.smithi142.stdout:2/417: unlink d3/d4d/d5f/l60 0 2024-02-19T19:07:33.802 INFO:tasks.workunit.client.1.smithi142.stdout:2/418: mknod d3/d68/c88 0 2024-02-19T19:07:33.804 INFO:tasks.workunit.client.1.smithi142.stdout:7/322: rename d0/d1b/d21/d24/d29/d2d to d0/d1b/d21/d24/d31/d47/d69 0 2024-02-19T19:07:33.804 INFO:tasks.workunit.client.1.smithi142.stdout:7/323: chown d0/d1b/d21/d24/d29/d44/d49 184 1 2024-02-19T19:07:33.806 INFO:tasks.workunit.client.1.smithi142.stdout:1/515: rename d5/c1b to d5/d1a/cb0 0 2024-02-19T19:07:33.806 INFO:tasks.workunit.client.1.smithi142.stdout:1/516: creat d5/d37/d6c/fb1 x:0 0 0 2024-02-19T19:07:33.806 INFO:tasks.workunit.client.1.smithi142.stdout:1/517: readlink d5/l5e 0 2024-02-19T19:07:33.806 INFO:tasks.workunit.client.1.smithi142.stdout:8/445: write d9/dd/f17 [2385482,126975] 0 2024-02-19T19:07:33.806 INFO:tasks.workunit.client.1.smithi142.stdout:8/446: creat d9/dd/de/f86 x:0 0 0 2024-02-19T19:07:33.806 INFO:tasks.workunit.client.1.smithi142.stdout:0/340: dread f17 [0,4194304] 0 2024-02-19T19:07:33.806 INFO:tasks.workunit.client.1.smithi142.stdout:8/447: write d9/dd/d44/d79/f69 [4507447,105570] 0 2024-02-19T19:07:33.807 INFO:tasks.workunit.client.1.smithi142.stdout:7/324: link d0/d13/d1e/d22/c48 d0/d1b/d21/d24/d5e/d65/c6a 0 2024-02-19T19:07:33.808 INFO:tasks.workunit.client.1.smithi142.stdout:3/538: rename d1d/d1e/f23 to d1d/d36/d3a/d62/d8d/d92/f9f 0 2024-02-19T19:07:33.809 INFO:tasks.workunit.client.1.smithi142.stdout:8/448: dread d9/dd/de/f6f [0,4194304] 0 2024-02-19T19:07:33.810 INFO:tasks.workunit.client.1.smithi142.stdout:1/518: mkdir d5/d77/da9/dae/db2 0 2024-02-19T19:07:33.811 INFO:tasks.workunit.client.1.smithi142.stdout:1/519: read d5/d7/d4a/d53/d6a/f84 [82362,48332] 0 2024-02-19T19:07:33.811 INFO:tasks.workunit.client.1.smithi142.stdout:1/520: chown d5/d7/d23 1 1 2024-02-19T19:07:33.812 INFO:tasks.workunit.client.1.smithi142.stdout:6/331: dwrite d2/d17/f24 [0,4194304] 0 2024-02-19T19:07:33.813 INFO:tasks.workunit.client.1.smithi142.stdout:4/486: dwrite d4/d1d/d42/d66/d12/d79/fa3 [0,4194304] 0 2024-02-19T19:07:33.813 INFO:tasks.workunit.client.1.smithi142.stdout:7/325: creat d0/f6b x:0 0 0 2024-02-19T19:07:33.813 INFO:tasks.workunit.client.1.smithi142.stdout:6/332: write d2/d1f/f2b [185637,1456] 0 2024-02-19T19:07:33.813 INFO:tasks.workunit.client.1.smithi142.stdout:4/487: write d4/d14/d31/d43/d52/f60 [507814,101027] 0 2024-02-19T19:07:33.813 INFO:tasks.workunit.client.1.smithi142.stdout:4/488: stat d4/d1c/f2e 0 2024-02-19T19:07:33.814 INFO:tasks.workunit.client.1.smithi142.stdout:9/443: dwrite db/d10/d32/f76 [0,4194304] 0 2024-02-19T19:07:33.814 INFO:tasks.workunit.client.1.smithi142.stdout:9/444: truncate db/d10/d27/d2f/d4c/f70 684331 0 2024-02-19T19:07:33.814 INFO:tasks.workunit.client.1.smithi142.stdout:3/539: mknod d1d/d1e/d2e/d8b/ca0 0 2024-02-19T19:07:33.814 INFO:tasks.workunit.client.1.smithi142.stdout:3/540: chown d1d/d1e/d2e/c40 79 1 2024-02-19T19:07:33.814 INFO:tasks.workunit.client.1.smithi142.stdout:3/541: creat d1d/fa1 x:0 0 0 2024-02-19T19:07:33.814 INFO:tasks.workunit.client.1.smithi142.stdout:3/542: dread - d1d/d1e/d6e/f72 zero size 2024-02-19T19:07:33.814 INFO:tasks.workunit.client.1.smithi142.stdout:8/449: mknod d9/dd/de/d14/d65/c87 0 2024-02-19T19:07:33.816 INFO:tasks.workunit.client.1.smithi142.stdout:1/521: unlink d5/d37/c5a 0 2024-02-19T19:07:33.816 INFO:tasks.workunit.client.1.smithi142.stdout:1/522: chown d5/d37 343 1 2024-02-19T19:07:33.816 INFO:tasks.workunit.client.1.smithi142.stdout:2/419: dread d3/db/fc [4194304,4194304] 0 2024-02-19T19:07:33.816 INFO:tasks.workunit.client.1.smithi142.stdout:0/341: getdents d23/d32 0 2024-02-19T19:07:33.822 INFO:tasks.workunit.client.1.smithi142.stdout:7/326: creat d0/f6c x:0 0 0 2024-02-19T19:07:33.822 INFO:tasks.workunit.client.1.smithi142.stdout:7/327: read - d0/d1b/d21/d24/f5f zero size 2024-02-19T19:07:33.824 INFO:tasks.workunit.client.1.smithi142.stdout:7/328: dread d0/d1b/d21/d24/d31/d47/d69/f60 [0,4194304] 0 2024-02-19T19:07:33.824 INFO:tasks.workunit.client.1.smithi142.stdout:6/333: creat d2/d1f/d5c/f6f x:0 0 0 2024-02-19T19:07:33.824 INFO:tasks.workunit.client.1.smithi142.stdout:6/334: fsync d2/f14 0 2024-02-19T19:07:33.825 INFO:tasks.workunit.client.1.smithi142.stdout:4/489: rmdir d4/d1d/d42/d66/dd/d10/d3b 39 2024-02-19T19:07:33.825 INFO:tasks.workunit.client.1.smithi142.stdout:4/490: creat d4/d1d/d42/d66/d2c/fa5 x:0 0 0 2024-02-19T19:07:33.825 INFO:tasks.workunit.client.1.smithi142.stdout:7/329: dread d0/d1b/d21/d24/d31/f45 [0,4194304] 0 2024-02-19T19:07:33.825 INFO:tasks.workunit.client.1.smithi142.stdout:7/330: write d0/d1b/d21/d24/d31/f33 [367082,130056] 0 2024-02-19T19:07:33.825 INFO:tasks.workunit.client.1.smithi142.stdout:7/331: write d0/d1b/d21/d24/d31/d47/d69/f60 [1784354,125348] 0 2024-02-19T19:07:33.825 INFO:tasks.workunit.client.1.smithi142.stdout:7/332: readlink d0/d13/d1e/l58 0 2024-02-19T19:07:33.829 INFO:tasks.workunit.client.1.smithi142.stdout:9/445: mkdir db/d10/d27/d2f/d4c/d54/d83 0 2024-02-19T19:07:33.831 INFO:tasks.workunit.client.1.smithi142.stdout:8/450: unlink d9/dd/d15/f22 0 2024-02-19T19:07:33.832 INFO:tasks.workunit.client.1.smithi142.stdout:3/543: dwrite d1d/d36/f95 [0,4194304] 0 2024-02-19T19:07:33.834 INFO:tasks.workunit.client.1.smithi142.stdout:1/523: rename d5/d37/d6c/d75/da7/fac to d5/d7/d4a/d53/fb3 0 2024-02-19T19:07:33.835 INFO:tasks.workunit.client.1.smithi142.stdout:2/420: truncate d3/d4d/f6c 985209 0 2024-02-19T19:07:33.836 INFO:tasks.workunit.client.1.smithi142.stdout:0/342: symlink d23/d28/l6f 0 2024-02-19T19:07:33.837 INFO:tasks.workunit.client.1.smithi142.stdout:6/335: creat d2/d17/d33/d39/f70 x:0 0 0 2024-02-19T19:07:33.837 INFO:tasks.workunit.client.1.smithi142.stdout:6/336: write d2/d1f/d20/f2c [2977839,113778] 0 2024-02-19T19:07:33.838 INFO:tasks.workunit.client.1.smithi142.stdout:6/337: creat d2/d29/d47/f71 x:0 0 0 2024-02-19T19:07:33.838 INFO:tasks.workunit.client.1.smithi142.stdout:7/333: dread d0/d1b/d21/d24/f34 [0,4194304] 0 2024-02-19T19:07:33.844 INFO:tasks.workunit.client.1.smithi142.stdout:8/451: creat d9/dd/de/d2d/d2e/d49/f88 x:0 0 0 2024-02-19T19:07:33.845 INFO:tasks.workunit.client.1.smithi142.stdout:8/452: fdatasync d9/dd/de/d2d/d2e/d49/f70 0 2024-02-19T19:07:33.847 INFO:tasks.workunit.client.1.smithi142.stdout:3/544: mkdir d1d/d36/d3a/d62/da2 0 2024-02-19T19:07:33.847 INFO:tasks.workunit.client.1.smithi142.stdout:3/545: fdatasync f1 0 2024-02-19T19:07:33.847 INFO:tasks.workunit.client.1.smithi142.stdout:1/524: dread f4 [0,4194304] 0 2024-02-19T19:07:33.847 INFO:tasks.workunit.client.1.smithi142.stdout:1/525: readlink d5/d1a/d59/l9a 0 2024-02-19T19:07:33.848 INFO:tasks.workunit.client.1.smithi142.stdout:2/421: unlink d3/d35/f3f 0 2024-02-19T19:07:33.849 INFO:tasks.workunit.client.1.smithi142.stdout:4/491: dwrite d4/d14/d31/f7d [0,4194304] 0 2024-02-19T19:07:33.849 INFO:tasks.workunit.client.1.smithi142.stdout:6/338: write d2/d1f/d20/f25 [1914162,22400] 0 2024-02-19T19:07:33.851 INFO:tasks.workunit.client.1.smithi142.stdout:9/446: link db/d10/d27/d2f/d4c/d59/f71 db/f84 0 2024-02-19T19:07:33.853 INFO:tasks.workunit.client.1.smithi142.stdout:8/453: creat d9/dd/de/d2d/d2e/d73/d77/f89 x:0 0 0 2024-02-19T19:07:33.855 INFO:tasks.workunit.client.1.smithi142.stdout:3/546: unlink d1d/d36/d52/f98 0 2024-02-19T19:07:33.856 INFO:tasks.workunit.client.1.smithi142.stdout:1/526: creat d5/d7/d23/dab/fb4 x:0 0 0 2024-02-19T19:07:33.859 INFO:tasks.workunit.client.1.smithi142.stdout:0/343: getdents d23/d28 0 2024-02-19T19:07:33.860 INFO:tasks.workunit.client.1.smithi142.stdout:2/422: read d3/f8 [1730743,113920] 0 2024-02-19T19:07:33.862 INFO:tasks.workunit.client.1.smithi142.stdout:4/492: dread d4/d14/d31/f7d [0,4194304] 0 2024-02-19T19:07:33.863 INFO:tasks.workunit.client.1.smithi142.stdout:8/454: dread d9/f4e [0,4194304] 0 2024-02-19T19:07:33.863 INFO:tasks.workunit.client.1.smithi142.stdout:8/455: truncate d9/dd/de/d2d/d2e/d49/d50/d59/f7f 185418 0 2024-02-19T19:07:33.866 INFO:tasks.workunit.client.1.smithi142.stdout:6/339: dwrite d2/d1f/d20/d31/d3d/f50 [4194304,4194304] 0 2024-02-19T19:07:33.866 INFO:tasks.workunit.client.1.smithi142.stdout:1/527: write d5/d7/d4a/d53/fb3 [1352560,87968] 0 2024-02-19T19:07:33.867 INFO:tasks.workunit.client.1.smithi142.stdout:1/528: write d5/d7/d4a/d53/d6a/f63 [315318,94605] 0 2024-02-19T19:07:33.868 INFO:tasks.workunit.client.1.smithi142.stdout:9/447: rmdir db/d10/d22/d24/d3d 39 2024-02-19T19:07:33.869 INFO:tasks.workunit.client.1.smithi142.stdout:3/547: mknod d1d/d36/d3a/d57/ca3 0 2024-02-19T19:07:33.870 INFO:tasks.workunit.client.1.smithi142.stdout:0/344: link d23/d28/f33 d23/d28/f70 0 2024-02-19T19:07:33.873 INFO:tasks.workunit.client.1.smithi142.stdout:4/493: symlink d4/d1d/d42/la6 0 2024-02-19T19:07:33.873 INFO:tasks.workunit.client.1.smithi142.stdout:4/494: chown d4/d14/d31/f38 473842992 1 2024-02-19T19:07:33.873 INFO:tasks.workunit.client.1.smithi142.stdout:4/495: stat d4/d1d/d42/d66/dd/c76 0 2024-02-19T19:07:33.875 INFO:tasks.workunit.client.1.smithi142.stdout:6/340: rename d2/d17/d33/d42/f4b to d2/d1f/d20/d31/d62/f72 0 2024-02-19T19:07:33.875 INFO:tasks.workunit.client.1.smithi142.stdout:6/341: readlink d2/d1f/l23 0 2024-02-19T19:07:33.875 INFO:tasks.workunit.client.1.smithi142.stdout:1/529: truncate d5/d1a/d33/f36 1329098 0 2024-02-19T19:07:33.877 INFO:tasks.workunit.client.1.smithi142.stdout:9/448: symlink db/d10/d7d/l85 0 2024-02-19T19:07:33.878 INFO:tasks.workunit.client.1.smithi142.stdout:3/548: mkdir d1d/d36/d52/d5a/da4 0 2024-02-19T19:07:33.879 INFO:tasks.workunit.client.1.smithi142.stdout:0/345: truncate f1a 4091694 0 2024-02-19T19:07:33.880 INFO:tasks.workunit.client.1.smithi142.stdout:0/346: fsync f13 0 2024-02-19T19:07:33.881 INFO:tasks.workunit.client.1.smithi142.stdout:4/496: mknod d4/d1d/d42/d66/dd/d10/ca7 0 2024-02-19T19:07:33.881 INFO:tasks.workunit.client.1.smithi142.stdout:4/497: dread - d4/d1d/d42/d66/dd/f6a zero size 2024-02-19T19:07:33.882 INFO:tasks.workunit.client.1.smithi142.stdout:6/342: creat d2/d17/f73 x:0 0 0 2024-02-19T19:07:33.883 INFO:tasks.workunit.client.1.smithi142.stdout:5/394: sync 2024-02-19T19:07:33.883 INFO:tasks.workunit.client.1.smithi142.stdout:9/449: mknod db/d10/d32/c86 0 2024-02-19T19:07:33.884 INFO:tasks.workunit.client.1.smithi142.stdout:9/450: read - db/d10/d32/d3f/f7e zero size 2024-02-19T19:07:33.884 INFO:tasks.workunit.client.1.smithi142.stdout:9/451: chown db/d10/d32/d3f/d5f/c60 1 1 2024-02-19T19:07:33.884 INFO:tasks.workunit.client.1.smithi142.stdout:9/452: readlink db/d10/d22/d24/d3d/l43 0 2024-02-19T19:07:33.884 INFO:tasks.workunit.client.1.smithi142.stdout:9/453: creat db/d10/d27/d2f/f87 x:0 0 0 2024-02-19T19:07:33.887 INFO:tasks.workunit.client.1.smithi142.stdout:6/343: creat d2/d17/d33/d42/f74 x:0 0 0 2024-02-19T19:07:33.887 INFO:tasks.workunit.client.1.smithi142.stdout:6/344: fdatasync d2/d29/d47/f68 0 2024-02-19T19:07:33.888 INFO:tasks.workunit.client.1.smithi142.stdout:6/345: chown d2/d17/d33/f5a 3910 1 2024-02-19T19:07:33.888 INFO:tasks.workunit.client.1.smithi142.stdout:6/346: stat d2/d17/d51/d55 0 2024-02-19T19:07:33.890 INFO:tasks.workunit.client.1.smithi142.stdout:0/347: creat d23/d28/d2d/d51/f71 x:0 0 0 2024-02-19T19:07:33.890 INFO:tasks.workunit.client.1.smithi142.stdout:0/348: readlink d23/d28/d2d/d51/d44/l45 0 2024-02-19T19:07:33.890 INFO:tasks.workunit.client.1.smithi142.stdout:4/498: write d4/d14/d31/f7d [2953707,99123] 0 2024-02-19T19:07:33.891 INFO:tasks.workunit.client.1.smithi142.stdout:3/549: dwrite d1d/d36/d52/d71/f80 [0,4194304] 0 2024-02-19T19:07:33.891 INFO:tasks.workunit.client.1.smithi142.stdout:1/530: dwrite d5/d1a/d33/f4d [0,4194304] 0 2024-02-19T19:07:33.892 INFO:tasks.workunit.client.1.smithi142.stdout:6/347: rename d2/d1f/d20/l2f to d2/d1f/d20/d31/d3d/d3e/l75 0 2024-02-19T19:07:33.895 INFO:tasks.workunit.client.1.smithi142.stdout:4/499: dread d4/d1d/d42/d66/dd/d10/d3e/f4e [0,4194304] 0 2024-02-19T19:07:33.895 INFO:tasks.workunit.client.1.smithi142.stdout:4/500: truncate d4/d14/f2f 1444705 0 2024-02-19T19:07:33.897 INFO:tasks.workunit.client.1.smithi142.stdout:1/531: truncate d5/d7/d4a/d53/d6a/f7e 3657197 0 2024-02-19T19:07:33.897 INFO:tasks.workunit.client.1.smithi142.stdout:1/532: fdatasync d5/fd 0 2024-02-19T19:07:33.900 INFO:tasks.workunit.client.1.smithi142.stdout:0/349: unlink d23/d28/l2f 0 2024-02-19T19:07:33.900 INFO:tasks.workunit.client.1.smithi142.stdout:0/350: write d23/d28/d2d/f3b [1234416,100930] 0 2024-02-19T19:07:33.902 INFO:tasks.workunit.client.1.smithi142.stdout:1/533: link d5/d1a/d33/l6e d5/d37/d6c/lb5 0 2024-02-19T19:07:33.903 INFO:tasks.workunit.client.1.smithi142.stdout:6/348: rmdir d2/d29/d47 39 2024-02-19T19:07:33.903 INFO:tasks.workunit.client.1.smithi142.stdout:1/534: symlink d5/d37/d6c/d75/da7/lb6 0 2024-02-19T19:07:33.904 INFO:tasks.workunit.client.1.smithi142.stdout:1/535: stat d5/d7/d4a/d53/d6a/f84 0 2024-02-19T19:07:33.904 INFO:tasks.workunit.client.1.smithi142.stdout:6/349: mkdir d2/d1e/d35/d66/d76 0 2024-02-19T19:07:33.904 INFO:tasks.workunit.client.1.smithi142.stdout:6/350: chown d2/d1f/d45/c48 7689 1 2024-02-19T19:07:33.904 INFO:tasks.workunit.client.1.smithi142.stdout:4/501: dread d4/d1d/d42/d66/dd/d10/d3b/f89 [0,4194304] 0 2024-02-19T19:07:33.904 INFO:tasks.workunit.client.1.smithi142.stdout:4/502: creat d4/d1d/d42/fa8 x:0 0 0 2024-02-19T19:07:33.905 INFO:tasks.workunit.client.1.smithi142.stdout:4/503: chown d4/d1c/f2e 294 1 2024-02-19T19:07:33.905 INFO:tasks.workunit.client.1.smithi142.stdout:5/395: dwrite d5/dd/df/f6b [0,4194304] 0 2024-02-19T19:07:33.905 INFO:tasks.workunit.client.1.smithi142.stdout:5/396: dread - d5/dd/d8/d29/f63 zero size 2024-02-19T19:07:33.905 INFO:tasks.workunit.client.1.smithi142.stdout:5/397: fsync d5/f2c 0 2024-02-19T19:07:33.906 INFO:tasks.workunit.client.1.smithi142.stdout:9/454: dwrite db/f53 [0,4194304] 0 2024-02-19T19:07:33.906 INFO:tasks.workunit.client.1.smithi142.stdout:1/536: creat d5/d37/d6c/d75/da7/fb7 x:0 0 0 2024-02-19T19:07:33.907 INFO:tasks.workunit.client.1.smithi142.stdout:6/351: symlink d2/d17/l77 0 2024-02-19T19:07:33.907 INFO:tasks.workunit.client.1.smithi142.stdout:6/352: fsync d2/d29/d47/f68 0 2024-02-19T19:07:33.910 INFO:tasks.workunit.client.1.smithi142.stdout:4/504: rmdir d4/d1d/d42/d66/d2c/d98 0 2024-02-19T19:07:33.921 INFO:tasks.workunit.client.1.smithi142.stdout:9/455: unlink db/d10/d7d/c77 0 2024-02-19T19:07:33.921 INFO:tasks.workunit.client.1.smithi142.stdout:9/456: fdatasync db/d10/d32/f7f 0 2024-02-19T19:07:33.922 INFO:tasks.workunit.client.1.smithi142.stdout:1/537: rename d5/d7/l14 to d5/d1a/d59/lb8 0 2024-02-19T19:07:33.923 INFO:tasks.workunit.client.1.smithi142.stdout:4/505: creat d4/d1d/d42/d66/dd/d10/d3b/d3f/fa9 x:0 0 0 2024-02-19T19:07:33.925 INFO:tasks.workunit.client.1.smithi142.stdout:5/398: rmdir d5/dd/df/d22 39 2024-02-19T19:07:33.925 INFO:tasks.workunit.client.1.smithi142.stdout:5/399: readlink d5/dd/d8/d2a/d57/l5a 0 2024-02-19T19:07:33.925 INFO:tasks.workunit.client.1.smithi142.stdout:5/400: chown d5/dd/d8/f3d 1665578 1 2024-02-19T19:07:33.925 INFO:tasks.workunit.client.1.smithi142.stdout:1/538: mknod d5/d37/d6c/d75/da2/cb9 0 2024-02-19T19:07:33.926 INFO:tasks.workunit.client.1.smithi142.stdout:4/506: mkdir d4/d1d/d42/d66/d2c/daa 0 2024-02-19T19:07:33.928 INFO:tasks.workunit.client.1.smithi142.stdout:1/539: creat d5/d7/d34/d6f/fba x:0 0 0 2024-02-19T19:07:33.928 INFO:tasks.workunit.client.1.smithi142.stdout:1/540: readlink d5/d37/d49/l4c 0 2024-02-19T19:07:33.929 INFO:tasks.workunit.client.1.smithi142.stdout:1/541: creat d5/d77/da9/dae/db2/fbb x:0 0 0 2024-02-19T19:07:33.929 INFO:tasks.workunit.client.1.smithi142.stdout:1/542: truncate d5/d37/d49/f89 640442 0 2024-02-19T19:07:33.933 INFO:tasks.workunit.client.1.smithi142.stdout:4/507: rename d4/d14/d31/d43/d52 to d4/d14/d31/dab 0 2024-02-19T19:07:33.933 INFO:tasks.workunit.client.1.smithi142.stdout:4/508: chown d4/d1d/d42/d66/d2c/c37 59 1 2024-02-19T19:07:33.933 INFO:tasks.workunit.client.1.smithi142.stdout:1/543: dread d5/d7/d4a/d53/d6a/f84 [0,4194304] 0 2024-02-19T19:07:33.934 INFO:tasks.workunit.client.1.smithi142.stdout:1/544: mkdir d5/d7/d23/d2c/dbc 0 2024-02-19T19:07:33.934 INFO:tasks.workunit.client.1.smithi142.stdout:1/545: creat d5/d7/d23/dab/fbd x:0 0 0 2024-02-19T19:07:33.934 INFO:tasks.workunit.client.1.smithi142.stdout:1/546: dread - d5/d73/f91 zero size 2024-02-19T19:07:33.936 INFO:tasks.workunit.client.1.smithi142.stdout:9/457: dwrite db/d10/d22/f50 [0,4194304] 0 2024-02-19T19:07:33.938 INFO:tasks.workunit.client.1.smithi142.stdout:1/547: link d5/d37/d6c/c8e d5/d7/d23/da4/cbe 0 2024-02-19T19:07:33.942 INFO:tasks.workunit.client.1.smithi142.stdout:5/401: dwrite d5/dd/f1e [0,4194304] 0 2024-02-19T19:07:33.945 INFO:tasks.workunit.client.1.smithi142.stdout:9/458: write db/f16 [779644,27073] 0 2024-02-19T19:07:33.945 INFO:tasks.workunit.client.1.smithi142.stdout:5/402: truncate d5/dd/df/d22/f37 804942 0 2024-02-19T19:07:33.947 INFO:tasks.workunit.client.1.smithi142.stdout:6/353: dwrite d2/d1f/d56/f6b [4194304,4194304] 0 2024-02-19T19:07:33.949 INFO:tasks.workunit.client.1.smithi142.stdout:5/403: symlink d5/dd/d8/d31/l86 0 2024-02-19T19:07:33.951 INFO:tasks.workunit.client.1.smithi142.stdout:4/509: dwrite d4/d14/d31/dab/f63 [0,4194304] 0 2024-02-19T19:07:33.952 INFO:tasks.workunit.client.1.smithi142.stdout:6/354: symlink d2/d17/d33/d39/l78 0 2024-02-19T19:07:33.952 INFO:tasks.workunit.client.1.smithi142.stdout:6/355: chown d2/d1f/d20/c27 0 1 2024-02-19T19:07:33.953 INFO:tasks.workunit.client.1.smithi142.stdout:5/404: mknod d5/dd/df/d22/c87 0 2024-02-19T19:07:33.953 INFO:tasks.workunit.client.1.smithi142.stdout:5/405: write d5/dd/d5f/f85 [795369,107576] 0 2024-02-19T19:07:33.953 INFO:tasks.workunit.client.1.smithi142.stdout:5/406: truncate d5/dd/d8/f3d 5327 0 2024-02-19T19:07:33.955 INFO:tasks.workunit.client.1.smithi142.stdout:4/510: unlink d4/d34/d44/l6c 0 2024-02-19T19:07:33.956 INFO:tasks.workunit.client.1.smithi142.stdout:6/356: symlink d2/d1f/l79 0 2024-02-19T19:07:33.956 INFO:tasks.workunit.client.1.smithi142.stdout:6/357: creat d2/d17/f7a x:0 0 0 2024-02-19T19:07:33.957 INFO:tasks.workunit.client.1.smithi142.stdout:1/548: dwrite d5/d7/d4a/d53/d6a/f65 [0,4194304] 0 2024-02-19T19:07:33.957 INFO:tasks.workunit.client.1.smithi142.stdout:1/549: fsync d5/d37/d6c/f85 0 2024-02-19T19:07:33.959 INFO:tasks.workunit.client.1.smithi142.stdout:4/511: mkdir d4/d1d/d42/d66/dd/dac 0 2024-02-19T19:07:33.959 INFO:tasks.workunit.client.1.smithi142.stdout:6/358: mkdir d2/d17/d33/d42/d5e/d7b 0 2024-02-19T19:07:33.963 INFO:tasks.workunit.client.1.smithi142.stdout:4/512: symlink d4/d1d/lad 0 2024-02-19T19:07:33.963 INFO:tasks.workunit.client.1.smithi142.stdout:4/513: readlink d4/d1d/d42/d66/dd/d10/l30 0 2024-02-19T19:07:33.964 INFO:tasks.workunit.client.1.smithi142.stdout:6/359: rename d2/d1e/f2a to d2/d1e/d35/d66/f7c 0 2024-02-19T19:07:33.965 INFO:tasks.workunit.client.1.smithi142.stdout:6/360: rmdir d2/d1f/d20/d31 39 2024-02-19T19:07:33.965 INFO:tasks.workunit.client.1.smithi142.stdout:6/361: write d2/d29/d47/f5b [229106,118676] 0 2024-02-19T19:07:33.966 INFO:tasks.workunit.client.1.smithi142.stdout:6/362: symlink d2/d1f/d5c/d63/l7d 0 2024-02-19T19:07:33.967 INFO:tasks.workunit.client.1.smithi142.stdout:6/363: mknod d2/d1f/d5c/d63/c7e 0 2024-02-19T19:07:33.968 INFO:tasks.workunit.client.1.smithi142.stdout:6/364: creat d2/d1e/d35/d66/f7f x:0 0 0 2024-02-19T19:07:33.968 INFO:tasks.workunit.client.1.smithi142.stdout:6/365: write d2/d17/d33/d39/f49 [2719095,96740] 0 2024-02-19T19:07:33.974 INFO:tasks.workunit.client.1.smithi142.stdout:4/514: dread d4/d1d/d42/d66/d12/d79/fa3 [0,4194304] 0 2024-02-19T19:07:33.975 INFO:tasks.workunit.client.1.smithi142.stdout:4/515: mkdir d4/d1c/dae 0 2024-02-19T19:07:33.978 INFO:tasks.workunit.client.1.smithi142.stdout:6/366: dread d2/d17/f19 [0,4194304] 0 2024-02-19T19:07:33.980 INFO:tasks.workunit.client.1.smithi142.stdout:9/459: dwrite db/d10/d27/d2f/d4c/f35 [0,4194304] 0 2024-02-19T19:07:33.982 INFO:tasks.workunit.client.1.smithi142.stdout:5/407: dwrite d5/fe [4194304,4194304] 0 2024-02-19T19:07:33.983 INFO:tasks.workunit.client.1.smithi142.stdout:5/408: mknod d5/dd/c88 0 2024-02-19T19:07:33.984 INFO:tasks.workunit.client.1.smithi142.stdout:1/550: dwrite d5/d7/d23/f45 [4194304,4194304] 0 2024-02-19T19:07:33.984 INFO:tasks.workunit.client.1.smithi142.stdout:1/551: truncate d5/d73/f8b 785648 0 2024-02-19T19:07:33.984 INFO:tasks.workunit.client.1.smithi142.stdout:5/409: creat d5/dd/df/d22/d41/d6f/f89 x:0 0 0 2024-02-19T19:07:33.992 INFO:tasks.workunit.client.1.smithi142.stdout:6/367: dwrite d2/f12 [0,4194304] 0 2024-02-19T19:07:33.993 INFO:tasks.workunit.client.1.smithi142.stdout:6/368: chown d2/c1b 11 1 2024-02-19T19:07:33.993 INFO:tasks.workunit.client.1.smithi142.stdout:1/552: link d5/c9e d5/d7/d23/d41/cbf 0 2024-02-19T19:07:33.993 INFO:tasks.workunit.client.1.smithi142.stdout:5/410: write d5/dd/df/d22/d41/f3a [349440,99597] 0 2024-02-19T19:07:33.997 INFO:tasks.workunit.client.1.smithi142.stdout:1/553: mknod d5/d1a/d33/cc0 0 2024-02-19T19:07:33.997 INFO:tasks.workunit.client.1.smithi142.stdout:1/554: chown d5/d7/d23/d2c 8559803 1 2024-02-19T19:07:34.001 INFO:tasks.workunit.client.1.smithi142.stdout:6/369: rmdir d2/d17 39 2024-02-19T19:07:34.001 INFO:tasks.workunit.client.1.smithi142.stdout:6/370: stat d2/d1f/d5c/d63/l7d 0 2024-02-19T19:07:34.001 INFO:tasks.workunit.client.1.smithi142.stdout:6/371: write d2/d17/d33/d39/f49 [2320774,67326] 0 2024-02-19T19:07:34.004 INFO:tasks.workunit.client.1.smithi142.stdout:5/411: rename d5/dd/d8/d1c/d64 to d5/dd/d8/d1c/d8a 0 2024-02-19T19:07:34.005 INFO:tasks.workunit.client.1.smithi142.stdout:5/412: fsync d5/dd/df/d15/f7a 0 2024-02-19T19:07:34.005 INFO:tasks.workunit.client.1.smithi142.stdout:5/413: fsync d5/dd/df/d22/d41/d6f/f89 0 2024-02-19T19:07:34.018 INFO:tasks.workunit.client.1.smithi142.stdout:6/372: truncate d2/d1f/d20/d31/d3d/f50 3266092 0 2024-02-19T19:07:34.019 INFO:tasks.workunit.client.1.smithi142.stdout:6/373: rename d2/d1e/d35/d66/c6c to d2/d1f/d56/d65/c80 0 2024-02-19T19:07:34.021 INFO:tasks.workunit.client.1.smithi142.stdout:6/374: symlink d2/d29/d47/l81 0 2024-02-19T19:07:34.021 INFO:tasks.workunit.client.1.smithi142.stdout:6/375: write d2/d17/f73 [884194,44673] 0 2024-02-19T19:07:34.023 INFO:tasks.workunit.client.1.smithi142.stdout:1/555: dwrite d5/d7/d4a/d53/fb3 [0,4194304] 0 2024-02-19T19:07:34.025 INFO:tasks.workunit.client.1.smithi142.stdout:5/414: dwrite d5/fe [0,4194304] 0 2024-02-19T19:07:34.025 INFO:tasks.workunit.client.1.smithi142.stdout:5/415: creat d5/dd/df/d22/d41/d6f/f8b x:0 0 0 2024-02-19T19:07:34.025 INFO:tasks.workunit.client.1.smithi142.stdout:1/556: link d5/d7/d34/f7a d5/d7/d4a/fc1 0 2024-02-19T19:07:34.026 INFO:tasks.workunit.client.1.smithi142.stdout:1/557: chown d5/d7/d23/dab/fb4 70814383 1 2024-02-19T19:07:34.026 INFO:tasks.workunit.client.1.smithi142.stdout:1/558: chown d5/d7/d4a/f94 0 1 2024-02-19T19:07:34.026 INFO:tasks.workunit.client.1.smithi142.stdout:1/559: creat d5/d37/d6c/d75/fc2 x:0 0 0 2024-02-19T19:07:34.026 INFO:tasks.workunit.client.1.smithi142.stdout:5/416: truncate d5/dd/df/d22/f37 32853 0 2024-02-19T19:07:34.028 INFO:tasks.workunit.client.1.smithi142.stdout:1/560: link d5/d37/d6c/d75/f98 d5/d7/d4a/d53/fc3 0 2024-02-19T19:07:34.029 INFO:tasks.workunit.client.1.smithi142.stdout:5/417: mknod d5/dd/df/d15/d5b/c8c 0 2024-02-19T19:07:34.030 INFO:tasks.workunit.client.1.smithi142.stdout:5/418: dread - d5/dd/df/d22/d41/d6f/f89 zero size 2024-02-19T19:07:34.031 INFO:tasks.workunit.client.1.smithi142.stdout:1/561: rename d5/d37/l48 to d5/d7/d23/d2c/dbc/lc4 0 2024-02-19T19:07:34.032 INFO:tasks.workunit.client.1.smithi142.stdout:1/562: mknod d5/d7/d34/d6f/cc5 0 2024-02-19T19:07:34.032 INFO:tasks.workunit.client.1.smithi142.stdout:1/563: chown d5/d1a/l20 344 1 2024-02-19T19:07:34.032 INFO:tasks.workunit.client.1.smithi142.stdout:1/564: dread - d5/d37/d6c/fa0 zero size 2024-02-19T19:07:34.032 INFO:tasks.workunit.client.1.smithi142.stdout:1/565: write d5/d1a/f7d [827125,11182] 0 2024-02-19T19:07:34.032 INFO:tasks.workunit.client.1.smithi142.stdout:2/423: sync 2024-02-19T19:07:34.032 INFO:tasks.workunit.client.1.smithi142.stdout:7/334: sync 2024-02-19T19:07:34.037 INFO:tasks.workunit.client.1.smithi142.stdout:6/376: dwrite d2/d1f/d20/d31/d3d/f50 [0,4194304] 0 2024-02-19T19:07:34.037 INFO:tasks.workunit.client.1.smithi142.stdout:6/377: write d2/d1f/d45/f57 [5021296,116842] 0 2024-02-19T19:07:34.039 INFO:tasks.workunit.client.1.smithi142.stdout:6/378: creat d2/d1f/d5c/d63/f82 x:0 0 0 2024-02-19T19:07:34.041 INFO:tasks.workunit.client.1.smithi142.stdout:1/566: write d5/d7/d4a/d53/d6a/f65 [2597464,65836] 0 2024-02-19T19:07:34.042 INFO:tasks.workunit.client.1.smithi142.stdout:5/419: read d5/dd/df/f12 [2665255,33144] 0 2024-02-19T19:07:34.043 INFO:tasks.workunit.client.1.smithi142.stdout:6/379: creat d2/d17/d33/f83 x:0 0 0 2024-02-19T19:07:34.047 INFO:tasks.workunit.client.1.smithi142.stdout:1/567: mknod d5/cc6 0 2024-02-19T19:07:34.048 INFO:tasks.workunit.client.1.smithi142.stdout:5/420: write d5/dd/d5f/f85 [735101,68376] 0 2024-02-19T19:07:34.048 INFO:tasks.workunit.client.1.smithi142.stdout:5/421: write d5/dd/f68 [392545,23677] 0 2024-02-19T19:07:34.048 INFO:tasks.workunit.client.1.smithi142.stdout:5/422: chown d5/dd/d8/d29/l5c 4 1 2024-02-19T19:07:34.049 INFO:tasks.workunit.client.1.smithi142.stdout:5/423: dread d5/dd/d8/f3d [0,4194304] 0 2024-02-19T19:07:34.049 INFO:tasks.workunit.client.1.smithi142.stdout:5/424: fsync d5/f13 0 2024-02-19T19:07:34.049 INFO:tasks.workunit.client.1.smithi142.stdout:6/380: symlink d2/d1f/l84 0 2024-02-19T19:07:34.052 INFO:tasks.workunit.client.1.smithi142.stdout:2/424: dwrite d3/f8 [0,4194304] 0 2024-02-19T19:07:34.053 INFO:tasks.workunit.client.1.smithi142.stdout:1/568: mkdir d5/d7/d23/d41/dc7 0 2024-02-19T19:07:34.053 INFO:tasks.workunit.client.1.smithi142.stdout:1/569: write d5/d7/d4a/fc1 [545043,11360] 0 2024-02-19T19:07:34.054 INFO:tasks.workunit.client.1.smithi142.stdout:5/425: mkdir d5/dd/d8/d31/d4d/d8d 0 2024-02-19T19:07:34.056 INFO:tasks.workunit.client.1.smithi142.stdout:6/381: unlink d2/d29/d47/l64 0 2024-02-19T19:07:34.056 INFO:tasks.workunit.client.1.smithi142.stdout:7/335: dwrite d0/d1b/d21/d24/d31/d47/d69/f2e [0,4194304] 0 2024-02-19T19:07:34.061 INFO:tasks.workunit.client.1.smithi142.stdout:1/570: creat d5/d37/d6c/d75/da2/fc8 x:0 0 0 2024-02-19T19:07:34.063 INFO:tasks.workunit.client.1.smithi142.stdout:7/336: dread d0/d1b/d21/d24/d31/f45 [0,4194304] 0 2024-02-19T19:07:34.069 INFO:tasks.workunit.client.1.smithi142.stdout:1/571: write d5/d1a/d33/f36 [383534,86798] 0 2024-02-19T19:07:34.069 INFO:tasks.workunit.client.1.smithi142.stdout:1/572: creat d5/d1a/d59/fc9 x:0 0 0 2024-02-19T19:07:34.069 INFO:tasks.workunit.client.1.smithi142.stdout:1/573: fsync d5/d1a/f3a 0 2024-02-19T19:07:34.069 INFO:tasks.workunit.client.1.smithi142.stdout:1/574: stat d5/d7/d23/d41/c69 0 2024-02-19T19:07:34.071 INFO:tasks.workunit.client.1.smithi142.stdout:1/575: creat d5/d77/da9/dae/fca x:0 0 0 2024-02-19T19:07:34.072 INFO:tasks.workunit.client.1.smithi142.stdout:1/576: symlink d5/d37/d6c/d75/lcb 0 2024-02-19T19:07:34.072 INFO:tasks.workunit.client.1.smithi142.stdout:1/577: read - d5/d37/d6c/d75/da7/fb7 zero size 2024-02-19T19:07:34.073 INFO:tasks.workunit.client.1.smithi142.stdout:7/337: write d0/d1b/d21/f36 [3974246,101619] 0 2024-02-19T19:07:34.073 INFO:tasks.workunit.client.1.smithi142.stdout:1/578: creat d5/d7/d23/d41/fcc x:0 0 0 2024-02-19T19:07:34.073 INFO:tasks.workunit.client.1.smithi142.stdout:1/579: creat d5/d7/d23/fcd x:0 0 0 2024-02-19T19:07:34.073 INFO:tasks.workunit.client.1.smithi142.stdout:1/580: dread - d5/d37/d6c/fb1 zero size 2024-02-19T19:07:34.075 INFO:tasks.workunit.client.1.smithi142.stdout:1/581: mkdir d5/d1a/d33/dce 0 2024-02-19T19:07:34.075 INFO:tasks.workunit.client.1.smithi142.stdout:7/338: dread d0/d1b/d21/d24/d31/d47/d69/f40 [0,4194304] 0 2024-02-19T19:07:34.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:33 smithi046 ceph-mon[88928]: osdmap e62: 6 total, 5 up, 6 in 2024-02-19T19:07:34.085 INFO:tasks.workunit.client.1.smithi142.stdout:2/425: dwrite d3/db/f15 [0,4194304] 0 2024-02-19T19:07:34.086 INFO:tasks.workunit.client.1.smithi142.stdout:2/426: getdents d3/db/d29/d6d 0 2024-02-19T19:07:34.086 INFO:tasks.workunit.client.1.smithi142.stdout:2/427: truncate d3/df/f12 8375519 0 2024-02-19T19:07:34.087 INFO:tasks.workunit.client.1.smithi142.stdout:2/428: write d3/db/d29/d4c/d4a/f75 [537565,20842] 0 2024-02-19T19:07:34.088 INFO:tasks.workunit.client.1.smithi142.stdout:1/582: dread d5/d7/d4a/d53/d6a/fa5 [0,4194304] 0 2024-02-19T19:07:34.089 INFO:tasks.workunit.client.1.smithi142.stdout:1/583: mkdir d5/d7/d23/dab/dcf 0 2024-02-19T19:07:34.090 INFO:tasks.workunit.client.1.smithi142.stdout:1/584: unlink d5/d7/d23/d41/f80 0 2024-02-19T19:07:34.091 INFO:tasks.workunit.client.1.smithi142.stdout:1/585: mkdir d5/d37/d6c/dd0 0 2024-02-19T19:07:34.091 INFO:tasks.workunit.client.1.smithi142.stdout:1/586: chown d5/d7/d34/f46 0 1 2024-02-19T19:07:34.091 INFO:tasks.workunit.client.1.smithi142.stdout:1/587: write d5/d1a/d33/f50 [785675,66270] 0 2024-02-19T19:07:34.092 INFO:tasks.workunit.client.1.smithi142.stdout:1/588: dread d5/d37/d49/f89 [0,4194304] 0 2024-02-19T19:07:34.092 INFO:tasks.workunit.client.1.smithi142.stdout:5/426: dwrite d5/fe [4194304,4194304] 0 2024-02-19T19:07:34.093 INFO:tasks.workunit.client.1.smithi142.stdout:5/427: stat d5/dd/d8/d31/d4d/d75 0 2024-02-19T19:07:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:6/382: dwrite d2/f5f [0,4194304] 0 2024-02-19T19:07:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:6/383: dread - d2/d1e/d35/d66/f7f zero size 2024-02-19T19:07:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:6/384: write d2/d1f/d20/d31/d3d/d3e/f46 [980932,59128] 0 2024-02-19T19:07:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:6/385: chown d2/d1f/d56/d65/c80 1211 1 2024-02-19T19:07:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:6/386: chown d2/ca 459860692 1 2024-02-19T19:07:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:6/387: fsync d2/d29/d47/f68 0 2024-02-19T19:07:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:7/339: dwrite d0/d1b/d21/d24/d5e/f63 [0,4194304] 0 2024-02-19T19:07:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:1/589: getdents d5/d1a 0 2024-02-19T19:07:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:1/590: write d5/d77/da9/dae/db2/fbb [875697,82801] 0 2024-02-19T19:07:34.094 INFO:tasks.workunit.client.1.smithi142.stdout:1/591: truncate d5/d7/d23/faf 476701 0 2024-02-19T19:07:34.095 INFO:tasks.workunit.client.1.smithi142.stdout:5/428: creat d5/dd/d8/f8e x:0 0 0 2024-02-19T19:07:34.101 INFO:tasks.workunit.client.1.smithi142.stdout:6/388: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:34.101 INFO:tasks.workunit.client.1.smithi142.stdout:6/389: chown d2/d29/d47/f68 147771522 1 2024-02-19T19:07:34.107 INFO:tasks.workunit.client.1.smithi142.stdout:7/340: mknod d0/d1b/d21/c6d 0 2024-02-19T19:07:34.107 INFO:tasks.workunit.client.1.smithi142.stdout:7/341: write d0/f6c [4718,28490] 0 2024-02-19T19:07:34.107 INFO:tasks.workunit.client.1.smithi142.stdout:5/429: getdents d5/d45 0 2024-02-19T19:07:34.109 INFO:tasks.workunit.client.1.smithi142.stdout:1/592: dwrite d5/f4e [0,4194304] 0 2024-02-19T19:07:34.109 INFO:tasks.workunit.client.1.smithi142.stdout:1/593: write d5/d7/d34/f62 [897301,59029] 0 2024-02-19T19:07:34.110 INFO:tasks.workunit.client.1.smithi142.stdout:6/390: symlink d2/d17/d51/l85 0 2024-02-19T19:07:34.111 INFO:tasks.workunit.client.1.smithi142.stdout:5/430: mknod d5/dd/d5f/c8f 0 2024-02-19T19:07:34.114 INFO:tasks.workunit.client.1.smithi142.stdout:6/391: dread d2/d1f/d20/d31/d3d/f50 [0,4194304] 0 2024-02-19T19:07:34.116 INFO:tasks.workunit.client.1.smithi142.stdout:1/594: rename f4 to d5/d7/d23/dab/fd1 0 2024-02-19T19:07:34.116 INFO:tasks.workunit.client.1.smithi142.stdout:1/595: chown d5/d7/d4a/c64 20252858 1 2024-02-19T19:07:34.117 INFO:tasks.workunit.client.1.smithi142.stdout:6/392: rmdir d2/d29 39 2024-02-19T19:07:34.118 INFO:tasks.workunit.client.1.smithi142.stdout:2/429: dwrite d3/db/d29/f41 [8388608,4194304] 0 2024-02-19T19:07:34.118 INFO:tasks.workunit.client.1.smithi142.stdout:2/430: write d3/f1c [78074,42745] 0 2024-02-19T19:07:34.119 INFO:tasks.workunit.client.1.smithi142.stdout:1/596: rename d5/d7/d4a/d53/d6a/f63 to d5/d7/d4a/d53/d6a/fd2 0 2024-02-19T19:07:34.120 INFO:tasks.workunit.client.1.smithi142.stdout:5/431: dread d5/dd/df/d22/d41/f25 [0,4194304] 0 2024-02-19T19:07:34.120 INFO:tasks.workunit.client.1.smithi142.stdout:7/342: dwrite d0/d1b/d21/d24/f30 [0,4194304] 0 2024-02-19T19:07:34.120 INFO:tasks.workunit.client.1.smithi142.stdout:7/343: dread - d0/d1b/f59 zero size 2024-02-19T19:07:34.121 INFO:tasks.workunit.client.1.smithi142.stdout:1/597: creat d5/d7/fd3 x:0 0 0 2024-02-19T19:07:34.122 INFO:tasks.workunit.client.1.smithi142.stdout:5/432: truncate f4 3462668 0 2024-02-19T19:07:34.122 INFO:tasks.workunit.client.1.smithi142.stdout:5/433: creat d5/dd/d8/d2a/f90 x:0 0 0 2024-02-19T19:07:34.122 INFO:tasks.workunit.client.1.smithi142.stdout:5/434: fdatasync d5/dd/d8/d29/f78 0 2024-02-19T19:07:34.123 INFO:tasks.workunit.client.1.smithi142.stdout:8/456: sync 2024-02-19T19:07:34.123 INFO:tasks.workunit.client.1.smithi142.stdout:0/351: sync 2024-02-19T19:07:34.123 INFO:tasks.workunit.client.1.smithi142.stdout:3/550: sync 2024-02-19T19:07:34.123 INFO:tasks.workunit.client.1.smithi142.stdout:6/393: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:34.124 INFO:tasks.workunit.client.1.smithi142.stdout:1/598: mknod d5/d7/d23/d2c/cd4 0 2024-02-19T19:07:34.124 INFO:tasks.workunit.client.1.smithi142.stdout:4/516: sync 2024-02-19T19:07:34.124 INFO:tasks.workunit.client.1.smithi142.stdout:9/460: sync 2024-02-19T19:07:34.126 INFO:tasks.workunit.client.1.smithi142.stdout:5/435: mknod d5/dd/d8/d31/d4d/d8d/c91 0 2024-02-19T19:07:34.128 INFO:tasks.workunit.client.1.smithi142.stdout:8/457: mkdir d9/dd/de/d2d/d2e/d49/d50/d59/d8a 0 2024-02-19T19:07:34.129 INFO:tasks.workunit.client.1.smithi142.stdout:0/352: truncate d23/f31 3707586 0 2024-02-19T19:07:34.131 INFO:tasks.workunit.client.1.smithi142.stdout:3/551: creat d1d/d36/d3a/d62/d91/fa5 x:0 0 0 2024-02-19T19:07:34.131 INFO:tasks.workunit.client.1.smithi142.stdout:3/552: write d1d/d1e/d2e/d50/f8a [941342,78331] 0 2024-02-19T19:07:34.135 INFO:tasks.workunit.client.1.smithi142.stdout:6/394: rename d2/d1f/f5d to d2/d17/d33/d39/f86 0 2024-02-19T19:07:34.135 INFO:tasks.workunit.client.1.smithi142.stdout:6/395: chown d2/d1e/d35/d66/d76 25607 1 2024-02-19T19:07:34.136 INFO:tasks.workunit.client.1.smithi142.stdout:1/599: creat d5/d37/d6c/dd0/fd5 x:0 0 0 2024-02-19T19:07:34.136 INFO:tasks.workunit.client.1.smithi142.stdout:1/600: chown d5/d37/d6c/fb1 65094676 1 2024-02-19T19:07:34.137 INFO:tasks.workunit.client.1.smithi142.stdout:4/517: write d4/d14/d31/f61 [142942,105818] 0 2024-02-19T19:07:34.138 INFO:tasks.workunit.client.1.smithi142.stdout:8/458: mknod d9/dd/de/d14/c8b 0 2024-02-19T19:07:34.138 INFO:tasks.workunit.client.1.smithi142.stdout:8/459: write d9/dd/f47 [661162,13659] 0 2024-02-19T19:07:34.138 INFO:tasks.workunit.client.1.smithi142.stdout:8/460: creat d9/dd/de/f8c x:0 0 0 2024-02-19T19:07:34.139 INFO:tasks.workunit.client.1.smithi142.stdout:2/431: dwrite d3/d4d/f50 [0,4194304] 0 2024-02-19T19:07:34.139 INFO:tasks.workunit.client.1.smithi142.stdout:2/432: write d3/db/f34 [228652,5464] 0 2024-02-19T19:07:34.141 INFO:tasks.workunit.client.1.smithi142.stdout:0/353: creat d23/d28/f72 x:0 0 0 2024-02-19T19:07:34.143 INFO:tasks.workunit.client.1.smithi142.stdout:3/553: rename d1d/d1e/f5d to d1d/d36/d3a/d62/d8d/d92/fa6 0 2024-02-19T19:07:34.145 INFO:tasks.workunit.client.1.smithi142.stdout:6/396: mkdir d2/d1f/d4d/d60/d87 0 2024-02-19T19:07:34.145 INFO:tasks.workunit.client.1.smithi142.stdout:7/344: dwrite d0/d13/d1e/d22/f57 [0,4194304] 0 2024-02-19T19:07:34.146 INFO:tasks.workunit.client.1.smithi142.stdout:4/518: mknod d4/d14/d31/d43/caf 0 2024-02-19T19:07:34.146 INFO:tasks.workunit.client.1.smithi142.stdout:4/519: chown d4/d1d/d42/d66/d5f/c80 4654 1 2024-02-19T19:07:34.148 INFO:tasks.workunit.client.1.smithi142.stdout:5/436: dwrite d5/dd/d8/d2a/f4e [0,4194304] 0 2024-02-19T19:07:34.151 INFO:tasks.workunit.client.1.smithi142.stdout:2/433: mknod d3/db/d29/d4c/d4a/c89 0 2024-02-19T19:07:34.151 INFO:tasks.workunit.client.1.smithi142.stdout:2/434: truncate d3/db/d29/f85 939164 0 2024-02-19T19:07:34.152 INFO:tasks.workunit.client.1.smithi142.stdout:0/354: mknod d23/d28/d2d/d51/d44/d58/c73 0 2024-02-19T19:07:34.155 INFO:tasks.workunit.client.1.smithi142.stdout:6/397: rmdir d2/d1f/d4d/d60 39 2024-02-19T19:07:34.158 INFO:tasks.workunit.client.1.smithi142.stdout:7/345: creat d0/d1b/d21/d24/d29/f6e x:0 0 0 2024-02-19T19:07:34.158 INFO:tasks.workunit.client.1.smithi142.stdout:7/346: stat d0/d1b/d21/d24/d29/d44/f55 0 2024-02-19T19:07:34.159 INFO:tasks.workunit.client.1.smithi142.stdout:4/520: getdents d4/d1d/d42/d66/dd/d10/d26/d50/d54 0 2024-02-19T19:07:34.162 INFO:tasks.workunit.client.1.smithi142.stdout:2/435: truncate d3/db/f3a 2601199 0 2024-02-19T19:07:34.163 INFO:tasks.workunit.client.1.smithi142.stdout:0/355: creat d23/d28/d2d/d54/f74 x:0 0 0 2024-02-19T19:07:34.163 INFO:tasks.workunit.client.1.smithi142.stdout:8/461: dwrite d9/dd/d44/d79/f53 [0,4194304] 0 2024-02-19T19:07:34.166 INFO:tasks.workunit.client.1.smithi142.stdout:1/601: dwrite d5/d7/f8a [0,4194304] 0 2024-02-19T19:07:34.166 INFO:tasks.workunit.client.1.smithi142.stdout:9/461: dwrite db/f53 [0,4194304] 0 2024-02-19T19:07:34.169 INFO:tasks.workunit.client.1.smithi142.stdout:6/398: mkdir d2/d1f/d20/d31/d88 0 2024-02-19T19:07:34.171 INFO:tasks.workunit.client.1.smithi142.stdout:7/347: symlink d0/d1b/d21/d24/d29/l6f 0 2024-02-19T19:07:34.172 INFO:tasks.workunit.client.1.smithi142.stdout:7/348: chown d0/d13 14976 1 2024-02-19T19:07:34.172 INFO:tasks.workunit.client.1.smithi142.stdout:8/462: write d9/dd/de/d14/f20 [952278,91880] 0 2024-02-19T19:07:34.173 INFO:tasks.workunit.client.1.smithi142.stdout:2/436: write d3/d35/d53/f65 [1948662,26234] 0 2024-02-19T19:07:34.173 INFO:tasks.workunit.client.1.smithi142.stdout:2/437: write d3/db/f47 [1410575,72183] 0 2024-02-19T19:07:34.173 INFO:tasks.workunit.client.1.smithi142.stdout:2/438: chown d3/db/d29/d4c/d4a 202 1 2024-02-19T19:07:34.179 INFO:tasks.workunit.client.1.smithi142.stdout:9/462: unlink db/d10/d22/c30 0 2024-02-19T19:07:34.180 INFO:tasks.workunit.client.1.smithi142.stdout:9/463: fsync db/d10/d27/d2f/d4c/f35 0 2024-02-19T19:07:34.180 INFO:tasks.workunit.client.1.smithi142.stdout:9/464: chown db/d10/d27/f42 17202 1 2024-02-19T19:07:34.181 INFO:tasks.workunit.client.1.smithi142.stdout:0/356: dwrite d23/d28/f72 [0,4194304] 0 2024-02-19T19:07:34.181 INFO:tasks.workunit.client.1.smithi142.stdout:0/357: fsync d23/f31 0 2024-02-19T19:07:34.185 INFO:tasks.workunit.client.1.smithi142.stdout:7/349: creat d0/d13/f70 x:0 0 0 2024-02-19T19:07:34.185 INFO:tasks.workunit.client.1.smithi142.stdout:7/350: creat d0/d13/d1e/f71 x:0 0 0 2024-02-19T19:07:34.186 INFO:tasks.workunit.client.1.smithi142.stdout:8/463: mknod d9/dd/de/d2d/d2e/d49/d50/d59/c8d 0 2024-02-19T19:07:34.186 INFO:tasks.workunit.client.1.smithi142.stdout:8/464: read - d9/dd/de/f86 zero size 2024-02-19T19:07:34.186 INFO:tasks.workunit.client.1.smithi142.stdout:8/465: truncate d9/dd/f68 644563 0 2024-02-19T19:07:34.187 INFO:tasks.workunit.client.1.smithi142.stdout:8/466: creat d9/dd/de/d2d/d2e/d49/d50/d59/f8e x:0 0 0 2024-02-19T19:07:34.187 INFO:tasks.workunit.client.1.smithi142.stdout:8/467: write d9/dd/f47 [872933,79259] 0 2024-02-19T19:07:34.187 INFO:tasks.workunit.client.1.smithi142.stdout:8/468: chown d9/dd/de/d14/c8b 1092 1 2024-02-19T19:07:34.187 INFO:tasks.workunit.client.1.smithi142.stdout:8/469: chown f0 23307429 1 2024-02-19T19:07:34.187 INFO:tasks.workunit.client.1.smithi142.stdout:8/470: write d9/dd/de/d2d/d2e/d49/d50/f64 [1263671,17244] 0 2024-02-19T19:07:34.187 INFO:tasks.workunit.client.1.smithi142.stdout:6/399: dwrite d2/f14 [4194304,4194304] 0 2024-02-19T19:07:34.194 INFO:tasks.workunit.client.1.smithi142.stdout:2/439: mknod d3/db/d29/d4c/d4a/c8a 0 2024-02-19T19:07:34.194 INFO:tasks.workunit.client.1.smithi142.stdout:2/440: fdatasync d3/db/f47 0 2024-02-19T19:07:34.195 INFO:tasks.workunit.client.1.smithi142.stdout:3/554: rename d1d/d36 to d1d/d1e/d2e/d50/d7c/da7 0 2024-02-19T19:07:34.195 INFO:tasks.workunit.client.1.smithi142.stdout:9/465: truncate db/d10/d22/f50 47327 0 2024-02-19T19:07:34.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:33 smithi142 ceph-mon[69118]: osdmap e62: 6 total, 5 up, 6 in 2024-02-19T19:07:34.204 INFO:tasks.workunit.client.1.smithi142.stdout:5/437: truncate f4 3194755 0 2024-02-19T19:07:34.204 INFO:tasks.workunit.client.1.smithi142.stdout:5/438: truncate d5/dd/d5f/f7b 785055 0 2024-02-19T19:07:34.205 INFO:tasks.workunit.client.1.smithi142.stdout:2/441: mknod d3/d4d/c8b 0 2024-02-19T19:07:34.205 INFO:tasks.workunit.client.1.smithi142.stdout:2/442: creat d3/d4b/f8c x:0 0 0 2024-02-19T19:07:34.207 INFO:tasks.workunit.client.1.smithi142.stdout:1/602: rename d5/d7/d23/d2c/ca1 to d5/d1a/d33/cd6 0 2024-02-19T19:07:34.209 INFO:tasks.workunit.client.1.smithi142.stdout:2/443: dread d3/db/d29/d6d/f56 [0,4194304] 0 2024-02-19T19:07:34.210 INFO:tasks.workunit.client.1.smithi142.stdout:3/555: link d1d/d1e/f32 d1d/d1e/d2e/d50/d7c/da7/d3a/d62/da2/fa8 0 2024-02-19T19:07:34.210 INFO:tasks.workunit.client.1.smithi142.stdout:3/556: read - d1d/d1e/d2e/f48 zero size 2024-02-19T19:07:34.211 INFO:tasks.workunit.client.1.smithi142.stdout:9/466: truncate db/d10/d22/f5c 2029023 0 2024-02-19T19:07:34.211 INFO:tasks.workunit.client.1.smithi142.stdout:9/467: chown db/d10/d32/d3f/d5f/l65 416 1 2024-02-19T19:07:34.213 INFO:tasks.workunit.client.1.smithi142.stdout:0/358: unlink d23/d28/d41/f5e 0 2024-02-19T19:07:34.213 INFO:tasks.workunit.client.1.smithi142.stdout:0/359: creat d23/d28/d41/f75 x:0 0 0 2024-02-19T19:07:34.214 INFO:tasks.workunit.client.1.smithi142.stdout:8/471: getdents d9/dd 0 2024-02-19T19:07:34.220 INFO:tasks.workunit.client.1.smithi142.stdout:3/557: dread d1d/d1e/d2e/f78 [0,4194304] 0 2024-02-19T19:07:34.220 INFO:tasks.workunit.client.1.smithi142.stdout:3/558: chown d1d/d1e/d2e/d50/d7c/da7/d52/d71 687454 1 2024-02-19T19:07:34.221 INFO:tasks.workunit.client.1.smithi142.stdout:1/603: dwrite d5/d7/d23/fcd [0,4194304] 0 2024-02-19T19:07:34.224 INFO:tasks.workunit.client.1.smithi142.stdout:9/468: mknod db/d10/d22/d24/d3d/c88 0 2024-02-19T19:07:34.224 INFO:tasks.workunit.client.1.smithi142.stdout:9/469: truncate db/d10/d32/f7f 254821 0 2024-02-19T19:07:34.230 INFO:tasks.workunit.client.1.smithi142.stdout:1/604: unlink d5/d1a/l1e 0 2024-02-19T19:07:34.230 INFO:tasks.workunit.client.1.smithi142.stdout:1/605: chown d5/d7/c86 0 1 2024-02-19T19:07:34.230 INFO:tasks.workunit.client.1.smithi142.stdout:1/606: write d5/d73/f91 [311891,56383] 0 2024-02-19T19:07:34.231 INFO:tasks.workunit.client.1.smithi142.stdout:1/607: readlink d5/d1a/lad 0 2024-02-19T19:07:34.231 INFO:tasks.workunit.client.1.smithi142.stdout:1/608: chown d5/ff 4 1 2024-02-19T19:07:34.232 INFO:tasks.workunit.client.1.smithi142.stdout:7/351: rename d0/d1b/d21/d24/d31 to d0/d13/d72 0 2024-02-19T19:07:34.233 INFO:tasks.workunit.client.1.smithi142.stdout:7/352: chown d0/d13 551 1 2024-02-19T19:07:34.235 INFO:tasks.workunit.client.1.smithi142.stdout:5/439: rename d5/dd/d8/d1c/l23 to d5/dd/d8/d31/d4d/d75/l92 0 2024-02-19T19:07:34.235 INFO:tasks.workunit.client.1.smithi142.stdout:9/470: read db/f53 [2917682,26226] 0 2024-02-19T19:07:34.235 INFO:tasks.workunit.client.1.smithi142.stdout:9/471: write db/d10/d32/d3f/f7e [1039565,110460] 0 2024-02-19T19:07:34.237 INFO:tasks.workunit.client.1.smithi142.stdout:2/444: rename d3/d35/d53/l67 to d3/d4d/d81/l8d 0 2024-02-19T19:07:34.238 INFO:tasks.workunit.client.1.smithi142.stdout:2/445: dread - d3/d4d/d5f/d7c/f7e zero size 2024-02-19T19:07:34.238 INFO:tasks.workunit.client.1.smithi142.stdout:2/446: stat d3/db/d29/d6d/d59/f6e 0 2024-02-19T19:07:34.239 INFO:tasks.workunit.client.1.smithi142.stdout:9/472: mkdir db/d10/d22/d24/d3d/d89 0 2024-02-19T19:07:34.244 INFO:tasks.workunit.client.1.smithi142.stdout:8/472: dwrite d9/dd/de/d2d/d2e/d49/f70 [0,4194304] 0 2024-02-19T19:07:34.245 INFO:tasks.workunit.client.1.smithi142.stdout:1/609: dwrite d5/d37/d6c/fa8 [0,4194304] 0 2024-02-19T19:07:34.246 INFO:tasks.workunit.client.1.smithi142.stdout:0/360: rename d23/d28/f40 to d23/d28/d2d/d51/d44/d58/f76 0 2024-02-19T19:07:34.248 INFO:tasks.workunit.client.1.smithi142.stdout:2/447: rmdir d3/d4d/d5f 39 2024-02-19T19:07:34.252 INFO:tasks.workunit.client.1.smithi142.stdout:8/473: rmdir d9/dd/de/d14/d65 39 2024-02-19T19:07:34.257 INFO:tasks.workunit.client.1.smithi142.stdout:5/440: write d5/dd/df/d22/d41/d32/f62 [1951264,72060] 0 2024-02-19T19:07:34.257 INFO:tasks.workunit.client.1.smithi142.stdout:5/441: chown d5/dd/df/f6b 14 1 2024-02-19T19:07:34.257 INFO:tasks.workunit.client.1.smithi142.stdout:5/442: chown d5/dd/df/d22/d41/d6f/f89 3899790 1 2024-02-19T19:07:34.257 INFO:tasks.workunit.client.1.smithi142.stdout:1/610: unlink d5/d1a/d59/f90 0 2024-02-19T19:07:34.258 INFO:tasks.workunit.client.1.smithi142.stdout:3/559: rename d1d/d1e/d2e/d50/d7c/da7/d3a/d62/d8d/d92 to d1d/d1e/d2e/d37/d6c/da9 0 2024-02-19T19:07:34.258 INFO:tasks.workunit.client.1.smithi142.stdout:3/560: write d1d/d1e/d2e/d50/d7c/da7/f5c [917564,13370] 0 2024-02-19T19:07:34.259 INFO:tasks.workunit.client.1.smithi142.stdout:2/448: link d3/d35/f48 d3/d4d/d81/f8e 0 2024-02-19T19:07:34.261 INFO:tasks.workunit.client.1.smithi142.stdout:8/474: link d9/dd/de/d2d/d2e/d49/d50/d59/f7f d9/dd/de/d2d/d2e/d49/d74/f8f 0 2024-02-19T19:07:34.262 INFO:tasks.workunit.client.1.smithi142.stdout:1/611: creat d5/d7/d23/d2c/fd7 x:0 0 0 2024-02-19T19:07:34.262 INFO:tasks.workunit.client.1.smithi142.stdout:9/473: dwrite db/d10/d22/d24/f3e [0,4194304] 0 2024-02-19T19:07:34.262 INFO:tasks.workunit.client.1.smithi142.stdout:9/474: truncate db/d10/d27/d2f/f87 155728 0 2024-02-19T19:07:34.263 INFO:tasks.workunit.client.1.smithi142.stdout:9/475: readlink db/d10/d32/d3f/d5f/l73 0 2024-02-19T19:07:34.263 INFO:tasks.workunit.client.1.smithi142.stdout:7/353: dwrite d0/d13/f15 [0,4194304] 0 2024-02-19T19:07:34.263 INFO:tasks.workunit.client.1.smithi142.stdout:7/354: fsync d0/d13/f70 0 2024-02-19T19:07:34.265 INFO:tasks.workunit.client.1.smithi142.stdout:5/443: rename d5/d45 to d5/dd/d8/d2a/d93 0 2024-02-19T19:07:34.265 INFO:tasks.workunit.client.1.smithi142.stdout:0/361: dwrite d23/d28/d2d/d51/f4f [0,4194304] 0 2024-02-19T19:07:34.265 INFO:tasks.workunit.client.1.smithi142.stdout:8/475: dread d9/dd/de/d14/f20 [0,4194304] 0 2024-02-19T19:07:34.266 INFO:tasks.workunit.client.1.smithi142.stdout:3/561: getdents d1d/d1e/d2e/d50/d7c/da7/d3a/d62 0 2024-02-19T19:07:34.267 INFO:tasks.workunit.client.1.smithi142.stdout:5/444: fdatasync d5/dd/df/d22/d41/d32/f62 0 2024-02-19T19:07:34.269 INFO:tasks.workunit.client.1.smithi142.stdout:2/449: symlink d3/db/l8f 0 2024-02-19T19:07:34.269 INFO:tasks.workunit.client.1.smithi142.stdout:2/450: creat d3/d4d/f90 x:0 0 0 2024-02-19T19:07:34.275 INFO:tasks.workunit.client.1.smithi142.stdout:1/612: unlink d5/d1a/d59/fc9 0 2024-02-19T19:07:34.277 INFO:tasks.workunit.client.1.smithi142.stdout:9/476: dwrite db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:34.281 INFO:tasks.workunit.client.1.smithi142.stdout:0/362: dwrite d23/d28/d2d/d51/f4f [0,4194304] 0 2024-02-19T19:07:34.284 INFO:tasks.workunit.client.1.smithi142.stdout:7/355: mknod d0/d13/d1e/c73 0 2024-02-19T19:07:34.284 INFO:tasks.workunit.client.1.smithi142.stdout:1/613: write d5/d7/d4a/f81 [490304,124785] 0 2024-02-19T19:07:34.284 INFO:tasks.workunit.client.1.smithi142.stdout:1/614: fsync d5/d7/d23/d2c/f51 0 2024-02-19T19:07:34.289 INFO:tasks.workunit.client.1.smithi142.stdout:8/476: creat d9/dd/de/d14/d65/f90 x:0 0 0 2024-02-19T19:07:34.289 INFO:tasks.workunit.client.1.smithi142.stdout:8/477: stat d9/la 0 2024-02-19T19:07:34.291 INFO:tasks.workunit.client.1.smithi142.stdout:2/451: getdents d3/db/d29/d6d/d59/d64 0 2024-02-19T19:07:34.295 INFO:tasks.workunit.client.1.smithi142.stdout:9/477: rename db/d10/d32/f69 to db/d10/d27/d2f/d4c/d54/d83/f8a 0 2024-02-19T19:07:34.298 INFO:tasks.workunit.client.1.smithi142.stdout:7/356: creat d0/d1b/d21/d24/d5e/d65/f74 x:0 0 0 2024-02-19T19:07:34.299 INFO:tasks.workunit.client.1.smithi142.stdout:1/615: mknod d5/d37/d6c/dd0/cd8 0 2024-02-19T19:07:34.301 INFO:tasks.workunit.client.1.smithi142.stdout:8/478: symlink d9/dd/d15/d31/l91 0 2024-02-19T19:07:34.301 INFO:tasks.workunit.client.1.smithi142.stdout:9/478: dread db/d10/f15 [0,4194304] 0 2024-02-19T19:07:34.301 INFO:tasks.workunit.client.1.smithi142.stdout:9/479: chown db/d10/d7d/f4d 11279 1 2024-02-19T19:07:34.301 INFO:tasks.workunit.client.1.smithi142.stdout:4/521: sync 2024-02-19T19:07:34.302 INFO:tasks.workunit.client.1.smithi142.stdout:3/562: getdents d1d/d1e 0 2024-02-19T19:07:34.303 INFO:tasks.workunit.client.1.smithi142.stdout:6/400: sync 2024-02-19T19:07:34.303 INFO:tasks.workunit.client.1.smithi142.stdout:6/401: readlink d2/d1e/l34 0 2024-02-19T19:07:34.304 INFO:tasks.workunit.client.1.smithi142.stdout:3/563: write fa [4943776,51080] 0 2024-02-19T19:07:34.304 INFO:tasks.workunit.client.1.smithi142.stdout:5/445: getdents d5/dd/d8/d31/d4d/d60 0 2024-02-19T19:07:34.307 INFO:tasks.workunit.client.1.smithi142.stdout:2/452: rename d3/db/l24 to d3/db/d29/d4c/l91 0 2024-02-19T19:07:34.308 INFO:tasks.workunit.client.1.smithi142.stdout:1/616: dread d5/d7/f3e [0,4194304] 0 2024-02-19T19:07:34.308 INFO:tasks.workunit.client.1.smithi142.stdout:1/617: creat d5/d37/d6c/d75/da2/fd9 x:0 0 0 2024-02-19T19:07:34.308 INFO:tasks.workunit.client.1.smithi142.stdout:0/363: truncate d23/d28/f33 7956 0 2024-02-19T19:07:34.312 INFO:tasks.workunit.client.1.smithi142.stdout:8/479: creat d9/dd/de/d2d/d2e/d73/f92 x:0 0 0 2024-02-19T19:07:34.313 INFO:tasks.workunit.client.1.smithi142.stdout:8/480: dread d9/dd/de/d2d/d2e/d49/d50/d59/f7f [0,4194304] 0 2024-02-19T19:07:34.314 INFO:tasks.workunit.client.1.smithi142.stdout:6/402: mkdir d2/d1f/d20/d31/d3d/d89 0 2024-02-19T19:07:34.316 INFO:tasks.workunit.client.1.smithi142.stdout:7/357: rename d0/d13/l1a to d0/d13/d72/d47/d69/l75 0 2024-02-19T19:07:34.316 INFO:tasks.workunit.client.1.smithi142.stdout:1/618: write d5/d1a/f47 [604920,103779] 0 2024-02-19T19:07:34.318 INFO:tasks.workunit.client.1.smithi142.stdout:2/453: dread d3/d35/d53/f65 [0,4194304] 0 2024-02-19T19:07:34.318 INFO:tasks.workunit.client.1.smithi142.stdout:2/454: chown d3/db/f7f 573356 1 2024-02-19T19:07:34.320 INFO:tasks.workunit.client.1.smithi142.stdout:9/480: dwrite db/d10/d27/f42 [0,4194304] 0 2024-02-19T19:07:34.320 INFO:tasks.workunit.client.1.smithi142.stdout:9/481: stat db/d10/c6e 0 2024-02-19T19:07:34.320 INFO:tasks.workunit.client.1.smithi142.stdout:9/482: chown db/d10/d22/f37 255 1 2024-02-19T19:07:34.320 INFO:tasks.workunit.client.1.smithi142.stdout:4/522: dwrite d4/d14/d31/d43/f5d [0,4194304] 0 2024-02-19T19:07:34.320 INFO:tasks.workunit.client.1.smithi142.stdout:4/523: write d4/d1d/d42/d66/d12/f18 [992240,87038] 0 2024-02-19T19:07:34.321 INFO:tasks.workunit.client.1.smithi142.stdout:8/481: mknod d9/dd/d15/c93 0 2024-02-19T19:07:34.321 INFO:tasks.workunit.client.1.smithi142.stdout:8/482: dread d9/dd/f68 [0,4194304] 0 2024-02-19T19:07:34.323 INFO:tasks.workunit.client.1.smithi142.stdout:3/564: rename f5 to d1d/d1e/d2e/d50/d7c/da7/d52/d71/faa 0 2024-02-19T19:07:34.325 INFO:tasks.workunit.client.1.smithi142.stdout:3/565: dread d1d/d1e/f6b [0,4194304] 0 2024-02-19T19:07:34.325 INFO:tasks.workunit.client.1.smithi142.stdout:3/566: chown fa 10469435 1 2024-02-19T19:07:34.326 INFO:tasks.workunit.client.1.smithi142.stdout:1/619: creat d5/d77/fda x:0 0 0 2024-02-19T19:07:34.327 INFO:tasks.workunit.client.1.smithi142.stdout:2/455: mknod d3/df/c92 0 2024-02-19T19:07:34.329 INFO:tasks.workunit.client.1.smithi142.stdout:0/364: link d23/d28/c39 d23/d28/d41/c77 0 2024-02-19T19:07:34.333 INFO:tasks.workunit.client.1.smithi142.stdout:9/483: creat db/d10/d22/d24/f8b x:0 0 0 2024-02-19T19:07:34.333 INFO:tasks.workunit.client.1.smithi142.stdout:9/484: chown db/d10/d27/c6f 69956804 1 2024-02-19T19:07:34.335 INFO:tasks.workunit.client.1.smithi142.stdout:4/524: truncate d4/d1d/d42/d66/d12/d2d/f69 1376806 0 2024-02-19T19:07:34.336 INFO:tasks.workunit.client.1.smithi142.stdout:7/358: getdents d0/d13/d1e 0 2024-02-19T19:07:34.337 INFO:tasks.workunit.client.1.smithi142.stdout:7/359: write d0/d13/d72/f33 [258549,50539] 0 2024-02-19T19:07:34.337 INFO:tasks.workunit.client.1.smithi142.stdout:8/483: mkdir d9/dd/de/d14/d65/d94 0 2024-02-19T19:07:34.339 INFO:tasks.workunit.client.1.smithi142.stdout:5/446: rename d5/dd/d8/d2a/f46 to d5/dd/d8/d31/d4d/f94 0 2024-02-19T19:07:34.339 INFO:tasks.workunit.client.1.smithi142.stdout:5/447: write d5/dd/d8/d31/f6e [81881,69408] 0 2024-02-19T19:07:34.340 INFO:tasks.workunit.client.1.smithi142.stdout:8/484: dread d9/dd/d15/f28 [0,4194304] 0 2024-02-19T19:07:34.340 INFO:tasks.workunit.client.1.smithi142.stdout:8/485: creat d9/dd/de/d2d/d2e/d49/d58/f95 x:0 0 0 2024-02-19T19:07:34.341 INFO:tasks.workunit.client.1.smithi142.stdout:3/567: creat d1d/d1e/d2e/d50/d7c/da7/d52/d5a/fab x:0 0 0 2024-02-19T19:07:34.341 INFO:tasks.workunit.client.1.smithi142.stdout:3/568: fsync d1d/f9e 0 2024-02-19T19:07:34.342 INFO:tasks.workunit.client.1.smithi142.stdout:0/365: mkdir d23/d28/d41/d78 0 2024-02-19T19:07:34.343 INFO:tasks.workunit.client.1.smithi142.stdout:9/485: unlink db/d10/d27/c6f 0 2024-02-19T19:07:34.344 INFO:tasks.workunit.client.1.smithi142.stdout:4/525: symlink d4/d1d/d42/d66/d5f/lb0 0 2024-02-19T19:07:34.344 INFO:tasks.workunit.client.1.smithi142.stdout:4/526: dread - d4/d1d/d42/d66/dd/d10/d3e/d68/d87/f9e zero size 2024-02-19T19:07:34.345 INFO:tasks.workunit.client.1.smithi142.stdout:6/403: rename d2/f18 to d2/d1f/d4d/d60/d87/f8a 0 2024-02-19T19:07:34.345 INFO:tasks.workunit.client.1.smithi142.stdout:2/456: dwrite d3/df/f32 [8388608,4194304] 0 2024-02-19T19:07:34.346 INFO:tasks.workunit.client.1.smithi142.stdout:2/457: chown d3/df/l30 24898 1 2024-02-19T19:07:34.346 INFO:tasks.workunit.client.1.smithi142.stdout:1/620: dwrite d5/f4e [0,4194304] 0 2024-02-19T19:07:34.348 INFO:tasks.workunit.client.1.smithi142.stdout:3/569: creat d1d/d1e/d2e/d50/d7c/da7/d3a/d57/fac x:0 0 0 2024-02-19T19:07:34.349 INFO:tasks.workunit.client.1.smithi142.stdout:0/366: rmdir d23/d28/d2d/d51/d44/d58 39 2024-02-19T19:07:34.349 INFO:tasks.workunit.client.1.smithi142.stdout:0/367: creat d23/d28/d2d/f79 x:0 0 0 2024-02-19T19:07:34.349 INFO:tasks.workunit.client.1.smithi142.stdout:0/368: fsync d23/d28/d2d/d51/d44/d58/f76 0 2024-02-19T19:07:34.350 INFO:tasks.workunit.client.1.smithi142.stdout:9/486: creat db/d10/d22/d24/d3d/d89/f8c x:0 0 0 2024-02-19T19:07:34.351 INFO:tasks.workunit.client.1.smithi142.stdout:4/527: mknod d4/d1d/d42/d66/d2c/cb1 0 2024-02-19T19:07:34.352 INFO:tasks.workunit.client.1.smithi142.stdout:2/458: symlink d3/d68/l93 0 2024-02-19T19:07:34.355 INFO:tasks.workunit.client.1.smithi142.stdout:7/360: rename d0/d13/d1e/d22/l41 to d0/d1b/d21/d24/d5e/l76 0 2024-02-19T19:07:34.357 INFO:tasks.workunit.client.1.smithi142.stdout:5/448: getdents d5/dd/df/d15 0 2024-02-19T19:07:34.359 INFO:tasks.workunit.client.1.smithi142.stdout:3/570: link d1d/l2d d1d/d1e/d2e/d50/d7c/da7/d3a/d62/d91/lad 0 2024-02-19T19:07:34.364 INFO:tasks.workunit.client.1.smithi142.stdout:9/487: unlink db/d10/d27/d2f/d4c/f35 0 2024-02-19T19:07:34.368 INFO:tasks.workunit.client.1.smithi142.stdout:4/528: getdents d4/d1d/d42/d66/d12/d2d 0 2024-02-19T19:07:34.373 INFO:tasks.workunit.client.1.smithi142.stdout:0/369: rename d23/d28/d2d/f57 to d23/d28/f7a 0 2024-02-19T19:07:34.373 INFO:tasks.workunit.client.1.smithi142.stdout:0/370: chown d23/d28/d2d/d51/d44/d58/f5d 193670774 1 2024-02-19T19:07:34.373 INFO:tasks.workunit.client.1.smithi142.stdout:5/449: rmdir d5/dd/df/d22/d41/d6f 39 2024-02-19T19:07:34.373 INFO:tasks.workunit.client.1.smithi142.stdout:4/529: dread d4/d14/f2f [0,4194304] 0 2024-02-19T19:07:34.373 INFO:tasks.workunit.client.1.smithi142.stdout:4/530: truncate d4/d1d/d42/d66/dd/d10/d3e/f81 719457 0 2024-02-19T19:07:34.374 INFO:tasks.workunit.client.1.smithi142.stdout:0/371: rename d23/d28/d41/c42 to d23/d28/d2d/d54/c7b 0 2024-02-19T19:07:34.375 INFO:tasks.workunit.client.1.smithi142.stdout:5/450: mkdir d5/dd/d95 0 2024-02-19T19:07:34.375 INFO:tasks.workunit.client.1.smithi142.stdout:5/451: creat d5/dd/d8/d29/f96 x:0 0 0 2024-02-19T19:07:34.375 INFO:tasks.workunit.client.1.smithi142.stdout:5/452: write d5/dd/df/d22/d41/d32/f62 [2285002,105093] 0 2024-02-19T19:07:34.375 INFO:tasks.workunit.client.1.smithi142.stdout:0/372: symlink d23/d28/d2d/l7c 0 2024-02-19T19:07:34.375 INFO:tasks.workunit.client.1.smithi142.stdout:0/373: fsync f18 0 2024-02-19T19:07:34.377 INFO:tasks.workunit.client.1.smithi142.stdout:5/453: rename d5/dd/df/d22/d41/f3a to d5/dd/d8/d1c/f97 0 2024-02-19T19:07:34.377 INFO:tasks.workunit.client.1.smithi142.stdout:0/374: mkdir d23/d7d 0 2024-02-19T19:07:34.378 INFO:tasks.workunit.client.1.smithi142.stdout:0/375: creat d23/d28/d2d/d51/f7e x:0 0 0 2024-02-19T19:07:34.389 INFO:tasks.workunit.client.1.smithi142.stdout:8/486: dwrite d9/dd/de/d14/d65/d6c/f33 [0,4194304] 0 2024-02-19T19:07:34.391 INFO:tasks.workunit.client.1.smithi142.stdout:8/487: getdents d9/dd/de/d2d/d2e 0 2024-02-19T19:07:34.392 INFO:tasks.workunit.client.1.smithi142.stdout:8/488: mkdir d9/dd/d15/d31/d96 0 2024-02-19T19:07:34.414 INFO:tasks.workunit.client.1.smithi142.stdout:6/404: dwrite d2/d17/f19 [0,4194304] 0 2024-02-19T19:07:34.416 INFO:tasks.workunit.client.1.smithi142.stdout:6/405: unlink d2/c8 0 2024-02-19T19:07:34.421 INFO:tasks.workunit.client.1.smithi142.stdout:1/621: dwrite d5/d37/d6c/fa8 [0,4194304] 0 2024-02-19T19:07:34.421 INFO:tasks.workunit.client.1.smithi142.stdout:1/622: dread - d5/d7/d4a/d53/d6a/faa zero size 2024-02-19T19:07:34.422 INFO:tasks.workunit.client.1.smithi142.stdout:3/571: dwrite d1d/d1e/d2e/d50/d7c/da7/d52/d5a/fab [0,4194304] 0 2024-02-19T19:07:34.422 INFO:tasks.workunit.client.1.smithi142.stdout:3/572: chown f1c 38541 1 2024-02-19T19:07:34.422 INFO:tasks.workunit.client.1.smithi142.stdout:9/488: dwrite db/d10/d22/d24/f8b [0,4194304] 0 2024-02-19T19:07:34.423 INFO:tasks.workunit.client.1.smithi142.stdout:5/454: dwrite d5/dd/df/f6b [0,4194304] 0 2024-02-19T19:07:34.423 INFO:tasks.workunit.client.1.smithi142.stdout:4/531: dwrite d4/d14/d31/d43/f48 [0,4194304] 0 2024-02-19T19:07:34.423 INFO:tasks.workunit.client.1.smithi142.stdout:0/376: dwrite f13 [0,4194304] 0 2024-02-19T19:07:34.423 INFO:tasks.workunit.client.1.smithi142.stdout:1/623: symlink d5/d77/da9/dae/ldb 0 2024-02-19T19:07:34.424 INFO:tasks.workunit.client.1.smithi142.stdout:7/361: dwrite d0/d1b/d21/d24/d29/d44/d49/f64 [0,4194304] 0 2024-02-19T19:07:34.424 INFO:tasks.workunit.client.1.smithi142.stdout:7/362: write d0/d1b/d21/d24/d29/d44/f55 [509543,83629] 0 2024-02-19T19:07:34.426 INFO:tasks.workunit.client.1.smithi142.stdout:3/573: dread d1d/d1e/d2e/d50/d7c/da7/d3a/f4b [0,4194304] 0 2024-02-19T19:07:34.426 INFO:tasks.workunit.client.1.smithi142.stdout:3/574: write d1d/d1e/d2e/d50/d7c/da7/d52/d5a/f94 [132276,121294] 0 2024-02-19T19:07:34.433 INFO:tasks.workunit.client.1.smithi142.stdout:9/489: dread db/d10/d22/f5c [0,4194304] 0 2024-02-19T19:07:34.434 INFO:tasks.workunit.client.1.smithi142.stdout:9/490: fsync db/d10/d32/d3f/f75 0 2024-02-19T19:07:34.434 INFO:tasks.workunit.client.1.smithi142.stdout:9/491: fsync db/d10/d22/f37 0 2024-02-19T19:07:34.438 INFO:tasks.workunit.client.1.smithi142.stdout:5/455: creat d5/dd/d8/d31/d4d/d8d/f98 x:0 0 0 2024-02-19T19:07:34.445 INFO:tasks.workunit.client.1.smithi142.stdout:7/363: mknod d0/d1b/d21/c77 0 2024-02-19T19:07:34.446 INFO:tasks.workunit.client.1.smithi142.stdout:3/575: creat d1d/d1e/d2e/d50/d83/fae x:0 0 0 2024-02-19T19:07:34.447 INFO:tasks.workunit.client.1.smithi142.stdout:9/492: symlink db/d10/d80/l8d 0 2024-02-19T19:07:34.448 INFO:tasks.workunit.client.1.smithi142.stdout:7/364: rename d0/d13/d72/d47/d69/f60 to d0/d13/d1e/d22/f78 0 2024-02-19T19:07:34.450 INFO:tasks.workunit.client.1.smithi142.stdout:3/576: symlink d1d/d1e/d2e/d50/d7c/da7/laf 0 2024-02-19T19:07:34.452 INFO:tasks.workunit.client.1.smithi142.stdout:3/577: unlink d1d/d1e/d2e/d50/f8a 0 2024-02-19T19:07:34.453 INFO:tasks.workunit.client.1.smithi142.stdout:3/578: symlink d1d/d1e/d2e/d37/d81/lb0 0 2024-02-19T19:07:34.455 INFO:tasks.workunit.client.1.smithi142.stdout:3/579: mknod d1d/d1e/d2e/d50/d7c/da7/d52/d5a/da4/cb1 0 2024-02-19T19:07:34.457 INFO:tasks.workunit.client.1.smithi142.stdout:9/493: write db/d10/d7d/f4d [5918996,40884] 0 2024-02-19T19:07:34.458 INFO:tasks.workunit.client.1.smithi142.stdout:3/580: unlink lf 0 2024-02-19T19:07:34.458 INFO:tasks.workunit.client.1.smithi142.stdout:3/581: fsync d1d/d1e/d2e/d50/d7c/da7/d52/f54 0 2024-02-19T19:07:34.459 INFO:tasks.workunit.client.1.smithi142.stdout:3/582: fdatasync d1d/d1e/d2e/d50/d7c/da7/d52/f56 0 2024-02-19T19:07:34.459 INFO:tasks.workunit.client.1.smithi142.stdout:3/583: write d1d/d1e/d2e/d50/d7c/da7/f5c [939171,122693] 0 2024-02-19T19:07:34.461 INFO:tasks.workunit.client.1.smithi142.stdout:3/584: symlink d1d/d1e/d2e/d50/d83/lb2 0 2024-02-19T19:07:34.462 INFO:tasks.workunit.client.1.smithi142.stdout:9/494: mkdir db/d8e 0 2024-02-19T19:07:34.462 INFO:tasks.workunit.client.1.smithi142.stdout:9/495: readlink db/d10/d22/d24/d41/l67 0 2024-02-19T19:07:34.463 INFO:tasks.workunit.client.1.smithi142.stdout:3/585: rename d1d/d1e/d2e/l5e to d1d/d1e/d2e/d50/d7c/da7/d3a/d62/da2/lb3 0 2024-02-19T19:07:34.464 INFO:tasks.workunit.client.1.smithi142.stdout:9/496: creat db/d10/d7d/f8f x:0 0 0 2024-02-19T19:07:34.464 INFO:tasks.workunit.client.1.smithi142.stdout:9/497: stat db/d10/d27/d2f/d4c 0 2024-02-19T19:07:34.466 INFO:tasks.workunit.client.1.smithi142.stdout:9/498: link db/d10/d32/d3f/c62 db/d10/d27/c90 0 2024-02-19T19:07:34.468 INFO:tasks.workunit.client.1.smithi142.stdout:9/499: write db/d10/d22/f5c [1962949,18720] 0 2024-02-19T19:07:34.475 INFO:tasks.workunit.client.1.smithi142.stdout:3/586: dread d1d/d1e/d2e/d50/d7c/da7/d52/d5a/fab [0,4194304] 0 2024-02-19T19:07:34.476 INFO:tasks.workunit.client.1.smithi142.stdout:1/624: dwrite d5/d7/d4a/d53/d6a/faa [0,4194304] 0 2024-02-19T19:07:34.476 INFO:tasks.workunit.client.1.smithi142.stdout:6/406: dwrite d2/d1f/d5c/f6f [0,4194304] 0 2024-02-19T19:07:34.476 INFO:tasks.workunit.client.1.smithi142.stdout:0/377: dwrite d23/d32/f65 [4194304,4194304] 0 2024-02-19T19:07:34.477 INFO:tasks.workunit.client.1.smithi142.stdout:7/365: dwrite d0/d13/d1e/f5c [0,4194304] 0 2024-02-19T19:07:34.477 INFO:tasks.workunit.client.1.smithi142.stdout:7/366: chown d0/d13/d1e/f71 22 1 2024-02-19T19:07:34.477 INFO:tasks.workunit.client.1.smithi142.stdout:0/378: read d23/d28/f70 [3735,44285] 0 2024-02-19T19:07:34.477 INFO:tasks.workunit.client.1.smithi142.stdout:0/379: fdatasync f1a 0 2024-02-19T19:07:34.477 INFO:tasks.workunit.client.1.smithi142.stdout:0/380: write d23/d28/d41/f75 [352196,22008] 0 2024-02-19T19:07:34.477 INFO:tasks.workunit.client.1.smithi142.stdout:5/456: dwrite d5/dd/df/d22/d41/d32/f74 [0,4194304] 0 2024-02-19T19:07:34.477 INFO:tasks.workunit.client.1.smithi142.stdout:4/532: dwrite d4/d1d/d42/f9c [0,4194304] 0 2024-02-19T19:07:34.477 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:34 smithi046 podman[106629]: 2024-02-19 19:07:34.181018056 +0000 UTC m=+0.765445323 container remove acb7edc764a05788532b11ffa80f7655937e7d178c7852901d96880340fd3c2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-activate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-19T19:07:34.477 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:34 smithi046 podman[106691]: 2024-02-19 19:07:34.333205392 +0000 UTC m=+0.023947592 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:07:34.478 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:34 smithi046 podman[106691]: 2024-02-19 19:07:34.457478474 +0000 UTC m=+0.148220704 container create 974e56511c367ec8a3410f5b60756a7532527a2d63f1702708ab70b8612032f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-19T19:07:34.480 INFO:tasks.workunit.client.1.smithi142.stdout:1/625: getdents d5/d1a/d33 0 2024-02-19T19:07:34.480 INFO:tasks.workunit.client.1.smithi142.stdout:1/626: getdents d5/d1a/d33/dce 0 2024-02-19T19:07:34.484 INFO:tasks.workunit.client.1.smithi142.stdout:6/407: unlink d2/d17/l77 0 2024-02-19T19:07:34.484 INFO:tasks.workunit.client.1.smithi142.stdout:6/408: read - d2/d29/d47/f68 zero size 2024-02-19T19:07:34.484 INFO:tasks.workunit.client.1.smithi142.stdout:6/409: creat d2/d1e/d35/d66/f8b x:0 0 0 2024-02-19T19:07:34.484 INFO:tasks.workunit.client.1.smithi142.stdout:6/410: truncate d2/d17/f7a 254650 0 2024-02-19T19:07:34.488 INFO:tasks.workunit.client.1.smithi142.stdout:7/367: mknod d0/d13/d72/d47/d69/c79 0 2024-02-19T19:07:34.490 INFO:tasks.workunit.client.1.smithi142.stdout:0/381: chown d23/d28/c2b 840 1 2024-02-19T19:07:34.491 INFO:tasks.workunit.client.1.smithi142.stdout:6/411: write d2/d1f/d20/f52 [2284239,64254] 0 2024-02-19T19:07:34.491 INFO:tasks.workunit.client.1.smithi142.stdout:6/412: fdatasync d2/d1f/d5c/f6f 0 2024-02-19T19:07:34.498 INFO:tasks.workunit.client.1.smithi142.stdout:5/457: rename d5/dd/d8/d29/c40 to d5/dd/d8/d31/d4d/d60/c99 0 2024-02-19T19:07:34.498 INFO:tasks.workunit.client.1.smithi142.stdout:5/458: truncate d5/f20 626229 0 2024-02-19T19:07:34.498 INFO:tasks.workunit.client.1.smithi142.stdout:0/382: read d23/d28/d2d/d51/d44/d58/f5d [1807074,40920] 0 2024-02-19T19:07:34.498 INFO:tasks.workunit.client.1.smithi142.stdout:0/383: stat d23/d28/d2d/d51/l6e 0 2024-02-19T19:07:34.500 INFO:tasks.workunit.client.1.smithi142.stdout:3/587: rmdir d1d/d1e/d6e 39 2024-02-19T19:07:34.507 INFO:tasks.workunit.client.1.smithi142.stdout:7/368: dwrite d0/f2a [0,4194304] 0 2024-02-19T19:07:34.508 INFO:tasks.workunit.client.1.smithi142.stdout:4/533: creat d4/d1d/d42/d66/dd/d10/d26/d50/d54/fb2 x:0 0 0 2024-02-19T19:07:34.508 INFO:tasks.workunit.client.1.smithi142.stdout:4/534: chown d4/d1d/d42/d66/dd/f7b 27 1 2024-02-19T19:07:34.508 INFO:tasks.workunit.client.1.smithi142.stdout:4/535: readlink d4/d1d/d42/d66/d12/d79/l90 0 2024-02-19T19:07:34.508 INFO:tasks.workunit.client.1.smithi142.stdout:1/627: mkdir d5/d7/d4a/d53/d6a/ddc 0 2024-02-19T19:07:34.510 INFO:tasks.workunit.client.1.smithi142.stdout:5/459: mknod d5/dd/df/d22/d41/d6f/c9a 0 2024-02-19T19:07:34.511 INFO:tasks.workunit.client.1.smithi142.stdout:6/413: dwrite d2/d1e/d35/d66/f7f [0,4194304] 0 2024-02-19T19:07:34.511 INFO:tasks.workunit.client.1.smithi142.stdout:0/384: rename d23/d28/d41/c77 to d23/d28/d2d/d51/d44/d58/c7f 0 2024-02-19T19:07:34.512 INFO:tasks.workunit.client.1.smithi142.stdout:3/588: mknod d1d/d1e/d2e/cb4 0 2024-02-19T19:07:34.512 INFO:tasks.workunit.client.1.smithi142.stdout:3/589: getdents d1d/d1e/d2e/d50/d7c/da7/d3a/d62 0 2024-02-19T19:07:34.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/459: sync 2024-02-19T19:07:34.517 INFO:tasks.workunit.client.1.smithi142.stdout:8/489: sync 2024-02-19T19:07:34.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/460: chown d3/db/d29/f55 1 1 2024-02-19T19:07:34.517 INFO:tasks.workunit.client.1.smithi142.stdout:8/490: chown d9/dd/d15/d31/l80 68 1 2024-02-19T19:07:34.518 INFO:tasks.workunit.client.1.smithi142.stdout:7/369: mkdir d0/d1b/d21/d24/d29/d44/d49/d7a 0 2024-02-19T19:07:34.518 INFO:tasks.workunit.client.1.smithi142.stdout:7/370: dread - d0/d13/d1e/f42 zero size 2024-02-19T19:07:34.518 INFO:tasks.workunit.client.1.smithi142.stdout:7/371: dread - d0/d13/d72/d47/f4b zero size 2024-02-19T19:07:34.522 INFO:tasks.workunit.client.1.smithi142.stdout:6/414: mkdir d2/d1f/d20/d31/d3d/d3e/d8c 0 2024-02-19T19:07:34.522 INFO:tasks.workunit.client.1.smithi142.stdout:6/415: chown d2/d1f/f30 177237 1 2024-02-19T19:07:34.522 INFO:tasks.workunit.client.1.smithi142.stdout:6/416: stat d2/d1f/d20/d31/d3d/d3e/f46 0 2024-02-19T19:07:34.523 INFO:tasks.workunit.client.1.smithi142.stdout:1/628: rename d5/d37/c9f to d5/d37/d49/cdd 0 2024-02-19T19:07:34.525 INFO:tasks.workunit.client.1.smithi142.stdout:0/385: symlink d23/d28/d41/d78/l80 0 2024-02-19T19:07:34.525 INFO:tasks.workunit.client.1.smithi142.stdout:4/536: dwrite d4/d1d/d42/d66/dd/d10/d26/d50/d54/f59 [0,4194304] 0 2024-02-19T19:07:34.525 INFO:tasks.workunit.client.1.smithi142.stdout:4/537: readlink d4/l92 0 2024-02-19T19:07:34.525 INFO:tasks.workunit.client.1.smithi142.stdout:4/538: write d4/d1d/d42/d66/d12/d2d/d2a/f6f [888499,87584] 0 2024-02-19T19:07:34.526 INFO:tasks.workunit.client.1.smithi142.stdout:3/590: mknod d1d/d1e/d2e/d37/d6c/cb5 0 2024-02-19T19:07:34.527 INFO:tasks.workunit.client.1.smithi142.stdout:8/491: mkdir d9/dd/de/d2d/d2e/d49/d50/d59/d97 0 2024-02-19T19:07:34.535 INFO:tasks.workunit.client.1.smithi142.stdout:0/386: write d23/d32/f6a [80456,77328] 0 2024-02-19T19:07:34.537 INFO:tasks.workunit.client.1.smithi142.stdout:5/460: rmdir d5 39 2024-02-19T19:07:34.539 INFO:tasks.workunit.client.1.smithi142.stdout:6/417: dwrite d2/d1e/d35/d66/f8b [0,4194304] 0 2024-02-19T19:07:34.539 INFO:tasks.workunit.client.1.smithi142.stdout:6/418: chown d2/d29 7906482 1 2024-02-19T19:07:34.540 INFO:tasks.workunit.client.1.smithi142.stdout:7/372: rename d0/c6 to d0/d1b/d21/d24/d5e/d65/c7b 0 2024-02-19T19:07:34.540 INFO:tasks.workunit.client.1.smithi142.stdout:1/629: link d5/d37/d6c/fa0 d5/d37/d6c/d75/fde 0 2024-02-19T19:07:34.540 INFO:tasks.workunit.client.1.smithi142.stdout:1/630: creat d5/d7/d23/dab/fdf x:0 0 0 2024-02-19T19:07:34.541 INFO:tasks.workunit.client.1.smithi142.stdout:4/539: mkdir d4/d14/d31/dab/da2/db3 0 2024-02-19T19:07:34.542 INFO:tasks.workunit.client.1.smithi142.stdout:3/591: mkdir d1d/db6 0 2024-02-19T19:07:34.543 INFO:tasks.workunit.client.1.smithi142.stdout:8/492: truncate d9/dd/d44/d79/f53 2627116 0 2024-02-19T19:07:34.543 INFO:tasks.workunit.client.1.smithi142.stdout:8/493: write d9/dd/de/d14/d65/f90 [367592,40842] 0 2024-02-19T19:07:34.543 INFO:tasks.workunit.client.1.smithi142.stdout:8/494: fsync f2 0 2024-02-19T19:07:34.545 INFO:tasks.workunit.client.1.smithi142.stdout:0/387: symlink d23/d28/d2d/d51/d44/l81 0 2024-02-19T19:07:34.546 INFO:tasks.workunit.client.1.smithi142.stdout:5/461: write d5/dd/df/d22/d41/f26 [846313,31782] 0 2024-02-19T19:07:34.546 INFO:tasks.workunit.client.1.smithi142.stdout:5/462: readlink d5/dd/df/d22/d41/d32/d53/l77 0 2024-02-19T19:07:34.548 INFO:tasks.workunit.client.1.smithi142.stdout:1/631: mkdir d5/d1a/d33/dce/de0 0 2024-02-19T19:07:34.548 INFO:tasks.workunit.client.1.smithi142.stdout:4/540: mkdir d4/d1d/d42/d66/dd/d10/d3e/d68/db4 0 2024-02-19T19:07:34.549 INFO:tasks.workunit.client.1.smithi142.stdout:8/495: mknod d9/dd/d15/d31/d5e/c98 0 2024-02-19T19:07:34.551 INFO:tasks.workunit.client.1.smithi142.stdout:5/463: getdents d5/dd/df/d15/d5b 0 2024-02-19T19:07:34.553 INFO:tasks.workunit.client.1.smithi142.stdout:6/419: rename d2/d1f/d20/d31/d3d to d2/d1e/d35/d66/d8d 0 2024-02-19T19:07:34.553 INFO:tasks.workunit.client.1.smithi142.stdout:6/420: chown d2/d1f/d5c/d63/l7d 2264 1 2024-02-19T19:07:34.554 INFO:tasks.workunit.client.1.smithi142.stdout:6/421: creat d2/d1f/d56/f8e x:0 0 0 2024-02-19T19:07:34.556 INFO:tasks.workunit.client.1.smithi142.stdout:5/464: rmdir d5 39 2024-02-19T19:07:34.559 INFO:tasks.workunit.client.1.smithi142.stdout:3/592: dwrite d1d/d1e/d2e/d37/d6c/f7b [0,4194304] 0 2024-02-19T19:07:34.559 INFO:tasks.workunit.client.1.smithi142.stdout:7/373: rename d0/d1b/d21/d24/l39 to d0/d1b/d21/d24/d29/d44/d49/l7c 0 2024-02-19T19:07:34.560 INFO:tasks.workunit.client.1.smithi142.stdout:7/374: chown d0/d1b/d21/d24/d29/d44 139 1 2024-02-19T19:07:34.560 INFO:tasks.workunit.client.1.smithi142.stdout:7/375: write d0/d1b/d21/f4c [1031972,117007] 0 2024-02-19T19:07:34.564 INFO:tasks.workunit.client.1.smithi142.stdout:4/541: write d4/d34/f97 [110479,50730] 0 2024-02-19T19:07:34.564 INFO:tasks.workunit.client.1.smithi142.stdout:4/542: chown d4/d1d/d42/d66/d12/d2d/d2a/d84/l96 280 1 2024-02-19T19:07:34.564 INFO:tasks.workunit.client.1.smithi142.stdout:4/543: write d4/d1d/d42/d66/f8b [258794,34606] 0 2024-02-19T19:07:34.564 INFO:tasks.workunit.client.1.smithi142.stdout:4/544: write d4/d1d/d42/d66/d12/f18 [961390,47106] 0 2024-02-19T19:07:34.567 INFO:tasks.workunit.client.1.smithi142.stdout:1/632: rmdir d5/d7 39 2024-02-19T19:07:34.569 INFO:tasks.workunit.client.1.smithi142.stdout:1/633: dread d5/d7/d4a/fc1 [0,4194304] 0 2024-02-19T19:07:34.569 INFO:tasks.workunit.client.1.smithi142.stdout:1/634: dread - d5/d7/d34/d6f/f7b zero size 2024-02-19T19:07:34.574 INFO:tasks.workunit.client.1.smithi142.stdout:3/593: mkdir d1d/d1e/d2e/d37/d81/db7 0 2024-02-19T19:07:34.575 INFO:tasks.workunit.client.1.smithi142.stdout:0/388: rename d23/l2c to d23/d28/d2d/d51/d44/l82 0 2024-02-19T19:07:34.575 INFO:tasks.workunit.client.1.smithi142.stdout:3/594: unlink f13 0 2024-02-19T19:07:34.577 INFO:tasks.workunit.client.1.smithi142.stdout:3/595: creat d1d/db6/fb8 x:0 0 0 2024-02-19T19:07:34.577 INFO:tasks.workunit.client.1.smithi142.stdout:3/596: read - d1d/d1e/d2e/d50/d7c/da7/f84 zero size 2024-02-19T19:07:34.577 INFO:tasks.workunit.client.1.smithi142.stdout:3/597: chown d1d/d1e/d2e/d50/c5b 0 1 2024-02-19T19:07:34.581 INFO:tasks.workunit.client.1.smithi142.stdout:8/496: dwrite d9/dd/de/d2d/d2e/d49/d50/f7b [0,4194304] 0 2024-02-19T19:07:34.583 INFO:tasks.workunit.client.1.smithi142.stdout:8/497: link c3 d9/dd/c99 0 2024-02-19T19:07:34.583 INFO:tasks.workunit.client.1.smithi142.stdout:8/498: stat d9/dd/de/d2d/d2e/l2f 0 2024-02-19T19:07:34.584 INFO:tasks.workunit.client.1.smithi142.stdout:8/499: link d9/dd/de/d2d/d2e/d49/l4a d9/dd/de/d2d/l9a 0 2024-02-19T19:07:34.586 INFO:tasks.workunit.client.1.smithi142.stdout:8/500: creat d9/dd/de/d14/d65/d6c/f9b x:0 0 0 2024-02-19T19:07:34.586 INFO:tasks.workunit.client.1.smithi142.stdout:8/501: fdatasync d9/dd/de/d2d/d2e/d49/d50/d59/f82 0 2024-02-19T19:07:34.586 INFO:tasks.workunit.client.1.smithi142.stdout:0/389: dread d23/d32/f65 [0,4194304] 0 2024-02-19T19:07:34.586 INFO:tasks.workunit.client.1.smithi142.stdout:8/502: write d9/dd/de/d2d/d2e/d49/d50/d59/f8e [158348,113682] 0 2024-02-19T19:07:34.586 INFO:tasks.workunit.client.1.smithi142.stdout:8/503: mkdir d9/dd/de/d14/d65/d6c/d9c 0 2024-02-19T19:07:34.588 INFO:tasks.workunit.client.1.smithi142.stdout:8/504: creat d9/dd/de/d14/d65/d94/f9d x:0 0 0 2024-02-19T19:07:34.594 INFO:tasks.workunit.client.1.smithi142.stdout:0/390: dread f17 [0,4194304] 0 2024-02-19T19:07:34.594 INFO:tasks.workunit.client.1.smithi142.stdout:9/500: sync 2024-02-19T19:07:34.595 INFO:tasks.workunit.client.1.smithi142.stdout:5/465: dwrite d5/dd/d8/d2a/f2d [0,4194304] 0 2024-02-19T19:07:34.596 INFO:tasks.workunit.client.1.smithi142.stdout:0/391: creat d23/d28/d2d/d51/d44/d58/f83 x:0 0 0 2024-02-19T19:07:34.596 INFO:tasks.workunit.client.1.smithi142.stdout:0/392: dread - d23/f3d zero size 2024-02-19T19:07:34.596 INFO:tasks.workunit.client.1.smithi142.stdout:7/376: dwrite d0/d13/d1e/f42 [0,4194304] 0 2024-02-19T19:07:34.596 INFO:tasks.workunit.client.1.smithi142.stdout:3/598: dwrite d1d/fa1 [0,4194304] 0 2024-02-19T19:07:34.597 INFO:tasks.workunit.client.1.smithi142.stdout:4/545: dwrite d4/d1d/d42/d66/d12/d2d/f75 [0,4194304] 0 2024-02-19T19:07:34.597 INFO:tasks.workunit.client.1.smithi142.stdout:4/546: chown d4/d1d/d42/d66/d2c/fa0 1 1 2024-02-19T19:07:34.597 INFO:tasks.workunit.client.1.smithi142.stdout:4/547: creat d4/d1c/fb5 x:0 0 0 2024-02-19T19:07:34.599 INFO:tasks.workunit.client.1.smithi142.stdout:8/505: dread d9/dd/d44/d79/f69 [0,4194304] 0 2024-02-19T19:07:34.600 INFO:tasks.workunit.client.1.smithi142.stdout:0/393: symlink d23/l84 0 2024-02-19T19:07:34.600 INFO:tasks.workunit.client.1.smithi142.stdout:8/506: creat d9/dd/de/d14/d65/f9e x:0 0 0 2024-02-19T19:07:34.600 INFO:tasks.workunit.client.1.smithi142.stdout:8/507: chown d9/dd/d44 14686 1 2024-02-19T19:07:34.600 INFO:tasks.workunit.client.1.smithi142.stdout:8/508: dread - d9/dd/de/d2d/d2e/d49/d50/d59/f82 zero size 2024-02-19T19:07:34.600 INFO:tasks.workunit.client.1.smithi142.stdout:8/509: write d9/dd/de/d14/f60 [1011612,73383] 0 2024-02-19T19:07:34.604 INFO:tasks.workunit.client.1.smithi142.stdout:9/501: dread db/f53 [0,4194304] 0 2024-02-19T19:07:34.606 INFO:tasks.workunit.client.1.smithi142.stdout:7/377: read d0/d13/d72/d47/d69/f3c [1131072,33646] 0 2024-02-19T19:07:34.610 INFO:tasks.workunit.client.1.smithi142.stdout:3/599: rename d1d/d1e/d2e/d50/d83/lb2 to d1d/d1e/d2e/d37/d81/lb9 0 2024-02-19T19:07:34.617 INFO:tasks.workunit.client.1.smithi142.stdout:0/394: mkdir d23/d28/d2d/d54/d85 0 2024-02-19T19:07:34.619 INFO:tasks.workunit.client.1.smithi142.stdout:8/510: symlink d9/dd/de/d2d/d2e/d49/l9f 0 2024-02-19T19:07:34.619 INFO:tasks.workunit.client.1.smithi142.stdout:8/511: creat d9/dd/d15/d31/fa0 x:0 0 0 2024-02-19T19:07:34.619 INFO:tasks.workunit.client.1.smithi142.stdout:8/512: creat d9/dd/de/d2d/d2e/d49/fa1 x:0 0 0 2024-02-19T19:07:34.619 INFO:tasks.workunit.client.1.smithi142.stdout:9/502: truncate db/d10/d22/d24/f8b 869907 0 2024-02-19T19:07:34.619 INFO:tasks.workunit.client.1.smithi142.stdout:9/503: write db/d10/d32/d3f/f75 [860954,49428] 0 2024-02-19T19:07:34.623 INFO:tasks.workunit.client.1.smithi142.stdout:7/378: dwrite d0/f16 [0,4194304] 0 2024-02-19T19:07:34.642 INFO:tasks.workunit.client.1.smithi142.stdout:0/395: mkdir d23/d86 0 2024-02-19T19:07:34.642 INFO:tasks.workunit.client.1.smithi142.stdout:0/396: dread - d23/d28/d2d/f60 zero size 2024-02-19T19:07:34.642 INFO:tasks.workunit.client.1.smithi142.stdout:0/397: chown d23/f25 211898 1 2024-02-19T19:07:34.647 INFO:tasks.workunit.client.1.smithi142.stdout:8/513: symlink d9/dd/de/d2d/d2e/d49/d50/d59/d97/la2 0 2024-02-19T19:07:34.650 INFO:tasks.workunit.client.1.smithi142.stdout:9/504: unlink db/d10/d32/d3f/d5f/c66 0 2024-02-19T19:07:34.652 INFO:tasks.workunit.client.1.smithi142.stdout:7/379: symlink d0/d1b/d21/d24/d29/d44/l7d 0 2024-02-19T19:07:34.652 INFO:tasks.workunit.client.1.smithi142.stdout:7/380: write d0/f6b [962517,14442] 0 2024-02-19T19:07:34.653 INFO:tasks.workunit.client.1.smithi142.stdout:7/381: write d0/d13/d72/d47/f4b [979772,68762] 0 2024-02-19T19:07:34.653 INFO:tasks.workunit.client.1.smithi142.stdout:7/382: write d0/d13/d72/f4f [564217,18460] 0 2024-02-19T19:07:34.653 INFO:tasks.workunit.client.1.smithi142.stdout:7/383: chown d0/d1b/d21/d24/f34 850591 1 2024-02-19T19:07:34.654 INFO:tasks.workunit.client.1.smithi142.stdout:2/461: sync 2024-02-19T19:07:34.654 INFO:tasks.workunit.client.1.smithi142.stdout:2/462: stat d3/db/d29/d6d/f56 0 2024-02-19T19:07:34.674 INFO:tasks.workunit.client.1.smithi142.stdout:8/514: dwrite d9/dd/de/f6f [0,4194304] 0 2024-02-19T19:07:34.676 INFO:tasks.workunit.client.1.smithi142.stdout:9/505: dwrite db/d10/d22/d24/f3c [0,4194304] 0 2024-02-19T19:07:34.676 INFO:tasks.workunit.client.1.smithi142.stdout:9/506: readlink db/l12 0 2024-02-19T19:07:34.676 INFO:tasks.workunit.client.1.smithi142.stdout:9/507: truncate db/d10/d22/f50 571462 0 2024-02-19T19:07:34.688 INFO:tasks.workunit.client.1.smithi142.stdout:9/508: dread db/d10/f1c [0,4194304] 0 2024-02-19T19:07:34.696 INFO:tasks.workunit.client.1.smithi142.stdout:3/600: truncate d1d/fa1 3751227 0 2024-02-19T19:07:34.697 INFO:tasks.workunit.client.1.smithi142.stdout:3/601: write d1d/d1e/d2e/f7e [569946,122523] 0 2024-02-19T19:07:34.697 INFO:tasks.workunit.client.1.smithi142.stdout:3/602: chown d1d/d1e/d2e/d37/l44 276 1 2024-02-19T19:07:34.699 INFO:tasks.workunit.client.1.smithi142.stdout:2/463: symlink d3/df/l94 0 2024-02-19T19:07:34.700 INFO:tasks.workunit.client.1.smithi142.stdout:8/515: creat d9/dd/de/d2d/fa3 x:0 0 0 2024-02-19T19:07:34.709 INFO:tasks.workunit.client.1.smithi142.stdout:9/509: fdatasync db/d10/d32/d3f/f63 0 2024-02-19T19:07:34.709 INFO:tasks.workunit.client.1.smithi142.stdout:9/510: chown db/d10/d7d/f4d 6875 1 2024-02-19T19:07:34.709 INFO:tasks.workunit.client.1.smithi142.stdout:9/511: write db/d10/f4b [4899012,47127] 0 2024-02-19T19:07:34.711 INFO:tasks.workunit.client.1.smithi142.stdout:0/398: getdents d23/d28/d2d/d51 0 2024-02-19T19:07:34.713 INFO:tasks.workunit.client.1.smithi142.stdout:3/603: mknod d1d/d1e/d2e/cba 0 2024-02-19T19:07:34.715 INFO:tasks.workunit.client.1.smithi142.stdout:2/464: mkdir d3/d68/d95 0 2024-02-19T19:07:34.716 INFO:tasks.workunit.client.1.smithi142.stdout:8/516: mknod d9/dd/d15/d31/ca4 0 2024-02-19T19:07:34.717 INFO:tasks.workunit.client.1.smithi142.stdout:3/604: dread d1d/d1e/d2e/d50/f8c [0,4194304] 0 2024-02-19T19:07:34.719 INFO:tasks.workunit.client.1.smithi142.stdout:3/605: mkdir d1d/d1e/d2e/d50/d7c/da7/d3a/d62/da2/dbb 0 2024-02-19T19:07:34.719 INFO:tasks.workunit.client.1.smithi142.stdout:8/517: dread d9/dd/d15/f28 [0,4194304] 0 2024-02-19T19:07:34.719 INFO:tasks.workunit.client.1.smithi142.stdout:8/518: chown d9/dd/d15/d31/c6d 516229 1 2024-02-19T19:07:34.720 INFO:tasks.workunit.client.1.smithi142.stdout:3/606: mkdir d1d/d1e/d2e/d37/d81/dbc 0 2024-02-19T19:07:34.722 INFO:tasks.workunit.client.1.smithi142.stdout:8/519: mknod d9/dd/d15/d31/ca5 0 2024-02-19T19:07:34.722 INFO:tasks.workunit.client.1.smithi142.stdout:8/520: truncate d9/dd/de/d14/f20 2084181 0 2024-02-19T19:07:34.722 INFO:tasks.workunit.client.1.smithi142.stdout:8/521: creat d9/dd/de/d2d/d2e/d73/d77/fa6 x:0 0 0 2024-02-19T19:07:34.724 INFO:tasks.workunit.client.1.smithi142.stdout:3/607: creat d1d/d1e/d2e/d37/d81/fbd x:0 0 0 2024-02-19T19:07:34.726 INFO:tasks.workunit.client.1.smithi142.stdout:8/522: mkdir d9/dd/de/d14/d65/d6c/da7 0 2024-02-19T19:07:34.726 INFO:tasks.workunit.client.1.smithi142.stdout:8/523: write d9/dd/d15/f28 [882907,47819] 0 2024-02-19T19:07:34.727 INFO:tasks.workunit.client.1.smithi142.stdout:3/608: symlink d1d/d1e/d2e/d50/d83/lbe 0 2024-02-19T19:07:34.727 INFO:tasks.workunit.client.1.smithi142.stdout:3/609: chown d1d/d1e/f6b 183 1 2024-02-19T19:07:34.730 INFO:tasks.workunit.client.1.smithi142.stdout:3/610: unlink d1d/l61 0 2024-02-19T19:07:34.732 INFO:tasks.workunit.client.1.smithi142.stdout:9/512: dwrite db/d10/d22/d24/f3e [0,4194304] 0 2024-02-19T19:07:34.732 INFO:tasks.workunit.client.1.smithi142.stdout:4/548: rename d4/d1c/c29 to d4/cb6 0 2024-02-19T19:07:34.732 INFO:tasks.workunit.client.1.smithi142.stdout:7/384: mkdir d0/d1b/d21/d24/d29/d7e 0 2024-02-19T19:07:34.733 INFO:tasks.workunit.client.1.smithi142.stdout:9/513: truncate db/f53 3676075 0 2024-02-19T19:07:34.734 INFO:tasks.workunit.client.1.smithi142.stdout:2/465: dwrite d3/db/f7f [0,4194304] 0 2024-02-19T19:07:34.734 INFO:tasks.workunit.client.1.smithi142.stdout:4/549: creat d4/fb7 x:0 0 0 2024-02-19T19:07:34.735 INFO:tasks.workunit.client.1.smithi142.stdout:6/422: sync 2024-02-19T19:07:34.736 INFO:tasks.workunit.client.1.smithi142.stdout:7/385: creat d0/d1b/d21/d24/d29/f7f x:0 0 0 2024-02-19T19:07:34.740 INFO:tasks.workunit.client.1.smithi142.stdout:2/466: mknod d3/d4d/d5f/d7c/c96 0 2024-02-19T19:07:34.740 INFO:tasks.workunit.client.1.smithi142.stdout:2/467: fsync d3/db/d29/f41 0 2024-02-19T19:07:34.740 INFO:tasks.workunit.client.1.smithi142.stdout:2/468: write d3/d68/f87 [184384,71959] 0 2024-02-19T19:07:34.741 INFO:tasks.workunit.client.1.smithi142.stdout:9/514: dread db/d10/d22/f37 [4194304,4194304] 0 2024-02-19T19:07:34.741 INFO:tasks.workunit.client.1.smithi142.stdout:9/515: dread - db/d10/d7d/f8f zero size 2024-02-19T19:07:34.742 INFO:tasks.workunit.client.1.smithi142.stdout:6/423: mkdir d2/d1f/d20/d31/d88/d8f 0 2024-02-19T19:07:34.747 INFO:tasks.workunit.client.1.smithi142.stdout:6/424: creat d2/d1f/d4d/d60/f90 x:0 0 0 2024-02-19T19:07:34.747 INFO:tasks.workunit.client.1.smithi142.stdout:6/425: chown d2/d1f/d20/d31/d62 375 1 2024-02-19T19:07:34.750 INFO:tasks.workunit.client.1.smithi142.stdout:6/426: creat d2/d17/d51/f91 x:0 0 0 2024-02-19T19:07:34.754 INFO:tasks.workunit.client.1.smithi142.stdout:9/516: rename db/d10/d80 to db/d10/d32/d91 0 2024-02-19T19:07:34.754 INFO:tasks.workunit.client.1.smithi142.stdout:6/427: write d2/d1e/d35/d66/d8d/f50 [2735453,94774] 0 2024-02-19T19:07:34.754 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:34 smithi046 podman[106691]: 2024-02-19 19:07:34.702017786 +0000 UTC m=+0.392759999 container init 974e56511c367ec8a3410f5b60756a7532527a2d63f1702708ab70b8612032f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:07:34.754 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:34 smithi046 podman[106691]: 2024-02-19 19:07:34.706000077 +0000 UTC m=+0.396742270 container start 974e56511c367ec8a3410f5b60756a7532527a2d63f1702708ab70b8612032f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-19T19:07:34.755 INFO:tasks.workunit.client.1.smithi142.stdout:9/517: rmdir db/d10/d27/d2f/d4c/d59 39 2024-02-19T19:07:34.755 INFO:tasks.workunit.client.1.smithi142.stdout:9/518: stat db/d10/c6c 0 2024-02-19T19:07:34.757 INFO:tasks.workunit.client.1.smithi142.stdout:8/524: mkdir d9/da8 0 2024-02-19T19:07:34.759 INFO:tasks.workunit.client.1.smithi142.stdout:8/525: mkdir d9/dd/de/d2d/d2e/d49/d50/d59/da9 0 2024-02-19T19:07:34.760 INFO:tasks.workunit.client.1.smithi142.stdout:7/386: dwrite d0/d1b/d21/d24/d5e/f63 [0,4194304] 0 2024-02-19T19:07:34.761 INFO:tasks.workunit.client.1.smithi142.stdout:3/611: dwrite d1d/d1e/d2e/d37/f4c [4194304,4194304] 0 2024-02-19T19:07:34.761 INFO:tasks.workunit.client.1.smithi142.stdout:4/550: dwrite d4/d1c/f22 [0,4194304] 0 2024-02-19T19:07:34.761 INFO:tasks.workunit.client.1.smithi142.stdout:4/551: write d4/d14/d31/f8d [492199,42575] 0 2024-02-19T19:07:34.762 INFO:tasks.workunit.client.1.smithi142.stdout:7/387: unlink d0/d13/d72/d47/d69/f3c 0 2024-02-19T19:07:34.763 INFO:tasks.workunit.client.1.smithi142.stdout:4/552: dread d4/d14/f2f [0,4194304] 0 2024-02-19T19:07:34.765 INFO:tasks.workunit.client.1.smithi142.stdout:4/553: unlink d4/d14/l19 0 2024-02-19T19:07:34.767 INFO:tasks.workunit.client.1.smithi142.stdout:9/519: dread db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:34.767 INFO:tasks.workunit.client.1.smithi142.stdout:4/554: link d4/d1d/f74 d4/d1d/d42/d66/d12/d2d/d2a/fb8 0 2024-02-19T19:07:34.770 INFO:tasks.workunit.client.1.smithi142.stdout:9/520: rename db/d10/d7d/f4d to db/d10/d22/d24/f92 0 2024-02-19T19:07:34.772 INFO:tasks.workunit.client.1.smithi142.stdout:7/388: dread d0/d13/d1e/f5c [0,4194304] 0 2024-02-19T19:07:34.773 INFO:tasks.workunit.client.1.smithi142.stdout:9/521: rename db/d10/l3a to db/d10/d27/d2f/d4c/d59/l93 0 2024-02-19T19:07:34.774 INFO:tasks.workunit.client.1.smithi142.stdout:9/522: fdatasync db/d10/d22/d24/f8b 0 2024-02-19T19:07:34.774 INFO:tasks.workunit.client.1.smithi142.stdout:9/523: write db/d10/d22/f5c [684337,44548] 0 2024-02-19T19:07:34.776 INFO:tasks.workunit.client.1.smithi142.stdout:3/612: dwrite f18 [4194304,4194304] 0 2024-02-19T19:07:34.776 INFO:tasks.workunit.client.1.smithi142.stdout:3/613: chown d1d/d1e/d2e/d50/d7c/da7/d52/d71/l9c 30473 1 2024-02-19T19:07:34.780 INFO:tasks.workunit.client.1.smithi142.stdout:4/555: dread d4/d14/d31/f61 [0,4194304] 0 2024-02-19T19:07:34.780 INFO:tasks.workunit.client.1.smithi142.stdout:4/556: truncate d4/d14/d31/dab/f60 1387781 0 2024-02-19T19:07:34.780 INFO:tasks.workunit.client.1.smithi142.stdout:4/557: chown d4/d1d/d42/d66/d5f/lb0 29 1 2024-02-19T19:07:34.780 INFO:tasks.workunit.client.1.smithi142.stdout:9/524: getdents db/d10/d27/d2f 0 2024-02-19T19:07:34.780 INFO:tasks.workunit.client.1.smithi142.stdout:7/389: dread d0/d1b/d21/d24/d29/f2c [0,4194304] 0 2024-02-19T19:07:34.780 INFO:tasks.workunit.client.1.smithi142.stdout:3/614: mknod d1d/d1e/d2e/d50/d7c/da7/d3a/d62/cbf 0 2024-02-19T19:07:34.782 INFO:tasks.workunit.client.1.smithi142.stdout:7/390: mknod d0/d1b/d21/d24/d29/d7e/c80 0 2024-02-19T19:07:34.783 INFO:tasks.workunit.client.1.smithi142.stdout:5/466: sync 2024-02-19T19:07:34.784 INFO:tasks.workunit.client.1.smithi142.stdout:1/635: sync 2024-02-19T19:07:34.784 INFO:tasks.workunit.client.1.smithi142.stdout:9/525: rmdir db/d10/d32/d3f/d5f 39 2024-02-19T19:07:34.784 INFO:tasks.workunit.client.1.smithi142.stdout:3/615: write d1d/d1e/d6e/f6f [20964,50191] 0 2024-02-19T19:07:34.786 INFO:tasks.workunit.client.1.smithi142.stdout:7/391: creat d0/d62/f81 x:0 0 0 2024-02-19T19:07:34.786 INFO:tasks.workunit.client.1.smithi142.stdout:4/558: dread d4/d14/d31/dab/f63 [0,4194304] 0 2024-02-19T19:07:34.786 INFO:tasks.workunit.client.1.smithi142.stdout:4/559: write d4/d1d/d42/d66/dd/d10/d3b/f89 [126216,40469] 0 2024-02-19T19:07:34.786 INFO:tasks.workunit.client.1.smithi142.stdout:5/467: link d5/dd/df/d22/c87 d5/c9b 0 2024-02-19T19:07:34.787 INFO:tasks.workunit.client.1.smithi142.stdout:1/636: mknod d5/d7/d23/d2c/ce1 0 2024-02-19T19:07:34.789 INFO:tasks.workunit.client.1.smithi142.stdout:9/526: rename db/d10/d27/f40 to db/d10/d27/d2f/f94 0 2024-02-19T19:07:34.790 INFO:tasks.workunit.client.1.smithi142.stdout:9/527: chown db/d10/d27/d2f/d4c/d59/l93 16182 1 2024-02-19T19:07:34.790 INFO:tasks.workunit.client.1.smithi142.stdout:9/528: read db/f53 [99014,114364] 0 2024-02-19T19:07:34.790 INFO:tasks.workunit.client.1.smithi142.stdout:9/529: fdatasync db/d10/d22/d24/f92 0 2024-02-19T19:07:34.790 INFO:tasks.workunit.client.1.smithi142.stdout:9/530: write db/d10/d7d/f78 [261065,84787] 0 2024-02-19T19:07:34.790 INFO:tasks.workunit.client.1.smithi142.stdout:9/531: write db/d10/d32/d3f/f7e [1900953,47614] 0 2024-02-19T19:07:34.790 INFO:tasks.workunit.client.1.smithi142.stdout:3/616: mkdir d1d/d1e/d2e/d50/d7c/da7/d52/d71/dc0 0 2024-02-19T19:07:34.790 INFO:tasks.workunit.client.1.smithi142.stdout:7/392: truncate d0/f9 1638854 0 2024-02-19T19:07:34.792 INFO:tasks.workunit.client.1.smithi142.stdout:5/468: creat d5/dd/d8/d1c/d8a/f9c x:0 0 0 2024-02-19T19:07:34.792 INFO:tasks.workunit.client.1.smithi142.stdout:5/469: fsync d5/dd/d8/d2a/f90 0 2024-02-19T19:07:34.793 INFO:tasks.workunit.client.1.smithi142.stdout:1/637: mknod d5/d7/d23/d2c/dbc/ce2 0 2024-02-19T19:07:34.793 INFO:tasks.workunit.client.1.smithi142.stdout:1/638: chown d5/c6 0 1 2024-02-19T19:07:34.794 INFO:tasks.workunit.client.1.smithi142.stdout:1/639: chown d5/d7/d23/l29 8528758 1 2024-02-19T19:07:34.794 INFO:tasks.workunit.client.1.smithi142.stdout:9/532: symlink db/d10/d32/d3f/d5f/l95 0 2024-02-19T19:07:34.795 INFO:tasks.workunit.client.1.smithi142.stdout:3/617: mkdir d1d/d1e/d2e/d50/d7c/da7/d3a/d62/dc1 0 2024-02-19T19:07:34.796 INFO:tasks.workunit.client.1.smithi142.stdout:5/470: rmdir d5/dd/d8/d31/d4d/d8d 39 2024-02-19T19:07:34.798 INFO:tasks.workunit.client.1.smithi142.stdout:1/640: mknod d5/d77/da9/dae/ce3 0 2024-02-19T19:07:34.798 INFO:tasks.workunit.client.1.smithi142.stdout:1/641: creat d5/d77/da9/dae/db2/fe4 x:0 0 0 2024-02-19T19:07:34.798 INFO:tasks.workunit.client.1.smithi142.stdout:1/642: read - d5/d77/da9/dae/db2/fe4 zero size 2024-02-19T19:07:34.798 INFO:tasks.workunit.client.1.smithi142.stdout:1/643: fdatasync d5/d7/d4a/d53/fc3 0 2024-02-19T19:07:34.799 INFO:tasks.workunit.client.1.smithi142.stdout:9/533: dread db/d10/d32/f7f [0,4194304] 0 2024-02-19T19:07:34.800 INFO:tasks.workunit.client.1.smithi142.stdout:3/618: unlink d1d/d1e/d2e/d50/d83/c89 0 2024-02-19T19:07:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:7/393: mknod d0/d13/c82 0 2024-02-19T19:07:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:7/394: chown d0/d13/d1e/d22/f57 414199 1 2024-02-19T19:07:34.801 INFO:tasks.workunit.client.1.smithi142.stdout:7/395: dread - d0/d1b/d21/d24/d5e/d65/f74 zero size 2024-02-19T19:07:34.804 INFO:tasks.workunit.client.1.smithi142.stdout:1/644: mknod d5/d7/d23/d2c/dbc/ce5 0 2024-02-19T19:07:34.808 INFO:tasks.workunit.client.1.smithi142.stdout:4/560: dwrite d4/d1d/d42/d66/d12/d2d/f75 [0,4194304] 0 2024-02-19T19:07:34.808 INFO:tasks.workunit.client.1.smithi142.stdout:4/561: readlink d4/d1d/d42/d66/d5f/lb0 0 2024-02-19T19:07:34.808 INFO:tasks.workunit.client.1.smithi142.stdout:4/562: dread - d4/d1d/d42/d66/d12/fa4 zero size 2024-02-19T19:07:34.811 INFO:tasks.workunit.client.1.smithi142.stdout:9/534: symlink db/d8e/l96 0 2024-02-19T19:07:34.811 INFO:tasks.workunit.client.1.smithi142.stdout:3/619: dread d1d/d1e/d2e/d37/f64 [0,4194304] 0 2024-02-19T19:07:34.811 INFO:tasks.workunit.client.1.smithi142.stdout:1/645: read d5/d7/d4a/d53/f99 [3278797,41111] 0 2024-02-19T19:07:34.813 INFO:tasks.workunit.client.1.smithi142.stdout:7/396: dread d0/f19 [0,4194304] 0 2024-02-19T19:07:34.813 INFO:tasks.workunit.client.1.smithi142.stdout:7/397: chown d0/d13 162694517 1 2024-02-19T19:07:34.817 INFO:tasks.workunit.client.1.smithi142.stdout:4/563: truncate d4/d14/f2f 123010 0 2024-02-19T19:07:34.819 INFO:tasks.workunit.client.1.smithi142.stdout:9/535: rename db/d10/c6e to db/d10/d22/d24/d41/c97 0 2024-02-19T19:07:34.822 INFO:tasks.workunit.client.1.smithi142.stdout:7/398: creat d0/d1b/d21/d24/d29/d7e/f83 x:0 0 0 2024-02-19T19:07:34.822 INFO:tasks.workunit.client.1.smithi142.stdout:7/399: fsync d0/d1b/f59 0 2024-02-19T19:07:34.825 INFO:tasks.workunit.client.1.smithi142.stdout:1/646: rename d5/c9e to d5/d7/d23/d2c/ce6 0 2024-02-19T19:07:34.825 INFO:tasks.workunit.client.1.smithi142.stdout:1/647: readlink d5/d7/l6d 0 2024-02-19T19:07:34.825 INFO:tasks.workunit.client.1.smithi142.stdout:1/648: chown d5/d37/d6c/dd0/fd5 878216152 1 2024-02-19T19:07:34.826 INFO:tasks.workunit.client.1.smithi142.stdout:3/620: link d1d/d1e/d2e/cba d1d/d1e/d6e/cc2 0 2024-02-19T19:07:34.826 INFO:tasks.workunit.client.1.smithi142.stdout:9/536: write db/d10/d22/f46 [3403500,5708] 0 2024-02-19T19:07:34.828 INFO:tasks.workunit.client.1.smithi142.stdout:1/649: rename d5/d73/l8d to d5/d77/le7 0 2024-02-19T19:07:34.830 INFO:tasks.workunit.client.1.smithi142.stdout:3/621: creat d1d/d1e/d2e/d50/d7c/da7/d3a/d62/dc1/fc3 x:0 0 0 2024-02-19T19:07:34.831 INFO:tasks.workunit.client.1.smithi142.stdout:3/622: write d1d/f35 [497747,98007] 0 2024-02-19T19:07:34.833 INFO:tasks.workunit.client.1.smithi142.stdout:9/537: symlink db/d10/d27/l98 0 2024-02-19T19:07:34.835 INFO:tasks.workunit.client.1.smithi142.stdout:1/650: getdents d5/d7 0 2024-02-19T19:07:34.837 INFO:tasks.workunit.client.1.smithi142.stdout:3/623: creat d1d/d1e/d2e/d37/d6c/da9/fc4 x:0 0 0 2024-02-19T19:07:34.839 INFO:tasks.workunit.client.1.smithi142.stdout:3/624: creat d1d/d1e/d2e/d50/d7c/da7/d3a/d62/fc5 x:0 0 0 2024-02-19T19:07:34.840 INFO:tasks.workunit.client.1.smithi142.stdout:3/625: mknod d1d/d1e/d2e/d50/d7c/da7/d52/d71/cc6 0 2024-02-19T19:07:34.841 INFO:tasks.workunit.client.1.smithi142.stdout:3/626: mkdir d1d/d1e/d2e/d50/d7c/da7/d3a/dc7 0 2024-02-19T19:07:34.841 INFO:tasks.workunit.client.1.smithi142.stdout:3/627: fsync d1d/d1e/f6b 0 2024-02-19T19:07:34.842 INFO:tasks.workunit.client.1.smithi142.stdout:9/538: write db/d10/d22/d24/f3e [2685380,64101] 0 2024-02-19T19:07:34.843 INFO:tasks.workunit.client.1.smithi142.stdout:9/539: mkdir db/d10/d22/d24/d41/d99 0 2024-02-19T19:07:34.843 INFO:tasks.workunit.client.1.smithi142.stdout:9/540: write db/d10/d27/d2f/f94 [850975,91233] 0 2024-02-19T19:07:34.844 INFO:tasks.workunit.client.1.smithi142.stdout:9/541: mknod db/c9a 0 2024-02-19T19:07:34.845 INFO:tasks.workunit.client.1.smithi142.stdout:9/542: chown db/d10/d22/d24/f8b 51422 1 2024-02-19T19:07:34.845 INFO:tasks.workunit.client.1.smithi142.stdout:9/543: readlink db/d10/l7c 0 2024-02-19T19:07:34.846 INFO:tasks.workunit.client.1.smithi142.stdout:0/399: sync 2024-02-19T19:07:34.846 INFO:tasks.workunit.client.1.smithi142.stdout:9/544: creat db/d10/d22/d24/d41/f9b x:0 0 0 2024-02-19T19:07:34.850 INFO:tasks.workunit.client.1.smithi142.stdout:0/400: symlink d23/d28/l87 0 2024-02-19T19:07:34.850 INFO:tasks.workunit.client.1.smithi142.stdout:0/401: write f11 [6580072,76540] 0 2024-02-19T19:07:34.850 INFO:tasks.workunit.client.1.smithi142.stdout:0/402: truncate d23/d28/d2d/f60 65630 0 2024-02-19T19:07:34.851 INFO:tasks.workunit.client.1.smithi142.stdout:9/545: mknod db/d10/d32/c9c 0 2024-02-19T19:07:34.857 INFO:tasks.workunit.client.1.smithi142.stdout:7/400: dwrite d0/d13/d1e/f71 [0,4194304] 0 2024-02-19T19:07:34.861 INFO:tasks.workunit.client.1.smithi142.stdout:1/651: dwrite d5/d37/f52 [0,4194304] 0 2024-02-19T19:07:34.861 INFO:tasks.workunit.client.1.smithi142.stdout:1/652: write d5/d7/d34/d6f/fba [229815,21202] 0 2024-02-19T19:07:34.861 INFO:tasks.workunit.client.1.smithi142.stdout:7/401: mknod d0/d13/d72/c84 0 2024-02-19T19:07:34.862 INFO:tasks.workunit.client.1.smithi142.stdout:7/402: dread - d0/d1b/d21/d24/f5f zero size 2024-02-19T19:07:34.862 INFO:tasks.workunit.client.1.smithi142.stdout:7/403: creat d0/d1b/d21/d24/d29/d44/f85 x:0 0 0 2024-02-19T19:07:34.864 INFO:tasks.workunit.client.1.smithi142.stdout:4/564: dread d4/d14/f2f [0,4194304] 0 2024-02-19T19:07:34.866 INFO:tasks.workunit.client.1.smithi142.stdout:3/628: dwrite d1d/d1e/d2e/d50/d7c/da7/d3a/d62/d91/fa5 [0,4194304] 0 2024-02-19T19:07:34.870 INFO:tasks.workunit.client.1.smithi142.stdout:3/629: mkdir d1d/d1e/d2e/d50/d7c/da7/dc8 0 2024-02-19T19:07:34.870 INFO:tasks.workunit.client.1.smithi142.stdout:0/403: dwrite d23/d28/f34 [0,4194304] 0 2024-02-19T19:07:34.870 INFO:tasks.workunit.client.1.smithi142.stdout:0/404: read - d23/d28/d41/f69 zero size 2024-02-19T19:07:34.872 INFO:tasks.workunit.client.1.smithi142.stdout:3/630: link d1d/d87/f8e d1d/d1e/d2e/d50/d7c/da7/fc9 0 2024-02-19T19:07:34.875 INFO:tasks.workunit.client.1.smithi142.stdout:3/631: unlink d1d/d1e/d2e/d37/f64 0 2024-02-19T19:07:34.875 INFO:tasks.workunit.client.1.smithi142.stdout:3/632: fdatasync d1d/d1e/d2e/d50/f93 0 2024-02-19T19:07:34.877 INFO:tasks.workunit.client.1.smithi142.stdout:3/633: creat d1d/d1e/d2e/d50/d7c/da7/d3a/d62/da2/fca x:0 0 0 2024-02-19T19:07:34.877 INFO:tasks.workunit.client.1.smithi142.stdout:3/634: write d1d/d1e/d2e/d50/f8c [1296092,44008] 0 2024-02-19T19:07:34.877 INFO:tasks.workunit.client.1.smithi142.stdout:3/635: fdatasync d1d/d1e/d2e/d50/d7c/da7/fc9 0 2024-02-19T19:07:34.878 INFO:tasks.workunit.client.1.smithi142.stdout:3/636: creat d1d/d1e/d2e/d50/d7c/da7/d3a/fcb x:0 0 0 2024-02-19T19:07:34.878 INFO:tasks.workunit.client.1.smithi142.stdout:4/565: dread d4/d1d/d42/d66/d2c/f3d [4194304,4194304] 0 2024-02-19T19:07:34.882 INFO:tasks.workunit.client.1.smithi142.stdout:0/405: dread d23/f31 [0,4194304] 0 2024-02-19T19:07:34.882 INFO:tasks.workunit.client.1.smithi142.stdout:0/406: write d23/d32/f30 [1809358,41720] 0 2024-02-19T19:07:34.889 INFO:tasks.workunit.client.1.smithi142.stdout:9/546: dwrite db/d10/d7d/f78 [0,4194304] 0 2024-02-19T19:07:34.899 INFO:tasks.workunit.client.1.smithi142.stdout:7/404: dwrite d0/d1b/f5a [0,4194304] 0 2024-02-19T19:07:34.900 INFO:tasks.workunit.client.1.smithi142.stdout:9/547: truncate db/d10/f1c 3523754 0 2024-02-19T19:07:34.902 INFO:tasks.workunit.client.1.smithi142.stdout:4/566: dwrite d4/d1d/d42/d66/d2c/fa0 [0,4194304] 0 2024-02-19T19:07:34.902 INFO:tasks.workunit.client.1.smithi142.stdout:4/567: stat d4/d1d/d42/d66/dd/d10/d26/d50/d54/f59 0 2024-02-19T19:07:34.902 INFO:tasks.workunit.client.1.smithi142.stdout:4/568: fdatasync d4/d1d/f5b 0 2024-02-19T19:07:34.904 INFO:tasks.workunit.client.1.smithi142.stdout:1/653: dwrite d5/d37/d49/f89 [0,4194304] 0 2024-02-19T19:07:34.904 INFO:tasks.workunit.client.1.smithi142.stdout:1/654: creat d5/d77/da9/dae/db2/fe8 x:0 0 0 2024-02-19T19:07:34.904 INFO:tasks.workunit.client.1.smithi142.stdout:1/655: write d5/d7/d4a/fc1 [1423842,82935] 0 2024-02-19T19:07:34.904 INFO:tasks.workunit.client.1.smithi142.stdout:3/637: getdents d1d/d1e/d2e/d50/d7c/da7 0 2024-02-19T19:07:34.905 INFO:tasks.workunit.client.1.smithi142.stdout:0/407: dwrite d23/d28/d2d/d51/f7e [0,4194304] 0 2024-02-19T19:07:34.905 INFO:tasks.workunit.client.1.smithi142.stdout:0/408: truncate d23/f31 3948971 0 2024-02-19T19:07:34.906 INFO:tasks.workunit.client.1.smithi142.stdout:9/548: rmdir db/d10/d22/d24/d41 39 2024-02-19T19:07:34.907 INFO:tasks.workunit.client.1.smithi142.stdout:4/569: dread d4/d1d/d42/d66/dd/d10/d3e/f81 [0,4194304] 0 2024-02-19T19:07:34.907 INFO:tasks.workunit.client.1.smithi142.stdout:4/570: write d4/d1d/d42/d66/d12/f7f [3886021,5569] 0 2024-02-19T19:07:34.911 INFO:tasks.workunit.client.1.smithi142.stdout:1/656: truncate d5/d7/d4a/d53/d6a/faa 3544397 0 2024-02-19T19:07:34.911 INFO:tasks.workunit.client.1.smithi142.stdout:1/657: creat d5/d37/d6c/d75/da2/fe9 x:0 0 0 2024-02-19T19:07:34.913 INFO:tasks.workunit.client.1.smithi142.stdout:0/409: mkdir d23/d28/d2d/d54/d88 0 2024-02-19T19:07:34.915 INFO:tasks.workunit.client.1.smithi142.stdout:0/410: stat d23/d28/f38 0 2024-02-19T19:07:34.917 INFO:tasks.workunit.client.1.smithi142.stdout:0/411: creat d23/d28/d2d/d51/d44/f89 x:0 0 0 2024-02-19T19:07:34.917 INFO:tasks.workunit.client.1.smithi142.stdout:0/412: rmdir d23 39 2024-02-19T19:07:34.919 INFO:tasks.workunit.client.1.smithi142.stdout:2/469: sync 2024-02-19T19:07:34.919 INFO:tasks.workunit.client.1.smithi142.stdout:6/428: sync 2024-02-19T19:07:34.919 INFO:tasks.workunit.client.1.smithi142.stdout:4/571: dread d4/d1d/d42/d66/dd/f4a [0,4194304] 0 2024-02-19T19:07:34.919 INFO:tasks.workunit.client.1.smithi142.stdout:5/471: sync 2024-02-19T19:07:34.921 INFO:tasks.workunit.client.1.smithi142.stdout:9/549: dread db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:34.921 INFO:tasks.workunit.client.1.smithi142.stdout:8/526: sync 2024-02-19T19:07:34.921 INFO:tasks.workunit.client.1.smithi142.stdout:8/527: stat d9/dd/de/d14/d65/l7c 0 2024-02-19T19:07:34.921 INFO:tasks.workunit.client.1.smithi142.stdout:9/550: write db/d10/d22/d24/d41/f74 [684970,47372] 0 2024-02-19T19:07:34.921 INFO:tasks.workunit.client.1.smithi142.stdout:8/528: chown d9/l10 84854300 1 2024-02-19T19:07:34.921 INFO:tasks.workunit.client.1.smithi142.stdout:9/551: write db/d10/d7d/f8f [645112,87328] 0 2024-02-19T19:07:34.922 INFO:tasks.workunit.client.1.smithi142.stdout:5/472: link d5/dd/d8/d1c/l4a d5/dd/d5f/l9d 0 2024-02-19T19:07:34.922 INFO:tasks.workunit.client.1.smithi142.stdout:5/473: write d5/dd/df/f12 [6023857,74855] 0 2024-02-19T19:07:34.922 INFO:tasks.workunit.client.1.smithi142.stdout:5/474: write d5/dd/d5f/f81 [26059,66167] 0 2024-02-19T19:07:34.922 INFO:tasks.workunit.client.1.smithi142.stdout:2/470: mkdir d3/d35/d97 0 2024-02-19T19:07:34.922 INFO:tasks.workunit.client.1.smithi142.stdout:7/405: dwrite d0/d1b/f5a [0,4194304] 0 2024-02-19T19:07:34.923 INFO:tasks.workunit.client.1.smithi142.stdout:4/572: getdents d4/d14/d31/d43 0 2024-02-19T19:07:34.926 INFO:tasks.workunit.client.1.smithi142.stdout:9/552: getdents db/d10/d32/d3f/d5f 0 2024-02-19T19:07:34.927 INFO:tasks.workunit.client.1.smithi142.stdout:0/413: write d23/d28/d2d/d51/f4f [238861,119468] 0 2024-02-19T19:07:34.927 INFO:tasks.workunit.client.1.smithi142.stdout:5/475: mkdir d5/dd/d8/d31/d4d/d75/d9e 0 2024-02-19T19:07:34.928 INFO:tasks.workunit.client.1.smithi142.stdout:1/658: truncate d5/d37/d49/f89 3228294 0 2024-02-19T19:07:34.929 INFO:tasks.workunit.client.1.smithi142.stdout:7/406: mkdir d0/d1b/d21/d24/d5e/d65/d86 0 2024-02-19T19:07:34.930 INFO:tasks.workunit.client.1.smithi142.stdout:6/429: dread d2/f12 [0,4194304] 0 2024-02-19T19:07:34.930 INFO:tasks.workunit.client.1.smithi142.stdout:6/430: fdatasync d2/d29/d47/f4a 0 2024-02-19T19:07:34.931 INFO:tasks.workunit.client.1.smithi142.stdout:6/431: dread - d2/d17/d33/d42/f74 zero size 2024-02-19T19:07:34.931 INFO:tasks.workunit.client.1.smithi142.stdout:4/573: mknod d4/d1d/d42/d66/d5f/cb9 0 2024-02-19T19:07:34.931 INFO:tasks.workunit.client.1.smithi142.stdout:4/574: chown d4/d14/d31/d43/f5d 22 1 2024-02-19T19:07:34.932 INFO:tasks.workunit.client.1.smithi142.stdout:3/638: dwrite d1d/d1e/d2e/d37/d81/fbd [0,4194304] 0 2024-02-19T19:07:34.932 INFO:tasks.workunit.client.1.smithi142.stdout:3/639: readlink d1d/l47 0 2024-02-19T19:07:34.932 INFO:tasks.workunit.client.1.smithi142.stdout:3/640: fsync d1d/d1e/d2e/d50/d7c/da7/d3a/fcb 0 2024-02-19T19:07:34.933 INFO:tasks.workunit.client.1.smithi142.stdout:0/414: mkdir d23/d32/d8a 0 2024-02-19T19:07:34.933 INFO:tasks.workunit.client.1.smithi142.stdout:9/553: creat db/d10/d22/f9d x:0 0 0 2024-02-19T19:07:34.933 INFO:tasks.workunit.client.1.smithi142.stdout:9/554: fdatasync db/d10/d22/d24/d3d/d89/f8c 0 2024-02-19T19:07:34.934 INFO:tasks.workunit.client.1.smithi142.stdout:5/476: link d5/dd/df/d15/d5b/c8c d5/dd/df/d22/c9f 0 2024-02-19T19:07:34.935 INFO:tasks.workunit.client.1.smithi142.stdout:5/477: write d5/dd/df/d22/d41/d32/f74 [4913614,115570] 0 2024-02-19T19:07:34.935 INFO:tasks.workunit.client.1.smithi142.stdout:1/659: rmdir d5/d7/d4a/d53/d6a 39 2024-02-19T19:07:34.936 INFO:tasks.workunit.client.1.smithi142.stdout:1/660: write d5/d7/d34/f66 [856343,7164] 0 2024-02-19T19:07:34.936 INFO:tasks.workunit.client.1.smithi142.stdout:1/661: readlink d5/l22 0 2024-02-19T19:07:34.938 INFO:tasks.workunit.client.1.smithi142.stdout:7/407: rename d0/l37 to d0/d1b/d21/d24/d29/d44/l87 0 2024-02-19T19:07:34.938 INFO:tasks.workunit.client.1.smithi142.stdout:7/408: write d0/f6b [1195122,100550] 0 2024-02-19T19:07:34.938 INFO:tasks.workunit.client.1.smithi142.stdout:7/409: stat d0/d1b/c68 0 2024-02-19T19:07:34.938 INFO:tasks.workunit.client.1.smithi142.stdout:7/410: fdatasync d0/d1b/d21/d24/d5e/f63 0 2024-02-19T19:07:34.939 INFO:tasks.workunit.client.1.smithi142.stdout:6/432: symlink d2/d1f/d20/d31/d88/d8f/l92 0 2024-02-19T19:07:34.941 INFO:tasks.workunit.client.1.smithi142.stdout:4/575: mkdir d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba 0 2024-02-19T19:07:34.945 INFO:tasks.workunit.client.1.smithi142.stdout:0/415: creat d23/d86/f8b x:0 0 0 2024-02-19T19:07:34.946 INFO:tasks.workunit.client.1.smithi142.stdout:5/478: mkdir d5/dd/df/da0 0 2024-02-19T19:07:34.948 INFO:tasks.workunit.client.1.smithi142.stdout:7/411: link d0/d13/f15 d0/d13/d72/f88 0 2024-02-19T19:07:34.948 INFO:tasks.workunit.client.1.smithi142.stdout:7/412: fdatasync d0/d13/d1e/f42 0 2024-02-19T19:07:34.948 INFO:tasks.workunit.client.1.smithi142.stdout:7/413: getdents d0/d13/d1e 0 2024-02-19T19:07:34.949 INFO:tasks.workunit.client.1.smithi142.stdout:8/529: dwrite d9/dd/de/d2d/d2e/d73/d77/f89 [0,4194304] 0 2024-02-19T19:07:34.949 INFO:tasks.workunit.client.1.smithi142.stdout:6/433: mknod d2/d29/d47/c93 0 2024-02-19T19:07:34.950 INFO:tasks.workunit.client.1.smithi142.stdout:4/576: creat d4/d1d/d42/d66/d12/d2d/d2a/d84/fbb x:0 0 0 2024-02-19T19:07:34.952 INFO:tasks.workunit.client.1.smithi142.stdout:1/662: write d5/f38 [1019564,47399] 0 2024-02-19T19:07:34.952 INFO:tasks.workunit.client.1.smithi142.stdout:3/641: dwrite d1d/d1e/d2e/d37/f4a [4194304,4194304] 0 2024-02-19T19:07:34.954 INFO:tasks.workunit.client.1.smithi142.stdout:0/416: unlink d23/d28/f72 0 2024-02-19T19:07:34.954 INFO:tasks.workunit.client.1.smithi142.stdout:9/555: dwrite db/d10/d27/d2f/d4c/d54/d83/f8a [0,4194304] 0 2024-02-19T19:07:34.954 INFO:tasks.workunit.client.1.smithi142.stdout:9/556: truncate db/d10/d22/d24/d3d/d89/f8c 969241 0 2024-02-19T19:07:34.956 INFO:tasks.workunit.client.1.smithi142.stdout:5/479: link d5/dd/c42 d5/dd/df/d22/d41/d32/ca1 0 2024-02-19T19:07:34.958 INFO:tasks.workunit.client.1.smithi142.stdout:7/414: rmdir d0/d13/d1e 39 2024-02-19T19:07:34.958 INFO:tasks.workunit.client.1.smithi142.stdout:7/415: chown d0/d1b/d21/d24/d5e/d65/c7b 25110092 1 2024-02-19T19:07:34.958 INFO:tasks.workunit.client.1.smithi142.stdout:7/416: fsync d0/d1b/d21/d24/f28 0 2024-02-19T19:07:34.961 INFO:tasks.workunit.client.1.smithi142.stdout:5/480: dread d5/dd/f68 [0,4194304] 0 2024-02-19T19:07:34.963 INFO:tasks.workunit.client.1.smithi142.stdout:6/434: creat d2/d29/f94 x:0 0 0 2024-02-19T19:07:34.963 INFO:tasks.workunit.client.1.smithi142.stdout:6/435: chown d2/d29/d47/f71 468505 1 2024-02-19T19:07:34.963 INFO:tasks.workunit.client.1.smithi142.stdout:0/417: dread d23/d32/f6a [0,4194304] 0 2024-02-19T19:07:34.963 INFO:tasks.workunit.client.1.smithi142.stdout:6/436: readlink d2/l10 0 2024-02-19T19:07:34.969 INFO:tasks.workunit.client.1.smithi142.stdout:1/663: mkdir d5/d77/da9/dae/db2/dea 0 2024-02-19T19:07:34.969 INFO:tasks.workunit.client.1.smithi142.stdout:1/664: write d5/d7/fd3 [161333,35740] 0 2024-02-19T19:07:34.970 INFO:tasks.workunit.client.1.smithi142.stdout:3/642: truncate d1d/d1e/d2e/d50/d7c/da7/d3a/d62/da2/fa8 31886 0 2024-02-19T19:07:34.970 INFO:tasks.workunit.client.1.smithi142.stdout:7/417: mkdir d0/d13/d72/d47/d89 0 2024-02-19T19:07:34.971 INFO:tasks.workunit.client.1.smithi142.stdout:6/437: rmdir d2/d1f/d4d 39 2024-02-19T19:07:34.972 INFO:tasks.workunit.client.1.smithi142.stdout:0/418: truncate d23/d28/f7a 3963547 0 2024-02-19T19:07:34.972 INFO:tasks.workunit.client.1.smithi142.stdout:3/643: truncate d1d/d1e/d2e/f46 460499 0 2024-02-19T19:07:34.974 INFO:tasks.workunit.client.1.smithi142.stdout:6/438: symlink d2/d1f/d5c/l95 0 2024-02-19T19:07:34.974 INFO:tasks.workunit.client.1.smithi142.stdout:6/439: fdatasync d2/d1f/d20/f2c 0 2024-02-19T19:07:34.974 INFO:tasks.workunit.client.1.smithi142.stdout:6/440: fdatasync d2/d17/d33/d42/f74 0 2024-02-19T19:07:34.974 INFO:tasks.workunit.client.1.smithi142.stdout:6/441: stat d2/d17/d33/d42/d5e/d7b 0 2024-02-19T19:07:34.974 INFO:tasks.workunit.client.1.smithi142.stdout:6/442: write d2/d1f/d20/f2c [1561929,44278] 0 2024-02-19T19:07:34.975 INFO:tasks.workunit.client.1.smithi142.stdout:0/419: link d23/d32/c6c d23/c8c 0 2024-02-19T19:07:34.975 INFO:tasks.workunit.client.1.smithi142.stdout:6/443: truncate d2/d17/d33/d39/f70 218719 0 2024-02-19T19:07:34.975 INFO:tasks.workunit.client.1.smithi142.stdout:6/444: dread - d2/d1f/d4d/d60/f90 zero size 2024-02-19T19:07:34.976 INFO:tasks.workunit.client.1.smithi142.stdout:4/577: dwrite d4/d1d/d42/d66/d12/d2d/f75 [4194304,4194304] 0 2024-02-19T19:07:34.977 INFO:tasks.workunit.client.1.smithi142.stdout:4/578: creat d4/d1d/d42/fbc x:0 0 0 2024-02-19T19:07:34.977 INFO:tasks.workunit.client.1.smithi142.stdout:3/644: dread d1d/d87/f8e [0,4194304] 0 2024-02-19T19:07:34.978 INFO:tasks.workunit.client.1.smithi142.stdout:0/420: rename d23/d28/d2d/l56 to d23/d28/d2d/d51/d44/d58/l8d 0 2024-02-19T19:07:34.978 INFO:tasks.workunit.client.1.smithi142.stdout:0/421: read - d23/d28/d2d/d51/f71 zero size 2024-02-19T19:07:34.978 INFO:tasks.workunit.client.1.smithi142.stdout:0/422: chown d23/d28/f34 11659 1 2024-02-19T19:07:34.978 INFO:tasks.workunit.client.1.smithi142.stdout:9/557: dwrite db/f61 [0,4194304] 0 2024-02-19T19:07:34.978 INFO:tasks.workunit.client.1.smithi142.stdout:9/558: stat db/d10/d27/d2f/d4c/l55 0 2024-02-19T19:07:34.978 INFO:tasks.workunit.client.1.smithi142.stdout:8/530: dwrite d9/dd/de/f8c [0,4194304] 0 2024-02-19T19:07:34.979 INFO:tasks.workunit.client.1.smithi142.stdout:6/445: mkdir d2/d1e/d35/d96 0 2024-02-19T19:07:34.989 INFO:tasks.workunit.client.1.smithi142.stdout:0/423: link d23/d28/d2d/f53 d23/d28/d2d/f8e 0 2024-02-19T19:07:34.990 INFO:tasks.workunit.client.1.smithi142.stdout:0/424: write d23/f3d [23911,17002] 0 2024-02-19T19:07:34.990 INFO:tasks.workunit.client.1.smithi142.stdout:0/425: chown d23/d28/d2d/d51/f37 44541337 1 2024-02-19T19:07:34.990 INFO:tasks.workunit.client.1.smithi142.stdout:7/418: dwrite d0/d1b/d21/d24/f34 [0,4194304] 0 2024-02-19T19:07:34.990 INFO:tasks.workunit.client.1.smithi142.stdout:7/419: write d0/d1b/f5a [4899296,74901] 0 2024-02-19T19:07:34.991 INFO:tasks.workunit.client.1.smithi142.stdout:3/645: rename f1 to d1d/d1e/d2e/d50/d7c/da7/d52/d5a/fcc 0 2024-02-19T19:07:34.991 INFO:tasks.workunit.client.1.smithi142.stdout:4/579: write d4/d1c/f22 [161075,61786] 0 2024-02-19T19:07:34.992 INFO:tasks.workunit.client.1.smithi142.stdout:1/665: dwrite d5/d37/d6c/d75/da2/fd9 [0,4194304] 0 2024-02-19T19:07:34.995 INFO:tasks.workunit.client.1.smithi142.stdout:8/531: creat d9/dd/d44/faa x:0 0 0 2024-02-19T19:07:34.998 INFO:tasks.workunit.client.1.smithi142.stdout:9/559: dwrite db/d10/f4b [4194304,4194304] 0 2024-02-19T19:07:35.000 INFO:tasks.workunit.client.1.smithi142.stdout:7/420: creat d0/d13/d1e/f8a x:0 0 0 2024-02-19T19:07:35.002 INFO:tasks.workunit.client.1.smithi142.stdout:6/446: rename d2/d1e/l34 to d2/d1f/l97 0 2024-02-19T19:07:35.003 INFO:tasks.workunit.client.1.smithi142.stdout:6/447: fdatasync d2/d1f/d5c/f6f 0 2024-02-19T19:07:35.003 INFO:tasks.workunit.client.1.smithi142.stdout:6/448: chown d2/d29/l67 0 1 2024-02-19T19:07:35.004 INFO:tasks.workunit.client.1.smithi142.stdout:3/646: truncate d1d/d1e/d2e/f3f 2423942 0 2024-02-19T19:07:35.004 INFO:tasks.workunit.client.1.smithi142.stdout:3/647: fdatasync d1d/d1e/d2e/d50/d7c/da7/d52/d5a/fcc 0 2024-02-19T19:07:35.006 INFO:tasks.workunit.client.1.smithi142.stdout:7/421: read d0/f19 [2361871,121375] 0 2024-02-19T19:07:35.006 INFO:tasks.workunit.client.1.smithi142.stdout:7/422: truncate d0/fd 2316538 0 2024-02-19T19:07:35.006 INFO:tasks.workunit.client.1.smithi142.stdout:7/423: chown d0/d13/d72/f45 758501 1 2024-02-19T19:07:35.006 INFO:tasks.workunit.client.1.smithi142.stdout:7/424: truncate d0/f9 2564453 0 2024-02-19T19:07:35.006 INFO:tasks.workunit.client.1.smithi142.stdout:4/580: mkdir d4/d1d/d42/d66/dd/d10/d3e/dbd 0 2024-02-19T19:07:35.008 INFO:tasks.workunit.client.1.smithi142.stdout:0/426: dwrite d23/d32/f5b [0,4194304] 0 2024-02-19T19:07:35.017 INFO:tasks.workunit.client.1.smithi142.stdout:0/427: dread f13 [0,4194304] 0 2024-02-19T19:07:35.017 INFO:tasks.workunit.client.1.smithi142.stdout:0/428: readlink d23/d28/d2d/d51/d44/l81 0 2024-02-19T19:07:35.019 INFO:tasks.workunit.client.1.smithi142.stdout:1/666: mkdir d5/d77/da9/dae/deb 0 2024-02-19T19:07:35.019 INFO:tasks.workunit.client.1.smithi142.stdout:1/667: write d5/d77/da9/dae/db2/fe4 [568709,96714] 0 2024-02-19T19:07:35.022 INFO:tasks.workunit.client.1.smithi142.stdout:8/532: creat d9/dd/d44/d79/fab x:0 0 0 2024-02-19T19:07:35.024 INFO:tasks.workunit.client.1.smithi142.stdout:9/560: rename f5 to db/d10/d22/f9e 0 2024-02-19T19:07:35.024 INFO:tasks.workunit.client.1.smithi142.stdout:9/561: chown db/d10/d22/d24/l64 432540852 1 2024-02-19T19:07:35.024 INFO:tasks.workunit.client.1.smithi142.stdout:9/562: truncate db/d10/d27/f6d 594343 0 2024-02-19T19:07:35.024 INFO:tasks.workunit.client.1.smithi142.stdout:9/563: dread - db/d10/d22/f9d zero size 2024-02-19T19:07:35.024 INFO:tasks.workunit.client.1.smithi142.stdout:9/564: stat db/f84 0 2024-02-19T19:07:35.025 INFO:tasks.workunit.client.1.smithi142.stdout:7/425: dwrite d0/f2a [0,4194304] 0 2024-02-19T19:07:35.026 INFO:tasks.workunit.client.1.smithi142.stdout:3/648: mkdir d1d/d1e/dcd 0 2024-02-19T19:07:35.029 INFO:tasks.workunit.client.1.smithi142.stdout:0/429: creat d23/d32/f8f x:0 0 0 2024-02-19T19:07:35.029 INFO:tasks.workunit.client.1.smithi142.stdout:0/430: chown d23/d28/d2d/f79 256584 1 2024-02-19T19:07:35.029 INFO:tasks.workunit.client.1.smithi142.stdout:0/431: read d23/d28/f7a [1065676,43013] 0 2024-02-19T19:07:35.029 INFO:tasks.workunit.client.1.smithi142.stdout:0/432: fsync d23/f46 0 2024-02-19T19:07:35.033 INFO:tasks.workunit.client.1.smithi142.stdout:8/533: link d9/dd/d15/c93 d9/dd/de/d14/cac 0 2024-02-19T19:07:35.036 INFO:tasks.workunit.client.1.smithi142.stdout:6/449: rename d2/d29/d47/l81 to d2/d1f/d4d/l98 0 2024-02-19T19:07:35.038 INFO:tasks.workunit.client.1.smithi142.stdout:9/565: link db/d10/f15 db/d10/d27/d2f/d4c/f9f 0 2024-02-19T19:07:35.042 INFO:tasks.workunit.client.1.smithi142.stdout:7/426: dwrite d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:35.042 INFO:tasks.workunit.client.1.smithi142.stdout:7/427: fdatasync d0/d1b/d21/d24/d29/f7f 0 2024-02-19T19:07:35.044 INFO:tasks.workunit.client.1.smithi142.stdout:8/534: mknod d9/dd/de/d2d/d2e/d49/cad 0 2024-02-19T19:07:35.046 INFO:tasks.workunit.client.1.smithi142.stdout:4/581: rename d4/d1d/d42/d66/d2c/f67 to d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f/fbe 0 2024-02-19T19:07:35.047 INFO:tasks.workunit.client.1.smithi142.stdout:6/450: symlink d2/d1f/d4d/l99 0 2024-02-19T19:07:35.047 INFO:tasks.workunit.client.1.smithi142.stdout:6/451: truncate d2/d1f/d20/d31/d62/f72 1051658 0 2024-02-19T19:07:35.051 INFO:tasks.workunit.client.1.smithi142.stdout:7/428: mkdir d0/d1b/d21/d24/d29/d44/d49/d8b 0 2024-02-19T19:07:35.052 INFO:tasks.workunit.client.1.smithi142.stdout:0/433: dwrite d23/d28/f33 [0,4194304] 0 2024-02-19T19:07:35.052 INFO:tasks.workunit.client.1.smithi142.stdout:0/434: write f13 [4542789,37180] 0 2024-02-19T19:07:35.052 INFO:tasks.workunit.client.1.smithi142.stdout:0/435: write d23/d28/d2d/f8e [716437,23111] 0 2024-02-19T19:07:35.057 INFO:tasks.workunit.client.1.smithi142.stdout:8/535: dread d9/dd/de/d2d/d2e/d73/d77/f89 [0,4194304] 0 2024-02-19T19:07:35.057 INFO:tasks.workunit.client.1.smithi142.stdout:8/536: chown d9/dd/de/d2d/d2e/d73/d77/f89 441 1 2024-02-19T19:07:35.057 INFO:tasks.workunit.client.1.smithi142.stdout:3/649: rename d1d/d1e/d2e/d50/f8c to d1d/d1e/d2e/d50/d7c/da7/d52/d5a/da4/fce 0 2024-02-19T19:07:35.058 INFO:tasks.workunit.client.1.smithi142.stdout:6/452: write d2/d1f/d5c/f6f [3603554,86235] 0 2024-02-19T19:07:35.058 INFO:tasks.workunit.client.1.smithi142.stdout:6/453: fsync d2/d1f/d20/f2c 0 2024-02-19T19:07:35.060 INFO:tasks.workunit.client.1.smithi142.stdout:7/429: getdents d0/d62 0 2024-02-19T19:07:35.060 INFO:tasks.workunit.client.1.smithi142.stdout:7/430: creat d0/d1b/d21/d24/d29/d44/f8c x:0 0 0 2024-02-19T19:07:35.061 INFO:tasks.workunit.client.1.smithi142.stdout:3/650: creat d1d/d1e/d2e/d50/d7c/da7/d52/d71/fcf x:0 0 0 2024-02-19T19:07:35.062 INFO:tasks.workunit.client.1.smithi142.stdout:0/436: dread d23/d28/d2d/d51/d44/d58/f5d [0,4194304] 0 2024-02-19T19:07:35.065 INFO:tasks.workunit.client.1.smithi142.stdout:7/431: rename d0/d13/d1e/f8a to d0/d1b/d21/f8d 0 2024-02-19T19:07:35.065 INFO:tasks.workunit.client.1.smithi142.stdout:7/432: stat d0/d1b/d21/f36 0 2024-02-19T19:07:35.065 INFO:tasks.workunit.client.1.smithi142.stdout:7/433: stat d0/d1b/f5a 0 2024-02-19T19:07:35.065 INFO:tasks.workunit.client.1.smithi142.stdout:7/434: dread - d0/d1b/d21/d24/d29/d44/f85 zero size 2024-02-19T19:07:35.066 INFO:tasks.workunit.client.1.smithi142.stdout:4/582: dwrite d4/f5 [0,4194304] 0 2024-02-19T19:07:35.066 INFO:tasks.workunit.client.1.smithi142.stdout:0/437: symlink d23/d32/l90 0 2024-02-19T19:07:35.066 INFO:tasks.workunit.client.1.smithi142.stdout:0/438: write d23/d28/d2d/d51/f4f [3785858,87298] 0 2024-02-19T19:07:35.069 INFO:tasks.workunit.client.1.smithi142.stdout:3/651: rename d1d/d1e/f32 to d1d/d1e/dcd/fd0 0 2024-02-19T19:07:35.069 INFO:tasks.workunit.client.1.smithi142.stdout:7/435: rename d0/d1b/d21 to d0/d1b/d21/d24/d5e/d65/d86/d8e 22 2024-02-19T19:07:35.071 INFO:tasks.workunit.client.1.smithi142.stdout:8/537: read d9/dd/d15/f56 [3309262,122596] 0 2024-02-19T19:07:35.072 INFO:tasks.workunit.client.1.smithi142.stdout:9/566: rmdir db/d10/d22 39 2024-02-19T19:07:35.073 INFO:tasks.workunit.client.1.smithi142.stdout:6/454: dwrite d2/d17/f7a [0,4194304] 0 2024-02-19T19:07:35.073 INFO:tasks.workunit.client.1.smithi142.stdout:4/583: rename d4/d1d/d42/d66/c20 to d4/d14/d31/dab/da2/cbf 0 2024-02-19T19:07:35.074 INFO:tasks.workunit.client.1.smithi142.stdout:4/584: chown d4/d1d/d42/d66/dd/f7c 2535 1 2024-02-19T19:07:35.074 INFO:tasks.workunit.client.1.smithi142.stdout:4/585: dread - d4/d1d/d42/d66/dd/f7b zero size 2024-02-19T19:07:35.074 INFO:tasks.workunit.client.1.smithi142.stdout:4/586: fdatasync d4/fb7 0 2024-02-19T19:07:35.076 INFO:tasks.workunit.client.1.smithi142.stdout:8/538: mkdir d9/dd/de/d2d/d2e/d73/dae 0 2024-02-19T19:07:35.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:34 smithi046 ceph-mon[88928]: pgmap v79: 65 pgs: 8 active+clean+remapped, 1 peering, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 750 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 162 MiB/s rd, 196 MiB/s wr, 251 op/s; 5535/32751 objects degraded (16.900%); 1044/32751 objects misplaced (3.188%); 4.9 MiB/s, 78 objects/s recovering 2024-02-19T19:07:35.082 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:34 smithi046 ceph-osd[106711]: -- 172.21.15.46:0/4067998877 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bc99d6d1e0 con 0x55bc99d3ec00 2024-02-19T19:07:35.082 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:34 smithi046 bash[106691]: 974e56511c367ec8a3410f5b60756a7532527a2d63f1702708ab70b8612032f5 2024-02-19T19:07:35.082 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:34 smithi046 systemd[1]: Started Ceph osd.1 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:07:35.082 INFO:tasks.workunit.client.1.smithi142.stdout:4/587: dread d4/d1d/d42/d66/d12/d2d/d2a/f4c [0,4194304] 0 2024-02-19T19:07:35.082 INFO:tasks.workunit.client.1.smithi142.stdout:8/539: mknod d9/dd/de/d2d/d2e/d49/caf 0 2024-02-19T19:07:35.083 INFO:tasks.workunit.client.1.smithi142.stdout:8/540: chown d9/dd/d15/d31/l38 805152 1 2024-02-19T19:07:35.087 INFO:tasks.workunit.client.1.smithi142.stdout:4/588: creat d4/d1d/d42/d66/d12/fc0 x:0 0 0 2024-02-19T19:07:35.088 INFO:tasks.workunit.client.1.smithi142.stdout:4/589: creat d4/d1c/fc1 x:0 0 0 2024-02-19T19:07:35.089 INFO:tasks.workunit.client.1.smithi142.stdout:8/541: link f2 d9/dd/de/d2d/d2e/d73/fb0 0 2024-02-19T19:07:35.090 INFO:tasks.workunit.client.1.smithi142.stdout:9/567: dread db/d10/f15 [0,4194304] 0 2024-02-19T19:07:35.091 INFO:tasks.workunit.client.1.smithi142.stdout:4/590: mknod d4/d1d/d42/d66/dd/d10/d3e/cc2 0 2024-02-19T19:07:35.093 INFO:tasks.workunit.client.1.smithi142.stdout:4/591: creat d4/d1d/d42/d66/dd/d10/d3e/d68/db4/fc3 x:0 0 0 2024-02-19T19:07:35.094 INFO:tasks.workunit.client.1.smithi142.stdout:4/592: creat d4/d14/d31/dab/d6e/fc4 x:0 0 0 2024-02-19T19:07:35.094 INFO:tasks.workunit.client.1.smithi142.stdout:4/593: write d4/d1d/d42/d66/dd/d10/d3b/d3f/fa9 [558295,5409] 0 2024-02-19T19:07:35.094 INFO:tasks.workunit.client.1.smithi142.stdout:4/594: chown d4/l86 1026 1 2024-02-19T19:07:35.094 INFO:tasks.workunit.client.1.smithi142.stdout:4/595: truncate d4/d1d/d42/d66/d12/d2d/d2a/d84/fbb 792119 0 2024-02-19T19:07:35.097 INFO:tasks.workunit.client.1.smithi142.stdout:8/542: write d9/dd/de/d2d/d2e/d73/fb0 [3558149,105177] 0 2024-02-19T19:07:35.098 INFO:tasks.workunit.client.1.smithi142.stdout:8/543: write d9/dd/de/d2d/d2e/d73/d77/fa6 [955703,52876] 0 2024-02-19T19:07:35.099 INFO:tasks.workunit.client.1.smithi142.stdout:8/544: getdents d9/dd/de/d2d/d2e/d73/d77 0 2024-02-19T19:07:35.100 INFO:tasks.workunit.client.1.smithi142.stdout:8/545: truncate d9/dd/f68 104512 0 2024-02-19T19:07:35.101 INFO:tasks.workunit.client.1.smithi142.stdout:8/546: truncate d9/dd/de/d2d/d2e/d73/d77/f67 495253 0 2024-02-19T19:07:35.101 INFO:tasks.workunit.client.1.smithi142.stdout:8/547: mkdir d9/dd/de/d14/d65/db1 0 2024-02-19T19:07:35.101 INFO:tasks.workunit.client.1.smithi142.stdout:9/568: dread db/d10/d22/f9e [0,4194304] 0 2024-02-19T19:07:35.102 INFO:tasks.workunit.client.1.smithi142.stdout:9/569: truncate db/d10/d22/d24/d41/f74 385386 0 2024-02-19T19:07:35.103 INFO:tasks.workunit.client.1.smithi142.stdout:9/570: chown db/d10/d22/d24/f25 10573583 1 2024-02-19T19:07:35.104 INFO:tasks.workunit.client.1.smithi142.stdout:9/571: link db/d10/c19 db/d10/d7d/ca0 0 2024-02-19T19:07:35.105 INFO:tasks.workunit.client.1.smithi142.stdout:4/596: write d4/d1d/d42/d66/d12/d79/fa3 [1605020,86984] 0 2024-02-19T19:07:35.105 INFO:tasks.workunit.client.1.smithi142.stdout:4/597: write d4/d1d/d42/fa8 [500176,50739] 0 2024-02-19T19:07:35.105 INFO:tasks.workunit.client.1.smithi142.stdout:4/598: write d4/d1c/f22 [4047513,129153] 0 2024-02-19T19:07:35.106 INFO:tasks.workunit.client.1.smithi142.stdout:0/439: dwrite d23/d28/f7a [0,4194304] 0 2024-02-19T19:07:35.106 INFO:tasks.workunit.client.1.smithi142.stdout:0/440: chown d23/d32 1109 1 2024-02-19T19:07:35.106 INFO:tasks.workunit.client.1.smithi142.stdout:3/652: dwrite d1d/d1e/d2e/d50/f93 [0,4194304] 0 2024-02-19T19:07:35.107 INFO:tasks.workunit.client.1.smithi142.stdout:7/436: dwrite d0/d1b/d21/f8d [0,4194304] 0 2024-02-19T19:07:35.107 INFO:tasks.workunit.client.1.smithi142.stdout:7/437: chown d0/d1b/d21/d24/d5e/f63 25692022 1 2024-02-19T19:07:35.107 INFO:tasks.workunit.client.1.smithi142.stdout:7/438: read d0/d1b/d21/d24/f28 [3482840,109361] 0 2024-02-19T19:07:35.107 INFO:tasks.workunit.client.1.smithi142.stdout:7/439: dread - d0/d1b/d21/d24/d5e/d65/f74 zero size 2024-02-19T19:07:35.113 INFO:tasks.workunit.client.1.smithi142.stdout:4/599: dread d4/d34/f97 [0,4194304] 0 2024-02-19T19:07:35.123 INFO:tasks.workunit.client.1.smithi142.stdout:0/441: rename d23/d28/d2d/f8e to d23/d28/d41/f91 0 2024-02-19T19:07:35.123 INFO:tasks.workunit.client.1.smithi142.stdout:0/442: fsync d23/d28/d2d/d51/f37 0 2024-02-19T19:07:35.123 INFO:tasks.workunit.client.1.smithi142.stdout:0/443: fdatasync d23/d32/f6a 0 2024-02-19T19:07:35.124 INFO:tasks.workunit.client.1.smithi142.stdout:0/444: write d23/f64 [1041914,19192] 0 2024-02-19T19:07:35.125 INFO:tasks.workunit.client.1.smithi142.stdout:8/548: dwrite d9/dd/d44/d79/f35 [0,4194304] 0 2024-02-19T19:07:35.127 INFO:tasks.workunit.client.1.smithi142.stdout:3/653: creat d1d/d1e/d2e/d50/d7c/da7/d3a/d62/d91/fd1 x:0 0 0 2024-02-19T19:07:35.127 INFO:tasks.workunit.client.1.smithi142.stdout:3/654: creat d1d/d1e/d2e/d50/d7c/da7/d3a/d62/da2/fd2 x:0 0 0 2024-02-19T19:07:35.131 INFO:tasks.workunit.client.1.smithi142.stdout:7/440: mknod d0/d1b/d21/d24/d5e/c8f 0 2024-02-19T19:07:35.131 INFO:tasks.workunit.client.1.smithi142.stdout:7/441: stat d0/d13/d72/f88 0 2024-02-19T19:07:35.131 INFO:tasks.workunit.client.1.smithi142.stdout:7/442: fdatasync d0/d13/d72/f33 0 2024-02-19T19:07:35.132 INFO:tasks.workunit.client.1.smithi142.stdout:4/600: symlink d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f/lc5 0 2024-02-19T19:07:35.133 INFO:tasks.workunit.client.1.smithi142.stdout:0/445: rename d23/d28/d2d/f48 to d23/d7d/f92 0 2024-02-19T19:07:35.133 INFO:tasks.workunit.client.1.smithi142.stdout:0/446: read d23/d28/d2d/f60 [29618,108236] 0 2024-02-19T19:07:35.138 INFO:tasks.workunit.client.1.smithi142.stdout:8/549: link d9/dd/de/f6f d9/dd/de/d14/d65/fb2 0 2024-02-19T19:07:35.138 INFO:tasks.workunit.client.1.smithi142.stdout:8/550: chown d9 809264 1 2024-02-19T19:07:35.138 INFO:tasks.workunit.client.1.smithi142.stdout:8/551: chown d9/dd/de/d14/f51 78 1 2024-02-19T19:07:35.138 INFO:tasks.workunit.client.1.smithi142.stdout:8/552: truncate d9/dd/de/f86 1042384 0 2024-02-19T19:07:35.139 INFO:tasks.workunit.client.1.smithi142.stdout:9/572: rmdir db/d10/d7d 39 2024-02-19T19:07:35.140 INFO:tasks.workunit.client.1.smithi142.stdout:3/655: truncate d1d/d1e/d2e/d50/f67 3688419 0 2024-02-19T19:07:35.141 INFO:tasks.workunit.client.1.smithi142.stdout:8/553: dread d9/dd/f1c [0,4194304] 0 2024-02-19T19:07:35.142 INFO:tasks.workunit.client.1.smithi142.stdout:4/601: symlink d4/d1d/d42/d66/d2c/lc6 0 2024-02-19T19:07:35.144 INFO:tasks.workunit.client.1.smithi142.stdout:3/656: read d1d/f41 [354048,94734] 0 2024-02-19T19:07:35.145 INFO:tasks.workunit.client.1.smithi142.stdout:7/443: rename d0/d13/d72/d47/d69/c5d to d0/d1b/d21/d24/d29/c90 0 2024-02-19T19:07:35.146 INFO:tasks.workunit.client.1.smithi142.stdout:4/602: mknod d4/d1d/d42/d66/dd/cc7 0 2024-02-19T19:07:35.147 INFO:tasks.workunit.client.1.smithi142.stdout:7/444: getdents d0/d1b 0 2024-02-19T19:07:35.148 INFO:tasks.workunit.client.1.smithi142.stdout:9/573: creat db/d10/d32/d91/fa1 x:0 0 0 2024-02-19T19:07:35.149 INFO:tasks.workunit.client.1.smithi142.stdout:4/603: symlink d4/d1d/d42/d66/d12/d2d/d2a/d84/lc8 0 2024-02-19T19:07:35.151 INFO:tasks.workunit.client.1.smithi142.stdout:4/604: symlink d4/d1d/d42/d66/dd/d10/d26/lc9 0 2024-02-19T19:07:35.151 INFO:tasks.workunit.client.1.smithi142.stdout:4/605: readlink d4/d1d/lad 0 2024-02-19T19:07:35.151 INFO:tasks.workunit.client.1.smithi142.stdout:4/606: creat d4/d1d/d42/d66/dd/d10/d26/d50/d54/fca x:0 0 0 2024-02-19T19:07:35.151 INFO:tasks.workunit.client.1.smithi142.stdout:2/471: sync 2024-02-19T19:07:35.151 INFO:tasks.workunit.client.1.smithi142.stdout:5/481: sync 2024-02-19T19:07:35.151 INFO:tasks.workunit.client.1.smithi142.stdout:5/482: stat d5/dd/d8/d31/f6e 0 2024-02-19T19:07:35.151 INFO:tasks.workunit.client.1.smithi142.stdout:2/472: fdatasync d3/d4d/f69 0 2024-02-19T19:07:35.152 INFO:tasks.workunit.client.1.smithi142.stdout:5/483: dread - d5/dd/df/d22/d41/d6f/f8b zero size 2024-02-19T19:07:35.152 INFO:tasks.workunit.client.1.smithi142.stdout:0/447: dwrite d23/d28/d41/f91 [0,4194304] 0 2024-02-19T19:07:35.152 INFO:tasks.workunit.client.1.smithi142.stdout:8/554: dread d9/dd/d44/d79/f69 [0,4194304] 0 2024-02-19T19:07:35.152 INFO:tasks.workunit.client.1.smithi142.stdout:9/574: mkdir db/da2 0 2024-02-19T19:07:35.152 INFO:tasks.workunit.client.1.smithi142.stdout:9/575: stat db/f2b 0 2024-02-19T19:07:35.152 INFO:tasks.workunit.client.1.smithi142.stdout:9/576: chown db/d10/d7d/l85 11 1 2024-02-19T19:07:35.154 INFO:tasks.workunit.client.1.smithi142.stdout:3/657: write d1d/d1e/d2e/d37/d6c/f7b [107048,107058] 0 2024-02-19T19:07:35.154 INFO:tasks.workunit.client.1.smithi142.stdout:3/658: dread - d1d/d1e/d2e/d50/d7c/da7/d52/d5a/f6d zero size 2024-02-19T19:07:35.155 INFO:tasks.workunit.client.1.smithi142.stdout:4/607: mkdir d4/d1c/dae/dcb 0 2024-02-19T19:07:35.155 INFO:tasks.workunit.client.1.smithi142.stdout:4/608: readlink d4/d1d/d42/d66/d12/d2d/d2a/d84/l93 0 2024-02-19T19:07:35.155 INFO:tasks.workunit.client.1.smithi142.stdout:4/609: truncate d4/d1d/d42/d66/dd/d10/d3e/d68/db4/fc3 53318 0 2024-02-19T19:07:35.156 INFO:tasks.workunit.client.1.smithi142.stdout:5/484: symlink d5/dd/df/d22/d80/la2 0 2024-02-19T19:07:35.156 INFO:tasks.workunit.client.1.smithi142.stdout:7/445: write d0/d13/d1e/d22/f57 [3111459,45339] 0 2024-02-19T19:07:35.157 INFO:tasks.workunit.client.1.smithi142.stdout:7/446: write d0/d1b/d21/d24/d29/d7e/f83 [336067,111006] 0 2024-02-19T19:07:35.157 INFO:tasks.workunit.client.1.smithi142.stdout:9/577: dread db/d10/d7d/f8f [0,4194304] 0 2024-02-19T19:07:35.161 INFO:tasks.workunit.client.1.smithi142.stdout:2/473: dread d3/d35/d53/f65 [0,4194304] 0 2024-02-19T19:07:35.161 INFO:tasks.workunit.client.1.smithi142.stdout:7/447: read d0/d13/d1e/d22/f78 [736753,56294] 0 2024-02-19T19:07:35.161 INFO:tasks.workunit.client.1.smithi142.stdout:7/448: truncate d0/d1b/d21/d24/d29/f7f 674231 0 2024-02-19T19:07:35.161 INFO:tasks.workunit.client.1.smithi142.stdout:8/555: rename d9/dd/de/d2d/d2e/d73/dae to d9/dd/de/d2d/d2e/db3 0 2024-02-19T19:07:35.163 INFO:tasks.workunit.client.1.smithi142.stdout:3/659: symlink d1d/d1e/d2e/ld3 0 2024-02-19T19:07:35.163 INFO:tasks.workunit.client.1.smithi142.stdout:3/660: creat d1d/d1e/d2e/d37/d6c/da9/fd4 x:0 0 0 2024-02-19T19:07:35.165 INFO:tasks.workunit.client.1.smithi142.stdout:9/578: dread db/d10/d22/d24/f25 [0,4194304] 0 2024-02-19T19:07:35.165 INFO:tasks.workunit.client.1.smithi142.stdout:4/610: link d4/d14/d31/dab/f60 d4/d1d/d42/d66/dd/d10/d3e/d68/fcc 0 2024-02-19T19:07:35.166 INFO:tasks.workunit.client.1.smithi142.stdout:1/668: sync 2024-02-19T19:07:35.167 INFO:tasks.workunit.client.1.smithi142.stdout:5/485: creat d5/dd/d8/d1c/fa3 x:0 0 0 2024-02-19T19:07:35.169 INFO:tasks.workunit.client.1.smithi142.stdout:4/611: fdatasync d4/d1d/d42/fa8 0 2024-02-19T19:07:35.171 INFO:tasks.workunit.client.1.smithi142.stdout:0/448: link d23/f3a d23/d28/f93 0 2024-02-19T19:07:35.172 INFO:tasks.workunit.client.1.smithi142.stdout:6/455: sync 2024-02-19T19:07:35.173 INFO:tasks.workunit.client.1.smithi142.stdout:6/456: dread - d2/d29/d47/f71 zero size 2024-02-19T19:07:35.173 INFO:tasks.workunit.client.1.smithi142.stdout:3/661: read d1d/d1e/d2e/d50/d7c/da7/d3a/d62/d91/fa5 [3947087,33854] 0 2024-02-19T19:07:35.173 INFO:tasks.workunit.client.1.smithi142.stdout:9/579: dread db/f16 [0,4194304] 0 2024-02-19T19:07:35.173 INFO:tasks.workunit.client.1.smithi142.stdout:2/474: mknod d3/db/d29/d6d/d59/c98 0 2024-02-19T19:07:35.175 INFO:tasks.workunit.client.1.smithi142.stdout:7/449: rename d0/f19 to d0/d1b/f91 0 2024-02-19T19:07:35.176 INFO:tasks.workunit.client.1.smithi142.stdout:7/450: fdatasync d0/d1b/d21/d24/d29/f6e 0 2024-02-19T19:07:35.176 INFO:tasks.workunit.client.1.smithi142.stdout:7/451: write d0/d1b/d21/d24/d29/d44/d49/f64 [4877638,74106] 0 2024-02-19T19:07:35.176 INFO:tasks.workunit.client.1.smithi142.stdout:7/452: chown d0/d1b/d21/d24/d29/d7e 5 1 2024-02-19T19:07:35.180 INFO:tasks.workunit.client.1.smithi142.stdout:5/486: mknod d5/dd/d8/d29/ca4 0 2024-02-19T19:07:35.182 INFO:tasks.workunit.client.1.smithi142.stdout:4/612: mkdir d4/d1d/d42/d66/d12/d2d/dcd 0 2024-02-19T19:07:35.184 INFO:tasks.workunit.client.1.smithi142.stdout:3/662: link d1d/d1e/d2e/d37/f4c d1d/d1e/dcd/fd5 0 2024-02-19T19:07:35.187 INFO:tasks.workunit.client.1.smithi142.stdout:2/475: creat d3/db/d29/d6d/d59/f99 x:0 0 0 2024-02-19T19:07:35.188 INFO:tasks.workunit.client.1.smithi142.stdout:7/453: dread d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:35.188 INFO:tasks.workunit.client.1.smithi142.stdout:7/454: readlink d0/d13/d72/d47/d69/l75 0 2024-02-19T19:07:35.188 INFO:tasks.workunit.client.1.smithi142.stdout:1/669: rename d5/d1a/d33/l44 to d5/d77/da9/lec 0 2024-02-19T19:07:35.188 INFO:tasks.workunit.client.1.smithi142.stdout:1/670: write d5/d7/d23/d2c/fd7 [1035561,73792] 0 2024-02-19T19:07:35.193 INFO:tasks.workunit.client.1.smithi142.stdout:2/476: mkdir d3/db/d29/d4c/d4e/d9a 0 2024-02-19T19:07:35.194 INFO:tasks.workunit.client.1.smithi142.stdout:6/457: rename d2/d17/d33/f5a to d2/d1f/d5c/f9a 0 2024-02-19T19:07:35.195 INFO:tasks.workunit.client.1.smithi142.stdout:1/671: symlink d5/d37/d6c/d75/led 0 2024-02-19T19:07:35.195 INFO:tasks.workunit.client.1.smithi142.stdout:1/672: fsync d5/f68 0 2024-02-19T19:07:35.196 INFO:tasks.workunit.client.1.smithi142.stdout:4/613: getdents d4/d1d/d42/d66/d12/d2d/d2a/d84 0 2024-02-19T19:07:35.197 INFO:tasks.workunit.client.1.smithi142.stdout:2/477: symlink d3/l9b 0 2024-02-19T19:07:35.197 INFO:tasks.workunit.client.1.smithi142.stdout:2/478: chown d3/db/d29/d4c/d4e/c5b 0 1 2024-02-19T19:07:35.198 INFO:tasks.workunit.client.1.smithi142.stdout:1/673: mknod d5/d37/d6c/d75/da2/cee 0 2024-02-19T19:07:35.198 INFO:tasks.workunit.client.1.smithi142.stdout:1/674: creat d5/d37/d6c/dd0/fef x:0 0 0 2024-02-19T19:07:35.199 INFO:tasks.workunit.client.1.smithi142.stdout:4/614: creat d4/d14/d31/d43/fce x:0 0 0 2024-02-19T19:07:35.199 INFO:tasks.workunit.client.1.smithi142.stdout:4/615: read d4/d14/d31/f7d [3872009,21045] 0 2024-02-19T19:07:35.200 INFO:tasks.workunit.client.1.smithi142.stdout:1/675: write d5/d1a/d33/f50 [692490,51930] 0 2024-02-19T19:07:35.201 INFO:tasks.workunit.client.1.smithi142.stdout:4/616: symlink d4/d1d/d42/lcf 0 2024-02-19T19:07:35.201 INFO:tasks.workunit.client.1.smithi142.stdout:4/617: fdatasync d4/d34/f51 0 2024-02-19T19:07:35.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:34 smithi142 ceph-mon[69118]: pgmap v79: 65 pgs: 8 active+clean+remapped, 1 peering, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 750 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 162 MiB/s rd, 196 MiB/s wr, 251 op/s; 5535/32751 objects degraded (16.900%); 1044/32751 objects misplaced (3.188%); 4.9 MiB/s, 78 objects/s recovering 2024-02-19T19:07:35.202 INFO:tasks.workunit.client.1.smithi142.stdout:9/580: dwrite db/d10/f15 [4194304,4194304] 0 2024-02-19T19:07:35.203 INFO:tasks.workunit.client.1.smithi142.stdout:9/581: symlink db/d10/d22/d81/la3 0 2024-02-19T19:07:35.203 INFO:tasks.workunit.client.1.smithi142.stdout:1/676: dread d5/d1a/d33/f4d [4194304,4194304] 0 2024-02-19T19:07:35.203 INFO:tasks.workunit.client.1.smithi142.stdout:1/677: fdatasync d5/d7/d23/d41/fcc 0 2024-02-19T19:07:35.208 INFO:tasks.workunit.client.1.smithi142.stdout:9/582: dread db/d10/d27/d2f/f94 [0,4194304] 0 2024-02-19T19:07:35.208 INFO:tasks.workunit.client.1.smithi142.stdout:9/583: getdents db/d10/d32/d3f/d5f 0 2024-02-19T19:07:35.208 INFO:tasks.workunit.client.1.smithi142.stdout:9/584: read db/d10/d22/d24/f92 [6220871,67092] 0 2024-02-19T19:07:35.209 INFO:tasks.workunit.client.1.smithi142.stdout:6/458: dread d2/d1f/d56/f6b [0,4194304] 0 2024-02-19T19:07:35.209 INFO:tasks.workunit.client.1.smithi142.stdout:9/585: read db/d10/d27/f6d [440586,19227] 0 2024-02-19T19:07:35.216 INFO:tasks.workunit.client.1.smithi142.stdout:1/678: write d5/d7/d4a/d53/d6a/faa [2492926,103934] 0 2024-02-19T19:07:35.218 INFO:tasks.workunit.client.1.smithi142.stdout:0/449: dwrite f17 [0,4194304] 0 2024-02-19T19:07:35.218 INFO:tasks.workunit.client.1.smithi142.stdout:0/450: stat d23/d28/d2d/d51/d44/d58/f76 0 2024-02-19T19:07:35.219 INFO:tasks.workunit.client.1.smithi142.stdout:8/556: getdents d9/dd/de/d2d/d2e/d73 0 2024-02-19T19:07:35.222 INFO:tasks.workunit.client.1.smithi142.stdout:0/451: mknod d23/d28/d2d/d54/d88/c94 0 2024-02-19T19:07:35.222 INFO:tasks.workunit.client.1.smithi142.stdout:8/557: mkdir d9/dd/de/db4 0 2024-02-19T19:07:35.222 INFO:tasks.workunit.client.1.smithi142.stdout:6/459: write d2/d1e/d35/d66/d8d/d3e/f58 [3980170,12464] 0 2024-02-19T19:07:35.222 INFO:tasks.workunit.client.1.smithi142.stdout:8/558: fdatasync d9/dd/de/d2d/d2e/d49/d50/d59/f7f 0 2024-02-19T19:07:35.223 INFO:tasks.workunit.client.1.smithi142.stdout:0/452: mknod d23/d28/d2d/d51/d44/c95 0 2024-02-19T19:07:35.224 INFO:tasks.workunit.client.1.smithi142.stdout:6/460: rmdir d2/d1f/d4d/d60/d87 39 2024-02-19T19:07:35.226 INFO:tasks.workunit.client.1.smithi142.stdout:8/559: rename d9/dd/d44/d79/l5f to d9/dd/de/d14/d65/db1/lb5 0 2024-02-19T19:07:35.228 INFO:tasks.workunit.client.1.smithi142.stdout:6/461: link d2/l16 d2/d1f/d5c/d63/l9b 0 2024-02-19T19:07:35.229 INFO:tasks.workunit.client.1.smithi142.stdout:3/663: dwrite d1d/d1e/d6e/f99 [0,4194304] 0 2024-02-19T19:07:35.229 INFO:tasks.workunit.client.1.smithi142.stdout:3/664: chown d1d/d1e/d2e/d50/d7c/da7/d52/d71 383 1 2024-02-19T19:07:35.231 INFO:tasks.workunit.client.1.smithi142.stdout:0/453: rename d23/d28/d2d/d51/f7e to d23/d32/d8a/f96 0 2024-02-19T19:07:35.231 INFO:tasks.workunit.client.1.smithi142.stdout:0/454: write d23/f31 [243104,41789] 0 2024-02-19T19:07:35.236 INFO:tasks.workunit.client.1.smithi142.stdout:5/487: dwrite d5/dd/df/d22/d41/d32/f84 [0,4194304] 0 2024-02-19T19:07:35.245 INFO:tasks.workunit.client.1.smithi142.stdout:6/462: symlink d2/d1f/d4d/d60/l9c 0 2024-02-19T19:07:35.247 INFO:tasks.workunit.client.1.smithi142.stdout:3/665: mknod d1d/d1e/d2e/d50/cd6 0 2024-02-19T19:07:35.248 INFO:tasks.workunit.client.1.smithi142.stdout:0/455: mknod d23/c97 0 2024-02-19T19:07:35.250 INFO:tasks.workunit.client.1.smithi142.stdout:3/666: symlink d1d/d1e/d2e/d37/d81/db7/ld7 0 2024-02-19T19:07:35.251 INFO:tasks.workunit.client.1.smithi142.stdout:3/667: rename d1d/d1e/d2e/d37/d6c/da9/fa6 to d1d/d1e/d2e/d50/d7c/da7/d3a/d62/dc1/fd8 0 2024-02-19T19:07:35.251 INFO:tasks.workunit.client.1.smithi142.stdout:3/668: write d1d/d1e/d2e/d50/d7c/da7/d3a/d62/da2/fd2 [1006236,29029] 0 2024-02-19T19:07:35.252 INFO:tasks.workunit.client.1.smithi142.stdout:3/669: getdents d1d/d1e/d2e/d50/d7c/da7/d3a/d57 0 2024-02-19T19:07:35.252 INFO:tasks.workunit.client.1.smithi142.stdout:3/670: chown f18 32462 1 2024-02-19T19:07:35.252 INFO:tasks.workunit.client.1.smithi142.stdout:3/671: write d1d/d1e/d2e/f48 [989781,12796] 0 2024-02-19T19:07:35.254 INFO:tasks.workunit.client.1.smithi142.stdout:4/618: dwrite d4/d1d/d42/d66/d12/d2d/d2a/fb8 [4194304,4194304] 0 2024-02-19T19:07:35.254 INFO:tasks.workunit.client.1.smithi142.stdout:4/619: chown d4/d1d/d42/d66/f8e 461 1 2024-02-19T19:07:35.255 INFO:tasks.workunit.client.1.smithi142.stdout:3/672: unlink d1d/d1e/d2e/d50/d7c/da7/d52/d5a/fab 0 2024-02-19T19:07:35.255 INFO:tasks.workunit.client.1.smithi142.stdout:3/673: dread - d1d/d1e/d2e/d50/d7c/da7/d52/f56 zero size 2024-02-19T19:07:35.256 INFO:tasks.workunit.client.1.smithi142.stdout:3/674: truncate d1d/d1e/d2e/d37/d6c/f7b 380155 0 2024-02-19T19:07:35.256 INFO:tasks.workunit.client.1.smithi142.stdout:3/675: write d1d/d1e/d2e/d50/d7c/da7/d52/d5a/f94 [838430,70944] 0 2024-02-19T19:07:35.258 INFO:tasks.workunit.client.1.smithi142.stdout:3/676: symlink d1d/d1e/d2e/d50/d7c/da7/d3a/d62/dc1/ld9 0 2024-02-19T19:07:35.258 INFO:tasks.workunit.client.1.smithi142.stdout:3/677: fdatasync d1d/d1e/f21 0 2024-02-19T19:07:35.259 INFO:tasks.workunit.client.1.smithi142.stdout:3/678: symlink d1d/d1e/d2e/d50/d7c/da7/d3a/d62/d91/lda 0 2024-02-19T19:07:35.259 INFO:tasks.workunit.client.1.smithi142.stdout:2/479: dwrite d3/db/d29/f41 [0,4194304] 0 2024-02-19T19:07:35.261 INFO:tasks.workunit.client.1.smithi142.stdout:3/679: rename d1d/d1e/d2e/d50/d7c/da7/d52/d5a/da4/fce to d1d/d1e/d2e/d50/d7c/da7/d52/d71/fdb 0 2024-02-19T19:07:35.261 INFO:tasks.workunit.client.1.smithi142.stdout:6/463: dread d2/d1f/d20/f52 [0,4194304] 0 2024-02-19T19:07:35.261 INFO:tasks.workunit.client.1.smithi142.stdout:2/480: rmdir d3/db/d29/d6d/d59/d64 39 2024-02-19T19:07:35.263 INFO:tasks.workunit.client.1.smithi142.stdout:1/679: dwrite d5/d7/d34/f66 [0,4194304] 0 2024-02-19T19:07:35.264 INFO:tasks.workunit.client.1.smithi142.stdout:9/586: dwrite db/f53 [0,4194304] 0 2024-02-19T19:07:35.270 INFO:tasks.workunit.client.1.smithi142.stdout:8/560: dwrite d9/dd/de/d14/d65/d6c/f3a [0,4194304] 0 2024-02-19T19:07:35.270 INFO:tasks.workunit.client.1.smithi142.stdout:8/561: dread - d9/dd/de/d2d/fa3 zero size 2024-02-19T19:07:35.277 INFO:tasks.workunit.client.1.smithi142.stdout:5/488: dwrite d5/dd/d5f/f81 [0,4194304] 0 2024-02-19T19:07:35.279 INFO:tasks.workunit.client.1.smithi142.stdout:9/587: dread db/d10/f4b [4194304,4194304] 0 2024-02-19T19:07:35.316 INFO:tasks.workunit.client.1.smithi142.stdout:4/620: dwrite d4/d34/f97 [4194304,4194304] 0 2024-02-19T19:07:35.317 INFO:tasks.workunit.client.1.smithi142.stdout:4/621: rmdir d4/d1d/d42/d66/dd/d10/d3e/dbd 0 2024-02-19T19:07:35.322 INFO:tasks.workunit.client.1.smithi142.stdout:4/622: stat d4/d14/d31/dab/da2/cbf 0 2024-02-19T19:07:35.322 INFO:tasks.workunit.client.1.smithi142.stdout:4/623: fdatasync d4/d14/d31/d43/fce 0 2024-02-19T19:07:35.324 INFO:tasks.workunit.client.1.smithi142.stdout:3/680: dwrite d1d/d1e/d2e/d50/f93 [0,4194304] 0 2024-02-19T19:07:35.324 INFO:tasks.workunit.client.1.smithi142.stdout:3/681: creat d1d/d1e/d2e/d50/d83/fdc x:0 0 0 2024-02-19T19:07:35.325 INFO:tasks.workunit.client.1.smithi142.stdout:8/562: dwrite d9/dd/f57 [0,4194304] 0 2024-02-19T19:07:35.328 INFO:tasks.workunit.client.1.smithi142.stdout:8/563: creat d9/da8/fb6 x:0 0 0 2024-02-19T19:07:35.329 INFO:tasks.workunit.client.1.smithi142.stdout:8/564: mkdir d9/dd/de/d2d/db7 0 2024-02-19T19:07:35.329 INFO:tasks.workunit.client.1.smithi142.stdout:8/565: write d9/dd/f1d [4241589,52472] 0 2024-02-19T19:07:35.334 INFO:tasks.workunit.client.1.smithi142.stdout:3/682: write d1d/f2b [3535998,109351] 0 2024-02-19T19:07:35.334 INFO:tasks.workunit.client.1.smithi142.stdout:3/683: write d1d/d1e/d2e/d37/d6c/da9/fd4 [814933,44381] 0 2024-02-19T19:07:35.336 INFO:tasks.workunit.client.1.smithi142.stdout:3/684: dread d1d/f9e [0,4194304] 0 2024-02-19T19:07:35.337 INFO:tasks.workunit.client.1.smithi142.stdout:1/680: dwrite d5/d7/d4a/d53/d6a/fa5 [0,4194304] 0 2024-02-19T19:07:35.337 INFO:tasks.workunit.client.1.smithi142.stdout:1/681: write d5/f68 [2591040,4035] 0 2024-02-19T19:07:35.342 INFO:tasks.workunit.client.1.smithi142.stdout:8/566: dread d9/dd/d44/d79/f39 [0,4194304] 0 2024-02-19T19:07:35.342 INFO:tasks.workunit.client.1.smithi142.stdout:8/567: chown d9/dd/de/d14/d65/d6c/da7 174163 1 2024-02-19T19:07:35.342 INFO:tasks.workunit.client.1.smithi142.stdout:8/568: write d9/dd/de/d2d/d2e/d73/d77/f67 [1517499,27711] 0 2024-02-19T19:07:35.348 INFO:tasks.workunit.client.1.smithi142.stdout:2/481: dwrite d3/db/d29/d6d/d59/f99 [0,4194304] 0 2024-02-19T19:07:35.348 INFO:tasks.workunit.client.1.smithi142.stdout:5/489: dwrite d5/dd/df/d22/d41/d32/f62 [0,4194304] 0 2024-02-19T19:07:35.349 INFO:tasks.workunit.client.1.smithi142.stdout:1/682: read d5/d1a/f3a [1049534,119874] 0 2024-02-19T19:07:35.349 INFO:tasks.workunit.client.1.smithi142.stdout:1/683: truncate d5/d7/d23/dab/fdf 951948 0 2024-02-19T19:07:35.349 INFO:tasks.workunit.client.1.smithi142.stdout:1/684: dread - d5/d37/d6c/d75/da2/fe9 zero size 2024-02-19T19:07:35.350 INFO:tasks.workunit.client.1.smithi142.stdout:9/588: dwrite db/d10/f1c [0,4194304] 0 2024-02-19T19:07:35.351 INFO:tasks.workunit.client.1.smithi142.stdout:5/490: creat d5/dd/d8/d2a/fa5 x:0 0 0 2024-02-19T19:07:35.351 INFO:tasks.workunit.client.1.smithi142.stdout:5/491: creat d5/dd/d8/d1c/d8a/fa6 x:0 0 0 2024-02-19T19:07:35.352 INFO:tasks.workunit.client.1.smithi142.stdout:2/482: symlink d3/d4d/d5f/l9c 0 2024-02-19T19:07:35.354 INFO:tasks.workunit.client.1.smithi142.stdout:1/685: rename d5/d7/d23/dab/fd1 to d5/d1a/d59/ff0 0 2024-02-19T19:07:35.356 INFO:tasks.workunit.client.1.smithi142.stdout:4/624: dwrite d4/d1d/d42/d66/d12/f18 [0,4194304] 0 2024-02-19T19:07:35.360 INFO:tasks.workunit.client.1.smithi142.stdout:3/685: dwrite d1d/d1e/d2e/d50/d7c/da7/d3a/d62/da2/fd2 [0,4194304] 0 2024-02-19T19:07:35.360 INFO:tasks.workunit.client.1.smithi142.stdout:3/686: chown d1d/c25 325420 1 2024-02-19T19:07:35.360 INFO:tasks.workunit.client.1.smithi142.stdout:3/687: chown f1c 12144 1 2024-02-19T19:07:35.360 INFO:tasks.workunit.client.1.smithi142.stdout:8/569: dwrite d9/dd/de/d2d/d2e/d49/d50/d59/f7f [0,4194304] 0 2024-02-19T19:07:35.361 INFO:tasks.workunit.client.1.smithi142.stdout:9/589: rename db/d10/d7d/ca0 to db/d10/d7d/ca4 0 2024-02-19T19:07:35.361 INFO:tasks.workunit.client.1.smithi142.stdout:9/590: dread - db/d10/d27/d2f/f5d zero size 2024-02-19T19:07:35.363 INFO:tasks.workunit.client.1.smithi142.stdout:5/492: symlink d5/dd/d8/d31/la7 0 2024-02-19T19:07:35.363 INFO:tasks.workunit.client.1.smithi142.stdout:5/493: chown d5/dd/d8/d2a/f4e 51874 1 2024-02-19T19:07:35.364 INFO:tasks.workunit.client.1.smithi142.stdout:2/483: mkdir d3/db/d29/d4c/d4e/d9a/d9d 0 2024-02-19T19:07:35.364 INFO:tasks.workunit.client.1.smithi142.stdout:2/484: chown d3/d4d/c8b 3603495 1 2024-02-19T19:07:35.366 INFO:tasks.workunit.client.1.smithi142.stdout:1/686: creat d5/ff1 x:0 0 0 2024-02-19T19:07:35.366 INFO:tasks.workunit.client.1.smithi142.stdout:1/687: fsync d5/d7/d23/d2c/f3b 0 2024-02-19T19:07:35.368 INFO:tasks.workunit.client.1.smithi142.stdout:4/625: unlink d4/d1d/d42/d66/d2c/c37 0 2024-02-19T19:07:35.368 INFO:tasks.workunit.client.1.smithi142.stdout:4/626: fsync d4/d1d/d42/d66/dd/d10/d3e/d68/fcc 0 2024-02-19T19:07:35.369 INFO:tasks.workunit.client.1.smithi142.stdout:9/591: write db/d10/d27/d2f/d4c/d54/d83/f8a [2316682,74897] 0 2024-02-19T19:07:35.375 INFO:tasks.workunit.client.1.smithi142.stdout:8/570: creat d9/dd/de/d2d/d2e/d49/d50/d59/d8a/fb8 x:0 0 0 2024-02-19T19:07:35.375 INFO:tasks.workunit.client.1.smithi142.stdout:8/571: fsync d9/dd/d44/d79/f39 0 2024-02-19T19:07:35.375 INFO:tasks.workunit.client.1.smithi142.stdout:8/572: chown d9/dd/c41 1 1 2024-02-19T19:07:35.375 INFO:tasks.workunit.client.1.smithi142.stdout:3/688: dwrite d1d/d1e/d2e/d37/f4c [0,4194304] 0 2024-02-19T19:07:35.376 INFO:tasks.workunit.client.1.smithi142.stdout:4/627: dread d4/d14/f16 [0,4194304] 0 2024-02-19T19:07:35.377 INFO:tasks.workunit.client.1.smithi142.stdout:4/628: fsync d4/d1d/d42/d66/f8e 0 2024-02-19T19:07:35.377 INFO:tasks.workunit.client.1.smithi142.stdout:4/629: stat d4/d14/d31/dab/d6e 0 2024-02-19T19:07:35.377 INFO:tasks.workunit.client.1.smithi142.stdout:4/630: read d4/d14/d31/f7d [3305921,84856] 0 2024-02-19T19:07:35.377 INFO:tasks.workunit.client.1.smithi142.stdout:5/494: creat d5/dd/df/d22/d41/d32/fa8 x:0 0 0 2024-02-19T19:07:35.378 INFO:tasks.workunit.client.1.smithi142.stdout:5/495: dread d5/dd/df/d22/f37 [0,4194304] 0 2024-02-19T19:07:35.378 INFO:tasks.workunit.client.1.smithi142.stdout:2/485: link d3/d4d/d5f/d7c/f7e d3/f9e 0 2024-02-19T19:07:35.379 INFO:tasks.workunit.client.1.smithi142.stdout:1/688: creat d5/d7/d23/da4/ff2 x:0 0 0 2024-02-19T19:07:35.380 INFO:tasks.workunit.client.1.smithi142.stdout:9/592: rmdir db/d10/d32/d3f/d5f 39 2024-02-19T19:07:35.381 INFO:tasks.workunit.client.1.smithi142.stdout:9/593: chown db/d10/d22/f50 8618087 1 2024-02-19T19:07:35.384 INFO:tasks.workunit.client.1.smithi142.stdout:2/486: write d3/db/f3a [2339702,9999] 0 2024-02-19T19:07:35.384 INFO:tasks.workunit.client.1.smithi142.stdout:7/455: sync 2024-02-19T19:07:35.386 INFO:tasks.workunit.client.1.smithi142.stdout:3/689: dread d1d/d1e/d2e/d50/d7c/da7/f95 [0,4194304] 0 2024-02-19T19:07:35.387 INFO:tasks.workunit.client.1.smithi142.stdout:4/631: creat d4/d1d/d42/d66/d12/d2d/d2a/d84/fd0 x:0 0 0 2024-02-19T19:07:35.387 INFO:tasks.workunit.client.1.smithi142.stdout:7/456: write d0/d1b/d21/d24/d29/d44/f55 [422464,127956] 0 2024-02-19T19:07:35.387 INFO:tasks.workunit.client.1.smithi142.stdout:7/457: readlink d0/d13/d72/d47/d69/l75 0 2024-02-19T19:07:35.388 INFO:tasks.workunit.client.1.smithi142.stdout:7/458: fsync d0/d1b/d21/f4c 0 2024-02-19T19:07:35.388 INFO:tasks.workunit.client.1.smithi142.stdout:5/496: write d5/dd/df/f6b [1584667,37186] 0 2024-02-19T19:07:35.388 INFO:tasks.workunit.client.1.smithi142.stdout:1/689: symlink d5/d7/d4a/d53/lf3 0 2024-02-19T19:07:35.390 INFO:tasks.workunit.client.1.smithi142.stdout:9/594: symlink db/d10/d27/d2f/d4c/la5 0 2024-02-19T19:07:35.392 INFO:tasks.workunit.client.1.smithi142.stdout:3/690: mkdir d1d/d1e/d2e/d50/d7c/da7/d52/d71/ddd 0 2024-02-19T19:07:35.397 INFO:tasks.workunit.client.1.smithi142.stdout:4/632: rename d4/d1d/d42/fbc to d4/d1d/d42/d66/d5f/fd1 0 2024-02-19T19:07:35.398 INFO:tasks.workunit.client.1.smithi142.stdout:1/690: creat d5/d77/da9/ff4 x:0 0 0 2024-02-19T19:07:35.398 INFO:tasks.workunit.client.1.smithi142.stdout:1/691: creat d5/d37/d6c/ff5 x:0 0 0 2024-02-19T19:07:35.401 INFO:tasks.workunit.client.1.smithi142.stdout:5/497: dread d5/dd/df/f6b [0,4194304] 0 2024-02-19T19:07:35.401 INFO:tasks.workunit.client.1.smithi142.stdout:3/691: symlink d1d/d1e/d2e/d37/d81/db7/lde 0 2024-02-19T19:07:35.401 INFO:tasks.workunit.client.1.smithi142.stdout:4/633: mkdir d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba/dd2 0 2024-02-19T19:07:35.402 INFO:tasks.workunit.client.1.smithi142.stdout:7/459: write d0/d1b/f5a [3580845,21086] 0 2024-02-19T19:07:35.404 INFO:tasks.workunit.client.1.smithi142.stdout:5/498: symlink d5/dd/d8/d1c/la9 0 2024-02-19T19:07:35.404 INFO:tasks.workunit.client.1.smithi142.stdout:2/487: dwrite d3/f1f [0,4194304] 0 2024-02-19T19:07:35.408 INFO:tasks.workunit.client.1.smithi142.stdout:7/460: rename d0/d1b/d21/d24/l4d to d0/d1b/l92 0 2024-02-19T19:07:35.408 INFO:tasks.workunit.client.1.smithi142.stdout:7/461: fsync d0/d13/f27 0 2024-02-19T19:07:35.408 INFO:tasks.workunit.client.1.smithi142.stdout:0/456: sync 2024-02-19T19:07:35.410 INFO:tasks.workunit.client.1.smithi142.stdout:5/499: truncate d5/dd/d5f/f81 528439 0 2024-02-19T19:07:35.410 INFO:tasks.workunit.client.1.smithi142.stdout:5/500: chown d5/dd/df/d22/d41/d32/f35 252 1 2024-02-19T19:07:35.411 INFO:tasks.workunit.client.1.smithi142.stdout:2/488: mkdir d3/d4d/d9f 0 2024-02-19T19:07:35.411 INFO:tasks.workunit.client.1.smithi142.stdout:3/692: write d1d/d1e/d2e/d50/d7c/da7/d3a/d57/f59 [2983688,2370] 0 2024-02-19T19:07:35.412 INFO:tasks.workunit.client.1.smithi142.stdout:3/693: write d1d/d1e/d2e/d37/d6c/da9/fc4 [732550,88334] 0 2024-02-19T19:07:35.414 INFO:tasks.workunit.client.1.smithi142.stdout:7/462: rename d0/d1b/d21/d24/c53 to d0/d62/c93 0 2024-02-19T19:07:35.416 INFO:tasks.workunit.client.1.smithi142.stdout:5/501: link d5/dd/df/d22/f37 d5/dd/d8/d2a/d93/faa 0 2024-02-19T19:07:35.417 INFO:tasks.workunit.client.1.smithi142.stdout:7/463: mknod d0/d1b/d21/d24/d29/d44/d49/d8b/c94 0 2024-02-19T19:07:35.419 INFO:tasks.workunit.client.1.smithi142.stdout:0/457: rename le to d23/d28/l98 0 2024-02-19T19:07:35.419 INFO:tasks.workunit.client.1.smithi142.stdout:0/458: chown d23/d32/l90 89832407 1 2024-02-19T19:07:35.419 INFO:tasks.workunit.client.1.smithi142.stdout:0/459: fsync d23/d28/d2d/d51/d44/f89 0 2024-02-19T19:07:35.419 INFO:tasks.workunit.client.1.smithi142.stdout:0/460: fsync d23/f3a 0 2024-02-19T19:07:35.420 INFO:tasks.workunit.client.1.smithi142.stdout:0/461: read - d23/d86/f8b zero size 2024-02-19T19:07:35.421 INFO:tasks.workunit.client.1.smithi142.stdout:7/464: creat d0/d1b/d21/d24/d29/d44/d49/f95 x:0 0 0 2024-02-19T19:07:35.422 INFO:tasks.workunit.client.1.smithi142.stdout:2/489: write d3/df/f10 [237369,125893] 0 2024-02-19T19:07:35.422 INFO:tasks.workunit.client.1.smithi142.stdout:5/502: rename d5/dd/d8/l21 to d5/dd/d5f/d6a/lab 0 2024-02-19T19:07:35.422 INFO:tasks.workunit.client.1.smithi142.stdout:5/503: chown d5/dd/df/d22/d80/la2 2 1 2024-02-19T19:07:35.423 INFO:tasks.workunit.client.1.smithi142.stdout:0/462: getdents d23/d28/d41/d78 0 2024-02-19T19:07:35.423 INFO:tasks.workunit.client.1.smithi142.stdout:0/463: dread - d23/d28/d2d/d51/d44/f89 zero size 2024-02-19T19:07:35.424 INFO:tasks.workunit.client.1.smithi142.stdout:5/504: symlink d5/dd/d8/d1c/lac 0 2024-02-19T19:07:35.424 INFO:tasks.workunit.client.1.smithi142.stdout:5/505: chown d5/f24 8876 1 2024-02-19T19:07:35.426 INFO:tasks.workunit.client.1.smithi142.stdout:5/506: rename d5/dd/df/d22/d41/d6f/f8b to d5/dd/df/d22/d41/d32/fad 0 2024-02-19T19:07:35.426 INFO:tasks.workunit.client.1.smithi142.stdout:5/507: fdatasync d5/dd/df/d22/d41/d32/f39 0 2024-02-19T19:07:35.426 INFO:tasks.workunit.client.1.smithi142.stdout:5/508: fsync d5/dd/df/d22/d41/d32/f84 0 2024-02-19T19:07:35.427 INFO:tasks.workunit.client.1.smithi142.stdout:5/509: mknod d5/dd/df/d22/d80/cae 0 2024-02-19T19:07:35.427 INFO:tasks.workunit.client.1.smithi142.stdout:6/464: sync 2024-02-19T19:07:35.428 INFO:tasks.workunit.client.1.smithi142.stdout:1/692: dwrite d5/d7/d34/f62 [0,4194304] 0 2024-02-19T19:07:35.428 INFO:tasks.workunit.client.1.smithi142.stdout:4/634: dwrite d4/d14/d31/d43/f48 [4194304,4194304] 0 2024-02-19T19:07:35.432 INFO:tasks.workunit.client.1.smithi142.stdout:9/595: dwrite db/d10/d22/d24/f92 [4194304,4194304] 0 2024-02-19T19:07:35.433 INFO:tasks.workunit.client.1.smithi142.stdout:4/635: link d4/d34/d44/c72 d4/d14/d31/dab/d6e/cd3 0 2024-02-19T19:07:35.433 INFO:tasks.workunit.client.1.smithi142.stdout:0/464: dread f1a [0,4194304] 0 2024-02-19T19:07:35.437 INFO:tasks.workunit.client.1.smithi142.stdout:4/636: unlink d4/d1d/d42/d66/dd/c76 0 2024-02-19T19:07:35.437 INFO:tasks.workunit.client.1.smithi142.stdout:4/637: truncate d4/d1d/d42/d66/dd/d10/d3e/d68/d87/f9e 910126 0 2024-02-19T19:07:35.437 INFO:tasks.workunit.client.1.smithi142.stdout:4/638: chown d4/d1d/d42/d66/dd/d10/d26/d50/d54 2029 1 2024-02-19T19:07:35.441 INFO:tasks.workunit.client.1.smithi142.stdout:1/693: dread d5/d7/f11 [0,4194304] 0 2024-02-19T19:07:35.449 INFO:tasks.workunit.client.1.smithi142.stdout:6/465: write d2/d1f/d56/f6b [5665651,21306] 0 2024-02-19T19:07:35.449 INFO:tasks.workunit.client.1.smithi142.stdout:6/466: readlink d2/d1f/l79 0 2024-02-19T19:07:35.449 INFO:tasks.workunit.client.1.smithi142.stdout:6/467: write d2/d1e/d35/d66/d8d/f50 [5106461,15792] 0 2024-02-19T19:07:35.449 INFO:tasks.workunit.client.1.smithi142.stdout:6/468: fsync d2/d17/f19 0 2024-02-19T19:07:35.449 INFO:tasks.workunit.client.1.smithi142.stdout:6/469: write d2/d1f/d56/f8e [41526,114122] 0 2024-02-19T19:07:35.457 INFO:tasks.workunit.client.1.smithi142.stdout:2/490: dwrite d3/d4d/f90 [0,4194304] 0 2024-02-19T19:07:35.457 INFO:tasks.workunit.client.1.smithi142.stdout:2/491: stat d3/db/f79 0 2024-02-19T19:07:35.460 INFO:tasks.workunit.client.1.smithi142.stdout:2/492: mknod d3/d35/ca0 0 2024-02-19T19:07:35.460 INFO:tasks.workunit.client.1.smithi142.stdout:2/493: symlink d3/d4d/d9f/la1 0 2024-02-19T19:07:35.461 INFO:tasks.workunit.client.1.smithi142.stdout:2/494: mknod d3/d35/ca2 0 2024-02-19T19:07:35.467 INFO:tasks.workunit.client.1.smithi142.stdout:5/510: dwrite d5/dd/df/d22/d41/d32/fad [0,4194304] 0 2024-02-19T19:07:35.468 INFO:tasks.workunit.client.1.smithi142.stdout:6/470: dread d2/d1f/d20/f25 [0,4194304] 0 2024-02-19T19:07:35.468 INFO:tasks.workunit.client.1.smithi142.stdout:6/471: fsync d2/d1f/d20/f2c 0 2024-02-19T19:07:35.469 INFO:tasks.workunit.client.1.smithi142.stdout:5/511: rmdir d5/dd/df/d15/d5b 39 2024-02-19T19:07:35.470 INFO:tasks.workunit.client.1.smithi142.stdout:9/596: dwrite db/d10/d22/d24/d41/f9b [0,4194304] 0 2024-02-19T19:07:35.470 INFO:tasks.workunit.client.1.smithi142.stdout:6/472: symlink d2/d29/l9d 0 2024-02-19T19:07:35.470 INFO:tasks.workunit.client.1.smithi142.stdout:4/639: dwrite d4/d1c/fc1 [0,4194304] 0 2024-02-19T19:07:35.471 INFO:tasks.workunit.client.1.smithi142.stdout:1/694: dwrite d5/d7/d4a/d53/fb3 [0,4194304] 0 2024-02-19T19:07:35.474 INFO:tasks.workunit.client.1.smithi142.stdout:9/597: fsync db/d10/d32/f76 0 2024-02-19T19:07:35.477 INFO:tasks.workunit.client.1.smithi142.stdout:6/473: mknod d2/d1e/d35/d66/c9e 0 2024-02-19T19:07:35.477 INFO:tasks.workunit.client.1.smithi142.stdout:6/474: fsync d2/d29/f94 0 2024-02-19T19:07:35.481 INFO:tasks.workunit.client.1.smithi142.stdout:5/512: read d5/dd/f1e [3560091,24938] 0 2024-02-19T19:07:35.481 INFO:tasks.workunit.client.1.smithi142.stdout:2/495: dwrite d3/d4d/d5f/d7c/f7e [0,4194304] 0 2024-02-19T19:07:35.481 INFO:tasks.workunit.client.1.smithi142.stdout:2/496: chown d3/d35/d53 77291107 1 2024-02-19T19:07:35.481 INFO:tasks.workunit.client.1.smithi142.stdout:2/497: read d3/d35/d53/f65 [176033,9840] 0 2024-02-19T19:07:35.483 INFO:tasks.workunit.client.1.smithi142.stdout:4/640: symlink d4/d1d/d42/d66/dd/d10/d26/ld4 0 2024-02-19T19:07:35.483 INFO:tasks.workunit.client.1.smithi142.stdout:4/641: fdatasync d4/d1d/d42/d66/d12/d2d/d2a/fb8 0 2024-02-19T19:07:35.487 INFO:tasks.workunit.client.1.smithi142.stdout:1/695: dwrite d5/d7/d23/d2c/f3c [0,4194304] 0 2024-02-19T19:07:35.488 INFO:tasks.workunit.client.1.smithi142.stdout:9/598: symlink db/d8e/la6 0 2024-02-19T19:07:35.490 INFO:tasks.workunit.client.1.smithi142.stdout:6/475: creat d2/d1e/d35/d66/d8d/d3e/d8c/f9f x:0 0 0 2024-02-19T19:07:35.490 INFO:tasks.workunit.client.1.smithi142.stdout:6/476: dread - d2/d29/f94 zero size 2024-02-19T19:07:35.493 INFO:tasks.workunit.client.1.smithi142.stdout:5/513: creat d5/dd/df/da0/faf x:0 0 0 2024-02-19T19:07:35.493 INFO:tasks.workunit.client.1.smithi142.stdout:2/498: mknod d3/d4b/ca3 0 2024-02-19T19:07:35.494 INFO:tasks.workunit.client.1.smithi142.stdout:4/642: creat d4/d14/d31/dab/da2/db3/fd5 x:0 0 0 2024-02-19T19:07:35.494 INFO:tasks.workunit.client.1.smithi142.stdout:4/643: write d4/d34/f51 [836848,56516] 0 2024-02-19T19:07:35.495 INFO:tasks.workunit.client.1.smithi142.stdout:1/696: dread d5/d7/d34/f62 [0,4194304] 0 2024-02-19T19:07:35.500 INFO:tasks.workunit.client.1.smithi142.stdout:5/514: creat d5/dd/df/d15/d5b/fb0 x:0 0 0 2024-02-19T19:07:35.501 INFO:tasks.workunit.client.1.smithi142.stdout:2/499: mkdir d3/df/da4 0 2024-02-19T19:07:35.501 INFO:tasks.workunit.client.1.smithi142.stdout:2/500: truncate d3/db/d29/d4c/d4a/f75 1259823 0 2024-02-19T19:07:35.502 INFO:tasks.workunit.client.1.smithi142.stdout:1/697: creat d5/d7/d23/d2c/dbc/ff6 x:0 0 0 2024-02-19T19:07:35.503 INFO:tasks.workunit.client.1.smithi142.stdout:6/477: dwrite d2/d29/d47/f68 [0,4194304] 0 2024-02-19T19:07:35.504 INFO:tasks.workunit.client.1.smithi142.stdout:9/599: rmdir db/d10/d27/d2f/d4c 39 2024-02-19T19:07:35.504 INFO:tasks.workunit.client.1.smithi142.stdout:9/600: rename db/d10/d22/d24 to db/d10/d22/d24/d3d/d89/da7 22 2024-02-19T19:07:35.505 INFO:tasks.workunit.client.1.smithi142.stdout:5/515: creat d5/dd/df/d15/fb1 x:0 0 0 2024-02-19T19:07:35.505 INFO:tasks.workunit.client.1.smithi142.stdout:5/516: readlink d5/dd/d8/d1c/lac 0 2024-02-19T19:07:35.506 INFO:tasks.workunit.client.1.smithi142.stdout:2/501: getdents d3/d4d/d81 0 2024-02-19T19:07:35.507 INFO:tasks.workunit.client.1.smithi142.stdout:4/644: mknod d4/cd6 0 2024-02-19T19:07:35.508 INFO:tasks.workunit.client.1.smithi142.stdout:5/517: dread d5/dd/d5f/f85 [0,4194304] 0 2024-02-19T19:07:35.508 INFO:tasks.workunit.client.1.smithi142.stdout:1/698: creat d5/d7/d23/d41/dc7/ff7 x:0 0 0 2024-02-19T19:07:35.508 INFO:tasks.workunit.client.1.smithi142.stdout:1/699: truncate d5/d37/d6c/d75/fc2 243968 0 2024-02-19T19:07:35.511 INFO:tasks.workunit.client.1.smithi142.stdout:6/478: creat d2/d1f/d4d/fa0 x:0 0 0 2024-02-19T19:07:35.511 INFO:tasks.workunit.client.1.smithi142.stdout:6/479: dread - d2/d1f/d4d/fa0 zero size 2024-02-19T19:07:35.511 INFO:tasks.workunit.client.1.smithi142.stdout:6/480: readlink d2/d1f/d20/d31/d62/l6a 0 2024-02-19T19:07:35.511 INFO:tasks.workunit.client.1.smithi142.stdout:9/601: write db/f61 [3683710,69888] 0 2024-02-19T19:07:35.512 INFO:tasks.workunit.client.1.smithi142.stdout:2/502: creat d3/db/d29/d4c/d4e/fa5 x:0 0 0 2024-02-19T19:07:35.512 INFO:tasks.workunit.client.1.smithi142.stdout:6/481: write d2/d1e/d35/d66/d8d/d3e/f46 [500247,56778] 0 2024-02-19T19:07:35.513 INFO:tasks.workunit.client.1.smithi142.stdout:4/645: creat d4/d1d/d42/d66/d12/d79/d8c/fd7 x:0 0 0 2024-02-19T19:07:35.513 INFO:tasks.workunit.client.1.smithi142.stdout:9/602: fsync db/f61 0 2024-02-19T19:07:35.514 INFO:tasks.workunit.client.1.smithi142.stdout:2/503: dread d3/d35/f48 [0,4194304] 0 2024-02-19T19:07:35.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/518: rmdir d5/dd/d8/d31 39 2024-02-19T19:07:35.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/519: dread - d5/dd/df/d15/d5b/f79 zero size 2024-02-19T19:07:35.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/520: readlink d5/dd/d8/d31/la7 0 2024-02-19T19:07:35.514 INFO:tasks.workunit.client.1.smithi142.stdout:5/521: stat d5/dd/df/f59 0 2024-02-19T19:07:35.515 INFO:tasks.workunit.client.1.smithi142.stdout:1/700: mknod d5/d7/d4a/d53/d6a/cf8 0 2024-02-19T19:07:35.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/504: dread d3/df/f10 [0,4194304] 0 2024-02-19T19:07:35.517 INFO:tasks.workunit.client.1.smithi142.stdout:6/482: unlink d2/d1f/l97 0 2024-02-19T19:07:35.518 INFO:tasks.workunit.client.1.smithi142.stdout:6/483: fdatasync d2/d17/f19 0 2024-02-19T19:07:35.522 INFO:tasks.workunit.client.1.smithi142.stdout:9/603: link db/f16 db/d10/d32/d3f/d5f/fa8 0 2024-02-19T19:07:35.522 INFO:tasks.workunit.client.1.smithi142.stdout:9/604: fdatasync db/d10/d32/f7f 0 2024-02-19T19:07:35.522 INFO:tasks.workunit.client.1.smithi142.stdout:1/701: mkdir d5/d77/da9/dae/deb/df9 0 2024-02-19T19:07:35.523 INFO:tasks.workunit.client.1.smithi142.stdout:2/505: truncate d3/db/d29/d6d/d59/f99 4141092 0 2024-02-19T19:07:35.523 INFO:tasks.workunit.client.1.smithi142.stdout:2/506: read d3/d68/f87 [162524,101878] 0 2024-02-19T19:07:35.524 INFO:tasks.workunit.client.1.smithi142.stdout:4/646: rmdir d4/d1d/d42/d66/d12/d2d/d2a 39 2024-02-19T19:07:35.524 INFO:tasks.workunit.client.1.smithi142.stdout:4/647: chown d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f/lc5 26 1 2024-02-19T19:07:35.525 INFO:tasks.workunit.client.1.smithi142.stdout:9/605: rmdir db/d10/d22/d24/d41 39 2024-02-19T19:07:35.525 INFO:tasks.workunit.client.1.smithi142.stdout:9/606: chown db/f61 1 1 2024-02-19T19:07:35.526 INFO:tasks.workunit.client.1.smithi142.stdout:1/702: creat d5/d77/da9/dae/deb/ffa x:0 0 0 2024-02-19T19:07:35.526 INFO:tasks.workunit.client.1.smithi142.stdout:1/703: chown d5/d7/d23/d2c/c58 0 1 2024-02-19T19:07:35.527 INFO:tasks.workunit.client.1.smithi142.stdout:5/522: dwrite d5/dd/d5f/f65 [0,4194304] 0 2024-02-19T19:07:35.527 INFO:tasks.workunit.client.1.smithi142.stdout:5/523: stat d5/dd/df/d22/d41/d6f 0 2024-02-19T19:07:35.528 INFO:tasks.workunit.client.1.smithi142.stdout:4/648: unlink d4/d1d/d42/d66/d12/d2d/c23 0 2024-02-19T19:07:35.529 INFO:tasks.workunit.client.1.smithi142.stdout:1/704: creat d5/d1a/ffb x:0 0 0 2024-02-19T19:07:35.529 INFO:tasks.workunit.client.1.smithi142.stdout:1/705: write d5/ff1 [538778,99491] 0 2024-02-19T19:07:35.530 INFO:tasks.workunit.client.1.smithi142.stdout:5/524: mknod d5/dd/d8/d2a/d93/cb2 0 2024-02-19T19:07:35.532 INFO:tasks.workunit.client.1.smithi142.stdout:6/484: dwrite d2/d1e/d35/d66/f7c [4194304,4194304] 0 2024-02-19T19:07:35.543 INFO:tasks.workunit.client.1.smithi142.stdout:6/485: unlink d2/d29/c59 0 2024-02-19T19:07:35.544 INFO:tasks.workunit.client.1.smithi142.stdout:6/486: chown d2/d17/f7a 114366 1 2024-02-19T19:07:35.547 INFO:tasks.workunit.client.1.smithi142.stdout:6/487: rename d2/d17/f24 to d2/d1f/d5c/d63/fa1 0 2024-02-19T19:07:35.552 INFO:tasks.workunit.client.1.smithi142.stdout:6/488: write d2/d1f/d5c/d63/fa1 [36963,80387] 0 2024-02-19T19:07:35.581 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:35 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[106707]: 2024-02-19T19:07:35.250+0000 7ff927cba7c0 -1 Falling back to public interface 2024-02-19T19:07:35.593 INFO:tasks.workunit.client.1.smithi142.stdout:5/525: dwrite d5/dd/d8/d2a/f4e [0,4194304] 0 2024-02-19T19:07:35.596 INFO:tasks.workunit.client.1.smithi142.stdout:5/526: creat d5/fb3 x:0 0 0 2024-02-19T19:07:35.604 INFO:tasks.workunit.client.1.smithi142.stdout:4/649: dwrite d4/d34/f51 [0,4194304] 0 2024-02-19T19:07:35.605 INFO:tasks.workunit.client.1.smithi142.stdout:1/706: dwrite d5/d7/d4a/d53/fc3 [4194304,4194304] 0 2024-02-19T19:07:35.605 INFO:tasks.workunit.client.1.smithi142.stdout:1/707: dread - d5/d7/d23/dab/fbd zero size 2024-02-19T19:07:35.609 INFO:tasks.workunit.client.1.smithi142.stdout:5/527: write d5/dd/df/d22/d41/d32/f84 [3175071,52880] 0 2024-02-19T19:07:35.609 INFO:tasks.workunit.client.1.smithi142.stdout:1/708: symlink d5/d7/d23/lfc 0 2024-02-19T19:07:35.612 INFO:tasks.workunit.client.1.smithi142.stdout:5/528: mkdir d5/dd/df/d22/d80/db4 0 2024-02-19T19:07:35.613 INFO:tasks.workunit.client.1.smithi142.stdout:8/573: sync 2024-02-19T19:07:35.613 INFO:tasks.workunit.client.1.smithi142.stdout:3/694: sync 2024-02-19T19:07:35.613 INFO:tasks.workunit.client.1.smithi142.stdout:8/574: chown d9/f46 15859335 1 2024-02-19T19:07:35.615 INFO:tasks.workunit.client.1.smithi142.stdout:6/489: getdents d2/d1f/d5c/d63 0 2024-02-19T19:07:35.616 INFO:tasks.workunit.client.1.smithi142.stdout:6/490: dread - d2/d17/d33/d39/f86 zero size 2024-02-19T19:07:35.616 INFO:tasks.workunit.client.1.smithi142.stdout:6/491: fdatasync d2/d1f/d20/f2c 0 2024-02-19T19:07:35.617 INFO:tasks.workunit.client.1.smithi142.stdout:6/492: mkdir d2/d17/d33/d42/da2 0 2024-02-19T19:07:35.618 INFO:tasks.workunit.client.1.smithi142.stdout:4/650: dwrite d4/d1c/fb5 [0,4194304] 0 2024-02-19T19:07:35.618 INFO:tasks.workunit.client.1.smithi142.stdout:4/651: chown d4/d1d/d42/d66/d12/d2d/d2a/d84/fbb 611155 1 2024-02-19T19:07:35.618 INFO:tasks.workunit.client.1.smithi142.stdout:4/652: readlink d4/d1d/d42/d66/dd/d10/d26/d50/d54/l58 0 2024-02-19T19:07:35.620 INFO:tasks.workunit.client.1.smithi142.stdout:6/493: unlink d2/f12 0 2024-02-19T19:07:35.624 INFO:tasks.workunit.client.1.smithi142.stdout:8/575: dread d9/dd/d15/d31/f55 [0,4194304] 0 2024-02-19T19:07:35.624 INFO:tasks.workunit.client.1.smithi142.stdout:6/494: link d2/d17/d33/f83 d2/d1f/d4d/fa3 0 2024-02-19T19:07:35.624 INFO:tasks.workunit.client.1.smithi142.stdout:6/495: chown d2/d17 758221 1 2024-02-19T19:07:35.624 INFO:tasks.workunit.client.1.smithi142.stdout:6/496: stat d2/d1e/d35/d66/d8d/d89 0 2024-02-19T19:07:35.625 INFO:tasks.workunit.client.1.smithi142.stdout:8/576: truncate d9/dd/d44/d79/f69 50316 0 2024-02-19T19:07:35.626 INFO:tasks.workunit.client.1.smithi142.stdout:6/497: symlink d2/d17/d33/d42/da2/la4 0 2024-02-19T19:07:35.627 INFO:tasks.workunit.client.1.smithi142.stdout:6/498: chown d2/d17/d33/d39 1 1 2024-02-19T19:07:35.627 INFO:tasks.workunit.client.1.smithi142.stdout:6/499: fdatasync d2/d1f/f30 0 2024-02-19T19:07:35.627 INFO:tasks.workunit.client.1.smithi142.stdout:7/465: sync 2024-02-19T19:07:35.627 INFO:tasks.workunit.client.1.smithi142.stdout:0/465: sync 2024-02-19T19:07:35.627 INFO:tasks.workunit.client.1.smithi142.stdout:1/709: dwrite d5/ff [0,4194304] 0 2024-02-19T19:07:35.628 INFO:tasks.workunit.client.1.smithi142.stdout:8/577: mknod d9/dd/de/d2d/d2e/d49/cb9 0 2024-02-19T19:07:35.629 INFO:tasks.workunit.client.1.smithi142.stdout:7/466: rmdir d0/d1b/d21/d24/d29/d44/d49/d8b 39 2024-02-19T19:07:35.631 INFO:tasks.workunit.client.1.smithi142.stdout:1/710: mkdir d5/d77/da9/dae/db2/dfd 0 2024-02-19T19:07:35.631 INFO:tasks.workunit.client.1.smithi142.stdout:8/578: creat d9/dd/de/d14/fba x:0 0 0 2024-02-19T19:07:35.632 INFO:tasks.workunit.client.1.smithi142.stdout:7/467: rename d0/d1b/d21/d24/d29/d44/f8c to d0/d13/d1e/f96 0 2024-02-19T19:07:35.632 INFO:tasks.workunit.client.1.smithi142.stdout:7/468: dread - d0/d1b/f59 zero size 2024-02-19T19:07:35.632 INFO:tasks.workunit.client.1.smithi142.stdout:7/469: chown d0/d1b/d21/d24/d29/d44/d49/d8b 29 1 2024-02-19T19:07:35.632 INFO:tasks.workunit.client.1.smithi142.stdout:7/470: truncate d0/d1b/d21/d24/f30 5126811 0 2024-02-19T19:07:35.633 INFO:tasks.workunit.client.1.smithi142.stdout:4/653: dread d4/d34/f51 [0,4194304] 0 2024-02-19T19:07:35.633 INFO:tasks.workunit.client.1.smithi142.stdout:4/654: chown d4 63727194 1 2024-02-19T19:07:35.633 INFO:tasks.workunit.client.1.smithi142.stdout:4/655: write d4/d1d/d42/d66/dd/d10/d3e/d68/db4/fc3 [369782,45706] 0 2024-02-19T19:07:35.633 INFO:tasks.workunit.client.1.smithi142.stdout:4/656: chown d4/d1d/d42/d66/d5f 1 1 2024-02-19T19:07:35.633 INFO:tasks.workunit.client.1.smithi142.stdout:8/579: rename d9/dd/f17 to d9/dd/d15/d31/fbb 0 2024-02-19T19:07:35.633 INFO:tasks.workunit.client.1.smithi142.stdout:7/471: creat d0/d1b/d21/d24/d29/d44/d49/d8b/f97 x:0 0 0 2024-02-19T19:07:35.635 INFO:tasks.workunit.client.1.smithi142.stdout:4/657: creat d4/d1d/d42/d66/dd/d10/fd8 x:0 0 0 2024-02-19T19:07:35.636 INFO:tasks.workunit.client.1.smithi142.stdout:8/580: symlink d9/dd/de/db4/lbc 0 2024-02-19T19:07:35.637 INFO:tasks.workunit.client.1.smithi142.stdout:4/658: creat d4/d1d/d42/d66/dd/d10/d3e/d68/fd9 x:0 0 0 2024-02-19T19:07:35.639 INFO:tasks.workunit.client.1.smithi142.stdout:4/659: creat d4/d1d/d42/d66/d12/d2d/fda x:0 0 0 2024-02-19T19:07:35.641 INFO:tasks.workunit.client.1.smithi142.stdout:0/466: dread d23/d28/f7a [0,4194304] 0 2024-02-19T19:07:35.643 INFO:tasks.workunit.client.1.smithi142.stdout:0/467: creat d23/d7d/f99 x:0 0 0 2024-02-19T19:07:35.646 INFO:tasks.workunit.client.1.smithi142.stdout:5/529: dwrite d5/dd/df/d15/fb1 [0,4194304] 0 2024-02-19T19:07:35.647 INFO:tasks.workunit.client.1.smithi142.stdout:6/500: dwrite d2/d17/d33/d39/f49 [0,4194304] 0 2024-02-19T19:07:35.648 INFO:tasks.workunit.client.1.smithi142.stdout:8/581: dread d9/dd/f5c [0,4194304] 0 2024-02-19T19:07:35.648 INFO:tasks.workunit.client.1.smithi142.stdout:8/582: creat d9/da8/fbd x:0 0 0 2024-02-19T19:07:35.649 INFO:tasks.workunit.client.1.smithi142.stdout:0/468: creat d23/d32/d8a/f9a x:0 0 0 2024-02-19T19:07:35.651 INFO:tasks.workunit.client.1.smithi142.stdout:4/660: write d4/d14/d31/d43/f5d [3959290,106555] 0 2024-02-19T19:07:35.654 INFO:tasks.workunit.client.1.smithi142.stdout:8/583: mkdir d9/dd/de/d2d/d2e/d49/d50/d59/d97/dbe 0 2024-02-19T19:07:35.655 INFO:tasks.workunit.client.1.smithi142.stdout:0/469: mknod d23/d28/d2d/d51/d44/c9b 0 2024-02-19T19:07:35.656 INFO:tasks.workunit.client.1.smithi142.stdout:4/661: mknod d4/d1d/d42/d66/dd/d10/d3b/cdb 0 2024-02-19T19:07:35.656 INFO:tasks.workunit.client.1.smithi142.stdout:8/584: rmdir d9/dd/de/d2d/d2e/d73 39 2024-02-19T19:07:35.658 INFO:tasks.workunit.client.1.smithi142.stdout:5/530: read d5/f2c [6138210,42467] 0 2024-02-19T19:07:35.659 INFO:tasks.workunit.client.1.smithi142.stdout:4/662: creat d4/d1d/d42/d66/d12/d2d/d2a/d84/fdc x:0 0 0 2024-02-19T19:07:35.660 INFO:tasks.workunit.client.1.smithi142.stdout:8/585: link d9/dd/de/d14/d65/l7c d9/dd/de/d14/d65/d94/lbf 0 2024-02-19T19:07:35.661 INFO:tasks.workunit.client.1.smithi142.stdout:0/470: getdents d23/d32 0 2024-02-19T19:07:35.661 INFO:tasks.workunit.client.1.smithi142.stdout:0/471: chown d23/d32/l5c 4007 1 2024-02-19T19:07:35.664 INFO:tasks.workunit.client.1.smithi142.stdout:7/472: dwrite d0/d1b/d21/d24/d29/f6e [0,4194304] 0 2024-02-19T19:07:35.664 INFO:tasks.workunit.client.1.smithi142.stdout:7/473: chown d0/d13/d72/d47 944193049 1 2024-02-19T19:07:35.665 INFO:tasks.workunit.client.1.smithi142.stdout:5/531: rename d5/dd/d8/d31/d4d/d75/l92 to d5/dd/df/d22/lb5 0 2024-02-19T19:07:35.665 INFO:tasks.workunit.client.1.smithi142.stdout:5/532: fdatasync d5/dd/df/f59 0 2024-02-19T19:07:35.665 INFO:tasks.workunit.client.1.smithi142.stdout:5/533: write d5/dd/df/d22/d41/d32/fa8 [113459,54766] 0 2024-02-19T19:07:35.666 INFO:tasks.workunit.client.1.smithi142.stdout:6/501: dwrite d2/f9 [0,4194304] 0 2024-02-19T19:07:35.667 INFO:tasks.workunit.client.1.smithi142.stdout:4/663: mkdir d4/d1d/d42/d66/dd/d10/d3b/ddd 0 2024-02-19T19:07:35.667 INFO:tasks.workunit.client.1.smithi142.stdout:4/664: chown d4/d1d/d42/d66/dd/d10/d3b/ddd 193 1 2024-02-19T19:07:35.667 INFO:tasks.workunit.client.1.smithi142.stdout:7/474: dread d0/d1b/d21/d24/d29/d44/f55 [0,4194304] 0 2024-02-19T19:07:35.670 INFO:tasks.workunit.client.1.smithi142.stdout:8/586: dread d9/dd/de/d2d/d2e/d49/f70 [0,4194304] 0 2024-02-19T19:07:35.672 INFO:tasks.workunit.client.1.smithi142.stdout:7/475: getdents d0/d13/d72/d47 0 2024-02-19T19:07:35.673 INFO:tasks.workunit.client.1.smithi142.stdout:5/534: dread d5/dd/f1e [0,4194304] 0 2024-02-19T19:07:35.675 INFO:tasks.workunit.client.1.smithi142.stdout:6/502: dread d2/d1f/d5c/d63/fa1 [0,4194304] 0 2024-02-19T19:07:35.677 INFO:tasks.workunit.client.1.smithi142.stdout:0/472: dwrite d23/d28/d41/f91 [0,4194304] 0 2024-02-19T19:07:35.677 INFO:tasks.workunit.client.1.smithi142.stdout:4/665: dread d4/d1c/f22 [0,4194304] 0 2024-02-19T19:07:35.677 INFO:tasks.workunit.client.1.smithi142.stdout:0/473: truncate d23/d28/d41/f69 255078 0 2024-02-19T19:07:35.679 INFO:tasks.workunit.client.1.smithi142.stdout:8/587: mknod d9/da8/cc0 0 2024-02-19T19:07:35.680 INFO:tasks.workunit.client.1.smithi142.stdout:7/476: creat d0/d13/d72/d47/d69/f98 x:0 0 0 2024-02-19T19:07:35.681 INFO:tasks.workunit.client.1.smithi142.stdout:5/535: symlink d5/dd/df/lb6 0 2024-02-19T19:07:35.689 INFO:tasks.workunit.client.1.smithi142.stdout:5/536: link l2 d5/dd/d8/d29/lb7 0 2024-02-19T19:07:35.689 INFO:tasks.workunit.client.1.smithi142.stdout:5/537: truncate d5/dd/d8/d31/f6e 263767 0 2024-02-19T19:07:35.691 INFO:tasks.workunit.client.1.smithi142.stdout:6/503: dwrite d2/f9 [0,4194304] 0 2024-02-19T19:07:35.691 INFO:tasks.workunit.client.1.smithi142.stdout:6/504: chown d2/d1f/f2b 13381953 1 2024-02-19T19:07:35.691 INFO:tasks.workunit.client.1.smithi142.stdout:6/505: creat d2/d1e/d35/d66/fa5 x:0 0 0 2024-02-19T19:07:35.692 INFO:tasks.workunit.client.1.smithi142.stdout:0/474: rename d23/d28/l6f to d23/d28/d2d/d54/d85/l9c 0 2024-02-19T19:07:35.695 INFO:tasks.workunit.client.1.smithi142.stdout:7/477: rename d0/d13/d72/d47/d69/c79 to d0/d1b/d21/d24/d5e/c99 0 2024-02-19T19:07:35.695 INFO:tasks.workunit.client.1.smithi142.stdout:7/478: stat d0/d1b/d21/d24/d29/l2f 0 2024-02-19T19:07:35.699 INFO:tasks.workunit.client.1.smithi142.stdout:7/479: mknod d0/d13/d72/d47/d69/c9a 0 2024-02-19T19:07:35.701 INFO:tasks.workunit.client.1.smithi142.stdout:7/480: mkdir d0/d1b/d21/d24/d29/d44/d49/d9b 0 2024-02-19T19:07:35.706 INFO:tasks.workunit.client.1.smithi142.stdout:0/475: dread d23/f25 [0,4194304] 0 2024-02-19T19:07:35.706 INFO:tasks.workunit.client.1.smithi142.stdout:0/476: readlink d23/d28/d2d/d54/l63 0 2024-02-19T19:07:35.722 INFO:tasks.workunit.client.1.smithi142.stdout:5/538: dwrite d5/dd/d8/d31/d4d/d60/f7d [0,4194304] 0 2024-02-19T19:07:35.722 INFO:tasks.workunit.client.1.smithi142.stdout:5/539: readlink d5/dd/d8/l3f 0 2024-02-19T19:07:35.724 INFO:tasks.workunit.client.1.smithi142.stdout:5/540: rmdir d5/dd/d8/d31/d4d/d75 39 2024-02-19T19:07:35.725 INFO:tasks.workunit.client.1.smithi142.stdout:5/541: rename d5/l44 to d5/dd/df/d22/d41/d32/lb8 0 2024-02-19T19:07:35.726 INFO:tasks.workunit.client.1.smithi142.stdout:5/542: mkdir d5/dd/df/d22/db9 0 2024-02-19T19:07:35.735 INFO:tasks.workunit.client.1.smithi142.stdout:7/481: dwrite d0/d13/d1e/f5c [0,4194304] 0 2024-02-19T19:07:35.735 INFO:tasks.workunit.client.1.smithi142.stdout:7/482: dread - d0/d13/f70 zero size 2024-02-19T19:07:35.735 INFO:tasks.workunit.client.1.smithi142.stdout:7/483: chown d0/d1b/d21/d24/d29/d44/d49/d8b/f97 248 1 2024-02-19T19:07:35.735 INFO:tasks.workunit.client.1.smithi142.stdout:8/588: dwrite d9/dd/de/f24 [0,4194304] 0 2024-02-19T19:07:35.735 INFO:tasks.workunit.client.1.smithi142.stdout:6/506: dwrite d2/d17/f19 [4194304,4194304] 0 2024-02-19T19:07:35.735 INFO:tasks.workunit.client.1.smithi142.stdout:6/507: dread - d2/d17/d33/f83 zero size 2024-02-19T19:07:35.735 INFO:tasks.workunit.client.1.smithi142.stdout:0/477: dwrite d23/d32/f5b [0,4194304] 0 2024-02-19T19:07:35.735 INFO:tasks.workunit.client.1.smithi142.stdout:0/478: creat d23/d28/d41/f9d x:0 0 0 2024-02-19T19:07:35.735 INFO:tasks.workunit.client.1.smithi142.stdout:4/666: dwrite d4/d1d/d42/d66/dd/d10/d3e/d68/fcc [0,4194304] 0 2024-02-19T19:07:35.737 INFO:tasks.workunit.client.1.smithi142.stdout:7/484: dread d0/d1b/d21/f4c [0,4194304] 0 2024-02-19T19:07:35.740 INFO:tasks.workunit.client.1.smithi142.stdout:8/589: dread d9/dd/d15/d31/f55 [0,4194304] 0 2024-02-19T19:07:35.746 INFO:tasks.workunit.client.1.smithi142.stdout:6/508: write d2/d17/d33/d39/f49 [2285989,79020] 0 2024-02-19T19:07:35.747 INFO:tasks.workunit.client.1.smithi142.stdout:6/509: truncate d2/d17/d33/f83 514918 0 2024-02-19T19:07:35.747 INFO:tasks.workunit.client.1.smithi142.stdout:6/510: chown d2/d1f/d20/f2c 413031 1 2024-02-19T19:07:35.753 INFO:tasks.workunit.client.1.smithi142.stdout:0/479: unlink d23/d32/l90 0 2024-02-19T19:07:35.756 INFO:tasks.workunit.client.1.smithi142.stdout:7/485: rename d0/d1b/c67 to d0/d1b/d21/d24/d5e/c9c 0 2024-02-19T19:07:35.756 INFO:tasks.workunit.client.1.smithi142.stdout:7/486: write d0/d1b/d21/d24/d29/d44/d49/f95 [459487,72116] 0 2024-02-19T19:07:35.756 INFO:tasks.workunit.client.1.smithi142.stdout:6/511: dread d2/d1f/f2b [0,4194304] 0 2024-02-19T19:07:35.764 INFO:tasks.workunit.client.1.smithi142.stdout:1/711: sync 2024-02-19T19:07:35.764 INFO:tasks.workunit.client.1.smithi142.stdout:9/607: sync 2024-02-19T19:07:35.764 INFO:tasks.workunit.client.1.smithi142.stdout:2/507: sync 2024-02-19T19:07:35.764 INFO:tasks.workunit.client.1.smithi142.stdout:3/695: sync 2024-02-19T19:07:35.764 INFO:tasks.workunit.client.1.smithi142.stdout:1/712: readlink d5/d1a/d59/lb8 0 2024-02-19T19:07:35.764 INFO:tasks.workunit.client.1.smithi142.stdout:9/608: chown db/d10/d32/f7f 10 1 2024-02-19T19:07:35.764 INFO:tasks.workunit.client.1.smithi142.stdout:9/609: chown db/d10/d22/d24/l64 417709 1 2024-02-19T19:07:35.764 INFO:tasks.workunit.client.1.smithi142.stdout:1/713: creat d5/d37/d6c/d75/da2/ffe x:0 0 0 2024-02-19T19:07:35.764 INFO:tasks.workunit.client.1.smithi142.stdout:1/714: chown d5/d7/d4a/d53/fb3 1493946 1 2024-02-19T19:07:35.765 INFO:tasks.workunit.client.1.smithi142.stdout:1/715: getdents d5/d77/da9/dae/deb/df9 0 2024-02-19T19:07:35.765 INFO:tasks.workunit.client.1.smithi142.stdout:2/508: mknod d3/d4d/d5f/ca6 0 2024-02-19T19:07:35.767 INFO:tasks.workunit.client.1.smithi142.stdout:1/716: rename d5/d37/d6c/dd0/fef to d5/d7/d4a/d53/d6a/fff 0 2024-02-19T19:07:35.767 INFO:tasks.workunit.client.1.smithi142.stdout:7/487: write d0/d13/f15 [2988225,13358] 0 2024-02-19T19:07:35.767 INFO:tasks.workunit.client.1.smithi142.stdout:4/667: dwrite d4/d1c/f4b [0,4194304] 0 2024-02-19T19:07:35.767 INFO:tasks.workunit.client.1.smithi142.stdout:8/590: dwrite d9/dd/f68 [0,4194304] 0 2024-02-19T19:07:35.767 INFO:tasks.workunit.client.1.smithi142.stdout:8/591: stat d9/dd/de/d14/d65/c87 0 2024-02-19T19:07:35.767 INFO:tasks.workunit.client.1.smithi142.stdout:8/592: chown d9/dd/de/d2d/d2e/db3 3177 1 2024-02-19T19:07:35.768 INFO:tasks.workunit.client.1.smithi142.stdout:2/509: mknod d3/db/d29/d4c/d4e/d9a/ca7 0 2024-02-19T19:07:35.768 INFO:tasks.workunit.client.1.smithi142.stdout:6/512: dread d2/d1f/d5c/d63/fa1 [0,4194304] 0 2024-02-19T19:07:35.768 INFO:tasks.workunit.client.1.smithi142.stdout:6/513: creat d2/d17/d33/fa6 x:0 0 0 2024-02-19T19:07:35.772 INFO:tasks.workunit.client.1.smithi142.stdout:8/593: symlink d9/dd/de/d14/d65/d6c/da7/lc1 0 2024-02-19T19:07:35.779 INFO:tasks.workunit.client.1.smithi142.stdout:0/480: dwrite d23/d86/f8b [0,4194304] 0 2024-02-19T19:07:35.783 INFO:tasks.workunit.client.1.smithi142.stdout:3/696: write f18 [12080684,96275] 0 2024-02-19T19:07:35.783 INFO:tasks.workunit.client.1.smithi142.stdout:3/697: write d1d/d1e/d2e/d50/d7c/da7/f3d [10218262,23925] 0 2024-02-19T19:07:35.783 INFO:tasks.workunit.client.1.smithi142.stdout:3/698: dread - d1d/d1e/d2e/d50/d83/fae zero size 2024-02-19T19:07:35.784 INFO:tasks.workunit.client.1.smithi142.stdout:3/699: write d1d/d1e/d2e/f46 [191139,17862] 0 2024-02-19T19:07:35.784 INFO:tasks.workunit.client.1.smithi142.stdout:3/700: truncate d1d/d1e/dcd/fd5 8845363 0 2024-02-19T19:07:35.784 INFO:tasks.workunit.client.1.smithi142.stdout:8/594: write d9/dd/de/d2d/d2e/d49/d50/d59/f7f [3746929,127587] 0 2024-02-19T19:07:35.785 INFO:tasks.workunit.client.1.smithi142.stdout:4/668: rmdir d4/d1d/d42 39 2024-02-19T19:07:35.787 INFO:tasks.workunit.client.1.smithi142.stdout:2/510: rmdir d3/db/d29/d4c/d4e 39 2024-02-19T19:07:35.790 INFO:tasks.workunit.client.1.smithi142.stdout:0/481: dread d23/f3a [0,4194304] 0 2024-02-19T19:07:35.791 INFO:tasks.workunit.client.1.smithi142.stdout:6/514: rename d2/d17/d51 to d2/d17/d33/d42/da2/da7 0 2024-02-19T19:07:35.791 INFO:tasks.workunit.client.1.smithi142.stdout:6/515: write d2/d1f/f30 [4766065,3829] 0 2024-02-19T19:07:35.791 INFO:tasks.workunit.client.1.smithi142.stdout:6/516: write d2/d17/d33/d42/f74 [727235,127684] 0 2024-02-19T19:07:35.791 INFO:tasks.workunit.client.1.smithi142.stdout:2/511: link d3/db/d29/d4c/d4e/l6a d3/d4b/la8 0 2024-02-19T19:07:35.792 INFO:tasks.workunit.client.1.smithi142.stdout:0/482: write d23/d28/d2d/f3b [916849,113744] 0 2024-02-19T19:07:35.793 INFO:tasks.workunit.client.1.smithi142.stdout:3/701: rename d1d/d1e/d2e/d50/d7c/da7/d52/d71/f80 to d1d/d1e/d2e/d37/d81/dbc/fdf 0 2024-02-19T19:07:35.796 INFO:tasks.workunit.client.1.smithi142.stdout:0/483: getdents d23/d7d 0 2024-02-19T19:07:35.796 INFO:tasks.workunit.client.1.smithi142.stdout:0/484: readlink d23/d28/d2d/l7c 0 2024-02-19T19:07:35.800 INFO:tasks.workunit.client.1.smithi142.stdout:0/485: truncate d23/f64 348041 0 2024-02-19T19:07:35.800 INFO:tasks.workunit.client.1.smithi142.stdout:0/486: fdatasync d23/d28/d2d/d51/f71 0 2024-02-19T19:07:35.800 INFO:tasks.workunit.client.1.smithi142.stdout:9/610: dwrite db/d10/d22/d24/f92 [4194304,4194304] 0 2024-02-19T19:07:35.800 INFO:tasks.workunit.client.1.smithi142.stdout:9/611: fdatasync db/f18 0 2024-02-19T19:07:35.800 INFO:tasks.workunit.client.1.smithi142.stdout:8/595: write d9/dd/de/f6f [1006651,128081] 0 2024-02-19T19:07:35.802 INFO:tasks.workunit.client.1.smithi142.stdout:8/596: symlink d9/dd/de/d2d/d2e/d49/lc2 0 2024-02-19T19:07:35.802 INFO:tasks.workunit.client.1.smithi142.stdout:8/597: readlink d9/dd/de/d14/d65/d6c/da7/lc1 0 2024-02-19T19:07:35.802 INFO:tasks.workunit.client.1.smithi142.stdout:8/598: readlink d9/dd/d15/d31/l38 0 2024-02-19T19:07:35.803 INFO:tasks.workunit.client.1.smithi142.stdout:8/599: getdents d9/da8 0 2024-02-19T19:07:35.804 INFO:tasks.workunit.client.1.smithi142.stdout:8/600: mkdir d9/dd/de/d2d/d2e/d49/d50/d59/d97/dbe/dc3 0 2024-02-19T19:07:35.805 INFO:tasks.workunit.client.1.smithi142.stdout:8/601: read d9/dd/de/d2d/d2e/d73/d77/fa6 [337913,110866] 0 2024-02-19T19:07:35.807 INFO:tasks.workunit.client.1.smithi142.stdout:8/602: mknod d9/dd/de/d2d/d2e/d49/d74/cc4 0 2024-02-19T19:07:35.807 INFO:tasks.workunit.client.1.smithi142.stdout:8/603: readlink d9/l5a 0 2024-02-19T19:07:35.808 INFO:tasks.workunit.client.1.smithi142.stdout:8/604: mkdir d9/dd/d15/d31/d96/dc5 0 2024-02-19T19:07:35.816 INFO:tasks.workunit.client.1.smithi142.stdout:9/612: dwrite db/f84 [0,4194304] 0 2024-02-19T19:07:35.817 INFO:tasks.workunit.client.1.smithi142.stdout:9/613: stat db/d10/d27/d2f/d4c/d54/d83/f8a 0 2024-02-19T19:07:35.817 INFO:tasks.workunit.client.1.smithi142.stdout:9/614: fdatasync db/d10/d7d/f8f 0 2024-02-19T19:07:35.817 INFO:tasks.workunit.client.1.smithi142.stdout:8/605: dread d9/dd/f57 [0,4194304] 0 2024-02-19T19:07:35.817 INFO:tasks.workunit.client.1.smithi142.stdout:8/606: chown d9/dd/de/d14/d65/d6c/f3a 222 1 2024-02-19T19:07:35.817 INFO:tasks.workunit.client.1.smithi142.stdout:8/607: truncate d9/dd/de/d2d/d2e/f3d 4996674 0 2024-02-19T19:07:35.818 INFO:tasks.workunit.client.1.smithi142.stdout:9/615: truncate db/d10/d32/d3f/f63 51889 0 2024-02-19T19:07:35.821 INFO:tasks.workunit.client.1.smithi142.stdout:8/608: dread d9/dd/d15/d31/f55 [0,4194304] 0 2024-02-19T19:07:35.824 INFO:tasks.workunit.client.1.smithi142.stdout:8/609: dread d9/dd/de/d2d/d2e/d49/d50/d59/f7f [0,4194304] 0 2024-02-19T19:07:35.831 INFO:tasks.workunit.client.1.smithi142.stdout:1/717: dwrite d5/d7/d23/d2c/f6b [0,4194304] 0 2024-02-19T19:07:35.834 INFO:tasks.workunit.client.1.smithi142.stdout:1/718: dread d5/d73/f91 [0,4194304] 0 2024-02-19T19:07:35.834 INFO:tasks.workunit.client.1.smithi142.stdout:1/719: write d5/d37/d6c/fa0 [346258,109896] 0 2024-02-19T19:07:35.834 INFO:tasks.workunit.client.1.smithi142.stdout:1/720: write d5/d7/d4a/d53/fc3 [8760031,63445] 0 2024-02-19T19:07:35.839 INFO:tasks.workunit.client.1.smithi142.stdout:1/721: creat d5/d7/d34/f100 x:0 0 0 2024-02-19T19:07:35.840 INFO:tasks.workunit.client.1.smithi142.stdout:8/610: dwrite d9/dd/d44/d79/fab [0,4194304] 0 2024-02-19T19:07:35.840 INFO:tasks.workunit.client.1.smithi142.stdout:8/611: fsync d9/dd/de/d14/d65/f9e 0 2024-02-19T19:07:35.840 INFO:tasks.workunit.client.1.smithi142.stdout:8/612: chown d9/dd/de/l29 0 1 2024-02-19T19:07:35.841 INFO:tasks.workunit.client.1.smithi142.stdout:0/487: dread f16 [0,4194304] 0 2024-02-19T19:07:35.843 INFO:tasks.workunit.client.1.smithi142.stdout:1/722: dread d5/d7/d34/f7a [0,4194304] 0 2024-02-19T19:07:35.847 INFO:tasks.workunit.client.1.smithi142.stdout:8/613: symlink d9/dd/d15/lc6 0 2024-02-19T19:07:35.847 INFO:tasks.workunit.client.1.smithi142.stdout:8/614: truncate d9/dd/de/d2d/d2e/d49/d50/d59/d8a/fb8 787191 0 2024-02-19T19:07:35.847 INFO:tasks.workunit.client.1.smithi142.stdout:8/615: chown d9/dd/de/d14/d65/db1 322453817 1 2024-02-19T19:07:35.848 INFO:tasks.workunit.client.1.smithi142.stdout:0/488: truncate d23/d28/d41/f91 2678078 0 2024-02-19T19:07:35.849 INFO:tasks.workunit.client.1.smithi142.stdout:1/723: mknod d5/d7/d23/d2c/dbc/c101 0 2024-02-19T19:07:35.855 INFO:tasks.workunit.client.1.smithi142.stdout:3/702: dwrite d1d/d1e/d2e/d50/d7c/da7/d3a/d62/d91/fd1 [0,4194304] 0 2024-02-19T19:07:35.857 INFO:tasks.workunit.client.1.smithi142.stdout:3/703: getdents d1d/d1e/d2e/d50/d7c 0 2024-02-19T19:07:35.859 INFO:tasks.workunit.client.1.smithi142.stdout:1/724: dread d5/d1a/d33/f50 [0,4194304] 0 2024-02-19T19:07:35.860 INFO:tasks.workunit.client.1.smithi142.stdout:6/517: dwrite d2/d17/d33/f83 [0,4194304] 0 2024-02-19T19:07:35.860 INFO:tasks.workunit.client.1.smithi142.stdout:6/518: readlink d2/d1f/d20/l41 0 2024-02-19T19:07:35.860 INFO:tasks.workunit.client.1.smithi142.stdout:6/519: fsync d2/d29/d47/f68 0 2024-02-19T19:07:35.860 INFO:tasks.workunit.client.1.smithi142.stdout:6/520: chown d2/c1b 5616251 1 2024-02-19T19:07:35.860 INFO:tasks.workunit.client.1.smithi142.stdout:9/616: dwrite db/d10/f4b [4194304,4194304] 0 2024-02-19T19:07:35.860 INFO:tasks.workunit.client.1.smithi142.stdout:7/488: dwrite d0/d13/d72/f88 [0,4194304] 0 2024-02-19T19:07:35.861 INFO:tasks.workunit.client.1.smithi142.stdout:1/725: mknod d5/d37/d49/c102 0 2024-02-19T19:07:35.863 INFO:tasks.workunit.client.1.smithi142.stdout:9/617: dread db/d10/d32/f7f [0,4194304] 0 2024-02-19T19:07:35.863 INFO:tasks.workunit.client.1.smithi142.stdout:6/521: link d2/d29/d47/f71 d2/d1f/d20/d31/fa8 0 2024-02-19T19:07:35.863 INFO:tasks.workunit.client.1.smithi142.stdout:6/522: readlink d2/d1f/d4d/l99 0 2024-02-19T19:07:35.863 INFO:tasks.workunit.client.1.smithi142.stdout:6/523: chown d2/d1f/d20/l41 7391 1 2024-02-19T19:07:35.864 INFO:tasks.workunit.client.1.smithi142.stdout:0/489: dread d23/d32/d8a/f96 [0,4194304] 0 2024-02-19T19:07:35.864 INFO:tasks.workunit.client.1.smithi142.stdout:0/490: chown d23/d28/d2d/f79 239 1 2024-02-19T19:07:35.871 INFO:tasks.workunit.client.1.smithi142.stdout:8/616: truncate d9/dd/d44/d79/fab 1768732 0 2024-02-19T19:07:35.871 INFO:tasks.workunit.client.1.smithi142.stdout:1/726: dread d5/d7/d4a/d53/fc3 [4194304,4194304] 0 2024-02-19T19:07:35.871 INFO:tasks.workunit.client.1.smithi142.stdout:1/727: chown d5/d37/d6c/c95 607876 1 2024-02-19T19:07:35.871 INFO:tasks.workunit.client.1.smithi142.stdout:1/728: truncate d5/d7/d4a/d53/d6a/f9c 839983 0 2024-02-19T19:07:35.872 INFO:tasks.workunit.client.1.smithi142.stdout:8/617: dread d9/dd/de/d2d/d2e/d49/d74/f84 [0,4194304] 0 2024-02-19T19:07:35.874 INFO:tasks.workunit.client.1.smithi142.stdout:7/489: mkdir d0/d1b/d9d 0 2024-02-19T19:07:35.875 INFO:tasks.workunit.client.1.smithi142.stdout:6/524: mknod d2/d17/d33/d42/da2/da7/d55/ca9 0 2024-02-19T19:07:35.877 INFO:tasks.workunit.client.1.smithi142.stdout:0/491: getdents d23/d32 0 2024-02-19T19:07:35.877 INFO:tasks.workunit.client.1.smithi142.stdout:0/492: fdatasync f18 0 2024-02-19T19:07:35.879 INFO:tasks.workunit.client.1.smithi142.stdout:0/493: mkdir d23/d7d/d9e 0 2024-02-19T19:07:35.879 INFO:tasks.workunit.client.1.smithi142.stdout:0/494: fdatasync f13 0 2024-02-19T19:07:35.879 INFO:tasks.workunit.client.1.smithi142.stdout:0/495: write d23/f3d [254563,6761] 0 2024-02-19T19:07:35.879 INFO:tasks.workunit.client.1.smithi142.stdout:0/496: dread - d23/d32/f50 zero size 2024-02-19T19:07:35.880 INFO:tasks.workunit.client.1.smithi142.stdout:0/497: mkdir d23/d28/d2d/d54/d88/d9f 0 2024-02-19T19:07:35.881 INFO:tasks.workunit.client.1.smithi142.stdout:0/498: write d23/d32/d8a/f9a [425507,117875] 0 2024-02-19T19:07:35.882 INFO:tasks.workunit.client.1.smithi142.stdout:1/729: dread d5/ff [0,4194304] 0 2024-02-19T19:07:35.882 INFO:tasks.workunit.client.1.smithi142.stdout:1/730: stat d5/d77/da9/dae/deb/df9 0 2024-02-19T19:07:35.882 INFO:tasks.workunit.client.1.smithi142.stdout:3/704: dwrite d1d/d1e/d2e/d50/d7c/da7/d52/d71/fcf [0,4194304] 0 2024-02-19T19:07:35.882 INFO:tasks.workunit.client.1.smithi142.stdout:0/499: symlink d23/d7d/d9e/la0 0 2024-02-19T19:07:35.883 INFO:tasks.workunit.client.1.smithi142.stdout:1/731: mkdir d5/d7/d23/d41/d103 0 2024-02-19T19:07:35.884 INFO:tasks.workunit.client.1.smithi142.stdout:9/618: dwrite db/d10/d22/d24/f8b [0,4194304] 0 2024-02-19T19:07:35.884 INFO:tasks.workunit.client.1.smithi142.stdout:8/618: write d9/dd/de/f24 [1679652,36017] 0 2024-02-19T19:07:35.886 INFO:tasks.workunit.client.1.smithi142.stdout:3/705: truncate d1d/d1e/d2e/d50/d7c/da7/d52/f54 1285971 0 2024-02-19T19:07:35.887 INFO:tasks.workunit.client.1.smithi142.stdout:0/500: mknod d23/d28/d2d/d51/ca1 0 2024-02-19T19:07:35.889 INFO:tasks.workunit.client.1.smithi142.stdout:9/619: creat db/fa9 x:0 0 0 2024-02-19T19:07:35.889 INFO:tasks.workunit.client.1.smithi142.stdout:9/620: write db/f53 [4935231,67760] 0 2024-02-19T19:07:35.890 INFO:tasks.workunit.client.1.smithi142.stdout:0/501: dread d23/d28/d2d/f60 [0,4194304] 0 2024-02-19T19:07:35.890 INFO:tasks.workunit.client.1.smithi142.stdout:0/502: creat d23/d28/d41/fa2 x:0 0 0 2024-02-19T19:07:35.891 INFO:tasks.workunit.client.1.smithi142.stdout:8/619: unlink f2 0 2024-02-19T19:07:35.892 INFO:tasks.workunit.client.1.smithi142.stdout:8/620: chown d9/dd/de/d2d/d2e/d49/d58/f5b 1135394 1 2024-02-19T19:07:35.894 INFO:tasks.workunit.client.1.smithi142.stdout:1/732: dread d5/d7/d4a/d53/d6a/f65 [0,4194304] 0 2024-02-19T19:07:35.895 INFO:tasks.workunit.client.1.smithi142.stdout:0/503: symlink d23/d32/d8a/la3 0 2024-02-19T19:07:35.895 INFO:tasks.workunit.client.1.smithi142.stdout:0/504: dread - d23/d28/d41/fa2 zero size 2024-02-19T19:07:35.896 INFO:tasks.workunit.client.1.smithi142.stdout:8/621: symlink d9/dd/de/d2d/d2e/d49/d50/lc7 0 2024-02-19T19:07:35.897 INFO:tasks.workunit.client.1.smithi142.stdout:9/621: mknod db/d10/d32/d3f/caa 0 2024-02-19T19:07:35.898 INFO:tasks.workunit.client.1.smithi142.stdout:6/525: dwrite d2/d17/d33/d42/f74 [0,4194304] 0 2024-02-19T19:07:35.900 INFO:tasks.workunit.client.1.smithi142.stdout:1/733: link d5/d7/d34/d6f/cc5 d5/d77/da9/dae/deb/df9/c104 0 2024-02-19T19:07:35.900 INFO:tasks.workunit.client.1.smithi142.stdout:8/622: mknod d9/dd/de/d2d/d2e/db3/cc8 0 2024-02-19T19:07:35.900 INFO:tasks.workunit.client.1.smithi142.stdout:3/706: dwrite d1d/d1e/d2e/d50/d7c/da7/d52/d71/fdb [0,4194304] 0 2024-02-19T19:07:35.901 INFO:tasks.workunit.client.1.smithi142.stdout:6/526: dread d2/d1f/d20/d31/d62/f72 [0,4194304] 0 2024-02-19T19:07:35.901 INFO:tasks.workunit.client.1.smithi142.stdout:6/527: write d2/d1f/f30 [3758512,109067] 0 2024-02-19T19:07:35.901 INFO:tasks.workunit.client.1.smithi142.stdout:6/528: chown d2/d29/d47/f5b 6415928 1 2024-02-19T19:07:35.902 INFO:tasks.workunit.client.1.smithi142.stdout:5/543: sync 2024-02-19T19:07:35.902 INFO:tasks.workunit.client.1.smithi142.stdout:5/544: write d5/dd/df/d15/f7a [247775,45353] 0 2024-02-19T19:07:35.902 INFO:tasks.workunit.client.1.smithi142.stdout:5/545: dread - d5/dd/df/d15/d5b/f79 zero size 2024-02-19T19:07:35.907 INFO:tasks.workunit.client.1.smithi142.stdout:8/623: mknod d9/dd/de/d2d/d2e/d49/d58/cc9 0 2024-02-19T19:07:35.909 INFO:tasks.workunit.client.1.smithi142.stdout:9/622: dread db/d10/f4b [4194304,4194304] 0 2024-02-19T19:07:35.909 INFO:tasks.workunit.client.1.smithi142.stdout:9/623: write db/d10/d32/d3f/f75 [988662,107918] 0 2024-02-19T19:07:35.910 INFO:tasks.workunit.client.1.smithi142.stdout:3/707: creat d1d/d1e/d2e/d50/d7c/da7/d52/d71/dc0/fe0 x:0 0 0 2024-02-19T19:07:35.912 INFO:tasks.workunit.client.1.smithi142.stdout:0/505: dwrite d23/d28/d2d/f60 [0,4194304] 0 2024-02-19T19:07:35.914 INFO:tasks.workunit.client.1.smithi142.stdout:1/734: getdents d5/d37/d6c/d75/da7 0 2024-02-19T19:07:35.914 INFO:tasks.workunit.client.1.smithi142.stdout:6/529: link d2/f9 d2/d1f/d45/faa 0 2024-02-19T19:07:35.921 INFO:tasks.workunit.client.1.smithi142.stdout:9/624: dread db/d10/d27/f49 [0,4194304] 0 2024-02-19T19:07:35.921 INFO:tasks.workunit.client.1.smithi142.stdout:9/625: write db/d10/d32/d91/fa1 [354808,17270] 0 2024-02-19T19:07:35.921 INFO:tasks.workunit.client.1.smithi142.stdout:9/626: chown db/d10/d22/d24/d3d/d89 2049169 1 2024-02-19T19:07:35.921 INFO:tasks.workunit.client.1.smithi142.stdout:9/627: write db/d10/d27/f6d [749906,105467] 0 2024-02-19T19:07:35.925 INFO:tasks.workunit.client.1.smithi142.stdout:0/506: creat d23/d28/d2d/d54/d88/fa4 x:0 0 0 2024-02-19T19:07:35.929 INFO:tasks.workunit.client.1.smithi142.stdout:5/546: dwrite d5/dd/d8/d31/d4d/d60/f7d [0,4194304] 0 2024-02-19T19:07:35.929 INFO:tasks.workunit.client.1.smithi142.stdout:8/624: dwrite d9/dd/de/d14/f51 [0,4194304] 0 2024-02-19T19:07:35.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/628: mkdir db/d10/dab 0 2024-02-19T19:07:35.937 INFO:tasks.workunit.client.1.smithi142.stdout:1/735: dwrite d5/d7/d34/d6f/f88 [0,4194304] 0 2024-02-19T19:07:35.937 INFO:tasks.workunit.client.1.smithi142.stdout:1/736: chown d5/d7/d34/f66 374 1 2024-02-19T19:07:35.937 INFO:tasks.workunit.client.1.smithi142.stdout:1/737: fdatasync d5/d37/d6c/d75/da2/fd9 0 2024-02-19T19:07:35.937 INFO:tasks.workunit.client.1.smithi142.stdout:1/738: fsync d5/d7/d4a/d53/d6a/fd2 0 2024-02-19T19:07:35.938 INFO:tasks.workunit.client.1.smithi142.stdout:1/739: stat d5/d37/d6c/d75/da2 0 2024-02-19T19:07:35.938 INFO:tasks.workunit.client.1.smithi142.stdout:0/507: dread d23/d7d/f92 [0,4194304] 0 2024-02-19T19:07:35.938 INFO:tasks.workunit.client.1.smithi142.stdout:3/708: dwrite d1d/d1e/d2e/d50/d7c/da7/d3a/d57/f59 [0,4194304] 0 2024-02-19T19:07:35.938 INFO:tasks.workunit.client.1.smithi142.stdout:3/709: chown d1d/d1e/d6e/f6f 706829 1 2024-02-19T19:07:35.938 INFO:tasks.workunit.client.1.smithi142.stdout:3/710: creat d1d/d1e/d2e/d50/d7c/da7/d3a/d62/dc1/fe1 x:0 0 0 2024-02-19T19:07:35.940 INFO:tasks.workunit.client.1.smithi142.stdout:5/547: link d5/dd/df/d22/d41/d32/f84 d5/dd/df/d22/d80/fba 0 2024-02-19T19:07:35.944 INFO:tasks.workunit.client.1.smithi142.stdout:1/740: link d5/d7/d23/da4/cbe d5/d7/d23/d2c/c105 0 2024-02-19T19:07:35.945 INFO:tasks.workunit.client.1.smithi142.stdout:1/741: truncate d5/d37/f93 500397 0 2024-02-19T19:07:35.946 INFO:tasks.workunit.client.1.smithi142.stdout:6/530: truncate d2/d1f/f30 2279597 0 2024-02-19T19:07:35.946 INFO:tasks.workunit.client.1.smithi142.stdout:6/531: truncate d2/d1f/d4d/d60/d87/f8a 4897054 0 2024-02-19T19:07:35.948 INFO:tasks.workunit.client.1.smithi142.stdout:9/629: dwrite db/d10/f1c [0,4194304] 0 2024-02-19T19:07:35.951 INFO:tasks.workunit.client.1.smithi142.stdout:0/508: rename c1f to d23/d32/d8a/ca5 0 2024-02-19T19:07:35.951 INFO:tasks.workunit.client.1.smithi142.stdout:0/509: truncate d23/d32/f8f 371377 0 2024-02-19T19:07:35.954 INFO:tasks.workunit.client.1.smithi142.stdout:5/548: mkdir d5/dd/d95/dbb 0 2024-02-19T19:07:35.955 INFO:tasks.workunit.client.1.smithi142.stdout:1/742: symlink d5/d1a/d59/l106 0 2024-02-19T19:07:35.958 INFO:tasks.workunit.client.1.smithi142.stdout:3/711: link d1d/d1e/d2e/d50/d7c/da7/d52/d71/fcf d1d/d1e/d6e/fe2 0 2024-02-19T19:07:35.960 INFO:tasks.workunit.client.1.smithi142.stdout:5/549: mkdir d5/dd/d8/dbc 0 2024-02-19T19:07:35.960 INFO:tasks.workunit.client.1.smithi142.stdout:5/550: dread - d5/dd/df/da0/faf zero size 2024-02-19T19:07:35.964 INFO:tasks.workunit.client.1.smithi142.stdout:1/743: symlink d5/d1a/d33/dce/l107 0 2024-02-19T19:07:35.964 INFO:tasks.workunit.client.1.smithi142.stdout:1/744: creat d5/d77/f108 x:0 0 0 2024-02-19T19:07:35.965 INFO:tasks.workunit.client.1.smithi142.stdout:3/712: creat d1d/d1e/d2e/d50/d7c/fe3 x:0 0 0 2024-02-19T19:07:35.965 INFO:tasks.workunit.client.1.smithi142.stdout:3/713: fsync d1d/f35 0 2024-02-19T19:07:35.965 INFO:tasks.workunit.client.1.smithi142.stdout:9/630: dwrite db/d10/d32/d3f/f63 [0,4194304] 0 2024-02-19T19:07:35.965 INFO:tasks.workunit.client.1.smithi142.stdout:9/631: write db/d10/d7d/f8f [1747751,59749] 0 2024-02-19T19:07:35.966 INFO:tasks.workunit.client.1.smithi142.stdout:9/632: readlink db/d10/d7d/l85 0 2024-02-19T19:07:35.969 INFO:tasks.workunit.client.1.smithi142.stdout:1/745: rename d5/d7/d23/lfc to d5/d7/d23/d2c/l109 0 2024-02-19T19:07:35.969 INFO:tasks.workunit.client.1.smithi142.stdout:8/625: dwrite d9/dd/de/d2d/d2e/d49/d50/f72 [0,4194304] 0 2024-02-19T19:07:35.969 INFO:tasks.workunit.client.1.smithi142.stdout:8/626: write d9/dd/de/d2d/d2e/f52 [2094244,130531] 0 2024-02-19T19:07:35.972 INFO:tasks.workunit.client.1.smithi142.stdout:1/746: unlink d5/d37/d6c/d75/da7/fb7 0 2024-02-19T19:07:35.975 INFO:tasks.workunit.client.1.smithi142.stdout:1/747: creat d5/d77/da9/dae/db2/dea/f10a x:0 0 0 2024-02-19T19:07:35.976 INFO:tasks.workunit.client.1.smithi142.stdout:2/512: sync 2024-02-19T19:07:35.976 INFO:tasks.workunit.client.1.smithi142.stdout:2/513: chown d3/db/fc 4016 1 2024-02-19T19:07:35.976 INFO:tasks.workunit.client.1.smithi142.stdout:4/669: sync 2024-02-19T19:07:35.976 INFO:tasks.workunit.client.1.smithi142.stdout:1/748: rmdir d5/d7/d4a 39 2024-02-19T19:07:35.977 INFO:tasks.workunit.client.1.smithi142.stdout:2/514: mkdir d3/db/d29/d4c/d4e/d9a/da9 0 2024-02-19T19:07:35.977 INFO:tasks.workunit.client.1.smithi142.stdout:2/515: readlink d3/db/d29/d6d/l49 0 2024-02-19T19:07:35.977 INFO:tasks.workunit.client.1.smithi142.stdout:2/516: chown d3/df/l94 220489474 1 2024-02-19T19:07:35.978 INFO:tasks.workunit.client.1.smithi142.stdout:4/670: creat d4/d1c/dae/fde x:0 0 0 2024-02-19T19:07:35.979 INFO:tasks.workunit.client.1.smithi142.stdout:1/749: mknod d5/d7/d23/d2c/c10b 0 2024-02-19T19:07:35.979 INFO:tasks.workunit.client.1.smithi142.stdout:1/750: readlink d5/d7/d23/d2c/l109 0 2024-02-19T19:07:35.980 INFO:tasks.workunit.client.1.smithi142.stdout:4/671: creat d4/d1d/d42/d66/d5f/fdf x:0 0 0 2024-02-19T19:07:35.980 INFO:tasks.workunit.client.1.smithi142.stdout:4/672: truncate d4/d1d/d42/d66/d12/d2d/d2a/d84/fbb 1571959 0 2024-02-19T19:07:35.981 INFO:tasks.workunit.client.1.smithi142.stdout:1/751: unlink d5/d7/d4a/d53/f99 0 2024-02-19T19:07:35.982 INFO:tasks.workunit.client.1.smithi142.stdout:4/673: link d4/d1d/d42/d66/f8b d4/d1d/d42/d66/dd/d10/d3b/d3f/fe0 0 2024-02-19T19:07:35.983 INFO:tasks.workunit.client.1.smithi142.stdout:1/752: link d5/d37/d49/l4c d5/d37/d6c/d75/l10c 0 2024-02-19T19:07:35.985 INFO:tasks.workunit.client.1.smithi142.stdout:0/510: dwrite d23/d28/d2d/d51/d44/f89 [0,4194304] 0 2024-02-19T19:07:35.985 INFO:tasks.workunit.client.1.smithi142.stdout:6/532: dwrite d2/f9 [0,4194304] 0 2024-02-19T19:07:35.985 INFO:tasks.workunit.client.1.smithi142.stdout:4/674: symlink d4/d1d/d42/d66/d12/d2d/d2a/d84/le1 0 2024-02-19T19:07:35.985 INFO:tasks.workunit.client.1.smithi142.stdout:4/675: truncate d4/d1d/d42/d66/dd/d10/d3e/f4e 2759203 0 2024-02-19T19:07:35.985 INFO:tasks.workunit.client.1.smithi142.stdout:4/676: creat d4/d1c/dae/fe2 x:0 0 0 2024-02-19T19:07:35.985 INFO:tasks.workunit.client.1.smithi142.stdout:4/677: stat d4/d1d/d42/d66/dd/l65 0 2024-02-19T19:07:35.986 INFO:tasks.workunit.client.1.smithi142.stdout:1/753: rename d5/c40 to d5/d77/da9/dae/deb/df9/c10d 0 2024-02-19T19:07:35.988 INFO:tasks.workunit.client.1.smithi142.stdout:0/511: dread d23/f46 [0,4194304] 0 2024-02-19T19:07:35.990 INFO:tasks.workunit.client.1.smithi142.stdout:1/754: dread d5/d7/d34/d6f/fba [0,4194304] 0 2024-02-19T19:07:35.993 INFO:tasks.workunit.client.1.smithi142.stdout:8/627: dwrite d9/dd/f68 [4194304,4194304] 0 2024-02-19T19:07:35.994 INFO:tasks.workunit.client.1.smithi142.stdout:5/551: dwrite d5/dd/d5f/f65 [4194304,4194304] 0 2024-02-19T19:07:35.994 INFO:tasks.workunit.client.1.smithi142.stdout:5/552: chown d5/dd/df/d22/d41/d32/f74 1860038344 1 2024-02-19T19:07:35.994 INFO:tasks.workunit.client.1.smithi142.stdout:5/553: write d5/dd/df/d22/d41/d32/fa8 [1085695,45688] 0 2024-02-19T19:07:35.994 INFO:tasks.workunit.client.1.smithi142.stdout:5/554: write d5/dd/d8/d1c/d8a/fa6 [17334,24458] 0 2024-02-19T19:07:35.995 INFO:tasks.workunit.client.1.smithi142.stdout:3/714: dwrite d1d/d1e/d2e/f33 [0,4194304] 0 2024-02-19T19:07:35.995 INFO:tasks.workunit.client.1.smithi142.stdout:4/678: rmdir d4/d1d/d42/d66/dd/d10/d3b/ddd 0 2024-02-19T19:07:35.995 INFO:tasks.workunit.client.1.smithi142.stdout:4/679: fdatasync d4/d1c/fb5 0 2024-02-19T19:07:35.998 INFO:tasks.workunit.client.1.smithi142.stdout:1/755: unlink d5/d77/da9/lec 0 2024-02-19T19:07:35.998 INFO:tasks.workunit.client.1.smithi142.stdout:0/512: dread d23/d32/f65 [4194304,4194304] 0 2024-02-19T19:07:35.998 INFO:tasks.workunit.client.1.smithi142.stdout:0/513: write d23/d28/d2d/d51/d44/f49 [3570985,51994] 0 2024-02-19T19:07:36.007 INFO:tasks.workunit.client.1.smithi142.stdout:5/555: mknod d5/dd/d8/d2a/d93/cbd 0 2024-02-19T19:07:36.007 INFO:tasks.workunit.client.1.smithi142.stdout:0/514: dread d23/f25 [0,4194304] 0 2024-02-19T19:07:36.007 INFO:tasks.workunit.client.1.smithi142.stdout:4/680: getdents d4/d1d/d42/d66/dd/d10/d26/d50/d54 0 2024-02-19T19:07:36.009 INFO:tasks.workunit.client.1.smithi142.stdout:8/628: creat d9/dd/de/d14/d65/d6c/d9c/fca x:0 0 0 2024-02-19T19:07:36.009 INFO:tasks.workunit.client.1.smithi142.stdout:8/629: fdatasync d9/dd/de/d14/d65/fb2 0 2024-02-19T19:07:36.009 INFO:tasks.workunit.client.1.smithi142.stdout:8/630: write d9/dd/de/d2d/d2e/d49/fa1 [396235,115005] 0 2024-02-19T19:07:36.009 INFO:tasks.workunit.client.1.smithi142.stdout:3/715: read f9 [2081208,22987] 0 2024-02-19T19:07:36.011 INFO:tasks.workunit.client.1.smithi142.stdout:5/556: rename d5/dd/df/d22/d41/f2b to d5/dd/df/d15/fbe 0 2024-02-19T19:07:36.011 INFO:tasks.workunit.client.1.smithi142.stdout:5/557: fsync d5/dd/d8/d5d/f7e 0 2024-02-19T19:07:36.011 INFO:tasks.workunit.client.1.smithi142.stdout:5/558: fsync d5/dd/d8/d31/f33 0 2024-02-19T19:07:36.012 INFO:tasks.workunit.client.1.smithi142.stdout:4/681: getdents d4/d1d/d42/d66 0 2024-02-19T19:07:36.012 INFO:tasks.workunit.client.1.smithi142.stdout:4/682: fsync d4/d1d/d42/d66/dd/f6a 0 2024-02-19T19:07:36.012 INFO:tasks.workunit.client.1.smithi142.stdout:1/756: dread d5/fd [4194304,4194304] 0 2024-02-19T19:07:36.012 INFO:tasks.workunit.client.1.smithi142.stdout:1/757: readlink d5/d1a/l83 0 2024-02-19T19:07:36.013 INFO:tasks.workunit.client.1.smithi142.stdout:0/515: getdents d23/d28/d2d/d54/d85 0 2024-02-19T19:07:36.014 INFO:tasks.workunit.client.1.smithi142.stdout:8/631: symlink d9/dd/d44/d79/lcb 0 2024-02-19T19:07:36.014 INFO:tasks.workunit.client.1.smithi142.stdout:2/517: dwrite d3/df/f12 [0,4194304] 0 2024-02-19T19:07:36.014 INFO:tasks.workunit.client.1.smithi142.stdout:6/533: dwrite d2/d17/d33/d42/f74 [0,4194304] 0 2024-02-19T19:07:36.015 INFO:tasks.workunit.client.1.smithi142.stdout:3/716: mkdir d1d/d1e/d2e/d50/d7c/da7/d3a/d62/d8d/de4 0 2024-02-19T19:07:36.015 INFO:tasks.workunit.client.1.smithi142.stdout:3/717: chown d1d/d1e/d2e/d50/f69 669 1 2024-02-19T19:07:36.017 INFO:tasks.workunit.client.1.smithi142.stdout:4/683: rename d4/d1d/d42/d66/d12/d2d/d2a/d84/fdc to d4/d1d/d42/d66/d12/fe3 0 2024-02-19T19:07:36.018 INFO:tasks.workunit.client.1.smithi142.stdout:1/758: mknod d5/d37/d6c/c10e 0 2024-02-19T19:07:36.018 INFO:tasks.workunit.client.1.smithi142.stdout:1/759: creat d5/d77/da9/dae/db2/f10f x:0 0 0 2024-02-19T19:07:36.018 INFO:tasks.workunit.client.1.smithi142.stdout:1/760: chown d5/d7/d23/faf 11 1 2024-02-19T19:07:36.019 INFO:tasks.workunit.client.1.smithi142.stdout:0/516: creat d23/d28/d2d/d51/fa6 x:0 0 0 2024-02-19T19:07:36.020 INFO:tasks.workunit.client.1.smithi142.stdout:0/517: fsync f17 0 2024-02-19T19:07:36.022 INFO:tasks.workunit.client.1.smithi142.stdout:6/534: symlink d2/d17/d33/d42/da2/da7/lab 0 2024-02-19T19:07:36.022 INFO:tasks.workunit.client.1.smithi142.stdout:6/535: chown d2/d1f/d20/d31/d62/f72 51918 1 2024-02-19T19:07:36.024 INFO:tasks.workunit.client.1.smithi142.stdout:3/718: write d1d/d1e/d2e/d37/d81/dbc/fdf [579605,99559] 0 2024-02-19T19:07:36.024 INFO:tasks.workunit.client.1.smithi142.stdout:3/719: truncate d1d/d1e/d2e/d37/d6c/da9/f9f 840976 0 2024-02-19T19:07:36.024 INFO:tasks.workunit.client.1.smithi142.stdout:3/720: readlink d1d/d1e/d2e/d37/d81/db7/lde 0 2024-02-19T19:07:36.024 INFO:tasks.workunit.client.1.smithi142.stdout:3/721: getdents d1d/d1e/d2e/d50/d7c/da7/d3a/d57 0 2024-02-19T19:07:36.025 INFO:tasks.workunit.client.1.smithi142.stdout:1/761: creat d5/d7/d23/d41/d103/f110 x:0 0 0 2024-02-19T19:07:36.025 INFO:tasks.workunit.client.1.smithi142.stdout:2/518: read d3/f8 [2372434,78544] 0 2024-02-19T19:07:36.027 INFO:tasks.workunit.client.1.smithi142.stdout:6/536: creat d2/d1f/d20/d31/fac x:0 0 0 2024-02-19T19:07:36.027 INFO:tasks.workunit.client.1.smithi142.stdout:6/537: fsync d2/d1e/d35/d66/fa5 0 2024-02-19T19:07:36.030 INFO:tasks.workunit.client.1.smithi142.stdout:1/762: rename d5/d7/d34/f100 to d5/d7/d34/f111 0 2024-02-19T19:07:36.030 INFO:tasks.workunit.client.1.smithi142.stdout:4/684: dread d4/d1c/fb5 [0,4194304] 0 2024-02-19T19:07:36.030 INFO:tasks.workunit.client.1.smithi142.stdout:4/685: write d4/d1d/d42/d66/dd/d10/d3e/d68/d87/f9e [1108045,19192] 0 2024-02-19T19:07:36.031 INFO:tasks.workunit.client.1.smithi142.stdout:1/763: symlink d5/d37/d6c/d75/da7/l112 0 2024-02-19T19:07:36.031 INFO:tasks.workunit.client.1.smithi142.stdout:1/764: fdatasync d5/d7/d4a/d53/d6a/fa5 0 2024-02-19T19:07:36.032 INFO:tasks.workunit.client.1.smithi142.stdout:7/490: sync 2024-02-19T19:07:36.033 INFO:tasks.workunit.client.1.smithi142.stdout:1/765: symlink d5/d1a/d59/l113 0 2024-02-19T19:07:36.033 INFO:tasks.workunit.client.1.smithi142.stdout:0/518: write d23/d28/f34 [1110190,6025] 0 2024-02-19T19:07:36.034 INFO:tasks.workunit.client.1.smithi142.stdout:8/632: dwrite d9/dd/f47 [0,4194304] 0 2024-02-19T19:07:36.034 INFO:tasks.workunit.client.1.smithi142.stdout:8/633: readlink d9/dd/de/d14/d65/l7c 0 2024-02-19T19:07:36.037 INFO:tasks.workunit.client.1.smithi142.stdout:2/519: dread d3/db/f47 [0,4194304] 0 2024-02-19T19:07:36.037 INFO:tasks.workunit.client.1.smithi142.stdout:2/520: fdatasync d3/db/d29/d6d/d59/f99 0 2024-02-19T19:07:36.038 INFO:tasks.workunit.client.1.smithi142.stdout:7/491: dread d0/d13/d72/d47/d69/f40 [0,4194304] 0 2024-02-19T19:07:36.038 INFO:tasks.workunit.client.1.smithi142.stdout:7/492: chown d0/d1b/d21/f36 2620 1 2024-02-19T19:07:36.038 INFO:tasks.workunit.client.1.smithi142.stdout:7/493: fsync d0/d13/d1e/d22/f57 0 2024-02-19T19:07:36.039 INFO:tasks.workunit.client.1.smithi142.stdout:2/521: unlink d3/d4d/d81/f8e 0 2024-02-19T19:07:36.039 INFO:tasks.workunit.client.1.smithi142.stdout:2/522: rename d3/d4d to d3/d4d/d5f/d7c/daa 22 2024-02-19T19:07:36.040 INFO:tasks.workunit.client.1.smithi142.stdout:7/494: mknod d0/d13/d72/d47/d69/c9e 0 2024-02-19T19:07:36.041 INFO:tasks.workunit.client.1.smithi142.stdout:2/523: getdents d3 0 2024-02-19T19:07:36.041 INFO:tasks.workunit.client.1.smithi142.stdout:2/524: stat d3/d4d/d5f/d7c/c96 0 2024-02-19T19:07:36.041 INFO:tasks.workunit.client.1.smithi142.stdout:2/525: chown d3/d35/d53 65 1 2024-02-19T19:07:36.042 INFO:tasks.workunit.client.1.smithi142.stdout:7/495: creat d0/d62/f9f x:0 0 0 2024-02-19T19:07:36.043 INFO:tasks.workunit.client.1.smithi142.stdout:5/559: dwrite d5/dd/d8/d1c/d8a/f9c [0,4194304] 0 2024-02-19T19:07:36.043 INFO:tasks.workunit.client.1.smithi142.stdout:4/686: dread d4/d14/d31/d43/f5d [0,4194304] 0 2024-02-19T19:07:36.043 INFO:tasks.workunit.client.1.smithi142.stdout:4/687: stat d4/d1d/d42/d66/dd/f7c 0 2024-02-19T19:07:36.043 INFO:tasks.workunit.client.1.smithi142.stdout:4/688: fsync d4/d14/d31/f61 0 2024-02-19T19:07:36.043 INFO:tasks.workunit.client.1.smithi142.stdout:6/538: write d2/d1e/d35/d66/f8b [1501320,29167] 0 2024-02-19T19:07:36.044 INFO:tasks.workunit.client.1.smithi142.stdout:7/496: getdents d0/d13 0 2024-02-19T19:07:36.044 INFO:tasks.workunit.client.1.smithi142.stdout:3/722: dwrite d1d/d1e/d2e/d50/d7c/da7/d3a/d62/da2/fa8 [0,4194304] 0 2024-02-19T19:07:36.046 INFO:tasks.workunit.client.1.smithi142.stdout:5/560: unlink d5/dd/df/d22/d80/fba 0 2024-02-19T19:07:36.046 INFO:tasks.workunit.client.1.smithi142.stdout:5/561: truncate d5/dd/d8/d31/d4d/d8d/f98 794055 0 2024-02-19T19:07:36.048 INFO:tasks.workunit.client.1.smithi142.stdout:7/497: truncate d0/d1b/f91 807809 0 2024-02-19T19:07:36.050 INFO:tasks.workunit.client.1.smithi142.stdout:8/634: write d9/dd/de/d14/d65/d6c/f33 [3766123,71461] 0 2024-02-19T19:07:36.050 INFO:tasks.workunit.client.1.smithi142.stdout:8/635: read - d9/dd/d15/d31/fa0 zero size 2024-02-19T19:07:36.053 INFO:tasks.workunit.client.1.smithi142.stdout:0/519: dread d23/d28/f34 [0,4194304] 0 2024-02-19T19:07:36.053 INFO:tasks.workunit.client.1.smithi142.stdout:5/562: mknod d5/dd/d8/cbf 0 2024-02-19T19:07:36.053 INFO:tasks.workunit.client.1.smithi142.stdout:5/563: chown d5/dd/c3b 1234043 1 2024-02-19T19:07:36.053 INFO:tasks.workunit.client.1.smithi142.stdout:5/564: chown d5/dd/d8/d1c/d8a 6197945 1 2024-02-19T19:07:36.053 INFO:tasks.workunit.client.1.smithi142.stdout:7/498: rename d0/d13/d72/f4f to d0/d1b/d21/d24/d29/d44/d49/d9b/fa0 0 2024-02-19T19:07:36.054 INFO:tasks.workunit.client.1.smithi142.stdout:5/565: write d5/dd/df/d15/fbe [573920,115022] 0 2024-02-19T19:07:36.056 INFO:tasks.workunit.client.1.smithi142.stdout:0/520: dread d23/d28/d2d/d51/d44/f4d [0,4194304] 0 2024-02-19T19:07:36.056 INFO:tasks.workunit.client.1.smithi142.stdout:0/521: chown d23/d28/d2d/d51/d44/d58/c73 11 1 2024-02-19T19:07:36.056 INFO:tasks.workunit.client.1.smithi142.stdout:8/636: mknod d9/dd/de/d14/d65/d6c/da7/ccc 0 2024-02-19T19:07:36.057 INFO:tasks.workunit.client.1.smithi142.stdout:6/539: write d2/d29/d47/f4a [1261179,54825] 0 2024-02-19T19:07:36.058 INFO:tasks.workunit.client.1.smithi142.stdout:6/540: readlink d2/d1f/d20/d31/d88/d8f/l92 0 2024-02-19T19:07:36.059 INFO:tasks.workunit.client.1.smithi142.stdout:6/541: creat d2/d1f/d56/fad x:0 0 0 2024-02-19T19:07:36.059 INFO:tasks.workunit.client.1.smithi142.stdout:6/542: write d2/d1f/d56/f6b [8981529,18762] 0 2024-02-19T19:07:36.059 INFO:tasks.workunit.client.1.smithi142.stdout:0/522: dread d23/d32/f8f [0,4194304] 0 2024-02-19T19:07:36.060 INFO:tasks.workunit.client.1.smithi142.stdout:7/499: creat d0/fa1 x:0 0 0 2024-02-19T19:07:36.060 INFO:tasks.workunit.client.1.smithi142.stdout:7/500: write d0/d13/d72/f33 [1076645,65183] 0 2024-02-19T19:07:36.060 INFO:tasks.workunit.client.1.smithi142.stdout:7/501: chown d0/d13/d1e/f42 0 1 2024-02-19T19:07:36.060 INFO:tasks.workunit.client.1.smithi142.stdout:7/502: fdatasync d0/d13/d72/f45 0 2024-02-19T19:07:36.060 INFO:tasks.workunit.client.1.smithi142.stdout:7/503: truncate d0/d13/d72/f45 948542 0 2024-02-19T19:07:36.061 INFO:tasks.workunit.client.1.smithi142.stdout:5/566: mkdir d5/dd/df/d22/dc0 0 2024-02-19T19:07:36.061 INFO:tasks.workunit.client.1.smithi142.stdout:5/567: write d5/dd/df/f6b [3951390,58548] 0 2024-02-19T19:07:36.062 INFO:tasks.workunit.client.1.smithi142.stdout:1/766: dwrite d5/d7/d4a/f81 [0,4194304] 0 2024-02-19T19:07:36.062 INFO:tasks.workunit.client.1.smithi142.stdout:1/767: truncate d5/d7/d23/da4/ff2 941357 0 2024-02-19T19:07:36.062 INFO:tasks.workunit.client.1.smithi142.stdout:3/723: dread d1d/f22 [0,4194304] 0 2024-02-19T19:07:36.063 INFO:tasks.workunit.client.1.smithi142.stdout:8/637: dread d9/dd/de/f86 [0,4194304] 0 2024-02-19T19:07:36.063 INFO:tasks.workunit.client.1.smithi142.stdout:8/638: fsync f7 0 2024-02-19T19:07:36.065 INFO:tasks.workunit.client.1.smithi142.stdout:0/523: link d23/d28/d2d/d54/d85/l9c d23/d28/d41/d78/la7 0 2024-02-19T19:07:36.069 INFO:tasks.workunit.client.1.smithi142.stdout:5/568: rename d5/f2c to d5/dd/d8/d31/fc1 0 2024-02-19T19:07:36.072 INFO:tasks.workunit.client.1.smithi142.stdout:3/724: read d1d/d1e/d2e/f43 [1840973,104874] 0 2024-02-19T19:07:36.074 INFO:tasks.workunit.client.1.smithi142.stdout:2/526: dwrite d3/d4d/f90 [0,4194304] 0 2024-02-19T19:07:36.074 INFO:tasks.workunit.client.1.smithi142.stdout:4/689: dwrite d4/d14/d31/dab/f63 [0,4194304] 0 2024-02-19T19:07:36.076 INFO:tasks.workunit.client.1.smithi142.stdout:4/690: dread d4/d1d/d42/d66/d12/d2d/d2a/f6f [0,4194304] 0 2024-02-19T19:07:36.077 INFO:tasks.workunit.client.1.smithi142.stdout:1/768: dread d5/d7/d23/d2c/f3b [0,4194304] 0 2024-02-19T19:07:36.080 INFO:tasks.workunit.client.1.smithi142.stdout:5/569: dread d5/dd/d8/d31/d4d/f94 [0,4194304] 0 2024-02-19T19:07:36.080 INFO:tasks.workunit.client.1.smithi142.stdout:5/570: readlink d5/dd/d5f/d6a/lab 0 2024-02-19T19:07:36.084 INFO:tasks.workunit.client.1.smithi142.stdout:0/524: dwrite f16 [4194304,4194304] 0 2024-02-19T19:07:36.086 INFO:tasks.workunit.client.1.smithi142.stdout:8/639: link d9/dd/d15/l40 d9/dd/de/d14/d65/d94/lcd 0 2024-02-19T19:07:36.087 INFO:tasks.workunit.client.1.smithi142.stdout:0/525: write d23/d32/d8a/f96 [3194604,16867] 0 2024-02-19T19:07:36.088 INFO:tasks.workunit.client.1.smithi142.stdout:6/543: symlink d2/d1e/d35/d66/d8d/d89/lae 0 2024-02-19T19:07:36.088 INFO:tasks.workunit.client.1.smithi142.stdout:6/544: truncate d2/d29/f94 458015 0 2024-02-19T19:07:36.088 INFO:tasks.workunit.client.1.smithi142.stdout:6/545: chown d2/d17 3622 1 2024-02-19T19:07:36.090 INFO:tasks.workunit.client.1.smithi142.stdout:3/725: link d1d/d1e/d2e/f7e d1d/d1e/d2e/d50/d7c/da7/d52/d71/dc0/fe5 0 2024-02-19T19:07:36.090 INFO:tasks.workunit.client.1.smithi142.stdout:3/726: fsync d1d/f9e 0 2024-02-19T19:07:36.090 INFO:tasks.workunit.client.1.smithi142.stdout:3/727: write d1d/f2b [359530,122760] 0 2024-02-19T19:07:36.091 INFO:tasks.workunit.client.1.smithi142.stdout:2/527: symlink d3/df/da4/lab 0 2024-02-19T19:07:36.091 INFO:tasks.workunit.client.1.smithi142.stdout:7/504: getdents d0 0 2024-02-19T19:07:36.093 INFO:tasks.workunit.client.1.smithi142.stdout:4/691: symlink d4/d14/d31/le4 0 2024-02-19T19:07:36.094 INFO:tasks.workunit.client.1.smithi142.stdout:1/769: rename d5/d7/d4a/d53/l54 to d5/d7/l114 0 2024-02-19T19:07:36.095 INFO:tasks.workunit.client.1.smithi142.stdout:8/640: link d9/dd/de/d2d/d2e/d49/d50/d59/l7d d9/dd/d15/d31/d5e/lce 0 2024-02-19T19:07:36.096 INFO:tasks.workunit.client.1.smithi142.stdout:0/526: dread d23/d32/f5b [0,4194304] 0 2024-02-19T19:07:36.102 INFO:tasks.workunit.client.1.smithi142.stdout:3/728: creat d1d/d1e/d2e/d50/d7c/da7/fe6 x:0 0 0 2024-02-19T19:07:36.103 INFO:tasks.workunit.client.1.smithi142.stdout:2/528: creat d3/fac x:0 0 0 2024-02-19T19:07:36.105 INFO:tasks.workunit.client.1.smithi142.stdout:7/505: creat d0/d13/fa2 x:0 0 0 2024-02-19T19:07:36.105 INFO:tasks.workunit.client.1.smithi142.stdout:0/527: dread f17 [0,4194304] 0 2024-02-19T19:07:36.105 INFO:tasks.workunit.client.1.smithi142.stdout:0/528: write d23/f25 [1786672,31490] 0 2024-02-19T19:07:36.107 INFO:tasks.workunit.client.1.smithi142.stdout:4/692: link d4/d1c/fb5 d4/d34/d44/fe5 0 2024-02-19T19:07:36.111 INFO:tasks.workunit.client.1.smithi142.stdout:7/506: rename d0/d1b/c2b to d0/d1b/ca3 0 2024-02-19T19:07:36.111 INFO:tasks.workunit.client.1.smithi142.stdout:3/729: dread d1d/d1e/d2e/d50/d7c/da7/d3a/d62/d91/fa5 [0,4194304] 0 2024-02-19T19:07:36.111 INFO:tasks.workunit.client.1.smithi142.stdout:6/546: dwrite d2/d1f/d20/d31/d62/f72 [0,4194304] 0 2024-02-19T19:07:36.112 INFO:tasks.workunit.client.1.smithi142.stdout:8/641: creat d9/dd/de/db4/fcf x:0 0 0 2024-02-19T19:07:36.113 INFO:tasks.workunit.client.1.smithi142.stdout:7/507: mkdir d0/d1b/d9d/da4 0 2024-02-19T19:07:36.113 INFO:tasks.workunit.client.1.smithi142.stdout:7/508: dread - d0/d62/f81 zero size 2024-02-19T19:07:36.113 INFO:tasks.workunit.client.1.smithi142.stdout:7/509: truncate d0/d13/d72/f45 1497716 0 2024-02-19T19:07:36.114 INFO:tasks.workunit.client.1.smithi142.stdout:9/633: sync 2024-02-19T19:07:36.116 INFO:tasks.workunit.client.1.smithi142.stdout:6/547: mkdir d2/d17/d33/d42/da2/da7/d55/daf 0 2024-02-19T19:07:36.117 INFO:tasks.workunit.client.1.smithi142.stdout:7/510: link d0/d13/d1e/c73 d0/d1b/d21/d24/d29/d44/d49/d9b/ca5 0 2024-02-19T19:07:36.117 INFO:tasks.workunit.client.1.smithi142.stdout:7/511: dread - d0/d1b/d21/d24/f5f zero size 2024-02-19T19:07:36.119 INFO:tasks.workunit.client.1.smithi142.stdout:6/548: rename d2/d1e/d35/d96 to d2/d17/d33/d42/d5e/d7b/db0 0 2024-02-19T19:07:36.119 INFO:tasks.workunit.client.1.smithi142.stdout:6/549: chown d2/d1e/l4c 508189463 1 2024-02-19T19:07:36.120 INFO:tasks.workunit.client.1.smithi142.stdout:6/550: readlink d2/d1f/d5c/d63/l7d 0 2024-02-19T19:07:36.124 INFO:tasks.workunit.client.1.smithi142.stdout:6/551: mknod d2/d17/d33/d42/d5e/cb1 0 2024-02-19T19:07:36.124 INFO:tasks.workunit.client.1.smithi142.stdout:7/512: rmdir d0/d1b/d21/d24/d29/d44/d49/d8b 39 2024-02-19T19:07:36.134 INFO:tasks.workunit.client.1.smithi142.stdout:6/552: dread d2/d1e/d35/d66/f7f [0,4194304] 0 2024-02-19T19:07:36.136 INFO:tasks.workunit.client.1.smithi142.stdout:6/553: creat d2/d17/d33/d42/da2/da7/d55/d69/fb2 x:0 0 0 2024-02-19T19:07:36.151 INFO:tasks.workunit.client.1.smithi142.stdout:6/554: dwrite d2/d1f/d20/d31/fa8 [0,4194304] 0 2024-02-19T19:07:36.157 INFO:tasks.workunit.client.1.smithi142.stdout:1/770: dwrite d5/d37/d6c/f85 [0,4194304] 0 2024-02-19T19:07:36.157 INFO:tasks.workunit.client.1.smithi142.stdout:1/771: readlink d5/d7/d23/d2c/l67 0 2024-02-19T19:07:36.157 INFO:tasks.workunit.client.1.smithi142.stdout:2/529: dwrite d3/db/d29/d4c/d4a/f75 [0,4194304] 0 2024-02-19T19:07:36.157 INFO:tasks.workunit.client.1.smithi142.stdout:2/530: dread - d3/db/d29/d6d/d59/f78 zero size 2024-02-19T19:07:36.160 INFO:tasks.workunit.client.1.smithi142.stdout:2/531: mkdir d3/db/d29/d4c/d4e/d9a/da9/dad 0 2024-02-19T19:07:36.161 INFO:tasks.workunit.client.1.smithi142.stdout:2/532: mkdir d3/db/d29/d4c/dae 0 2024-02-19T19:07:36.162 INFO:tasks.workunit.client.1.smithi142.stdout:3/730: write d1d/d1e/d6e/fe2 [2050095,98984] 0 2024-02-19T19:07:36.162 INFO:tasks.workunit.client.1.smithi142.stdout:3/731: chown d1d/d1e/l2f 14 1 2024-02-19T19:07:36.162 INFO:tasks.workunit.client.1.smithi142.stdout:3/732: creat d1d/d1e/d2e/d50/d7c/fe7 x:0 0 0 2024-02-19T19:07:36.162 INFO:tasks.workunit.client.1.smithi142.stdout:3/733: write d1d/d1e/d2e/d50/d7c/da7/d52/d5a/f94 [1832810,41431] 0 2024-02-19T19:07:36.171 INFO:tasks.workunit.client.1.smithi142.stdout:7/513: dwrite d0/fd [0,4194304] 0 2024-02-19T19:07:36.173 INFO:tasks.workunit.client.1.smithi142.stdout:4/693: dwrite d4/d14/d31/f8d [0,4194304] 0 2024-02-19T19:07:36.173 INFO:tasks.workunit.client.1.smithi142.stdout:4/694: chown d4/d1c/fb5 0 1 2024-02-19T19:07:36.173 INFO:tasks.workunit.client.1.smithi142.stdout:4/695: dread - d4/d1d/d42/d66/d5f/fd1 zero size 2024-02-19T19:07:36.173 INFO:tasks.workunit.client.1.smithi142.stdout:4/696: truncate d4/d1d/d42/d66/d12/fe3 58380 0 2024-02-19T19:07:36.173 INFO:tasks.workunit.client.1.smithi142.stdout:4/697: chown d4/d34/d44/fe5 85 1 2024-02-19T19:07:36.173 INFO:tasks.workunit.client.1.smithi142.stdout:6/555: dwrite d2/d1f/f2b [0,4194304] 0 2024-02-19T19:07:36.173 INFO:tasks.workunit.client.1.smithi142.stdout:2/533: dread d3/d4d/d5f/f72 [4194304,4194304] 0 2024-02-19T19:07:36.173 INFO:tasks.workunit.client.1.smithi142.stdout:2/534: truncate d3/d35/f66 4930596 0 2024-02-19T19:07:36.173 INFO:tasks.workunit.client.1.smithi142.stdout:2/535: readlink d3/db/d29/d4c/l91 0 2024-02-19T19:07:36.174 INFO:tasks.workunit.client.1.smithi142.stdout:7/514: rename d0/d13/d1e/c73 to d0/d1b/d9d/ca6 0 2024-02-19T19:07:36.177 INFO:tasks.workunit.client.1.smithi142.stdout:3/734: write fa [3637224,58354] 0 2024-02-19T19:07:36.182 INFO:tasks.workunit.client.1.smithi142.stdout:7/515: rename d0/d13/d1e/d22 to d0/d13/d72/da7 0 2024-02-19T19:07:36.184 INFO:tasks.workunit.client.1.smithi142.stdout:7/516: symlink d0/d1b/d21/d24/d5e/d65/la8 0 2024-02-19T19:07:36.184 INFO:tasks.workunit.client.1.smithi142.stdout:7/517: chown d0/d13/d72/da7 117 1 2024-02-19T19:07:36.184 INFO:tasks.workunit.client.1.smithi142.stdout:7/518: write d0/d13/f27 [2346515,74464] 0 2024-02-19T19:07:36.185 INFO:tasks.workunit.client.1.smithi142.stdout:7/519: mkdir d0/d1b/d21/d24/da9 0 2024-02-19T19:07:36.185 INFO:tasks.workunit.client.1.smithi142.stdout:7/520: symlink d0/d1b/d9d/laa 0 2024-02-19T19:07:36.186 INFO:tasks.workunit.client.1.smithi142.stdout:7/521: symlink d0/d13/d72/lab 0 2024-02-19T19:07:36.187 INFO:tasks.workunit.client.1.smithi142.stdout:7/522: symlink d0/d1b/d9d/lac 0 2024-02-19T19:07:36.187 INFO:tasks.workunit.client.1.smithi142.stdout:3/735: write d1d/d1e/d2e/d50/d7c/da7/f3d [4681419,36112] 0 2024-02-19T19:07:36.189 INFO:tasks.workunit.client.1.smithi142.stdout:3/736: rename d1d/d1e/d2e/d50/d7c/da7/d3a/d62/dc1/fc3 to d1d/d1e/d2e/d37/d81/fe8 0 2024-02-19T19:07:36.189 INFO:tasks.workunit.client.1.smithi142.stdout:7/523: dread d0/f6c [0,4194304] 0 2024-02-19T19:07:36.190 INFO:tasks.workunit.client.1.smithi142.stdout:3/737: symlink d1d/d1e/d2e/d50/d7c/da7/d3a/dc7/le9 0 2024-02-19T19:07:36.191 INFO:tasks.workunit.client.1.smithi142.stdout:7/524: symlink d0/d1b/d21/lad 0 2024-02-19T19:07:36.192 INFO:tasks.workunit.client.1.smithi142.stdout:3/738: creat d1d/d1e/d2e/d50/d7c/da7/d52/d5a/da4/fea x:0 0 0 2024-02-19T19:07:36.193 INFO:tasks.workunit.client.1.smithi142.stdout:3/739: rmdir d1d/d1e/d2e/d37/d81/dbc 39 2024-02-19T19:07:36.193 INFO:tasks.workunit.client.1.smithi142.stdout:3/740: chown d1d/d1e/d2e/f33 29 1 2024-02-19T19:07:36.193 INFO:tasks.workunit.client.1.smithi142.stdout:3/741: fsync d1d/d1e/d6e/f99 0 2024-02-19T19:07:36.194 INFO:tasks.workunit.client.1.smithi142.stdout:3/742: symlink d1d/d1e/d2e/d37/d6c/leb 0 2024-02-19T19:07:36.195 INFO:tasks.workunit.client.1.smithi142.stdout:3/743: dread d1d/d1e/f58 [0,4194304] 0 2024-02-19T19:07:36.196 INFO:tasks.workunit.client.1.smithi142.stdout:5/571: sync 2024-02-19T19:07:36.197 INFO:tasks.workunit.client.1.smithi142.stdout:6/556: dwrite d2/d29/f94 [0,4194304] 0 2024-02-19T19:07:36.198 INFO:tasks.workunit.client.1.smithi142.stdout:5/572: mkdir d5/dd/d8/d2a/d93/dc2 0 2024-02-19T19:07:36.198 INFO:tasks.workunit.client.1.smithi142.stdout:7/525: dread d0/d1b/d21/d24/d29/d44/f66 [0,4194304] 0 2024-02-19T19:07:36.199 INFO:tasks.workunit.client.1.smithi142.stdout:2/536: dwrite d3/d4b/f58 [0,4194304] 0 2024-02-19T19:07:36.199 INFO:tasks.workunit.client.1.smithi142.stdout:2/537: stat d3/db/d29/l44 0 2024-02-19T19:07:36.199 INFO:tasks.workunit.client.1.smithi142.stdout:4/698: dwrite d4/d1c/dae/fde [0,4194304] 0 2024-02-19T19:07:36.199 INFO:tasks.workunit.client.1.smithi142.stdout:4/699: creat d4/d34/fe6 x:0 0 0 2024-02-19T19:07:36.199 INFO:tasks.workunit.client.1.smithi142.stdout:4/700: write d4/d1d/d42/d66/dd/f7c [706618,72374] 0 2024-02-19T19:07:36.199 INFO:tasks.workunit.client.1.smithi142.stdout:5/573: symlink d5/dd/d8/dbc/lc3 0 2024-02-19T19:07:36.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:36.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:36.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:36.208 INFO:tasks.workunit.client.1.smithi142.stdout:2/538: truncate d3/d35/f48 436709 0 2024-02-19T19:07:36.208 INFO:tasks.workunit.client.1.smithi142.stdout:5/574: getdents d5/dd/df/d15 0 2024-02-19T19:07:36.208 INFO:tasks.workunit.client.1.smithi142.stdout:5/575: creat d5/dd/d8/d2a/fc4 x:0 0 0 2024-02-19T19:07:36.208 INFO:tasks.workunit.client.1.smithi142.stdout:7/526: dread d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:36.208 INFO:tasks.workunit.client.1.smithi142.stdout:6/557: write d2/d1f/d20/d31/d62/f72 [939866,18694] 0 2024-02-19T19:07:36.208 INFO:tasks.workunit.client.1.smithi142.stdout:7/527: fsync d0/d13/fa2 0 2024-02-19T19:07:36.209 INFO:tasks.workunit.client.1.smithi142.stdout:5/576: rmdir d5/dd/d8/d2a/d93/dc2 0 2024-02-19T19:07:36.211 INFO:tasks.workunit.client.1.smithi142.stdout:7/528: link d0/d1b/d21/d24/d29/d44/d49/l4e d0/d13/lae 0 2024-02-19T19:07:36.211 INFO:tasks.workunit.client.1.smithi142.stdout:7/529: fdatasync d0/d13/fa2 0 2024-02-19T19:07:36.213 INFO:tasks.workunit.client.1.smithi142.stdout:5/577: creat d5/dd/d5f/fc5 x:0 0 0 2024-02-19T19:07:36.213 INFO:tasks.workunit.client.1.smithi142.stdout:4/701: write d4/d1d/d42/d66/d12/d2d/f75 [3681142,57547] 0 2024-02-19T19:07:36.214 INFO:tasks.workunit.client.1.smithi142.stdout:7/530: rename d0/d13/d1e/f42 to d0/d13/d72/da7/faf 0 2024-02-19T19:07:36.216 INFO:tasks.workunit.client.1.smithi142.stdout:5/578: creat d5/dd/df/d15/fc6 x:0 0 0 2024-02-19T19:07:36.217 INFO:tasks.workunit.client.1.smithi142.stdout:4/702: mkdir d4/d14/d31/dab/de7 0 2024-02-19T19:07:36.217 INFO:tasks.workunit.client.1.smithi142.stdout:2/539: read d3/f1c [3966218,52303] 0 2024-02-19T19:07:36.219 INFO:tasks.workunit.client.1.smithi142.stdout:7/531: link d0/d1b/f91 d0/d1b/d21/d24/d29/d44/d49/d8b/fb0 0 2024-02-19T19:07:36.220 INFO:tasks.workunit.client.1.smithi142.stdout:5/579: truncate d5/fe 4800647 0 2024-02-19T19:07:36.221 INFO:tasks.workunit.client.1.smithi142.stdout:5/580: readlink d5/dd/df/d15/l4b 0 2024-02-19T19:07:36.221 INFO:tasks.workunit.client.1.smithi142.stdout:6/558: dread d2/d29/d47/f68 [0,4194304] 0 2024-02-19T19:07:36.221 INFO:tasks.workunit.client.1.smithi142.stdout:3/744: dwrite d1d/d1e/f21 [0,4194304] 0 2024-02-19T19:07:36.222 INFO:tasks.workunit.client.1.smithi142.stdout:2/540: creat d3/db/d29/d4c/d4e/d9a/da9/dad/faf x:0 0 0 2024-02-19T19:07:36.225 INFO:tasks.workunit.client.1.smithi142.stdout:7/532: rename d0/d13/d72/d47/d69/c3b to d0/d13/cb1 0 2024-02-19T19:07:36.226 INFO:tasks.workunit.client.1.smithi142.stdout:5/581: mkdir d5/dd/d8/d31/d4d/d75/dc7 0 2024-02-19T19:07:36.230 INFO:tasks.workunit.client.1.smithi142.stdout:2/541: write d3/df/f32 [6643775,66458] 0 2024-02-19T19:07:36.235 INFO:tasks.workunit.client.1.smithi142.stdout:6/559: creat d2/d17/d33/d42/da2/da7/d55/daf/fb3 x:0 0 0 2024-02-19T19:07:36.236 INFO:tasks.workunit.client.1.smithi142.stdout:4/703: dwrite d4/d1d/d42/d66/dd/d10/d3b/d3f/fe0 [0,4194304] 0 2024-02-19T19:07:36.237 INFO:tasks.workunit.client.1.smithi142.stdout:3/745: creat d1d/d1e/d2e/d8b/fec x:0 0 0 2024-02-19T19:07:36.239 INFO:tasks.workunit.client.1.smithi142.stdout:5/582: rmdir d5/dd/df/d22/d41/d6f/d82 0 2024-02-19T19:07:36.241 INFO:tasks.workunit.client.1.smithi142.stdout:6/560: creat d2/d17/d33/d42/da2/fb4 x:0 0 0 2024-02-19T19:07:36.241 INFO:tasks.workunit.client.1.smithi142.stdout:6/561: creat d2/d17/d33/d42/da2/fb5 x:0 0 0 2024-02-19T19:07:36.245 INFO:tasks.workunit.client.1.smithi142.stdout:3/746: mkdir d1d/d1e/d2e/ded 0 2024-02-19T19:07:36.246 INFO:tasks.workunit.client.1.smithi142.stdout:5/583: symlink d5/dd/d8/d31/d4d/d75/dc7/lc8 0 2024-02-19T19:07:36.248 INFO:tasks.workunit.client.1.smithi142.stdout:5/584: dread d5/dd/f68 [0,4194304] 0 2024-02-19T19:07:36.248 INFO:tasks.workunit.client.1.smithi142.stdout:5/585: getdents d5/dd/d95/dbb 0 2024-02-19T19:07:36.249 INFO:tasks.workunit.client.1.smithi142.stdout:5/586: fsync d5/dd/d8/d2a/f90 0 2024-02-19T19:07:36.249 INFO:tasks.workunit.client.1.smithi142.stdout:5/587: fsync d5/dd/d8/d29/f63 0 2024-02-19T19:07:36.249 INFO:tasks.workunit.client.1.smithi142.stdout:5/588: chown d5/dd/df/d15/fbe 120 1 2024-02-19T19:07:36.249 INFO:tasks.workunit.client.1.smithi142.stdout:4/704: dread d4/f5 [0,4194304] 0 2024-02-19T19:07:36.249 INFO:tasks.workunit.client.1.smithi142.stdout:4/705: chown d4/d1c/fc1 223442338 1 2024-02-19T19:07:36.250 INFO:tasks.workunit.client.1.smithi142.stdout:6/562: mkdir d2/d1f/d4d/d60/db6 0 2024-02-19T19:07:36.250 INFO:tasks.workunit.client.1.smithi142.stdout:2/542: dwrite d3/f73 [0,4194304] 0 2024-02-19T19:07:36.250 INFO:tasks.workunit.client.1.smithi142.stdout:2/543: fdatasync d3/db/d29/f5d 0 2024-02-19T19:07:36.250 INFO:tasks.workunit.client.1.smithi142.stdout:2/544: readlink d3/db/l3d 0 2024-02-19T19:07:36.250 INFO:tasks.workunit.client.1.smithi142.stdout:2/545: fsync d3/d4d/d5f/f72 0 2024-02-19T19:07:36.250 INFO:tasks.workunit.client.1.smithi142.stdout:7/533: dwrite d0/d13/d72/f45 [0,4194304] 0 2024-02-19T19:07:36.251 INFO:tasks.workunit.client.1.smithi142.stdout:7/534: creat d0/d13/d1e/fb2 x:0 0 0 2024-02-19T19:07:36.253 INFO:tasks.workunit.client.1.smithi142.stdout:5/589: symlink d5/dd/d8/d2a/d93/lc9 0 2024-02-19T19:07:36.254 INFO:tasks.workunit.client.1.smithi142.stdout:4/706: mkdir d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba/dd2/de8 0 2024-02-19T19:07:36.254 INFO:tasks.workunit.client.1.smithi142.stdout:4/707: readlink d4/d1d/d42/d66/d12/d79/d8c/l9d 0 2024-02-19T19:07:36.255 INFO:tasks.workunit.client.1.smithi142.stdout:6/563: chown d2/d17/d33/d39/l78 1 1 2024-02-19T19:07:36.261 INFO:tasks.workunit.client.1.smithi142.stdout:7/535: dread d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:36.261 INFO:tasks.workunit.client.1.smithi142.stdout:7/536: chown d0/d1b/f5a 6530 1 2024-02-19T19:07:36.266 INFO:tasks.workunit.client.1.smithi142.stdout:4/708: dread d4/d1d/d42/d66/d12/d79/fa3 [0,4194304] 0 2024-02-19T19:07:36.266 INFO:tasks.workunit.client.1.smithi142.stdout:0/529: sync 2024-02-19T19:07:36.266 INFO:tasks.workunit.client.1.smithi142.stdout:8/642: sync 2024-02-19T19:07:36.266 INFO:tasks.workunit.client.1.smithi142.stdout:1/772: sync 2024-02-19T19:07:36.266 INFO:tasks.workunit.client.1.smithi142.stdout:9/634: sync 2024-02-19T19:07:36.267 INFO:tasks.workunit.client.1.smithi142.stdout:9/635: read db/d10/d27/f6d [154104,72337] 0 2024-02-19T19:07:36.267 INFO:tasks.workunit.client.1.smithi142.stdout:9/636: fdatasync db/f53 0 2024-02-19T19:07:36.267 INFO:tasks.workunit.client.1.smithi142.stdout:9/637: fsync db/d10/d22/d24/d41/f74 0 2024-02-19T19:07:36.267 INFO:tasks.workunit.client.1.smithi142.stdout:9/638: stat db/d10/d32/d3f/f63 0 2024-02-19T19:07:36.268 INFO:tasks.workunit.client.1.smithi142.stdout:7/537: link d0/d1b/d9d/lac d0/d13/d72/d47/lb3 0 2024-02-19T19:07:36.268 INFO:tasks.workunit.client.1.smithi142.stdout:7/538: fdatasync d0/d1b/d21/f8d 0 2024-02-19T19:07:36.268 INFO:tasks.workunit.client.1.smithi142.stdout:7/539: write d0/d13/d72/f33 [1438858,32987] 0 2024-02-19T19:07:36.268 INFO:tasks.workunit.client.1.smithi142.stdout:6/564: read d2/d1f/d20/d31/fa8 [4143693,58719] 0 2024-02-19T19:07:36.269 INFO:tasks.workunit.client.1.smithi142.stdout:6/565: creat d2/d17/d33/d42/da2/da7/d55/d69/fb7 x:0 0 0 2024-02-19T19:07:36.270 INFO:tasks.workunit.client.1.smithi142.stdout:4/709: dread d4/d1d/d42/fa8 [0,4194304] 0 2024-02-19T19:07:36.270 INFO:tasks.workunit.client.1.smithi142.stdout:3/747: rename d1d/d1e/d2e/d50/d7c/da7/d3a/d62 to d1d/d1e/d2e/dee 0 2024-02-19T19:07:36.271 INFO:tasks.workunit.client.1.smithi142.stdout:3/748: readlink d1d/l31 0 2024-02-19T19:07:36.271 INFO:tasks.workunit.client.1.smithi142.stdout:3/749: fsync d1d/f35 0 2024-02-19T19:07:36.272 INFO:tasks.workunit.client.1.smithi142.stdout:0/530: creat d23/d28/d41/d78/fa8 x:0 0 0 2024-02-19T19:07:36.273 INFO:tasks.workunit.client.1.smithi142.stdout:8/643: mknod d9/dd/de/d2d/d2e/d49/d50/d59/da9/cd0 0 2024-02-19T19:07:36.273 INFO:tasks.workunit.client.1.smithi142.stdout:8/644: fsync d9/dd/de/d14/d65/f90 0 2024-02-19T19:07:36.273 INFO:tasks.workunit.client.1.smithi142.stdout:8/645: fdatasync d9/f46 0 2024-02-19T19:07:36.274 INFO:tasks.workunit.client.1.smithi142.stdout:1/773: truncate d5/d7/d4a/f94 28944 0 2024-02-19T19:07:36.275 INFO:tasks.workunit.client.1.smithi142.stdout:9/639: stat db/d10/d27/d2f/d4c/l48 0 2024-02-19T19:07:36.280 INFO:tasks.workunit.client.1.smithi142.stdout:7/540: link d0/f6b d0/d1b/d21/d24/d29/d44/d49/d9b/fb4 0 2024-02-19T19:07:36.280 INFO:tasks.workunit.client.1.smithi142.stdout:7/541: chown d0/d13/d72/d47 219622637 1 2024-02-19T19:07:36.280 INFO:tasks.workunit.client.1.smithi142.stdout:7/542: truncate d0/d1b/d21/d24/d29/d44/d49/d8b/f97 685675 0 2024-02-19T19:07:36.280 INFO:tasks.workunit.client.1.smithi142.stdout:4/710: write d4/d1c/f4b [1122375,86738] 0 2024-02-19T19:07:36.280 INFO:tasks.workunit.client.1.smithi142.stdout:4/711: stat d4/d1d/d42/d66/d12 0 2024-02-19T19:07:36.283 INFO:tasks.workunit.client.1.smithi142.stdout:6/566: symlink d2/d17/d33/d42/d5e/lb8 0 2024-02-19T19:07:36.283 INFO:tasks.workunit.client.1.smithi142.stdout:5/590: dwrite d5/dd/d8/d31/d4d/d8d/f98 [0,4194304] 0 2024-02-19T19:07:36.284 INFO:tasks.workunit.client.1.smithi142.stdout:2/546: dwrite d3/f5 [0,4194304] 0 2024-02-19T19:07:36.284 INFO:tasks.workunit.client.1.smithi142.stdout:2/547: fsync d3/db/f15 0 2024-02-19T19:07:36.284 INFO:tasks.workunit.client.1.smithi142.stdout:0/531: mknod d23/d32/d8a/ca9 0 2024-02-19T19:07:36.287 INFO:tasks.workunit.client.1.smithi142.stdout:8/646: dread d9/dd/d44/d79/f39 [0,4194304] 0 2024-02-19T19:07:36.287 INFO:tasks.workunit.client.1.smithi142.stdout:8/647: fdatasync d9/dd/de/d14/d65/f9e 0 2024-02-19T19:07:36.287 INFO:tasks.workunit.client.1.smithi142.stdout:8/648: creat d9/dd/d44/fd1 x:0 0 0 2024-02-19T19:07:36.287 INFO:tasks.workunit.client.1.smithi142.stdout:9/640: rename db/c34 to db/d10/d22/d24/d3d/d89/cac 0 2024-02-19T19:07:36.289 INFO:tasks.workunit.client.1.smithi142.stdout:4/712: symlink d4/d1c/dae/le9 0 2024-02-19T19:07:36.289 INFO:tasks.workunit.client.1.smithi142.stdout:4/713: fdatasync d4/d1d/d42/d66/f27 0 2024-02-19T19:07:36.290 INFO:tasks.workunit.client.1.smithi142.stdout:6/567: mkdir d2/d1e/d35/d66/d76/db9 0 2024-02-19T19:07:36.293 INFO:tasks.workunit.client.1.smithi142.stdout:3/750: dwrite f1c [0,4194304] 0 2024-02-19T19:07:36.293 INFO:tasks.workunit.client.1.smithi142.stdout:3/751: chown d1d/f41 44606 1 2024-02-19T19:07:36.293 INFO:tasks.workunit.client.1.smithi142.stdout:3/752: dread - d1d/d1e/d2e/d50/d7c/da7/d52/d5a/da4/fea zero size 2024-02-19T19:07:36.294 INFO:tasks.workunit.client.1.smithi142.stdout:0/532: write d23/d7d/f92 [2650654,15904] 0 2024-02-19T19:07:36.294 INFO:tasks.workunit.client.1.smithi142.stdout:5/591: stat d5/dd/d5f/l9d 0 2024-02-19T19:07:36.295 INFO:tasks.workunit.client.1.smithi142.stdout:5/592: fdatasync d5/f38 0 2024-02-19T19:07:36.295 INFO:tasks.workunit.client.1.smithi142.stdout:2/548: dread d3/d4d/f50 [0,4194304] 0 2024-02-19T19:07:36.295 INFO:tasks.workunit.client.1.smithi142.stdout:1/774: rmdir d5/d37/d6c/d75/da2 39 2024-02-19T19:07:36.296 INFO:tasks.workunit.client.1.smithi142.stdout:3/753: dread d1d/d1e/d2e/d50/d7c/da7/f5c [0,4194304] 0 2024-02-19T19:07:36.298 INFO:tasks.workunit.client.1.smithi142.stdout:8/649: unlink d9/dd/de/d2d/d2e/d49/d50/d59/l7d 0 2024-02-19T19:07:36.299 INFO:tasks.workunit.client.1.smithi142.stdout:4/714: dread d4/d1d/d42/d66/d12/f5c [4194304,4194304] 0 2024-02-19T19:07:36.301 INFO:tasks.workunit.client.1.smithi142.stdout:9/641: mkdir db/d10/d22/d24/d3d/d89/dad 0 2024-02-19T19:07:36.301 INFO:tasks.workunit.client.1.smithi142.stdout:9/642: chown db/d8e 13486672 1 2024-02-19T19:07:36.301 INFO:tasks.workunit.client.1.smithi142.stdout:9/643: write db/d10/d27/d2f/f87 [335208,84439] 0 2024-02-19T19:07:36.302 INFO:tasks.workunit.client.1.smithi142.stdout:6/568: dread d2/d1f/d4d/d60/d87/f8a [0,4194304] 0 2024-02-19T19:07:36.307 INFO:tasks.workunit.client.1.smithi142.stdout:0/533: getdents d23 0 2024-02-19T19:07:36.307 INFO:tasks.workunit.client.1.smithi142.stdout:0/534: fdatasync d23/d28/d41/f5a 0 2024-02-19T19:07:36.307 INFO:tasks.workunit.client.1.smithi142.stdout:0/535: read d23/d28/d41/f75 [327872,41129] 0 2024-02-19T19:07:36.308 INFO:tasks.workunit.client.1.smithi142.stdout:5/593: creat d5/dd/d8/d2a/d57/fca x:0 0 0 2024-02-19T19:07:36.309 INFO:tasks.workunit.client.1.smithi142.stdout:2/549: symlink d3/d4d/d5f/d7c/lb0 0 2024-02-19T19:07:36.310 INFO:tasks.workunit.client.1.smithi142.stdout:1/775: truncate d5/d7/d23/d2c/f3c 2823381 0 2024-02-19T19:07:36.310 INFO:tasks.workunit.client.1.smithi142.stdout:1/776: write d5/f68 [2119352,24197] 0 2024-02-19T19:07:36.312 INFO:tasks.workunit.client.1.smithi142.stdout:3/754: creat d1d/d1e/d2e/dee/da2/dbb/fef x:0 0 0 2024-02-19T19:07:36.312 INFO:tasks.workunit.client.1.smithi142.stdout:3/755: chown d1d/d1e/d2e/d37/d81/fe8 4822487 1 2024-02-19T19:07:36.312 INFO:tasks.workunit.client.1.smithi142.stdout:3/756: dread - d1d/d1e/d2e/d50/d7c/da7/d3a/d57/fac zero size 2024-02-19T19:07:36.313 INFO:tasks.workunit.client.1.smithi142.stdout:6/569: dread d2/d29/f94 [0,4194304] 0 2024-02-19T19:07:36.314 INFO:tasks.workunit.client.1.smithi142.stdout:8/650: symlink d9/dd/de/d2d/d2e/db3/ld2 0 2024-02-19T19:07:36.314 INFO:tasks.workunit.client.1.smithi142.stdout:9/644: dwrite db/f61 [4194304,4194304] 0 2024-02-19T19:07:36.315 INFO:tasks.workunit.client.1.smithi142.stdout:4/715: link d4/d1d/d42/d66/d5f/cb9 d4/d1d/d42/d66/d12/d2d/cea 0 2024-02-19T19:07:36.317 INFO:tasks.workunit.client.1.smithi142.stdout:0/536: dread d23/d32/f6a [0,4194304] 0 2024-02-19T19:07:36.317 INFO:tasks.workunit.client.1.smithi142.stdout:5/594: mknod d5/dd/d8/d31/d4d/d75/ccb 0 2024-02-19T19:07:36.320 INFO:tasks.workunit.client.1.smithi142.stdout:2/550: rename d3/d4d/d5f/d7c/l84 to d3/df/da4/lb1 0 2024-02-19T19:07:36.322 INFO:tasks.workunit.client.1.smithi142.stdout:9/645: creat db/d8e/fae x:0 0 0 2024-02-19T19:07:36.324 INFO:tasks.workunit.client.1.smithi142.stdout:4/716: truncate d4/d1c/fb5 992132 0 2024-02-19T19:07:36.326 INFO:tasks.workunit.client.1.smithi142.stdout:5/595: creat d5/dd/d8/d31/d4d/d8d/fcc x:0 0 0 2024-02-19T19:07:36.327 INFO:tasks.workunit.client.1.smithi142.stdout:6/570: dwrite d2/d17/d33/d42/da2/fb5 [0,4194304] 0 2024-02-19T19:07:36.328 INFO:tasks.workunit.client.1.smithi142.stdout:2/551: rename d3/d4d/d5f/d7c/c96 to d3/d4d/d5f/cb2 0 2024-02-19T19:07:36.328 INFO:tasks.workunit.client.1.smithi142.stdout:2/552: write d3/d35/f48 [1454757,103721] 0 2024-02-19T19:07:36.329 INFO:tasks.workunit.client.1.smithi142.stdout:9/646: rmdir db/d10/d32 39 2024-02-19T19:07:36.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:36.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:36.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:36.332 INFO:tasks.workunit.client.1.smithi142.stdout:4/717: symlink d4/d1d/d42/d66/d12/leb 0 2024-02-19T19:07:36.333 INFO:tasks.workunit.client.1.smithi142.stdout:0/537: rename d23/d28/f7a to d23/d28/faa 0 2024-02-19T19:07:36.334 INFO:tasks.workunit.client.1.smithi142.stdout:5/596: symlink d5/dd/df/d22/d41/lcd 0 2024-02-19T19:07:36.334 INFO:tasks.workunit.client.1.smithi142.stdout:5/597: write d5/dd/d8/d31/f34 [4329464,519] 0 2024-02-19T19:07:36.334 INFO:tasks.workunit.client.1.smithi142.stdout:5/598: stat d5/dd/d8/dbc/lc3 0 2024-02-19T19:07:36.335 INFO:tasks.workunit.client.1.smithi142.stdout:6/571: mknod d2/d1f/d20/cba 0 2024-02-19T19:07:36.337 INFO:tasks.workunit.client.1.smithi142.stdout:4/718: link d4/d1d/d42/d66/d12/d2d/f75 d4/d1d/d42/d66/dd/d10/d26/fec 0 2024-02-19T19:07:36.338 INFO:tasks.workunit.client.1.smithi142.stdout:9/647: getdents db/d10/d32 0 2024-02-19T19:07:36.339 INFO:tasks.workunit.client.1.smithi142.stdout:4/719: mkdir d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba/ded 0 2024-02-19T19:07:36.340 INFO:tasks.workunit.client.1.smithi142.stdout:9/648: truncate db/d10/d22/f9e 3847846 0 2024-02-19T19:07:36.341 INFO:tasks.workunit.client.1.smithi142.stdout:9/649: mkdir db/d10/d22/daf 0 2024-02-19T19:07:36.352 INFO:tasks.workunit.client.1.smithi142.stdout:4/720: dread d4/d1d/f5b [0,4194304] 0 2024-02-19T19:07:36.353 INFO:tasks.workunit.client.1.smithi142.stdout:4/721: mknod d4/d1d/d42/d66/dd/d10/d26/cee 0 2024-02-19T19:07:36.353 INFO:tasks.workunit.client.1.smithi142.stdout:4/722: fsync d4/d14/f16 0 2024-02-19T19:07:36.353 INFO:tasks.workunit.client.1.smithi142.stdout:4/723: chown d4/d14/d31/dab/d6e/cd3 11 1 2024-02-19T19:07:36.353 INFO:tasks.workunit.client.1.smithi142.stdout:4/724: rmdir d4/d1d/d42/d66/dd/d10/d26/d50/d54 39 2024-02-19T19:07:36.354 INFO:tasks.workunit.client.1.smithi142.stdout:9/650: write db/d10/d27/d2f/d4c/f9f [7273168,86842] 0 2024-02-19T19:07:36.355 INFO:tasks.workunit.client.1.smithi142.stdout:4/725: link d4/d1d/d42/d66/d5f/cb9 d4/d1d/d42/d66/d12/d79/d8c/cef 0 2024-02-19T19:07:36.355 INFO:tasks.workunit.client.1.smithi142.stdout:4/726: fdatasync d4/d1d/d42/d66/dd/d10/d26/d50/d54/f59 0 2024-02-19T19:07:36.355 INFO:tasks.workunit.client.1.smithi142.stdout:4/727: chown d4/d14/d31/f61 40481 1 2024-02-19T19:07:36.356 INFO:tasks.workunit.client.1.smithi142.stdout:4/728: creat d4/d1d/d42/d66/dd/d10/d3e/d68/d87/ff0 x:0 0 0 2024-02-19T19:07:36.362 INFO:tasks.workunit.client.1.smithi142.stdout:5/599: dwrite d5/f38 [0,4194304] 0 2024-02-19T19:07:36.363 INFO:tasks.workunit.client.1.smithi142.stdout:5/600: write d5/dd/df/d15/fbe [1433383,82677] 0 2024-02-19T19:07:36.367 INFO:tasks.workunit.client.1.smithi142.stdout:9/651: dread db/d10/d32/d3f/d5f/fa8 [0,4194304] 0 2024-02-19T19:07:36.381 INFO:tasks.workunit.client.1.smithi142.stdout:9/652: dwrite db/d10/d22/f46 [0,4194304] 0 2024-02-19T19:07:36.381 INFO:tasks.workunit.client.1.smithi142.stdout:9/653: write db/d10/d27/d2f/f94 [1948155,21074] 0 2024-02-19T19:07:36.381 INFO:tasks.workunit.client.1.smithi142.stdout:9/654: write db/d10/d22/d24/d41/f74 [966426,108769] 0 2024-02-19T19:07:36.389 INFO:tasks.workunit.client.1.smithi142.stdout:3/757: write d1d/d1e/d2e/f63 [3492473,75815] 0 2024-02-19T19:07:36.389 INFO:tasks.workunit.client.1.smithi142.stdout:3/758: fsync d1d/d1e/d2e/d50/d7c/da7/d3a/f4b 0 2024-02-19T19:07:36.389 INFO:tasks.workunit.client.1.smithi142.stdout:3/759: creat d1d/d1e/d2e/ff0 x:0 0 0 2024-02-19T19:07:36.389 INFO:tasks.workunit.client.1.smithi142.stdout:3/760: write d1d/f41 [2272497,103768] 0 2024-02-19T19:07:36.390 INFO:tasks.workunit.client.1.smithi142.stdout:6/572: write d2/d17/d33/d39/f70 [38087,39810] 0 2024-02-19T19:07:36.390 INFO:tasks.workunit.client.1.smithi142.stdout:2/553: dread d3/db/d29/d6d/d59/f6e [0,4194304] 0 2024-02-19T19:07:36.391 INFO:tasks.workunit.client.1.smithi142.stdout:1/777: dwrite d5/d1a/ffb [0,4194304] 0 2024-02-19T19:07:36.393 INFO:tasks.workunit.client.1.smithi142.stdout:3/761: mkdir d1d/d1e/d2e/dee/da2/df1 0 2024-02-19T19:07:36.395 INFO:tasks.workunit.client.1.smithi142.stdout:6/573: mkdir d2/d1f/d5c/dbb 0 2024-02-19T19:07:36.395 INFO:tasks.workunit.client.1.smithi142.stdout:2/554: symlink d3/db/d29/d4c/d4e/lb3 0 2024-02-19T19:07:36.396 INFO:tasks.workunit.client.1.smithi142.stdout:2/555: stat d3/d4d/d5f/d7c/lb0 0 2024-02-19T19:07:36.396 INFO:tasks.workunit.client.1.smithi142.stdout:2/556: readlink d3/db/d29/d4c/d4e/lb3 0 2024-02-19T19:07:36.396 INFO:tasks.workunit.client.1.smithi142.stdout:0/538: dwrite d23/d28/d41/f91 [0,4194304] 0 2024-02-19T19:07:36.397 INFO:tasks.workunit.client.1.smithi142.stdout:4/729: write d4/d1d/d42/f9c [3967241,90782] 0 2024-02-19T19:07:36.397 INFO:tasks.workunit.client.1.smithi142.stdout:4/730: read d4/d1d/d42/d66/d12/d79/fa3 [73553,59830] 0 2024-02-19T19:07:36.399 INFO:tasks.workunit.client.1.smithi142.stdout:1/778: mknod d5/d37/d6c/d75/da2/c115 0 2024-02-19T19:07:36.401 INFO:tasks.workunit.client.1.smithi142.stdout:2/557: mkdir d3/db/d29/d6d/d59/db4 0 2024-02-19T19:07:36.403 INFO:tasks.workunit.client.1.smithi142.stdout:3/762: dread d1d/d1e/d2e/d50/d7c/da7/f3d [8388608,4194304] 0 2024-02-19T19:07:36.403 INFO:tasks.workunit.client.1.smithi142.stdout:9/655: dwrite db/d10/d27/d2f/d4c/f7a [0,4194304] 0 2024-02-19T19:07:36.403 INFO:tasks.workunit.client.1.smithi142.stdout:3/763: creat d1d/d1e/d2e/d37/d6c/da9/ff2 x:0 0 0 2024-02-19T19:07:36.403 INFO:tasks.workunit.client.1.smithi142.stdout:0/539: link d23/d32/d8a/f96 d23/d28/d2d/d51/d44/fab 0 2024-02-19T19:07:36.407 INFO:tasks.workunit.client.1.smithi142.stdout:4/731: rename d4/d34/f97 to d4/d1d/d42/d66/d2c/ff1 0 2024-02-19T19:07:36.409 INFO:tasks.workunit.client.1.smithi142.stdout:1/779: rmdir d5/d1a/d33/dce 39 2024-02-19T19:07:36.411 INFO:tasks.workunit.client.1.smithi142.stdout:0/540: read f16 [2173992,27007] 0 2024-02-19T19:07:36.416 INFO:tasks.workunit.client.1.smithi142.stdout:4/732: dread d4/d1d/d42/d66/f8a [0,4194304] 0 2024-02-19T19:07:36.416 INFO:tasks.workunit.client.1.smithi142.stdout:4/733: write d4/d14/d31/dab/d6e/fc4 [614693,21679] 0 2024-02-19T19:07:36.416 INFO:tasks.workunit.client.1.smithi142.stdout:1/780: dread d5/d1a/d33/f4d [0,4194304] 0 2024-02-19T19:07:36.417 INFO:tasks.workunit.client.1.smithi142.stdout:6/574: getdents d2 0 2024-02-19T19:07:36.419 INFO:tasks.workunit.client.1.smithi142.stdout:6/575: dread d2/d1f/d56/f8e [0,4194304] 0 2024-02-19T19:07:36.419 INFO:tasks.workunit.client.1.smithi142.stdout:2/558: mkdir d3/d4d/d5f/db5 0 2024-02-19T19:07:36.419 INFO:tasks.workunit.client.1.smithi142.stdout:6/576: chown d2/d1e/l4c 14818315 1 2024-02-19T19:07:36.422 INFO:tasks.workunit.client.1.smithi142.stdout:9/656: creat db/d10/d32/d3f/d5f/fb0 x:0 0 0 2024-02-19T19:07:36.424 INFO:tasks.workunit.client.1.smithi142.stdout:3/764: mknod d1d/d1e/d2e/d50/d7c/da7/d52/d5a/da4/cf3 0 2024-02-19T19:07:36.425 INFO:tasks.workunit.client.1.smithi142.stdout:0/541: symlink d23/d28/d41/d78/lac 0 2024-02-19T19:07:36.426 INFO:tasks.workunit.client.1.smithi142.stdout:4/734: symlink d4/d1c/dae/lf2 0 2024-02-19T19:07:36.428 INFO:tasks.workunit.client.1.smithi142.stdout:6/577: mknod d2/d1f/d5c/d63/cbc 0 2024-02-19T19:07:36.428 INFO:tasks.workunit.client.1.smithi142.stdout:6/578: read d2/d1f/d20/f25 [2917157,86878] 0 2024-02-19T19:07:36.429 INFO:tasks.workunit.client.1.smithi142.stdout:3/765: link d1d/db6/fb8 d1d/d1e/d2e/d50/ff4 0 2024-02-19T19:07:36.430 INFO:tasks.workunit.client.1.smithi142.stdout:9/657: dread db/d10/d22/f46 [0,4194304] 0 2024-02-19T19:07:36.430 INFO:tasks.workunit.client.1.smithi142.stdout:9/658: fsync db/d10/d27/d2f/d4c/d59/f71 0 2024-02-19T19:07:36.430 INFO:tasks.workunit.client.1.smithi142.stdout:0/542: creat d23/d7d/fad x:0 0 0 2024-02-19T19:07:36.432 INFO:tasks.workunit.client.1.smithi142.stdout:4/735: creat d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba/dd2/ff3 x:0 0 0 2024-02-19T19:07:36.433 INFO:tasks.workunit.client.1.smithi142.stdout:1/781: rmdir d5/d77/da9/dae/db2 39 2024-02-19T19:07:36.434 INFO:tasks.workunit.client.1.smithi142.stdout:6/579: stat d2/l16 0 2024-02-19T19:07:36.434 INFO:tasks.workunit.client.1.smithi142.stdout:2/559: dwrite d3/df/f10 [0,4194304] 0 2024-02-19T19:07:36.434 INFO:tasks.workunit.client.1.smithi142.stdout:2/560: chown d3/db/l3d 172 1 2024-02-19T19:07:36.435 INFO:tasks.workunit.client.1.smithi142.stdout:3/766: symlink d1d/d1e/d2e/dee/d8d/de4/lf5 0 2024-02-19T19:07:36.437 INFO:tasks.workunit.client.1.smithi142.stdout:9/659: truncate db/d10/d27/f42 1473740 0 2024-02-19T19:07:36.437 INFO:tasks.workunit.client.1.smithi142.stdout:9/660: fdatasync db/d10/d22/f37 0 2024-02-19T19:07:36.437 INFO:tasks.workunit.client.1.smithi142.stdout:9/661: write db/d10/d22/f9d [240317,111276] 0 2024-02-19T19:07:36.439 INFO:tasks.workunit.client.1.smithi142.stdout:0/543: link d23/d28/d2d/d51/d44/d58/f62 d23/d28/d2d/d54/d88/fae 0 2024-02-19T19:07:36.439 INFO:tasks.workunit.client.1.smithi142.stdout:1/782: rmdir d5/d7/d23/dab 39 2024-02-19T19:07:36.439 INFO:tasks.workunit.client.1.smithi142.stdout:1/783: truncate d5/d7/d4a/f94 184600 0 2024-02-19T19:07:36.443 INFO:tasks.workunit.client.1.smithi142.stdout:2/561: rmdir d3/d4d/d5f 39 2024-02-19T19:07:36.445 INFO:tasks.workunit.client.1.smithi142.stdout:3/767: link d1d/d1e/d2e/d50/d7c/da7/d3a/c4e d1d/d1e/d2e/d50/d7c/da7/d3a/dc7/cf6 0 2024-02-19T19:07:36.450 INFO:tasks.workunit.client.1.smithi142.stdout:2/562: link d3/f62 d3/db/d29/d4c/d4a/fb6 0 2024-02-19T19:07:36.452 INFO:tasks.workunit.client.1.smithi142.stdout:3/768: symlink d1d/d1e/d2e/dee/da2/df1/lf7 0 2024-02-19T19:07:36.452 INFO:tasks.workunit.client.1.smithi142.stdout:3/769: creat d1d/d1e/d2e/d37/d6c/da9/ff8 x:0 0 0 2024-02-19T19:07:36.452 INFO:tasks.workunit.client.1.smithi142.stdout:3/770: dread - d1d/d1e/d2e/d50/d7c/fe3 zero size 2024-02-19T19:07:36.455 INFO:tasks.workunit.client.1.smithi142.stdout:4/736: dwrite d4/d1d/d42/d66/d5f/fd1 [0,4194304] 0 2024-02-19T19:07:36.456 INFO:tasks.workunit.client.1.smithi142.stdout:4/737: fsync d4/d14/f2f 0 2024-02-19T19:07:36.459 INFO:tasks.workunit.client.1.smithi142.stdout:2/563: getdents d3/d4d/d5f/d7c 0 2024-02-19T19:07:36.460 INFO:tasks.workunit.client.1.smithi142.stdout:7/543: sync 2024-02-19T19:07:36.460 INFO:tasks.workunit.client.1.smithi142.stdout:7/544: chown d0/d1b/d21/d24/d29/d44/d49/f64 11 1 2024-02-19T19:07:36.461 INFO:tasks.workunit.client.1.smithi142.stdout:3/771: mknod d1d/d1e/d2e/d37/d81/db7/cf9 0 2024-02-19T19:07:36.464 INFO:tasks.workunit.client.1.smithi142.stdout:6/580: dwrite d2/d17/d33/d42/da2/da7/d55/daf/fb3 [0,4194304] 0 2024-02-19T19:07:36.464 INFO:tasks.workunit.client.1.smithi142.stdout:6/581: chown d2/d1f/d56 7045 1 2024-02-19T19:07:36.466 INFO:tasks.workunit.client.1.smithi142.stdout:4/738: unlink d4/d1d/d42/d66/d5f/l99 0 2024-02-19T19:07:36.467 INFO:tasks.workunit.client.1.smithi142.stdout:0/544: dwrite d23/d28/d41/d78/fa8 [0,4194304] 0 2024-02-19T19:07:36.469 INFO:tasks.workunit.client.1.smithi142.stdout:3/772: creat d1d/d1e/d2e/dee/ffa x:0 0 0 2024-02-19T19:07:36.469 INFO:tasks.workunit.client.1.smithi142.stdout:3/773: write d1d/d1e/d2e/d37/d6c/da9/ff8 [989033,23583] 0 2024-02-19T19:07:36.469 INFO:tasks.workunit.client.1.smithi142.stdout:1/784: dwrite d5/d7/d34/d6f/f88 [0,4194304] 0 2024-02-19T19:07:36.476 INFO:tasks.workunit.client.1.smithi142.stdout:0/545: rename d23/d28/d2d/d51/f4f to d23/d7d/faf 0 2024-02-19T19:07:36.476 INFO:tasks.workunit.client.1.smithi142.stdout:0/546: creat d23/d32/d8a/fb0 x:0 0 0 2024-02-19T19:07:36.478 INFO:tasks.workunit.client.1.smithi142.stdout:9/662: rmdir db 39 2024-02-19T19:07:36.480 INFO:tasks.workunit.client.1.smithi142.stdout:3/774: mkdir d1d/d1e/d2e/dee/dc1/dfb 0 2024-02-19T19:07:36.480 INFO:tasks.workunit.client.1.smithi142.stdout:3/775: write d1d/d1e/d2e/d50/d7c/da7/d52/d5a/f94 [2438895,8404] 0 2024-02-19T19:07:36.480 INFO:tasks.workunit.client.1.smithi142.stdout:3/776: chown d1d/d1e/d2e/d50/d7c/da7/d52/d5a/da4/cf3 1 1 2024-02-19T19:07:36.480 INFO:tasks.workunit.client.1.smithi142.stdout:7/545: dread d0/d13/f27 [0,4194304] 0 2024-02-19T19:07:36.480 INFO:tasks.workunit.client.1.smithi142.stdout:7/546: readlink d0/d13/d72/d47/lb3 0 2024-02-19T19:07:36.482 INFO:tasks.workunit.client.1.smithi142.stdout:1/785: creat d5/d37/d6c/d75/da2/f116 x:0 0 0 2024-02-19T19:07:36.483 INFO:tasks.workunit.client.1.smithi142.stdout:1/786: write d5/d37/d6c/d75/da2/f116 [770983,44396] 0 2024-02-19T19:07:36.483 INFO:tasks.workunit.client.1.smithi142.stdout:1/787: dread - d5/d7/d4a/d53/d6a/f79 zero size 2024-02-19T19:07:36.483 INFO:tasks.workunit.client.1.smithi142.stdout:1/788: creat d5/f117 x:0 0 0 2024-02-19T19:07:36.483 INFO:tasks.workunit.client.1.smithi142.stdout:1/789: dread - d5/d37/d6c/d75/da2/ffe zero size 2024-02-19T19:07:36.483 INFO:tasks.workunit.client.1.smithi142.stdout:2/564: dwrite d3/df/f31 [0,4194304] 0 2024-02-19T19:07:36.483 INFO:tasks.workunit.client.1.smithi142.stdout:6/582: dwrite d2/d1f/d56/f8e [0,4194304] 0 2024-02-19T19:07:36.483 INFO:tasks.workunit.client.1.smithi142.stdout:8/651: sync 2024-02-19T19:07:36.483 INFO:tasks.workunit.client.1.smithi142.stdout:5/601: sync 2024-02-19T19:07:36.484 INFO:tasks.workunit.client.1.smithi142.stdout:8/652: truncate d9/dd/de/d2d/d2e/d49/d50/d59/f66 4401832 0 2024-02-19T19:07:36.485 INFO:tasks.workunit.client.1.smithi142.stdout:0/547: mkdir d23/d32/d8a/db1 0 2024-02-19T19:07:36.487 INFO:tasks.workunit.client.1.smithi142.stdout:7/547: symlink d0/d1b/d21/d24/d29/d7e/lb5 0 2024-02-19T19:07:36.493 INFO:tasks.workunit.client.1.smithi142.stdout:4/739: dwrite d4/d14/f16 [0,4194304] 0 2024-02-19T19:07:36.493 INFO:tasks.workunit.client.1.smithi142.stdout:6/583: dread d2/d1f/d5c/f6f [0,4194304] 0 2024-02-19T19:07:36.494 INFO:tasks.workunit.client.1.smithi142.stdout:3/777: dwrite d1d/d1e/f21 [0,4194304] 0 2024-02-19T19:07:36.494 INFO:tasks.workunit.client.1.smithi142.stdout:3/778: chown f9 633 1 2024-02-19T19:07:36.497 INFO:tasks.workunit.client.1.smithi142.stdout:5/602: stat d5/dd/df/d22/d41/d32/lb8 0 2024-02-19T19:07:36.497 INFO:tasks.workunit.client.1.smithi142.stdout:0/548: write d23/d28/d2d/d51/d44/f89 [3459682,49705] 0 2024-02-19T19:07:36.499 INFO:tasks.workunit.client.1.smithi142.stdout:8/653: mknod d9/dd/de/d2d/d2e/d49/d58/cd3 0 2024-02-19T19:07:36.502 INFO:tasks.workunit.client.1.smithi142.stdout:7/548: mknod d0/d1b/d21/d24/d29/d7e/cb6 0 2024-02-19T19:07:36.503 INFO:tasks.workunit.client.1.smithi142.stdout:3/779: dread d1d/f2b [0,4194304] 0 2024-02-19T19:07:36.503 INFO:tasks.workunit.client.1.smithi142.stdout:3/780: chown l1b 80 1 2024-02-19T19:07:36.503 INFO:tasks.workunit.client.1.smithi142.stdout:3/781: fsync d1d/d1e/d2e/d50/d7c/da7/f3d 0 2024-02-19T19:07:36.505 INFO:tasks.workunit.client.1.smithi142.stdout:0/549: dread d23/d28/d2d/f60 [0,4194304] 0 2024-02-19T19:07:36.507 INFO:tasks.workunit.client.1.smithi142.stdout:2/565: rmdir d3/db/d29/d4c 39 2024-02-19T19:07:36.509 INFO:tasks.workunit.client.1.smithi142.stdout:6/584: rmdir d2/d1e/d35/d66/d8d 39 2024-02-19T19:07:36.509 INFO:tasks.workunit.client.1.smithi142.stdout:6/585: fsync d2/d17/d33/d39/f86 0 2024-02-19T19:07:36.509 INFO:tasks.workunit.client.1.smithi142.stdout:6/586: chown d2/d1f 5 1 2024-02-19T19:07:36.511 INFO:tasks.workunit.client.1.smithi142.stdout:4/740: link d4/d1d/d42/d66/dd/d10/d26/d50/d54/f59 d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba/dd2/ff4 0 2024-02-19T19:07:36.511 INFO:tasks.workunit.client.1.smithi142.stdout:3/782: dread d1d/d1e/d2e/dee/da2/fd2 [0,4194304] 0 2024-02-19T19:07:36.511 INFO:tasks.workunit.client.1.smithi142.stdout:3/783: chown d1d/d1e/d2e/d50/d83/fae 3 1 2024-02-19T19:07:36.514 INFO:tasks.workunit.client.1.smithi142.stdout:8/654: dwrite d9/dd/de/d14/d65/f9e [0,4194304] 0 2024-02-19T19:07:36.514 INFO:tasks.workunit.client.1.smithi142.stdout:4/741: dread d4/f5 [0,4194304] 0 2024-02-19T19:07:36.516 INFO:tasks.workunit.client.1.smithi142.stdout:5/603: link d5/dd/df/d22/d41/d32/fa8 d5/dd/df/d15/d5b/fce 0 2024-02-19T19:07:36.516 INFO:tasks.workunit.client.1.smithi142.stdout:5/604: chown d5/fb3 1252 1 2024-02-19T19:07:36.517 INFO:tasks.workunit.client.1.smithi142.stdout:7/549: mkdir d0/d13/d1e/db7 0 2024-02-19T19:07:36.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/550: symlink d23/d7d/d9e/lb2 0 2024-02-19T19:07:36.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/551: readlink d23/d28/d2d/d51/l55 0 2024-02-19T19:07:36.518 INFO:tasks.workunit.client.1.smithi142.stdout:6/587: mknod d2/d17/d33/d42/da2/da7/d55/cbd 0 2024-02-19T19:07:36.518 INFO:tasks.workunit.client.1.smithi142.stdout:6/588: creat d2/d1f/d5c/fbe x:0 0 0 2024-02-19T19:07:36.518 INFO:tasks.workunit.client.1.smithi142.stdout:6/589: chown d2/d1f/l79 608570507 1 2024-02-19T19:07:36.523 INFO:tasks.workunit.client.1.smithi142.stdout:4/742: creat d4/d1d/d42/d66/dd/d10/d3e/ff5 x:0 0 0 2024-02-19T19:07:36.523 INFO:tasks.workunit.client.1.smithi142.stdout:4/743: chown d4/d14/d31/dab/da2/cbf 35972408 1 2024-02-19T19:07:36.523 INFO:tasks.workunit.client.1.smithi142.stdout:4/744: truncate d4/d14/d31/dab/da2/db3/fd5 345862 0 2024-02-19T19:07:36.524 INFO:tasks.workunit.client.1.smithi142.stdout:4/745: chown d4/d14/d31/f7d 2014 1 2024-02-19T19:07:36.524 INFO:tasks.workunit.client.1.smithi142.stdout:4/746: readlink d4/d1d/d42/d66/d12/d2d/d2a/d84/l8f 0 2024-02-19T19:07:36.524 INFO:tasks.workunit.client.1.smithi142.stdout:7/550: mknod d0/d13/d1e/cb8 0 2024-02-19T19:07:36.525 INFO:tasks.workunit.client.1.smithi142.stdout:0/552: mknod d23/cb3 0 2024-02-19T19:07:36.528 INFO:tasks.workunit.client.1.smithi142.stdout:6/590: symlink d2/d1e/lbf 0 2024-02-19T19:07:36.533 INFO:tasks.workunit.client.1.smithi142.stdout:3/784: rmdir d1d/d1e/d2e/d50/d7c 39 2024-02-19T19:07:36.534 INFO:tasks.workunit.client.1.smithi142.stdout:4/747: creat d4/d1c/dae/dcb/ff6 x:0 0 0 2024-02-19T19:07:36.535 INFO:tasks.workunit.client.1.smithi142.stdout:7/551: creat d0/d1b/d21/d24/d29/d44/d49/d9b/fb9 x:0 0 0 2024-02-19T19:07:36.536 INFO:tasks.workunit.client.1.smithi142.stdout:2/566: dwrite d3/f5 [4194304,4194304] 0 2024-02-19T19:07:36.536 INFO:tasks.workunit.client.1.smithi142.stdout:2/567: write d3/db/d29/d6d/d59/f6e [1316880,76551] 0 2024-02-19T19:07:36.536 INFO:tasks.workunit.client.1.smithi142.stdout:2/568: stat d3/f8 0 2024-02-19T19:07:36.536 INFO:tasks.workunit.client.1.smithi142.stdout:2/569: readlink d3/df/l94 0 2024-02-19T19:07:36.536 INFO:tasks.workunit.client.1.smithi142.stdout:0/553: symlink d23/d28/d2d/d54/d85/lb4 0 2024-02-19T19:07:36.536 INFO:tasks.workunit.client.1.smithi142.stdout:8/655: dwrite d9/dd/de/d2d/d2e/d49/d50/d59/f8e [0,4194304] 0 2024-02-19T19:07:36.537 INFO:tasks.workunit.client.1.smithi142.stdout:5/605: dwrite d5/dd/d8/d31/d4d/d8d/fcc [0,4194304] 0 2024-02-19T19:07:36.537 INFO:tasks.workunit.client.1.smithi142.stdout:6/591: mkdir d2/d17/d33/d42/da2/da7/d55/dc0 0 2024-02-19T19:07:36.537 INFO:tasks.workunit.client.1.smithi142.stdout:6/592: readlink d2/le 0 2024-02-19T19:07:36.537 INFO:tasks.workunit.client.1.smithi142.stdout:4/748: mkdir d4/d1d/d42/d66/dd/d10/d26/df7 0 2024-02-19T19:07:36.538 INFO:tasks.workunit.client.1.smithi142.stdout:4/749: creat d4/d1d/ff8 x:0 0 0 2024-02-19T19:07:36.539 INFO:tasks.workunit.client.1.smithi142.stdout:7/552: creat d0/d1b/d21/fba x:0 0 0 2024-02-19T19:07:36.539 INFO:tasks.workunit.client.1.smithi142.stdout:8/656: dread d9/dd/de/d14/f20 [0,4194304] 0 2024-02-19T19:07:36.540 INFO:tasks.workunit.client.1.smithi142.stdout:2/570: rename d3/d4b/l74 to d3/d35/d53/lb7 0 2024-02-19T19:07:36.540 INFO:tasks.workunit.client.1.smithi142.stdout:2/571: fdatasync d3/db/f3a 0 2024-02-19T19:07:36.541 INFO:tasks.workunit.client.1.smithi142.stdout:4/750: dread d4/f5 [0,4194304] 0 2024-02-19T19:07:36.542 INFO:tasks.workunit.client.1.smithi142.stdout:5/606: rmdir d5/dd/df/d22/d41/d6f 39 2024-02-19T19:07:36.543 INFO:tasks.workunit.client.1.smithi142.stdout:6/593: mknod d2/d17/d33/d42/cc1 0 2024-02-19T19:07:36.543 INFO:tasks.workunit.client.1.smithi142.stdout:6/594: write d2/d17/f73 [1404706,115943] 0 2024-02-19T19:07:36.545 INFO:tasks.workunit.client.1.smithi142.stdout:7/553: creat d0/d13/d72/d47/fbb x:0 0 0 2024-02-19T19:07:36.545 INFO:tasks.workunit.client.1.smithi142.stdout:2/572: dread d3/db/f47 [0,4194304] 0 2024-02-19T19:07:36.545 INFO:tasks.workunit.client.1.smithi142.stdout:2/573: chown d3/d4b/f8c 682 1 2024-02-19T19:07:36.545 INFO:tasks.workunit.client.1.smithi142.stdout:2/574: write d3/db/d29/d6d/f56 [449245,94410] 0 2024-02-19T19:07:36.545 INFO:tasks.workunit.client.1.smithi142.stdout:8/657: symlink d9/dd/de/d14/d65/db1/ld4 0 2024-02-19T19:07:36.546 INFO:tasks.workunit.client.1.smithi142.stdout:7/554: dread d0/d1b/d21/d24/d29/d44/d49/d8b/f97 [0,4194304] 0 2024-02-19T19:07:36.546 INFO:tasks.workunit.client.1.smithi142.stdout:5/607: mknod d5/dd/d5f/ccf 0 2024-02-19T19:07:36.546 INFO:tasks.workunit.client.1.smithi142.stdout:5/608: fdatasync d5/dd/df/d15/d5b/fce 0 2024-02-19T19:07:36.548 INFO:tasks.workunit.client.1.smithi142.stdout:2/575: symlink d3/db/d29/d4c/d4e/d9a/da9/lb8 0 2024-02-19T19:07:36.550 INFO:tasks.workunit.client.1.smithi142.stdout:2/576: rmdir d3/db/d29/d4c/d4e/d9a/d9d 0 2024-02-19T19:07:36.551 INFO:tasks.workunit.client.1.smithi142.stdout:2/577: unlink d3/d4d/d5f/d7c/lb0 0 2024-02-19T19:07:36.553 INFO:tasks.workunit.client.1.smithi142.stdout:2/578: mkdir d3/db/d29/d4c/d4e/db9 0 2024-02-19T19:07:36.554 INFO:tasks.workunit.client.1.smithi142.stdout:2/579: mkdir d3/db/d29/dba 0 2024-02-19T19:07:36.556 INFO:tasks.workunit.client.1.smithi142.stdout:6/595: dread d2/d1f/f30 [0,4194304] 0 2024-02-19T19:07:36.557 INFO:tasks.workunit.client.1.smithi142.stdout:6/596: symlink d2/lc2 0 2024-02-19T19:07:36.557 INFO:tasks.workunit.client.1.smithi142.stdout:6/597: creat d2/d1f/fc3 x:0 0 0 2024-02-19T19:07:36.558 INFO:tasks.workunit.client.1.smithi142.stdout:6/598: truncate d2/d29/f94 1463640 0 2024-02-19T19:07:36.560 INFO:tasks.workunit.client.1.smithi142.stdout:5/609: read f4 [2305968,121491] 0 2024-02-19T19:07:36.560 INFO:tasks.workunit.client.1.smithi142.stdout:5/610: write d5/dd/d8/d31/d4d/d60/f73 [51920,84196] 0 2024-02-19T19:07:36.560 INFO:tasks.workunit.client.1.smithi142.stdout:6/599: rename d2/d1f/d20/l22 to d2/d17/d33/d42/da2/da7/lc4 0 2024-02-19T19:07:36.561 INFO:tasks.workunit.client.1.smithi142.stdout:6/600: getdents d2/d1f/d5c/dbb 0 2024-02-19T19:07:36.561 INFO:tasks.workunit.client.1.smithi142.stdout:6/601: fdatasync d2/d1e/d35/d66/d8d/f50 0 2024-02-19T19:07:36.563 INFO:tasks.workunit.client.1.smithi142.stdout:6/602: mknod d2/d17/d33/d42/da2/da7/d55/dc0/cc5 0 2024-02-19T19:07:36.564 INFO:tasks.workunit.client.1.smithi142.stdout:6/603: rmdir d2/d17/d33/d42/da2/da7/d55 39 2024-02-19T19:07:36.565 INFO:tasks.workunit.client.1.smithi142.stdout:6/604: truncate d2/d1e/d35/d66/d8d/d3e/f46 347179 0 2024-02-19T19:07:36.566 INFO:tasks.workunit.client.1.smithi142.stdout:6/605: stat d2/d1f/d20/d31/d88/d8f/l92 0 2024-02-19T19:07:36.566 INFO:tasks.workunit.client.1.smithi142.stdout:6/606: truncate d2/d1f/f2b 1104009 0 2024-02-19T19:07:36.568 INFO:tasks.workunit.client.1.smithi142.stdout:4/751: dwrite d4/d14/d31/dab/f63 [0,4194304] 0 2024-02-19T19:07:36.568 INFO:tasks.workunit.client.1.smithi142.stdout:4/752: truncate d4/d1d/d42/d66/d12/d2d/d2a/f4c 1785639 0 2024-02-19T19:07:36.568 INFO:tasks.workunit.client.1.smithi142.stdout:6/607: link d2/d1e/c21 d2/d29/d47/cc6 0 2024-02-19T19:07:36.569 INFO:tasks.workunit.client.1.smithi142.stdout:4/753: mknod d4/d1d/d42/d66/d12/cf9 0 2024-02-19T19:07:36.570 INFO:tasks.workunit.client.1.smithi142.stdout:4/754: write d4/d34/d44/fe5 [1112436,120207] 0 2024-02-19T19:07:36.570 INFO:tasks.workunit.client.1.smithi142.stdout:4/755: chown d4/d1d/d42/d66/d12/c46 230598 1 2024-02-19T19:07:36.570 INFO:tasks.workunit.client.1.smithi142.stdout:4/756: stat d4/d1d/d42/d66/d12/f5c 0 2024-02-19T19:07:36.570 INFO:tasks.workunit.client.1.smithi142.stdout:6/608: mknod d2/cc7 0 2024-02-19T19:07:36.571 INFO:tasks.workunit.client.1.smithi142.stdout:4/757: mkdir d4/d1c/dae/dfa 0 2024-02-19T19:07:36.571 INFO:tasks.workunit.client.1.smithi142.stdout:4/758: rename d4/d1d/d42/d66/d12 to d4/d1d/d42/d66/d12/d2d/dfb 22 2024-02-19T19:07:36.571 INFO:tasks.workunit.client.1.smithi142.stdout:4/759: write d4/d1c/f22 [27813,111094] 0 2024-02-19T19:07:36.572 INFO:tasks.workunit.client.1.smithi142.stdout:4/760: fdatasync d4/d1c/dae/dcb/ff6 0 2024-02-19T19:07:36.572 INFO:tasks.workunit.client.1.smithi142.stdout:4/761: stat d4/d14/f2f 0 2024-02-19T19:07:36.572 INFO:tasks.workunit.client.1.smithi142.stdout:3/785: dwrite d1d/d1e/dcd/fd5 [0,4194304] 0 2024-02-19T19:07:36.572 INFO:tasks.workunit.client.1.smithi142.stdout:6/609: mknod d2/d17/d33/d42/d5e/cc8 0 2024-02-19T19:07:36.572 INFO:tasks.workunit.client.1.smithi142.stdout:8/658: dwrite d9/dd/d15/f1f [4194304,4194304] 0 2024-02-19T19:07:36.573 INFO:tasks.workunit.client.1.smithi142.stdout:7/555: dwrite d0/d1b/d21/d24/d29/d44/d49/d9b/fa0 [0,4194304] 0 2024-02-19T19:07:36.573 INFO:tasks.workunit.client.1.smithi142.stdout:7/556: write d0/d1b/d21/d24/f28 [1917919,67643] 0 2024-02-19T19:07:36.573 INFO:tasks.workunit.client.1.smithi142.stdout:5/611: dwrite d5/dd/f68 [0,4194304] 0 2024-02-19T19:07:36.573 INFO:tasks.workunit.client.1.smithi142.stdout:5/612: readlink d5/dd/d8/d2a/d93/lc9 0 2024-02-19T19:07:36.573 INFO:tasks.workunit.client.1.smithi142.stdout:5/613: truncate d5/dd/d8/d2a/d57/fca 370577 0 2024-02-19T19:07:36.580 INFO:tasks.workunit.client.1.smithi142.stdout:4/762: dread d4/d1d/d42/f9c [0,4194304] 0 2024-02-19T19:07:36.583 INFO:tasks.workunit.client.1.smithi142.stdout:3/786: link d1d/d1e/d2e/d50/d7c/da7/d52/d71/fdb d1d/d1e/d2e/d50/d7c/da7/d3a/ffc 0 2024-02-19T19:07:36.583 INFO:tasks.workunit.client.1.smithi142.stdout:3/787: fsync d1d/d1e/d6e/f6f 0 2024-02-19T19:07:36.584 INFO:tasks.workunit.client.1.smithi142.stdout:7/557: write d0/d13/d72/d47/d69/f2e [3856548,1986] 0 2024-02-19T19:07:36.584 INFO:tasks.workunit.client.1.smithi142.stdout:7/558: stat d0/d1b/d21/d24/f34 0 2024-02-19T19:07:36.584 INFO:tasks.workunit.client.1.smithi142.stdout:7/559: dread - d0/d13/d72/d47/fbb zero size 2024-02-19T19:07:36.584 INFO:tasks.workunit.client.1.smithi142.stdout:6/610: link d2/d1e/d35/d66/d8d/d3e/d8c/f9f d2/d17/d33/d42/d5e/d7b/fc9 0 2024-02-19T19:07:36.584 INFO:tasks.workunit.client.1.smithi142.stdout:6/611: creat d2/d29/fca x:0 0 0 2024-02-19T19:07:36.588 INFO:tasks.workunit.client.1.smithi142.stdout:4/763: dread d4/d1d/d42/d66/dd/f4a [0,4194304] 0 2024-02-19T19:07:36.588 INFO:tasks.workunit.client.1.smithi142.stdout:5/614: dwrite d5/fb3 [0,4194304] 0 2024-02-19T19:07:36.590 INFO:tasks.workunit.client.1.smithi142.stdout:8/659: mknod d9/dd/de/d2d/d2e/d49/d74/cd5 0 2024-02-19T19:07:36.590 INFO:tasks.workunit.client.1.smithi142.stdout:8/660: write d9/dd/de/d2d/d2e/f3d [788190,8907] 0 2024-02-19T19:07:36.592 INFO:tasks.workunit.client.1.smithi142.stdout:3/788: write d1d/d1e/dcd/fd5 [4727080,25924] 0 2024-02-19T19:07:36.595 INFO:tasks.workunit.client.1.smithi142.stdout:7/560: mkdir d0/d1b/dbc 0 2024-02-19T19:07:36.597 INFO:tasks.workunit.client.1.smithi142.stdout:6/612: creat d2/fcb x:0 0 0 2024-02-19T19:07:36.601 INFO:tasks.workunit.client.1.smithi142.stdout:3/789: dread d1d/d1e/d2e/d50/d7c/da7/d3a/d57/f59 [0,4194304] 0 2024-02-19T19:07:36.602 INFO:tasks.workunit.client.1.smithi142.stdout:5/615: creat d5/dd/df/d22/d41/fd0 x:0 0 0 2024-02-19T19:07:36.602 INFO:tasks.workunit.client.1.smithi142.stdout:5/616: dread - d5/dd/df/d15/fc6 zero size 2024-02-19T19:07:36.602 INFO:tasks.workunit.client.1.smithi142.stdout:5/617: chown d5/dd/df/d22/dc0 251 1 2024-02-19T19:07:36.604 INFO:tasks.workunit.client.1.smithi142.stdout:8/661: mkdir d9/dd/d15/dd6 0 2024-02-19T19:07:36.604 INFO:tasks.workunit.client.1.smithi142.stdout:8/662: write d9/dd/de/d14/d65/d6c/f33 [4514072,69798] 0 2024-02-19T19:07:36.607 INFO:tasks.workunit.client.1.smithi142.stdout:7/561: mkdir d0/d1b/d21/d24/d29/d44/dbd 0 2024-02-19T19:07:36.609 INFO:tasks.workunit.client.1.smithi142.stdout:6/613: symlink d2/d17/d33/d42/da2/da7/d55/lcc 0 2024-02-19T19:07:36.611 INFO:tasks.workunit.client.1.smithi142.stdout:3/790: mknod d1d/d1e/d2e/d37/cfd 0 2024-02-19T19:07:36.614 INFO:tasks.workunit.client.1.smithi142.stdout:8/663: link d9/dd/de/d2d/d2e/d73/d77/c6b d9/dd/d44/d79/cd7 0 2024-02-19T19:07:36.617 INFO:tasks.workunit.client.1.smithi142.stdout:7/562: mknod d0/d1b/d21/d24/d29/d44/d49/d7a/cbe 0 2024-02-19T19:07:36.618 INFO:tasks.workunit.client.1.smithi142.stdout:3/791: rmdir d1d/d1e/dcd 39 2024-02-19T19:07:36.618 INFO:tasks.workunit.client.1.smithi142.stdout:3/792: fdatasync d1d/d1e/d2e/d50/d7c/da7/d52/d5a/f6d 0 2024-02-19T19:07:36.618 INFO:tasks.workunit.client.1.smithi142.stdout:3/793: write fa [3867708,32709] 0 2024-02-19T19:07:36.618 INFO:tasks.workunit.client.1.smithi142.stdout:3/794: stat d1d/d1e/d2e/d37/d6c/da9/fc4 0 2024-02-19T19:07:36.626 INFO:tasks.workunit.client.1.smithi142.stdout:8/664: link d9/dd/d44/d79/c4c d9/dd/de/d14/d65/d6c/cd8 0 2024-02-19T19:07:36.628 INFO:tasks.workunit.client.1.smithi142.stdout:3/795: unlink d1d/d1e/d2e/c4f 0 2024-02-19T19:07:36.629 INFO:tasks.workunit.client.1.smithi142.stdout:8/665: mknod d9/dd/de/d14/d65/d94/cd9 0 2024-02-19T19:07:36.630 INFO:tasks.workunit.client.1.smithi142.stdout:3/796: symlink d1d/d1e/d2e/d37/d81/lfe 0 2024-02-19T19:07:36.636 INFO:tasks.workunit.client.1.smithi142.stdout:9/663: sync 2024-02-19T19:07:36.636 INFO:tasks.workunit.client.1.smithi142.stdout:1/790: sync 2024-02-19T19:07:36.637 INFO:tasks.workunit.client.1.smithi142.stdout:1/791: creat d5/d7/d4a/f118 x:0 0 0 2024-02-19T19:07:36.639 INFO:tasks.workunit.client.1.smithi142.stdout:1/792: link d5/d37/d49/l4c d5/d7/d4a/d53/d6a/l119 0 2024-02-19T19:07:36.640 INFO:tasks.workunit.client.1.smithi142.stdout:1/793: unlink d5/ff 0 2024-02-19T19:07:36.641 INFO:tasks.workunit.client.1.smithi142.stdout:1/794: truncate d5/d37/d6c/fa8 86951 0 2024-02-19T19:07:36.641 INFO:tasks.workunit.client.1.smithi142.stdout:8/666: dread d9/dd/de/d2d/d2e/d49/d50/d59/f66 [0,4194304] 0 2024-02-19T19:07:36.642 INFO:tasks.workunit.client.1.smithi142.stdout:6/614: dwrite d2/d1f/d4d/d60/f90 [0,4194304] 0 2024-02-19T19:07:36.642 INFO:tasks.workunit.client.1.smithi142.stdout:6/615: chown d2/d1e/lbf 146 1 2024-02-19T19:07:36.642 INFO:tasks.workunit.client.1.smithi142.stdout:6/616: write d2/d29/d47/f5b [1012174,67398] 0 2024-02-19T19:07:36.642 INFO:tasks.workunit.client.1.smithi142.stdout:1/795: getdents d5/d7/d23/d41 0 2024-02-19T19:07:36.643 INFO:tasks.workunit.client.1.smithi142.stdout:8/667: truncate d9/dd/de/d14/d65/d6c/f3a 729237 0 2024-02-19T19:07:36.646 INFO:tasks.workunit.client.1.smithi142.stdout:6/617: unlink d2/d1e/d35/d66/d8d/d3e/c61 0 2024-02-19T19:07:36.646 INFO:tasks.workunit.client.1.smithi142.stdout:1/796: mknod d5/d77/da9/dae/deb/df9/c11a 0 2024-02-19T19:07:36.647 INFO:tasks.workunit.client.1.smithi142.stdout:1/797: creat d5/d7/d23/d2c/f11b x:0 0 0 2024-02-19T19:07:36.649 INFO:tasks.workunit.client.1.smithi142.stdout:1/798: getdents d5/d77/da9/dae/deb 0 2024-02-19T19:07:36.649 INFO:tasks.workunit.client.1.smithi142.stdout:1/799: fdatasync d5/d7/d23/f45 0 2024-02-19T19:07:36.650 INFO:tasks.workunit.client.1.smithi142.stdout:7/563: dwrite d0/d13/d72/d47/f4b [0,4194304] 0 2024-02-19T19:07:36.650 INFO:tasks.workunit.client.1.smithi142.stdout:7/564: truncate d0/d1b/d21/d24/d29/d44/f55 715220 0 2024-02-19T19:07:36.650 INFO:tasks.workunit.client.1.smithi142.stdout:7/565: fsync d0/d13/f27 0 2024-02-19T19:07:36.650 INFO:tasks.workunit.client.1.smithi142.stdout:5/618: dwrite d5/dd/df/d15/fb1 [0,4194304] 0 2024-02-19T19:07:36.650 INFO:tasks.workunit.client.1.smithi142.stdout:5/619: dread - d5/dd/d5f/fc5 zero size 2024-02-19T19:07:36.651 INFO:tasks.workunit.client.1.smithi142.stdout:1/800: mknod d5/d7/d23/c11c 0 2024-02-19T19:07:36.657 INFO:tasks.workunit.client.1.smithi142.stdout:5/620: mknod d5/dd/df/d22/d41/d32/d53/cd1 0 2024-02-19T19:07:36.657 INFO:tasks.workunit.client.1.smithi142.stdout:8/668: write d9/dd/f47 [2359528,60803] 0 2024-02-19T19:07:36.657 INFO:tasks.workunit.client.1.smithi142.stdout:8/669: write d9/dd/de/d14/d65/fb2 [1655010,122487] 0 2024-02-19T19:07:36.657 INFO:tasks.workunit.client.1.smithi142.stdout:8/670: stat d9/dd/de/d2d/d2e/d49/d50/d59/d8a/fb8 0 2024-02-19T19:07:36.657 INFO:tasks.workunit.client.1.smithi142.stdout:8/671: chown d9/dd/de/d2d/d2e/d49/d50 0 1 2024-02-19T19:07:36.657 INFO:tasks.workunit.client.1.smithi142.stdout:8/672: dread - d9/dd/de/d2d/d2e/d49/d50/d59/f82 zero size 2024-02-19T19:07:36.657 INFO:tasks.workunit.client.1.smithi142.stdout:8/673: creat d9/dd/d15/d31/fda x:0 0 0 2024-02-19T19:07:36.657 INFO:tasks.workunit.client.1.smithi142.stdout:5/621: dread d5/dd/d5f/f7b [0,4194304] 0 2024-02-19T19:07:36.662 INFO:tasks.workunit.client.1.smithi142.stdout:8/674: symlink d9/dd/de/d2d/d2e/d49/d74/ldb 0 2024-02-19T19:07:36.663 INFO:tasks.workunit.client.1.smithi142.stdout:7/566: dread d0/d1b/d21/d24/f34 [0,4194304] 0 2024-02-19T19:07:36.665 INFO:tasks.workunit.client.1.smithi142.stdout:8/675: mkdir d9/dd/de/d2d/d2e/d49/ddc 0 2024-02-19T19:07:36.665 INFO:tasks.workunit.client.1.smithi142.stdout:8/676: write d9/dd/de/d2d/d2e/d73/d77/fa6 [1951230,11455] 0 2024-02-19T19:07:36.665 INFO:tasks.workunit.client.1.smithi142.stdout:8/677: chown d9/dd/de/d14/d65/d94/cd9 0 1 2024-02-19T19:07:36.666 INFO:tasks.workunit.client.1.smithi142.stdout:5/622: dread d5/dd/df/d22/d41/d32/f62 [0,4194304] 0 2024-02-19T19:07:36.666 INFO:tasks.workunit.client.1.smithi142.stdout:5/623: write d5/f13 [349308,99492] 0 2024-02-19T19:07:36.666 INFO:tasks.workunit.client.1.smithi142.stdout:5/624: write d5/dd/d8/f3d [471238,86482] 0 2024-02-19T19:07:36.666 INFO:tasks.workunit.client.1.smithi142.stdout:5/625: chown d5/dd/df 172055098 1 2024-02-19T19:07:36.666 INFO:tasks.workunit.client.1.smithi142.stdout:7/567: rename d0/d1b/d21/d24/d29/d44/d49/d8b/c94 to d0/d1b/d21/d24/d5e/cbf 0 2024-02-19T19:07:36.667 INFO:tasks.workunit.client.1.smithi142.stdout:3/797: dwrite d1d/d1e/d2e/d50/d7c/da7/d52/d5a/fcc [0,4194304] 0 2024-02-19T19:07:36.668 INFO:tasks.workunit.client.1.smithi142.stdout:3/798: creat d1d/d1e/d2e/dee/da2/df1/fff x:0 0 0 2024-02-19T19:07:36.670 INFO:tasks.workunit.client.1.smithi142.stdout:3/799: rename d1d/d1e/d2e/d37/d81/lb9 to d1d/d1e/d2e/dee/l100 0 2024-02-19T19:07:36.670 INFO:tasks.workunit.client.1.smithi142.stdout:3/800: chown ce 43302247 1 2024-02-19T19:07:36.671 INFO:tasks.workunit.client.1.smithi142.stdout:5/626: rmdir d5/dd/d95/dbb 0 2024-02-19T19:07:36.673 INFO:tasks.workunit.client.1.smithi142.stdout:3/801: link d1d/d1e/d2e/d37/d81/dbc/fdf d1d/d1e/d2e/d50/d7c/da7/d52/d71/ddd/f101 0 2024-02-19T19:07:36.673 INFO:tasks.workunit.client.1.smithi142.stdout:5/627: symlink d5/dd/d8/d31/d4d/d75/dc7/ld2 0 2024-02-19T19:07:36.674 INFO:tasks.workunit.client.1.smithi142.stdout:6/618: dwrite d2/d1f/d20/d31/d62/f72 [0,4194304] 0 2024-02-19T19:07:36.674 INFO:tasks.workunit.client.1.smithi142.stdout:3/802: mknod d1d/d1e/d2e/dee/d8d/c102 0 2024-02-19T19:07:36.675 INFO:tasks.workunit.client.1.smithi142.stdout:6/619: link d2/d1e/d35/d66/fa5 d2/d1e/d35/d66/d76/fcd 0 2024-02-19T19:07:36.678 INFO:tasks.workunit.client.1.smithi142.stdout:3/803: creat d1d/d1e/d2e/d50/d7c/da7/d3a/dc7/f103 x:0 0 0 2024-02-19T19:07:36.678 INFO:tasks.workunit.client.1.smithi142.stdout:3/804: chown d1d/d1e/d2e/d37/d6c/da9/f9f 109822990 1 2024-02-19T19:07:36.678 INFO:tasks.workunit.client.1.smithi142.stdout:3/805: chown d1d/d1e/d2e/d37/cfd 18623 1 2024-02-19T19:07:36.678 INFO:tasks.workunit.client.1.smithi142.stdout:1/801: dwrite d5/d37/d6c/ff5 [0,4194304] 0 2024-02-19T19:07:36.678 INFO:tasks.workunit.client.1.smithi142.stdout:1/802: chown d5/d7/d23/d2c/dbc/ff6 275457 1 2024-02-19T19:07:36.679 INFO:tasks.workunit.client.1.smithi142.stdout:9/664: dwrite db/d10/d32/d3f/f75 [0,4194304] 0 2024-02-19T19:07:36.681 INFO:tasks.workunit.client.1.smithi142.stdout:1/803: symlink d5/d77/da9/dae/deb/df9/l11d 0 2024-02-19T19:07:36.681 INFO:tasks.workunit.client.1.smithi142.stdout:8/678: dread d9/dd/de/d2d/d2e/d73/d77/f89 [0,4194304] 0 2024-02-19T19:07:36.681 INFO:tasks.workunit.client.1.smithi142.stdout:8/679: chown d9/dd/de/d2d/d2e/d49/d58 363929 1 2024-02-19T19:07:36.683 INFO:tasks.workunit.client.1.smithi142.stdout:7/568: dread d0/d13/d72/d47/f4b [0,4194304] 0 2024-02-19T19:07:36.692 INFO:tasks.workunit.client.1.smithi142.stdout:9/665: creat db/d10/d22/d24/d41/d99/fb1 x:0 0 0 2024-02-19T19:07:36.693 INFO:tasks.workunit.client.1.smithi142.stdout:3/806: dread d1d/d1e/d2e/f63 [0,4194304] 0 2024-02-19T19:07:36.693 INFO:tasks.workunit.client.1.smithi142.stdout:1/804: link d5/d7/d23/ca3 d5/d37/d49/c11e 0 2024-02-19T19:07:36.694 INFO:tasks.workunit.client.1.smithi142.stdout:8/680: mkdir d9/dd/d15/dd6/ddd 0 2024-02-19T19:07:36.694 INFO:tasks.workunit.client.1.smithi142.stdout:8/681: truncate d9/dd/de/d14/f60 2061824 0 2024-02-19T19:07:36.696 INFO:tasks.workunit.client.1.smithi142.stdout:9/666: creat db/d10/fb2 x:0 0 0 2024-02-19T19:07:36.698 INFO:tasks.workunit.client.1.smithi142.stdout:3/807: creat d1d/d1e/d2e/d50/d7c/da7/dc8/f104 x:0 0 0 2024-02-19T19:07:36.699 INFO:tasks.workunit.client.1.smithi142.stdout:5/628: dwrite d5/dd/d8/d31/f33 [0,4194304] 0 2024-02-19T19:07:36.700 INFO:tasks.workunit.client.1.smithi142.stdout:8/682: truncate d9/dd/de/d2d/d2e/d49/d74/f84 150174 0 2024-02-19T19:07:36.701 INFO:tasks.workunit.client.1.smithi142.stdout:7/569: rmdir d0/d13/d1e 39 2024-02-19T19:07:36.701 INFO:tasks.workunit.client.1.smithi142.stdout:7/570: truncate d0/d1b/d21/d24/d29/f7f 842773 0 2024-02-19T19:07:36.704 INFO:tasks.workunit.client.1.smithi142.stdout:9/667: rmdir db/d10/dab 0 2024-02-19T19:07:36.704 INFO:tasks.workunit.client.1.smithi142.stdout:9/668: fdatasync db/d10/d32/d3f/f63 0 2024-02-19T19:07:36.704 INFO:tasks.workunit.client.1.smithi142.stdout:8/683: write d9/dd/d44/d79/fab [517449,53121] 0 2024-02-19T19:07:36.706 INFO:tasks.workunit.client.1.smithi142.stdout:5/629: rename d5/dd/d8/d31/d4d/f94 to d5/dd/fd3 0 2024-02-19T19:07:36.710 INFO:tasks.workunit.client.1.smithi142.stdout:8/684: unlink d9/dd/de/d2d/d2e/d49/d50/d59/d8a/fb8 0 2024-02-19T19:07:36.712 INFO:tasks.workunit.client.1.smithi142.stdout:7/571: rename d0/d1b/d21/d24/d29/d44/d49/d9b/fb9 to d0/d13/fc0 0 2024-02-19T19:07:36.713 INFO:tasks.workunit.client.1.smithi142.stdout:9/669: mkdir db/d10/d32/d3f/db3 0 2024-02-19T19:07:36.717 INFO:tasks.workunit.client.1.smithi142.stdout:5/630: rename d5/dd/df/d22/d80 to d5/dd/d8/dd4 0 2024-02-19T19:07:36.717 INFO:tasks.workunit.client.1.smithi142.stdout:5/631: creat d5/dd/df/d15/fd5 x:0 0 0 2024-02-19T19:07:36.717 INFO:tasks.workunit.client.1.smithi142.stdout:5/632: write d5/dd/d8/f8e [421788,4635] 0 2024-02-19T19:07:36.717 INFO:tasks.workunit.client.1.smithi142.stdout:5/633: write d5/dd/d8/d31/d4d/d60/f73 [1046785,51581] 0 2024-02-19T19:07:36.717 INFO:tasks.workunit.client.1.smithi142.stdout:5/634: truncate d5/dd/d8/d2a/d57/fca 849573 0 2024-02-19T19:07:36.720 INFO:tasks.workunit.client.1.smithi142.stdout:5/635: symlink d5/dd/d5f/ld6 0 2024-02-19T19:07:36.721 INFO:tasks.workunit.client.1.smithi142.stdout:5/636: creat d5/dd/d8/dd4/db4/fd7 x:0 0 0 2024-02-19T19:07:36.721 INFO:tasks.workunit.client.1.smithi142.stdout:4/764: sync 2024-02-19T19:07:36.721 INFO:tasks.workunit.client.1.smithi142.stdout:0/554: sync 2024-02-19T19:07:36.721 INFO:tasks.workunit.client.1.smithi142.stdout:4/765: chown d4/d1d/f74 171035 1 2024-02-19T19:07:36.722 INFO:tasks.workunit.client.1.smithi142.stdout:2/580: sync 2024-02-19T19:07:36.724 INFO:tasks.workunit.client.1.smithi142.stdout:4/766: mknod d4/d1d/cfc 0 2024-02-19T19:07:36.724 INFO:tasks.workunit.client.1.smithi142.stdout:6/620: dwrite d2/d17/d33/fa6 [0,4194304] 0 2024-02-19T19:07:36.725 INFO:tasks.workunit.client.1.smithi142.stdout:2/581: mkdir d3/d4b/dbb 0 2024-02-19T19:07:36.725 INFO:tasks.workunit.client.1.smithi142.stdout:2/582: write d3/db/f34 [5171479,46501] 0 2024-02-19T19:07:36.725 INFO:tasks.workunit.client.1.smithi142.stdout:2/583: chown d3/d4d/d5f/ca6 1435 1 2024-02-19T19:07:36.727 INFO:tasks.workunit.client.1.smithi142.stdout:4/767: creat d4/d1d/d42/d66/dd/d10/d26/df7/ffd x:0 0 0 2024-02-19T19:07:36.727 INFO:tasks.workunit.client.1.smithi142.stdout:4/768: chown d4/d1d/d42/d66/d12/fe3 264681 1 2024-02-19T19:07:36.730 INFO:tasks.workunit.client.1.smithi142.stdout:6/621: mknod d2/d17/d33/d42/cce 0 2024-02-19T19:07:36.730 INFO:tasks.workunit.client.1.smithi142.stdout:6/622: write d2/d1f/d20/f52 [2450380,121602] 0 2024-02-19T19:07:36.732 INFO:tasks.workunit.client.1.smithi142.stdout:2/584: mknod d3/db/d29/d4c/d4e/d9a/da9/cbc 0 2024-02-19T19:07:36.732 INFO:tasks.workunit.client.1.smithi142.stdout:2/585: write d3/f1f [4664687,100348] 0 2024-02-19T19:07:36.733 INFO:tasks.workunit.client.1.smithi142.stdout:4/769: creat d4/d1d/d42/d66/dd/d10/d26/d50/d54/ffe x:0 0 0 2024-02-19T19:07:36.733 INFO:tasks.workunit.client.1.smithi142.stdout:4/770: chown d4/d1d/l53 20172 1 2024-02-19T19:07:36.734 INFO:tasks.workunit.client.1.smithi142.stdout:6/623: symlink d2/d29/lcf 0 2024-02-19T19:07:36.734 INFO:tasks.workunit.client.1.smithi142.stdout:6/624: write d2/d1f/d20/d31/fa8 [4756516,80301] 0 2024-02-19T19:07:36.736 INFO:tasks.workunit.client.1.smithi142.stdout:6/625: symlink d2/d17/d33/d42/da2/da7/d55/ld0 0 2024-02-19T19:07:36.737 INFO:tasks.workunit.client.1.smithi142.stdout:4/771: rename d4/d14/d31/f61 to d4/fff 0 2024-02-19T19:07:36.737 INFO:tasks.workunit.client.1.smithi142.stdout:4/772: chown d4/f5 888291704 1 2024-02-19T19:07:36.738 INFO:tasks.workunit.client.1.smithi142.stdout:4/773: mkdir d4/d1d/d42/d66/dd/d10/d3b/d3f/d100 0 2024-02-19T19:07:36.739 INFO:tasks.workunit.client.1.smithi142.stdout:4/774: mknod d4/d1d/d42/d66/dd/d10/d3e/d68/db4/c101 0 2024-02-19T19:07:36.739 INFO:tasks.workunit.client.1.smithi142.stdout:4/775: truncate d4/d1d/d42/d66/d12/d2d/fda 191829 0 2024-02-19T19:07:36.740 INFO:tasks.workunit.client.1.smithi142.stdout:4/776: read d4/d1d/d42/fa8 [484869,70814] 0 2024-02-19T19:07:36.740 INFO:tasks.workunit.client.1.smithi142.stdout:4/777: creat d4/d1c/dae/dcb/f102 x:0 0 0 2024-02-19T19:07:36.742 INFO:tasks.workunit.client.1.smithi142.stdout:1/805: dwrite d5/d7/d4a/f94 [0,4194304] 0 2024-02-19T19:07:36.742 INFO:tasks.workunit.client.1.smithi142.stdout:3/808: dwrite d1d/d1e/d2e/dee/da2/fd2 [0,4194304] 0 2024-02-19T19:07:36.744 INFO:tasks.workunit.client.1.smithi142.stdout:1/806: truncate d5/f4e 3244604 0 2024-02-19T19:07:36.744 INFO:tasks.workunit.client.1.smithi142.stdout:3/809: mknod d1d/d1e/d2e/d50/d7c/da7/dc8/c105 0 2024-02-19T19:07:36.744 INFO:tasks.workunit.client.1.smithi142.stdout:1/807: unlink d5/d37/d6c/d75/da7/l112 0 2024-02-19T19:07:36.745 INFO:tasks.workunit.client.1.smithi142.stdout:3/810: stat d1d/l31 0 2024-02-19T19:07:36.746 INFO:tasks.workunit.client.1.smithi142.stdout:5/637: dread d5/dd/d8/d31/f33 [0,4194304] 0 2024-02-19T19:07:36.746 INFO:tasks.workunit.client.1.smithi142.stdout:5/638: write d5/dd/df/da0/faf [18433,108199] 0 2024-02-19T19:07:36.746 INFO:tasks.workunit.client.1.smithi142.stdout:5/639: write d5/dd/d8/d2a/d93/faa [165468,44766] 0 2024-02-19T19:07:36.746 INFO:tasks.workunit.client.1.smithi142.stdout:1/808: truncate d5/d37/d6c/ff5 1654964 0 2024-02-19T19:07:36.747 INFO:tasks.workunit.client.1.smithi142.stdout:3/811: symlink d1d/d1e/d2e/d50/d7c/da7/d3a/l106 0 2024-02-19T19:07:36.749 INFO:tasks.workunit.client.1.smithi142.stdout:5/640: creat d5/dd/d8/d5d/fd8 x:0 0 0 2024-02-19T19:07:36.750 INFO:tasks.workunit.client.1.smithi142.stdout:1/809: rmdir d5/d7/d23/d41/d103 39 2024-02-19T19:07:36.755 INFO:tasks.workunit.client.1.smithi142.stdout:0/555: dwrite d23/d28/d41/d78/fa8 [0,4194304] 0 2024-02-19T19:07:36.755 INFO:tasks.workunit.client.1.smithi142.stdout:8/685: dwrite d9/dd/d44/faa [0,4194304] 0 2024-02-19T19:07:36.755 INFO:tasks.workunit.client.1.smithi142.stdout:8/686: fsync d9/dd/de/d2d/d2e/d49/d50/f72 0 2024-02-19T19:07:36.756 INFO:tasks.workunit.client.1.smithi142.stdout:9/670: dwrite db/d10/d32/f7f [0,4194304] 0 2024-02-19T19:07:36.759 INFO:tasks.workunit.client.1.smithi142.stdout:0/556: rename d23/c29 to d23/d28/d2d/cb5 0 2024-02-19T19:07:36.759 INFO:tasks.workunit.client.1.smithi142.stdout:0/557: dread - d23/d28/d41/f9d zero size 2024-02-19T19:07:36.761 INFO:tasks.workunit.client.1.smithi142.stdout:7/572: dwrite d0/f6c [0,4194304] 0 2024-02-19T19:07:36.761 INFO:tasks.workunit.client.1.smithi142.stdout:7/573: chown d0/d1b/d21/d24/d29/d44/c61 63275646 1 2024-02-19T19:07:36.761 INFO:tasks.workunit.client.1.smithi142.stdout:1/810: dread d5/d7/f4f [0,4194304] 0 2024-02-19T19:07:36.770 INFO:tasks.workunit.client.1.smithi142.stdout:9/671: dread db/d10/d22/d24/f8b [0,4194304] 0 2024-02-19T19:07:36.770 INFO:tasks.workunit.client.1.smithi142.stdout:9/672: fsync db/d10/d27/d2f/d4c/d59/f71 0 2024-02-19T19:07:36.771 INFO:tasks.workunit.client.1.smithi142.stdout:8/687: write d9/dd/d15/d31/fbb [6237732,111013] 0 2024-02-19T19:07:36.773 INFO:tasks.workunit.client.1.smithi142.stdout:7/574: rename d0/d1b/d21/lad to d0/d1b/d21/d24/lc1 0 2024-02-19T19:07:36.775 INFO:tasks.workunit.client.1.smithi142.stdout:1/811: mkdir d5/d1a/d33/d11f 0 2024-02-19T19:07:36.775 INFO:tasks.workunit.client.1.smithi142.stdout:1/812: chown d5/d7/d4a/d53/fc3 1 1 2024-02-19T19:07:36.779 INFO:tasks.workunit.client.1.smithi142.stdout:3/812: dwrite d1d/d1e/d2e/d37/d6c/da9/f9f [0,4194304] 0 2024-02-19T19:07:36.779 INFO:tasks.workunit.client.1.smithi142.stdout:5/641: dwrite d5/dd/df/d15/d5b/fce [0,4194304] 0 2024-02-19T19:07:36.779 INFO:tasks.workunit.client.1.smithi142.stdout:4/778: dwrite d4/d1c/f2e [0,4194304] 0 2024-02-19T19:07:36.779 INFO:tasks.workunit.client.1.smithi142.stdout:0/558: dwrite d23/d32/d8a/f9a [0,4194304] 0 2024-02-19T19:07:36.785 INFO:tasks.workunit.client.1.smithi142.stdout:9/673: link db/f53 db/d10/d22/d24/d3d/d89/dad/fb4 0 2024-02-19T19:07:36.786 INFO:tasks.workunit.client.1.smithi142.stdout:8/688: dwrite d9/dd/de/d14/d65/f9e [4194304,4194304] 0 2024-02-19T19:07:36.786 INFO:tasks.workunit.client.1.smithi142.stdout:8/689: fdatasync d9/dd/de/d2d/d2e/d49/d58/f5b 0 2024-02-19T19:07:36.787 INFO:tasks.workunit.client.1.smithi142.stdout:7/575: mknod d0/d13/cc2 0 2024-02-19T19:07:36.787 INFO:tasks.workunit.client.1.smithi142.stdout:7/576: chown d0/d1b/d21/d24/d29/d44/l7d 214 1 2024-02-19T19:07:36.788 INFO:tasks.workunit.client.1.smithi142.stdout:3/813: write d1d/d1e/d2e/d50/f93 [3855536,85585] 0 2024-02-19T19:07:36.788 INFO:tasks.workunit.client.1.smithi142.stdout:1/813: symlink d5/d7/d34/l120 0 2024-02-19T19:07:36.794 INFO:tasks.workunit.client.1.smithi142.stdout:5/642: mknod d5/dd/d8/dd4/cd9 0 2024-02-19T19:07:36.794 INFO:tasks.workunit.client.1.smithi142.stdout:5/643: readlink d5/dd/d8/d2a/d57/l5a 0 2024-02-19T19:07:36.797 INFO:tasks.workunit.client.1.smithi142.stdout:0/559: dwrite d23/d28/d41/f75 [0,4194304] 0 2024-02-19T19:07:36.798 INFO:tasks.workunit.client.1.smithi142.stdout:4/779: truncate d4/d1d/d42/d66/dd/d10/d3b/d3f/fa9 170348 0 2024-02-19T19:07:36.798 INFO:tasks.workunit.client.1.smithi142.stdout:4/780: chown d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba/dd2/ff3 6327501 1 2024-02-19T19:07:36.799 INFO:tasks.workunit.client.1.smithi142.stdout:4/781: write d4/d1d/d42/d66/d12/d79/d8c/fd7 [562788,58300] 0 2024-02-19T19:07:36.799 INFO:tasks.workunit.client.1.smithi142.stdout:4/782: chown d4/d1d/d42/d66/d12/d79/d8c/cef 29 1 2024-02-19T19:07:36.799 INFO:tasks.workunit.client.1.smithi142.stdout:4/783: dread - d4/d1d/d42/d66/d12/fc0 zero size 2024-02-19T19:07:36.799 INFO:tasks.workunit.client.1.smithi142.stdout:4/784: truncate d4/d1d/d42/d66/f27 9003873 0 2024-02-19T19:07:36.800 INFO:tasks.workunit.client.1.smithi142.stdout:4/785: dread d4/d1d/d42/d66/dd/f4a [0,4194304] 0 2024-02-19T19:07:36.801 INFO:tasks.workunit.client.1.smithi142.stdout:4/786: creat d4/d1d/d42/d66/dd/d10/d26/df7/f103 x:0 0 0 2024-02-19T19:07:36.801 INFO:tasks.workunit.client.1.smithi142.stdout:4/787: dread d4/d14/d31/dab/da2/db3/fd5 [0,4194304] 0 2024-02-19T19:07:36.801 INFO:tasks.workunit.client.1.smithi142.stdout:9/674: rename db/d10/d32/d3f/d5f/l65 to db/d10/d32/d3f/db3/lb5 0 2024-02-19T19:07:36.805 INFO:tasks.workunit.client.1.smithi142.stdout:8/690: creat d9/fde x:0 0 0 2024-02-19T19:07:36.806 INFO:tasks.workunit.client.1.smithi142.stdout:0/560: dread d23/d32/f6a [0,4194304] 0 2024-02-19T19:07:36.806 INFO:tasks.workunit.client.1.smithi142.stdout:7/577: mknod d0/d1b/d21/d24/d5e/d65/d86/cc3 0 2024-02-19T19:07:36.806 INFO:tasks.workunit.client.1.smithi142.stdout:7/578: fsync d0/d13/d72/d47/fbb 0 2024-02-19T19:07:36.806 INFO:tasks.workunit.client.1.smithi142.stdout:9/675: dread db/d10/d32/d91/fa1 [0,4194304] 0 2024-02-19T19:07:36.808 INFO:tasks.workunit.client.1.smithi142.stdout:3/814: creat d1d/d1e/d2e/dee/dc1/dfb/f107 x:0 0 0 2024-02-19T19:07:36.810 INFO:tasks.workunit.client.1.smithi142.stdout:5/644: mkdir d5/dda 0 2024-02-19T19:07:36.815 INFO:tasks.workunit.client.1.smithi142.stdout:7/579: dread d0/d1b/d21/d24/f30 [0,4194304] 0 2024-02-19T19:07:36.817 INFO:tasks.workunit.client.1.smithi142.stdout:4/788: rename d4/d14/d31/d43/c83 to d4/d1d/d42/d66/dd/dac/c104 0 2024-02-19T19:07:36.818 INFO:tasks.workunit.client.1.smithi142.stdout:8/691: mknod d9/dd/d15/d31/d96/cdf 0 2024-02-19T19:07:36.818 INFO:tasks.workunit.client.1.smithi142.stdout:8/692: write d9/dd/de/d14/d65/d6c/d9c/fca [736656,125646] 0 2024-02-19T19:07:36.818 INFO:tasks.workunit.client.1.smithi142.stdout:0/561: getdents d23/d7d/d9e 0 2024-02-19T19:07:36.819 INFO:tasks.workunit.client.1.smithi142.stdout:9/676: rmdir db/d10/d27/d2f/d4c/d54 39 2024-02-19T19:07:36.820 INFO:tasks.workunit.client.1.smithi142.stdout:3/815: rmdir d1d/d1e/d2e/dee/d8d/de4 39 2024-02-19T19:07:36.820 INFO:tasks.workunit.client.1.smithi142.stdout:3/816: stat d1d/f2b 0 2024-02-19T19:07:36.821 INFO:tasks.workunit.client.1.smithi142.stdout:5/645: symlink d5/dd/d8/d2a/d93/ldb 0 2024-02-19T19:07:36.822 INFO:tasks.workunit.client.1.smithi142.stdout:7/580: mknod d0/d1b/d9d/cc4 0 2024-02-19T19:07:36.822 INFO:tasks.workunit.client.1.smithi142.stdout:7/581: readlink d0/d1b/d21/d24/lc1 0 2024-02-19T19:07:36.822 INFO:tasks.workunit.client.1.smithi142.stdout:7/582: truncate d0/d13/d72/d47/d69/f98 386341 0 2024-02-19T19:07:36.823 INFO:tasks.workunit.client.1.smithi142.stdout:7/583: read d0/f6b [742126,53196] 0 2024-02-19T19:07:36.823 INFO:tasks.workunit.client.1.smithi142.stdout:7/584: dread - d0/d13/d1e/f96 zero size 2024-02-19T19:07:36.823 INFO:tasks.workunit.client.1.smithi142.stdout:7/585: write d0/d13/d72/f33 [47694,1060] 0 2024-02-19T19:07:36.826 INFO:tasks.workunit.client.1.smithi142.stdout:4/789: link d4/d1d/d42/d66/d12/cf9 d4/d1d/d42/d66/d5f/c105 0 2024-02-19T19:07:36.827 INFO:tasks.workunit.client.1.smithi142.stdout:0/562: mkdir d23/d28/d2d/d51/d44/d58/db6 0 2024-02-19T19:07:36.828 INFO:tasks.workunit.client.1.smithi142.stdout:3/817: getdents d1d/d1e/d2e/dee/d91 0 2024-02-19T19:07:36.828 INFO:tasks.workunit.client.1.smithi142.stdout:3/818: write d1d/f2c [2446420,127493] 0 2024-02-19T19:07:36.829 INFO:tasks.workunit.client.1.smithi142.stdout:5/646: rename d5/dd/d8/d1c/fa3 to d5/dd/d8/dd4/db4/fdc 0 2024-02-19T19:07:36.832 INFO:tasks.workunit.client.1.smithi142.stdout:7/586: mkdir d0/d1b/d21/d24/d29/dc5 0 2024-02-19T19:07:36.833 INFO:tasks.workunit.client.1.smithi142.stdout:0/563: creat d23/d7d/d9e/fb7 x:0 0 0 2024-02-19T19:07:36.834 INFO:tasks.workunit.client.1.smithi142.stdout:4/790: write d4/d14/d31/f8d [2389099,43298] 0 2024-02-19T19:07:36.835 INFO:tasks.workunit.client.1.smithi142.stdout:3/819: mkdir d1d/d1e/d2e/d50/d7c/da7/d52/d108 0 2024-02-19T19:07:36.835 INFO:tasks.workunit.client.1.smithi142.stdout:3/820: creat d1d/d1e/d2e/dee/dc1/dfb/f109 x:0 0 0 2024-02-19T19:07:36.836 INFO:tasks.workunit.client.1.smithi142.stdout:5/647: creat d5/dd/df/d22/d41/d6f/fdd x:0 0 0 2024-02-19T19:07:36.836 INFO:tasks.workunit.client.1.smithi142.stdout:5/648: stat d5/dd/df/d15/fc6 0 2024-02-19T19:07:36.837 INFO:tasks.workunit.client.1.smithi142.stdout:8/693: dread d9/dd/de/f6f [0,4194304] 0 2024-02-19T19:07:36.837 INFO:tasks.workunit.client.1.smithi142.stdout:8/694: write d9/dd/de/d2d/d2e/d73/d77/fa6 [450295,98847] 0 2024-02-19T19:07:36.837 INFO:tasks.workunit.client.1.smithi142.stdout:8/695: fsync d9/dd/de/d2d/d2e/d49/d50/d59/f82 0 2024-02-19T19:07:36.839 INFO:tasks.workunit.client.1.smithi142.stdout:0/564: rename d23/d32/f5b to d23/d28/d2d/d51/d44/fb8 0 2024-02-19T19:07:36.839 INFO:tasks.workunit.client.1.smithi142.stdout:0/565: write d23/f25 [4607565,18530] 0 2024-02-19T19:07:36.841 INFO:tasks.workunit.client.1.smithi142.stdout:3/821: creat d1d/d1e/d2e/d37/d81/db7/f10a x:0 0 0 2024-02-19T19:07:36.842 INFO:tasks.workunit.client.1.smithi142.stdout:5/649: mknod d5/dd/df/d22/db9/cde 0 2024-02-19T19:07:36.842 INFO:tasks.workunit.client.1.smithi142.stdout:5/650: fsync d5/dd/d8/d1c/d8a/f6c 0 2024-02-19T19:07:36.842 INFO:tasks.workunit.client.1.smithi142.stdout:5/651: chown d5/dd/d8/d2a/d93/l4c 942 1 2024-02-19T19:07:36.842 INFO:tasks.workunit.client.1.smithi142.stdout:4/791: write d4/d1c/fc1 [895260,8269] 0 2024-02-19T19:07:36.843 INFO:tasks.workunit.client.1.smithi142.stdout:4/792: write d4/d1d/d42/fa8 [1299735,19712] 0 2024-02-19T19:07:36.843 INFO:tasks.workunit.client.1.smithi142.stdout:8/696: mknod d9/dd/d15/d31/d96/ce0 0 2024-02-19T19:07:36.847 INFO:tasks.workunit.client.1.smithi142.stdout:3/822: truncate d1d/d1e/d2e/d37/d81/dbc/fdf 286294 0 2024-02-19T19:07:36.847 INFO:tasks.workunit.client.1.smithi142.stdout:3/823: read d1d/d1e/d2e/d50/d7c/da7/d52/d71/faa [1491868,115008] 0 2024-02-19T19:07:36.848 INFO:tasks.workunit.client.1.smithi142.stdout:4/793: truncate d4/d1d/f5b 3094180 0 2024-02-19T19:07:36.848 INFO:tasks.workunit.client.1.smithi142.stdout:0/566: dread d23/d28/f33 [0,4194304] 0 2024-02-19T19:07:36.849 INFO:tasks.workunit.client.1.smithi142.stdout:8/697: truncate d9/dd/de/d2d/d2e/d49/d74/f8f 3056182 0 2024-02-19T19:07:36.849 INFO:tasks.workunit.client.1.smithi142.stdout:8/698: creat d9/dd/de/d14/d65/fe1 x:0 0 0 2024-02-19T19:07:36.851 INFO:tasks.workunit.client.1.smithi142.stdout:4/794: rmdir d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f 39 2024-02-19T19:07:36.856 INFO:tasks.workunit.client.1.smithi142.stdout:5/652: dwrite d5/dd/d8/d31/d4d/d8d/fcc [0,4194304] 0 2024-02-19T19:07:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:5/653: fsync d5/dd/f68 0 2024-02-19T19:07:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:5/654: fdatasync d5/dd/df/d15/d5b/fb0 0 2024-02-19T19:07:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:5/655: write d5/dd/df/d22/d41/d6f/f89 [299250,67032] 0 2024-02-19T19:07:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:8/699: rename d9/dd/de/db4/fcf to d9/dd/de/d14/d65/d6c/da7/fe2 0 2024-02-19T19:07:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:8/700: readlink d9/dd/de/d14/d65/db1/ld4 0 2024-02-19T19:07:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:8/701: readlink d9/dd/de/d2d/l9a 0 2024-02-19T19:07:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:8/702: readlink d9/dd/de/d2d/d2e/d49/d50/d59/d97/la2 0 2024-02-19T19:07:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:8/703: chown d9/dd/de/d2d/db7 0 1 2024-02-19T19:07:36.857 INFO:tasks.workunit.client.1.smithi142.stdout:3/824: rmdir d1d/db6 39 2024-02-19T19:07:36.860 INFO:tasks.workunit.client.1.smithi142.stdout:4/795: rename d4/d1c/fc1 to d4/d1c/f106 0 2024-02-19T19:07:36.860 INFO:tasks.workunit.client.1.smithi142.stdout:4/796: write d4/d1c/f106 [3494689,72288] 0 2024-02-19T19:07:36.860 INFO:tasks.workunit.client.1.smithi142.stdout:4/797: truncate d4/d1d/ff8 603343 0 2024-02-19T19:07:36.860 INFO:tasks.workunit.client.1.smithi142.stdout:2/586: sync 2024-02-19T19:07:36.861 INFO:tasks.workunit.client.1.smithi142.stdout:6/626: sync 2024-02-19T19:07:36.861 INFO:tasks.workunit.client.1.smithi142.stdout:6/627: write d2/d29/fca [900980,8332] 0 2024-02-19T19:07:36.864 INFO:tasks.workunit.client.1.smithi142.stdout:5/656: symlink d5/dd/d8/d29/ldf 0 2024-02-19T19:07:36.864 INFO:tasks.workunit.client.1.smithi142.stdout:5/657: write d5/dd/d8/d31/f34 [4457963,84543] 0 2024-02-19T19:07:36.866 INFO:tasks.workunit.client.1.smithi142.stdout:8/704: mkdir d9/dd/de/d14/de3 0 2024-02-19T19:07:36.866 INFO:tasks.workunit.client.1.smithi142.stdout:8/705: read d9/dd/de/d2d/d2e/d49/fa1 [508949,5894] 0 2024-02-19T19:07:36.870 INFO:tasks.workunit.client.1.smithi142.stdout:4/798: dread d4/d1d/d42/d66/d12/d79/f85 [0,4194304] 0 2024-02-19T19:07:36.870 INFO:tasks.workunit.client.1.smithi142.stdout:4/799: chown d4/d1d/d42/d66/dd/d10/d3b/d3f/fe0 39 1 2024-02-19T19:07:36.871 INFO:tasks.workunit.client.1.smithi142.stdout:0/567: rmdir d23/d7d 39 2024-02-19T19:07:36.873 INFO:tasks.workunit.client.1.smithi142.stdout:4/800: dread d4/d1d/d42/d66/dd/d10/d3e/d68/d87/f9e [0,4194304] 0 2024-02-19T19:07:36.874 INFO:tasks.workunit.client.1.smithi142.stdout:6/628: mknod d2/d1f/d4d/cd1 0 2024-02-19T19:07:36.875 INFO:tasks.workunit.client.1.smithi142.stdout:8/706: mkdir d9/dd/d44/de4 0 2024-02-19T19:07:36.877 INFO:tasks.workunit.client.1.smithi142.stdout:0/568: truncate d23/f3a 115761 0 2024-02-19T19:07:36.878 INFO:tasks.workunit.client.1.smithi142.stdout:4/801: mkdir d4/d1d/d42/d66/dd/dac/d107 0 2024-02-19T19:07:36.878 INFO:tasks.workunit.client.1.smithi142.stdout:4/802: stat d4/d1d/d42/d66/dd 0 2024-02-19T19:07:36.879 INFO:tasks.workunit.client.1.smithi142.stdout:8/707: dread - d9/dd/d15/d31/d5e/f62 zero size 2024-02-19T19:07:36.880 INFO:tasks.workunit.client.1.smithi142.stdout:2/587: dwrite d3/d4b/f7d [0,4194304] 0 2024-02-19T19:07:36.880 INFO:tasks.workunit.client.1.smithi142.stdout:4/803: mknod d4/d1c/dae/dfa/c108 0 2024-02-19T19:07:36.881 INFO:tasks.workunit.client.1.smithi142.stdout:5/658: dwrite d5/f24 [0,4194304] 0 2024-02-19T19:07:36.885 INFO:tasks.workunit.client.1.smithi142.stdout:0/569: write d23/d28/f70 [3842669,101349] 0 2024-02-19T19:07:36.885 INFO:tasks.workunit.client.1.smithi142.stdout:2/588: unlink d3/db/d29/d6d/d59/d64/l7b 0 2024-02-19T19:07:36.885 INFO:tasks.workunit.client.1.smithi142.stdout:2/589: chown d3/db/d29/d4c/d4a 859 1 2024-02-19T19:07:36.887 INFO:tasks.workunit.client.1.smithi142.stdout:6/629: rmdir d2/d1f/d5c/dbb 0 2024-02-19T19:07:36.889 INFO:tasks.workunit.client.1.smithi142.stdout:5/659: mknod d5/dd/d8/d31/d4d/d75/d9e/ce0 0 2024-02-19T19:07:36.909 INFO:tasks.workunit.client.1.smithi142.stdout:6/630: mkdir d2/d17/d33/d42/da2/da7/dd2 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:0/570: getdents d23/d28/d41 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:4/804: dread d4/d1d/d42/d66/d5f/fd1 [0,4194304] 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:2/590: write d3/d4d/f90 [3013620,44984] 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:8/708: dwrite d9/dd/de/d14/d65/d6c/f3a [0,4194304] 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:6/631: unlink d2/d17/d33/d42/d5e/cb1 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:4/805: symlink d4/d14/d31/l109 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:4/806: fdatasync d4/d1d/d42/d66/d12/d2d/f75 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:2/591: link d3/d4d/d5f/l9c d3/db/d29/d4c/dae/lbd 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:1/814: sync 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:8/709: mknod d9/dd/d44/de4/ce5 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:8/710: chown d9/dd/de/d2d/d2e/d49/d50/d59/d8a 11952 1 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:8/711: creat d9/dd/de/d14/fe6 x:0 0 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:5/660: dwrite d5/dd/df/d22/f37 [0,4194304] 0 2024-02-19T19:07:36.910 INFO:tasks.workunit.client.1.smithi142.stdout:4/807: unlink d4/d1d/d42/f9c 0 2024-02-19T19:07:36.911 INFO:tasks.workunit.client.1.smithi142.stdout:6/632: dread d2/d1e/d35/d66/d8d/f50 [0,4194304] 0 2024-02-19T19:07:36.911 INFO:tasks.workunit.client.1.smithi142.stdout:6/633: dread - d2/d17/d33/d42/da2/fb4 zero size 2024-02-19T19:07:36.912 INFO:tasks.workunit.client.1.smithi142.stdout:5/661: mknod d5/dd/d5f/d6a/ce1 0 2024-02-19T19:07:36.912 INFO:tasks.workunit.client.1.smithi142.stdout:5/662: chown d5/dd/df/d22/d41/d32/d53/l77 3693 1 2024-02-19T19:07:36.913 INFO:tasks.workunit.client.1.smithi142.stdout:2/592: write d3/df/f12 [11154761,44377] 0 2024-02-19T19:07:36.914 INFO:tasks.workunit.client.1.smithi142.stdout:2/593: readlink d3/df/l30 0 2024-02-19T19:07:36.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/634: rename d2/d1e/d35/d66/d8d/d89 to d2/d17/d33/d42/da2/da7/dd2/dd3 0 2024-02-19T19:07:36.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/635: dread - d2/d17/d33/d42/da2/fb4 zero size 2024-02-19T19:07:36.917 INFO:tasks.workunit.client.1.smithi142.stdout:0/571: dwrite d23/d7d/f99 [0,4194304] 0 2024-02-19T19:07:36.917 INFO:tasks.workunit.client.1.smithi142.stdout:5/663: symlink d5/dd/d8/d1c/le2 0 2024-02-19T19:07:36.918 INFO:tasks.workunit.client.1.smithi142.stdout:1/815: write d5/f38 [2425704,117215] 0 2024-02-19T19:07:36.918 INFO:tasks.workunit.client.1.smithi142.stdout:1/816: creat d5/d37/d6c/d75/da2/f121 x:0 0 0 2024-02-19T19:07:36.923 INFO:tasks.workunit.client.1.smithi142.stdout:0/572: getdents d23/d32 0 2024-02-19T19:07:36.923 INFO:tasks.workunit.client.1.smithi142.stdout:2/594: write d3/d4d/d5f/f72 [2771033,119543] 0 2024-02-19T19:07:36.925 INFO:tasks.workunit.client.1.smithi142.stdout:5/664: mkdir d5/dda/de3 0 2024-02-19T19:07:36.925 INFO:tasks.workunit.client.1.smithi142.stdout:5/665: truncate d5/dd/d8/d1c/d8a/f6c 902536 0 2024-02-19T19:07:36.925 INFO:tasks.workunit.client.1.smithi142.stdout:5/666: read - d5/dd/d8/d2a/fc4 zero size 2024-02-19T19:07:36.928 INFO:tasks.workunit.client.1.smithi142.stdout:6/636: write d2/d17/d33/d42/da2/da7/d55/daf/fb3 [1334403,86417] 0 2024-02-19T19:07:36.928 INFO:tasks.workunit.client.1.smithi142.stdout:6/637: write d2/d17/d33/d42/da2/da7/d55/d69/fb2 [378594,80731] 0 2024-02-19T19:07:36.928 INFO:tasks.workunit.client.1.smithi142.stdout:8/712: dwrite d9/dd/d44/d79/f39 [0,4194304] 0 2024-02-19T19:07:36.929 INFO:tasks.workunit.client.1.smithi142.stdout:0/573: rename d23/d28/d2d/d51/d44/fb8 to d23/d28/d2d/d51/d44/fb9 0 2024-02-19T19:07:36.931 INFO:tasks.workunit.client.1.smithi142.stdout:5/667: symlink d5/dd/d8/d2a/le4 0 2024-02-19T19:07:36.933 INFO:tasks.workunit.client.1.smithi142.stdout:1/817: dread d5/d7/f3e [0,4194304] 0 2024-02-19T19:07:36.933 INFO:tasks.workunit.client.1.smithi142.stdout:4/808: dwrite d4/d1d/d42/d66/d12/d2d/fda [0,4194304] 0 2024-02-19T19:07:36.935 INFO:tasks.workunit.client.1.smithi142.stdout:6/638: link d2/d1f/d20/f25 d2/d17/d33/d42/da2/da7/dd2/dd3/fd4 0 2024-02-19T19:07:36.938 INFO:tasks.workunit.client.1.smithi142.stdout:0/574: rename d23/d28/d2d/d54/d85/lb4 to d23/d7d/lba 0 2024-02-19T19:07:36.938 INFO:tasks.workunit.client.1.smithi142.stdout:0/575: write d23/d28/d2d/d51/d44/d58/f83 [751000,32629] 0 2024-02-19T19:07:36.943 INFO:tasks.workunit.client.1.smithi142.stdout:2/595: dwrite d3/db/f3a [0,4194304] 0 2024-02-19T19:07:36.944 INFO:tasks.workunit.client.1.smithi142.stdout:1/818: getdents d5/d77/da9/dae/deb/df9 0 2024-02-19T19:07:36.948 INFO:tasks.workunit.client.1.smithi142.stdout:4/809: unlink d4/d1d/d42/d66/d12/f18 0 2024-02-19T19:07:36.949 INFO:tasks.workunit.client.1.smithi142.stdout:6/639: unlink d2/d1f/d5c/d63/f82 0 2024-02-19T19:07:36.952 INFO:tasks.workunit.client.1.smithi142.stdout:0/576: symlink d23/d28/d2d/d51/d44/d58/lbb 0 2024-02-19T19:07:36.956 INFO:tasks.workunit.client.1.smithi142.stdout:4/810: rename d4/d14/d31/c47 to d4/d14/d31/dab/da2/c10a 0 2024-02-19T19:07:36.956 INFO:tasks.workunit.client.1.smithi142.stdout:4/811: chown d4/d1d/d42/d66/d12/d79 1 1 2024-02-19T19:07:36.957 INFO:tasks.workunit.client.1.smithi142.stdout:8/713: dwrite f1 [4194304,4194304] 0 2024-02-19T19:07:36.957 INFO:tasks.workunit.client.1.smithi142.stdout:8/714: stat d9/dd/de/d14/d65/d6c/d9c/fca 0 2024-02-19T19:07:36.958 INFO:tasks.workunit.client.1.smithi142.stdout:5/668: dwrite d5/dd/df/d22/d41/d32/f84 [0,4194304] 0 2024-02-19T19:07:36.958 INFO:tasks.workunit.client.1.smithi142.stdout:5/669: fsync d5/dd/d8/d2a/f2d 0 2024-02-19T19:07:36.958 INFO:tasks.workunit.client.1.smithi142.stdout:6/640: link d2/d17/d33/c44 d2/d1e/cd5 0 2024-02-19T19:07:36.958 INFO:tasks.workunit.client.1.smithi142.stdout:6/641: chown d2/d1f/c28 0 1 2024-02-19T19:07:36.958 INFO:tasks.workunit.client.1.smithi142.stdout:0/577: stat d23/d28/d2d/cb5 0 2024-02-19T19:07:36.960 INFO:tasks.workunit.client.1.smithi142.stdout:4/812: rename d4/d14/d31/dab/da2/db3/fd5 to d4/d1d/d42/d66/dd/d10/d3e/d68/f10b 0 2024-02-19T19:07:36.960 INFO:tasks.workunit.client.1.smithi142.stdout:6/642: rename d2/d17/d33/d42/da2/da7/d55 to d2/d17/d33/d42/da2/da7/d55/daf/dd6 22 2024-02-19T19:07:36.962 INFO:tasks.workunit.client.1.smithi142.stdout:5/670: truncate d5/dd/df/d22/d41/d32/fa8 2802974 0 2024-02-19T19:07:36.965 INFO:tasks.workunit.client.1.smithi142.stdout:0/578: creat d23/d28/d2d/d54/d88/d9f/fbc x:0 0 0 2024-02-19T19:07:36.966 INFO:tasks.workunit.client.1.smithi142.stdout:0/579: truncate d23/d28/d2d/d51/d44/f4d 1529462 0 2024-02-19T19:07:36.966 INFO:tasks.workunit.client.1.smithi142.stdout:2/596: dwrite d3/db/d29/d4c/d4e/d9a/da9/dad/faf [0,4194304] 0 2024-02-19T19:07:36.968 INFO:tasks.workunit.client.1.smithi142.stdout:8/715: write d9/dd/de/d14/f51 [3053904,66008] 0 2024-02-19T19:07:36.968 INFO:tasks.workunit.client.1.smithi142.stdout:8/716: fdatasync d9/dd/de/d2d/fa3 0 2024-02-19T19:07:36.969 INFO:tasks.workunit.client.1.smithi142.stdout:6/643: truncate d2/d17/f73 718540 0 2024-02-19T19:07:36.969 INFO:tasks.workunit.client.1.smithi142.stdout:6/644: chown d2/d1e/d35/d66/fa5 0 1 2024-02-19T19:07:36.969 INFO:tasks.workunit.client.1.smithi142.stdout:5/671: mknod d5/dd/d8/d2a/d57/ce5 0 2024-02-19T19:07:36.969 INFO:tasks.workunit.client.1.smithi142.stdout:6/645: chown d2/d1f/d20/d31/d62 16 1 2024-02-19T19:07:36.969 INFO:tasks.workunit.client.1.smithi142.stdout:5/672: truncate d5/dd/d8/d31/f6e 1227018 0 2024-02-19T19:07:36.969 INFO:tasks.workunit.client.1.smithi142.stdout:5/673: creat d5/dd/d8/d5d/fe6 x:0 0 0 2024-02-19T19:07:36.970 INFO:tasks.workunit.client.1.smithi142.stdout:9/677: sync 2024-02-19T19:07:36.970 INFO:tasks.workunit.client.1.smithi142.stdout:4/813: write d4/d1c/f2e [2634757,88314] 0 2024-02-19T19:07:36.973 INFO:tasks.workunit.client.1.smithi142.stdout:9/678: rename db/d8e/fae to db/d10/fb6 0 2024-02-19T19:07:36.973 INFO:tasks.workunit.client.1.smithi142.stdout:9/679: dread - db/d10/fb6 zero size 2024-02-19T19:07:36.978 INFO:tasks.workunit.client.1.smithi142.stdout:4/814: rename d4/d1c/dae/dcb/f102 to d4/d1c/dae/dfa/f10c 0 2024-02-19T19:07:36.979 INFO:tasks.workunit.client.1.smithi142.stdout:9/680: rmdir db/d10/d27/d2f/d4c/d54 39 2024-02-19T19:07:36.980 INFO:tasks.workunit.client.1.smithi142.stdout:3/825: sync 2024-02-19T19:07:36.982 INFO:tasks.workunit.client.1.smithi142.stdout:4/815: symlink d4/d1d/d42/d66/dd/d10/d3e/d68/l10d 0 2024-02-19T19:07:36.982 INFO:tasks.workunit.client.1.smithi142.stdout:4/816: write d4/fff [521061,75868] 0 2024-02-19T19:07:36.982 INFO:tasks.workunit.client.1.smithi142.stdout:4/817: chown d4/d14/d31/dab/f63 7771836 1 2024-02-19T19:07:36.982 INFO:tasks.workunit.client.1.smithi142.stdout:7/587: sync 2024-02-19T19:07:36.982 INFO:tasks.workunit.client.1.smithi142.stdout:5/674: dread d5/dd/df/d22/d41/d6f/f89 [0,4194304] 0 2024-02-19T19:07:36.983 INFO:tasks.workunit.client.1.smithi142.stdout:5/675: fsync d5/dd/df/f59 0 2024-02-19T19:07:36.986 INFO:tasks.workunit.client.1.smithi142.stdout:7/588: unlink d0/d1b/d21/d24/d29/d44/c61 0 2024-02-19T19:07:36.986 INFO:tasks.workunit.client.1.smithi142.stdout:9/681: dread db/d10/d22/d24/d41/f74 [0,4194304] 0 2024-02-19T19:07:36.986 INFO:tasks.workunit.client.1.smithi142.stdout:9/682: fdatasync db/d10/d7d/f8f 0 2024-02-19T19:07:36.986 INFO:tasks.workunit.client.1.smithi142.stdout:9/683: write db/d10/fb6 [32646,48171] 0 2024-02-19T19:07:36.988 INFO:tasks.workunit.client.1.smithi142.stdout:5/676: rename d5/dd/d8/c1f to d5/dd/df/da0/ce7 0 2024-02-19T19:07:36.989 INFO:tasks.workunit.client.1.smithi142.stdout:5/677: chown d5/dd/df/f6b 1891 1 2024-02-19T19:07:36.990 INFO:tasks.workunit.client.1.smithi142.stdout:0/580: dwrite d23/d7d/f92 [0,4194304] 0 2024-02-19T19:07:36.991 INFO:tasks.workunit.client.1.smithi142.stdout:7/589: rmdir d0/d1b/d21/d24/da9 0 2024-02-19T19:07:36.992 INFO:tasks.workunit.client.1.smithi142.stdout:9/684: creat db/d10/d32/fb7 x:0 0 0 2024-02-19T19:07:36.994 INFO:tasks.workunit.client.1.smithi142.stdout:4/818: write d4/d1d/d42/d66/f8b [1028437,88017] 0 2024-02-19T19:07:36.994 INFO:tasks.workunit.client.1.smithi142.stdout:5/678: symlink d5/dd/d8/d31/d4d/d75/le8 0 2024-02-19T19:07:36.994 INFO:tasks.workunit.client.1.smithi142.stdout:8/717: dwrite d9/dd/de/d2d/d2e/d49/d50/d59/f7f [0,4194304] 0 2024-02-19T19:07:36.998 INFO:tasks.workunit.client.1.smithi142.stdout:3/826: dread d1d/d1e/d6e/f99 [0,4194304] 0 2024-02-19T19:07:36.998 INFO:tasks.workunit.client.1.smithi142.stdout:9/685: mkdir db/d10/d22/d24/d41/db8 0 2024-02-19T19:07:37.000 INFO:tasks.workunit.client.1.smithi142.stdout:5/679: dread d5/dd/d8/d31/d4d/d60/f66 [0,4194304] 0 2024-02-19T19:07:37.000 INFO:tasks.workunit.client.1.smithi142.stdout:5/680: write d5/dd/d8/d2a/f90 [582231,124928] 0 2024-02-19T19:07:37.000 INFO:tasks.workunit.client.1.smithi142.stdout:5/681: read d5/dd/fd3 [729534,58558] 0 2024-02-19T19:07:37.002 INFO:tasks.workunit.client.1.smithi142.stdout:5/682: creat d5/dd/d8/d31/d4d/fe9 x:0 0 0 2024-02-19T19:07:37.011 INFO:tasks.workunit.client.1.smithi142.stdout:9/686: dread db/f18 [0,4194304] 0 2024-02-19T19:07:37.012 INFO:tasks.workunit.client.1.smithi142.stdout:8/718: read d9/dd/f57 [274034,81321] 0 2024-02-19T19:07:37.012 INFO:tasks.workunit.client.1.smithi142.stdout:8/719: write d9/dd/de/d2d/d2e/d73/f92 [347182,10668] 0 2024-02-19T19:07:37.012 INFO:tasks.workunit.client.1.smithi142.stdout:8/720: write d9/dd/d44/d79/f69 [984557,39147] 0 2024-02-19T19:07:37.014 INFO:tasks.workunit.client.1.smithi142.stdout:8/721: unlink d9/dd/de/d2d/d2e/d49/d58/f5b 0 2024-02-19T19:07:37.015 INFO:tasks.workunit.client.1.smithi142.stdout:3/827: write d1d/d1e/d2e/d50/d7c/da7/f95 [3352135,93546] 0 2024-02-19T19:07:37.016 INFO:tasks.workunit.client.1.smithi142.stdout:8/722: unlink f0 0 2024-02-19T19:07:37.019 INFO:tasks.workunit.client.1.smithi142.stdout:8/723: truncate d9/dd/d15/d31/fbb 6106966 0 2024-02-19T19:07:37.032 INFO:tasks.workunit.client.1.smithi142.stdout:3/828: dread d1d/d1e/d2e/d50/d7c/da7/d52/d5a/fcc [0,4194304] 0 2024-02-19T19:07:37.032 INFO:tasks.workunit.client.1.smithi142.stdout:3/829: write d1d/d1e/d2e/dee/da2/fd2 [5238727,87513] 0 2024-02-19T19:07:37.033 INFO:tasks.workunit.client.1.smithi142.stdout:3/830: dread - d1d/d1e/d6e/f72 zero size 2024-02-19T19:07:37.035 INFO:tasks.workunit.client.1.smithi142.stdout:7/590: dwrite d0/d13/d1e/f5c [0,4194304] 0 2024-02-19T19:07:37.036 INFO:tasks.workunit.client.1.smithi142.stdout:5/683: dwrite d5/dd/fd3 [0,4194304] 0 2024-02-19T19:07:37.036 INFO:tasks.workunit.client.1.smithi142.stdout:7/591: mknod d0/d1b/d21/d24/d29/d44/d49/d7a/cc6 0 2024-02-19T19:07:37.038 INFO:tasks.workunit.client.1.smithi142.stdout:2/597: dwrite d3/db/d29/d6d/d59/f99 [0,4194304] 0 2024-02-19T19:07:37.038 INFO:tasks.workunit.client.1.smithi142.stdout:2/598: creat d3/fbe x:0 0 0 2024-02-19T19:07:37.038 INFO:tasks.workunit.client.1.smithi142.stdout:0/581: dwrite d23/d28/d2d/d51/d44/d58/f83 [0,4194304] 0 2024-02-19T19:07:37.038 INFO:tasks.workunit.client.1.smithi142.stdout:0/582: chown d23/l84 610 1 2024-02-19T19:07:37.038 INFO:tasks.workunit.client.1.smithi142.stdout:9/687: dwrite db/d10/d22/d24/d41/d99/fb1 [0,4194304] 0 2024-02-19T19:07:37.038 INFO:tasks.workunit.client.1.smithi142.stdout:9/688: getdents db/d10/d22/daf 0 2024-02-19T19:07:37.038 INFO:tasks.workunit.client.1.smithi142.stdout:9/689: fsync db/d10/d27/d2f/d4c/f7a 0 2024-02-19T19:07:37.038 INFO:tasks.workunit.client.1.smithi142.stdout:5/684: rename d5/dd/df/d22/d41/f26 to d5/dd/df/d22/d41/fea 0 2024-02-19T19:07:37.038 INFO:tasks.workunit.client.1.smithi142.stdout:4/819: dwrite d4/d1d/d42/d66/d12/d2d/f33 [4194304,4194304] 0 2024-02-19T19:07:37.040 INFO:tasks.workunit.client.1.smithi142.stdout:7/592: symlink d0/lc7 0 2024-02-19T19:07:37.042 INFO:tasks.workunit.client.1.smithi142.stdout:2/599: rename d3/db/d29/d4c/d4a to d3/d35/d97/dbf 0 2024-02-19T19:07:37.042 INFO:tasks.workunit.client.1.smithi142.stdout:2/600: fdatasync d3/f8 0 2024-02-19T19:07:37.042 INFO:tasks.workunit.client.1.smithi142.stdout:2/601: fsync d3/db/d29/d4c/d4e/d9a/da9/dad/faf 0 2024-02-19T19:07:37.046 INFO:tasks.workunit.client.1.smithi142.stdout:7/593: dread d0/d1b/f91 [0,4194304] 0 2024-02-19T19:07:37.049 INFO:tasks.workunit.client.1.smithi142.stdout:0/583: symlink d23/d28/d2d/d51/d44/d58/lbd 0 2024-02-19T19:07:37.050 INFO:tasks.workunit.client.1.smithi142.stdout:2/602: dread d3/db/d29/f5d [0,4194304] 0 2024-02-19T19:07:37.051 INFO:tasks.workunit.client.1.smithi142.stdout:9/690: unlink db/d10/d27/f49 0 2024-02-19T19:07:37.065 INFO:tasks.workunit.client.1.smithi142.stdout:7/594: mknod d0/d1b/d21/d24/cc8 0 2024-02-19T19:07:37.066 INFO:tasks.workunit.client.1.smithi142.stdout:0/584: mknod d23/d28/d2d/d51/cbe 0 2024-02-19T19:07:37.067 INFO:tasks.workunit.client.1.smithi142.stdout:9/691: mkdir db/d10/d27/db9 0 2024-02-19T19:07:37.072 INFO:tasks.workunit.client.1.smithi142.stdout:7/595: creat d0/d1b/d9d/fc9 x:0 0 0 2024-02-19T19:07:37.072 INFO:tasks.workunit.client.1.smithi142.stdout:7/596: write d0/d1b/f91 [1702792,80688] 0 2024-02-19T19:07:37.072 INFO:tasks.workunit.client.1.smithi142.stdout:5/685: dwrite d5/dd/d5f/f85 [0,4194304] 0 2024-02-19T19:07:37.072 INFO:tasks.workunit.client.1.smithi142.stdout:5/686: chown d5/dd/d8/d1c/lac 493 1 2024-02-19T19:07:37.072 INFO:tasks.workunit.client.1.smithi142.stdout:4/820: dwrite d4/d1d/d42/d66/d5f/fd1 [4194304,4194304] 0 2024-02-19T19:07:37.073 INFO:tasks.workunit.client.1.smithi142.stdout:0/585: truncate d23/d28/d2d/d51/d44/f89 1269271 0 2024-02-19T19:07:37.076 INFO:tasks.workunit.client.1.smithi142.stdout:9/692: rename db/d10/d27/d2f/d4c/d54/d83 to db/d10/d27/d2f/dba 0 2024-02-19T19:07:37.084 INFO:tasks.workunit.client.1.smithi142.stdout:4/821: symlink d4/d1d/d42/d66/l10e 0 2024-02-19T19:07:37.084 INFO:tasks.workunit.client.1.smithi142.stdout:4/822: write d4/d14/d31/dab/d6e/fc4 [664348,53794] 0 2024-02-19T19:07:37.084 INFO:tasks.workunit.client.1.smithi142.stdout:4/823: dread - d4/d1d/d42/d66/dd/f7b zero size 2024-02-19T19:07:37.085 INFO:tasks.workunit.client.1.smithi142.stdout:0/586: symlink d23/d28/d2d/d54/d88/d9f/lbf 0 2024-02-19T19:07:37.085 INFO:tasks.workunit.client.1.smithi142.stdout:0/587: write d23/d28/d2d/d51/fa6 [839246,119553] 0 2024-02-19T19:07:37.085 INFO:tasks.workunit.client.1.smithi142.stdout:0/588: chown d23/d28/d2d/d51/cbe 202 1 2024-02-19T19:07:37.085 INFO:tasks.workunit.client.1.smithi142.stdout:0/589: chown d23/d28/d2d/f79 1128833 1 2024-02-19T19:07:37.085 INFO:tasks.workunit.client.1.smithi142.stdout:0/590: fdatasync d23/d28/d2d/d51/d44/f49 0 2024-02-19T19:07:37.086 INFO:tasks.workunit.client.1.smithi142.stdout:0/591: readlink d23/d7d/d9e/lb2 0 2024-02-19T19:07:37.088 INFO:tasks.workunit.client.1.smithi142.stdout:5/687: rename d5/dd/d5f/f85 to d5/dd/d8/dbc/feb 0 2024-02-19T19:07:37.089 INFO:tasks.workunit.client.1.smithi142.stdout:7/597: getdents d0/d1b/d21 0 2024-02-19T19:07:37.089 INFO:tasks.workunit.client.1.smithi142.stdout:7/598: getdents d0/d1b/d21/d24/d29/d44/dbd 0 2024-02-19T19:07:37.091 INFO:tasks.workunit.client.1.smithi142.stdout:4/824: creat d4/d1d/d42/d66/d12/d79/f10f x:0 0 0 2024-02-19T19:07:37.092 INFO:tasks.workunit.client.1.smithi142.stdout:0/592: dread d23/d28/d41/f91 [0,4194304] 0 2024-02-19T19:07:37.092 INFO:tasks.workunit.client.1.smithi142.stdout:0/593: write d23/d28/d2d/f79 [1005950,83745] 0 2024-02-19T19:07:37.093 INFO:tasks.workunit.client.1.smithi142.stdout:9/693: rename db/d10/d27/d2f/d4c/d54/l4f to db/d10/d27/lbb 0 2024-02-19T19:07:37.095 INFO:tasks.workunit.client.1.smithi142.stdout:5/688: creat d5/dd/df/d22/fec x:0 0 0 2024-02-19T19:07:37.096 INFO:tasks.workunit.client.1.smithi142.stdout:7/599: truncate d0/d1b/d21/d24/f34 1184533 0 2024-02-19T19:07:37.098 INFO:tasks.workunit.client.1.smithi142.stdout:4/825: mknod d4/d1d/c110 0 2024-02-19T19:07:37.098 INFO:tasks.workunit.client.1.smithi142.stdout:4/826: chown d4/d1d/d42/d66/d12/d2d/d2a 974 1 2024-02-19T19:07:37.099 INFO:tasks.workunit.client.1.smithi142.stdout:9/694: creat db/d10/d32/d3f/d5f/fbc x:0 0 0 2024-02-19T19:07:37.100 INFO:tasks.workunit.client.1.smithi142.stdout:7/600: mkdir d0/d13/d1e/db7/dca 0 2024-02-19T19:07:37.100 INFO:tasks.workunit.client.1.smithi142.stdout:7/601: stat d0/d1b/d21/d24/d29/d44/d49 0 2024-02-19T19:07:37.100 INFO:tasks.workunit.client.1.smithi142.stdout:9/695: rmdir db/d10/d32/d3f/db3 39 2024-02-19T19:07:37.101 INFO:tasks.workunit.client.1.smithi142.stdout:9/696: creat db/d10/fbd x:0 0 0 2024-02-19T19:07:37.101 INFO:tasks.workunit.client.1.smithi142.stdout:9/697: chown db/d10/d22/f9d 3 1 2024-02-19T19:07:37.101 INFO:tasks.workunit.client.1.smithi142.stdout:0/594: dread d23/d28/d2d/d51/d44/d58/f76 [0,4194304] 0 2024-02-19T19:07:37.101 INFO:tasks.workunit.client.1.smithi142.stdout:7/602: mkdir d0/d1b/dbc/dcb 0 2024-02-19T19:07:37.103 INFO:tasks.workunit.client.1.smithi142.stdout:4/827: dread d4/d1c/f106 [0,4194304] 0 2024-02-19T19:07:37.105 INFO:tasks.workunit.client.1.smithi142.stdout:9/698: getdents db/d8e 0 2024-02-19T19:07:37.108 INFO:tasks.workunit.client.1.smithi142.stdout:0/595: mkdir d23/d7d/d9e/dc0 0 2024-02-19T19:07:37.109 INFO:tasks.workunit.client.1.smithi142.stdout:7/603: creat d0/d1b/d9d/da4/fcc x:0 0 0 2024-02-19T19:07:37.111 INFO:tasks.workunit.client.1.smithi142.stdout:4/828: mkdir d4/d1d/d42/d66/dd/d10/d26/d50/d54/d111 0 2024-02-19T19:07:37.111 INFO:tasks.workunit.client.1.smithi142.stdout:1/819: sync 2024-02-19T19:07:37.111 INFO:tasks.workunit.client.1.smithi142.stdout:5/689: dwrite d5/dd/df/d22/d41/d6f/fdd [0,4194304] 0 2024-02-19T19:07:37.111 INFO:tasks.workunit.client.1.smithi142.stdout:5/690: dread - d5/dd/d8/d5d/f7e zero size 2024-02-19T19:07:37.112 INFO:tasks.workunit.client.1.smithi142.stdout:0/596: mkdir d23/d28/d2d/d51/d44/d58/dc1 0 2024-02-19T19:07:37.115 INFO:tasks.workunit.client.1.smithi142.stdout:1/820: creat d5/d7/d23/dab/f122 x:0 0 0 2024-02-19T19:07:37.115 INFO:tasks.workunit.client.1.smithi142.stdout:1/821: truncate d5/d37/d6c/d75/da2/f121 888175 0 2024-02-19T19:07:37.115 INFO:tasks.workunit.client.1.smithi142.stdout:1/822: fsync d5/f117 0 2024-02-19T19:07:37.115 INFO:tasks.workunit.client.1.smithi142.stdout:4/829: getdents d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f 0 2024-02-19T19:07:37.121 INFO:tasks.workunit.client.1.smithi142.stdout:5/691: mknod d5/dd/df/d15/ced 0 2024-02-19T19:07:37.122 INFO:tasks.workunit.client.1.smithi142.stdout:5/692: write d5/f20 [1387686,105117] 0 2024-02-19T19:07:37.122 INFO:tasks.workunit.client.1.smithi142.stdout:5/693: dread - d5/dd/df/d22/d41/fd0 zero size 2024-02-19T19:07:37.125 INFO:tasks.workunit.client.1.smithi142.stdout:1/823: link d5/d37/d6c/d75/da2/cee d5/d77/da9/dae/deb/df9/c123 0 2024-02-19T19:07:37.125 INFO:tasks.workunit.client.1.smithi142.stdout:1/824: readlink d5/d77/da9/dae/deb/df9/l11d 0 2024-02-19T19:07:37.125 INFO:tasks.workunit.client.1.smithi142.stdout:1/825: fsync d5/d7/d4a/f81 0 2024-02-19T19:07:37.127 INFO:tasks.workunit.client.1.smithi142.stdout:1/826: dread d5/d37/f93 [0,4194304] 0 2024-02-19T19:07:37.127 INFO:tasks.workunit.client.1.smithi142.stdout:7/604: dwrite d0/d62/f81 [0,4194304] 0 2024-02-19T19:07:37.127 INFO:tasks.workunit.client.1.smithi142.stdout:7/605: chown d0/d13/d72/f45 2059 1 2024-02-19T19:07:37.127 INFO:tasks.workunit.client.1.smithi142.stdout:4/830: mkdir d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f/d112 0 2024-02-19T19:07:37.127 INFO:tasks.workunit.client.1.smithi142.stdout:4/831: dread - d4/d1d/d42/d66/dd/f7b zero size 2024-02-19T19:07:37.127 INFO:tasks.workunit.client.1.smithi142.stdout:4/832: dread - d4/d1d/d42/d66/d12/fc0 zero size 2024-02-19T19:07:37.130 INFO:tasks.workunit.client.1.smithi142.stdout:5/694: rename f4 to d5/dd/d5f/fee 0 2024-02-19T19:07:37.130 INFO:tasks.workunit.client.1.smithi142.stdout:5/695: fsync d5/dd/df/f59 0 2024-02-19T19:07:37.130 INFO:tasks.workunit.client.1.smithi142.stdout:5/696: write d5/dd/d8/d29/f96 [176863,91560] 0 2024-02-19T19:07:37.134 INFO:tasks.workunit.client.1.smithi142.stdout:7/606: symlink d0/d1b/d21/d24/d29/d44/d49/lcd 0 2024-02-19T19:07:37.134 INFO:tasks.workunit.client.1.smithi142.stdout:7/607: getdents d0/d1b/d21 0 2024-02-19T19:07:37.136 INFO:tasks.workunit.client.1.smithi142.stdout:4/833: link d4/d1d/d42/d66/d12/d79/l90 d4/d1d/d42/d66/dd/d10/d26/d50/d54/d111/l113 0 2024-02-19T19:07:37.137 INFO:tasks.workunit.client.1.smithi142.stdout:7/608: creat d0/d13/d72/da7/fce x:0 0 0 2024-02-19T19:07:37.137 INFO:tasks.workunit.client.1.smithi142.stdout:7/609: write d0/f16 [6164705,93923] 0 2024-02-19T19:07:37.138 INFO:tasks.workunit.client.1.smithi142.stdout:7/610: write d0/d1b/d21/d24/d29/d44/f66 [2002026,59760] 0 2024-02-19T19:07:37.138 INFO:tasks.workunit.client.1.smithi142.stdout:7/611: write d0/d13/f70 [138002,46550] 0 2024-02-19T19:07:37.141 INFO:tasks.workunit.client.1.smithi142.stdout:7/612: rename d0/d1b/d21/d24/d29/l2f to d0/d1b/d21/d24/d29/lcf 0 2024-02-19T19:07:37.143 INFO:tasks.workunit.client.1.smithi142.stdout:6/646: sync 2024-02-19T19:07:37.143 INFO:tasks.workunit.client.1.smithi142.stdout:5/697: dread d5/dd/d5f/fee [0,4194304] 0 2024-02-19T19:07:37.143 INFO:tasks.workunit.client.1.smithi142.stdout:0/597: dwrite d23/d86/f8b [4194304,4194304] 0 2024-02-19T19:07:37.145 INFO:tasks.workunit.client.1.smithi142.stdout:6/647: truncate d2/d29/d47/f68 2432968 0 2024-02-19T19:07:37.146 INFO:tasks.workunit.client.1.smithi142.stdout:1/827: dwrite d5/d7/d4a/d53/fb3 [0,4194304] 0 2024-02-19T19:07:37.147 INFO:tasks.workunit.client.1.smithi142.stdout:5/698: symlink d5/dd/d5f/d6a/lef 0 2024-02-19T19:07:37.150 INFO:tasks.workunit.client.1.smithi142.stdout:6/648: unlink d2/d17/d33/f53 0 2024-02-19T19:07:37.150 INFO:tasks.workunit.client.1.smithi142.stdout:6/649: fdatasync d2/d17/d33/d42/da2/fb5 0 2024-02-19T19:07:37.151 INFO:tasks.workunit.client.1.smithi142.stdout:5/699: getdents d5/dd/df/d15/d5b 0 2024-02-19T19:07:37.152 INFO:tasks.workunit.client.1.smithi142.stdout:5/700: mkdir d5/dd/d8/d31/df0 0 2024-02-19T19:07:37.153 INFO:tasks.workunit.client.1.smithi142.stdout:5/701: symlink d5/dd/d95/lf1 0 2024-02-19T19:07:37.154 INFO:tasks.workunit.client.1.smithi142.stdout:7/613: write d0/fd [891771,41578] 0 2024-02-19T19:07:37.156 INFO:tasks.workunit.client.1.smithi142.stdout:7/614: unlink d0/d13/d72/d47/d69/f98 0 2024-02-19T19:07:37.156 INFO:tasks.workunit.client.1.smithi142.stdout:7/615: fdatasync d0/d13/f15 0 2024-02-19T19:07:37.156 INFO:tasks.workunit.client.1.smithi142.stdout:7/616: readlink d0/d13/d1e/l5b 0 2024-02-19T19:07:37.156 INFO:tasks.workunit.client.1.smithi142.stdout:7/617: chown d0/d1b/d21/d24/d5e/d65/c7b 47 1 2024-02-19T19:07:37.156 INFO:tasks.workunit.client.1.smithi142.stdout:7/618: write d0/d1b/d21/d24/d5e/d65/f74 [343986,11528] 0 2024-02-19T19:07:37.156 INFO:tasks.workunit.client.1.smithi142.stdout:7/619: stat d0/d13/lae 0 2024-02-19T19:07:37.157 INFO:tasks.workunit.client.1.smithi142.stdout:7/620: fdatasync d0/fa1 0 2024-02-19T19:07:37.157 INFO:tasks.workunit.client.1.smithi142.stdout:0/598: dread d23/d28/f34 [0,4194304] 0 2024-02-19T19:07:37.157 INFO:tasks.workunit.client.1.smithi142.stdout:0/599: truncate d23/d32/d8a/fb0 172243 0 2024-02-19T19:07:37.157 INFO:tasks.workunit.client.1.smithi142.stdout:7/621: creat d0/d1b/fd0 x:0 0 0 2024-02-19T19:07:37.160 INFO:tasks.workunit.client.1.smithi142.stdout:1/828: dread d5/d7/d23/d2c/f3b [0,4194304] 0 2024-02-19T19:07:37.160 INFO:tasks.workunit.client.1.smithi142.stdout:1/829: truncate d5/d7/d23/dab/f122 548551 0 2024-02-19T19:07:37.160 INFO:tasks.workunit.client.1.smithi142.stdout:1/830: fdatasync d5/d37/d6c/d75/da2/fe9 0 2024-02-19T19:07:37.160 INFO:tasks.workunit.client.1.smithi142.stdout:1/831: creat d5/d7/d23/da4/f124 x:0 0 0 2024-02-19T19:07:37.160 INFO:tasks.workunit.client.1.smithi142.stdout:4/834: dwrite d4/d1d/d42/d66/dd/d10/d3e/f4e [0,4194304] 0 2024-02-19T19:07:37.161 INFO:tasks.workunit.client.1.smithi142.stdout:6/650: read d2/d1f/d4d/fa3 [4044627,72871] 0 2024-02-19T19:07:37.162 INFO:tasks.workunit.client.1.smithi142.stdout:1/832: write d5/d7/d23/d2c/fd7 [970032,16954] 0 2024-02-19T19:07:37.162 INFO:tasks.workunit.client.1.smithi142.stdout:5/702: dread d5/dd/df/d22/d41/fea [0,4194304] 0 2024-02-19T19:07:37.163 INFO:tasks.workunit.client.1.smithi142.stdout:5/703: rename d5/dd/df/d22/d41/d32 to d5/dd/df/d22/d41/d32/d53/df2 22 2024-02-19T19:07:37.169 INFO:tasks.workunit.client.1.smithi142.stdout:0/600: read f17 [2957048,5339] 0 2024-02-19T19:07:37.174 INFO:tasks.workunit.client.1.smithi142.stdout:7/622: dread d0/f16 [4194304,4194304] 0 2024-02-19T19:07:37.174 INFO:tasks.workunit.client.1.smithi142.stdout:7/623: chown d0/d1b/d21/d24/d29/d44/d49/d9b/fb4 7075 1 2024-02-19T19:07:37.177 INFO:tasks.workunit.client.1.smithi142.stdout:5/704: rmdir d5/dd/d8/d5d 39 2024-02-19T19:07:37.177 INFO:tasks.workunit.client.1.smithi142.stdout:5/705: stat d5/dd/df/d15/d5b/f79 0 2024-02-19T19:07:37.177 INFO:tasks.workunit.client.1.smithi142.stdout:5/706: chown d5/dd/d8/d31/d4d/d8d/f98 0 1 2024-02-19T19:07:37.179 INFO:tasks.workunit.client.1.smithi142.stdout:4/835: dwrite d4/d1d/d42/d66/dd/d10/d26/d50/d54/fca [0,4194304] 0 2024-02-19T19:07:37.180 INFO:tasks.workunit.client.1.smithi142.stdout:4/836: chown d4/d14/f16 17536391 1 2024-02-19T19:07:37.180 INFO:tasks.workunit.client.1.smithi142.stdout:0/601: rmdir d23/d28/d2d/d51 39 2024-02-19T19:07:37.181 INFO:tasks.workunit.client.1.smithi142.stdout:5/707: creat d5/dd/d8/ff3 x:0 0 0 2024-02-19T19:07:37.189 INFO:tasks.workunit.client.1.smithi142.stdout:1/833: dwrite d5/d7/d23/f45 [0,4194304] 0 2024-02-19T19:07:37.190 INFO:tasks.workunit.client.1.smithi142.stdout:4/837: rmdir d4/d1d/d42/d66/dd/dac/d107 0 2024-02-19T19:07:37.190 INFO:tasks.workunit.client.1.smithi142.stdout:6/651: dwrite d2/d17/d33/d39/f49 [4194304,4194304] 0 2024-02-19T19:07:37.191 INFO:tasks.workunit.client.1.smithi142.stdout:5/708: mknod d5/dd/d8/d29/cf4 0 2024-02-19T19:07:37.193 INFO:tasks.workunit.client.1.smithi142.stdout:4/838: getdents d4/d34/d44 0 2024-02-19T19:07:37.196 INFO:tasks.workunit.client.1.smithi142.stdout:1/834: dread d5/d77/da9/dae/db2/fe4 [0,4194304] 0 2024-02-19T19:07:37.196 INFO:tasks.workunit.client.1.smithi142.stdout:1/835: write d5/d7/f25 [4397313,61211] 0 2024-02-19T19:07:37.196 INFO:tasks.workunit.client.1.smithi142.stdout:1/836: write d5/d37/d6c/fa0 [1193525,699] 0 2024-02-19T19:07:37.196 INFO:tasks.workunit.client.1.smithi142.stdout:5/709: symlink d5/dd/d8/dbc/lf5 0 2024-02-19T19:07:37.196 INFO:tasks.workunit.client.1.smithi142.stdout:5/710: chown d5/dd/df 1182 1 2024-02-19T19:07:37.197 INFO:tasks.workunit.client.1.smithi142.stdout:3/831: sync 2024-02-19T19:07:37.197 INFO:tasks.workunit.client.1.smithi142.stdout:7/624: dwrite d0/d13/f27 [0,4194304] 0 2024-02-19T19:07:37.197 INFO:tasks.workunit.client.1.smithi142.stdout:3/832: fdatasync d1d/f2b 0 2024-02-19T19:07:37.197 INFO:tasks.workunit.client.1.smithi142.stdout:0/602: dread d23/d28/d41/f5a [0,4194304] 0 2024-02-19T19:07:37.197 INFO:tasks.workunit.client.1.smithi142.stdout:3/833: chown d1d/d1e/f58 46711 1 2024-02-19T19:07:37.198 INFO:tasks.workunit.client.1.smithi142.stdout:3/834: readlink d1d/d1e/d2e/d50/d7c/da7/l51 0 2024-02-19T19:07:37.198 INFO:tasks.workunit.client.1.smithi142.stdout:8/724: sync 2024-02-19T19:07:37.199 INFO:tasks.workunit.client.1.smithi142.stdout:1/837: rmdir d5/d7/d34 39 2024-02-19T19:07:37.200 INFO:tasks.workunit.client.1.smithi142.stdout:8/725: write d9/dd/de/d14/d65/d6c/d9c/fca [67220,5282] 0 2024-02-19T19:07:37.201 INFO:tasks.workunit.client.1.smithi142.stdout:9/699: sync 2024-02-19T19:07:37.201 INFO:tasks.workunit.client.1.smithi142.stdout:2/603: sync 2024-02-19T19:07:37.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:36 smithi142 ceph-mon[69118]: pgmap v80: 65 pgs: 9 active+clean+remapped, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 953 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 166 MiB/s rd, 195 MiB/s wr, 275 op/s; 5573/32943 objects degraded (16.917%); 1368/32943 objects misplaced (4.153%); 4.3 MiB/s, 106 objects/s recovering 2024-02-19T19:07:37.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:36 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 5573/32943 objects degraded (16.917%), 29 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:37.205 INFO:tasks.workunit.client.1.smithi142.stdout:2/604: dread d3/d4d/f69 [0,4194304] 0 2024-02-19T19:07:37.205 INFO:tasks.workunit.client.1.smithi142.stdout:0/603: mkdir d23/d32/d8a/db1/dc2 0 2024-02-19T19:07:37.207 INFO:tasks.workunit.client.1.smithi142.stdout:3/835: symlink d1d/d1e/d2e/d50/d7c/da7/d3a/l10b 0 2024-02-19T19:07:37.207 INFO:tasks.workunit.client.1.smithi142.stdout:3/836: chown d1d/d87 1 1 2024-02-19T19:07:37.209 INFO:tasks.workunit.client.1.smithi142.stdout:2/605: creat d3/d68/fc0 x:0 0 0 2024-02-19T19:07:37.210 INFO:tasks.workunit.client.1.smithi142.stdout:0/604: getdents d23/d28/d2d/d54/d85 0 2024-02-19T19:07:37.210 INFO:tasks.workunit.client.1.smithi142.stdout:0/605: chown d23/d28/d41/d78 343 1 2024-02-19T19:07:37.210 INFO:tasks.workunit.client.1.smithi142.stdout:7/625: dread d0/d13/f15 [0,4194304] 0 2024-02-19T19:07:37.210 INFO:tasks.workunit.client.1.smithi142.stdout:7/626: readlink d0/d1b/d21/d24/d29/d44/l87 0 2024-02-19T19:07:37.212 INFO:tasks.workunit.client.1.smithi142.stdout:8/726: mkdir d9/dd/de/d2d/d2e/d49/d50/d59/d97/dbe/dc3/de7 0 2024-02-19T19:07:37.212 INFO:tasks.workunit.client.1.smithi142.stdout:2/606: creat d3/d4d/d9f/fc1 x:0 0 0 2024-02-19T19:07:37.217 INFO:tasks.workunit.client.1.smithi142.stdout:4/839: dwrite d4/d1c/dae/fe2 [0,4194304] 0 2024-02-19T19:07:37.217 INFO:tasks.workunit.client.1.smithi142.stdout:2/607: symlink d3/df/lc2 0 2024-02-19T19:07:37.217 INFO:tasks.workunit.client.1.smithi142.stdout:4/840: write d4/d1d/d42/d66/d12/d2d/d2a/d84/fd0 [953742,5962] 0 2024-02-19T19:07:37.217 INFO:tasks.workunit.client.1.smithi142.stdout:1/838: dread d5/d7/f11 [0,4194304] 0 2024-02-19T19:07:37.220 INFO:tasks.workunit.client.1.smithi142.stdout:8/727: rmdir d9/dd/de/d14/d65 39 2024-02-19T19:07:37.222 INFO:tasks.workunit.client.1.smithi142.stdout:4/841: symlink d4/d1d/d42/d66/dd/d10/d26/d50/l114 0 2024-02-19T19:07:37.226 INFO:tasks.workunit.client.1.smithi142.stdout:9/700: dwrite db/f16 [0,4194304] 0 2024-02-19T19:07:37.227 INFO:tasks.workunit.client.1.smithi142.stdout:1/839: rename d5/d7/d4a/fc1 to d5/d7/d23/d2c/dbc/f125 0 2024-02-19T19:07:37.227 INFO:tasks.workunit.client.1.smithi142.stdout:5/711: dwrite d5/dd/df/d15/fd5 [0,4194304] 0 2024-02-19T19:07:37.227 INFO:tasks.workunit.client.1.smithi142.stdout:5/712: write d5/dd/d8/d5d/f7e [83447,97332] 0 2024-02-19T19:07:37.227 INFO:tasks.workunit.client.1.smithi142.stdout:4/842: creat d4/d1d/d42/d66/dd/d10/f115 x:0 0 0 2024-02-19T19:07:37.230 INFO:tasks.workunit.client.1.smithi142.stdout:2/608: dread d3/d4b/f58 [0,4194304] 0 2024-02-19T19:07:37.230 INFO:tasks.workunit.client.1.smithi142.stdout:9/701: truncate db/d10/d22/d24/f3c 3236253 0 2024-02-19T19:07:37.230 INFO:tasks.workunit.client.1.smithi142.stdout:9/702: write db/f18 [1781066,71736] 0 2024-02-19T19:07:37.230 INFO:tasks.workunit.client.1.smithi142.stdout:8/728: creat d9/dd/de/d2d/d2e/d49/d50/d59/da9/fe8 x:0 0 0 2024-02-19T19:07:37.231 INFO:tasks.workunit.client.1.smithi142.stdout:5/713: truncate d5/dd/d8/d1c/d8a/f6c 873180 0 2024-02-19T19:07:37.232 INFO:tasks.workunit.client.1.smithi142.stdout:5/714: write d5/dd/d8/d31/d4d/fe9 [746407,89398] 0 2024-02-19T19:07:37.233 INFO:tasks.workunit.client.1.smithi142.stdout:3/837: dwrite d1d/d1e/d2e/f48 [0,4194304] 0 2024-02-19T19:07:37.233 INFO:tasks.workunit.client.1.smithi142.stdout:0/606: dwrite d23/d28/d2d/d54/d88/fae [0,4194304] 0 2024-02-19T19:07:37.234 INFO:tasks.workunit.client.1.smithi142.stdout:4/843: creat d4/d14/d31/dab/f116 x:0 0 0 2024-02-19T19:07:37.234 INFO:tasks.workunit.client.1.smithi142.stdout:4/844: dread - d4/d1c/dae/dcb/ff6 zero size 2024-02-19T19:07:37.235 INFO:tasks.workunit.client.1.smithi142.stdout:2/609: creat d3/d35/d97/fc3 x:0 0 0 2024-02-19T19:07:37.238 INFO:tasks.workunit.client.1.smithi142.stdout:5/715: mknod d5/dd/df/da0/cf6 0 2024-02-19T19:07:37.238 INFO:tasks.workunit.client.1.smithi142.stdout:9/703: dread db/f61 [4194304,4194304] 0 2024-02-19T19:07:37.239 INFO:tasks.workunit.client.1.smithi142.stdout:7/627: dwrite d0/d13/d72/f45 [0,4194304] 0 2024-02-19T19:07:37.242 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:36 smithi046 ceph-mon[88928]: pgmap v80: 65 pgs: 9 active+clean+remapped, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 953 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 166 MiB/s rd, 195 MiB/s wr, 275 op/s; 5573/32943 objects degraded (16.917%); 1368/32943 objects misplaced (4.153%); 4.3 MiB/s, 106 objects/s recovering 2024-02-19T19:07:37.242 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:36 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 5573/32943 objects degraded (16.917%), 29 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:37.247 INFO:tasks.workunit.client.1.smithi142.stdout:0/607: rename d23/cb3 to d23/d28/d2d/d54/cc3 0 2024-02-19T19:07:37.247 INFO:tasks.workunit.client.1.smithi142.stdout:0/608: readlink d23/d28/d2d/d51/d44/l45 0 2024-02-19T19:07:37.247 INFO:tasks.workunit.client.1.smithi142.stdout:0/609: stat d23/d32/d8a/fb0 0 2024-02-19T19:07:37.247 INFO:tasks.workunit.client.1.smithi142.stdout:0/610: readlink d23/d7d/d9e/la0 0 2024-02-19T19:07:37.247 INFO:tasks.workunit.client.1.smithi142.stdout:3/838: dread d1d/d1e/d2e/d50/d7c/da7/f95 [0,4194304] 0 2024-02-19T19:07:37.248 INFO:tasks.workunit.client.1.smithi142.stdout:3/839: creat d1d/d1e/d2e/d50/d7c/da7/dc8/f10c x:0 0 0 2024-02-19T19:07:37.248 INFO:tasks.workunit.client.1.smithi142.stdout:3/840: write d1d/d1e/d6e/f72 [937196,58863] 0 2024-02-19T19:07:37.248 INFO:tasks.workunit.client.1.smithi142.stdout:3/841: fdatasync d1d/d1e/d2e/f48 0 2024-02-19T19:07:37.248 INFO:tasks.workunit.client.1.smithi142.stdout:3/842: chown d1d/d1e/d2e/dee/dc1 15356 1 2024-02-19T19:07:37.248 INFO:tasks.workunit.client.1.smithi142.stdout:4/845: mknod d4/d1d/d42/d66/dd/d10/d26/df7/c117 0 2024-02-19T19:07:37.250 INFO:tasks.workunit.client.1.smithi142.stdout:9/704: dread db/d10/d32/f7f [0,4194304] 0 2024-02-19T19:07:37.250 INFO:tasks.workunit.client.1.smithi142.stdout:9/705: truncate db/d10/d32/d3f/d5f/fb0 713720 0 2024-02-19T19:07:37.250 INFO:tasks.workunit.client.1.smithi142.stdout:2/610: creat d3/d68/fc4 x:0 0 0 2024-02-19T19:07:37.255 INFO:tasks.workunit.client.1.smithi142.stdout:4/846: mknod d4/d1d/d42/c118 0 2024-02-19T19:07:37.256 INFO:tasks.workunit.client.1.smithi142.stdout:0/611: dread d23/d7d/f99 [0,4194304] 0 2024-02-19T19:07:37.256 INFO:tasks.workunit.client.1.smithi142.stdout:9/706: link db/d10/d22/d24/d3d/d89/f8c db/d10/d22/fbe 0 2024-02-19T19:07:37.257 INFO:tasks.workunit.client.1.smithi142.stdout:2/611: symlink d3/d4d/d81/lc5 0 2024-02-19T19:07:37.257 INFO:tasks.workunit.client.1.smithi142.stdout:2/612: chown d3/db/d29/f55 519693 1 2024-02-19T19:07:37.257 INFO:tasks.workunit.client.1.smithi142.stdout:2/613: read d3/df/f12 [4953647,90909] 0 2024-02-19T19:07:37.258 INFO:tasks.workunit.client.1.smithi142.stdout:3/843: getdents d1d/d1e/d2e 0 2024-02-19T19:07:37.258 INFO:tasks.workunit.client.1.smithi142.stdout:3/844: truncate d1d/d1e/d2e/d37/d81/dbc/fdf 904411 0 2024-02-19T19:07:37.258 INFO:tasks.workunit.client.1.smithi142.stdout:3/845: chown d1d/d1e/d2e/d50/d7c/da7/d52 54693660 1 2024-02-19T19:07:37.259 INFO:tasks.workunit.client.1.smithi142.stdout:3/846: chown d1d/d1e/f21 1793330510 1 2024-02-19T19:07:37.259 INFO:tasks.workunit.client.1.smithi142.stdout:3/847: creat d1d/d1e/d2e/dee/da2/df1/f10d x:0 0 0 2024-02-19T19:07:37.259 INFO:tasks.workunit.client.1.smithi142.stdout:0/612: symlink d23/d28/d2d/d51/d44/d58/dc1/lc4 0 2024-02-19T19:07:37.259 INFO:tasks.workunit.client.1.smithi142.stdout:0/613: write d23/d32/d8a/f96 [1941756,87108] 0 2024-02-19T19:07:37.261 INFO:tasks.workunit.client.1.smithi142.stdout:3/848: mknod d1d/d1e/d2e/d50/d7c/da7/d3a/dc7/c10e 0 2024-02-19T19:07:37.261 INFO:tasks.workunit.client.1.smithi142.stdout:3/849: stat d1d/d1e/d2e/d50/d7c/da7/d52/f54 0 2024-02-19T19:07:37.261 INFO:tasks.workunit.client.1.smithi142.stdout:3/850: fsync d1d/d1e/d2e/d50/d7c/da7/d52/d71/dc0/fe5 0 2024-02-19T19:07:37.263 INFO:tasks.workunit.client.1.smithi142.stdout:1/840: dwrite d5/d37/d49/f5c [0,4194304] 0 2024-02-19T19:07:37.264 INFO:tasks.workunit.client.1.smithi142.stdout:5/716: dwrite d5/dd/df/d15/f7a [0,4194304] 0 2024-02-19T19:07:37.265 INFO:tasks.workunit.client.1.smithi142.stdout:8/729: dwrite d9/dd/f5c [0,4194304] 0 2024-02-19T19:07:37.267 INFO:tasks.workunit.client.1.smithi142.stdout:2/614: read d3/df/f10 [1144584,90313] 0 2024-02-19T19:07:37.267 INFO:tasks.workunit.client.1.smithi142.stdout:2/615: dread - d3/db/d29/d6d/d59/f78 zero size 2024-02-19T19:07:37.269 INFO:tasks.workunit.client.1.smithi142.stdout:0/614: dread d23/d32/f65 [4194304,4194304] 0 2024-02-19T19:07:37.269 INFO:tasks.workunit.client.1.smithi142.stdout:1/841: truncate d5/d7/f11 1085966 0 2024-02-19T19:07:37.273 INFO:tasks.workunit.client.1.smithi142.stdout:5/717: read d5/dd/df/d22/d41/d32/fa8 [421550,76116] 0 2024-02-19T19:07:37.274 INFO:tasks.workunit.client.1.smithi142.stdout:3/851: dwrite d1d/d1e/d2e/d50/d7c/da7/d52/d71/fdb [0,4194304] 0 2024-02-19T19:07:37.275 INFO:tasks.workunit.client.1.smithi142.stdout:8/730: stat d9/dd/de/d2d/d2e/d49/d50/d59/c8d 0 2024-02-19T19:07:37.275 INFO:tasks.workunit.client.1.smithi142.stdout:8/731: chown d9/dd/de/d2d/d2e/d49/f88 9022444 1 2024-02-19T19:07:37.276 INFO:tasks.workunit.client.1.smithi142.stdout:2/616: mknod d3/d68/d95/cc6 0 2024-02-19T19:07:37.278 INFO:tasks.workunit.client.1.smithi142.stdout:0/615: creat d23/d32/d8a/db1/fc5 x:0 0 0 2024-02-19T19:07:37.280 INFO:tasks.workunit.client.1.smithi142.stdout:5/718: rename d5/dd/d8/d29/l30 to d5/dd/d8/dd4/lf7 0 2024-02-19T19:07:37.282 INFO:tasks.workunit.client.1.smithi142.stdout:8/732: creat d9/dd/d15/d31/d96/fe9 x:0 0 0 2024-02-19T19:07:37.285 INFO:tasks.workunit.client.1.smithi142.stdout:1/842: getdents d5/d7/d23/dab 0 2024-02-19T19:07:37.285 INFO:tasks.workunit.client.1.smithi142.stdout:1/843: creat d5/d77/da9/dae/f126 x:0 0 0 2024-02-19T19:07:37.285 INFO:tasks.workunit.client.1.smithi142.stdout:1/844: chown d5/d1a/d59 447185 1 2024-02-19T19:07:37.285 INFO:tasks.workunit.client.1.smithi142.stdout:2/617: read d3/db/d29/d6d/d59/f99 [1280194,3909] 0 2024-02-19T19:07:37.285 INFO:tasks.workunit.client.1.smithi142.stdout:5/719: symlink d5/dd/d8/d2a/d57/lf8 0 2024-02-19T19:07:37.286 INFO:tasks.workunit.client.1.smithi142.stdout:5/720: read d5/dd/d8/f3d [464131,82543] 0 2024-02-19T19:07:37.287 INFO:tasks.workunit.client.1.smithi142.stdout:5/721: chown d5/dd/d8/dd4/db4/fd7 200795 1 2024-02-19T19:07:37.287 INFO:tasks.workunit.client.1.smithi142.stdout:5/722: write d5/fb3 [4610183,21485] 0 2024-02-19T19:07:37.288 INFO:tasks.workunit.client.1.smithi142.stdout:3/852: dwrite d1d/d1e/d2e/d50/ff4 [0,4194304] 0 2024-02-19T19:07:37.288 INFO:tasks.workunit.client.1.smithi142.stdout:3/853: write d1d/d1e/d2e/dee/dc1/fe1 [336821,40740] 0 2024-02-19T19:07:37.288 INFO:tasks.workunit.client.1.smithi142.stdout:9/707: truncate db/d10/d32/d3f/d5f/fa8 2160457 0 2024-02-19T19:07:37.288 INFO:tasks.workunit.client.1.smithi142.stdout:8/733: dread d9/dd/de/f45 [0,4194304] 0 2024-02-19T19:07:37.292 INFO:tasks.workunit.client.1.smithi142.stdout:5/723: link d5/dd/d5f/d6a/lab d5/dd/d8/d2a/d93/lf9 0 2024-02-19T19:07:37.293 INFO:tasks.workunit.client.1.smithi142.stdout:1/845: dread d5/d7/d34/f62 [0,4194304] 0 2024-02-19T19:07:37.294 INFO:tasks.workunit.client.1.smithi142.stdout:3/854: mkdir d1d/d1e/d2e/dee/dc1/d10f 0 2024-02-19T19:07:37.294 INFO:tasks.workunit.client.1.smithi142.stdout:2/618: dread d3/df/f12 [0,4194304] 0 2024-02-19T19:07:37.295 INFO:tasks.workunit.client.1.smithi142.stdout:8/734: symlink d9/dd/de/d2d/d2e/db3/lea 0 2024-02-19T19:07:37.298 INFO:tasks.workunit.client.1.smithi142.stdout:5/724: creat d5/dd/d8/d2a/d93/ffa x:0 0 0 2024-02-19T19:07:37.298 INFO:tasks.workunit.client.1.smithi142.stdout:5/725: truncate d5/dd/d8/d31/f34 4929421 0 2024-02-19T19:07:37.298 INFO:tasks.workunit.client.1.smithi142.stdout:1/846: mknod d5/d1a/c127 0 2024-02-19T19:07:37.300 INFO:tasks.workunit.client.1.smithi142.stdout:2/619: creat d3/d35/d53/fc7 x:0 0 0 2024-02-19T19:07:37.303 INFO:tasks.workunit.client.1.smithi142.stdout:5/726: link d5/dd/df/f6b d5/dd/df/d22/d41/d32/d53/ffb 0 2024-02-19T19:07:37.304 INFO:tasks.workunit.client.1.smithi142.stdout:8/735: read d9/dd/de/d2d/d2e/d49/f70 [858069,87786] 0 2024-02-19T19:07:37.305 INFO:tasks.workunit.client.1.smithi142.stdout:0/616: getdents d23/d32/d8a/db1 0 2024-02-19T19:07:37.305 INFO:tasks.workunit.client.1.smithi142.stdout:0/617: fsync d23/d28/d41/f9d 0 2024-02-19T19:07:37.307 INFO:tasks.workunit.client.1.smithi142.stdout:1/847: symlink d5/d77/da9/l128 0 2024-02-19T19:07:37.308 INFO:tasks.workunit.client.1.smithi142.stdout:1/848: read - d5/d77/da9/dae/db2/dea/f10a zero size 2024-02-19T19:07:37.308 INFO:tasks.workunit.client.1.smithi142.stdout:3/855: dwrite d1d/d1e/d2e/d50/d7c/da7/d52/d71/fdb [0,4194304] 0 2024-02-19T19:07:37.308 INFO:tasks.workunit.client.1.smithi142.stdout:3/856: fsync d1d/d1e/d2e/dee/fc5 0 2024-02-19T19:07:37.310 INFO:tasks.workunit.client.1.smithi142.stdout:0/618: rename d23/d28/d2d/d54/d88/d9f/lbf to d23/d28/d2d/d51/d44/d58/lc6 0 2024-02-19T19:07:37.310 INFO:tasks.workunit.client.1.smithi142.stdout:0/619: fdatasync d23/d28/d2d/f53 0 2024-02-19T19:07:37.311 INFO:tasks.workunit.client.1.smithi142.stdout:1/849: symlink d5/d1a/d33/d11f/l129 0 2024-02-19T19:07:37.311 INFO:tasks.workunit.client.1.smithi142.stdout:1/850: chown d5/d7/d23/d2c/dbc/ce5 1485299 1 2024-02-19T19:07:37.311 INFO:tasks.workunit.client.1.smithi142.stdout:2/620: write d3/d4d/f50 [2883531,69686] 0 2024-02-19T19:07:37.314 INFO:tasks.workunit.client.1.smithi142.stdout:0/620: unlink d23/d7d/faf 0 2024-02-19T19:07:37.314 INFO:tasks.workunit.client.1.smithi142.stdout:0/621: write d23/d7d/fad [543559,116806] 0 2024-02-19T19:07:37.315 INFO:tasks.workunit.client.1.smithi142.stdout:1/851: truncate d5/f4e 1023714 0 2024-02-19T19:07:37.319 INFO:tasks.workunit.client.1.smithi142.stdout:0/622: rmdir d23/d7d/d9e/dc0 0 2024-02-19T19:07:37.321 INFO:tasks.workunit.client.1.smithi142.stdout:1/852: creat d5/d7/d34/d6f/f12a x:0 0 0 2024-02-19T19:07:37.322 INFO:tasks.workunit.client.1.smithi142.stdout:0/623: mkdir d23/d7d/d9e/dc7 0 2024-02-19T19:07:37.322 INFO:tasks.workunit.client.1.smithi142.stdout:0/624: write d23/d28/d41/f69 [1268649,47311] 0 2024-02-19T19:07:37.322 INFO:tasks.workunit.client.1.smithi142.stdout:2/621: dread d3/db/f7f [0,4194304] 0 2024-02-19T19:07:37.323 INFO:tasks.workunit.client.1.smithi142.stdout:1/853: creat d5/d1a/d33/dce/f12b x:0 0 0 2024-02-19T19:07:37.323 INFO:tasks.workunit.client.1.smithi142.stdout:1/854: creat d5/d7/d4a/f12c x:0 0 0 2024-02-19T19:07:37.324 INFO:tasks.workunit.client.1.smithi142.stdout:2/622: unlink d3/d35/d53/f65 0 2024-02-19T19:07:37.327 INFO:tasks.workunit.client.1.smithi142.stdout:2/623: creat d3/d4d/d81/fc8 x:0 0 0 2024-02-19T19:07:37.327 INFO:tasks.workunit.client.1.smithi142.stdout:2/624: write d3/d68/fc4 [963479,33191] 0 2024-02-19T19:07:37.328 INFO:tasks.workunit.client.1.smithi142.stdout:6/652: sync 2024-02-19T19:07:37.329 INFO:tasks.workunit.client.1.smithi142.stdout:0/625: write d23/d7d/f99 [2017659,72995] 0 2024-02-19T19:07:37.330 INFO:tasks.workunit.client.1.smithi142.stdout:3/857: dwrite d1d/d1e/f53 [0,4194304] 0 2024-02-19T19:07:37.330 INFO:tasks.workunit.client.1.smithi142.stdout:3/858: fsync d1d/d1e/d6e/f99 0 2024-02-19T19:07:37.330 INFO:tasks.workunit.client.1.smithi142.stdout:3/859: creat d1d/d1e/d2e/d37/d6c/da9/f110 x:0 0 0 2024-02-19T19:07:37.331 INFO:tasks.workunit.client.1.smithi142.stdout:3/860: readlink d1d/d1e/d2e/dee/d8d/de4/lf5 0 2024-02-19T19:07:37.331 INFO:tasks.workunit.client.1.smithi142.stdout:8/736: dwrite f7 [0,4194304] 0 2024-02-19T19:07:37.331 INFO:tasks.workunit.client.1.smithi142.stdout:3/861: chown d1d/d1e/d2e/dee/l7f 5422425 1 2024-02-19T19:07:37.331 INFO:tasks.workunit.client.1.smithi142.stdout:3/862: creat d1d/d1e/d2e/d50/d83/f111 x:0 0 0 2024-02-19T19:07:37.331 INFO:tasks.workunit.client.1.smithi142.stdout:6/653: symlink d2/d1f/d20/d31/d62/ld7 0 2024-02-19T19:07:37.338 INFO:tasks.workunit.client.1.smithi142.stdout:1/855: dwrite d5/d7/d34/d6f/fba [0,4194304] 0 2024-02-19T19:07:37.340 INFO:tasks.workunit.client.1.smithi142.stdout:8/737: mkdir d9/dd/de/d2d/d2e/d49/d50/deb 0 2024-02-19T19:07:37.342 INFO:tasks.workunit.client.1.smithi142.stdout:3/863: mkdir d1d/d1e/d112 0 2024-02-19T19:07:37.343 INFO:tasks.workunit.client.1.smithi142.stdout:6/654: symlink d2/d17/d33/d42/da2/da7/dd2/dd3/ld8 0 2024-02-19T19:07:37.346 INFO:tasks.workunit.client.1.smithi142.stdout:8/738: mkdir d9/dd/de/d14/d65/d94/dec 0 2024-02-19T19:07:37.348 INFO:tasks.workunit.client.1.smithi142.stdout:8/739: rename d9/dd/f5c to d9/dd/de/d2d/d2e/d49/d50/d59/d97/fed 0 2024-02-19T19:07:37.349 INFO:tasks.workunit.client.1.smithi142.stdout:2/625: dwrite d3/d4d/d5f/d7c/f7e [0,4194304] 0 2024-02-19T19:07:37.353 INFO:tasks.workunit.client.1.smithi142.stdout:2/626: rename d3/db/d29/d4c/d4e/d9a/da9/dad/faf to d3/db/fc9 0 2024-02-19T19:07:37.353 INFO:tasks.workunit.client.1.smithi142.stdout:2/627: write d3/df/f10 [158518,49359] 0 2024-02-19T19:07:37.353 INFO:tasks.workunit.client.1.smithi142.stdout:3/864: write d1d/d1e/d2e/f48 [660062,1274] 0 2024-02-19T19:07:37.355 INFO:tasks.workunit.client.1.smithi142.stdout:2/628: mkdir d3/d68/d95/dca 0 2024-02-19T19:07:37.356 INFO:tasks.workunit.client.1.smithi142.stdout:3/865: creat d1d/d1e/d2e/d50/d7c/da7/d52/d71/f113 x:0 0 0 2024-02-19T19:07:37.357 INFO:tasks.workunit.client.1.smithi142.stdout:2/629: symlink d3/db/d29/d6d/d59/db4/lcb 0 2024-02-19T19:07:37.359 INFO:tasks.workunit.client.1.smithi142.stdout:3/866: unlink d1d/d1e/d2e/dee/l100 0 2024-02-19T19:07:37.360 INFO:tasks.workunit.client.1.smithi142.stdout:3/867: mknod d1d/c114 0 2024-02-19T19:07:37.371 INFO:tasks.workunit.client.1.smithi142.stdout:2/630: write d3/d35/f5c [2365099,28314] 0 2024-02-19T19:07:37.372 INFO:tasks.workunit.client.1.smithi142.stdout:6/655: dwrite d2/d1f/d56/f8e [0,4194304] 0 2024-02-19T19:07:37.372 INFO:tasks.workunit.client.1.smithi142.stdout:6/656: readlink d2/d17/d33/d42/da2/da7/d55/ld0 0 2024-02-19T19:07:37.374 INFO:tasks.workunit.client.1.smithi142.stdout:6/657: truncate d2/d17/d33/d39/f49 1160206 0 2024-02-19T19:07:37.381 INFO:tasks.workunit.client.1.smithi142.stdout:8/740: dwrite d9/dd/de/d2d/d2e/d49/d50/d59/f66 [0,4194304] 0 2024-02-19T19:07:37.382 INFO:tasks.workunit.client.1.smithi142.stdout:1/856: dwrite d5/d37/d6c/d75/da2/fe9 [0,4194304] 0 2024-02-19T19:07:37.382 INFO:tasks.workunit.client.1.smithi142.stdout:3/868: dwrite d1d/d1e/f49 [4194304,4194304] 0 2024-02-19T19:07:37.382 INFO:tasks.workunit.client.1.smithi142.stdout:3/869: fsync d1d/d1e/d2e/d8b/fec 0 2024-02-19T19:07:37.382 INFO:tasks.workunit.client.1.smithi142.stdout:1/857: write d5/d77/da9/dae/fca [525023,30781] 0 2024-02-19T19:07:37.382 INFO:tasks.workunit.client.1.smithi142.stdout:1/858: fsync d5/d7/d23/d41/d103/f110 0 2024-02-19T19:07:37.382 INFO:tasks.workunit.client.1.smithi142.stdout:1/859: creat d5/d37/d6c/d75/f12d x:0 0 0 2024-02-19T19:07:37.382 INFO:tasks.workunit.client.1.smithi142.stdout:1/860: write d5/d7/d23/d2c/f11b [164480,124584] 0 2024-02-19T19:07:37.382 INFO:tasks.workunit.client.1.smithi142.stdout:1/861: chown d5/d37/d6c/d75/da7/lb6 456 1 2024-02-19T19:07:37.391 INFO:tasks.workunit.client.1.smithi142.stdout:2/631: dwrite d3/db/d29/d6d/d59/f6e [0,4194304] 0 2024-02-19T19:07:37.392 INFO:tasks.workunit.client.1.smithi142.stdout:6/658: dwrite d2/d1f/d4d/fa0 [0,4194304] 0 2024-02-19T19:07:37.392 INFO:tasks.workunit.client.1.smithi142.stdout:8/741: write d9/dd/de/d2d/d2e/d49/d50/d59/f8e [3818620,45860] 0 2024-02-19T19:07:37.392 INFO:tasks.workunit.client.1.smithi142.stdout:8/742: chown d9/dd/de/d2d/d2e/d49/d50/l75 739 1 2024-02-19T19:07:37.392 INFO:tasks.workunit.client.1.smithi142.stdout:8/743: write d9/dd/d15/d31/d5e/f62 [81626,87006] 0 2024-02-19T19:07:37.393 INFO:tasks.workunit.client.1.smithi142.stdout:8/744: write d9/dd/de/d14/d65/f90 [826783,77371] 0 2024-02-19T19:07:37.393 INFO:tasks.workunit.client.1.smithi142.stdout:8/745: creat d9/fee x:0 0 0 2024-02-19T19:07:37.393 INFO:tasks.workunit.client.1.smithi142.stdout:8/746: stat d9/dd/de/d2d/l48 0 2024-02-19T19:07:37.393 INFO:tasks.workunit.client.1.smithi142.stdout:8/747: chown d9/dd/d15/d31/l91 3 1 2024-02-19T19:07:37.393 INFO:tasks.workunit.client.1.smithi142.stdout:1/862: creat d5/d7/d23/d41/d103/f12e x:0 0 0 2024-02-19T19:07:37.397 INFO:tasks.workunit.client.1.smithi142.stdout:7/628: sync 2024-02-19T19:07:37.397 INFO:tasks.workunit.client.1.smithi142.stdout:7/629: readlink d0/d1b/d21/d24/d29/d44/l87 0 2024-02-19T19:07:37.398 INFO:tasks.workunit.client.1.smithi142.stdout:3/870: rmdir d1d/d1e/d2e/d50 39 2024-02-19T19:07:37.398 INFO:tasks.workunit.client.1.smithi142.stdout:3/871: chown d1d/d1e/d2e/c40 10757 1 2024-02-19T19:07:37.398 INFO:tasks.workunit.client.1.smithi142.stdout:3/872: getdents d1d/d1e/d2e/dee/dc1/d10f 0 2024-02-19T19:07:37.398 INFO:tasks.workunit.client.1.smithi142.stdout:3/873: write d1d/d1e/d2e/d50/d7c/da7/d52/d5a/da4/fea [859863,4593] 0 2024-02-19T19:07:37.403 INFO:tasks.workunit.client.1.smithi142.stdout:8/748: mkdir d9/dd/d44/d79/def 0 2024-02-19T19:07:37.404 INFO:tasks.workunit.client.1.smithi142.stdout:1/863: creat d5/d7/d23/f12f x:0 0 0 2024-02-19T19:07:37.404 INFO:tasks.workunit.client.1.smithi142.stdout:1/864: stat d5/d7/c15 0 2024-02-19T19:07:37.404 INFO:tasks.workunit.client.1.smithi142.stdout:1/865: write d5/d37/d6c/dd0/fd5 [780248,21146] 0 2024-02-19T19:07:37.405 INFO:tasks.workunit.client.1.smithi142.stdout:7/630: symlink d0/d1b/d21/d24/d29/d44/d49/d7a/ld1 0 2024-02-19T19:07:37.406 INFO:tasks.workunit.client.1.smithi142.stdout:3/874: link d1d/d1e/d2e/f3f d1d/d1e/d2e/d50/d7c/da7/d52/d5a/f115 0 2024-02-19T19:07:37.409 INFO:tasks.workunit.client.1.smithi142.stdout:9/708: sync 2024-02-19T19:07:37.409 INFO:tasks.workunit.client.1.smithi142.stdout:5/727: sync 2024-02-19T19:07:37.409 INFO:tasks.workunit.client.1.smithi142.stdout:4/847: sync 2024-02-19T19:07:37.409 INFO:tasks.workunit.client.1.smithi142.stdout:5/728: chown d5/f20 1360 1 2024-02-19T19:07:37.409 INFO:tasks.workunit.client.1.smithi142.stdout:5/729: chown d5/dd/d8/d2a 134315559 1 2024-02-19T19:07:37.412 INFO:tasks.workunit.client.1.smithi142.stdout:7/631: write d0/d13/d72/f88 [497204,37068] 0 2024-02-19T19:07:37.416 INFO:tasks.workunit.client.1.smithi142.stdout:3/875: read d1d/d1e/d2e/dee/dc1/fd8 [1136844,34593] 0 2024-02-19T19:07:37.416 INFO:tasks.workunit.client.1.smithi142.stdout:5/730: rmdir d5/dd/d8/dbc 39 2024-02-19T19:07:37.423 INFO:tasks.workunit.client.1.smithi142.stdout:1/866: rmdir d5/d37 39 2024-02-19T19:07:37.424 INFO:tasks.workunit.client.1.smithi142.stdout:0/626: sync 2024-02-19T19:07:37.424 INFO:tasks.workunit.client.1.smithi142.stdout:8/749: dwrite d9/dd/de/d2d/d2e/d49/d50/d59/f82 [0,4194304] 0 2024-02-19T19:07:37.424 INFO:tasks.workunit.client.1.smithi142.stdout:8/750: dread - d9/da8/fb6 zero size 2024-02-19T19:07:37.425 INFO:tasks.workunit.client.1.smithi142.stdout:8/751: dread - d9/dd/de/d2d/d2e/d49/f88 zero size 2024-02-19T19:07:37.425 INFO:tasks.workunit.client.1.smithi142.stdout:8/752: creat d9/dd/de/d2d/d2e/d49/d50/d59/da9/ff0 x:0 0 0 2024-02-19T19:07:37.425 INFO:tasks.workunit.client.1.smithi142.stdout:9/709: symlink db/lbf 0 2024-02-19T19:07:37.425 INFO:tasks.workunit.client.1.smithi142.stdout:9/710: fdatasync db/d10/d32/fb7 0 2024-02-19T19:07:37.425 INFO:tasks.workunit.client.1.smithi142.stdout:9/711: fsync db/d10/d22/d24/f25 0 2024-02-19T19:07:37.426 INFO:tasks.workunit.client.1.smithi142.stdout:9/712: chown db/d10/l7c 671914 1 2024-02-19T19:07:37.428 INFO:tasks.workunit.client.1.smithi142.stdout:0/627: mknod d23/d28/d2d/d51/cc8 0 2024-02-19T19:07:37.432 INFO:tasks.workunit.client.1.smithi142.stdout:5/731: getdents d5/dd/d8 0 2024-02-19T19:07:37.434 INFO:tasks.workunit.client.1.smithi142.stdout:9/713: symlink db/d10/d22/d24/lc0 0 2024-02-19T19:07:37.434 INFO:tasks.workunit.client.1.smithi142.stdout:9/714: readlink db/d10/d27/d2f/l51 0 2024-02-19T19:07:37.435 INFO:tasks.workunit.client.1.smithi142.stdout:4/848: rename d4/d14/d31/dab to d4/d1d/d42/d66/d12/d79/d8c/d119 0 2024-02-19T19:07:37.436 INFO:tasks.workunit.client.1.smithi142.stdout:0/628: rename d23/d28/d2d/d51/d44 to d23/d28/d2d/d51/dc9 0 2024-02-19T19:07:37.437 INFO:tasks.workunit.client.1.smithi142.stdout:0/629: write d23/d28/d2d/d51/f71 [441462,60570] 0 2024-02-19T19:07:37.437 INFO:tasks.workunit.client.1.smithi142.stdout:0/630: chown d23/d28/d41 0 1 2024-02-19T19:07:37.437 INFO:tasks.workunit.client.1.smithi142.stdout:5/732: mkdir d5/dd/d8/d31/d4d/d75/d9e/dfc 0 2024-02-19T19:07:37.438 INFO:tasks.workunit.client.1.smithi142.stdout:9/715: mkdir db/d10/d32/d91/dc1 0 2024-02-19T19:07:37.439 INFO:tasks.workunit.client.1.smithi142.stdout:9/716: dread db/d10/d22/fbe [0,4194304] 0 2024-02-19T19:07:37.439 INFO:tasks.workunit.client.1.smithi142.stdout:7/632: rename d0/d1b/d9d/cc4 to d0/d1b/dbc/cd2 0 2024-02-19T19:07:37.440 INFO:tasks.workunit.client.1.smithi142.stdout:4/849: mknod d4/d1c/dae/dfa/c11a 0 2024-02-19T19:07:37.440 INFO:tasks.workunit.client.1.smithi142.stdout:8/753: dwrite d9/da8/fb6 [0,4194304] 0 2024-02-19T19:07:37.441 INFO:tasks.workunit.client.1.smithi142.stdout:0/631: rmdir d23/d28/d41 39 2024-02-19T19:07:37.441 INFO:tasks.workunit.client.1.smithi142.stdout:0/632: write d23/f3a [149784,9129] 0 2024-02-19T19:07:37.441 INFO:tasks.workunit.client.1.smithi142.stdout:0/633: readlink d23/l2e 0 2024-02-19T19:07:37.442 INFO:tasks.workunit.client.1.smithi142.stdout:5/733: symlink d5/dd/df/d22/d41/d32/lfd 0 2024-02-19T19:07:37.442 INFO:tasks.workunit.client.1.smithi142.stdout:5/734: write d5/dd/d8/d31/f34 [1673130,114818] 0 2024-02-19T19:07:37.443 INFO:tasks.workunit.client.1.smithi142.stdout:9/717: dread db/d10/d27/f6d [0,4194304] 0 2024-02-19T19:07:37.443 INFO:tasks.workunit.client.1.smithi142.stdout:3/876: rename d1d/d1e/d2e/c73 to d1d/d1e/d2e/dee/da2/dbb/c116 0 2024-02-19T19:07:37.446 INFO:tasks.workunit.client.1.smithi142.stdout:0/634: mkdir d23/d32/d8a/db1/dca 0 2024-02-19T19:07:37.448 INFO:tasks.workunit.client.1.smithi142.stdout:7/633: dread d0/d13/f27 [0,4194304] 0 2024-02-19T19:07:37.448 INFO:tasks.workunit.client.1.smithi142.stdout:7/634: creat d0/d13/fd3 x:0 0 0 2024-02-19T19:07:37.448 INFO:tasks.workunit.client.1.smithi142.stdout:9/718: mkdir db/d10/d32/d91/dc1/dc2 0 2024-02-19T19:07:37.449 INFO:tasks.workunit.client.1.smithi142.stdout:5/735: read d5/dd/df/d22/d41/d6f/fdd [1176257,73313] 0 2024-02-19T19:07:37.450 INFO:tasks.workunit.client.1.smithi142.stdout:5/736: fsync d5/dd/d8/d31/fc1 0 2024-02-19T19:07:37.450 INFO:tasks.workunit.client.1.smithi142.stdout:1/867: rename d5/d77/da9/dae/deb/ffa to d5/d77/da9/dae/f130 0 2024-02-19T19:07:37.450 INFO:tasks.workunit.client.1.smithi142.stdout:3/877: symlink d1d/d1e/d2e/d37/d81/l117 0 2024-02-19T19:07:37.451 INFO:tasks.workunit.client.1.smithi142.stdout:3/878: creat d1d/d1e/d2e/dee/da2/df1/f118 x:0 0 0 2024-02-19T19:07:37.451 INFO:tasks.workunit.client.1.smithi142.stdout:3/879: write d1d/d1e/d2e/d50/d7c/fe7 [437845,53687] 0 2024-02-19T19:07:37.453 INFO:tasks.workunit.client.1.smithi142.stdout:7/635: rmdir d0/d13/d72/d47/d89 0 2024-02-19T19:07:37.455 INFO:tasks.workunit.client.1.smithi142.stdout:9/719: mkdir db/d10/d22/d24/d3d/d89/dad/dc3 0 2024-02-19T19:07:37.455 INFO:tasks.workunit.client.1.smithi142.stdout:9/720: stat db/d10/d27/d2f/d4c/f9f 0 2024-02-19T19:07:37.457 INFO:tasks.workunit.client.1.smithi142.stdout:4/850: rename d4/d1d/cfc to d4/d1d/d42/d66/dd/d10/d26/c11b 0 2024-02-19T19:07:37.458 INFO:tasks.workunit.client.1.smithi142.stdout:1/868: mknod d5/d7/d34/d6f/c131 0 2024-02-19T19:07:37.462 INFO:tasks.workunit.client.1.smithi142.stdout:3/880: link d1d/d1e/d2e/d50/l9d d1d/d1e/d2e/d50/d7c/da7/d52/d71/ddd/l119 0 2024-02-19T19:07:37.462 INFO:tasks.workunit.client.1.smithi142.stdout:3/881: write d1d/d1e/d2e/d50/d7c/da7/fe6 [605088,118866] 0 2024-02-19T19:07:37.463 INFO:tasks.workunit.client.1.smithi142.stdout:7/636: mkdir d0/d1b/d21/d24/d5e/d65/d86/dd4 0 2024-02-19T19:07:37.463 INFO:tasks.workunit.client.1.smithi142.stdout:7/637: readlink d0/d1b/d21/d24/d29/d44/l87 0 2024-02-19T19:07:37.464 INFO:tasks.workunit.client.1.smithi142.stdout:9/721: creat db/d10/d27/db9/fc4 x:0 0 0 2024-02-19T19:07:37.467 INFO:tasks.workunit.client.1.smithi142.stdout:9/722: dread db/d10/d22/d24/d41/f74 [0,4194304] 0 2024-02-19T19:07:37.467 INFO:tasks.workunit.client.1.smithi142.stdout:8/754: rename d9/dd/d44/d79/f69 to d9/dd/de/d2d/d2e/d73/ff1 0 2024-02-19T19:07:37.468 INFO:tasks.workunit.client.1.smithi142.stdout:4/851: truncate d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f/fbe 750622 0 2024-02-19T19:07:37.470 INFO:tasks.workunit.client.1.smithi142.stdout:1/869: symlink d5/d77/da9/dae/db2/l132 0 2024-02-19T19:07:37.470 INFO:tasks.workunit.client.1.smithi142.stdout:1/870: write d5/d7/d34/f46 [4256630,31768] 0 2024-02-19T19:07:37.470 INFO:tasks.workunit.client.1.smithi142.stdout:1/871: chown d5/d77/le7 45344 1 2024-02-19T19:07:37.470 INFO:tasks.workunit.client.1.smithi142.stdout:0/635: dwrite f22 [4194304,4194304] 0 2024-02-19T19:07:37.472 INFO:tasks.workunit.client.1.smithi142.stdout:7/638: mkdir d0/d13/d1e/db7/dca/dd5 0 2024-02-19T19:07:37.473 INFO:tasks.workunit.client.1.smithi142.stdout:5/737: dwrite d5/dd/df/d22/d41/d32/fad [0,4194304] 0 2024-02-19T19:07:37.473 INFO:tasks.workunit.client.1.smithi142.stdout:9/723: mkdir db/d10/d27/d2f/dc5 0 2024-02-19T19:07:37.475 INFO:tasks.workunit.client.1.smithi142.stdout:8/755: mknod d9/dd/de/d14/d65/d6c/da7/cf2 0 2024-02-19T19:07:37.476 INFO:tasks.workunit.client.1.smithi142.stdout:3/882: read d1d/d1e/d2e/dee/da2/fa8 [600640,106678] 0 2024-02-19T19:07:37.476 INFO:tasks.workunit.client.1.smithi142.stdout:3/883: chown d1d/d1e/d6e/f6f 9528143 1 2024-02-19T19:07:37.477 INFO:tasks.workunit.client.1.smithi142.stdout:4/852: link d4/d1d/d42/d66/dd/d10/l94 d4/d14/d31/d43/l11c 0 2024-02-19T19:07:37.482 INFO:tasks.workunit.client.1.smithi142.stdout:7/639: dread d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:37.489 INFO:tasks.workunit.client.1.smithi142.stdout:5/738: write d5/dd/df/d22/d41/d32/f39 [2890668,74027] 0 2024-02-19T19:07:37.490 INFO:tasks.workunit.client.1.smithi142.stdout:9/724: creat db/d10/d22/d24/fc6 x:0 0 0 2024-02-19T19:07:37.490 INFO:tasks.workunit.client.1.smithi142.stdout:4/853: dwrite d4/d34/d44/fe5 [0,4194304] 0 2024-02-19T19:07:37.492 INFO:tasks.workunit.client.1.smithi142.stdout:8/756: symlink d9/dd/de/d2d/d2e/db3/lf3 0 2024-02-19T19:07:37.493 INFO:tasks.workunit.client.1.smithi142.stdout:3/884: mknod d1d/d1e/d2e/dee/d91/c11a 0 2024-02-19T19:07:37.494 INFO:tasks.workunit.client.1.smithi142.stdout:7/640: mkdir d0/d1b/d21/d24/d29/dd6 0 2024-02-19T19:07:37.494 INFO:tasks.workunit.client.1.smithi142.stdout:7/641: stat d0/f6c 0 2024-02-19T19:07:37.496 INFO:tasks.workunit.client.1.smithi142.stdout:5/739: truncate d5/dd/d8/fb 1231694 0 2024-02-19T19:07:37.496 INFO:tasks.workunit.client.1.smithi142.stdout:5/740: read d5/dd/df/d15/d5b/fce [1588449,21254] 0 2024-02-19T19:07:37.496 INFO:tasks.workunit.client.1.smithi142.stdout:5/741: creat d5/ffe x:0 0 0 2024-02-19T19:07:37.497 INFO:tasks.workunit.client.1.smithi142.stdout:5/742: creat d5/dd/d8/d2a/d93/fff x:0 0 0 2024-02-19T19:07:37.497 INFO:tasks.workunit.client.1.smithi142.stdout:9/725: rmdir db/d10/d22/d81 39 2024-02-19T19:07:37.501 INFO:tasks.workunit.client.1.smithi142.stdout:4/854: write d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f/fbe [257694,26193] 0 2024-02-19T19:07:37.503 INFO:tasks.workunit.client.1.smithi142.stdout:7/642: link d0/d13/cc2 d0/d1b/d21/cd7 0 2024-02-19T19:07:37.503 INFO:tasks.workunit.client.1.smithi142.stdout:7/643: fdatasync d0/d1b/d21/d24/d5e/d65/f74 0 2024-02-19T19:07:37.506 INFO:tasks.workunit.client.1.smithi142.stdout:5/743: mknod d5/dd/df/d15/d5b/c100 0 2024-02-19T19:07:37.506 INFO:tasks.workunit.client.1.smithi142.stdout:5/744: chown d5/dd/d8/d31/d4d 999 1 2024-02-19T19:07:37.506 INFO:tasks.workunit.client.1.smithi142.stdout:5/745: write d5/dd/df/d22/d41/d6f/fdd [3271781,32563] 0 2024-02-19T19:07:37.508 INFO:tasks.workunit.client.1.smithi142.stdout:0/636: dwrite d23/f25 [0,4194304] 0 2024-02-19T19:07:37.508 INFO:tasks.workunit.client.1.smithi142.stdout:0/637: creat d23/d28/d2d/d54/d88/fcb x:0 0 0 2024-02-19T19:07:37.508 INFO:tasks.workunit.client.1.smithi142.stdout:4/855: unlink d4/cd6 0 2024-02-19T19:07:37.510 INFO:tasks.workunit.client.1.smithi142.stdout:7/644: unlink d0/d1b/d21/d24/d29/d44/f85 0 2024-02-19T19:07:37.510 INFO:tasks.workunit.client.1.smithi142.stdout:7/645: chown d0/d1b/d21/c6d 608155 1 2024-02-19T19:07:37.510 INFO:tasks.workunit.client.1.smithi142.stdout:7/646: creat d0/d1b/d9d/fd8 x:0 0 0 2024-02-19T19:07:37.512 INFO:tasks.workunit.client.1.smithi142.stdout:5/746: mkdir d5/dd/d8/dd4/db4/d101 0 2024-02-19T19:07:37.512 INFO:tasks.workunit.client.1.smithi142.stdout:5/747: readlink d5/dd/d8/d31/la7 0 2024-02-19T19:07:37.516 INFO:tasks.workunit.client.1.smithi142.stdout:0/638: mkdir d23/d28/d2d/d51/dc9/dcc 0 2024-02-19T19:07:37.516 INFO:tasks.workunit.client.1.smithi142.stdout:0/639: fsync d23/d7d/d9e/fb7 0 2024-02-19T19:07:37.518 INFO:tasks.workunit.client.1.smithi142.stdout:7/647: link d0/d1b/f91 d0/d1b/d21/d24/d29/dc5/fd9 0 2024-02-19T19:07:37.519 INFO:tasks.workunit.client.1.smithi142.stdout:7/648: rename d0/d1b/d21/d24/f5f to d0/d1b/d21/d24/d29/d44/d49/d7a/fda 0 2024-02-19T19:07:37.521 INFO:tasks.workunit.client.1.smithi142.stdout:7/649: write d0/d13/d72/d47/d69/f40 [357195,49451] 0 2024-02-19T19:07:37.521 INFO:tasks.workunit.client.1.smithi142.stdout:5/748: dread d5/dd/df/f12 [0,4194304] 0 2024-02-19T19:07:37.522 INFO:tasks.workunit.client.1.smithi142.stdout:7/650: creat d0/d13/d72/fdb x:0 0 0 2024-02-19T19:07:37.524 INFO:tasks.workunit.client.1.smithi142.stdout:5/749: mkdir d5/dd/d8/d5d/d102 0 2024-02-19T19:07:37.524 INFO:tasks.workunit.client.1.smithi142.stdout:5/750: creat d5/dd/df/d22/d41/d6f/f103 x:0 0 0 2024-02-19T19:07:37.524 INFO:tasks.workunit.client.1.smithi142.stdout:5/751: readlink d5/dd/d8/d2a/d93/ldb 0 2024-02-19T19:07:37.525 INFO:tasks.workunit.client.1.smithi142.stdout:0/640: dread d23/d28/d2d/d51/dc9/fab [0,4194304] 0 2024-02-19T19:07:37.526 INFO:tasks.workunit.client.1.smithi142.stdout:7/651: rename d0/d1b/d21/d24/d29/d44/d49/f95 to d0/d1b/d21/d24/d29/d44/dbd/fdc 0 2024-02-19T19:07:37.528 INFO:tasks.workunit.client.1.smithi142.stdout:5/752: mknod d5/dd/d8/d31/d4d/d75/c104 0 2024-02-19T19:07:37.529 INFO:tasks.workunit.client.1.smithi142.stdout:3/885: dwrite d1d/d1e/d2e/dee/da2/fca [0,4194304] 0 2024-02-19T19:07:37.529 INFO:tasks.workunit.client.1.smithi142.stdout:9/726: dwrite db/d10/d22/d24/d41/f9b [0,4194304] 0 2024-02-19T19:07:37.530 INFO:tasks.workunit.client.1.smithi142.stdout:3/886: chown d1d/d1e/d2e/dee/da2/lb3 6370814 1 2024-02-19T19:07:37.530 INFO:tasks.workunit.client.1.smithi142.stdout:9/727: chown db/d10/d22/f9e 3595 1 2024-02-19T19:07:37.530 INFO:tasks.workunit.client.1.smithi142.stdout:9/728: fsync db/d10/d22/d24/f25 0 2024-02-19T19:07:37.530 INFO:tasks.workunit.client.1.smithi142.stdout:9/729: dread - db/d10/fbd zero size 2024-02-19T19:07:37.530 INFO:tasks.workunit.client.1.smithi142.stdout:0/641: creat d23/d32/d8a/db1/dca/fcd x:0 0 0 2024-02-19T19:07:37.530 INFO:tasks.workunit.client.1.smithi142.stdout:0/642: chown d23/d28/d2d/d54/d88/d9f/fbc 1707 1 2024-02-19T19:07:37.530 INFO:tasks.workunit.client.1.smithi142.stdout:5/753: dread d5/dd/df/d22/d41/d6f/f89 [0,4194304] 0 2024-02-19T19:07:37.530 INFO:tasks.workunit.client.1.smithi142.stdout:8/757: dwrite d9/dd/de/d14/f60 [0,4194304] 0 2024-02-19T19:07:37.531 INFO:tasks.workunit.client.1.smithi142.stdout:8/758: readlink d9/dd/d44/d79/lcb 0 2024-02-19T19:07:37.531 INFO:tasks.workunit.client.1.smithi142.stdout:7/652: creat d0/d1b/d21/d24/d5e/fdd x:0 0 0 2024-02-19T19:07:37.538 INFO:tasks.workunit.client.1.smithi142.stdout:3/887: unlink d1d/d1e/f6b 0 2024-02-19T19:07:37.538 INFO:tasks.workunit.client.1.smithi142.stdout:3/888: readlink d1d/d1e/d2e/dee/d8d/l8f 0 2024-02-19T19:07:37.541 INFO:tasks.workunit.client.1.smithi142.stdout:9/730: unlink db/d10/d32/f76 0 2024-02-19T19:07:37.544 INFO:tasks.workunit.client.1.smithi142.stdout:5/754: creat d5/dd/d8/d31/d4d/d75/d9e/f105 x:0 0 0 2024-02-19T19:07:37.544 INFO:tasks.workunit.client.1.smithi142.stdout:5/755: chown d5/dd/df/d15/d5b 1 1 2024-02-19T19:07:37.546 INFO:tasks.workunit.client.1.smithi142.stdout:8/759: dwrite d9/dd/de/d14/d65/d6c/d9c/fca [0,4194304] 0 2024-02-19T19:07:37.549 INFO:tasks.workunit.client.1.smithi142.stdout:7/653: rename d0/d1b/d21/d24/d5e/d65/d86/dd4 to d0/d1b/d21/d24/d29/d7e/dde 0 2024-02-19T19:07:37.549 INFO:tasks.workunit.client.1.smithi142.stdout:7/654: chown d0/d13/d72/fdb 599 1 2024-02-19T19:07:37.551 INFO:tasks.workunit.client.1.smithi142.stdout:3/889: rmdir d1d/d1e/d6e 39 2024-02-19T19:07:37.551 INFO:tasks.workunit.client.1.smithi142.stdout:3/890: write d1d/d1e/d2e/d50/d7c/da7/d52/d71/dc0/fe5 [1899845,19641] 0 2024-02-19T19:07:37.552 INFO:tasks.workunit.client.1.smithi142.stdout:9/731: readlink db/d10/d32/d3f/l4a 0 2024-02-19T19:07:37.553 INFO:tasks.workunit.client.1.smithi142.stdout:0/643: rmdir d23/d28/d2d/d54/d88/d9f 39 2024-02-19T19:07:37.554 INFO:tasks.workunit.client.1.smithi142.stdout:0/644: write d23/d28/f34 [2679412,48200] 0 2024-02-19T19:07:37.556 INFO:tasks.workunit.client.1.smithi142.stdout:5/756: link d5/dd/c88 d5/dd/d8/dbc/c106 0 2024-02-19T19:07:37.556 INFO:tasks.workunit.client.1.smithi142.stdout:5/757: write d5/dd/df/da0/faf [109833,129685] 0 2024-02-19T19:07:37.556 INFO:tasks.workunit.client.1.smithi142.stdout:8/760: dread d9/dd/de/d2d/d2e/d49/d50/f7b [0,4194304] 0 2024-02-19T19:07:37.561 INFO:tasks.workunit.client.1.smithi142.stdout:3/891: creat d1d/d87/f11b x:0 0 0 2024-02-19T19:07:37.561 INFO:tasks.workunit.client.1.smithi142.stdout:3/892: chown d1d/d1e/d2e/dee/d91/lda 1 1 2024-02-19T19:07:37.562 INFO:tasks.workunit.client.1.smithi142.stdout:3/893: write d1d/d1e/d2e/dee/da2/dbb/fef [719471,84239] 0 2024-02-19T19:07:37.562 INFO:tasks.workunit.client.1.smithi142.stdout:3/894: creat d1d/d1e/d2e/dee/da2/df1/f11c x:0 0 0 2024-02-19T19:07:37.562 INFO:tasks.workunit.client.1.smithi142.stdout:3/895: truncate d1d/d1e/d2e/d50/d7c/da7/d3a/dc7/f103 670804 0 2024-02-19T19:07:37.563 INFO:tasks.workunit.client.1.smithi142.stdout:9/732: link db/d10/d27/d2f/f87 db/d10/d22/d24/d41/d99/fc7 0 2024-02-19T19:07:37.565 INFO:tasks.workunit.client.1.smithi142.stdout:0/645: mknod d23/d28/d2d/d54/d88/d9f/cce 0 2024-02-19T19:07:37.566 INFO:tasks.workunit.client.1.smithi142.stdout:0/646: dread - d23/d28/d41/fa2 zero size 2024-02-19T19:07:37.568 INFO:tasks.workunit.client.1.smithi142.stdout:8/761: creat d9/dd/de/d14/d65/d94/ff4 x:0 0 0 2024-02-19T19:07:37.571 INFO:tasks.workunit.client.1.smithi142.stdout:5/758: dwrite d5/dd/df/d22/d41/fd0 [0,4194304] 0 2024-02-19T19:07:37.571 INFO:tasks.workunit.client.1.smithi142.stdout:0/647: creat d23/d28/d2d/d54/d85/fcf x:0 0 0 2024-02-19T19:07:37.573 INFO:tasks.workunit.client.1.smithi142.stdout:8/762: rmdir d9/dd/de/d2d/d2e/d49/d50/d59 39 2024-02-19T19:07:37.573 INFO:tasks.workunit.client.1.smithi142.stdout:8/763: chown d9/dd/de/d2d/d2e/d49/caf 5811 1 2024-02-19T19:07:37.573 INFO:tasks.workunit.client.1.smithi142.stdout:8/764: creat d9/dd/d15/ff5 x:0 0 0 2024-02-19T19:07:37.573 INFO:tasks.workunit.client.1.smithi142.stdout:6/659: sync 2024-02-19T19:07:37.573 INFO:tasks.workunit.client.1.smithi142.stdout:2/632: sync 2024-02-19T19:07:37.575 INFO:tasks.workunit.client.1.smithi142.stdout:8/765: write d9/dd/de/d2d/d2e/d73/d77/f67 [374029,20989] 0 2024-02-19T19:07:37.575 INFO:tasks.workunit.client.1.smithi142.stdout:8/766: write d9/f7e [294053,54490] 0 2024-02-19T19:07:37.576 INFO:tasks.workunit.client.1.smithi142.stdout:8/767: fdatasync d9/dd/de/d2d/d2e/d73/fb0 0 2024-02-19T19:07:37.576 INFO:tasks.workunit.client.1.smithi142.stdout:7/655: rename d0/d62 to d0/d1b/d21/d24/ddf 0 2024-02-19T19:07:37.576 INFO:tasks.workunit.client.1.smithi142.stdout:7/656: write d0/d13/f70 [297972,45450] 0 2024-02-19T19:07:37.584 INFO:tasks.workunit.client.1.smithi142.stdout:6/660: symlink d2/d17/ld9 0 2024-02-19T19:07:37.585 INFO:tasks.workunit.client.1.smithi142.stdout:7/657: write d0/d1b/d21/f8d [761061,70989] 0 2024-02-19T19:07:37.585 INFO:tasks.workunit.client.1.smithi142.stdout:7/658: fsync d0/d1b/d21/f4c 0 2024-02-19T19:07:37.586 INFO:tasks.workunit.client.1.smithi142.stdout:2/633: unlink d3/d4d/d5f/cb2 0 2024-02-19T19:07:37.588 INFO:tasks.workunit.client.1.smithi142.stdout:0/648: read d23/d28/d2d/d51/dc9/d58/f76 [2346832,48322] 0 2024-02-19T19:07:37.589 INFO:tasks.workunit.client.1.smithi142.stdout:8/768: link d9/dd/d15/d31/c71 d9/dd/de/d14/d65/d6c/cf6 0 2024-02-19T19:07:37.592 INFO:tasks.workunit.client.1.smithi142.stdout:3/896: rename d1d/d1e/d2e/dee/da2/df1/f10d to d1d/d1e/d2e/d50/f11d 0 2024-02-19T19:07:37.594 INFO:tasks.workunit.client.1.smithi142.stdout:6/661: mknod d2/d1f/d20/d31/d62/cda 0 2024-02-19T19:07:37.595 INFO:tasks.workunit.client.1.smithi142.stdout:2/634: write d3/db/f15 [1940051,77230] 0 2024-02-19T19:07:37.597 INFO:tasks.workunit.client.1.smithi142.stdout:9/733: rename db/d10/d32/d91/dc1/dc2 to db/d10/d22/d24/d41/dc8 0 2024-02-19T19:07:37.597 INFO:tasks.workunit.client.1.smithi142.stdout:5/759: rename d5/dd/d8 to d5/dd/d8/d2a/d57/d107 22 2024-02-19T19:07:37.600 INFO:tasks.workunit.client.1.smithi142.stdout:3/897: mknod d1d/d1e/d2e/d50/d7c/da7/d52/d5a/da4/c11e 0 2024-02-19T19:07:37.600 INFO:tasks.workunit.client.1.smithi142.stdout:3/898: dread - d1d/d1e/d2e/dee/da2/df1/f118 zero size 2024-02-19T19:07:37.600 INFO:tasks.workunit.client.1.smithi142.stdout:3/899: write d1d/d1e/d2e/d50/d7c/da7/d3a/f4b [2039636,4495] 0 2024-02-19T19:07:37.604 INFO:tasks.workunit.client.1.smithi142.stdout:6/662: mknod d2/d17/d33/d42/da2/da7/cdb 0 2024-02-19T19:07:37.604 INFO:tasks.workunit.client.1.smithi142.stdout:8/769: dread d9/dd/de/d2d/d2e/d49/f70 [0,4194304] 0 2024-02-19T19:07:37.607 INFO:tasks.workunit.client.1.smithi142.stdout:3/900: symlink d1d/d1e/d2e/d8b/l11f 0 2024-02-19T19:07:37.607 INFO:tasks.workunit.client.1.smithi142.stdout:9/734: dread db/d10/d22/f46 [0,4194304] 0 2024-02-19T19:07:37.607 INFO:tasks.workunit.client.1.smithi142.stdout:9/735: truncate db/d10/d22/f50 1136337 0 2024-02-19T19:07:37.609 INFO:tasks.workunit.client.1.smithi142.stdout:2/635: write d3/f9e [22295,21392] 0 2024-02-19T19:07:37.609 INFO:tasks.workunit.client.1.smithi142.stdout:6/663: unlink d2/d1f/d20/d31/d62/cda 0 2024-02-19T19:07:37.609 INFO:tasks.workunit.client.1.smithi142.stdout:6/664: fdatasync d2/d17/d33/d42/da2/da7/f91 0 2024-02-19T19:07:37.610 INFO:tasks.workunit.client.1.smithi142.stdout:8/770: symlink d9/dd/d15/lf7 0 2024-02-19T19:07:37.612 INFO:tasks.workunit.client.1.smithi142.stdout:3/901: rename d1d/d1e/d2e/d50/f69 to d1d/d1e/d2e/dee/d8d/de4/f120 0 2024-02-19T19:07:37.613 INFO:tasks.workunit.client.1.smithi142.stdout:2/636: mknod d3/d4b/ccc 0 2024-02-19T19:07:37.615 INFO:tasks.workunit.client.1.smithi142.stdout:6/665: truncate d2/d1f/f2b 182931 0 2024-02-19T19:07:37.615 INFO:tasks.workunit.client.1.smithi142.stdout:6/666: readlink d2/d1f/d5c/d63/l9b 0 2024-02-19T19:07:37.616 INFO:tasks.workunit.client.1.smithi142.stdout:6/667: read d2/d1f/d5c/d63/fa1 [358203,6732] 0 2024-02-19T19:07:37.616 INFO:tasks.workunit.client.1.smithi142.stdout:6/668: read d2/d1f/d4d/fa3 [2336112,18689] 0 2024-02-19T19:07:37.616 INFO:tasks.workunit.client.1.smithi142.stdout:6/669: creat d2/fdc x:0 0 0 2024-02-19T19:07:37.619 INFO:tasks.workunit.client.1.smithi142.stdout:2/637: rename d3/f17 to d3/d68/d95/dca/fcd 0 2024-02-19T19:07:37.619 INFO:tasks.workunit.client.1.smithi142.stdout:8/771: dread d9/da8/fb6 [0,4194304] 0 2024-02-19T19:07:37.620 INFO:tasks.workunit.client.1.smithi142.stdout:8/772: write d9/dd/de/d2d/d2e/d73/d77/fa6 [889067,1381] 0 2024-02-19T19:07:37.620 INFO:tasks.workunit.client.1.smithi142.stdout:9/736: write db/f61 [5754088,36718] 0 2024-02-19T19:07:37.620 INFO:tasks.workunit.client.1.smithi142.stdout:9/737: read - db/d10/d32/d3f/d5f/fbc zero size 2024-02-19T19:07:37.623 INFO:tasks.workunit.client.1.smithi142.stdout:2/638: rename d3/d4d/f90 to d3/d35/d97/fce 0 2024-02-19T19:07:37.623 INFO:tasks.workunit.client.1.smithi142.stdout:8/773: rename d9/dd/de/d14/d65 to d9/dd/de/d14/d65/db1/df8 22 2024-02-19T19:07:37.623 INFO:tasks.workunit.client.1.smithi142.stdout:8/774: rename d9/dd/de to d9/dd/de/d2d/d2e/d49/d50/deb/df9 22 2024-02-19T19:07:37.623 INFO:tasks.workunit.client.1.smithi142.stdout:8/775: readlink l6 0 2024-02-19T19:07:37.623 INFO:tasks.workunit.client.1.smithi142.stdout:6/670: dread d2/d1f/f30 [0,4194304] 0 2024-02-19T19:07:37.624 INFO:tasks.workunit.client.1.smithi142.stdout:9/738: symlink db/d10/d27/d2f/d4c/lc9 0 2024-02-19T19:07:37.625 INFO:tasks.workunit.client.1.smithi142.stdout:9/739: stat db/d10/d27/d2f/f87 0 2024-02-19T19:07:37.625 INFO:tasks.workunit.client.1.smithi142.stdout:0/649: dwrite d23/d32/d8a/fb0 [0,4194304] 0 2024-02-19T19:07:37.625 INFO:tasks.workunit.client.1.smithi142.stdout:7/659: dwrite d0/d13/f70 [0,4194304] 0 2024-02-19T19:07:37.626 INFO:tasks.workunit.client.1.smithi142.stdout:8/776: getdents d9/dd/de/d2d/d2e/d49/d50/d59/d97/dbe 0 2024-02-19T19:07:37.628 INFO:tasks.workunit.client.1.smithi142.stdout:6/671: link d2/d1f/d20/d31/d62/f72 d2/d1f/d4d/d60/fdd 0 2024-02-19T19:07:37.629 INFO:tasks.workunit.client.1.smithi142.stdout:6/672: fsync d2/d1e/d35/d66/f8b 0 2024-02-19T19:07:37.629 INFO:tasks.workunit.client.1.smithi142.stdout:6/673: write d2/d17/d33/d42/d5e/d7b/fc9 [422094,28437] 0 2024-02-19T19:07:37.629 INFO:tasks.workunit.client.1.smithi142.stdout:3/902: dread d1d/d1e/d2e/d50/d7c/da7/d52/d71/faa [0,4194304] 0 2024-02-19T19:07:37.630 INFO:tasks.workunit.client.1.smithi142.stdout:5/760: dwrite d5/dd/d8/ff3 [0,4194304] 0 2024-02-19T19:07:37.633 INFO:tasks.workunit.client.1.smithi142.stdout:2/639: dread d3/d4d/f50 [0,4194304] 0 2024-02-19T19:07:37.633 INFO:tasks.workunit.client.1.smithi142.stdout:2/640: write d3/db/d29/d6d/f56 [431136,87217] 0 2024-02-19T19:07:37.637 INFO:tasks.workunit.client.1.smithi142.stdout:6/674: rename d2/d17/d33/c44 to d2/d17/d33/d42/da2/da7/cde 0 2024-02-19T19:07:37.637 INFO:tasks.workunit.client.1.smithi142.stdout:0/650: dread d23/d28/d41/f75 [0,4194304] 0 2024-02-19T19:07:37.638 INFO:tasks.workunit.client.1.smithi142.stdout:3/903: mkdir d1d/db6/d121 0 2024-02-19T19:07:37.648 INFO:tasks.workunit.client.1.smithi142.stdout:2/641: rename d3/d35/d97/fc3 to d3/db/d29/d6d/d59/fcf 0 2024-02-19T19:07:37.650 INFO:tasks.workunit.client.1.smithi142.stdout:6/675: dread d2/d1f/d20/f25 [0,4194304] 0 2024-02-19T19:07:37.650 INFO:tasks.workunit.client.1.smithi142.stdout:6/676: read - d2/d17/d33/d39/f86 zero size 2024-02-19T19:07:37.652 INFO:tasks.workunit.client.1.smithi142.stdout:3/904: rename d1d/d1e/d2e/ff0 to d1d/d1e/d2e/d50/d7c/da7/d52/d5a/f122 0 2024-02-19T19:07:37.653 INFO:tasks.workunit.client.1.smithi142.stdout:2/642: mknod d3/db/d29/d4c/dae/cd0 0 2024-02-19T19:07:37.653 INFO:tasks.workunit.client.1.smithi142.stdout:2/643: stat d3/db/d29/d4c/dae/cd0 0 2024-02-19T19:07:37.654 INFO:tasks.workunit.client.1.smithi142.stdout:6/677: rmdir d2/d1e/d35/d66/d76 39 2024-02-19T19:07:37.654 INFO:tasks.workunit.client.1.smithi142.stdout:6/678: chown d2/d17/d33/d42/d5e 73655 1 2024-02-19T19:07:37.654 INFO:tasks.workunit.client.1.smithi142.stdout:6/679: creat d2/d1f/fdf x:0 0 0 2024-02-19T19:07:37.655 INFO:tasks.workunit.client.1.smithi142.stdout:6/680: fdatasync d2/d17/d33/d42/da2/da7/d55/daf/fb3 0 2024-02-19T19:07:37.658 INFO:tasks.workunit.client.1.smithi142.stdout:6/681: symlink d2/d17/d33/d42/da2/da7/dd2/dd3/le0 0 2024-02-19T19:07:37.662 INFO:tasks.workunit.client.1.smithi142.stdout:6/682: unlink d2/d1e/d35/d66/fa5 0 2024-02-19T19:07:37.663 INFO:tasks.workunit.client.1.smithi142.stdout:6/683: creat d2/d1e/d35/fe1 x:0 0 0 2024-02-19T19:07:37.665 INFO:tasks.workunit.client.1.smithi142.stdout:6/684: mkdir d2/d17/d33/d42/da2/da7/dd2/de2 0 2024-02-19T19:07:37.665 INFO:tasks.workunit.client.1.smithi142.stdout:3/905: dread fa [0,4194304] 0 2024-02-19T19:07:37.666 INFO:tasks.workunit.client.1.smithi142.stdout:6/685: mknod d2/d29/d47/ce3 0 2024-02-19T19:07:37.668 INFO:tasks.workunit.client.1.smithi142.stdout:3/906: rmdir d1d/d1e/d2e/dee/dc1 39 2024-02-19T19:07:37.668 INFO:tasks.workunit.client.1.smithi142.stdout:3/907: dread - d1d/d1e/d2e/d50/d83/fae zero size 2024-02-19T19:07:37.671 INFO:tasks.workunit.client.1.smithi142.stdout:6/686: link d2/f9 d2/d17/d33/d42/da2/da7/fe4 0 2024-02-19T19:07:37.672 INFO:tasks.workunit.client.1.smithi142.stdout:3/908: link d1d/d1e/d2e/dee/dc1/dfb/f107 d1d/d1e/d2e/d50/f123 0 2024-02-19T19:07:37.673 INFO:tasks.workunit.client.1.smithi142.stdout:5/761: dwrite d5/dd/d8/d2a/d93/fff [0,4194304] 0 2024-02-19T19:07:37.673 INFO:tasks.workunit.client.1.smithi142.stdout:0/651: dwrite d23/f25 [4194304,4194304] 0 2024-02-19T19:07:37.674 INFO:tasks.workunit.client.1.smithi142.stdout:0/652: fdatasync d23/d28/d2d/d54/d88/d9f/fbc 0 2024-02-19T19:07:37.674 INFO:tasks.workunit.client.1.smithi142.stdout:3/909: symlink d1d/d1e/l124 0 2024-02-19T19:07:37.674 INFO:tasks.workunit.client.1.smithi142.stdout:2/644: dwrite d3/f5 [0,4194304] 0 2024-02-19T19:07:37.675 INFO:tasks.workunit.client.1.smithi142.stdout:9/740: dwrite db/d10/d22/d24/d41/d99/fc7 [0,4194304] 0 2024-02-19T19:07:37.675 INFO:tasks.workunit.client.1.smithi142.stdout:9/741: chown db/d10/d22/fbe 1479 1 2024-02-19T19:07:37.676 INFO:tasks.workunit.client.1.smithi142.stdout:8/777: dwrite d9/dd/d44/d79/f35 [4194304,4194304] 0 2024-02-19T19:07:37.676 INFO:tasks.workunit.client.1.smithi142.stdout:8/778: truncate d9/dd/de/d14/d65/f90 1168816 0 2024-02-19T19:07:37.678 INFO:tasks.workunit.client.1.smithi142.stdout:5/762: creat d5/dd/d8/d31/d4d/d60/f108 x:0 0 0 2024-02-19T19:07:37.683 INFO:tasks.workunit.client.1.smithi142.stdout:0/653: rename d23/d28/d2d/f53 to d23/d7d/d9e/fd0 0 2024-02-19T19:07:37.683 INFO:tasks.workunit.client.1.smithi142.stdout:0/654: write d23/d32/d8a/f96 [4253539,9549] 0 2024-02-19T19:07:37.685 INFO:tasks.workunit.client.1.smithi142.stdout:3/910: mkdir d1d/d1e/d2e/d50/d7c/da7/d52/d108/d125 0 2024-02-19T19:07:37.685 INFO:tasks.workunit.client.1.smithi142.stdout:4/856: sync 2024-02-19T19:07:37.685 INFO:tasks.workunit.client.1.smithi142.stdout:1/872: sync 2024-02-19T19:07:37.685 INFO:tasks.workunit.client.1.smithi142.stdout:4/857: fsync d4/d1d/d42/d66/d5f/fd1 0 2024-02-19T19:07:37.685 INFO:tasks.workunit.client.1.smithi142.stdout:6/687: dwrite d2/d29/d47/f68 [0,4194304] 0 2024-02-19T19:07:37.689 INFO:tasks.workunit.client.1.smithi142.stdout:9/742: mknod db/d10/d22/cca 0 2024-02-19T19:07:37.694 INFO:tasks.workunit.client.1.smithi142.stdout:4/858: write d4/d1d/d42/d66/dd/d10/d26/d50/d54/fca [1181224,106063] 0 2024-02-19T19:07:37.696 INFO:tasks.workunit.client.1.smithi142.stdout:8/779: getdents d9/dd/d15/d31/d5e 0 2024-02-19T19:07:37.699 INFO:tasks.workunit.client.1.smithi142.stdout:5/763: link d5/dd/d8/c19 d5/dd/d8/d1c/c109 0 2024-02-19T19:07:37.701 INFO:tasks.workunit.client.1.smithi142.stdout:0/655: mknod d23/d28/d2d/d51/dc9/d58/dc1/cd1 0 2024-02-19T19:07:37.702 INFO:tasks.workunit.client.1.smithi142.stdout:0/656: write d23/d32/f30 [3245170,73466] 0 2024-02-19T19:07:37.702 INFO:tasks.workunit.client.1.smithi142.stdout:0/657: creat d23/d28/d41/d78/fd2 x:0 0 0 2024-02-19T19:07:37.703 INFO:tasks.workunit.client.1.smithi142.stdout:3/911: creat d1d/d1e/d2e/d50/d83/f126 x:0 0 0 2024-02-19T19:07:37.704 INFO:tasks.workunit.client.1.smithi142.stdout:1/873: mknod d5/d7/d23/d41/d103/c133 0 2024-02-19T19:07:37.704 INFO:tasks.workunit.client.1.smithi142.stdout:1/874: creat d5/f134 x:0 0 0 2024-02-19T19:07:37.706 INFO:tasks.workunit.client.1.smithi142.stdout:6/688: mknod d2/d1f/d20/d31/ce5 0 2024-02-19T19:07:37.706 INFO:tasks.workunit.client.1.smithi142.stdout:6/689: chown d2/d29/l9d 164 1 2024-02-19T19:07:37.707 INFO:tasks.workunit.client.1.smithi142.stdout:2/645: getdents d3/db 0 2024-02-19T19:07:37.707 INFO:tasks.workunit.client.1.smithi142.stdout:2/646: stat d3/d4d/f6c 0 2024-02-19T19:07:37.711 INFO:tasks.workunit.client.1.smithi142.stdout:0/658: dread d23/d7d/f92 [0,4194304] 0 2024-02-19T19:07:37.716 INFO:tasks.workunit.client.1.smithi142.stdout:4/859: creat d4/d1d/d42/d66/dd/dac/f11d x:0 0 0 2024-02-19T19:07:37.716 INFO:tasks.workunit.client.1.smithi142.stdout:4/860: chown d4/d1d/d42/d66/f8b 39 1 2024-02-19T19:07:37.718 INFO:tasks.workunit.client.1.smithi142.stdout:1/875: dwrite d5/d7/f3e [0,4194304] 0 2024-02-19T19:07:37.719 INFO:tasks.workunit.client.1.smithi142.stdout:8/780: mkdir d9/dd/de/d14/d65/d6c/dfa 0 2024-02-19T19:07:37.720 INFO:tasks.workunit.client.1.smithi142.stdout:8/781: write d9/dd/d15/d31/d5e/f62 [110695,96179] 0 2024-02-19T19:07:37.720 INFO:tasks.workunit.client.1.smithi142.stdout:8/782: dread - d9/da8/fbd zero size 2024-02-19T19:07:37.720 INFO:tasks.workunit.client.1.smithi142.stdout:8/783: chown d9/dd/d15/d31/l80 2859834 1 2024-02-19T19:07:37.720 INFO:tasks.workunit.client.1.smithi142.stdout:8/784: read - d9/dd/de/d14/d65/d6c/da7/fe2 zero size 2024-02-19T19:07:37.720 INFO:tasks.workunit.client.1.smithi142.stdout:1/876: dread d5/d7/d23/da4/ff2 [0,4194304] 0 2024-02-19T19:07:37.720 INFO:tasks.workunit.client.1.smithi142.stdout:5/764: rename d5/dd/df/da0/cf6 to d5/dd/d8/d31/d4d/d75/dc7/c10a 0 2024-02-19T19:07:37.722 INFO:tasks.workunit.client.1.smithi142.stdout:0/659: dread d23/d7d/f92 [0,4194304] 0 2024-02-19T19:07:37.723 INFO:tasks.workunit.client.1.smithi142.stdout:3/912: creat d1d/d1e/d2e/d50/d7c/da7/d52/d108/f127 x:0 0 0 2024-02-19T19:07:37.726 INFO:tasks.workunit.client.1.smithi142.stdout:6/690: mkdir d2/d17/d33/d42/da2/da7/de6 0 2024-02-19T19:07:37.726 INFO:tasks.workunit.client.1.smithi142.stdout:4/861: creat d4/d1d/d42/d66/dd/d10/d3e/f11e x:0 0 0 2024-02-19T19:07:37.728 INFO:tasks.workunit.client.1.smithi142.stdout:1/877: stat d5/d7/l2e 0 2024-02-19T19:07:37.731 INFO:tasks.workunit.client.1.smithi142.stdout:5/765: read d5/dd/df/d22/d41/f25 [1809020,17979] 0 2024-02-19T19:07:37.731 INFO:tasks.workunit.client.1.smithi142.stdout:0/660: creat d23/d28/d2d/d51/dc9/fd3 x:0 0 0 2024-02-19T19:07:37.731 INFO:tasks.workunit.client.1.smithi142.stdout:2/647: dwrite d3/d35/d97/fce [0,4194304] 0 2024-02-19T19:07:37.731 INFO:tasks.workunit.client.1.smithi142.stdout:2/648: fsync d3/db/f3a 0 2024-02-19T19:07:37.732 INFO:tasks.workunit.client.1.smithi142.stdout:5/766: dread d5/dd/d8/d29/f96 [0,4194304] 0 2024-02-19T19:07:37.733 INFO:tasks.workunit.client.1.smithi142.stdout:5/767: chown d5/dd/d8/d31/d4d/d60/f73 0 1 2024-02-19T19:07:37.733 INFO:tasks.workunit.client.1.smithi142.stdout:5/768: fsync d5/dd/d8/d31/d4d/fe9 0 2024-02-19T19:07:37.733 INFO:tasks.workunit.client.1.smithi142.stdout:3/913: truncate d1d/f41 2027935 0 2024-02-19T19:07:37.734 INFO:tasks.workunit.client.1.smithi142.stdout:6/691: rmdir d2/d17/d33/d42/da2/da7 39 2024-02-19T19:07:37.735 INFO:tasks.workunit.client.1.smithi142.stdout:4/862: rmdir d4/d1d/d42/d66/d12/d79/d8c/d119/d6e 39 2024-02-19T19:07:37.735 INFO:tasks.workunit.client.1.smithi142.stdout:4/863: read d4/d1d/d42/d66/dd/f4a [228023,2477] 0 2024-02-19T19:07:37.737 INFO:tasks.workunit.client.1.smithi142.stdout:1/878: mkdir d5/d7/d23/d41/d135 0 2024-02-19T19:07:37.737 INFO:tasks.workunit.client.1.smithi142.stdout:1/879: truncate d5/d7/d4a/d53/d6a/f84 607551 0 2024-02-19T19:07:37.740 INFO:tasks.workunit.client.1.smithi142.stdout:2/649: rmdir d3/d68/d95 39 2024-02-19T19:07:37.740 INFO:tasks.workunit.client.1.smithi142.stdout:2/650: chown d3/df/l19 181753430 1 2024-02-19T19:07:37.743 INFO:tasks.workunit.client.1.smithi142.stdout:5/769: symlink d5/dd/d8/d31/d4d/d60/l10b 0 2024-02-19T19:07:37.743 INFO:tasks.workunit.client.1.smithi142.stdout:5/770: fsync d5/dd/d8/d31/d4d/d60/f7d 0 2024-02-19T19:07:37.745 INFO:tasks.workunit.client.1.smithi142.stdout:3/914: mknod d1d/d1e/d2e/d50/d7c/da7/d52/d71/ddd/c128 0 2024-02-19T19:07:37.748 INFO:tasks.workunit.client.1.smithi142.stdout:1/880: dread d5/f68 [0,4194304] 0 2024-02-19T19:07:37.748 INFO:tasks.workunit.client.1.smithi142.stdout:6/692: mknod d2/d1f/d45/ce7 0 2024-02-19T19:07:37.748 INFO:tasks.workunit.client.1.smithi142.stdout:1/881: read d5/d37/f93 [37501,121343] 0 2024-02-19T19:07:37.749 INFO:tasks.workunit.client.1.smithi142.stdout:5/771: symlink d5/dd/d8/d2a/l10c 0 2024-02-19T19:07:37.751 INFO:tasks.workunit.client.1.smithi142.stdout:3/915: truncate d1d/d1e/f21 2318248 0 2024-02-19T19:07:37.751 INFO:tasks.workunit.client.1.smithi142.stdout:3/916: creat d1d/f129 x:0 0 0 2024-02-19T19:07:37.753 INFO:tasks.workunit.client.1.smithi142.stdout:4/864: dwrite d4/d1d/f74 [0,4194304] 0 2024-02-19T19:07:37.753 INFO:tasks.workunit.client.1.smithi142.stdout:4/865: write d4/d1d/d42/d66/dd/d10/d3e/f11e [678573,20259] 0 2024-02-19T19:07:37.753 INFO:tasks.workunit.client.1.smithi142.stdout:4/866: creat d4/d14/d31/f11f x:0 0 0 2024-02-19T19:07:37.755 INFO:tasks.workunit.client.1.smithi142.stdout:0/661: dwrite f1a [0,4194304] 0 2024-02-19T19:07:37.755 INFO:tasks.workunit.client.1.smithi142.stdout:0/662: read - d23/d32/d8a/db1/dca/fcd zero size 2024-02-19T19:07:37.756 INFO:tasks.workunit.client.1.smithi142.stdout:6/693: link d2/d1f/d4d/d60/l9c d2/d1f/d4d/d60/db6/le8 0 2024-02-19T19:07:37.756 INFO:tasks.workunit.client.1.smithi142.stdout:6/694: chown d2/d17/f73 5154 1 2024-02-19T19:07:37.759 INFO:tasks.workunit.client.1.smithi142.stdout:1/882: creat d5/d7/d4a/d53/f136 x:0 0 0 2024-02-19T19:07:37.760 INFO:tasks.workunit.client.1.smithi142.stdout:1/883: dread - d5/d7/d23/d41/d103/f12e zero size 2024-02-19T19:07:37.760 INFO:tasks.workunit.client.1.smithi142.stdout:2/651: dwrite d3/f1f [0,4194304] 0 2024-02-19T19:07:37.762 INFO:tasks.workunit.client.1.smithi142.stdout:5/772: rename d5/dd/d8/d31/f6e to d5/dd/d8/d31/d4d/f10d 0 2024-02-19T19:07:37.762 INFO:tasks.workunit.client.1.smithi142.stdout:5/773: fsync d5/dd/df/d22/d41/d6f/fdd 0 2024-02-19T19:07:37.763 INFO:tasks.workunit.client.1.smithi142.stdout:5/774: getdents d5/dd/d8/d31/d4d/d75/d9e/dfc 0 2024-02-19T19:07:37.767 INFO:tasks.workunit.client.1.smithi142.stdout:4/867: creat d4/d1d/d42/d66/d12/d79/d8c/d119/da2/f120 x:0 0 0 2024-02-19T19:07:37.771 INFO:tasks.workunit.client.1.smithi142.stdout:0/663: unlink d23/d28/l98 0 2024-02-19T19:07:37.771 INFO:tasks.workunit.client.1.smithi142.stdout:0/664: dread - d23/d32/d8a/db1/fc5 zero size 2024-02-19T19:07:37.771 INFO:tasks.workunit.client.1.smithi142.stdout:0/665: stat d23/d28/d2d/d51/dc9/c9b 0 2024-02-19T19:07:37.771 INFO:tasks.workunit.client.1.smithi142.stdout:0/666: write d23/d28/f70 [3902804,11556] 0 2024-02-19T19:07:37.775 INFO:tasks.workunit.client.1.smithi142.stdout:2/652: creat d3/db/fd1 x:0 0 0 2024-02-19T19:07:37.776 INFO:tasks.workunit.client.1.smithi142.stdout:1/884: dwrite d5/d7/fd3 [0,4194304] 0 2024-02-19T19:07:37.778 INFO:tasks.workunit.client.1.smithi142.stdout:5/775: rename d5/dd/df/d15/fd5 to d5/dd/d8/dd4/db4/f10e 0 2024-02-19T19:07:37.778 INFO:tasks.workunit.client.1.smithi142.stdout:5/776: truncate d5/dd/d8/f8e 635381 0 2024-02-19T19:07:37.778 INFO:tasks.workunit.client.1.smithi142.stdout:5/777: fsync d5/dd/df/d22/d41/d6f/f89 0 2024-02-19T19:07:37.778 INFO:tasks.workunit.client.1.smithi142.stdout:5/778: readlink d5/dd/d5f/d6a/lef 0 2024-02-19T19:07:37.778 INFO:tasks.workunit.client.1.smithi142.stdout:6/695: dwrite d2/d17/d33/d39/f70 [0,4194304] 0 2024-02-19T19:07:37.779 INFO:tasks.workunit.client.1.smithi142.stdout:4/868: mkdir d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f/d112/d121 0 2024-02-19T19:07:37.780 INFO:tasks.workunit.client.1.smithi142.stdout:0/667: symlink d23/d28/d2d/d51/dc9/d58/ld4 0 2024-02-19T19:07:37.783 INFO:tasks.workunit.client.1.smithi142.stdout:1/885: creat d5/d7/d23/d41/d135/f137 x:0 0 0 2024-02-19T19:07:37.783 INFO:tasks.workunit.client.1.smithi142.stdout:1/886: fdatasync d5/d37/d6c/d75/fc2 0 2024-02-19T19:07:37.783 INFO:tasks.workunit.client.1.smithi142.stdout:1/887: fdatasync d5/d7/d23/f45 0 2024-02-19T19:07:37.783 INFO:tasks.workunit.client.1.smithi142.stdout:1/888: chown d5/d37/d6c/f7c 8 1 2024-02-19T19:07:37.787 INFO:tasks.workunit.client.1.smithi142.stdout:6/696: symlink d2/d1f/d20/le9 0 2024-02-19T19:07:37.789 INFO:tasks.workunit.client.1.smithi142.stdout:4/869: symlink d4/d1d/d42/d66/dd/d10/d3b/d3f/d100/l122 0 2024-02-19T19:07:37.789 INFO:tasks.workunit.client.1.smithi142.stdout:4/870: creat d4/d1d/d42/d66/d12/d79/d8c/d119/da2/f123 x:0 0 0 2024-02-19T19:07:37.791 INFO:tasks.workunit.client.1.smithi142.stdout:0/668: rmdir d23/d28/d2d/d51/dc9/dcc 0 2024-02-19T19:07:37.794 INFO:tasks.workunit.client.1.smithi142.stdout:6/697: symlink d2/d17/d33/d42/lea 0 2024-02-19T19:07:37.794 INFO:tasks.workunit.client.1.smithi142.stdout:6/698: creat d2/d1e/d35/d66/d8d/d3e/d8c/feb x:0 0 0 2024-02-19T19:07:37.794 INFO:tasks.workunit.client.1.smithi142.stdout:2/653: dwrite d3/f9e [0,4194304] 0 2024-02-19T19:07:37.795 INFO:tasks.workunit.client.1.smithi142.stdout:2/654: dread d3/db/d29/f85 [0,4194304] 0 2024-02-19T19:07:37.797 INFO:tasks.workunit.client.1.smithi142.stdout:4/871: mkdir d4/d1d/d42/d66/dd/d10/d3e/d68/db4/d124 0 2024-02-19T19:07:37.798 INFO:tasks.workunit.client.1.smithi142.stdout:1/889: getdents d5/d1a/d33/dce 0 2024-02-19T19:07:37.798 INFO:tasks.workunit.client.1.smithi142.stdout:1/890: fsync d5/d7/d4a/d53/d6a/fa5 0 2024-02-19T19:07:37.800 INFO:tasks.workunit.client.1.smithi142.stdout:6/699: mkdir d2/d1e/d35/dec 0 2024-02-19T19:07:37.801 INFO:tasks.workunit.client.1.smithi142.stdout:4/872: mkdir d4/d1d/d42/d66/dd/dac/d125 0 2024-02-19T19:07:37.801 INFO:tasks.workunit.client.1.smithi142.stdout:1/891: read d5/f4e [406100,94325] 0 2024-02-19T19:07:37.801 INFO:tasks.workunit.client.1.smithi142.stdout:6/700: rmdir d2/d17/d33/d42/da2/da7/dd2/dd3 39 2024-02-19T19:07:37.803 INFO:tasks.workunit.client.1.smithi142.stdout:1/892: symlink d5/d7/d4a/l138 0 2024-02-19T19:07:37.804 INFO:tasks.workunit.client.1.smithi142.stdout:5/779: dwrite d5/dd/d8/d5d/fd8 [0,4194304] 0 2024-02-19T19:07:37.806 INFO:tasks.workunit.client.1.smithi142.stdout:6/701: symlink d2/d17/d33/d39/led 0 2024-02-19T19:07:37.812 INFO:tasks.workunit.client.1.smithi142.stdout:1/893: write d5/d7/f4f [8273483,74524] 0 2024-02-19T19:07:37.813 INFO:tasks.workunit.client.1.smithi142.stdout:4/873: rename d4/d34 to d4/d1d/d42/d66/d12/d79/d8c/d119/d6e/d126 0 2024-02-19T19:07:37.816 INFO:tasks.workunit.client.1.smithi142.stdout:1/894: unlink d5/d7/d23/d41/d103/f12e 0 2024-02-19T19:07:37.819 INFO:tasks.workunit.client.1.smithi142.stdout:5/780: rename d5/dd/df/da0/faf to d5/dd/d8/dd4/db4/f10f 0 2024-02-19T19:07:37.819 INFO:tasks.workunit.client.1.smithi142.stdout:5/781: chown d5/dd/d8/d31/d4d/d75/c104 649598 1 2024-02-19T19:07:37.819 INFO:tasks.workunit.client.1.smithi142.stdout:5/782: fsync d5/dd/d8/d2a/d93/faa 0 2024-02-19T19:07:37.819 INFO:tasks.workunit.client.1.smithi142.stdout:5/783: fdatasync d5/dd/d8/d29/f96 0 2024-02-19T19:07:37.819 INFO:tasks.workunit.client.1.smithi142.stdout:5/784: chown d5/dd/df/d15/c83 5462510 1 2024-02-19T19:07:37.819 INFO:tasks.workunit.client.1.smithi142.stdout:5/785: truncate d5/dd/df/d15/fc6 484779 0 2024-02-19T19:07:37.820 INFO:tasks.workunit.client.1.smithi142.stdout:5/786: chown d5/dda 9744 1 2024-02-19T19:07:37.820 INFO:tasks.workunit.client.1.smithi142.stdout:6/702: getdents d2/d29 0 2024-02-19T19:07:37.824 INFO:tasks.workunit.client.1.smithi142.stdout:1/895: getdents d5/d77/da9/dae/deb 0 2024-02-19T19:07:37.824 INFO:tasks.workunit.client.1.smithi142.stdout:1/896: chown d5/d1a/d59/c61 94138 1 2024-02-19T19:07:37.824 INFO:tasks.workunit.client.1.smithi142.stdout:5/787: creat d5/dd/d8/f110 x:0 0 0 2024-02-19T19:07:37.824 INFO:tasks.workunit.client.1.smithi142.stdout:4/874: dread d4/d14/d31/d43/f5d [0,4194304] 0 2024-02-19T19:07:37.824 INFO:tasks.workunit.client.1.smithi142.stdout:6/703: mkdir d2/d1f/d4d/d60/d87/dee 0 2024-02-19T19:07:37.824 INFO:tasks.workunit.client.1.smithi142.stdout:4/875: mknod d4/d1d/d42/d66/dd/d10/d3b/d3f/c127 0 2024-02-19T19:07:37.826 INFO:tasks.workunit.client.1.smithi142.stdout:6/704: creat d2/d17/d33/d42/da2/da7/d55/dc0/fef x:0 0 0 2024-02-19T19:07:37.826 INFO:tasks.workunit.client.1.smithi142.stdout:6/705: fdatasync d2/d1f/fdf 0 2024-02-19T19:07:37.826 INFO:tasks.workunit.client.1.smithi142.stdout:6/706: dread - d2/fcb zero size 2024-02-19T19:07:37.830 INFO:tasks.workunit.client.1.smithi142.stdout:4/876: creat d4/d1d/d42/d66/d12/d79/d8c/d119/da2/db3/f128 x:0 0 0 2024-02-19T19:07:37.831 INFO:tasks.workunit.client.1.smithi142.stdout:6/707: stat d2/d17/d33/d39/c3a 0 2024-02-19T19:07:37.832 INFO:tasks.workunit.client.1.smithi142.stdout:7/660: sync 2024-02-19T19:07:37.835 INFO:tasks.workunit.client.1.smithi142.stdout:4/877: unlink d4/d1d/d42/d66/dd/d10/d3e/f4e 0 2024-02-19T19:07:37.835 INFO:tasks.workunit.client.1.smithi142.stdout:1/897: dread d5/d7/f4f [4194304,4194304] 0 2024-02-19T19:07:37.836 INFO:tasks.workunit.client.1.smithi142.stdout:6/708: creat d2/d17/d33/d42/da2/da7/dd2/de2/ff0 x:0 0 0 2024-02-19T19:07:37.837 INFO:tasks.workunit.client.1.smithi142.stdout:7/661: mknod d0/d13/d72/d47/d69/ce0 0 2024-02-19T19:07:37.838 INFO:tasks.workunit.client.1.smithi142.stdout:4/878: mkdir d4/d1d/d42/d129 0 2024-02-19T19:07:37.838 INFO:tasks.workunit.client.1.smithi142.stdout:4/879: chown d4/d1d/d42/d66/d12/d79/d8c/d119/da2 49455 1 2024-02-19T19:07:37.838 INFO:tasks.workunit.client.1.smithi142.stdout:4/880: fdatasync d4/d1d/d42/d66/d12/fc0 0 2024-02-19T19:07:37.838 INFO:tasks.workunit.client.1.smithi142.stdout:4/881: creat d4/d1d/d42/d66/dd/d10/d26/df7/f12a x:0 0 0 2024-02-19T19:07:37.839 INFO:tasks.workunit.client.1.smithi142.stdout:5/788: dwrite d5/dd/d5f/fc5 [0,4194304] 0 2024-02-19T19:07:37.839 INFO:tasks.workunit.client.1.smithi142.stdout:5/789: readlink d5/dd/d8/d2a/d93/l4c 0 2024-02-19T19:07:37.839 INFO:tasks.workunit.client.1.smithi142.stdout:1/898: mkdir d5/d37/d6c/d139 0 2024-02-19T19:07:37.839 INFO:tasks.workunit.client.1.smithi142.stdout:1/899: readlink d5/d7/d23/l55 0 2024-02-19T19:07:37.840 INFO:tasks.workunit.client.1.smithi142.stdout:1/900: read d5/d73/f8b [565966,70608] 0 2024-02-19T19:07:37.840 INFO:tasks.workunit.client.1.smithi142.stdout:6/709: mkdir d2/d17/d33/d42/df1 0 2024-02-19T19:07:37.840 INFO:tasks.workunit.client.1.smithi142.stdout:6/710: chown d2/d1e/d35/fe1 248532429 1 2024-02-19T19:07:37.840 INFO:tasks.workunit.client.1.smithi142.stdout:6/711: creat d2/ff2 x:0 0 0 2024-02-19T19:07:37.840 INFO:tasks.workunit.client.1.smithi142.stdout:6/712: write d2/d29/d47/f4a [2913523,75548] 0 2024-02-19T19:07:37.841 INFO:tasks.workunit.client.1.smithi142.stdout:7/662: mkdir d0/d1b/d21/d24/d29/d44/de1 0 2024-02-19T19:07:37.841 INFO:tasks.workunit.client.1.smithi142.stdout:7/663: truncate d0/d13/d1e/f96 341777 0 2024-02-19T19:07:37.841 INFO:tasks.workunit.client.1.smithi142.stdout:7/664: readlink d0/d1b/d21/d24/d29/d44/l87 0 2024-02-19T19:07:37.843 INFO:tasks.workunit.client.1.smithi142.stdout:4/882: rename d4/d1d/d42/d66/d12/d2d/c88 to d4/d14/d31/c12b 0 2024-02-19T19:07:37.844 INFO:tasks.workunit.client.1.smithi142.stdout:4/883: dread - d4/d1d/d42/d66/d2c/fa5 zero size 2024-02-19T19:07:37.855 INFO:tasks.workunit.client.1.smithi142.stdout:4/884: dread d4/d1d/d42/d66/d12/d2d/f75 [4194304,4194304] 0 2024-02-19T19:07:37.855 INFO:tasks.workunit.client.1.smithi142.stdout:4/885: write d4/d14/d31/f7d [5097743,38409] 0 2024-02-19T19:07:37.855 INFO:tasks.workunit.client.1.smithi142.stdout:4/886: truncate d4/d1d/d42/d66/d12/d79/d8c/d119/da2/db3/f128 479706 0 2024-02-19T19:07:37.856 INFO:tasks.workunit.client.1.smithi142.stdout:4/887: link d4/d1d/d42/d66/dd/d10/l30 d4/d1d/d42/d129/l12c 0 2024-02-19T19:07:37.856 INFO:tasks.workunit.client.1.smithi142.stdout:8/785: sync 2024-02-19T19:07:37.857 INFO:tasks.workunit.client.1.smithi142.stdout:9/743: sync 2024-02-19T19:07:37.857 INFO:tasks.workunit.client.1.smithi142.stdout:1/901: dwrite d5/d37/d6c/fa8 [0,4194304] 0 2024-02-19T19:07:37.857 INFO:tasks.workunit.client.1.smithi142.stdout:1/902: fsync d5/d37/f52 0 2024-02-19T19:07:37.858 INFO:tasks.workunit.client.1.smithi142.stdout:6/713: dwrite d2/d29/d47/f68 [4194304,4194304] 0 2024-02-19T19:07:37.863 INFO:tasks.workunit.client.1.smithi142.stdout:4/888: dread d4/d14/d31/d43/f5d [0,4194304] 0 2024-02-19T19:07:37.865 INFO:tasks.workunit.client.1.smithi142.stdout:8/786: write d9/dd/d44/faa [1973497,51780] 0 2024-02-19T19:07:37.865 INFO:tasks.workunit.client.1.smithi142.stdout:8/787: truncate d9/dd/de/d2d/d2e/d49/d74/f7a 647276 0 2024-02-19T19:07:37.871 INFO:tasks.workunit.client.1.smithi142.stdout:9/744: dwrite db/d10/d22/d24/f3c [0,4194304] 0 2024-02-19T19:07:37.873 INFO:tasks.workunit.client.1.smithi142.stdout:9/745: dread db/d10/fb6 [0,4194304] 0 2024-02-19T19:07:37.892 INFO:tasks.workunit.client.1.smithi142.stdout:1/903: mknod d5/d7/d23/c13a 0 2024-02-19T19:07:37.892 INFO:tasks.workunit.client.1.smithi142.stdout:1/904: truncate d5/d77/da9/dae/db2/dea/f10a 910346 0 2024-02-19T19:07:37.893 INFO:tasks.workunit.client.1.smithi142.stdout:1/905: dread - d5/d77/da9/dae/f126 zero size 2024-02-19T19:07:37.893 INFO:tasks.workunit.client.1.smithi142.stdout:5/790: rmdir d5/dd/d8 39 2024-02-19T19:07:37.893 INFO:tasks.workunit.client.1.smithi142.stdout:5/791: write d5/dd/df/d22/d41/d6f/f103 [362957,45676] 0 2024-02-19T19:07:37.894 INFO:tasks.workunit.client.1.smithi142.stdout:5/792: chown d5/dd/df/d15/c76 35766073 1 2024-02-19T19:07:37.894 INFO:tasks.workunit.client.1.smithi142.stdout:1/906: dread d5/d7/d23/d2c/fd7 [0,4194304] 0 2024-02-19T19:07:37.894 INFO:tasks.workunit.client.1.smithi142.stdout:1/907: chown d5/d7/d23/f12f 844282065 1 2024-02-19T19:07:37.896 INFO:tasks.workunit.client.1.smithi142.stdout:4/889: read d4/d1d/d42/d66/dd/d10/d26/d50/d54/f59 [2685563,122837] 0 2024-02-19T19:07:37.896 INFO:tasks.workunit.client.1.smithi142.stdout:1/908: dread d5/d7/d23/dab/fdf [0,4194304] 0 2024-02-19T19:07:37.897 INFO:tasks.workunit.client.1.smithi142.stdout:6/714: truncate d2/f5f 2294342 0 2024-02-19T19:07:37.897 INFO:tasks.workunit.client.1.smithi142.stdout:6/715: creat d2/d1f/d20/d31/ff3 x:0 0 0 2024-02-19T19:07:37.897 INFO:tasks.workunit.client.1.smithi142.stdout:6/716: truncate d2/d17/d33/d42/da2/da7/d55/d69/fb2 1436227 0 2024-02-19T19:07:37.899 INFO:tasks.workunit.client.1.smithi142.stdout:8/788: rename d9/dd/de/d2d/d2e/d49/d50/f7b to d9/dd/de/d14/d65/d94/dec/ffb 0 2024-02-19T19:07:37.901 INFO:tasks.workunit.client.1.smithi142.stdout:9/746: mknod db/d10/d32/d91/ccb 0 2024-02-19T19:07:37.901 INFO:tasks.workunit.client.1.smithi142.stdout:9/747: chown db/d10/d27/db9 0 1 2024-02-19T19:07:37.903 INFO:tasks.workunit.client.1.smithi142.stdout:1/909: dread d5/d37/d6c/fa8 [0,4194304] 0 2024-02-19T19:07:37.903 INFO:tasks.workunit.client.1.smithi142.stdout:1/910: chown d5/d37/d6c/d75/da2/f121 1 1 2024-02-19T19:07:37.903 INFO:tasks.workunit.client.1.smithi142.stdout:1/911: readlink d5/d7/d4a/d53/d6a/l119 0 2024-02-19T19:07:37.904 INFO:tasks.workunit.client.1.smithi142.stdout:5/793: link d5/dd/d8/d31/d4d/d75/ccb d5/dd/d8/d31/c111 0 2024-02-19T19:07:37.905 INFO:tasks.workunit.client.1.smithi142.stdout:4/890: creat d4/d1d/d42/d66/dd/d10/d26/d50/f12d x:0 0 0 2024-02-19T19:07:37.910 INFO:tasks.workunit.client.1.smithi142.stdout:6/717: mknod d2/d1f/d20/d31/d62/cf4 0 2024-02-19T19:07:37.910 INFO:tasks.workunit.client.1.smithi142.stdout:6/718: truncate d2/d1f/d5c/fbe 275463 0 2024-02-19T19:07:37.912 INFO:tasks.workunit.client.1.smithi142.stdout:8/789: creat d9/da8/ffc x:0 0 0 2024-02-19T19:07:37.913 INFO:tasks.workunit.client.1.smithi142.stdout:9/748: symlink db/d10/lcc 0 2024-02-19T19:07:37.913 INFO:tasks.workunit.client.1.smithi142.stdout:9/749: write db/d10/d22/f50 [2181130,19837] 0 2024-02-19T19:07:37.913 INFO:tasks.workunit.client.1.smithi142.stdout:1/912: mknod d5/d37/d6c/d75/da7/c13b 0 2024-02-19T19:07:37.915 INFO:tasks.workunit.client.1.smithi142.stdout:4/891: unlink d4/d1d/d42/d66/d12/d2d/d2a/d84/fd0 0 2024-02-19T19:07:37.916 INFO:tasks.workunit.client.1.smithi142.stdout:4/892: write d4/d14/f2f [251223,76788] 0 2024-02-19T19:07:37.916 INFO:tasks.workunit.client.1.smithi142.stdout:4/893: write d4/d1d/d42/d66/dd/d10/d3e/f81 [793918,119591] 0 2024-02-19T19:07:37.916 INFO:tasks.workunit.client.1.smithi142.stdout:9/750: rename db/d10/d27/f42 to db/d10/d22/d24/fcd 0 2024-02-19T19:07:37.918 INFO:tasks.workunit.client.1.smithi142.stdout:1/913: link d5/d1a/f47 d5/d7/d23/da4/f13c 0 2024-02-19T19:07:37.918 INFO:tasks.workunit.client.1.smithi142.stdout:1/914: stat d5/d7/d23/c13a 0 2024-02-19T19:07:37.918 INFO:tasks.workunit.client.1.smithi142.stdout:1/915: creat d5/d7/d4a/f13d x:0 0 0 2024-02-19T19:07:37.918 INFO:tasks.workunit.client.1.smithi142.stdout:1/916: truncate d5/d77/da9/dae/db2/dea/f10a 1348724 0 2024-02-19T19:07:37.918 INFO:tasks.workunit.client.1.smithi142.stdout:9/751: write db/d10/d32/d3f/f7e [519229,105475] 0 2024-02-19T19:07:37.919 INFO:tasks.workunit.client.1.smithi142.stdout:3/917: sync 2024-02-19T19:07:37.919 INFO:tasks.workunit.client.1.smithi142.stdout:4/894: mkdir d4/d1d/d42/d66/dd/dac/d12e 0 2024-02-19T19:07:37.919 INFO:tasks.workunit.client.1.smithi142.stdout:3/918: write d1d/d1e/d2e/d37/d81/db7/f10a [643115,6300] 0 2024-02-19T19:07:37.919 INFO:tasks.workunit.client.1.smithi142.stdout:3/919: chown d1d/d1e/d2e/dee/dc1/dfb 1 1 2024-02-19T19:07:37.921 INFO:tasks.workunit.client.1.smithi142.stdout:1/917: truncate d5/d7/d4a/d53/d6a/fa5 335547 0 2024-02-19T19:07:37.921 INFO:tasks.workunit.client.1.smithi142.stdout:1/918: creat d5/d77/f13e x:0 0 0 2024-02-19T19:07:37.921 INFO:tasks.workunit.client.1.smithi142.stdout:1/919: chown d5/d7/d23 5511849 1 2024-02-19T19:07:37.922 INFO:tasks.workunit.client.1.smithi142.stdout:9/752: symlink db/d10/d27/d2f/lce 0 2024-02-19T19:07:37.922 INFO:tasks.workunit.client.1.smithi142.stdout:9/753: creat db/d10/d27/db9/fcf x:0 0 0 2024-02-19T19:07:37.924 INFO:tasks.workunit.client.1.smithi142.stdout:4/895: rename d4/d1d/d42/d66/d2c/lc6 to d4/d1d/d42/d66/l12f 0 2024-02-19T19:07:37.924 INFO:tasks.workunit.client.1.smithi142.stdout:4/896: readlink d4/d1d/d42/d66/l10e 0 2024-02-19T19:07:37.925 INFO:tasks.workunit.client.1.smithi142.stdout:3/920: getdents d1d/d1e/d2e/d50/d7c/da7/d52/d71/ddd 0 2024-02-19T19:07:37.925 INFO:tasks.workunit.client.1.smithi142.stdout:3/921: chown d1d/d1e/d2e/ded 137969449 1 2024-02-19T19:07:37.925 INFO:tasks.workunit.client.1.smithi142.stdout:3/922: dread - d1d/d1e/d2e/d50/d7c/da7/dc8/f10c zero size 2024-02-19T19:07:37.925 INFO:tasks.workunit.client.1.smithi142.stdout:8/790: write d9/dd/de/d2d/d2e/d49/d74/f8f [848147,95110] 0 2024-02-19T19:07:37.926 INFO:tasks.workunit.client.1.smithi142.stdout:8/791: readlink d9/dd/de/d2d/l9a 0 2024-02-19T19:07:37.926 INFO:tasks.workunit.client.1.smithi142.stdout:8/792: truncate d9/dd/de/d14/d65/fb2 4553210 0 2024-02-19T19:07:37.927 INFO:tasks.workunit.client.1.smithi142.stdout:1/920: truncate d5/d7/d4a/d53/d6a/f7e 3232661 0 2024-02-19T19:07:37.927 INFO:tasks.workunit.client.1.smithi142.stdout:1/921: write d5/d7/d34/d6f/f7b [192723,95681] 0 2024-02-19T19:07:37.928 INFO:tasks.workunit.client.1.smithi142.stdout:1/922: chown d5/d37/d6c 176347 1 2024-02-19T19:07:37.928 INFO:tasks.workunit.client.1.smithi142.stdout:0/669: sync 2024-02-19T19:07:37.928 INFO:tasks.workunit.client.1.smithi142.stdout:2/655: sync 2024-02-19T19:07:37.928 INFO:tasks.workunit.client.1.smithi142.stdout:0/670: fdatasync d23/d7d/f92 0 2024-02-19T19:07:37.928 INFO:tasks.workunit.client.1.smithi142.stdout:0/671: truncate d23/d28/f34 5188005 0 2024-02-19T19:07:37.928 INFO:tasks.workunit.client.1.smithi142.stdout:0/672: fdatasync d23/d28/d41/fa2 0 2024-02-19T19:07:37.929 INFO:tasks.workunit.client.1.smithi142.stdout:5/794: dwrite d5/dd/d8/d31/d4d/d60/f73 [0,4194304] 0 2024-02-19T19:07:37.929 INFO:tasks.workunit.client.1.smithi142.stdout:5/795: write d5/dd/df/f6b [731314,52748] 0 2024-02-19T19:07:37.929 INFO:tasks.workunit.client.1.smithi142.stdout:3/923: getdents d1d/d1e/d2e/d50/d7c/da7/d52/d71/dc0 0 2024-02-19T19:07:37.930 INFO:tasks.workunit.client.1.smithi142.stdout:1/923: unlink d5/d7/c86 0 2024-02-19T19:07:37.931 INFO:tasks.workunit.client.1.smithi142.stdout:9/754: dread db/d10/d32/d3f/d5f/fa8 [0,4194304] 0 2024-02-19T19:07:37.931 INFO:tasks.workunit.client.1.smithi142.stdout:0/673: mknod d23/d28/d2d/d51/dc9/d58/dc1/cd5 0 2024-02-19T19:07:37.933 INFO:tasks.workunit.client.1.smithi142.stdout:5/796: rmdir d5/dd/d8/d2a/d57 39 2024-02-19T19:07:37.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/719: dwrite d2/f14 [0,4194304] 0 2024-02-19T19:07:37.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/720: chown d2/d17/d33/d42/da2/da7/fe4 308335 1 2024-02-19T19:07:37.934 INFO:tasks.workunit.client.1.smithi142.stdout:6/721: creat d2/d1f/d45/ff5 x:0 0 0 2024-02-19T19:07:37.935 INFO:tasks.workunit.client.1.smithi142.stdout:1/924: mknod d5/d77/da9/dae/deb/c13f 0 2024-02-19T19:07:37.937 INFO:tasks.workunit.client.1.smithi142.stdout:9/755: creat db/d10/d27/d2f/dc5/fd0 x:0 0 0 2024-02-19T19:07:37.939 INFO:tasks.workunit.client.1.smithi142.stdout:8/793: write d9/dd/de/f8c [2307880,125487] 0 2024-02-19T19:07:37.941 INFO:tasks.workunit.client.1.smithi142.stdout:0/674: unlink d23/d28/d2d/d51/dc9/d58/lc6 0 2024-02-19T19:07:37.941 INFO:tasks.workunit.client.1.smithi142.stdout:0/675: chown d23/l2e 29109295 1 2024-02-19T19:07:37.941 INFO:tasks.workunit.client.1.smithi142.stdout:0/676: write d23/d28/d41/fa2 [103209,110712] 0 2024-02-19T19:07:37.942 INFO:tasks.workunit.client.1.smithi142.stdout:5/797: truncate d5/dd/df/d15/fb1 3744542 0 2024-02-19T19:07:37.942 INFO:tasks.workunit.client.1.smithi142.stdout:5/798: chown d5/dd/d8/dd4 5431 1 2024-02-19T19:07:37.942 INFO:tasks.workunit.client.1.smithi142.stdout:7/665: sync 2024-02-19T19:07:37.944 INFO:tasks.workunit.client.1.smithi142.stdout:2/656: dwrite d3/d35/f37 [0,4194304] 0 2024-02-19T19:07:37.948 INFO:tasks.workunit.client.1.smithi142.stdout:3/924: getdents d1d 0 2024-02-19T19:07:37.949 INFO:tasks.workunit.client.1.smithi142.stdout:3/925: fsync d1d/d1e/d2e/d50/d7c/da7/f5c 0 2024-02-19T19:07:37.961 INFO:tasks.workunit.client.1.smithi142.stdout:9/756: dwrite db/d10/d22/f37 [4194304,4194304] 0 2024-02-19T19:07:37.961 INFO:tasks.workunit.client.1.smithi142.stdout:9/757: chown db/d10/d22 1690860 1 2024-02-19T19:07:37.961 INFO:tasks.workunit.client.1.smithi142.stdout:6/722: mkdir d2/d1f/d4d/d60/df6 0 2024-02-19T19:07:37.961 INFO:tasks.workunit.client.1.smithi142.stdout:9/758: write db/d10/fbd [296289,100112] 0 2024-02-19T19:07:37.961 INFO:tasks.workunit.client.1.smithi142.stdout:8/794: dwrite d9/dd/d44/d79/f25 [0,4194304] 0 2024-02-19T19:07:37.961 INFO:tasks.workunit.client.1.smithi142.stdout:8/795: fsync d9/dd/de/d2d/d2e/d73/d77/fa6 0 2024-02-19T19:07:37.961 INFO:tasks.workunit.client.1.smithi142.stdout:8/796: write d9/dd/de/d2d/d2e/d49/d50/f64 [1487800,40264] 0 2024-02-19T19:07:37.961 INFO:tasks.workunit.client.1.smithi142.stdout:1/925: mkdir d5/d1a/d59/d140 0 2024-02-19T19:07:37.963 INFO:tasks.workunit.client.1.smithi142.stdout:0/677: mknod d23/d32/d8a/cd6 0 2024-02-19T19:07:37.963 INFO:tasks.workunit.client.1.smithi142.stdout:0/678: fdatasync d23/d28/d41/f69 0 2024-02-19T19:07:37.963 INFO:tasks.workunit.client.1.smithi142.stdout:5/799: truncate d5/dd/d5f/fc5 2035571 0 2024-02-19T19:07:37.966 INFO:tasks.workunit.client.1.smithi142.stdout:7/666: link d0/d1b/d21/d24/d29/l6f d0/d1b/d21/d24/d5e/d65/d86/le2 0 2024-02-19T19:07:37.968 INFO:tasks.workunit.client.1.smithi142.stdout:2/657: rename d3/d35/d53/l54 to d3/db/ld2 0 2024-02-19T19:07:37.969 INFO:tasks.workunit.client.1.smithi142.stdout:3/926: mkdir d1d/d1e/d2e/dee/da2/d12a 0 2024-02-19T19:07:37.971 INFO:tasks.workunit.client.1.smithi142.stdout:9/759: link db/d10/d22/c57 db/d10/d27/d2f/dba/cd1 0 2024-02-19T19:07:37.973 INFO:tasks.workunit.client.1.smithi142.stdout:1/926: symlink d5/d7/d34/l141 0 2024-02-19T19:07:37.973 INFO:tasks.workunit.client.1.smithi142.stdout:8/797: dread d9/dd/de/d2d/d2e/d49/d50/f72 [0,4194304] 0 2024-02-19T19:07:37.974 INFO:tasks.workunit.client.1.smithi142.stdout:5/800: creat d5/dd/d8/d2a/d57/f112 x:0 0 0 2024-02-19T19:07:37.974 INFO:tasks.workunit.client.1.smithi142.stdout:7/667: read d0/d1b/d21/d24/ddf/f81 [2158411,123475] 0 2024-02-19T19:07:37.975 INFO:tasks.workunit.client.1.smithi142.stdout:7/668: chown d0/d1b/d21 2581236 1 2024-02-19T19:07:37.975 INFO:tasks.workunit.client.1.smithi142.stdout:7/669: dread - d0/d1b/d9d/fd8 zero size 2024-02-19T19:07:37.977 INFO:tasks.workunit.client.1.smithi142.stdout:2/658: rename d3/db/fc9 to d3/db/d29/d4c/d4e/d9a/da9/fd3 0 2024-02-19T19:07:37.979 INFO:tasks.workunit.client.1.smithi142.stdout:3/927: symlink d1d/d1e/d2e/dee/da2/d12a/l12b 0 2024-02-19T19:07:37.979 INFO:tasks.workunit.client.1.smithi142.stdout:3/928: fsync d1d/d1e/d2e/dee/dc1/fd8 0 2024-02-19T19:07:37.979 INFO:tasks.workunit.client.1.smithi142.stdout:3/929: write d1d/d1e/d2e/d37/d81/dbc/fdf [1732096,115894] 0 2024-02-19T19:07:37.979 INFO:tasks.workunit.client.1.smithi142.stdout:3/930: creat d1d/d1e/d2e/d37/d81/db7/f12c x:0 0 0 2024-02-19T19:07:37.979 INFO:tasks.workunit.client.1.smithi142.stdout:6/723: link d2/d1e/d35/d66/d8d/c6d d2/d17/d33/d42/da2/da7/de6/cf7 0 2024-02-19T19:07:37.982 INFO:tasks.workunit.client.1.smithi142.stdout:5/801: read d5/dd/d8/d31/d4d/d8d/fcc [1435603,130692] 0 2024-02-19T19:07:37.984 INFO:tasks.workunit.client.1.smithi142.stdout:1/927: unlink d5/f68 0 2024-02-19T19:07:37.984 INFO:tasks.workunit.client.1.smithi142.stdout:1/928: creat d5/d7/d4a/f142 x:0 0 0 2024-02-19T19:07:37.984 INFO:tasks.workunit.client.1.smithi142.stdout:1/929: creat d5/d7/d23/da4/f143 x:0 0 0 2024-02-19T19:07:37.984 INFO:tasks.workunit.client.1.smithi142.stdout:1/930: chown d5/d7/d23/ca3 396 1 2024-02-19T19:07:37.985 INFO:tasks.workunit.client.1.smithi142.stdout:9/760: rename db/d10/d22/d24/d3d/d89 to db/d10/d22/d24/d41/dd2 0 2024-02-19T19:07:37.987 INFO:tasks.workunit.client.1.smithi142.stdout:3/931: symlink d1d/d1e/d2e/dee/da2/df1/l12d 0 2024-02-19T19:07:37.990 INFO:tasks.workunit.client.1.smithi142.stdout:6/724: write d2/d1f/d20/d31/d62/f72 [2553157,126797] 0 2024-02-19T19:07:37.990 INFO:tasks.workunit.client.1.smithi142.stdout:6/725: fdatasync d2/d1f/d20/d31/fac 0 2024-02-19T19:07:37.991 INFO:tasks.workunit.client.1.smithi142.stdout:1/931: rmdir d5/d37/d49 39 2024-02-19T19:07:37.994 INFO:tasks.workunit.client.1.smithi142.stdout:2/659: symlink d3/d35/ld4 0 2024-02-19T19:07:37.996 INFO:tasks.workunit.client.1.smithi142.stdout:6/726: creat d2/d17/d33/d39/ff8 x:0 0 0 2024-02-19T19:07:37.996 INFO:tasks.workunit.client.1.smithi142.stdout:9/761: dread db/d10/d7d/f78 [0,4194304] 0 2024-02-19T19:07:37.996 INFO:tasks.workunit.client.1.smithi142.stdout:6/727: dread - d2/d1f/d56/fad zero size 2024-02-19T19:07:37.996 INFO:tasks.workunit.client.1.smithi142.stdout:9/762: stat db/d10/d22/d24/f92 0 2024-02-19T19:07:37.997 INFO:tasks.workunit.client.1.smithi142.stdout:8/798: rename d9/dd/de/d14/d65/db1/lb5 to d9/dd/de/lfd 0 2024-02-19T19:07:37.997 INFO:tasks.workunit.client.1.smithi142.stdout:8/799: chown d9/dd/de/d2d/d2e/l2f 1064907 1 2024-02-19T19:07:37.999 INFO:tasks.workunit.client.1.smithi142.stdout:3/932: dread d1d/d1e/d2e/d37/d6c/da9/f9f [0,4194304] 0 2024-02-19T19:07:37.999 INFO:tasks.workunit.client.1.smithi142.stdout:3/933: readlink d1d/d1e/d2e/dee/l7d 0 2024-02-19T19:07:37.999 INFO:tasks.workunit.client.1.smithi142.stdout:3/934: chown d1d/d1e/d2e/f43 267930855 1 2024-02-19T19:07:37.999 INFO:tasks.workunit.client.1.smithi142.stdout:3/935: stat d1d/d1e/d2e/d50/d7c/da7/d52/d5a/f6d 0 2024-02-19T19:07:38.000 INFO:tasks.workunit.client.1.smithi142.stdout:5/802: dwrite d5/dd/d8/d2a/d93/fff [0,4194304] 0 2024-02-19T19:07:38.000 INFO:tasks.workunit.client.1.smithi142.stdout:7/670: rename d0/d13/d1e/f5c to d0/d1b/d21/d24/d29/d44/d49/d7a/fe3 0 2024-02-19T19:07:38.004 INFO:tasks.workunit.client.1.smithi142.stdout:3/936: creat d1d/d1e/d2e/d50/d7c/da7/d52/d71/f12e x:0 0 0 2024-02-19T19:07:38.004 INFO:tasks.workunit.client.1.smithi142.stdout:3/937: readlink d1d/d1e/d2e/dee/da2/df1/lf7 0 2024-02-19T19:07:38.004 INFO:tasks.workunit.client.1.smithi142.stdout:1/932: dread d5/f38 [0,4194304] 0 2024-02-19T19:07:38.009 INFO:tasks.workunit.client.1.smithi142.stdout:5/803: mkdir d5/dd/d8/d31/d4d/d8d/d113 0 2024-02-19T19:07:38.009 INFO:tasks.workunit.client.1.smithi142.stdout:5/804: chown d5/dd/df/d22/c9f 7 1 2024-02-19T19:07:38.010 INFO:tasks.workunit.client.1.smithi142.stdout:3/938: dread d1d/f41 [0,4194304] 0 2024-02-19T19:07:38.010 INFO:tasks.workunit.client.1.smithi142.stdout:3/939: fdatasync d1d/d1e/d2e/d50/d7c/da7/d3a/d57/f59 0 2024-02-19T19:07:38.010 INFO:tasks.workunit.client.1.smithi142.stdout:6/728: dread d2/d1f/d56/f8e [0,4194304] 0 2024-02-19T19:07:38.012 INFO:tasks.workunit.client.1.smithi142.stdout:2/660: dwrite d3/df/f31 [0,4194304] 0 2024-02-19T19:07:38.012 INFO:tasks.workunit.client.1.smithi142.stdout:1/933: mknod d5/d77/da9/dae/c144 0 2024-02-19T19:07:38.012 INFO:tasks.workunit.client.1.smithi142.stdout:1/934: dread - d5/d7/d23/d41/fcc zero size 2024-02-19T19:07:38.012 INFO:tasks.workunit.client.1.smithi142.stdout:1/935: write d5/d77/da9/dae/f126 [497545,105106] 0 2024-02-19T19:07:38.013 INFO:tasks.workunit.client.1.smithi142.stdout:1/936: getdents d5/d1a/d33/dce/de0 0 2024-02-19T19:07:38.014 INFO:tasks.workunit.client.1.smithi142.stdout:5/805: symlink d5/dd/d8/d31/d4d/d75/d9e/dfc/l114 0 2024-02-19T19:07:38.016 INFO:tasks.workunit.client.1.smithi142.stdout:6/729: creat d2/d1f/d4d/d60/d87/ff9 x:0 0 0 2024-02-19T19:07:38.016 INFO:tasks.workunit.client.1.smithi142.stdout:6/730: dread - d2/d1f/d45/ff5 zero size 2024-02-19T19:07:38.017 INFO:tasks.workunit.client.1.smithi142.stdout:7/671: dread d0/f16 [0,4194304] 0 2024-02-19T19:07:38.017 INFO:tasks.workunit.client.1.smithi142.stdout:8/800: dwrite d9/dd/de/d14/d65/fe1 [0,4194304] 0 2024-02-19T19:07:38.019 INFO:tasks.workunit.client.1.smithi142.stdout:2/661: unlink d3/db/l8f 0 2024-02-19T19:07:38.020 INFO:tasks.workunit.client.1.smithi142.stdout:5/806: symlink d5/dd/d8/d31/d4d/d60/l115 0 2024-02-19T19:07:38.022 INFO:tasks.workunit.client.1.smithi142.stdout:9/763: rename db/d10/d32/d3f/d5f to db/d10/d22/d24/d41/dd2/dd3 0 2024-02-19T19:07:38.022 INFO:tasks.workunit.client.1.smithi142.stdout:9/764: fsync db/d10/d22/f9d 0 2024-02-19T19:07:38.024 INFO:tasks.workunit.client.1.smithi142.stdout:6/731: truncate d2/d29/d47/f71 4147848 0 2024-02-19T19:07:38.024 INFO:tasks.workunit.client.1.smithi142.stdout:6/732: chown d2/d1f/d20/d31/d62/cf4 158 1 2024-02-19T19:07:38.026 INFO:tasks.workunit.client.1.smithi142.stdout:5/807: dread d5/dd/d8/d31/d4d/d8d/fcc [0,4194304] 0 2024-02-19T19:07:38.029 INFO:tasks.workunit.client.1.smithi142.stdout:2/662: symlink d3/d4d/d9f/ld5 0 2024-02-19T19:07:38.032 INFO:tasks.workunit.client.1.smithi142.stdout:3/940: rename d1d/d1e/d2e/dee/cbf to d1d/d1e/d2e/dee/d8d/c12f 0 2024-02-19T19:07:38.033 INFO:tasks.workunit.client.1.smithi142.stdout:3/941: write d1d/d1e/f55 [784457,116911] 0 2024-02-19T19:07:38.033 INFO:tasks.workunit.client.1.smithi142.stdout:6/733: dread d2/d17/f7a [0,4194304] 0 2024-02-19T19:07:38.033 INFO:tasks.workunit.client.1.smithi142.stdout:9/765: creat db/d10/d27/d2f/d4c/d54/fd4 x:0 0 0 2024-02-19T19:07:38.034 INFO:tasks.workunit.client.1.smithi142.stdout:9/766: chown db/d10/d22/d24/d41/dd2 25689 1 2024-02-19T19:07:38.035 INFO:tasks.workunit.client.1.smithi142.stdout:5/808: truncate d5/dd/d8/f3d 304990 0 2024-02-19T19:07:38.038 INFO:tasks.workunit.client.1.smithi142.stdout:1/937: rename d5/d7/d23/d2c/f11b to d5/d77/da9/dae/db2/dea/f145 0 2024-02-19T19:07:38.039 INFO:tasks.workunit.client.1.smithi142.stdout:2/663: write d3/df/f31 [2167799,70612] 0 2024-02-19T19:07:38.039 INFO:tasks.workunit.client.1.smithi142.stdout:2/664: write d3/db/d29/d6d/d59/f78 [539989,25697] 0 2024-02-19T19:07:38.039 INFO:tasks.workunit.client.1.smithi142.stdout:3/942: link d1d/d1e/d2e/dee/d91/fa5 d1d/d1e/d2e/dee/d91/f130 0 2024-02-19T19:07:38.039 INFO:tasks.workunit.client.1.smithi142.stdout:3/943: chown d1d/d1e/d2e/cba 0 1 2024-02-19T19:07:38.040 INFO:tasks.workunit.client.1.smithi142.stdout:6/734: symlink d2/d17/d33/d42/da2/da7/d55/dc0/lfa 0 2024-02-19T19:07:38.041 INFO:tasks.workunit.client.1.smithi142.stdout:9/767: mknod db/d10/d22/d24/d41/dc8/cd5 0 2024-02-19T19:07:38.042 INFO:tasks.workunit.client.1.smithi142.stdout:9/768: readlink db/l21 0 2024-02-19T19:07:38.042 INFO:tasks.workunit.client.1.smithi142.stdout:7/672: dwrite d0/d1b/d21/d24/d5e/f63 [0,4194304] 0 2024-02-19T19:07:38.042 INFO:tasks.workunit.client.1.smithi142.stdout:8/801: dwrite d9/f7e [0,4194304] 0 2024-02-19T19:07:38.042 INFO:tasks.workunit.client.1.smithi142.stdout:1/938: mkdir d5/d77/da9/dae/db2/dea/d146 0 2024-02-19T19:07:38.046 INFO:tasks.workunit.client.1.smithi142.stdout:2/665: unlink d3/db/d29/d4c/d4e/d9a/da9/cbc 0 2024-02-19T19:07:38.047 INFO:tasks.workunit.client.1.smithi142.stdout:6/735: creat d2/d17/ffb x:0 0 0 2024-02-19T19:07:38.049 INFO:tasks.workunit.client.1.smithi142.stdout:9/769: mknod db/d10/d22/d24/d41/d99/cd6 0 2024-02-19T19:07:38.050 INFO:tasks.workunit.client.1.smithi142.stdout:7/673: mkdir d0/d13/de4 0 2024-02-19T19:07:38.055 INFO:tasks.workunit.client.1.smithi142.stdout:8/802: truncate f7 745613 0 2024-02-19T19:07:38.060 INFO:tasks.workunit.client.1.smithi142.stdout:2/666: mkdir d3/d4d/d5f/d7c/dd6 0 2024-02-19T19:07:38.061 INFO:tasks.workunit.client.1.smithi142.stdout:6/736: creat d2/d1e/d35/d66/d8d/d3e/ffc x:0 0 0 2024-02-19T19:07:38.062 INFO:tasks.workunit.client.1.smithi142.stdout:4/897: sync 2024-02-19T19:07:38.062 INFO:tasks.workunit.client.1.smithi142.stdout:0/679: sync 2024-02-19T19:07:38.063 INFO:tasks.workunit.client.1.smithi142.stdout:3/944: dwrite d1d/d1e/d2e/dee/dc1/fe1 [0,4194304] 0 2024-02-19T19:07:38.064 INFO:tasks.workunit.client.1.smithi142.stdout:1/939: dwrite d5/d77/fda [0,4194304] 0 2024-02-19T19:07:38.064 INFO:tasks.workunit.client.1.smithi142.stdout:7/674: unlink d0/d13/f70 0 2024-02-19T19:07:38.067 INFO:tasks.workunit.client.1.smithi142.stdout:9/770: rename db/d10/d27/d2f/f87 to db/d10/d32/d3f/fd7 0 2024-02-19T19:07:38.067 INFO:tasks.workunit.client.1.smithi142.stdout:8/803: write d9/dd/de/d2d/d2e/d49/d50/d59/f66 [271640,126669] 0 2024-02-19T19:07:38.067 INFO:tasks.workunit.client.1.smithi142.stdout:1/940: read d5/d7/d4a/d53/d6a/f9c [438732,71720] 0 2024-02-19T19:07:38.067 INFO:tasks.workunit.client.1.smithi142.stdout:1/941: write d5/d7/d4a/d53/d6a/fd2 [1093329,48282] 0 2024-02-19T19:07:38.067 INFO:tasks.workunit.client.1.smithi142.stdout:1/942: write d5/d73/f8b [1622267,56245] 0 2024-02-19T19:07:38.067 INFO:tasks.workunit.client.1.smithi142.stdout:1/943: fsync d5/d7/d4a/d53/d6a/f65 0 2024-02-19T19:07:38.068 INFO:tasks.workunit.client.1.smithi142.stdout:4/898: mkdir d4/d14/d31/d43/d130 0 2024-02-19T19:07:38.068 INFO:tasks.workunit.client.1.smithi142.stdout:4/899: fdatasync d4/d1d/d42/d66/dd/d10/d3e/d68/f10b 0 2024-02-19T19:07:38.068 INFO:tasks.workunit.client.1.smithi142.stdout:4/900: write d4/d1c/dae/dcb/ff6 [280182,123075] 0 2024-02-19T19:07:38.068 INFO:tasks.workunit.client.1.smithi142.stdout:4/901: write d4/d1d/d42/d66/dd/d10/d3b/d3f/fa9 [1035614,23527] 0 2024-02-19T19:07:38.069 INFO:tasks.workunit.client.1.smithi142.stdout:4/902: write d4/d1d/d42/d66/d12/fc0 [1013185,78726] 0 2024-02-19T19:07:38.069 INFO:tasks.workunit.client.1.smithi142.stdout:0/680: symlink d23/d28/d2d/d51/dc9/d58/db6/ld7 0 2024-02-19T19:07:38.070 INFO:tasks.workunit.client.1.smithi142.stdout:6/737: read d2/d17/d33/d39/f70 [151203,130136] 0 2024-02-19T19:07:38.072 INFO:tasks.workunit.client.1.smithi142.stdout:3/945: symlink d1d/d1e/d2e/d50/d83/l131 0 2024-02-19T19:07:38.078 INFO:tasks.workunit.client.1.smithi142.stdout:7/675: rename d0/d1b/d21/d24/cc8 to d0/d1b/d21/d24/ce5 0 2024-02-19T19:07:38.078 INFO:tasks.workunit.client.1.smithi142.stdout:7/676: dread - d0/d1b/d9d/fd8 zero size 2024-02-19T19:07:38.080 INFO:tasks.workunit.client.1.smithi142.stdout:9/771: link db/d10/d22/d24/d41/dd2/dd3/c82 db/d10/d32/cd8 0 2024-02-19T19:07:38.084 INFO:tasks.workunit.client.1.smithi142.stdout:1/944: dread d5/d7/d4a/d53/fc3 [0,4194304] 0 2024-02-19T19:07:38.086 INFO:tasks.workunit.client.1.smithi142.stdout:8/804: symlink d9/dd/de/d2d/d2e/d73/d77/lfe 0 2024-02-19T19:07:38.089 INFO:tasks.workunit.client.1.smithi142.stdout:4/903: creat d4/d1d/d42/d66/d2c/daa/f131 x:0 0 0 2024-02-19T19:07:38.089 INFO:tasks.workunit.client.1.smithi142.stdout:4/904: fdatasync d4/d1d/d42/d66/dd/d10/d26/df7/f103 0 2024-02-19T19:07:38.092 INFO:tasks.workunit.client.1.smithi142.stdout:9/772: symlink db/d10/d27/d2f/d4c/d59/ld9 0 2024-02-19T19:07:38.093 INFO:tasks.workunit.client.1.smithi142.stdout:9/773: dread db/d10/d22/d24/d41/dd2/f8c [0,4194304] 0 2024-02-19T19:07:38.094 INFO:tasks.workunit.client.1.smithi142.stdout:8/805: rename d9/dd/de/d2d/d2e/d49/d58/f95 to d9/dd/de/d14/d65/db1/fff 0 2024-02-19T19:07:38.094 INFO:tasks.workunit.client.1.smithi142.stdout:8/806: write d9/dd/de/d14/d65/db1/fff [1017322,114385] 0 2024-02-19T19:07:38.094 INFO:tasks.workunit.client.1.smithi142.stdout:8/807: truncate d9/dd/de/d2d/d2e/d73/ff1 1704901 0 2024-02-19T19:07:38.094 INFO:tasks.workunit.client.1.smithi142.stdout:4/905: stat d4/d1d/d42/d66/d12/d79/d8c/l9d 0 2024-02-19T19:07:38.098 INFO:tasks.workunit.client.1.smithi142.stdout:4/906: rename d4/d1d/c110 to d4/d14/d31/d43/c132 0 2024-02-19T19:07:38.099 INFO:tasks.workunit.client.1.smithi142.stdout:8/808: dread d9/dd/de/d2d/d2e/d49/d50/f64 [0,4194304] 0 2024-02-19T19:07:38.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/907: rmdir d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f 39 2024-02-19T19:07:38.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/908: getdents d4/d1d/d42/d66/d12/d79/d8c/d119/da2/db3 0 2024-02-19T19:07:38.104 INFO:tasks.workunit.client.1.smithi142.stdout:4/909: fdatasync d4/d1d/d42/d66/d2c/fa5 0 2024-02-19T19:07:38.104 INFO:tasks.workunit.client.1.smithi142.stdout:9/774: write db/d10/d22/f37 [5599983,55078] 0 2024-02-19T19:07:38.106 INFO:tasks.workunit.client.1.smithi142.stdout:9/775: creat db/d10/d22/d24/d41/dd2/fda x:0 0 0 2024-02-19T19:07:38.109 INFO:tasks.workunit.client.1.smithi142.stdout:9/776: rmdir db/d10/d32/d91 39 2024-02-19T19:07:38.109 INFO:tasks.workunit.client.1.smithi142.stdout:8/809: write d9/dd/de/d14/d65/fe1 [1026313,27173] 0 2024-02-19T19:07:38.109 INFO:tasks.workunit.client.1.smithi142.stdout:9/777: creat db/d10/d32/fdb x:0 0 0 2024-02-19T19:07:38.113 INFO:tasks.workunit.client.1.smithi142.stdout:8/810: rmdir d9/dd/de/d2d/d2e/d49/d50 39 2024-02-19T19:07:38.113 INFO:tasks.workunit.client.1.smithi142.stdout:8/811: fsync d9/dd/de/d2d/d2e/d49/f70 0 2024-02-19T19:07:38.114 INFO:tasks.workunit.client.1.smithi142.stdout:8/812: dread d9/dd/de/f45 [0,4194304] 0 2024-02-19T19:07:38.114 INFO:tasks.workunit.client.1.smithi142.stdout:9/778: mknod db/d10/d22/d24/d41/dd2/dad/dc3/cdc 0 2024-02-19T19:07:38.117 INFO:tasks.workunit.client.1.smithi142.stdout:8/813: rename d9/da8/fb6 to d9/dd/de/d2d/d2e/d49/d50/d59/da9/f100 0 2024-02-19T19:07:38.117 INFO:tasks.workunit.client.1.smithi142.stdout:8/814: dread - d9/dd/de/d2d/d2e/d49/f88 zero size 2024-02-19T19:07:38.118 INFO:tasks.workunit.client.1.smithi142.stdout:0/681: dwrite f22 [8388608,4194304] 0 2024-02-19T19:07:38.119 INFO:tasks.workunit.client.1.smithi142.stdout:9/779: link db/d10/d22/d24/d41/d99/cd6 db/d10/d27/d2f/d4c/cdd 0 2024-02-19T19:07:38.120 INFO:tasks.workunit.client.1.smithi142.stdout:9/780: dread db/d10/d27/f6d [0,4194304] 0 2024-02-19T19:07:38.122 INFO:tasks.workunit.client.1.smithi142.stdout:0/682: rename d23/d28/d41/f75 to d23/d28/fd8 0 2024-02-19T19:07:38.122 INFO:tasks.workunit.client.1.smithi142.stdout:0/683: read d23/d28/d2d/d51/dc9/d58/f5d [2015759,28820] 0 2024-02-19T19:07:38.123 INFO:tasks.workunit.client.1.smithi142.stdout:9/781: symlink db/da2/lde 0 2024-02-19T19:07:38.124 INFO:tasks.workunit.client.1.smithi142.stdout:9/782: chown db/d10/d22/d24/d3d/l43 13292 1 2024-02-19T19:07:38.126 INFO:tasks.workunit.client.1.smithi142.stdout:6/738: dwrite d2/d17/d33/d42/da2/fb4 [0,4194304] 0 2024-02-19T19:07:38.126 INFO:tasks.workunit.client.1.smithi142.stdout:3/946: dwrite d1d/db6/fb8 [0,4194304] 0 2024-02-19T19:07:38.126 INFO:tasks.workunit.client.1.smithi142.stdout:7/677: dwrite d0/d13/d72/f45 [0,4194304] 0 2024-02-19T19:07:38.127 INFO:tasks.workunit.client.1.smithi142.stdout:4/910: dwrite d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba/dd2/ff3 [0,4194304] 0 2024-02-19T19:07:38.127 INFO:tasks.workunit.client.1.smithi142.stdout:4/911: read - d4/fb7 zero size 2024-02-19T19:07:38.127 INFO:tasks.workunit.client.1.smithi142.stdout:1/945: dwrite d5/d37/d6c/fa0 [0,4194304] 0 2024-02-19T19:07:38.131 INFO:tasks.workunit.client.1.smithi142.stdout:6/739: symlink d2/d17/lfd 0 2024-02-19T19:07:38.131 INFO:tasks.workunit.client.1.smithi142.stdout:6/740: chown d2/d1f/d56/f6b 1759 1 2024-02-19T19:07:38.135 INFO:tasks.workunit.client.1.smithi142.stdout:9/783: write db/f84 [2973328,7973] 0 2024-02-19T19:07:38.135 INFO:tasks.workunit.client.1.smithi142.stdout:3/947: unlink d1d/f35 0 2024-02-19T19:07:38.136 INFO:tasks.workunit.client.1.smithi142.stdout:3/948: fdatasync d1d/d1e/d2e/d37/d81/db7/f10a 0 2024-02-19T19:07:38.136 INFO:tasks.workunit.client.1.smithi142.stdout:9/784: write db/f84 [1053207,95116] 0 2024-02-19T19:07:38.136 INFO:tasks.workunit.client.1.smithi142.stdout:3/949: truncate d1d/d1e/d6e/fe2 4383191 0 2024-02-19T19:07:38.140 INFO:tasks.workunit.client.1.smithi142.stdout:4/912: mkdir d4/d1d/d42/d66/dd/d10/d3b/d3f/d100/d133 0 2024-02-19T19:07:38.143 INFO:tasks.workunit.client.1.smithi142.stdout:1/946: stat d5/d37/d49/l4c 0 2024-02-19T19:07:38.151 INFO:tasks.workunit.client.1.smithi142.stdout:3/950: rename d1d/d1e/d2e/d50/c5b to d1d/d1e/d2e/dee/dc1/c132 0 2024-02-19T19:07:38.153 INFO:tasks.workunit.client.1.smithi142.stdout:9/785: creat db/fdf x:0 0 0 2024-02-19T19:07:38.153 INFO:tasks.workunit.client.1.smithi142.stdout:1/947: write d5/d7/f8a [223089,33697] 0 2024-02-19T19:07:38.155 INFO:tasks.workunit.client.1.smithi142.stdout:4/913: link d4/d1c/dae/le9 d4/d1d/d42/d66/dd/d10/d3e/d68/d87/l134 0 2024-02-19T19:07:38.155 INFO:tasks.workunit.client.1.smithi142.stdout:4/914: chown d4/d14/d31/d43/d130 223644997 1 2024-02-19T19:07:38.156 INFO:tasks.workunit.client.1.smithi142.stdout:3/951: creat d1d/d1e/d2e/dee/d91/f133 x:0 0 0 2024-02-19T19:07:38.159 INFO:tasks.workunit.client.1.smithi142.stdout:7/678: dwrite d0/d1b/f91 [0,4194304] 0 2024-02-19T19:07:38.159 INFO:tasks.workunit.client.1.smithi142.stdout:6/741: dwrite d2/d1e/d35/d66/d8d/d3e/d8c/f9f [0,4194304] 0 2024-02-19T19:07:38.159 INFO:tasks.workunit.client.1.smithi142.stdout:9/786: rename db/d10/d22/d24/d41/c97 to db/d10/d22/d24/d41/dd2/dd3/ce0 0 2024-02-19T19:07:38.160 INFO:tasks.workunit.client.1.smithi142.stdout:8/815: dwrite d9/fee [0,4194304] 0 2024-02-19T19:07:38.164 INFO:tasks.workunit.client.1.smithi142.stdout:3/952: unlink d1d/d1e/d2e/d50/d7c/da7/d52/f54 0 2024-02-19T19:07:38.164 INFO:tasks.workunit.client.1.smithi142.stdout:3/953: chown d1d/d1e/d2e/d37/d81/db7/lde 2483 1 2024-02-19T19:07:38.166 INFO:tasks.workunit.client.1.smithi142.stdout:3/954: dread d1d/d1e/d2e/d37/d6c/f7b [0,4194304] 0 2024-02-19T19:07:38.166 INFO:tasks.workunit.client.1.smithi142.stdout:7/679: mkdir d0/d13/d72/de6 0 2024-02-19T19:07:38.166 INFO:tasks.workunit.client.1.smithi142.stdout:7/680: stat d0/l17 0 2024-02-19T19:07:38.167 INFO:tasks.workunit.client.1.smithi142.stdout:1/948: dread d5/fd [0,4194304] 0 2024-02-19T19:07:38.169 INFO:tasks.workunit.client.1.smithi142.stdout:8/816: dread d9/dd/d44/d79/f39 [0,4194304] 0 2024-02-19T19:07:38.169 INFO:tasks.workunit.client.1.smithi142.stdout:6/742: creat d2/d17/d33/d42/da2/da7/dd2/dd3/ffe x:0 0 0 2024-02-19T19:07:38.172 INFO:tasks.workunit.client.1.smithi142.stdout:9/787: truncate db/f53 998989 0 2024-02-19T19:07:38.176 INFO:tasks.workunit.client.1.smithi142.stdout:4/915: dwrite d4/d1c/f2e [0,4194304] 0 2024-02-19T19:07:38.177 INFO:tasks.workunit.client.1.smithi142.stdout:7/681: creat d0/d1b/d21/d24/d29/d44/de1/fe7 x:0 0 0 2024-02-19T19:07:38.178 INFO:tasks.workunit.client.1.smithi142.stdout:7/682: read d0/d13/d72/f88 [416136,129028] 0 2024-02-19T19:07:38.178 INFO:tasks.workunit.client.1.smithi142.stdout:7/683: creat d0/d1b/d21/d24/d29/d44/d49/fe8 x:0 0 0 2024-02-19T19:07:38.178 INFO:tasks.workunit.client.1.smithi142.stdout:7/684: chown d0/d13/d72/da7/f78 39 1 2024-02-19T19:07:38.179 INFO:tasks.workunit.client.1.smithi142.stdout:3/955: read d1d/d1e/d2e/f3f [202453,23283] 0 2024-02-19T19:07:38.179 INFO:tasks.workunit.client.1.smithi142.stdout:1/949: mkdir d5/d7/d23/d41/d135/d147 0 2024-02-19T19:07:38.180 INFO:tasks.workunit.client.1.smithi142.stdout:8/817: creat d9/dd/de/d2d/d2e/d49/d50/d59/d8a/f101 x:0 0 0 2024-02-19T19:07:38.182 INFO:tasks.workunit.client.1.smithi142.stdout:6/743: link d2/d1f/d5c/d63/l9b d2/d1e/d35/lff 0 2024-02-19T19:07:38.183 INFO:tasks.workunit.client.1.smithi142.stdout:4/916: symlink d4/d1d/d42/d66/d12/d2d/d2a/l135 0 2024-02-19T19:07:38.186 INFO:tasks.workunit.client.1.smithi142.stdout:7/685: symlink d0/d1b/d21/d24/d5e/le9 0 2024-02-19T19:07:38.186 INFO:tasks.workunit.client.1.smithi142.stdout:7/686: read d0/f6b [389447,62410] 0 2024-02-19T19:07:38.189 INFO:tasks.workunit.client.1.smithi142.stdout:9/788: dwrite db/d10/d22/d24/d41/dd2/f8c [0,4194304] 0 2024-02-19T19:07:38.189 INFO:tasks.workunit.client.1.smithi142.stdout:1/950: rename d5/d7/d23/d2c/f6b to d5/d1a/f148 0 2024-02-19T19:07:38.192 INFO:tasks.workunit.client.1.smithi142.stdout:8/818: dread d9/dd/de/d14/f51 [0,4194304] 0 2024-02-19T19:07:38.192 INFO:tasks.workunit.client.1.smithi142.stdout:4/917: unlink d4/d1d/d42/d66/d12/d79/d8c/d119/da2/f123 0 2024-02-19T19:07:38.196 INFO:tasks.workunit.client.1.smithi142.stdout:9/789: rmdir db/d10/d32/d3f/db3 39 2024-02-19T19:07:38.197 INFO:tasks.workunit.client.1.smithi142.stdout:1/951: mknod d5/d7/d23/dab/dcf/c149 0 2024-02-19T19:07:38.199 INFO:tasks.workunit.client.1.smithi142.stdout:4/918: mknod d4/d1d/d42/d66/d5f/c136 0 2024-02-19T19:07:38.199 INFO:tasks.workunit.client.1.smithi142.stdout:4/919: write d4/fff [1693374,111440] 0 2024-02-19T19:07:38.199 INFO:tasks.workunit.client.1.smithi142.stdout:4/920: creat d4/d1d/d42/d66/dd/d10/d26/d50/f137 x:0 0 0 2024-02-19T19:07:38.199 INFO:tasks.workunit.client.1.smithi142.stdout:9/790: truncate db/d10/d22/d24/d41/f9b 2227593 0 2024-02-19T19:07:38.201 INFO:tasks.workunit.client.1.smithi142.stdout:8/819: dread d9/dd/de/d14/f60 [0,4194304] 0 2024-02-19T19:07:38.201 INFO:tasks.workunit.client.1.smithi142.stdout:6/744: dwrite d2/d29/d47/f71 [4194304,4194304] 0 2024-02-19T19:07:38.202 INFO:tasks.workunit.client.1.smithi142.stdout:6/745: readlink d2/lc2 0 2024-02-19T19:07:38.202 INFO:tasks.workunit.client.1.smithi142.stdout:6/746: chown d2/d17/d33/d42/da2/da7/dd2/de2 90015 1 2024-02-19T19:07:38.203 INFO:tasks.workunit.client.1.smithi142.stdout:9/791: creat db/d10/d22/d24/d41/dd2/dad/fe1 x:0 0 0 2024-02-19T19:07:38.203 INFO:tasks.workunit.client.1.smithi142.stdout:9/792: fsync db/d10/d32/d91/fa1 0 2024-02-19T19:07:38.206 INFO:tasks.workunit.client.1.smithi142.stdout:8/820: rename d9/dd/c41 to d9/dd/d44/de4/c102 0 2024-02-19T19:07:38.206 INFO:tasks.workunit.client.1.smithi142.stdout:8/821: stat d9/dd/de/d14/d65/d6c/da7/fe2 0 2024-02-19T19:07:38.207 INFO:tasks.workunit.client.1.smithi142.stdout:1/952: dread d5/d37/d6c/f7c [0,4194304] 0 2024-02-19T19:07:38.207 INFO:tasks.workunit.client.1.smithi142.stdout:1/953: chown d5/d7/d4a/d53/fc3 989359 1 2024-02-19T19:07:38.207 INFO:tasks.workunit.client.1.smithi142.stdout:5/809: sync 2024-02-19T19:07:38.207 INFO:tasks.workunit.client.1.smithi142.stdout:5/810: readlink d5/dd/d8/d1c/l50 0 2024-02-19T19:07:38.207 INFO:tasks.workunit.client.1.smithi142.stdout:5/811: fsync d5/dd/d8/d31/d4d/f10d 0 2024-02-19T19:07:38.208 INFO:tasks.workunit.client.1.smithi142.stdout:1/954: read d5/d7/d23/da4/f13c [1531023,27876] 0 2024-02-19T19:07:38.209 INFO:tasks.workunit.client.1.smithi142.stdout:4/921: write d4/d1d/d42/d66/dd/d10/d3e/d68/fcc [2565368,128078] 0 2024-02-19T19:07:38.209 INFO:tasks.workunit.client.1.smithi142.stdout:4/922: readlink d4/d1d/d42/d66/dd/d10/l94 0 2024-02-19T19:07:38.211 INFO:tasks.workunit.client.1.smithi142.stdout:6/747: unlink d2/d17/d33/d42/da2/da7/dd2/dd3/le0 0 2024-02-19T19:07:38.213 INFO:tasks.workunit.client.1.smithi142.stdout:9/793: mknod db/d10/d27/d2f/ce2 0 2024-02-19T19:07:38.213 INFO:tasks.workunit.client.1.smithi142.stdout:9/794: write db/d10/d27/d2f/d4c/d59/f71 [3832254,104422] 0 2024-02-19T19:07:38.213 INFO:tasks.workunit.client.1.smithi142.stdout:9/795: fsync db/d10/d22/d24/d41/dd2/fda 0 2024-02-19T19:07:38.215 INFO:tasks.workunit.client.1.smithi142.stdout:8/822: mkdir d9/dd/de/d14/d65/d6c/d103 0 2024-02-19T19:07:38.215 INFO:tasks.workunit.client.1.smithi142.stdout:8/823: truncate d9/da8/ffc 684256 0 2024-02-19T19:07:38.221 INFO:tasks.workunit.client.1.smithi142.stdout:6/748: mkdir d2/d17/d33/d42/da2/da7/d55/d69/d100 0 2024-02-19T19:07:38.224 INFO:tasks.workunit.client.1.smithi142.stdout:9/796: dread db/d10/d32/f7f [0,4194304] 0 2024-02-19T19:07:38.232 INFO:tasks.workunit.client.1.smithi142.stdout:6/749: dread d2/d17/d33/d39/f49 [0,4194304] 0 2024-02-19T19:07:38.232 INFO:tasks.workunit.client.1.smithi142.stdout:6/750: creat d2/d1f/f101 x:0 0 0 2024-02-19T19:07:38.233 INFO:tasks.workunit.client.1.smithi142.stdout:1/955: write d5/d1a/ffb [3750571,35426] 0 2024-02-19T19:07:38.233 INFO:tasks.workunit.client.1.smithi142.stdout:1/956: write d5/d7/d23/da4/f143 [971563,48430] 0 2024-02-19T19:07:38.235 INFO:tasks.workunit.client.1.smithi142.stdout:6/751: mkdir d2/d1f/d20/d31/d88/d8f/d102 0 2024-02-19T19:07:38.235 INFO:tasks.workunit.client.1.smithi142.stdout:6/752: fsync d2/d29/d47/f4a 0 2024-02-19T19:07:38.235 INFO:tasks.workunit.client.1.smithi142.stdout:6/753: write d2/d1f/d5c/d63/fa1 [1759169,108227] 0 2024-02-19T19:07:38.235 INFO:tasks.workunit.client.1.smithi142.stdout:6/754: stat d2/d1e/l4c 0 2024-02-19T19:07:38.235 INFO:tasks.workunit.client.1.smithi142.stdout:8/824: dwrite d9/dd/de/d14/d65/d94/f9d [0,4194304] 0 2024-02-19T19:07:38.236 INFO:tasks.workunit.client.1.smithi142.stdout:8/825: truncate d9/dd/de/d2d/d2e/d49/d50/d59/d8a/f101 736963 0 2024-02-19T19:07:38.236 INFO:tasks.workunit.client.1.smithi142.stdout:8/826: dread - d9/dd/de/d2d/d2e/d49/f88 zero size 2024-02-19T19:07:38.236 INFO:tasks.workunit.client.1.smithi142.stdout:1/957: rmdir d5/d77/da9/dae/db2/dfd 0 2024-02-19T19:07:38.238 INFO:tasks.workunit.client.1.smithi142.stdout:8/827: dread d9/dd/de/d14/d65/db1/fff [0,4194304] 0 2024-02-19T19:07:38.242 INFO:tasks.workunit.client.1.smithi142.stdout:1/958: dread d5/d7/f11 [0,4194304] 0 2024-02-19T19:07:38.247 INFO:tasks.workunit.client.1.smithi142.stdout:1/959: dread d5/d37/d6c/d75/da2/f116 [0,4194304] 0 2024-02-19T19:07:38.249 INFO:tasks.workunit.client.1.smithi142.stdout:5/812: dwrite d5/dd/d8/d5d/fd8 [0,4194304] 0 2024-02-19T19:07:38.250 INFO:tasks.workunit.client.1.smithi142.stdout:5/813: chown d5/dd/df/d22/fec 8168261 1 2024-02-19T19:07:38.251 INFO:tasks.workunit.client.1.smithi142.stdout:5/814: mkdir d5/dd/d8/dd4/d116 0 2024-02-19T19:07:38.251 INFO:tasks.workunit.client.1.smithi142.stdout:5/815: stat d5/dd/df/d15/l4b 0 2024-02-19T19:07:38.251 INFO:tasks.workunit.client.1.smithi142.stdout:5/816: fdatasync d5/dd/df/d15/fc6 0 2024-02-19T19:07:38.257 INFO:tasks.workunit.client.1.smithi142.stdout:4/923: dwrite d4/d1d/d42/fa8 [0,4194304] 0 2024-02-19T19:07:38.258 INFO:tasks.workunit.client.1.smithi142.stdout:8/828: dwrite d9/dd/f47 [0,4194304] 0 2024-02-19T19:07:38.262 INFO:tasks.workunit.client.1.smithi142.stdout:6/755: rmdir d2/d17/d33/d42/da2/da7/d55/d69 39 2024-02-19T19:07:38.263 INFO:tasks.workunit.client.1.smithi142.stdout:5/817: dread d5/dd/d5f/f65 [0,4194304] 0 2024-02-19T19:07:38.263 INFO:tasks.workunit.client.1.smithi142.stdout:5/818: truncate d5/dd/df/d22/d41/d32/fad 4205320 0 2024-02-19T19:07:38.268 INFO:tasks.workunit.client.1.smithi142.stdout:1/960: rmdir d5/d77 39 2024-02-19T19:07:38.268 INFO:tasks.workunit.client.1.smithi142.stdout:1/961: chown d5/d1a/l20 1915515583 1 2024-02-19T19:07:38.270 INFO:tasks.workunit.client.1.smithi142.stdout:8/829: link d9/dd/de/d2d/d2e/d49/d50/d59/f8e d9/dd/de/d14/d65/d6c/f104 0 2024-02-19T19:07:38.272 INFO:tasks.workunit.client.1.smithi142.stdout:5/819: link d5/dd/d8/d1c/c109 d5/dd/d8/d31/d4d/d8d/c117 0 2024-02-19T19:07:38.273 INFO:tasks.workunit.client.1.smithi142.stdout:5/820: truncate d5/f20 1635920 0 2024-02-19T19:07:38.274 INFO:tasks.workunit.client.1.smithi142.stdout:1/962: creat d5/d7/d4a/d53/d6a/ddc/f14a x:0 0 0 2024-02-19T19:07:38.275 INFO:tasks.workunit.client.1.smithi142.stdout:6/756: mknod d2/d1e/d35/d66/d76/c103 0 2024-02-19T19:07:38.276 INFO:tasks.workunit.client.1.smithi142.stdout:5/821: mknod d5/dd/d95/c118 0 2024-02-19T19:07:38.284 INFO:tasks.workunit.client.1.smithi142.stdout:6/757: rmdir d2/d17/d33 39 2024-02-19T19:07:38.284 INFO:tasks.workunit.client.1.smithi142.stdout:1/963: read d5/d37/d6c/fa8 [4101038,109255] 0 2024-02-19T19:07:38.285 INFO:tasks.workunit.client.1.smithi142.stdout:6/758: truncate d2/d17/f19 6573649 0 2024-02-19T19:07:38.286 INFO:tasks.workunit.client.1.smithi142.stdout:1/964: truncate d5/d37/d6c/fa0 2460255 0 2024-02-19T19:07:38.286 INFO:tasks.workunit.client.1.smithi142.stdout:1/965: write d5/d73/f8b [2607065,83590] 0 2024-02-19T19:07:38.286 INFO:tasks.workunit.client.1.smithi142.stdout:1/966: stat d5/d73/f8b 0 2024-02-19T19:07:38.286 INFO:tasks.workunit.client.1.smithi142.stdout:1/967: chown d5/d1a/d59/d140 497 1 2024-02-19T19:07:38.286 INFO:tasks.workunit.client.1.smithi142.stdout:6/759: getdents d2/d1e/d35/d66/d8d 0 2024-02-19T19:07:38.287 INFO:tasks.workunit.client.1.smithi142.stdout:6/760: creat d2/d17/d33/d42/f104 x:0 0 0 2024-02-19T19:07:38.290 INFO:tasks.workunit.client.1.smithi142.stdout:2/667: sync 2024-02-19T19:07:38.291 INFO:tasks.workunit.client.1.smithi142.stdout:2/668: symlink d3/d4d/d5f/db5/ld7 0 2024-02-19T19:07:38.291 INFO:tasks.workunit.client.1.smithi142.stdout:2/669: write d3/db/d29/d4c/f77 [999046,121519] 0 2024-02-19T19:07:38.291 INFO:tasks.workunit.client.1.smithi142.stdout:2/670: stat d3/db/d29/d4c/dae 0 2024-02-19T19:07:38.291 INFO:tasks.workunit.client.1.smithi142.stdout:2/671: chown d3/f8 102 1 2024-02-19T19:07:38.292 INFO:tasks.workunit.client.1.smithi142.stdout:2/672: truncate d3/db/f20 463803 0 2024-02-19T19:07:38.293 INFO:tasks.workunit.client.1.smithi142.stdout:4/924: dwrite d4/d1d/d42/d66/dd/d10/d3e/d68/fcc [0,4194304] 0 2024-02-19T19:07:38.293 INFO:tasks.workunit.client.1.smithi142.stdout:4/925: chown d4/d1d/d42/d66/d12/d79/d8c/d119/d6e/d126/f51 766003 1 2024-02-19T19:07:38.294 INFO:tasks.workunit.client.1.smithi142.stdout:2/673: creat d3/df/da4/fd8 x:0 0 0 2024-02-19T19:07:38.294 INFO:tasks.workunit.client.1.smithi142.stdout:8/830: dwrite d9/dd/de/d2d/d2e/d49/d50/d59/f66 [0,4194304] 0 2024-02-19T19:07:38.296 INFO:tasks.workunit.client.1.smithi142.stdout:4/926: getdents d4/d1d/d42/d66 0 2024-02-19T19:07:38.298 INFO:tasks.workunit.client.1.smithi142.stdout:2/674: link d3/df/l30 d3/d35/d53/ld9 0 2024-02-19T19:07:38.302 INFO:tasks.workunit.client.1.smithi142.stdout:1/968: dwrite d5/d7/d4a/f118 [0,4194304] 0 2024-02-19T19:07:38.302 INFO:tasks.workunit.client.1.smithi142.stdout:1/969: chown d5/d7/d4a/d53/d6a/faa 3 1 2024-02-19T19:07:38.303 INFO:tasks.workunit.client.1.smithi142.stdout:5/822: truncate d5/dd/df/d22/d41/d32/fad 2099750 0 2024-02-19T19:07:38.305 INFO:tasks.workunit.client.1.smithi142.stdout:4/927: write d4/d1d/d42/d66/dd/d10/d3e/d68/fcc [3370878,65358] 0 2024-02-19T19:07:38.308 INFO:tasks.workunit.client.1.smithi142.stdout:8/831: rename d9/f46 to d9/f105 0 2024-02-19T19:07:38.308 INFO:tasks.workunit.client.1.smithi142.stdout:2/675: dread d3/db/f34 [0,4194304] 0 2024-02-19T19:07:38.311 INFO:tasks.workunit.client.1.smithi142.stdout:8/832: truncate d9/dd/d15/f1f 4748446 0 2024-02-19T19:07:38.312 INFO:tasks.workunit.client.1.smithi142.stdout:2/676: unlink d3/d35/f5c 0 2024-02-19T19:07:38.314 INFO:tasks.workunit.client.1.smithi142.stdout:2/677: mkdir d3/db/dda 0 2024-02-19T19:07:38.314 INFO:tasks.workunit.client.1.smithi142.stdout:2/678: dread - d3/d35/d53/fc7 zero size 2024-02-19T19:07:38.316 INFO:tasks.workunit.client.1.smithi142.stdout:3/956: sync 2024-02-19T19:07:38.316 INFO:tasks.workunit.client.1.smithi142.stdout:0/684: sync 2024-02-19T19:07:38.317 INFO:tasks.workunit.client.1.smithi142.stdout:4/928: write d4/d1d/d42/d66/d12/d2d/d2a/fb8 [3130370,38086] 0 2024-02-19T19:07:38.318 INFO:tasks.workunit.client.1.smithi142.stdout:8/833: write d9/dd/de/d2d/d2e/d73/ff1 [1188260,7425] 0 2024-02-19T19:07:38.319 INFO:tasks.workunit.client.1.smithi142.stdout:3/957: link d1d/d1e/d2e/d37/f4c d1d/d1e/d6e/f134 0 2024-02-19T19:07:38.319 INFO:tasks.workunit.client.1.smithi142.stdout:3/958: stat d1d/d1e/d2e/d50/d7c/da7/d52/d5a/da4/c11e 0 2024-02-19T19:07:38.321 INFO:tasks.workunit.client.1.smithi142.stdout:8/834: mkdir d9/dd/de/d2d/d2e/d49/d50/d59/d97/dbe/d106 0 2024-02-19T19:07:38.321 INFO:tasks.workunit.client.1.smithi142.stdout:3/959: mknod d1d/d1e/d2e/d50/d7c/da7/dc8/c135 0 2024-02-19T19:07:38.321 INFO:tasks.workunit.client.1.smithi142.stdout:3/960: read d1d/d1e/d2e/d37/f4c [5674977,13628] 0 2024-02-19T19:07:38.323 INFO:tasks.workunit.client.1.smithi142.stdout:8/835: rename d9/dd/de/d2d/d2e/d49/d50/d59/f7f to d9/dd/de/d14/d65/d6c/da7/f107 0 2024-02-19T19:07:38.324 INFO:tasks.workunit.client.1.smithi142.stdout:2/679: dread d3/db/fc [0,4194304] 0 2024-02-19T19:07:38.325 INFO:tasks.workunit.client.1.smithi142.stdout:3/961: rmdir d1d/d1e/d2e/dee/dc1/d10f 0 2024-02-19T19:07:38.326 INFO:tasks.workunit.client.1.smithi142.stdout:3/962: readlink d1d/d1e/d2e/dee/l96 0 2024-02-19T19:07:38.328 INFO:tasks.workunit.client.1.smithi142.stdout:3/963: rename d1d/d1e/d2e/d37/d6c to d1d/d136 0 2024-02-19T19:07:38.328 INFO:tasks.workunit.client.1.smithi142.stdout:3/964: readlink d1d/d1e/l74 0 2024-02-19T19:07:38.328 INFO:tasks.workunit.client.1.smithi142.stdout:3/965: creat d1d/d1e/d2e/d37/d81/f137 x:0 0 0 2024-02-19T19:07:38.329 INFO:tasks.workunit.client.1.smithi142.stdout:0/685: write d23/d28/d2d/d51/dc9/d58/f83 [2712068,25154] 0 2024-02-19T19:07:38.329 INFO:tasks.workunit.client.1.smithi142.stdout:3/966: mknod d1d/db6/d121/c138 0 2024-02-19T19:07:38.331 INFO:tasks.workunit.client.1.smithi142.stdout:0/686: creat d23/d7d/fd9 x:0 0 0 2024-02-19T19:07:38.332 INFO:tasks.workunit.client.1.smithi142.stdout:0/687: symlink d23/d28/d41/d78/lda 0 2024-02-19T19:07:38.333 INFO:tasks.workunit.client.1.smithi142.stdout:0/688: creat d23/d28/d41/fdb x:0 0 0 2024-02-19T19:07:38.335 INFO:tasks.workunit.client.1.smithi142.stdout:5/823: dwrite d5/dd/df/f59 [0,4194304] 0 2024-02-19T19:07:38.336 INFO:tasks.workunit.client.1.smithi142.stdout:5/824: chown d5/dd 1 1 2024-02-19T19:07:38.336 INFO:tasks.workunit.client.1.smithi142.stdout:5/825: fsync d5/dd/df/d22/d41/d32/fad 0 2024-02-19T19:07:38.336 INFO:tasks.workunit.client.1.smithi142.stdout:5/826: truncate d5/dd/d8/d31/f34 4976263 0 2024-02-19T19:07:38.336 INFO:tasks.workunit.client.1.smithi142.stdout:4/929: dwrite d4/d1d/d42/d66/d12/fa4 [0,4194304] 0 2024-02-19T19:07:38.339 INFO:tasks.workunit.client.1.smithi142.stdout:5/827: mknod d5/dd/df/d22/dc0/c119 0 2024-02-19T19:07:38.339 INFO:tasks.workunit.client.1.smithi142.stdout:5/828: fdatasync d5/dd/df/d22/d41/d32/f35 0 2024-02-19T19:07:38.340 INFO:tasks.workunit.client.1.smithi142.stdout:5/829: chown d5/dd/d8/d1c/d8a/f9c 3 1 2024-02-19T19:07:38.341 INFO:tasks.workunit.client.1.smithi142.stdout:2/680: write d3/f5 [1437196,31266] 0 2024-02-19T19:07:38.343 INFO:tasks.workunit.client.1.smithi142.stdout:0/689: dread d23/d28/f38 [0,4194304] 0 2024-02-19T19:07:38.344 INFO:tasks.workunit.client.1.smithi142.stdout:4/930: symlink d4/d1d/d42/d66/dd/d10/d26/df7/l138 0 2024-02-19T19:07:38.347 INFO:tasks.workunit.client.1.smithi142.stdout:3/967: dwrite d1d/d1e/dcd/fd0 [0,4194304] 0 2024-02-19T19:07:38.348 INFO:tasks.workunit.client.1.smithi142.stdout:2/681: link d3/db/f47 d3/db/d29/d4c/fdb 0 2024-02-19T19:07:38.348 INFO:tasks.workunit.client.1.smithi142.stdout:2/682: write d3/db/d29/f41 [6287843,65166] 0 2024-02-19T19:07:38.348 INFO:tasks.workunit.client.1.smithi142.stdout:2/683: write d3/d4d/f6c [1000789,19302] 0 2024-02-19T19:07:38.348 INFO:tasks.workunit.client.1.smithi142.stdout:2/684: chown d3/d4d/d5f/db5/ld7 246 1 2024-02-19T19:07:38.349 INFO:tasks.workunit.client.1.smithi142.stdout:8/836: getdents d9/dd/de/d14/d65/d6c/da7 0 2024-02-19T19:07:38.350 INFO:tasks.workunit.client.1.smithi142.stdout:0/690: mknod d23/d32/d8a/cdc 0 2024-02-19T19:07:38.350 INFO:tasks.workunit.client.1.smithi142.stdout:0/691: truncate d23/d7d/fd9 199422 0 2024-02-19T19:07:38.351 INFO:tasks.workunit.client.1.smithi142.stdout:4/931: mknod d4/d1d/d42/d66/dd/d10/c139 0 2024-02-19T19:07:38.351 INFO:tasks.workunit.client.1.smithi142.stdout:4/932: fsync d4/d1d/d42/d66/dd/d10/d26/d50/f12d 0 2024-02-19T19:07:38.353 INFO:tasks.workunit.client.1.smithi142.stdout:5/830: dwrite d5/dd/d8/d1c/d8a/fa6 [0,4194304] 0 2024-02-19T19:07:38.355 INFO:tasks.workunit.client.1.smithi142.stdout:2/685: symlink d3/d35/d53/ldc 0 2024-02-19T19:07:38.357 INFO:tasks.workunit.client.1.smithi142.stdout:8/837: symlink d9/dd/de/d14/l108 0 2024-02-19T19:07:38.357 INFO:tasks.workunit.client.1.smithi142.stdout:8/838: chown d9/f7e 9 1 2024-02-19T19:07:38.358 INFO:tasks.workunit.client.1.smithi142.stdout:3/968: dwrite d1d/d1e/d2e/d50/f11d [0,4194304] 0 2024-02-19T19:07:38.358 INFO:tasks.workunit.client.1.smithi142.stdout:8/839: dread d9/dd/de/d2d/d2e/d49/d74/f84 [0,4194304] 0 2024-02-19T19:07:38.358 INFO:tasks.workunit.client.1.smithi142.stdout:3/969: fdatasync d1d/d1e/d2e/d50/d7c/da7/d3a/fcb 0 2024-02-19T19:07:38.358 INFO:tasks.workunit.client.1.smithi142.stdout:3/970: readlink d1d/d1e/d2e/d50/d7c/da7/d3a/dc7/le9 0 2024-02-19T19:07:38.359 INFO:tasks.workunit.client.1.smithi142.stdout:0/692: mknod d23/cdd 0 2024-02-19T19:07:38.359 INFO:tasks.workunit.client.1.smithi142.stdout:0/693: stat d23/d28/c2b 0 2024-02-19T19:07:38.359 INFO:tasks.workunit.client.1.smithi142.stdout:0/694: chown l1e 57773737 1 2024-02-19T19:07:38.359 INFO:tasks.workunit.client.1.smithi142.stdout:4/933: mknod d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f/d112/d121/c13a 0 2024-02-19T19:07:38.359 INFO:tasks.workunit.client.1.smithi142.stdout:4/934: stat d4/d1d/d42/d66/dd/d10/d3e/d68/db4/d124 0 2024-02-19T19:07:38.362 INFO:tasks.workunit.client.1.smithi142.stdout:5/831: getdents d5/dd/d8/dd4 0 2024-02-19T19:07:38.362 INFO:tasks.workunit.client.1.smithi142.stdout:5/832: read d5/dd/df/d22/d41/d32/f39 [338780,96585] 0 2024-02-19T19:07:38.364 INFO:tasks.workunit.client.1.smithi142.stdout:8/840: creat d9/dd/de/d2d/db7/f109 x:0 0 0 2024-02-19T19:07:38.365 INFO:tasks.workunit.client.1.smithi142.stdout:3/971: creat d1d/d1e/d2e/d50/d7c/da7/d52/d108/d125/f139 x:0 0 0 2024-02-19T19:07:38.367 INFO:tasks.workunit.client.1.smithi142.stdout:4/935: link d4/d1d/d42/d66/dd/d10/c139 d4/d14/d31/d43/c13b 0 2024-02-19T19:07:38.367 INFO:tasks.workunit.client.1.smithi142.stdout:4/936: readlink d4/d1d/d42/d66/dd/d10/l9b 0 2024-02-19T19:07:38.367 INFO:tasks.workunit.client.1.smithi142.stdout:4/937: chown d4/d1c/dae/dcb/ff6 381667949 1 2024-02-19T19:07:38.367 INFO:tasks.workunit.client.1.smithi142.stdout:7/687: sync 2024-02-19T19:07:38.367 INFO:tasks.workunit.client.1.smithi142.stdout:9/797: sync 2024-02-19T19:07:38.367 INFO:tasks.workunit.client.1.smithi142.stdout:9/798: truncate db/d10/d27/f6d 973922 0 2024-02-19T19:07:38.368 INFO:tasks.workunit.client.1.smithi142.stdout:5/833: link d5/dd/df/d22/d41/l1b d5/dd/df/d22/d41/l11a 0 2024-02-19T19:07:38.370 INFO:tasks.workunit.client.1.smithi142.stdout:8/841: mkdir d9/dd/de/d14/d65/d6c/d10a 0 2024-02-19T19:07:38.372 INFO:tasks.workunit.client.1.smithi142.stdout:4/938: rename d4/fff to d4/d1d/d42/d66/d12/d79/d8c/d119/f13c 0 2024-02-19T19:07:38.373 INFO:tasks.workunit.client.1.smithi142.stdout:9/799: mknod db/d10/d27/d2f/d4c/d59/ce3 0 2024-02-19T19:07:38.374 INFO:tasks.workunit.client.1.smithi142.stdout:5/834: mknod d5/dd/df/d22/db9/c11b 0 2024-02-19T19:07:38.375 INFO:tasks.workunit.client.1.smithi142.stdout:8/842: rmdir d9/dd/d44/d79/def 0 2024-02-19T19:07:38.378 INFO:tasks.workunit.client.1.smithi142.stdout:7/688: rename d0/d13/d72/de6 to d0/d1b/d21/d24/ddf/dea 0 2024-02-19T19:07:38.379 INFO:tasks.workunit.client.1.smithi142.stdout:9/800: mknod db/d10/d22/ce4 0 2024-02-19T19:07:38.379 INFO:tasks.workunit.client.1.smithi142.stdout:9/801: fsync db/d10/d27/d2f/d4c/f9f 0 2024-02-19T19:07:38.383 INFO:tasks.workunit.client.1.smithi142.stdout:7/689: link d0/d1b/d21/d24/d5e/d65/d86/le2 d0/d1b/d9d/leb 0 2024-02-19T19:07:38.383 INFO:tasks.workunit.client.1.smithi142.stdout:7/690: write d0/f6b [1746077,31234] 0 2024-02-19T19:07:38.383 INFO:tasks.workunit.client.1.smithi142.stdout:7/691: chown d0/d13/d72/da7/faf 137 1 2024-02-19T19:07:38.383 INFO:tasks.workunit.client.1.smithi142.stdout:7/692: chown d0/d1b/d21/d24/d29/d44/de1/fe7 13295 1 2024-02-19T19:07:38.383 INFO:tasks.workunit.client.1.smithi142.stdout:5/835: write d5/dd/d8/d5d/fd8 [3215442,104252] 0 2024-02-19T19:07:38.383 INFO:tasks.workunit.client.1.smithi142.stdout:5/836: write d5/dd/d8/f3d [1155196,20458] 0 2024-02-19T19:07:38.384 INFO:tasks.workunit.client.1.smithi142.stdout:6/761: sync 2024-02-19T19:07:38.384 INFO:tasks.workunit.client.1.smithi142.stdout:6/762: chown d2/ld 4332598 1 2024-02-19T19:07:38.385 INFO:tasks.workunit.client.1.smithi142.stdout:2/686: dwrite d3/d35/d53/f6f [0,4194304] 0 2024-02-19T19:07:38.385 INFO:tasks.workunit.client.1.smithi142.stdout:0/695: dwrite d23/d28/d41/d78/fd2 [0,4194304] 0 2024-02-19T19:07:38.386 INFO:tasks.workunit.client.1.smithi142.stdout:3/972: dwrite d1d/d1e/d2e/d50/d7c/da7/d52/d71/faa [0,4194304] 0 2024-02-19T19:07:38.386 INFO:tasks.workunit.client.1.smithi142.stdout:3/973: fsync d1d/d1e/d2e/d50/d83/fdc 0 2024-02-19T19:07:38.387 INFO:tasks.workunit.client.1.smithi142.stdout:7/693: truncate d0/d13/d72/d47/f4b 720942 0 2024-02-19T19:07:38.388 INFO:tasks.workunit.client.1.smithi142.stdout:6/763: mknod d2/d17/d33/d42/da2/da7/c105 0 2024-02-19T19:07:38.388 INFO:tasks.workunit.client.1.smithi142.stdout:6/764: fsync d2/d17/d33/d42/da2/fb4 0 2024-02-19T19:07:38.388 INFO:tasks.workunit.client.1.smithi142.stdout:6/765: dread - d2/d17/d33/d42/da2/da7/d55/dc0/fef zero size 2024-02-19T19:07:38.391 INFO:tasks.workunit.client.1.smithi142.stdout:2/687: link d3/d4b/ca3 d3/d4d/d81/cdd 0 2024-02-19T19:07:38.399 INFO:tasks.workunit.client.1.smithi142.stdout:0/696: symlink d23/d7d/lde 0 2024-02-19T19:07:38.399 INFO:tasks.workunit.client.1.smithi142.stdout:0/697: fdatasync d23/f3d 0 2024-02-19T19:07:38.399 INFO:tasks.workunit.client.1.smithi142.stdout:0/698: fdatasync d23/d28/d2d/d51/dc9/f49 0 2024-02-19T19:07:38.399 INFO:tasks.workunit.client.1.smithi142.stdout:0/699: creat d23/d32/d8a/fdf x:0 0 0 2024-02-19T19:07:38.399 INFO:tasks.workunit.client.1.smithi142.stdout:0/700: chown d23/c3c 11 1 2024-02-19T19:07:38.400 INFO:tasks.workunit.client.1.smithi142.stdout:5/837: dwrite d5/dd/d8/dbc/feb [0,4194304] 0 2024-02-19T19:07:38.400 INFO:tasks.workunit.client.1.smithi142.stdout:8/843: rename d9/dd/de/d2d/d2e/d49 to d9/dd/de/d14/d65/d6c/da7/d10b 0 2024-02-19T19:07:38.403 INFO:tasks.workunit.client.1.smithi142.stdout:3/974: symlink d1d/d1e/d112/l13a 0 2024-02-19T19:07:38.403 INFO:tasks.workunit.client.1.smithi142.stdout:3/975: chown d1d/d1e/d2e/d50/cd6 2517452 1 2024-02-19T19:07:38.403 INFO:tasks.workunit.client.1.smithi142.stdout:7/694: creat d0/d13/de4/fec x:0 0 0 2024-02-19T19:07:38.405 INFO:tasks.workunit.client.1.smithi142.stdout:6/766: truncate d2/d17/d33/d39/f70 473111 0 2024-02-19T19:07:38.405 INFO:tasks.workunit.client.1.smithi142.stdout:2/688: mknod d3/d4d/d5f/db5/cde 0 2024-02-19T19:07:38.407 INFO:tasks.workunit.client.1.smithi142.stdout:0/701: rmdir d23/d7d/d9e 39 2024-02-19T19:07:38.409 INFO:tasks.workunit.client.1.smithi142.stdout:9/802: rename db/d10/d32/d3f/f7e to db/d10/d27/fe5 0 2024-02-19T19:07:38.410 INFO:tasks.workunit.client.1.smithi142.stdout:3/976: creat d1d/d1e/d2e/d50/d7c/da7/d3a/dc7/f13b x:0 0 0 2024-02-19T19:07:38.410 INFO:tasks.workunit.client.1.smithi142.stdout:3/977: write d1d/d1e/d2e/d37/d81/db7/f10a [814814,31926] 0 2024-02-19T19:07:38.412 INFO:tasks.workunit.client.1.smithi142.stdout:7/695: unlink d0/d1b/d21/d24/d29/dc5/fd9 0 2024-02-19T19:07:38.412 INFO:tasks.workunit.client.1.smithi142.stdout:7/696: stat d0/d1b/d21/d24/d29/d7e/dde 0 2024-02-19T19:07:38.412 INFO:tasks.workunit.client.1.smithi142.stdout:7/697: fsync d0/d13/d1e/f71 0 2024-02-19T19:07:38.413 INFO:tasks.workunit.client.1.smithi142.stdout:6/767: mkdir d2/d1f/d20/d31/d88/d8f/d102/d106 0 2024-02-19T19:07:38.413 INFO:tasks.workunit.client.1.smithi142.stdout:6/768: readlink d2/d17/d33/d42/da2/da7/d55/ld0 0 2024-02-19T19:07:38.413 INFO:tasks.workunit.client.1.smithi142.stdout:2/689: mknod d3/db/dda/cdf 0 2024-02-19T19:07:38.413 INFO:tasks.workunit.client.1.smithi142.stdout:2/690: write d3/f8 [5007959,35857] 0 2024-02-19T19:07:38.415 INFO:tasks.workunit.client.1.smithi142.stdout:1/970: sync 2024-02-19T19:07:38.416 INFO:tasks.workunit.client.1.smithi142.stdout:9/803: creat db/d10/d27/fe6 x:0 0 0 2024-02-19T19:07:38.416 INFO:tasks.workunit.client.1.smithi142.stdout:9/804: readlink db/d10/d22/d24/d3d/l43 0 2024-02-19T19:07:38.418 INFO:tasks.workunit.client.1.smithi142.stdout:9/805: dread db/d10/d22/d24/d41/dd2/dd3/fb0 [0,4194304] 0 2024-02-19T19:07:38.418 INFO:tasks.workunit.client.1.smithi142.stdout:9/806: stat db/d10/d27/d2f 0 2024-02-19T19:07:38.419 INFO:tasks.workunit.client.1.smithi142.stdout:6/769: truncate d2/d1f/f30 856586 0 2024-02-19T19:07:38.424 INFO:tasks.workunit.client.1.smithi142.stdout:1/971: link d5/d37/f93 d5/d7/d34/d6f/f14b 0 2024-02-19T19:07:38.425 INFO:tasks.workunit.client.1.smithi142.stdout:6/770: dread d2/f5f [0,4194304] 0 2024-02-19T19:07:38.425 INFO:tasks.workunit.client.1.smithi142.stdout:9/807: link db/d10/d27/d2f/d4c/f70 db/d10/fe7 0 2024-02-19T19:07:38.428 INFO:tasks.workunit.client.1.smithi142.stdout:7/698: rmdir d0/d13/d72 39 2024-02-19T19:07:38.434 INFO:tasks.workunit.client.1.smithi142.stdout:3/978: dwrite d1d/d1e/d2e/d37/d81/db7/f12c [0,4194304] 0 2024-02-19T19:07:38.434 INFO:tasks.workunit.client.1.smithi142.stdout:6/771: dread d2/d17/f7a [0,4194304] 0 2024-02-19T19:07:38.437 INFO:tasks.workunit.client.1.smithi142.stdout:2/691: rmdir d3 39 2024-02-19T19:07:38.438 INFO:tasks.workunit.client.1.smithi142.stdout:0/702: rename d23/d32/d8a/db1/dca to d23/d28/d2d/d54/d88/de0 0 2024-02-19T19:07:38.439 INFO:tasks.workunit.client.1.smithi142.stdout:0/703: write d23/d28/d2d/d54/d88/d9f/fbc [931992,97573] 0 2024-02-19T19:07:38.439 INFO:tasks.workunit.client.1.smithi142.stdout:1/972: mkdir d5/d37/d6c/d75/da2/d14c 0 2024-02-19T19:07:38.441 INFO:tasks.workunit.client.1.smithi142.stdout:7/699: rmdir d0/d1b/d21/d24/ddf/dea 0 2024-02-19T19:07:38.441 INFO:tasks.workunit.client.1.smithi142.stdout:7/700: truncate d0/d1b/d21/d24/f28 4724287 0 2024-02-19T19:07:38.442 INFO:tasks.workunit.client.1.smithi142.stdout:3/979: mknod d1d/db6/c13c 0 2024-02-19T19:07:38.442 INFO:tasks.workunit.client.1.smithi142.stdout:3/980: chown d1d/d1e/d2e 590 1 2024-02-19T19:07:38.442 INFO:tasks.workunit.client.1.smithi142.stdout:3/981: read d1d/d1e/d2e/f43 [1950240,62636] 0 2024-02-19T19:07:38.442 INFO:tasks.workunit.client.1.smithi142.stdout:3/982: stat d1d/l47 0 2024-02-19T19:07:38.443 INFO:tasks.workunit.client.1.smithi142.stdout:6/772: write d2/d1e/d35/d66/d8d/d3e/d8c/f9f [1472962,109371] 0 2024-02-19T19:07:38.445 INFO:tasks.workunit.client.1.smithi142.stdout:2/692: creat d3/d68/d95/dca/fe0 x:0 0 0 2024-02-19T19:07:38.445 INFO:tasks.workunit.client.1.smithi142.stdout:2/693: fsync d3/db/d29/f85 0 2024-02-19T19:07:38.445 INFO:tasks.workunit.client.1.smithi142.stdout:2/694: write d3/db/f70 [904066,35442] 0 2024-02-19T19:07:38.445 INFO:tasks.workunit.client.1.smithi142.stdout:2/695: write d3/d35/d53/fc7 [735780,95970] 0 2024-02-19T19:07:38.445 INFO:tasks.workunit.client.1.smithi142.stdout:0/704: symlink d23/d28/d2d/le1 0 2024-02-19T19:07:38.445 INFO:tasks.workunit.client.1.smithi142.stdout:0/705: creat d23/d7d/fe2 x:0 0 0 2024-02-19T19:07:38.445 INFO:tasks.workunit.client.1.smithi142.stdout:9/808: mknod db/d10/d32/d3f/ce8 0 2024-02-19T19:07:38.447 INFO:tasks.workunit.client.1.smithi142.stdout:7/701: rename d0/d1b/d21/d24/lc1 to d0/d1b/d21/d24/d29/d44/led 0 2024-02-19T19:07:38.449 INFO:tasks.workunit.client.1.smithi142.stdout:3/983: link d1d/d1e/d2e/d37/d81/db7/ld7 d1d/d1e/d2e/d37/d81/dbc/l13d 0 2024-02-19T19:07:38.453 INFO:tasks.workunit.client.1.smithi142.stdout:6/773: write d2/d1f/d56/f6b [592124,74556] 0 2024-02-19T19:07:38.453 INFO:tasks.workunit.client.1.smithi142.stdout:6/774: creat d2/d1e/d35/d66/d8d/d3e/f107 x:0 0 0 2024-02-19T19:07:38.454 INFO:tasks.workunit.client.1.smithi142.stdout:0/706: symlink d23/d32/d8a/le3 0 2024-02-19T19:07:38.456 INFO:tasks.workunit.client.1.smithi142.stdout:9/809: symlink db/d10/le9 0 2024-02-19T19:07:38.456 INFO:tasks.workunit.client.1.smithi142.stdout:9/810: chown db/d10/d22/d24/d41/dc8 268 1 2024-02-19T19:07:38.456 INFO:tasks.workunit.client.1.smithi142.stdout:2/696: dread d3/f16 [0,4194304] 0 2024-02-19T19:07:38.456 INFO:tasks.workunit.client.1.smithi142.stdout:2/697: dread - d3/d4d/d9f/fc1 zero size 2024-02-19T19:07:38.456 INFO:tasks.workunit.client.1.smithi142.stdout:2/698: dread - d3/d35/d97/dbf/fb6 zero size 2024-02-19T19:07:38.456 INFO:tasks.workunit.client.1.smithi142.stdout:2/699: chown d3/db 885176 1 2024-02-19T19:07:38.457 INFO:tasks.workunit.client.1.smithi142.stdout:7/702: rename d0/d13/lae to d0/d13/d72/lee 0 2024-02-19T19:07:38.457 INFO:tasks.workunit.client.1.smithi142.stdout:7/703: dread - d0/d1b/d21/d24/d29/d44/de1/fe7 zero size 2024-02-19T19:07:38.459 INFO:tasks.workunit.client.1.smithi142.stdout:1/973: dwrite d5/d7/d4a/d53/d6a/faa [0,4194304] 0 2024-02-19T19:07:38.459 INFO:tasks.workunit.client.1.smithi142.stdout:1/974: creat d5/d7/d4a/d53/d6a/ddc/f14d x:0 0 0 2024-02-19T19:07:38.460 INFO:tasks.workunit.client.1.smithi142.stdout:6/775: symlink d2/d17/d33/d42/da2/da7/de6/l108 0 2024-02-19T19:07:38.460 INFO:tasks.workunit.client.1.smithi142.stdout:6/776: fsync d2/d17/d33/d39/ff8 0 2024-02-19T19:07:38.461 INFO:tasks.workunit.client.1.smithi142.stdout:0/707: mkdir d23/d28/d2d/d51/dc9/d58/db6/de4 0 2024-02-19T19:07:38.461 INFO:tasks.workunit.client.1.smithi142.stdout:0/708: write d23/d28/d2d/d51/fa6 [1581362,38082] 0 2024-02-19T19:07:38.462 INFO:tasks.workunit.client.1.smithi142.stdout:2/700: mkdir d3/d4d/d9f/de1 0 2024-02-19T19:07:38.462 INFO:tasks.workunit.client.1.smithi142.stdout:3/984: write d1d/d1e/d2e/dee/da2/fd2 [402050,86884] 0 2024-02-19T19:07:38.463 INFO:tasks.workunit.client.1.smithi142.stdout:7/704: symlink d0/d13/d1e/db7/lef 0 2024-02-19T19:07:38.465 INFO:tasks.workunit.client.1.smithi142.stdout:3/985: dread d1d/d136/f7b [0,4194304] 0 2024-02-19T19:07:38.465 INFO:tasks.workunit.client.1.smithi142.stdout:3/986: creat d1d/d1e/d2e/dee/da2/df1/f13e x:0 0 0 2024-02-19T19:07:38.466 INFO:tasks.workunit.client.1.smithi142.stdout:1/975: truncate d5/d37/d6c/d75/fde 873954 0 2024-02-19T19:07:38.467 INFO:tasks.workunit.client.1.smithi142.stdout:6/777: symlink d2/d1f/d56/d65/l109 0 2024-02-19T19:07:38.467 INFO:tasks.workunit.client.1.smithi142.stdout:6/778: creat d2/d1e/d35/f10a x:0 0 0 2024-02-19T19:07:38.467 INFO:tasks.workunit.client.1.smithi142.stdout:6/779: readlink d2/lc2 0 2024-02-19T19:07:38.469 INFO:tasks.workunit.client.1.smithi142.stdout:0/709: creat d23/d28/d2d/d54/d88/d9f/fe5 x:0 0 0 2024-02-19T19:07:38.469 INFO:tasks.workunit.client.1.smithi142.stdout:0/710: write d23/d28/d2d/d51/dc9/fd3 [15751,121317] 0 2024-02-19T19:07:38.470 INFO:tasks.workunit.client.1.smithi142.stdout:0/711: chown d23/d32/f30 7513277 1 2024-02-19T19:07:38.470 INFO:tasks.workunit.client.1.smithi142.stdout:0/712: write d23/d28/f34 [1665351,124122] 0 2024-02-19T19:07:38.470 INFO:tasks.workunit.client.1.smithi142.stdout:0/713: stat d23/d32/c5f 0 2024-02-19T19:07:38.470 INFO:tasks.workunit.client.1.smithi142.stdout:0/714: dread - d23/d28/d2d/d54/f74 zero size 2024-02-19T19:07:38.471 INFO:tasks.workunit.client.1.smithi142.stdout:2/701: creat d3/db/d29/d4c/fe2 x:0 0 0 2024-02-19T19:07:38.473 INFO:tasks.workunit.client.1.smithi142.stdout:9/811: dwrite db/d10/d22/d24/d41/dd2/dd3/fa8 [0,4194304] 0 2024-02-19T19:07:38.474 INFO:tasks.workunit.client.1.smithi142.stdout:9/812: chown db/d10/fb6 276034421 1 2024-02-19T19:07:38.474 INFO:tasks.workunit.client.1.smithi142.stdout:9/813: dread - db/d10/d27/d2f/d4c/d54/fd4 zero size 2024-02-19T19:07:38.474 INFO:tasks.workunit.client.1.smithi142.stdout:9/814: truncate db/d10/d22/d24/d41/dd2/dad/fb4 1829962 0 2024-02-19T19:07:38.475 INFO:tasks.workunit.client.1.smithi142.stdout:3/987: link d1d/d1e/c65 d1d/d1e/d2e/d50/d7c/da7/dc8/c13f 0 2024-02-19T19:07:38.475 INFO:tasks.workunit.client.1.smithi142.stdout:3/988: chown d1d/d1e/d2e/dee/dc1 130883 1 2024-02-19T19:07:38.476 INFO:tasks.workunit.client.1.smithi142.stdout:1/976: creat d5/d37/d6c/d75/da2/d14c/f14e x:0 0 0 2024-02-19T19:07:38.476 INFO:tasks.workunit.client.1.smithi142.stdout:1/977: fsync d5/d1a/f39 0 2024-02-19T19:07:38.476 INFO:tasks.workunit.client.1.smithi142.stdout:1/978: truncate d5/d7/d23/d41/dc7/ff7 203503 0 2024-02-19T19:07:38.479 INFO:tasks.workunit.client.1.smithi142.stdout:9/815: dread db/d10/d22/f5c [0,4194304] 0 2024-02-19T19:07:38.480 INFO:tasks.workunit.client.1.smithi142.stdout:7/705: dwrite d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:38.481 INFO:tasks.workunit.client.1.smithi142.stdout:0/715: rename l21 to d23/d7d/le6 0 2024-02-19T19:07:38.481 INFO:tasks.workunit.client.1.smithi142.stdout:0/716: chown d23/d28/d2d/d51/dc9/c9b 92385598 1 2024-02-19T19:07:38.483 INFO:tasks.workunit.client.1.smithi142.stdout:2/702: creat d3/db/d29/d4c/dae/fe3 x:0 0 0 2024-02-19T19:07:38.484 INFO:tasks.workunit.client.1.smithi142.stdout:3/989: mkdir d1d/d136/d140 0 2024-02-19T19:07:38.484 INFO:tasks.workunit.client.1.smithi142.stdout:3/990: chown d1d/d1e/d2e/dee/da2/df1/lf7 17576998 1 2024-02-19T19:07:38.485 INFO:tasks.workunit.client.1.smithi142.stdout:7/706: creat d0/d1b/d21/d24/d29/d7e/dde/ff0 x:0 0 0 2024-02-19T19:07:38.485 INFO:tasks.workunit.client.1.smithi142.stdout:7/707: chown d0/d1b/d21/d24/d29/c90 115602577 1 2024-02-19T19:07:38.486 INFO:tasks.workunit.client.1.smithi142.stdout:0/717: mknod d23/d7d/d9e/ce7 0 2024-02-19T19:07:38.488 INFO:tasks.workunit.client.1.smithi142.stdout:9/816: rename db/d10/d22/f37 to db/d10/d22/d81/fea 0 2024-02-19T19:07:38.488 INFO:tasks.workunit.client.1.smithi142.stdout:9/817: stat db/d10/d27/d2f/d4c/la5 0 2024-02-19T19:07:38.488 INFO:tasks.workunit.client.1.smithi142.stdout:9/818: stat db/d10/d22/d24/f8b 0 2024-02-19T19:07:38.489 INFO:tasks.workunit.client.1.smithi142.stdout:7/708: mkdir d0/d13/d72/da7/df1 0 2024-02-19T19:07:38.489 INFO:tasks.workunit.client.1.smithi142.stdout:7/709: chown d0/d13/d72/da7/df1 1051051 1 2024-02-19T19:07:38.489 INFO:tasks.workunit.client.1.smithi142.stdout:7/710: chown d0/d1b/d21/d24/d5e/d65/c7b 21 1 2024-02-19T19:07:38.490 INFO:tasks.workunit.client.1.smithi142.stdout:0/718: truncate d23/d28/d2d/d51/dc9/d58/f5d 2387153 0 2024-02-19T19:07:38.490 INFO:tasks.workunit.client.1.smithi142.stdout:0/719: fdatasync d23/d28/f38 0 2024-02-19T19:07:38.491 INFO:tasks.workunit.client.1.smithi142.stdout:9/819: rename db/da2 to db/d10/d32/d3f/db3/deb 0 2024-02-19T19:07:38.492 INFO:tasks.workunit.client.1.smithi142.stdout:9/820: write db/d10/d32/fdb [998020,48458] 0 2024-02-19T19:07:38.493 INFO:tasks.workunit.client.1.smithi142.stdout:7/711: creat d0/d1b/d21/ff2 x:0 0 0 2024-02-19T19:07:38.493 INFO:tasks.workunit.client.1.smithi142.stdout:7/712: chown d0/d13/d1e/db7/lef 1808958 1 2024-02-19T19:07:38.493 INFO:tasks.workunit.client.1.smithi142.stdout:0/720: truncate d23/d28/d2d/d51/dc9/fb9 3280503 0 2024-02-19T19:07:38.495 INFO:tasks.workunit.client.1.smithi142.stdout:7/713: mkdir d0/d1b/d21/d24/d29/d44/de1/df3 0 2024-02-19T19:07:38.497 INFO:tasks.workunit.client.1.smithi142.stdout:7/714: mknod d0/d1b/d21/d24/d29/dd6/cf4 0 2024-02-19T19:07:38.497 INFO:tasks.workunit.client.1.smithi142.stdout:7/715: creat d0/d1b/d21/d24/d29/d44/d49/d9b/ff5 x:0 0 0 2024-02-19T19:07:38.498 INFO:tasks.workunit.client.1.smithi142.stdout:7/716: write d0/f6b [2769682,65873] 0 2024-02-19T19:07:38.498 INFO:tasks.workunit.client.1.smithi142.stdout:7/717: fdatasync d0/d1b/d21/d24/d29/d44/de1/fe7 0 2024-02-19T19:07:38.498 INFO:tasks.workunit.client.1.smithi142.stdout:7/718: truncate d0/d1b/d21/fba 650291 0 2024-02-19T19:07:38.499 INFO:tasks.workunit.client.1.smithi142.stdout:3/991: write d1d/d1e/f53 [1344010,28611] 0 2024-02-19T19:07:38.503 INFO:tasks.workunit.client.1.smithi142.stdout:1/979: dwrite d5/d37/d6c/fb1 [0,4194304] 0 2024-02-19T19:07:38.504 INFO:tasks.workunit.client.1.smithi142.stdout:6/780: dwrite d2/d1f/d20/f2c [0,4194304] 0 2024-02-19T19:07:38.508 INFO:tasks.workunit.client.1.smithi142.stdout:7/719: dread d0/d1b/d21/d24/ddf/f81 [0,4194304] 0 2024-02-19T19:07:38.508 INFO:tasks.workunit.client.1.smithi142.stdout:7/720: truncate d0/d1b/d21/d24/d29/d7e/dde/ff0 591883 0 2024-02-19T19:07:38.509 INFO:tasks.workunit.client.1.smithi142.stdout:7/721: write d0/d1b/d21/d24/d29/d44/d49/d8b/f97 [1094895,63561] 0 2024-02-19T19:07:38.511 INFO:tasks.workunit.client.1.smithi142.stdout:3/992: dread d1d/d1e/d2e/d50/f11d [0,4194304] 0 2024-02-19T19:07:38.514 INFO:tasks.workunit.client.1.smithi142.stdout:6/781: dread d2/d17/d33/d42/da2/fb5 [0,4194304] 0 2024-02-19T19:07:38.514 INFO:tasks.workunit.client.1.smithi142.stdout:6/782: readlink d2/d17/l38 0 2024-02-19T19:07:38.515 INFO:tasks.workunit.client.1.smithi142.stdout:9/821: dwrite db/d10/d27/db9/fc4 [0,4194304] 0 2024-02-19T19:07:38.517 INFO:tasks.workunit.client.1.smithi142.stdout:3/993: unlink d1d/d1e/d2e/d50/d7c/da7/d52/d71/faa 0 2024-02-19T19:07:38.517 INFO:tasks.workunit.client.1.smithi142.stdout:3/994: chown d1d/fa1 1723 1 2024-02-19T19:07:38.517 INFO:tasks.workunit.client.1.smithi142.stdout:0/721: dwrite d23/d86/f8b [4194304,4194304] 0 2024-02-19T19:07:38.517 INFO:tasks.workunit.client.1.smithi142.stdout:7/722: write d0/d13/f27 [2267362,128112] 0 2024-02-19T19:07:38.517 INFO:tasks.workunit.client.1.smithi142.stdout:0/722: creat d23/d28/d2d/d54/fe8 x:0 0 0 2024-02-19T19:07:38.520 INFO:tasks.workunit.client.1.smithi142.stdout:6/783: rename d2/d17/d33/d42/d5e/d7b to d2/d1e/d35/d66/d8d/d3e/d8c/d10b 0 2024-02-19T19:07:38.523 INFO:tasks.workunit.client.1.smithi142.stdout:3/995: truncate d1d/fa1 1120246 0 2024-02-19T19:07:38.527 INFO:tasks.workunit.client.1.smithi142.stdout:7/723: creat d0/d1b/dbc/dcb/ff6 x:0 0 0 2024-02-19T19:07:38.527 INFO:tasks.workunit.client.1.smithi142.stdout:7/724: stat d0/d1b/d21/d24/d5e/f63 0 2024-02-19T19:07:38.527 INFO:tasks.workunit.client.1.smithi142.stdout:7/725: read d0/d1b/d21/d24/ddf/f81 [3386026,49721] 0 2024-02-19T19:07:38.527 INFO:tasks.workunit.client.1.smithi142.stdout:7/726: write d0/d13/d1e/fb2 [927650,78143] 0 2024-02-19T19:07:38.527 INFO:tasks.workunit.client.1.smithi142.stdout:0/723: mknod d23/ce9 0 2024-02-19T19:07:38.533 INFO:tasks.workunit.client.1.smithi142.stdout:9/822: rename db/d10/d27/db9/fc4 to db/d8e/fec 0 2024-02-19T19:07:38.533 INFO:tasks.workunit.client.1.smithi142.stdout:9/823: truncate db/d10/d22/d24/f3e 5236404 0 2024-02-19T19:07:38.534 INFO:tasks.workunit.client.1.smithi142.stdout:3/996: truncate d1d/d1e/dcd/fd0 3192204 0 2024-02-19T19:07:38.535 INFO:tasks.workunit.client.1.smithi142.stdout:0/724: mknod d23/d28/d2d/d51/dc9/cea 0 2024-02-19T19:07:38.536 INFO:tasks.workunit.client.1.smithi142.stdout:0/725: fdatasync d23/d28/d41/f9d 0 2024-02-19T19:07:38.537 INFO:tasks.workunit.client.1.smithi142.stdout:6/784: rename d2/d17/l38 to d2/d17/d33/d42/d5e/l10c 0 2024-02-19T19:07:38.538 INFO:tasks.workunit.client.1.smithi142.stdout:9/824: creat db/d10/d22/d24/d41/dd2/dd3/fed x:0 0 0 2024-02-19T19:07:38.538 INFO:tasks.workunit.client.1.smithi142.stdout:9/825: write db/d10/d27/db9/fcf [159906,493] 0 2024-02-19T19:07:38.539 INFO:tasks.workunit.client.1.smithi142.stdout:0/726: creat d23/d32/d8a/db1/feb x:0 0 0 2024-02-19T19:07:38.539 INFO:tasks.workunit.client.1.smithi142.stdout:4/939: sync 2024-02-19T19:07:38.539 INFO:tasks.workunit.client.1.smithi142.stdout:0/727: write f17 [4526034,120671] 0 2024-02-19T19:07:38.539 INFO:tasks.workunit.client.1.smithi142.stdout:5/838: sync 2024-02-19T19:07:38.540 INFO:tasks.workunit.client.1.smithi142.stdout:7/727: dwrite d0/d1b/d21/d24/d5e/d65/f74 [0,4194304] 0 2024-02-19T19:07:38.540 INFO:tasks.workunit.client.1.smithi142.stdout:7/728: fdatasync d0/d13/f15 0 2024-02-19T19:07:38.540 INFO:tasks.workunit.client.1.smithi142.stdout:6/785: creat d2/d17/d33/d42/da2/da7/d55/f10d x:0 0 0 2024-02-19T19:07:38.542 INFO:tasks.workunit.client.1.smithi142.stdout:4/940: creat d4/d1d/d42/d66/dd/d10/d3b/f13d x:0 0 0 2024-02-19T19:07:38.542 INFO:tasks.workunit.client.1.smithi142.stdout:4/941: readlink d4/d1d/d42/d66/dd/d10/l9b 0 2024-02-19T19:07:38.543 INFO:tasks.workunit.client.1.smithi142.stdout:5/839: symlink d5/dd/d8/d31/d4d/d75/d9e/l11c 0 2024-02-19T19:07:38.544 INFO:tasks.workunit.client.1.smithi142.stdout:5/840: write d5/dd/df/d22/d41/d32/d53/ffb [2443036,99133] 0 2024-02-19T19:07:38.544 INFO:tasks.workunit.client.1.smithi142.stdout:5/841: truncate d5/dd/d8/d29/f78 874367 0 2024-02-19T19:07:38.547 INFO:tasks.workunit.client.1.smithi142.stdout:7/729: symlink d0/d1b/d21/d24/lf7 0 2024-02-19T19:07:38.549 INFO:tasks.workunit.client.1.smithi142.stdout:4/942: mknod d4/d1d/d42/d66/d12/d2d/dcd/c13e 0 2024-02-19T19:07:38.549 INFO:tasks.workunit.client.1.smithi142.stdout:4/943: creat d4/d1d/d42/d66/dd/d10/d3e/d68/d87/f13f x:0 0 0 2024-02-19T19:07:38.549 INFO:tasks.workunit.client.1.smithi142.stdout:0/728: write d23/d32/f6a [2613951,33653] 0 2024-02-19T19:07:38.550 INFO:tasks.workunit.client.1.smithi142.stdout:5/842: creat d5/dd/df/d22/dc0/f11d x:0 0 0 2024-02-19T19:07:38.551 INFO:tasks.workunit.client.1.smithi142.stdout:9/826: read db/d10/d22/f9e [266429,26900] 0 2024-02-19T19:07:38.558 INFO:tasks.workunit.client.1.smithi142.stdout:6/786: dwrite d2/d17/d33/d39/f49 [0,4194304] 0 2024-02-19T19:07:38.559 INFO:tasks.workunit.client.1.smithi142.stdout:7/730: rename d0/d1b/d21/d24/d29/d44/d49/d7a to d0/d1b/d21/d24/d5e/df8 0 2024-02-19T19:07:38.559 INFO:tasks.workunit.client.1.smithi142.stdout:7/731: read - d0/d1b/dbc/dcb/ff6 zero size 2024-02-19T19:07:38.562 INFO:tasks.workunit.client.1.smithi142.stdout:9/827: write db/d10/d22/d24/f3c [135765,41430] 0 2024-02-19T19:07:38.562 INFO:tasks.workunit.client.1.smithi142.stdout:4/944: creat d4/d1d/d42/d66/d12/d2d/dcd/f140 x:0 0 0 2024-02-19T19:07:38.564 INFO:tasks.workunit.client.1.smithi142.stdout:0/729: creat d23/d28/fec x:0 0 0 2024-02-19T19:07:38.567 INFO:tasks.workunit.client.1.smithi142.stdout:5/843: dwrite d5/dd/df/d22/d41/d32/f35 [0,4194304] 0 2024-02-19T19:07:38.567 INFO:tasks.workunit.client.1.smithi142.stdout:5/844: readlink d5/dd/d8/d1c/l28 0 2024-02-19T19:07:38.568 INFO:tasks.workunit.client.1.smithi142.stdout:6/787: creat d2/d1e/d35/d66/d8d/f10e x:0 0 0 2024-02-19T19:07:38.568 INFO:tasks.workunit.client.1.smithi142.stdout:6/788: write d2/d1e/d35/d66/d8d/d3e/ffc [1040534,24341] 0 2024-02-19T19:07:38.568 INFO:tasks.workunit.client.1.smithi142.stdout:6/789: chown d2/d17/d33/f83 599668 1 2024-02-19T19:07:38.568 INFO:tasks.workunit.client.1.smithi142.stdout:6/790: write d2/d17/d33/d42/da2/da7/dd2/dd3/fd4 [3284639,14229] 0 2024-02-19T19:07:38.568 INFO:tasks.workunit.client.1.smithi142.stdout:6/791: fdatasync d2/d17/d33/d42/da2/da7/f91 0 2024-02-19T19:07:38.568 INFO:tasks.workunit.client.1.smithi142.stdout:6/792: write d2/d1e/d35/d66/d8d/d3e/f46 [873090,6332] 0 2024-02-19T19:07:38.569 INFO:tasks.workunit.client.1.smithi142.stdout:6/793: write d2/d29/d47/f4a [2034554,12993] 0 2024-02-19T19:07:38.569 INFO:tasks.workunit.client.1.smithi142.stdout:7/732: truncate d0/d13/d72/f88 1033479 0 2024-02-19T19:07:38.570 INFO:tasks.workunit.client.1.smithi142.stdout:4/945: mknod d4/d1d/d42/d66/d12/d79/d8c/d119/c141 0 2024-02-19T19:07:38.571 INFO:tasks.workunit.client.1.smithi142.stdout:5/845: symlink d5/dd/d8/dd4/d116/l11e 0 2024-02-19T19:07:38.571 INFO:tasks.workunit.client.1.smithi142.stdout:5/846: truncate d5/dd/d8/d31/d4d/d60/f66 1485871 0 2024-02-19T19:07:38.574 INFO:tasks.workunit.client.1.smithi142.stdout:6/794: mkdir d2/d1e/d35/d66/d8d/d3e/d8c/d10b/d10f 0 2024-02-19T19:07:38.575 INFO:tasks.workunit.client.1.smithi142.stdout:7/733: creat d0/d1b/d21/d24/d29/d44/dbd/ff9 x:0 0 0 2024-02-19T19:07:38.575 INFO:tasks.workunit.client.1.smithi142.stdout:7/734: chown d0/d13/d72/lee 7865 1 2024-02-19T19:07:38.576 INFO:tasks.workunit.client.1.smithi142.stdout:4/946: link d4/d14/d31/f8d d4/d1d/d42/d66/d12/d79/d8c/d119/de7/f142 0 2024-02-19T19:07:38.578 INFO:tasks.workunit.client.1.smithi142.stdout:5/847: creat d5/dd/d8/dd4/d116/f11f x:0 0 0 2024-02-19T19:07:38.578 INFO:tasks.workunit.client.1.smithi142.stdout:5/848: chown d5/dd/d5f/f81 6299 1 2024-02-19T19:07:38.579 INFO:tasks.workunit.client.1.smithi142.stdout:6/795: mkdir d2/d17/d33/d42/da2/da7/d55/dc0/d110 0 2024-02-19T19:07:38.580 INFO:tasks.workunit.client.1.smithi142.stdout:7/735: mkdir d0/d1b/d9d/da4/dfa 0 2024-02-19T19:07:38.580 INFO:tasks.workunit.client.1.smithi142.stdout:7/736: creat d0/d1b/d21/d24/d5e/d65/ffb x:0 0 0 2024-02-19T19:07:38.583 INFO:tasks.workunit.client.1.smithi142.stdout:5/849: symlink d5/dd/d8/d5d/l120 0 2024-02-19T19:07:38.587 INFO:tasks.workunit.client.1.smithi142.stdout:6/796: rename d2/d1f/d4d/d60/db6 to d2/d29/d111 0 2024-02-19T19:07:38.587 INFO:tasks.workunit.client.1.smithi142.stdout:4/947: write d4/d14/f16 [3136927,126211] 0 2024-02-19T19:07:38.590 INFO:tasks.workunit.client.1.smithi142.stdout:5/850: unlink d5/dd/df/d15/c76 0 2024-02-19T19:07:38.592 INFO:tasks.workunit.client.1.smithi142.stdout:4/948: creat d4/d1d/d42/d66/d12/d79/d8c/d119/d6e/f143 x:0 0 0 2024-02-19T19:07:38.592 INFO:tasks.workunit.client.1.smithi142.stdout:5/851: symlink d5/l121 0 2024-02-19T19:07:38.592 INFO:tasks.workunit.client.1.smithi142.stdout:4/949: write d4/d1c/dae/dcb/ff6 [234813,4505] 0 2024-02-19T19:07:38.592 INFO:tasks.workunit.client.1.smithi142.stdout:8/844: sync 2024-02-19T19:07:38.592 INFO:tasks.workunit.client.1.smithi142.stdout:8/845: stat d9/dd/d15/d31/d5e/f62 0 2024-02-19T19:07:38.593 INFO:tasks.workunit.client.1.smithi142.stdout:5/852: unlink d5/dd/d8/d1c/d8a/f9c 0 2024-02-19T19:07:38.594 INFO:tasks.workunit.client.1.smithi142.stdout:4/950: creat d4/f144 x:0 0 0 2024-02-19T19:07:38.598 INFO:tasks.workunit.client.1.smithi142.stdout:8/846: rename d9/dd/f1c to d9/dd/de/d14/d65/d6c/da7/d10b/d74/f10c 0 2024-02-19T19:07:38.599 INFO:tasks.workunit.client.1.smithi142.stdout:5/853: symlink d5/dd/d8/d31/l122 0 2024-02-19T19:07:38.602 INFO:tasks.workunit.client.1.smithi142.stdout:7/737: dwrite d0/d1b/d21/d24/d29/d44/f66 [0,4194304] 0 2024-02-19T19:07:38.602 INFO:tasks.workunit.client.1.smithi142.stdout:7/738: fsync d0/d13/d72/d47/d69/f2e 0 2024-02-19T19:07:38.602 INFO:tasks.workunit.client.1.smithi142.stdout:6/797: dwrite d2/d1f/d20/f52 [0,4194304] 0 2024-02-19T19:07:38.602 INFO:tasks.workunit.client.1.smithi142.stdout:8/847: mkdir d9/dd/de/d2d/d2e/d73/d77/d10d 0 2024-02-19T19:07:38.604 INFO:tasks.workunit.client.1.smithi142.stdout:5/854: link d5/dd/d8/d1c/la9 d5/dd/d8/d2a/d93/l123 0 2024-02-19T19:07:38.611 INFO:tasks.workunit.client.1.smithi142.stdout:7/739: mkdir d0/d13/de4/dfc 0 2024-02-19T19:07:38.611 INFO:tasks.workunit.client.1.smithi142.stdout:7/740: write d0/d1b/d21/d24/f28 [2756266,27483] 0 2024-02-19T19:07:38.611 INFO:tasks.workunit.client.1.smithi142.stdout:7/741: creat d0/d1b/ffd x:0 0 0 2024-02-19T19:07:38.611 INFO:tasks.workunit.client.1.smithi142.stdout:7/742: write d0/f9 [2926155,31746] 0 2024-02-19T19:07:38.612 INFO:tasks.workunit.client.1.smithi142.stdout:6/798: mkdir d2/d1e/d35/d66/d8d/d3e/d8c/d112 0 2024-02-19T19:07:38.613 INFO:tasks.workunit.client.1.smithi142.stdout:8/848: getdents d9/dd/de 0 2024-02-19T19:07:38.614 INFO:tasks.workunit.client.1.smithi142.stdout:8/849: dread - d9/dd/de/d14/d65/d94/ff4 zero size 2024-02-19T19:07:38.625 INFO:tasks.workunit.client.1.smithi142.stdout:6/799: dread d2/d17/d33/d39/f70 [0,4194304] 0 2024-02-19T19:07:38.626 INFO:tasks.workunit.client.1.smithi142.stdout:7/743: dwrite d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:38.628 INFO:tasks.workunit.client.1.smithi142.stdout:6/800: mkdir d2/d17/d33/d42/da2/da7/d55/dc0/d110/d113 0 2024-02-19T19:07:38.634 INFO:tasks.workunit.client.1.smithi142.stdout:8/850: dwrite d9/dd/de/d14/d65/d6c/f3a [4194304,4194304] 0 2024-02-19T19:07:38.639 INFO:tasks.workunit.client.1.smithi142.stdout:2/703: sync 2024-02-19T19:07:38.640 INFO:tasks.workunit.client.1.smithi142.stdout:2/704: creat d3/db/d29/d4c/d4e/d9a/da9/dad/fe4 x:0 0 0 2024-02-19T19:07:38.640 INFO:tasks.workunit.client.1.smithi142.stdout:2/705: write d3/fac [266396,35053] 0 2024-02-19T19:07:38.640 INFO:tasks.workunit.client.1.smithi142.stdout:2/706: dread - d3/db/d29/d4c/dae/fe3 zero size 2024-02-19T19:07:38.641 INFO:tasks.workunit.client.1.smithi142.stdout:6/801: dread d2/d17/d33/d42/da2/da7/d55/daf/fb3 [0,4194304] 0 2024-02-19T19:07:38.641 INFO:tasks.workunit.client.1.smithi142.stdout:2/707: rename d3/db/fd1 to d3/db/d29/d4c/d4e/db9/fe5 0 2024-02-19T19:07:38.642 INFO:tasks.workunit.client.1.smithi142.stdout:2/708: truncate d3/d68/f87 989352 0 2024-02-19T19:07:38.642 INFO:tasks.workunit.client.1.smithi142.stdout:2/709: dread - d3/d4d/d81/fc8 zero size 2024-02-19T19:07:38.642 INFO:tasks.workunit.client.1.smithi142.stdout:8/851: write d9/dd/d15/f1f [2710905,1162] 0 2024-02-19T19:07:38.642 INFO:tasks.workunit.client.1.smithi142.stdout:8/852: getdents d9/dd/d15/dd6/ddd 0 2024-02-19T19:07:38.642 INFO:tasks.workunit.client.1.smithi142.stdout:8/853: write d9/dd/d15/d31/fda [186675,122021] 0 2024-02-19T19:07:38.643 INFO:tasks.workunit.client.1.smithi142.stdout:6/802: link d2/d17/d33/d42/da2/da7/f91 d2/d17/d33/d42/da2/da7/d55/d69/d100/f114 0 2024-02-19T19:07:38.644 INFO:tasks.workunit.client.1.smithi142.stdout:6/803: creat d2/d17/d33/d42/da2/da7/dd2/f115 x:0 0 0 2024-02-19T19:07:38.649 INFO:tasks.workunit.client.1.smithi142.stdout:7/744: dwrite d0/d1b/f59 [0,4194304] 0 2024-02-19T19:07:38.649 INFO:tasks.workunit.client.1.smithi142.stdout:7/745: truncate d0/d1b/d21/d24/d29/d44/de1/fe7 692595 0 2024-02-19T19:07:38.653 INFO:tasks.workunit.client.1.smithi142.stdout:2/710: read d3/db/d29/f5d [4023226,22282] 0 2024-02-19T19:07:38.656 INFO:tasks.workunit.client.1.smithi142.stdout:8/854: write d9/f4e [3115442,45992] 0 2024-02-19T19:07:38.656 INFO:tasks.workunit.client.1.smithi142.stdout:8/855: truncate d9/dd/de/d2d/d2e/d73/f92 995678 0 2024-02-19T19:07:38.656 INFO:tasks.workunit.client.1.smithi142.stdout:8/856: stat d9/dd/de/d2d 0 2024-02-19T19:07:38.656 INFO:tasks.workunit.client.1.smithi142.stdout:7/746: dread d0/d13/d72/da7/faf [0,4194304] 0 2024-02-19T19:07:38.659 INFO:tasks.workunit.client.1.smithi142.stdout:8/857: rename d9/dd/de/d14/d65/d6c/da7/lc1 to d9/l10e 0 2024-02-19T19:07:38.665 INFO:tasks.workunit.client.1.smithi142.stdout:6/804: dwrite d2/d1e/d35/f10a [0,4194304] 0 2024-02-19T19:07:38.669 INFO:tasks.workunit.client.1.smithi142.stdout:7/747: rmdir d0/d1b/d21/d24/d29 39 2024-02-19T19:07:38.669 INFO:tasks.workunit.client.1.smithi142.stdout:7/748: chown d0/d1b/d21/d24/d29/d44/d49/d9b/fa0 187967 1 2024-02-19T19:07:38.670 INFO:tasks.workunit.client.1.smithi142.stdout:8/858: rmdir d9/dd/d15/d31 39 2024-02-19T19:07:38.670 INFO:tasks.workunit.client.1.smithi142.stdout:8/859: write d9/dd/de/f86 [1172717,15495] 0 2024-02-19T19:07:38.672 INFO:tasks.workunit.client.1.smithi142.stdout:6/805: rmdir d2/d1f/d56/d65 39 2024-02-19T19:07:38.672 INFO:tasks.workunit.client.1.smithi142.stdout:6/806: write d2/d17/d33/f83 [603023,14639] 0 2024-02-19T19:07:38.673 INFO:tasks.workunit.client.1.smithi142.stdout:7/749: mknod d0/d1b/d21/d24/d29/d44/de1/df3/cfe 0 2024-02-19T19:07:38.675 INFO:tasks.workunit.client.1.smithi142.stdout:6/807: rmdir d2/d1f/d4d 39 2024-02-19T19:07:38.677 INFO:tasks.workunit.client.1.smithi142.stdout:6/808: mkdir d2/d1f/d4d/d60/d87/d116 0 2024-02-19T19:07:38.677 INFO:tasks.workunit.client.1.smithi142.stdout:6/809: truncate d2/d1f/f2b 720004 0 2024-02-19T19:07:38.679 INFO:tasks.workunit.client.1.smithi142.stdout:6/810: mkdir d2/d17/d33/d42/d5e/d117 0 2024-02-19T19:07:38.680 INFO:tasks.workunit.client.1.smithi142.stdout:6/811: write d2/d17/d33/d42/f104 [28507,42905] 0 2024-02-19T19:07:38.680 INFO:tasks.workunit.client.1.smithi142.stdout:6/812: fsync d2/d1e/d35/d66/d8d/d3e/ffc 0 2024-02-19T19:07:38.680 INFO:tasks.workunit.client.1.smithi142.stdout:6/813: fsync d2/d1f/d56/f8e 0 2024-02-19T19:07:38.682 INFO:tasks.workunit.client.1.smithi142.stdout:7/750: read d0/d1b/d21/d24/d5e/f63 [1805709,46554] 0 2024-02-19T19:07:38.682 INFO:tasks.workunit.client.1.smithi142.stdout:6/814: mknod d2/d1e/d35/d66/d76/c118 0 2024-02-19T19:07:38.683 INFO:tasks.workunit.client.1.smithi142.stdout:7/751: dread d0/d1b/d21/d24/d29/d44/de1/fe7 [0,4194304] 0 2024-02-19T19:07:38.685 INFO:tasks.workunit.client.1.smithi142.stdout:6/815: unlink d2/d17/d33/d42/da2/da7/cdb 0 2024-02-19T19:07:38.685 INFO:tasks.workunit.client.1.smithi142.stdout:6/816: fdatasync d2/d1e/d35/d66/d8d/d3e/f58 0 2024-02-19T19:07:38.685 INFO:tasks.workunit.client.1.smithi142.stdout:6/817: fsync d2/d17/d33/d39/ff8 0 2024-02-19T19:07:38.687 INFO:tasks.workunit.client.1.smithi142.stdout:8/860: dwrite d9/dd/de/d14/d65/d6c/f9b [0,4194304] 0 2024-02-19T19:07:38.690 INFO:tasks.workunit.client.1.smithi142.stdout:8/861: unlink d9/dd/de/d14/d65/d94/f9d 0 2024-02-19T19:07:38.691 INFO:tasks.workunit.client.1.smithi142.stdout:8/862: mknod d9/dd/de/d2d/d2e/d73/c10f 0 2024-02-19T19:07:38.692 INFO:tasks.workunit.client.1.smithi142.stdout:8/863: creat d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/da9/f110 x:0 0 0 2024-02-19T19:07:38.694 INFO:tasks.workunit.client.1.smithi142.stdout:8/864: symlink d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/da9/l111 0 2024-02-19T19:07:38.694 INFO:tasks.workunit.client.1.smithi142.stdout:8/865: write d9/dd/d15/d31/fbb [2629264,122108] 0 2024-02-19T19:07:38.695 INFO:tasks.workunit.client.1.smithi142.stdout:1/980: sync 2024-02-19T19:07:38.695 INFO:tasks.workunit.client.1.smithi142.stdout:3/997: sync 2024-02-19T19:07:38.695 INFO:tasks.workunit.client.1.smithi142.stdout:1/981: stat d5/d7/d23/d41/c69 0 2024-02-19T19:07:38.695 INFO:tasks.workunit.client.1.smithi142.stdout:1/982: creat d5/d7/d23/d41/d135/f14f x:0 0 0 2024-02-19T19:07:38.695 INFO:tasks.workunit.client.1.smithi142.stdout:1/983: fsync d5/d37/d6c/fb1 0 2024-02-19T19:07:38.695 INFO:tasks.workunit.client.1.smithi142.stdout:3/998: chown d1d/d1e/d2e/d50/d83/fae 3 1 2024-02-19T19:07:38.696 INFO:tasks.workunit.client.1.smithi142.stdout:7/752: dwrite d0/d1b/d21/d24/d29/d44/d49/d9b/fb4 [0,4194304] 0 2024-02-19T19:07:38.698 INFO:tasks.workunit.client.1.smithi142.stdout:1/984: creat d5/d7/d23/d41/f150 x:0 0 0 2024-02-19T19:07:38.700 INFO:tasks.workunit.client.1.smithi142.stdout:3/999: creat d1d/d1e/d2e/d50/d7c/da7/f141 x:0 0 0 2024-02-19T19:07:38.703 INFO:tasks.workunit.client.1.smithi142.stdout:6/818: rmdir d2/d17/d33/d42 39 2024-02-19T19:07:38.705 INFO:tasks.workunit.client.1.smithi142.stdout:8/866: dread d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/f82 [0,4194304] 0 2024-02-19T19:07:38.705 INFO:tasks.workunit.client.1.smithi142.stdout:6/819: creat d2/d17/d33/d42/da2/da7/d55/dc0/d110/f119 x:0 0 0 2024-02-19T19:07:38.707 INFO:tasks.workunit.client.1.smithi142.stdout:6/820: mknod d2/d1f/d56/c11a 0 2024-02-19T19:07:38.707 INFO:tasks.workunit.client.1.smithi142.stdout:6/821: dread - d2/d1f/d4d/d60/d87/ff9 zero size 2024-02-19T19:07:38.708 INFO:tasks.workunit.client.1.smithi142.stdout:6/822: creat d2/d1f/d56/d65/f11b x:0 0 0 2024-02-19T19:07:38.708 INFO:tasks.workunit.client.1.smithi142.stdout:6/823: creat d2/d1e/d35/d66/f11c x:0 0 0 2024-02-19T19:07:38.708 INFO:tasks.workunit.client.1.smithi142.stdout:1/985: write d5/d7/fd3 [2596296,7256] 0 2024-02-19T19:07:38.710 INFO:tasks.workunit.client.1.smithi142.stdout:6/824: mkdir d2/d1f/d20/d31/d88/d8f/d102/d11d 0 2024-02-19T19:07:38.710 INFO:tasks.workunit.client.1.smithi142.stdout:6/825: chown d2/d1e/d35/d66/f7f 6066640 1 2024-02-19T19:07:38.710 INFO:tasks.workunit.client.1.smithi142.stdout:7/753: dwrite d0/d1b/d21/d24/d29/d44/d49/fe8 [0,4194304] 0 2024-02-19T19:07:38.713 INFO:tasks.workunit.client.1.smithi142.stdout:1/986: mknod d5/d77/da9/dae/deb/df9/c151 0 2024-02-19T19:07:38.715 INFO:tasks.workunit.client.1.smithi142.stdout:6/826: mknod d2/d17/d33/d42/da2/da7/d55/c11e 0 2024-02-19T19:07:38.719 INFO:tasks.workunit.client.1.smithi142.stdout:7/754: creat d0/d1b/d21/d24/d5e/fff x:0 0 0 2024-02-19T19:07:38.720 INFO:tasks.workunit.client.1.smithi142.stdout:6/827: write d2/d1e/d35/d66/d76/fcd [973638,25641] 0 2024-02-19T19:07:38.721 INFO:tasks.workunit.client.1.smithi142.stdout:1/987: read d5/d37/d6c/fb1 [3429343,76511] 0 2024-02-19T19:07:38.721 INFO:tasks.workunit.client.1.smithi142.stdout:8/867: dwrite d9/dd/d15/d31/d96/fe9 [0,4194304] 0 2024-02-19T19:07:38.721 INFO:tasks.workunit.client.1.smithi142.stdout:8/868: write d9/dd/de/d2d/d2e/f3d [3123207,117792] 0 2024-02-19T19:07:38.721 INFO:tasks.workunit.client.1.smithi142.stdout:8/869: stat d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/da9/cd0 0 2024-02-19T19:07:38.722 INFO:tasks.workunit.client.1.smithi142.stdout:6/828: getdents d2/d1e/d35/d66/d76/db9 0 2024-02-19T19:07:38.730 INFO:tasks.workunit.client.1.smithi142.stdout:7/755: dread d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:38.735 INFO:tasks.workunit.client.1.smithi142.stdout:8/870: link d9/dd/de/d2d/d2e/d73/d77/f67 d9/dd/d15/d31/d96/f112 0 2024-02-19T19:07:38.736 INFO:tasks.workunit.client.1.smithi142.stdout:8/871: fdatasync d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/da9/f100 0 2024-02-19T19:07:38.737 INFO:tasks.workunit.client.1.smithi142.stdout:6/829: mkdir d2/d1f/d20/d11f 0 2024-02-19T19:07:38.737 INFO:tasks.workunit.client.1.smithi142.stdout:6/830: write d2/d17/d33/d39/f86 [828468,14472] 0 2024-02-19T19:07:38.738 INFO:tasks.workunit.client.1.smithi142.stdout:6/831: dread d2/d1f/d5c/f9a [0,4194304] 0 2024-02-19T19:07:38.738 INFO:tasks.workunit.client.1.smithi142.stdout:8/872: creat d9/dd/d15/d31/f113 x:0 0 0 2024-02-19T19:07:38.740 INFO:tasks.workunit.client.1.smithi142.stdout:6/832: symlink d2/d29/d111/l120 0 2024-02-19T19:07:38.741 INFO:tasks.workunit.client.1.smithi142.stdout:8/873: dread d9/dd/d15/d31/d96/f112 [0,4194304] 0 2024-02-19T19:07:38.742 INFO:tasks.workunit.client.1.smithi142.stdout:6/833: unlink d2/d1f/d20/d31/fac 0 2024-02-19T19:07:38.742 INFO:tasks.workunit.client.1.smithi142.stdout:6/834: truncate d2/d1f/d20/d31/ff3 826980 0 2024-02-19T19:07:38.743 INFO:tasks.workunit.client.1.smithi142.stdout:8/874: symlink d9/dd/de/d14/d65/l114 0 2024-02-19T19:07:38.744 INFO:tasks.workunit.client.1.smithi142.stdout:6/835: creat d2/d1f/d20/d31/d88/d8f/d102/f121 x:0 0 0 2024-02-19T19:07:38.746 INFO:tasks.workunit.client.1.smithi142.stdout:8/875: truncate d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/f76 42146 0 2024-02-19T19:07:38.747 INFO:tasks.workunit.client.1.smithi142.stdout:0/730: sync 2024-02-19T19:07:38.748 INFO:tasks.workunit.client.1.smithi142.stdout:9/828: sync 2024-02-19T19:07:38.748 INFO:tasks.workunit.client.1.smithi142.stdout:4/951: sync 2024-02-19T19:07:38.748 INFO:tasks.workunit.client.1.smithi142.stdout:0/731: dread - d23/d28/d2d/d54/d85/fcf zero size 2024-02-19T19:07:38.748 INFO:tasks.workunit.client.1.smithi142.stdout:5/855: sync 2024-02-19T19:07:38.748 INFO:tasks.workunit.client.1.smithi142.stdout:5/856: chown d5/dd/d8/d31 259939 1 2024-02-19T19:07:38.748 INFO:tasks.workunit.client.1.smithi142.stdout:9/829: write db/f18 [2730072,69718] 0 2024-02-19T19:07:38.748 INFO:tasks.workunit.client.1.smithi142.stdout:7/756: dwrite d0/d13/de4/fec [0,4194304] 0 2024-02-19T19:07:38.748 INFO:tasks.workunit.client.1.smithi142.stdout:1/988: dwrite d5/f4e [0,4194304] 0 2024-02-19T19:07:38.749 INFO:tasks.workunit.client.1.smithi142.stdout:1/989: fdatasync d5/d7/d4a/d53/d6a/fd2 0 2024-02-19T19:07:38.749 INFO:tasks.workunit.client.1.smithi142.stdout:0/732: unlink f16 0 2024-02-19T19:07:38.755 INFO:tasks.workunit.client.1.smithi142.stdout:9/830: unlink db/f2b 0 2024-02-19T19:07:38.755 INFO:tasks.workunit.client.1.smithi142.stdout:9/831: dread - db/d10/d22/d24/fc6 zero size 2024-02-19T19:07:38.755 INFO:tasks.workunit.client.1.smithi142.stdout:9/832: write db/f16 [4583345,126939] 0 2024-02-19T19:07:38.755 INFO:tasks.workunit.client.1.smithi142.stdout:9/833: creat db/d10/d27/fee x:0 0 0 2024-02-19T19:07:38.756 INFO:tasks.workunit.client.1.smithi142.stdout:4/952: getdents d4/d1d 0 2024-02-19T19:07:38.756 INFO:tasks.workunit.client.1.smithi142.stdout:4/953: write d4/d1d/d42/d66/dd/f6a [371116,50972] 0 2024-02-19T19:07:38.758 INFO:tasks.workunit.client.1.smithi142.stdout:8/876: dread d9/dd/f57 [0,4194304] 0 2024-02-19T19:07:38.758 INFO:tasks.workunit.client.1.smithi142.stdout:5/857: write d5/dd/d8/d31/d4d/d60/f7d [2488163,7083] 0 2024-02-19T19:07:38.758 INFO:tasks.workunit.client.1.smithi142.stdout:5/858: chown d5/fe 5 1 2024-02-19T19:07:38.758 INFO:tasks.workunit.client.1.smithi142.stdout:5/859: fsync d5/dd/d8/ff3 0 2024-02-19T19:07:38.758 INFO:tasks.workunit.client.1.smithi142.stdout:5/860: fdatasync d5/dd/d8/d2a/f90 0 2024-02-19T19:07:38.759 INFO:tasks.workunit.client.1.smithi142.stdout:8/877: write d9/dd/de/d14/d65/db1/fff [609806,86155] 0 2024-02-19T19:07:38.761 INFO:tasks.workunit.client.1.smithi142.stdout:6/836: dwrite d2/d17/d33/d42/da2/da7/dd2/dd3/ffe [0,4194304] 0 2024-02-19T19:07:38.764 INFO:tasks.workunit.client.1.smithi142.stdout:7/757: mknod d0/d1b/dbc/dcb/c100 0 2024-02-19T19:07:38.764 INFO:tasks.workunit.client.1.smithi142.stdout:7/758: readlink d0/d1b/d21/d24/d29/lcf 0 2024-02-19T19:07:38.764 INFO:tasks.workunit.client.1.smithi142.stdout:7/759: read d0/d13/f15 [40715,46474] 0 2024-02-19T19:07:38.764 INFO:tasks.workunit.client.1.smithi142.stdout:1/990: stat d5/d77/da9/dae/deb/df9/c104 0 2024-02-19T19:07:38.766 INFO:tasks.workunit.client.1.smithi142.stdout:0/733: mknod d23/d28/d2d/d51/ced 0 2024-02-19T19:07:38.766 INFO:tasks.workunit.client.1.smithi142.stdout:0/734: chown f22 65114438 1 2024-02-19T19:07:38.769 INFO:tasks.workunit.client.1.smithi142.stdout:9/834: getdents db/d10/d22/d24/d3d 0 2024-02-19T19:07:38.770 INFO:tasks.workunit.client.1.smithi142.stdout:6/837: dread d2/d1f/d20/f52 [0,4194304] 0 2024-02-19T19:07:38.770 INFO:tasks.workunit.client.1.smithi142.stdout:4/954: mkdir d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba/dd2/de8/d145 0 2024-02-19T19:07:38.770 INFO:tasks.workunit.client.1.smithi142.stdout:4/955: readlink d4/d1d/lad 0 2024-02-19T19:07:38.771 INFO:tasks.workunit.client.1.smithi142.stdout:5/861: getdents d5/dd/df/d22/d41/d32/d53 0 2024-02-19T19:07:38.771 INFO:tasks.workunit.client.1.smithi142.stdout:5/862: dread - d5/dd/df/d15/d5b/fb0 zero size 2024-02-19T19:07:38.771 INFO:tasks.workunit.client.1.smithi142.stdout:2/711: sync 2024-02-19T19:07:38.773 INFO:tasks.workunit.client.1.smithi142.stdout:9/835: dread db/d10/d22/d24/d41/dd2/dad/fb4 [0,4194304] 0 2024-02-19T19:07:38.773 INFO:tasks.workunit.client.1.smithi142.stdout:9/836: fsync db/d10/d22/f9e 0 2024-02-19T19:07:38.773 INFO:tasks.workunit.client.1.smithi142.stdout:9/837: stat db/d10/d27/d2f/f5d 0 2024-02-19T19:07:38.773 INFO:tasks.workunit.client.1.smithi142.stdout:9/838: chown db/d10/d27/d2f 16771132 1 2024-02-19T19:07:38.773 INFO:tasks.workunit.client.1.smithi142.stdout:8/878: rename d9/dd/d44/de4/ce5 to d9/dd/de/d14/d65/c115 0 2024-02-19T19:07:38.776 INFO:tasks.workunit.client.1.smithi142.stdout:7/760: creat d0/d1b/d21/d24/d5e/f101 x:0 0 0 2024-02-19T19:07:38.776 INFO:tasks.workunit.client.1.smithi142.stdout:7/761: fsync d0/d13/d72/fdb 0 2024-02-19T19:07:38.776 INFO:tasks.workunit.client.1.smithi142.stdout:7/762: creat d0/d1b/d9d/da4/f102 x:0 0 0 2024-02-19T19:07:38.776 INFO:tasks.workunit.client.1.smithi142.stdout:0/735: dread d23/d28/fd8 [0,4194304] 0 2024-02-19T19:07:38.777 INFO:tasks.workunit.client.1.smithi142.stdout:6/838: mkdir d2/d1e/d35/d66/d122 0 2024-02-19T19:07:38.778 INFO:tasks.workunit.client.1.smithi142.stdout:1/991: creat d5/d77/da9/dae/db2/dea/f152 x:0 0 0 2024-02-19T19:07:38.778 INFO:tasks.workunit.client.1.smithi142.stdout:1/992: fdatasync d5/d77/da9/dae/db2/f10f 0 2024-02-19T19:07:38.778 INFO:tasks.workunit.client.1.smithi142.stdout:1/993: dread - d5/d37/d6c/d75/f12d zero size 2024-02-19T19:07:38.778 INFO:tasks.workunit.client.1.smithi142.stdout:4/956: creat d4/d14/d31/d43/d130/f146 x:0 0 0 2024-02-19T19:07:38.779 INFO:tasks.workunit.client.1.smithi142.stdout:5/863: symlink d5/dd/d8/d31/d4d/d60/l124 0 2024-02-19T19:07:38.780 INFO:tasks.workunit.client.1.smithi142.stdout:5/864: stat d5/dd/d8/d31/f34 0 2024-02-19T19:07:38.780 INFO:tasks.workunit.client.1.smithi142.stdout:9/839: dread db/d10/d22/d81/fea [4194304,4194304] 0 2024-02-19T19:07:38.780 INFO:tasks.workunit.client.1.smithi142.stdout:2/712: mkdir d3/db/d29/d6d/de6 0 2024-02-19T19:07:38.780 INFO:tasks.workunit.client.1.smithi142.stdout:2/713: chown d3/db/d29/c4f 98 1 2024-02-19T19:07:38.782 INFO:tasks.workunit.client.1.smithi142.stdout:0/736: dread d23/d32/f30 [0,4194304] 0 2024-02-19T19:07:38.782 INFO:tasks.workunit.client.1.smithi142.stdout:0/737: chown d23/d32/d8a/f96 623064 1 2024-02-19T19:07:38.785 INFO:tasks.workunit.client.1.smithi142.stdout:6/839: truncate d2/d17/d33/f83 2816142 0 2024-02-19T19:07:38.785 INFO:tasks.workunit.client.1.smithi142.stdout:6/840: truncate d2/d29/d47/f5b 1785910 0 2024-02-19T19:07:38.785 INFO:tasks.workunit.client.1.smithi142.stdout:6/841: read d2/d1f/d56/f6b [7876047,82516] 0 2024-02-19T19:07:38.785 INFO:tasks.workunit.client.1.smithi142.stdout:6/842: dread - d2/d17/d33/d42/da2/da7/dd2/de2/ff0 zero size 2024-02-19T19:07:38.788 INFO:tasks.workunit.client.1.smithi142.stdout:1/994: rename d5/d77/da9/dae/db2/dea/f152 to d5/d1a/d59/d140/f153 0 2024-02-19T19:07:38.788 INFO:tasks.workunit.client.1.smithi142.stdout:1/995: write d5/d7/d23/d41/fcc [358688,71558] 0 2024-02-19T19:07:38.788 INFO:tasks.workunit.client.1.smithi142.stdout:1/996: stat d5/d37/d6c/fb1 0 2024-02-19T19:07:38.788 INFO:tasks.workunit.client.1.smithi142.stdout:7/763: dread d0/d1b/d21/f8d [0,4194304] 0 2024-02-19T19:07:38.788 INFO:tasks.workunit.client.1.smithi142.stdout:5/865: creat d5/dd/d8/d31/df0/f125 x:0 0 0 2024-02-19T19:07:38.789 INFO:tasks.workunit.client.1.smithi142.stdout:2/714: mkdir d3/df/da4/de7 0 2024-02-19T19:07:38.789 INFO:tasks.workunit.client.1.smithi142.stdout:8/879: rmdir d9/dd/de/d2d 39 2024-02-19T19:07:38.790 INFO:tasks.workunit.client.1.smithi142.stdout:6/843: creat d2/d17/d33/d42/d5e/d117/f123 x:0 0 0 2024-02-19T19:07:38.790 INFO:tasks.workunit.client.1.smithi142.stdout:6/844: write d2/d1e/d35/d66/f11c [887670,98986] 0 2024-02-19T19:07:38.791 INFO:tasks.workunit.client.1.smithi142.stdout:1/997: truncate d5/d37/d6c/ff5 1262774 0 2024-02-19T19:07:38.794 INFO:tasks.workunit.client.1.smithi142.stdout:7/764: rename d0/d1b/d21/d24/d29/d44/dbd to d0/d1b/d21/d24/d29/d44/d49/d8b/d103 0 2024-02-19T19:07:38.794 INFO:tasks.workunit.client.1.smithi142.stdout:5/866: mknod d5/dd/d8/d5d/c126 0 2024-02-19T19:07:38.794 INFO:tasks.workunit.client.1.smithi142.stdout:5/867: fdatasync d5/dd/d8/d5d/f7e 0 2024-02-19T19:07:38.794 INFO:tasks.workunit.client.1.smithi142.stdout:2/715: creat d3/db/d29/d6d/de6/fe8 x:0 0 0 2024-02-19T19:07:38.796 INFO:tasks.workunit.client.1.smithi142.stdout:8/880: getdents d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97 0 2024-02-19T19:07:38.796 INFO:tasks.workunit.client.1.smithi142.stdout:8/881: chown d9/dd/de/d14/d65/d6c/c43 2192819 1 2024-02-19T19:07:38.797 INFO:tasks.workunit.client.1.smithi142.stdout:5/868: mkdir d5/dd/d8/d31/d4d/d60/d127 0 2024-02-19T19:07:38.799 INFO:tasks.workunit.client.1.smithi142.stdout:2/716: creat d3/db/dda/fe9 x:0 0 0 2024-02-19T19:07:38.801 INFO:tasks.workunit.client.1.smithi142.stdout:5/869: creat d5/dd/f128 x:0 0 0 2024-02-19T19:07:38.802 INFO:tasks.workunit.client.1.smithi142.stdout:2/717: rmdir d3/d4d/d9f 39 2024-02-19T19:07:38.802 INFO:tasks.workunit.client.1.smithi142.stdout:2/718: readlink d3/df/l30 0 2024-02-19T19:07:38.806 INFO:tasks.workunit.client.1.smithi142.stdout:2/719: rename d3/db/d29/d4c/f77 to d3/d4d/d5f/d7c/fea 0 2024-02-19T19:07:38.807 INFO:tasks.workunit.client.1.smithi142.stdout:2/720: mknod d3/d4d/d81/ceb 0 2024-02-19T19:07:38.808 INFO:tasks.workunit.client.1.smithi142.stdout:8/882: dread d9/dd/de/d2d/d2e/d73/d77/f89 [0,4194304] 0 2024-02-19T19:07:38.808 INFO:tasks.workunit.client.1.smithi142.stdout:4/957: dwrite d4/d1d/d42/d66/d12/fa4 [0,4194304] 0 2024-02-19T19:07:38.808 INFO:tasks.workunit.client.1.smithi142.stdout:4/958: fsync d4/d14/d31/f7d 0 2024-02-19T19:07:38.809 INFO:tasks.workunit.client.1.smithi142.stdout:8/883: write d9/dd/de/d14/d65/fb2 [5315259,55909] 0 2024-02-19T19:07:38.809 INFO:tasks.workunit.client.1.smithi142.stdout:8/884: write d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d8a/f101 [1628299,89017] 0 2024-02-19T19:07:38.809 INFO:tasks.workunit.client.1.smithi142.stdout:8/885: stat d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/da9/cd0 0 2024-02-19T19:07:38.809 INFO:tasks.workunit.client.1.smithi142.stdout:2/721: rmdir d3/db/d29/d4c/d4e/d9a/da9/dad 39 2024-02-19T19:07:38.810 INFO:tasks.workunit.client.1.smithi142.stdout:2/722: mknod d3/cec 0 2024-02-19T19:07:38.812 INFO:tasks.workunit.client.1.smithi142.stdout:2/723: getdents d3/db/d29/d6d 0 2024-02-19T19:07:38.827 INFO:tasks.workunit.client.1.smithi142.stdout:9/840: dwrite db/d10/d27/d2f/dba/f8a [0,4194304] 0 2024-02-19T19:07:38.827 INFO:tasks.workunit.client.1.smithi142.stdout:0/738: dwrite d23/f3a [0,4194304] 0 2024-02-19T19:07:38.829 INFO:tasks.workunit.client.1.smithi142.stdout:0/739: mknod d23/d28/d2d/d51/dc9/cee 0 2024-02-19T19:07:38.829 INFO:tasks.workunit.client.1.smithi142.stdout:9/841: rmdir db/d10/d27/db9 39 2024-02-19T19:07:38.830 INFO:tasks.workunit.client.1.smithi142.stdout:0/740: truncate d23/d32/d8a/f96 361906 0 2024-02-19T19:07:38.833 INFO:tasks.workunit.client.1.smithi142.stdout:9/842: dread db/d10/d7d/f8f [0,4194304] 0 2024-02-19T19:07:38.833 INFO:tasks.workunit.client.1.smithi142.stdout:9/843: fsync db/d10/d27/db9/fcf 0 2024-02-19T19:07:38.833 INFO:tasks.workunit.client.1.smithi142.stdout:9/844: getdents db/d8e 0 2024-02-19T19:07:38.838 INFO:tasks.workunit.client.1.smithi142.stdout:0/741: dread d23/d28/f70 [0,4194304] 0 2024-02-19T19:07:38.839 INFO:tasks.workunit.client.1.smithi142.stdout:0/742: creat d23/d7d/d9e/fef x:0 0 0 2024-02-19T19:07:38.840 INFO:tasks.workunit.client.1.smithi142.stdout:0/743: creat d23/d28/d2d/d54/d85/ff0 x:0 0 0 2024-02-19T19:07:38.840 INFO:tasks.workunit.client.1.smithi142.stdout:0/744: dread - d23/d32/d8a/db1/fc5 zero size 2024-02-19T19:07:38.842 INFO:tasks.workunit.client.1.smithi142.stdout:0/745: truncate d23/d32/d8a/fb0 3921116 0 2024-02-19T19:07:38.842 INFO:tasks.workunit.client.1.smithi142.stdout:0/746: creat d23/d7d/d9e/ff1 x:0 0 0 2024-02-19T19:07:38.842 INFO:tasks.workunit.client.1.smithi142.stdout:0/747: chown d23/d32/d8a/le3 1559590 1 2024-02-19T19:07:38.844 INFO:tasks.workunit.client.1.smithi142.stdout:6/845: dwrite d2/d29/fca [0,4194304] 0 2024-02-19T19:07:38.844 INFO:tasks.workunit.client.1.smithi142.stdout:6/846: readlink d2/d17/d33/d42/l4e 0 2024-02-19T19:07:38.850 INFO:tasks.workunit.client.1.smithi142.stdout:0/748: dread d23/d28/d2d/d51/dc9/d58/f5d [0,4194304] 0 2024-02-19T19:07:38.850 INFO:tasks.workunit.client.1.smithi142.stdout:0/749: write d23/d32/f8f [671727,43149] 0 2024-02-19T19:07:38.850 INFO:tasks.workunit.client.1.smithi142.stdout:0/750: truncate d23/d28/d2d/d51/dc9/d58/f76 4567416 0 2024-02-19T19:07:38.851 INFO:tasks.workunit.client.1.smithi142.stdout:0/751: dread - d23/d32/d8a/db1/fc5 zero size 2024-02-19T19:07:38.852 INFO:tasks.workunit.client.1.smithi142.stdout:0/752: truncate d23/d28/d2d/f79 671646 0 2024-02-19T19:07:38.854 INFO:tasks.workunit.client.1.smithi142.stdout:0/753: getdents d23/d28/d2d 0 2024-02-19T19:07:38.855 INFO:tasks.workunit.client.1.smithi142.stdout:0/754: mknod d23/d32/d8a/cf2 0 2024-02-19T19:07:38.856 INFO:tasks.workunit.client.1.smithi142.stdout:6/847: write d2/d1f/d4d/d60/f90 [2964654,39700] 0 2024-02-19T19:07:38.857 INFO:tasks.workunit.client.1.smithi142.stdout:1/998: dwrite d5/d7/d4a/d53/d6a/ddc/f14a [0,4194304] 0 2024-02-19T19:07:38.857 INFO:tasks.workunit.client.1.smithi142.stdout:1/999: dread - d5/d7/d23/da4/f124 zero size 2024-02-19T19:07:38.858 INFO:tasks.workunit.client.1.smithi142.stdout:2/724: dwrite d3/db/f15 [4194304,4194304] 0 2024-02-19T19:07:38.858 INFO:tasks.workunit.client.1.smithi142.stdout:9/845: dwrite db/d10/f4b [8388608,4194304] 0 2024-02-19T19:07:38.858 INFO:tasks.workunit.client.1.smithi142.stdout:5/870: dwrite d5/dd/df/f59 [0,4194304] 0 2024-02-19T19:07:38.859 INFO:tasks.workunit.client.1.smithi142.stdout:4/959: dwrite d4/d1d/d42/d66/d12/d2d/d2a/fb8 [4194304,4194304] 0 2024-02-19T19:07:38.862 INFO:tasks.workunit.client.1.smithi142.stdout:8/886: dwrite d9/dd/de/d14/d65/d6c/f104 [0,4194304] 0 2024-02-19T19:07:38.862 INFO:tasks.workunit.client.1.smithi142.stdout:6/848: rename d2/d17/d33/d42/da2/da7/l85 to d2/d17/d33/d42/da2/da7/d55/d69/d100/l124 0 2024-02-19T19:07:38.876 INFO:tasks.workunit.client.1.smithi142.stdout:5/871: dread d5/dd/f1e [0,4194304] 0 2024-02-19T19:07:38.887 INFO:tasks.workunit.client.1.smithi142.stdout:6/849: unlink d2/d1f/d56/c11a 0 2024-02-19T19:07:38.888 INFO:tasks.workunit.client.1.smithi142.stdout:5/872: mkdir d5/dd/d8/d29/d129 0 2024-02-19T19:07:38.888 INFO:tasks.workunit.client.1.smithi142.stdout:5/873: write d5/dd/f1e [409485,64655] 0 2024-02-19T19:07:38.889 INFO:tasks.workunit.client.1.smithi142.stdout:6/850: rmdir d2/d17/d33/d42/da2/da7/d55/d69/d100 39 2024-02-19T19:07:38.892 INFO:tasks.workunit.client.1.smithi142.stdout:5/874: getdents d5/dd/d8/dd4/d116 0 2024-02-19T19:07:38.893 INFO:tasks.workunit.client.1.smithi142.stdout:5/875: mknod d5/dd/d5f/c12a 0 2024-02-19T19:07:38.893 INFO:tasks.workunit.client.1.smithi142.stdout:5/876: truncate d5/dd/d5f/f7b 1383589 0 2024-02-19T19:07:38.895 INFO:tasks.workunit.client.1.smithi142.stdout:5/877: mkdir d5/d12b 0 2024-02-19T19:07:38.897 INFO:tasks.workunit.client.1.smithi142.stdout:5/878: rename d5/dd/df/d15/d5b/fce to d5/dd/f12c 0 2024-02-19T19:07:38.899 INFO:tasks.workunit.client.1.smithi142.stdout:5/879: creat d5/dda/f12d x:0 0 0 2024-02-19T19:07:38.914 INFO:tasks.workunit.client.1.smithi142.stdout:0/755: dwrite d23/f3d [0,4194304] 0 2024-02-19T19:07:38.915 INFO:tasks.workunit.client.1.smithi142.stdout:8/887: dwrite d9/dd/de/d14/d65/d6c/da7/fe2 [0,4194304] 0 2024-02-19T19:07:38.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/851: dwrite d2/d1f/d20/d31/ff3 [0,4194304] 0 2024-02-19T19:07:38.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/852: chown d2/d1f/d20/d31/fa8 2158360 1 2024-02-19T19:07:38.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/853: fdatasync d2/d1f/d4d/d60/d87/ff9 0 2024-02-19T19:07:38.915 INFO:tasks.workunit.client.1.smithi142.stdout:6/854: write d2/d1f/d45/faa [4461252,45398] 0 2024-02-19T19:07:38.917 INFO:tasks.workunit.client.1.smithi142.stdout:2/725: dwrite d3/d35/f66 [0,4194304] 0 2024-02-19T19:07:38.917 INFO:tasks.workunit.client.1.smithi142.stdout:9/846: dwrite db/d10/d27/d2f/f94 [0,4194304] 0 2024-02-19T19:07:38.919 INFO:tasks.workunit.client.1.smithi142.stdout:4/960: dwrite d4/d1d/d42/d66/d12/d2d/d2a/f6f [0,4194304] 0 2024-02-19T19:07:38.920 INFO:tasks.workunit.client.1.smithi142.stdout:8/888: mknod d9/dd/de/c116 0 2024-02-19T19:07:38.926 INFO:tasks.workunit.client.1.smithi142.stdout:5/880: dwrite d5/dd/d8/d29/f63 [0,4194304] 0 2024-02-19T19:07:38.928 INFO:tasks.workunit.client.1.smithi142.stdout:9/847: rename db/d10/d22/d24/d41/dd2/dd3/c60 to db/d10/d27/d2f/dc5/cef 0 2024-02-19T19:07:38.931 INFO:tasks.workunit.client.1.smithi142.stdout:8/889: dread d9/fee [0,4194304] 0 2024-02-19T19:07:38.931 INFO:tasks.workunit.client.1.smithi142.stdout:8/890: write d9/dd/de/d14/d65/d6c/da7/d10b/d74/f10c [850770,122747] 0 2024-02-19T19:07:38.932 INFO:tasks.workunit.client.1.smithi142.stdout:8/891: write d9/dd/de/d14/d65/d6c/f33 [4270370,117322] 0 2024-02-19T19:07:38.933 INFO:tasks.workunit.client.1.smithi142.stdout:8/892: chown d9/dd/de/d14/d65/d6c/d9c 7 1 2024-02-19T19:07:38.933 INFO:tasks.workunit.client.1.smithi142.stdout:8/893: chown d9/dd/de/d14/d65/l7c 293 1 2024-02-19T19:07:38.935 INFO:tasks.workunit.client.1.smithi142.stdout:4/961: rmdir d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f/d112 39 2024-02-19T19:07:38.935 INFO:tasks.workunit.client.1.smithi142.stdout:4/962: write d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba/dd2/ff4 [3804752,119126] 0 2024-02-19T19:07:38.935 INFO:tasks.workunit.client.1.smithi142.stdout:2/726: dwrite d3/f8 [0,4194304] 0 2024-02-19T19:07:38.937 INFO:tasks.workunit.client.1.smithi142.stdout:5/881: symlink d5/dd/d8/d31/d4d/l12e 0 2024-02-19T19:07:38.938 INFO:tasks.workunit.client.1.smithi142.stdout:5/882: chown d5/dd/df/d22/f37 365 1 2024-02-19T19:07:38.941 INFO:tasks.workunit.client.1.smithi142.stdout:6/855: dwrite d2/d1f/d20/d31/fa8 [4194304,4194304] 0 2024-02-19T19:07:38.941 INFO:tasks.workunit.client.1.smithi142.stdout:8/894: truncate d9/dd/f1d 3017688 0 2024-02-19T19:07:38.942 INFO:tasks.workunit.client.1.smithi142.stdout:4/963: symlink d4/d1d/d42/d66/d12/d2d/l147 0 2024-02-19T19:07:38.943 INFO:tasks.workunit.client.1.smithi142.stdout:2/727: symlink d3/d68/led 0 2024-02-19T19:07:38.947 INFO:tasks.workunit.client.1.smithi142.stdout:5/883: rename d5/dd/df/d22/d41/d32/ca1 to d5/dd/d95/c12f 0 2024-02-19T19:07:38.947 INFO:tasks.workunit.client.1.smithi142.stdout:9/848: mkdir db/df0 0 2024-02-19T19:07:38.949 INFO:tasks.workunit.client.1.smithi142.stdout:8/895: unlink d9/l5a 0 2024-02-19T19:07:38.950 INFO:tasks.workunit.client.1.smithi142.stdout:8/896: truncate d9/dd/de/d14/d65/d6c/da7/d10b/f88 357801 0 2024-02-19T19:07:38.950 INFO:tasks.workunit.client.1.smithi142.stdout:8/897: chown d9/dd/de/d2d/l48 5693 1 2024-02-19T19:07:38.950 INFO:tasks.workunit.client.1.smithi142.stdout:4/964: creat d4/d1d/d42/d66/dd/d10/d3e/d68/db4/dba/dd2/de8/d145/f148 x:0 0 0 2024-02-19T19:07:38.950 INFO:tasks.workunit.client.1.smithi142.stdout:4/965: readlink d4/d14/d31/l109 0 2024-02-19T19:07:38.951 INFO:tasks.workunit.client.1.smithi142.stdout:2/728: creat d3/d4d/fee x:0 0 0 2024-02-19T19:07:38.952 INFO:tasks.workunit.client.1.smithi142.stdout:2/729: chown d3/d4d/d81/lc5 27532775 1 2024-02-19T19:07:38.954 INFO:tasks.workunit.client.1.smithi142.stdout:5/884: mkdir d5/dd/d8/d31/df0/d130 0 2024-02-19T19:07:38.956 INFO:tasks.workunit.client.1.smithi142.stdout:8/898: mkdir d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/d117 0 2024-02-19T19:07:38.957 INFO:tasks.workunit.client.1.smithi142.stdout:4/966: unlink d4/f144 0 2024-02-19T19:07:38.959 INFO:tasks.workunit.client.1.smithi142.stdout:2/730: symlink d3/d4d/d9f/lef 0 2024-02-19T19:07:38.959 INFO:tasks.workunit.client.1.smithi142.stdout:2/731: chown d3/d68/led 1 1 2024-02-19T19:07:38.960 INFO:tasks.workunit.client.1.smithi142.stdout:2/732: rmdir d3/d35/d97 39 2024-02-19T19:07:38.962 INFO:tasks.workunit.client.1.smithi142.stdout:2/733: link d3/db/f34 d3/d68/d95/dca/ff0 0 2024-02-19T19:07:38.963 INFO:tasks.workunit.client.1.smithi142.stdout:2/734: symlink d3/d68/d95/dca/lf1 0 2024-02-19T19:07:38.964 INFO:tasks.workunit.client.1.smithi142.stdout:2/735: symlink d3/db/d29/d4c/dae/lf2 0 2024-02-19T19:07:38.964 INFO:tasks.workunit.client.1.smithi142.stdout:2/736: creat d3/d68/d95/dca/ff3 x:0 0 0 2024-02-19T19:07:38.967 INFO:tasks.workunit.client.1.smithi142.stdout:2/737: creat d3/d4b/dbb/ff4 x:0 0 0 2024-02-19T19:07:38.967 INFO:tasks.workunit.client.1.smithi142.stdout:5/885: read d5/dd/fd3 [2870524,27213] 0 2024-02-19T19:07:38.967 INFO:tasks.workunit.client.1.smithi142.stdout:9/849: dwrite db/d10/d22/d24/d41/dd2/dad/fe1 [0,4194304] 0 2024-02-19T19:07:38.968 INFO:tasks.workunit.client.1.smithi142.stdout:4/967: write d4/d1d/d42/fa8 [982625,126400] 0 2024-02-19T19:07:38.968 INFO:tasks.workunit.client.1.smithi142.stdout:6/856: dwrite d2/d1e/d35/d66/d8d/d3e/d8c/feb [0,4194304] 0 2024-02-19T19:07:38.968 INFO:tasks.workunit.client.1.smithi142.stdout:2/738: rename d3/db/d29/f55 to d3/d68/d95/ff5 0 2024-02-19T19:07:38.968 INFO:tasks.workunit.client.1.smithi142.stdout:7/765: sync 2024-02-19T19:07:38.968 INFO:tasks.workunit.client.1.smithi142.stdout:7/766: dread - d0/d1b/d9d/fd8 zero size 2024-02-19T19:07:38.969 INFO:tasks.workunit.client.1.smithi142.stdout:5/886: mkdir d5/dda/d131 0 2024-02-19T19:07:38.969 INFO:tasks.workunit.client.1.smithi142.stdout:8/899: dread d9/dd/f57 [0,4194304] 0 2024-02-19T19:07:38.971 INFO:tasks.workunit.client.1.smithi142.stdout:9/850: mkdir db/d10/df1 0 2024-02-19T19:07:38.975 INFO:tasks.workunit.client.1.smithi142.stdout:4/968: unlink d4/d1d/d42/d66/dd/d10/d26/d50/f12d 0 2024-02-19T19:07:38.977 INFO:tasks.workunit.client.1.smithi142.stdout:6/857: getdents d2/d1f/d4d/d60/d87 0 2024-02-19T19:07:38.979 INFO:tasks.workunit.client.1.smithi142.stdout:2/739: symlink d3/d35/d97/lf6 0 2024-02-19T19:07:38.982 INFO:tasks.workunit.client.1.smithi142.stdout:7/767: rename d0/d13/d72/d47/d69/ce0 to d0/d1b/d21/d24/d29/d7e/dde/c104 0 2024-02-19T19:07:38.985 INFO:tasks.workunit.client.1.smithi142.stdout:5/887: creat d5/dd/d8/d31/d4d/d8d/d113/f132 x:0 0 0 2024-02-19T19:07:38.985 INFO:tasks.workunit.client.1.smithi142.stdout:8/900: creat d9/dd/de/d14/d65/d6c/da7/d10b/d50/f118 x:0 0 0 2024-02-19T19:07:38.985 INFO:tasks.workunit.client.1.smithi142.stdout:8/901: stat d9/dd/de/d2d/d2e/f3d 0 2024-02-19T19:07:38.986 INFO:tasks.workunit.client.1.smithi142.stdout:6/858: dread d2/d1e/d35/d66/f7f [0,4194304] 0 2024-02-19T19:07:38.986 INFO:tasks.workunit.client.1.smithi142.stdout:5/888: write d5/dd/d8/d31/d4d/d60/f66 [1339855,80286] 0 2024-02-19T19:07:38.988 INFO:tasks.workunit.client.1.smithi142.stdout:9/851: rename db/d8e/fec to db/d10/d22/d24/d3d/ff2 0 2024-02-19T19:07:38.991 INFO:tasks.workunit.client.1.smithi142.stdout:7/768: unlink d0/d1b/d21/d24/d29/d44/d49/l7c 0 2024-02-19T19:07:38.992 INFO:tasks.workunit.client.1.smithi142.stdout:8/902: rmdir d9/dd/de/d14/d65/d6c/da7 39 2024-02-19T19:07:38.997 INFO:tasks.workunit.client.1.smithi142.stdout:4/969: rename d4/d1d/d42/d66/dd/d10/d26/d50/d54/fca to d4/d1d/d42/d66/dd/dac/d12e/f149 0 2024-02-19T19:07:38.998 INFO:tasks.workunit.client.1.smithi142.stdout:9/852: symlink db/d10/d22/lf3 0 2024-02-19T19:07:38.999 INFO:tasks.workunit.client.1.smithi142.stdout:7/769: symlink d0/d1b/d21/d24/d5e/d65/d86/l105 0 2024-02-19T19:07:39.001 INFO:tasks.workunit.client.1.smithi142.stdout:8/903: mkdir d9/dd/de/d14/d65/d94/dec/d119 0 2024-02-19T19:07:39.002 INFO:tasks.workunit.client.1.smithi142.stdout:9/853: truncate db/d10/fe7 474261 0 2024-02-19T19:07:39.002 INFO:tasks.workunit.client.1.smithi142.stdout:9/854: truncate db/d10/d32/d3f/f75 5098626 0 2024-02-19T19:07:39.003 INFO:tasks.workunit.client.1.smithi142.stdout:7/770: creat d0/d1b/d21/d24/d5e/f106 x:0 0 0 2024-02-19T19:07:39.004 INFO:tasks.workunit.client.1.smithi142.stdout:2/740: dwrite d3/df/f31 [0,4194304] 0 2024-02-19T19:07:39.005 INFO:tasks.workunit.client.1.smithi142.stdout:4/970: write d4/d1d/d42/d66/d12/d2d/f69 [336791,23230] 0 2024-02-19T19:07:39.005 INFO:tasks.workunit.client.1.smithi142.stdout:4/971: write d4/d1d/d42/d66/d12/f7f [1974443,14646] 0 2024-02-19T19:07:39.005 INFO:tasks.workunit.client.1.smithi142.stdout:5/889: dwrite d5/dd/d8/dd4/d116/f11f [0,4194304] 0 2024-02-19T19:07:39.006 INFO:tasks.workunit.client.1.smithi142.stdout:8/904: creat d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/dc3/f11a x:0 0 0 2024-02-19T19:07:39.008 INFO:tasks.workunit.client.1.smithi142.stdout:9/855: unlink db/d10/d32/d3f/ce8 0 2024-02-19T19:07:39.019 INFO:tasks.workunit.client.1.smithi142.stdout:9/856: truncate db/d10/d22/d24/f3e 3862554 0 2024-02-19T19:07:39.020 INFO:tasks.workunit.client.1.smithi142.stdout:5/890: getdents d5/dd/d5f 0 2024-02-19T19:07:39.020 INFO:tasks.workunit.client.1.smithi142.stdout:5/891: write d5/dd/d8/dd4/db4/f10f [484887,128654] 0 2024-02-19T19:07:39.020 INFO:tasks.workunit.client.1.smithi142.stdout:5/892: fdatasync d5/dd/f68 0 2024-02-19T19:07:39.021 INFO:tasks.workunit.client.1.smithi142.stdout:4/972: dwrite d4/d1d/d42/d66/d5f/fdf [0,4194304] 0 2024-02-19T19:07:39.022 INFO:tasks.workunit.client.1.smithi142.stdout:8/905: mknod d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/c11b 0 2024-02-19T19:07:39.022 INFO:tasks.workunit.client.1.smithi142.stdout:8/906: readlink d9/dd/de/d14/d65/d94/lcd 0 2024-02-19T19:07:39.022 INFO:tasks.workunit.client.1.smithi142.stdout:8/907: fdatasync d9/dd/de/d14/d65/d6c/f33 0 2024-02-19T19:07:39.022 INFO:tasks.workunit.client.1.smithi142.stdout:8/908: fsync d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/da9/ff0 0 2024-02-19T19:07:39.022 INFO:tasks.workunit.client.1.smithi142.stdout:8/909: chown d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe 749 1 2024-02-19T19:07:39.022 INFO:tasks.workunit.client.1.smithi142.stdout:8/910: chown d9/dd/de/d2d/d2e/f52 19 1 2024-02-19T19:07:39.023 INFO:tasks.workunit.client.1.smithi142.stdout:8/911: write d9/dd/d15/d31/f113 [655216,112160] 0 2024-02-19T19:07:39.026 INFO:tasks.workunit.client.1.smithi142.stdout:5/893: creat d5/dd/d8/d5d/d102/f133 x:0 0 0 2024-02-19T19:07:39.026 INFO:tasks.workunit.client.1.smithi142.stdout:5/894: read - d5/dd/d8/d2a/d57/f112 zero size 2024-02-19T19:07:39.026 INFO:tasks.workunit.client.1.smithi142.stdout:5/895: fdatasync d5/dd/df/d22/d41/d6f/f89 0 2024-02-19T19:07:39.026 INFO:tasks.workunit.client.1.smithi142.stdout:5/896: truncate d5/f20 2572234 0 2024-02-19T19:07:39.027 INFO:tasks.workunit.client.1.smithi142.stdout:2/741: dwrite d3/df/da4/fd8 [0,4194304] 0 2024-02-19T19:07:39.031 INFO:tasks.workunit.client.1.smithi142.stdout:4/973: mkdir d4/d1d/d42/d66/d12/d79/d8c/d119/da2/db3/d14a 0 2024-02-19T19:07:39.031 INFO:tasks.workunit.client.1.smithi142.stdout:8/912: dread d9/fee [0,4194304] 0 2024-02-19T19:07:39.031 INFO:tasks.workunit.client.1.smithi142.stdout:5/897: mkdir d5/dd/d8/dbc/d134 0 2024-02-19T19:07:39.032 INFO:tasks.workunit.client.1.smithi142.stdout:9/857: dread db/d10/d22/fbe [0,4194304] 0 2024-02-19T19:07:39.035 INFO:tasks.workunit.client.1.smithi142.stdout:2/742: symlink d3/db/d29/d6d/d59/db4/lf7 0 2024-02-19T19:07:39.038 INFO:tasks.workunit.client.1.smithi142.stdout:8/913: rename d9/dd/de/d14/d65/d6c/cd8 to d9/dd/de/d14/c11c 0 2024-02-19T19:07:39.040 INFO:tasks.workunit.client.1.smithi142.stdout:5/898: symlink d5/dd/df/d22/l135 0 2024-02-19T19:07:39.040 INFO:tasks.workunit.client.1.smithi142.stdout:5/899: dread - d5/dd/d8/d31/d4d/d60/f108 zero size 2024-02-19T19:07:39.041 INFO:tasks.workunit.client.1.smithi142.stdout:5/900: fsync d5/dda/f12d 0 2024-02-19T19:07:39.042 INFO:tasks.workunit.client.1.smithi142.stdout:9/858: mkdir db/d10/d32/d91/df4 0 2024-02-19T19:07:39.045 INFO:tasks.workunit.client.1.smithi142.stdout:2/743: unlink d3/db/d29/d6d/d59/fcf 0 2024-02-19T19:07:39.046 INFO:tasks.workunit.client.1.smithi142.stdout:9/859: creat db/d10/d22/d24/d41/db8/ff5 x:0 0 0 2024-02-19T19:07:39.047 INFO:tasks.workunit.client.1.smithi142.stdout:9/860: write db/d10/d22/d24/f79 [516759,30013] 0 2024-02-19T19:07:39.048 INFO:tasks.workunit.client.1.smithi142.stdout:2/744: creat d3/df/da4/ff8 x:0 0 0 2024-02-19T19:07:39.049 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:38 smithi046 ceph-mon[88928]: pgmap v81: 65 pgs: 9 active+clean+remapped, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 953 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 142 MiB/s rd, 167 MiB/s wr, 235 op/s; 5573/32943 objects degraded (16.917%); 1368/32943 objects misplaced (4.153%); 3.7 MiB/s, 91 objects/s recovering 2024-02-19T19:07:39.050 INFO:tasks.workunit.client.1.smithi142.stdout:9/861: truncate db/d10/d22/d24/f92 7655044 0 2024-02-19T19:07:39.051 INFO:tasks.workunit.client.1.smithi142.stdout:2/745: mkdir d3/db/d29/d4c/df9 0 2024-02-19T19:07:39.052 INFO:tasks.workunit.client.1.smithi142.stdout:9/862: truncate db/d10/d22/f50 57649 0 2024-02-19T19:07:39.055 INFO:tasks.workunit.client.1.smithi142.stdout:4/974: dwrite d4/d1c/f22 [0,4194304] 0 2024-02-19T19:07:39.056 INFO:tasks.workunit.client.1.smithi142.stdout:0/756: sync 2024-02-19T19:07:39.057 INFO:tasks.workunit.client.1.smithi142.stdout:5/901: dwrite d5/dd/d8/d29/f78 [0,4194304] 0 2024-02-19T19:07:39.059 INFO:tasks.workunit.client.1.smithi142.stdout:4/975: rename d4/d1d/d42/d66/dd/f4a to d4/d1d/d42/d66/dd/d10/d3b/d3f/d100/f14b 0 2024-02-19T19:07:39.060 INFO:tasks.workunit.client.1.smithi142.stdout:0/757: creat d23/d28/d2d/d54/d88/de0/ff3 x:0 0 0 2024-02-19T19:07:39.060 INFO:tasks.workunit.client.1.smithi142.stdout:2/746: write d3/df/da4/fd8 [1801169,3099] 0 2024-02-19T19:07:39.061 INFO:tasks.workunit.client.1.smithi142.stdout:0/758: readlink d23/d28/d2d/d51/l6e 0 2024-02-19T19:07:39.068 INFO:tasks.workunit.client.1.smithi142.stdout:4/976: dread d4/d1d/d42/d66/dd/d10/d26/d50/d54/f59 [0,4194304] 0 2024-02-19T19:07:39.068 INFO:tasks.workunit.client.1.smithi142.stdout:4/977: chown d4/d1d/d42/d66/dd/d10/d3e/d68 13 1 2024-02-19T19:07:39.068 INFO:tasks.workunit.client.1.smithi142.stdout:0/759: getdents d23/d86 0 2024-02-19T19:07:39.071 INFO:tasks.workunit.client.1.smithi142.stdout:2/747: dread d3/db/f3a [0,4194304] 0 2024-02-19T19:07:39.072 INFO:tasks.workunit.client.1.smithi142.stdout:4/978: mkdir d4/d14c 0 2024-02-19T19:07:39.073 INFO:tasks.workunit.client.1.smithi142.stdout:2/748: stat d3/d4d/d81/cdd 0 2024-02-19T19:07:39.073 INFO:tasks.workunit.client.1.smithi142.stdout:2/749: chown d3/d35/d53/ldc 386907961 1 2024-02-19T19:07:39.074 INFO:tasks.workunit.client.1.smithi142.stdout:9/863: dwrite db/d10/d22/f46 [0,4194304] 0 2024-02-19T19:07:39.074 INFO:tasks.workunit.client.1.smithi142.stdout:9/864: readlink db/d10/d27/d2f/d4c/l48 0 2024-02-19T19:07:39.074 INFO:tasks.workunit.client.1.smithi142.stdout:9/865: fdatasync db/d10/d22/d24/d41/f74 0 2024-02-19T19:07:39.075 INFO:tasks.workunit.client.1.smithi142.stdout:2/750: unlink d3/db/fc 0 2024-02-19T19:07:39.075 INFO:tasks.workunit.client.1.smithi142.stdout:2/751: truncate d3/d35/f48 2357518 0 2024-02-19T19:07:39.075 INFO:tasks.workunit.client.1.smithi142.stdout:2/752: fdatasync d3/d4d/f6c 0 2024-02-19T19:07:39.075 INFO:tasks.workunit.client.1.smithi142.stdout:5/902: dwrite d5/dd/d8/d5d/fe6 [0,4194304] 0 2024-02-19T19:07:39.075 INFO:tasks.workunit.client.1.smithi142.stdout:4/979: dread d4/d1d/d42/d66/dd/d10/d26/d50/d54/d9f/fbe [0,4194304] 0 2024-02-19T19:07:39.079 INFO:tasks.workunit.client.1.smithi142.stdout:4/980: truncate d4/d1d/d42/d66/d12/d79/d8c/d119/d6e/d126/d44/fe5 1084495 0 2024-02-19T19:07:39.080 INFO:tasks.workunit.client.1.smithi142.stdout:9/866: dread db/d10/d27/fe5 [0,4194304] 0 2024-02-19T19:07:39.082 INFO:tasks.workunit.client.1.smithi142.stdout:9/867: unlink db/d10/d22/d24/f79 0 2024-02-19T19:07:39.082 INFO:tasks.workunit.client.1.smithi142.stdout:9/868: chown db/d10/d22/d24/d41/d99/cd6 107 1 2024-02-19T19:07:39.082 INFO:tasks.workunit.client.1.smithi142.stdout:9/869: write db/d10/d32/fb7 [617911,46246] 0 2024-02-19T19:07:39.083 INFO:tasks.workunit.client.1.smithi142.stdout:9/870: mknod db/d10/d22/d24/cf6 0 2024-02-19T19:07:39.084 INFO:tasks.workunit.client.1.smithi142.stdout:5/903: dread d5/dd/df/d22/d41/d32/d53/ffb [0,4194304] 0 2024-02-19T19:07:39.084 INFO:tasks.workunit.client.1.smithi142.stdout:5/904: fdatasync d5/dd/d5f/fc5 0 2024-02-19T19:07:39.084 INFO:tasks.workunit.client.1.smithi142.stdout:9/871: read db/d10/d22/f9d [90438,19963] 0 2024-02-19T19:07:39.092 INFO:tasks.workunit.client.1.smithi142.stdout:9/872: getdents db/d10/d22/d24 0 2024-02-19T19:07:39.094 INFO:tasks.workunit.client.1.smithi142.stdout:9/873: truncate db/d10/d22/d24/d41/d99/fb1 1951277 0 2024-02-19T19:07:39.094 INFO:tasks.workunit.client.1.smithi142.stdout:9/874: write db/f68 [450617,87907] 0 2024-02-19T19:07:39.095 INFO:tasks.workunit.client.1.smithi142.stdout:4/981: dwrite d4/d1d/d42/d66/d2c/fa5 [0,4194304] 0 2024-02-19T19:07:39.095 INFO:tasks.workunit.client.1.smithi142.stdout:9/875: creat db/d10/d27/d2f/ff7 x:0 0 0 2024-02-19T19:07:39.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/982: unlink d4/d1d/d42/d66/dd/d10/d3b/d3f/d100/l122 0 2024-02-19T19:07:39.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/983: stat d4/d1d/d42/d66/dd/d10/d3b/d3f/fe0 0 2024-02-19T19:07:39.099 INFO:tasks.workunit.client.1.smithi142.stdout:4/984: truncate d4/d1d/d42/d66/dd/d10/d3b/f13d 533499 0 2024-02-19T19:07:39.100 INFO:tasks.workunit.client.1.smithi142.stdout:4/985: chown d4/d1d/d42/d66/d5f/c80 9406 1 2024-02-19T19:07:39.100 INFO:tasks.workunit.client.1.smithi142.stdout:9/876: link db/d10/d22/d24/d41/dd2/cac db/d10/d27/d2f/d4c/cf8 0 2024-02-19T19:07:39.100 INFO:tasks.workunit.client.1.smithi142.stdout:9/877: chown db/d10/d27/d2f/d4c/l48 10288 1 2024-02-19T19:07:39.102 INFO:tasks.workunit.client.1.smithi142.stdout:9/878: mkdir db/d10/d22/d24/d41/dd2/dad/df9 0 2024-02-19T19:07:39.102 INFO:tasks.workunit.client.1.smithi142.stdout:9/879: fsync db/d10/f4b 0 2024-02-19T19:07:39.102 INFO:tasks.workunit.client.1.smithi142.stdout:5/905: dwrite d5/dd/d8/d2a/d93/faa [0,4194304] 0 2024-02-19T19:07:39.121 INFO:tasks.workunit.client.1.smithi142.stdout:4/986: dwrite d4/d1d/d42/d66/dd/d10/d3e/d68/d87/f13f [0,4194304] 0 2024-02-19T19:07:39.121 INFO:tasks.workunit.client.1.smithi142.stdout:4/987: chown d4/d1d/d42/d66/d12/d79/d8c/d119/da2/f120 38008694 1 2024-02-19T19:07:39.121 INFO:tasks.workunit.client.1.smithi142.stdout:4/988: fsync d4/d1d/d42/d66/d12/d79/d8c/d119/de7/f142 0 2024-02-19T19:07:39.122 INFO:tasks.workunit.client.1.smithi142.stdout:4/989: write d4/d1d/d42/d66/dd/d10/d3e/d68/fcc [54531,27061] 0 2024-02-19T19:07:39.122 INFO:tasks.workunit.client.1.smithi142.stdout:9/880: dwrite db/d10/d22/d24/d41/db8/ff5 [0,4194304] 0 2024-02-19T19:07:39.123 INFO:tasks.workunit.client.1.smithi142.stdout:4/990: truncate d4/d14/d31/d43/f48 6312557 0 2024-02-19T19:07:39.127 INFO:tasks.workunit.client.1.smithi142.stdout:9/881: creat db/d10/d27/d2f/d4c/ffa x:0 0 0 2024-02-19T19:07:39.127 INFO:tasks.workunit.client.1.smithi142.stdout:9/882: chown db/d10/d27/d2f/d4c/cf8 35663 1 2024-02-19T19:07:39.128 INFO:tasks.workunit.client.1.smithi142.stdout:4/991: symlink d4/d1d/d42/d66/d2c/l14d 0 2024-02-19T19:07:39.129 INFO:tasks.workunit.client.1.smithi142.stdout:9/883: truncate db/d10/d22/d24/d41/d99/fb1 597864 0 2024-02-19T19:07:39.129 INFO:tasks.workunit.client.1.smithi142.stdout:9/884: chown db/d10 77 1 2024-02-19T19:07:39.135 INFO:tasks.workunit.client.1.smithi142.stdout:4/992: read d4/d1d/d42/d66/d2c/fa0 [3284955,72976] 0 2024-02-19T19:07:39.136 INFO:tasks.workunit.client.1.smithi142.stdout:6/859: sync 2024-02-19T19:07:39.147 INFO:tasks.workunit.client.1.smithi142.stdout:4/993: write d4/d1d/d42/d66/d12/d2d/d2a/f6f [3931503,29413] 0 2024-02-19T19:07:39.150 INFO:tasks.workunit.client.1.smithi142.stdout:6/860: dread d2/d1e/d35/d66/f8b [0,4194304] 0 2024-02-19T19:07:39.150 INFO:tasks.workunit.client.1.smithi142.stdout:4/994: unlink d4/d1c/dae/fde 0 2024-02-19T19:07:39.150 INFO:tasks.workunit.client.1.smithi142.stdout:6/861: mkdir d2/d1f/d4d/d125 0 2024-02-19T19:07:39.151 INFO:tasks.workunit.client.1.smithi142.stdout:6/862: truncate d2/d17/d33/f83 642925 0 2024-02-19T19:07:39.152 INFO:tasks.workunit.client.1.smithi142.stdout:6/863: mknod d2/d17/d33/d42/da2/da7/d55/d69/c126 0 2024-02-19T19:07:39.154 INFO:tasks.workunit.client.1.smithi142.stdout:6/864: rename d2/d1e/d35/d66/d8d/d3e/d8c/d10b/fc9 to d2/d17/d33/d42/da2/da7/d55/d69/f127 0 2024-02-19T19:07:39.154 INFO:tasks.workunit.client.1.smithi142.stdout:6/865: getdents d2/d1f/d4d/d60/d87/d116 0 2024-02-19T19:07:39.156 INFO:tasks.workunit.client.1.smithi142.stdout:9/885: dwrite db/d10/d7d/f8f [0,4194304] 0 2024-02-19T19:07:39.160 INFO:tasks.workunit.client.1.smithi142.stdout:9/886: rename db/d10/d22/d24/d41/dd2/dd3/fb0 to db/d10/d27/ffb 0 2024-02-19T19:07:39.160 INFO:tasks.workunit.client.1.smithi142.stdout:4/995: read d4/d1d/d42/d66/dd/d10/d3e/d68/d87/f13f [1342705,107395] 0 2024-02-19T19:07:39.161 INFO:tasks.workunit.client.1.smithi142.stdout:9/887: unlink db/d8e/l96 0 2024-02-19T19:07:39.161 INFO:tasks.workunit.client.1.smithi142.stdout:9/888: stat db/d10/d7d/f78 0 2024-02-19T19:07:39.161 INFO:tasks.workunit.client.1.smithi142.stdout:9/889: creat db/d10/d22/d24/d41/d99/ffc x:0 0 0 2024-02-19T19:07:39.161 INFO:tasks.workunit.client.1.smithi142.stdout:9/890: chown db/d10/d22/d24/f92 22 1 2024-02-19T19:07:39.162 INFO:tasks.workunit.client.1.smithi142.stdout:4/996: link d4/d1d/d42/d66/dd/d10/d26/d50/d54/l58 d4/d1c/dae/dfa/l14e 0 2024-02-19T19:07:39.165 INFO:tasks.workunit.client.1.smithi142.stdout:9/891: rename db/d10/d32/d3f/db3/lb5 to db/df0/lfd 0 2024-02-19T19:07:39.166 INFO:tasks.workunit.client.1.smithi142.stdout:4/997: rename d4/d1d/d42/d66/d5f/fd1 to d4/d1d/d42/d66/d12/d79/f14f 0 2024-02-19T19:07:39.167 INFO:tasks.workunit.client.1.smithi142.stdout:9/892: creat db/d10/d27/db9/ffe x:0 0 0 2024-02-19T19:07:39.167 INFO:tasks.workunit.client.1.smithi142.stdout:9/893: stat db/d10/d27/d2f/d4c/c2e 0 2024-02-19T19:07:39.167 INFO:tasks.workunit.client.1.smithi142.stdout:9/894: chown db/d10/d32/d3f/caa 34001 1 2024-02-19T19:07:39.169 INFO:tasks.workunit.client.1.smithi142.stdout:6/866: dwrite d2/d1f/d45/faa [0,4194304] 0 2024-02-19T19:07:39.169 INFO:tasks.workunit.client.1.smithi142.stdout:6/867: creat d2/d17/d33/d42/da2/da7/d55/dc0/d110/f128 x:0 0 0 2024-02-19T19:07:39.177 INFO:tasks.workunit.client.1.smithi142.stdout:4/998: rmdir d4/d1d/d42/d66/dd/d10 39 2024-02-19T19:07:39.177 INFO:tasks.workunit.client.1.smithi142.stdout:4/999: fsync d4/d1d/d42/d66/dd/d10/d26/d50/d54/f59 0 2024-02-19T19:07:39.177 INFO:tasks.workunit.client.1.smithi142.stdout:9/895: write db/d10/d27/d2f/f94 [2999341,55049] 0 2024-02-19T19:07:39.180 INFO:tasks.workunit.client.1.smithi142.stdout:6/868: symlink d2/d1f/d20/d31/d88/d8f/l129 0 2024-02-19T19:07:39.183 INFO:tasks.workunit.client.1.smithi142.stdout:6/869: mknod d2/d1f/d5c/c12a 0 2024-02-19T19:07:39.183 INFO:tasks.workunit.client.1.smithi142.stdout:6/870: readlink d2/d1f/d20/d31/d88/d8f/l92 0 2024-02-19T19:07:39.183 INFO:tasks.workunit.client.1.smithi142.stdout:9/896: dread db/d10/d32/f7f [0,4194304] 0 2024-02-19T19:07:39.185 INFO:tasks.workunit.client.1.smithi142.stdout:9/897: getdents db/d10/d32/d91 0 2024-02-19T19:07:39.185 INFO:tasks.workunit.client.1.smithi142.stdout:9/898: chown db/d10/d22 92976 1 2024-02-19T19:07:39.185 INFO:tasks.workunit.client.1.smithi142.stdout:7/771: sync 2024-02-19T19:07:39.190 INFO:tasks.workunit.client.1.smithi142.stdout:7/772: rename d0/d1b/d21/d24/d5e/d65 to d0/d1b/d21/d107 0 2024-02-19T19:07:39.190 INFO:tasks.workunit.client.1.smithi142.stdout:7/773: chown d0/d1b/d21/d24/d5e/f63 0 1 2024-02-19T19:07:39.193 INFO:tasks.workunit.client.1.smithi142.stdout:7/774: creat d0/d1b/d21/d24/d29/f108 x:0 0 0 2024-02-19T19:07:39.197 INFO:tasks.workunit.client.1.smithi142.stdout:7/775: dread d0/d1b/d21/d24/d29/d44/d49/d8b/d103/fdc [0,4194304] 0 2024-02-19T19:07:39.197 INFO:tasks.workunit.client.1.smithi142.stdout:7/776: write d0/d1b/d9d/da4/fcc [843878,54257] 0 2024-02-19T19:07:39.197 INFO:tasks.workunit.client.1.smithi142.stdout:7/777: fsync d0/d13/d1e/f71 0 2024-02-19T19:07:39.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:38 smithi142 ceph-mon[69118]: pgmap v81: 65 pgs: 9 active+clean+remapped, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 953 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 142 MiB/s rd, 167 MiB/s wr, 235 op/s; 5573/32943 objects degraded (16.917%); 1368/32943 objects misplaced (4.153%); 3.7 MiB/s, 91 objects/s recovering 2024-02-19T19:07:39.202 INFO:tasks.workunit.client.1.smithi142.stdout:9/899: dwrite db/d10/d27/d2f/dba/f8a [4194304,4194304] 0 2024-02-19T19:07:39.202 INFO:tasks.workunit.client.1.smithi142.stdout:6/871: dwrite d2/f5f [0,4194304] 0 2024-02-19T19:07:39.205 INFO:tasks.workunit.client.1.smithi142.stdout:6/872: link d2/d17/lfd d2/d1f/d20/d31/d62/l12b 0 2024-02-19T19:07:39.212 INFO:tasks.workunit.client.1.smithi142.stdout:9/900: write db/d10/d22/d24/d41/dd2/dad/fe1 [2277931,87686] 0 2024-02-19T19:07:39.213 INFO:tasks.workunit.client.1.smithi142.stdout:7/778: dwrite d0/d1b/d21/d24/d29/d44/d49/d8b/d103/fdc [0,4194304] 0 2024-02-19T19:07:39.213 INFO:tasks.workunit.client.1.smithi142.stdout:9/901: stat db/d10/d27/c90 0 2024-02-19T19:07:39.216 INFO:tasks.workunit.client.1.smithi142.stdout:5/906: sync 2024-02-19T19:07:39.216 INFO:tasks.workunit.client.1.smithi142.stdout:0/760: sync 2024-02-19T19:07:39.216 INFO:tasks.workunit.client.1.smithi142.stdout:8/914: sync 2024-02-19T19:07:39.216 INFO:tasks.workunit.client.1.smithi142.stdout:2/753: sync 2024-02-19T19:07:39.217 INFO:tasks.workunit.client.1.smithi142.stdout:5/907: dread d5/dd/d8/d2a/d57/fca [0,4194304] 0 2024-02-19T19:07:39.218 INFO:tasks.workunit.client.1.smithi142.stdout:0/761: link d23/d28/d41/fdb d23/d28/d2d/d54/ff4 0 2024-02-19T19:07:39.220 INFO:tasks.workunit.client.1.smithi142.stdout:8/915: symlink d9/dd/de/d14/d65/l11d 0 2024-02-19T19:07:39.221 INFO:tasks.workunit.client.1.smithi142.stdout:9/902: rmdir db/d10/d27/d2f/d4c 39 2024-02-19T19:07:39.221 INFO:tasks.workunit.client.1.smithi142.stdout:9/903: creat db/d10/d22/d24/d41/dd2/dad/fff x:0 0 0 2024-02-19T19:07:39.224 INFO:tasks.workunit.client.1.smithi142.stdout:9/904: dread db/d10/d32/d91/fa1 [0,4194304] 0 2024-02-19T19:07:39.226 INFO:tasks.workunit.client.1.smithi142.stdout:9/905: link db/d10/d27/l98 db/d10/d22/daf/l100 0 2024-02-19T19:07:39.226 INFO:tasks.workunit.client.1.smithi142.stdout:9/906: chown db/d10/d27/d2f/d4c/ffa 14729282 1 2024-02-19T19:07:39.228 INFO:tasks.workunit.client.1.smithi142.stdout:9/907: link db/d10/d32/d91/fa1 db/d8e/f101 0 2024-02-19T19:07:39.228 INFO:tasks.workunit.client.1.smithi142.stdout:9/908: truncate db/d10/d27/d2f/dba/f8a 8866929 0 2024-02-19T19:07:39.228 INFO:tasks.workunit.client.1.smithi142.stdout:0/762: dread f22 [4194304,4194304] 0 2024-02-19T19:07:39.229 INFO:tasks.workunit.client.1.smithi142.stdout:9/909: unlink db/d10/d32/d91/ccb 0 2024-02-19T19:07:39.231 INFO:tasks.workunit.client.1.smithi142.stdout:9/910: unlink db/d10/d27/d2f/d4c/la5 0 2024-02-19T19:07:39.232 INFO:tasks.workunit.client.1.smithi142.stdout:9/911: link db/d10/d22/d24/f3e db/d10/d22/d24/d3d/f102 0 2024-02-19T19:07:39.236 INFO:tasks.workunit.client.1.smithi142.stdout:0/763: write d23/d32/d8a/fb0 [448932,123643] 0 2024-02-19T19:07:39.238 INFO:tasks.workunit.client.1.smithi142.stdout:0/764: mkdir d23/d7d/d9e/dc7/df5 0 2024-02-19T19:07:39.241 INFO:tasks.workunit.client.1.smithi142.stdout:5/908: dwrite d5/dd/f68 [4194304,4194304] 0 2024-02-19T19:07:39.241 INFO:tasks.workunit.client.1.smithi142.stdout:5/909: stat d5/dd/d8/d1c 0 2024-02-19T19:07:39.242 INFO:tasks.workunit.client.1.smithi142.stdout:8/916: dwrite d9/dd/de/d14/d65/f90 [0,4194304] 0 2024-02-19T19:07:39.244 INFO:tasks.workunit.client.1.smithi142.stdout:5/910: dread d5/dd/df/d22/d41/d32/d53/ffb [0,4194304] 0 2024-02-19T19:07:39.245 INFO:tasks.workunit.client.1.smithi142.stdout:2/754: dwrite d3/db/d29/d6d/d59/f6e [0,4194304] 0 2024-02-19T19:07:39.245 INFO:tasks.workunit.client.1.smithi142.stdout:0/765: dread d23/d32/f6a [0,4194304] 0 2024-02-19T19:07:39.245 INFO:tasks.workunit.client.1.smithi142.stdout:2/755: write d3/db/f47 [2051168,52940] 0 2024-02-19T19:07:39.245 INFO:tasks.workunit.client.1.smithi142.stdout:2/756: chown d3/d4d/d5f/d7c/f7e 0 1 2024-02-19T19:07:39.245 INFO:tasks.workunit.client.1.smithi142.stdout:2/757: truncate d3/db/f7f 4257075 0 2024-02-19T19:07:39.247 INFO:tasks.workunit.client.1.smithi142.stdout:8/917: creat d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/d106/f11e x:0 0 0 2024-02-19T19:07:39.253 INFO:tasks.workunit.client.1.smithi142.stdout:0/766: rename d23/d7d/le6 to d23/d28/d2d/d51/dc9/lf6 0 2024-02-19T19:07:39.257 INFO:tasks.workunit.client.1.smithi142.stdout:8/918: creat d9/dd/de/d2d/d2e/d73/d77/f11f x:0 0 0 2024-02-19T19:07:39.257 INFO:tasks.workunit.client.1.smithi142.stdout:8/919: chown d9/dd/c4b 845013614 1 2024-02-19T19:07:39.257 INFO:tasks.workunit.client.1.smithi142.stdout:9/912: rmdir db/d10/d27/d2f 39 2024-02-19T19:07:39.258 INFO:tasks.workunit.client.1.smithi142.stdout:2/758: getdents d3/df/da4 0 2024-02-19T19:07:39.260 INFO:tasks.workunit.client.1.smithi142.stdout:8/920: symlink d9/dd/de/d14/d65/d6c/d10a/l120 0 2024-02-19T19:07:39.263 INFO:tasks.workunit.client.1.smithi142.stdout:5/911: dwrite d5/dd/df/d22/d41/d32/f35 [4194304,4194304] 0 2024-02-19T19:07:39.265 INFO:tasks.workunit.client.1.smithi142.stdout:5/912: link d5/dd/d8/dbc/lc3 d5/dd/d8/d31/d4d/d75/l136 0 2024-02-19T19:07:39.265 INFO:tasks.workunit.client.1.smithi142.stdout:5/913: fsync d5/dd/d8/fb 0 2024-02-19T19:07:39.266 INFO:tasks.workunit.client.1.smithi142.stdout:2/759: dread d3/df/da4/fd8 [0,4194304] 0 2024-02-19T19:07:39.266 INFO:tasks.workunit.client.1.smithi142.stdout:2/760: fdatasync d3/d4b/f8c 0 2024-02-19T19:07:39.266 INFO:tasks.workunit.client.1.smithi142.stdout:2/761: chown d3/db/d29/d6d 339689 1 2024-02-19T19:07:39.266 INFO:tasks.workunit.client.1.smithi142.stdout:5/914: creat d5/dd/df/d22/db9/f137 x:0 0 0 2024-02-19T19:07:39.267 INFO:tasks.workunit.client.1.smithi142.stdout:2/762: unlink d3/d4b/dbb/ff4 0 2024-02-19T19:07:39.290 INFO:tasks.workunit.client.1.smithi142.stdout:8/921: dwrite d9/dd/de/d14/d65/fb2 [0,4194304] 0 2024-02-19T19:07:39.290 INFO:tasks.workunit.client.1.smithi142.stdout:5/915: dwrite d5/dd/df/d22/d41/d32/f74 [0,4194304] 0 2024-02-19T19:07:39.291 INFO:tasks.workunit.client.1.smithi142.stdout:8/922: readlink d9/dd/de/d2d/d2e/db3/lf3 0 2024-02-19T19:07:39.291 INFO:tasks.workunit.client.1.smithi142.stdout:2/763: dwrite d3/f1c [0,4194304] 0 2024-02-19T19:07:39.291 INFO:tasks.workunit.client.1.smithi142.stdout:2/764: stat d3/d4b/f58 0 2024-02-19T19:07:39.293 INFO:tasks.workunit.client.1.smithi142.stdout:8/923: mkdir d9/dd/d15/dd6/d121 0 2024-02-19T19:07:39.294 INFO:tasks.workunit.client.1.smithi142.stdout:8/924: readlink d9/dd/de/d14/d65/d6c/d10a/l120 0 2024-02-19T19:07:39.295 INFO:tasks.workunit.client.1.smithi142.stdout:2/765: link d3/l22 d3/d4b/lfa 0 2024-02-19T19:07:39.297 INFO:tasks.workunit.client.1.smithi142.stdout:5/916: dread d5/dd/df/d22/d41/d32/fad [0,4194304] 0 2024-02-19T19:07:39.297 INFO:tasks.workunit.client.1.smithi142.stdout:5/917: read - d5/dd/d8/d31/d4d/d8d/d113/f132 zero size 2024-02-19T19:07:39.301 INFO:tasks.workunit.client.1.smithi142.stdout:5/918: creat d5/dd/d8/dd4/d116/f138 x:0 0 0 2024-02-19T19:07:39.303 INFO:tasks.workunit.client.1.smithi142.stdout:5/919: link d5/dd/d8/d2a/f90 d5/dd/df/d22/d41/f139 0 2024-02-19T19:07:39.307 INFO:tasks.workunit.client.1.smithi142.stdout:5/920: symlink d5/dd/d8/dd4/d116/l13a 0 2024-02-19T19:07:39.313 INFO:tasks.workunit.client.1.smithi142.stdout:8/925: dwrite d9/dd/de/d14/d65/fb2 [4194304,4194304] 0 2024-02-19T19:07:39.315 INFO:tasks.workunit.client.1.smithi142.stdout:6/873: sync 2024-02-19T19:07:39.315 INFO:tasks.workunit.client.1.smithi142.stdout:6/874: fsync d2/d17/d33/fa6 0 2024-02-19T19:07:39.315 INFO:tasks.workunit.client.1.smithi142.stdout:6/875: write d2/d17/d33/d39/ff8 [373180,92717] 0 2024-02-19T19:07:39.315 INFO:tasks.workunit.client.1.smithi142.stdout:6/876: write d2/d17/d33/d42/da2/da7/d55/d69/f127 [114871,9374] 0 2024-02-19T19:07:39.317 INFO:tasks.workunit.client.1.smithi142.stdout:2/766: dwrite d3/db/d29/d6d/de6/fe8 [0,4194304] 0 2024-02-19T19:07:39.317 INFO:tasks.workunit.client.1.smithi142.stdout:2/767: fsync d3/db/f7f 0 2024-02-19T19:07:39.317 INFO:tasks.workunit.client.1.smithi142.stdout:8/926: creat d9/dd/de/d14/d65/d6c/dfa/f122 x:0 0 0 2024-02-19T19:07:39.317 INFO:tasks.workunit.client.1.smithi142.stdout:6/877: dread d2/d17/d33/d39/f86 [0,4194304] 0 2024-02-19T19:07:39.321 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:39 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[106707]: 2024-02-19T19:07:39.028+0000 7ff927cba7c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-19T19:07:39.321 INFO:tasks.workunit.client.1.smithi142.stdout:8/927: dread d9/dd/de/d14/d65/db1/fff [0,4194304] 0 2024-02-19T19:07:39.324 INFO:tasks.workunit.client.1.smithi142.stdout:5/921: dwrite d5/dd/d8/f110 [0,4194304] 0 2024-02-19T19:07:39.324 INFO:tasks.workunit.client.1.smithi142.stdout:5/922: readlink d5/dd/d8/d31/l86 0 2024-02-19T19:07:39.324 INFO:tasks.workunit.client.1.smithi142.stdout:5/923: truncate d5/dd/d8/dd4/db4/fd7 501778 0 2024-02-19T19:07:39.324 INFO:tasks.workunit.client.1.smithi142.stdout:5/924: fsync d5/dd/fd3 0 2024-02-19T19:07:39.324 INFO:tasks.workunit.client.1.smithi142.stdout:6/878: mknod d2/d17/c12c 0 2024-02-19T19:07:39.324 INFO:tasks.workunit.client.1.smithi142.stdout:6/879: creat d2/d1f/f12d x:0 0 0 2024-02-19T19:07:39.326 INFO:tasks.workunit.client.1.smithi142.stdout:2/768: dread d3/db/f20 [0,4194304] 0 2024-02-19T19:07:39.327 INFO:tasks.workunit.client.1.smithi142.stdout:5/925: mknod d5/dd/df/d22/d41/d6f/c13b 0 2024-02-19T19:07:39.329 INFO:tasks.workunit.client.1.smithi142.stdout:8/928: unlink d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/f6a 0 2024-02-19T19:07:39.330 INFO:tasks.workunit.client.1.smithi142.stdout:2/769: truncate d3/d4b/f58 3410822 0 2024-02-19T19:07:39.331 INFO:tasks.workunit.client.1.smithi142.stdout:0/767: sync 2024-02-19T19:07:39.331 INFO:tasks.workunit.client.1.smithi142.stdout:7/779: sync 2024-02-19T19:07:39.331 INFO:tasks.workunit.client.1.smithi142.stdout:9/913: sync 2024-02-19T19:07:39.331 INFO:tasks.workunit.client.1.smithi142.stdout:0/768: chown d23/d28/d2d/d51/dc9/d58/c73 1271 1 2024-02-19T19:07:39.332 INFO:tasks.workunit.client.1.smithi142.stdout:5/926: mknod d5/dd/d8/d31/d4d/d75/dc7/c13c 0 2024-02-19T19:07:39.333 INFO:tasks.workunit.client.1.smithi142.stdout:7/780: dread d0/d13/d72/d47/d69/f40 [0,4194304] 0 2024-02-19T19:07:39.333 INFO:tasks.workunit.client.1.smithi142.stdout:8/929: creat d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/f123 x:0 0 0 2024-02-19T19:07:39.333 INFO:tasks.workunit.client.1.smithi142.stdout:8/930: readlink d9/dd/de/d14/d65/d6c/da7/d10b/lc2 0 2024-02-19T19:07:39.334 INFO:tasks.workunit.client.1.smithi142.stdout:2/770: mknod d3/db/d29/d4c/df9/cfb 0 2024-02-19T19:07:39.335 INFO:tasks.workunit.client.1.smithi142.stdout:9/914: truncate db/d10/d22/f46 708496 0 2024-02-19T19:07:39.338 INFO:tasks.workunit.client.1.smithi142.stdout:0/769: rename d23/d28/d41/fa2 to d23/d28/d2d/d54/ff7 0 2024-02-19T19:07:39.340 INFO:tasks.workunit.client.1.smithi142.stdout:5/927: creat d5/dd/d8/d1c/d8a/f13d x:0 0 0 2024-02-19T19:07:39.340 INFO:tasks.workunit.client.1.smithi142.stdout:5/928: write d5/dd/df/f12 [6803629,121413] 0 2024-02-19T19:07:39.342 INFO:tasks.workunit.client.1.smithi142.stdout:7/781: symlink d0/d13/de4/l109 0 2024-02-19T19:07:39.343 INFO:tasks.workunit.client.1.smithi142.stdout:7/782: stat d0/d13/d72/f88 0 2024-02-19T19:07:39.344 INFO:tasks.workunit.client.1.smithi142.stdout:8/931: link d9/dd/de/d2d/d2e/d73/fb0 d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/d106/f124 0 2024-02-19T19:07:39.346 INFO:tasks.workunit.client.1.smithi142.stdout:0/770: rename d23/d32/d8a/le3 to d23/d28/d41/d78/lf8 0 2024-02-19T19:07:39.346 INFO:tasks.workunit.client.1.smithi142.stdout:2/771: write d3/db/d29/d6d/de6/fe8 [2689823,122981] 0 2024-02-19T19:07:39.346 INFO:tasks.workunit.client.1.smithi142.stdout:2/772: truncate d3/db/f79 888799 0 2024-02-19T19:07:39.346 INFO:tasks.workunit.client.1.smithi142.stdout:2/773: write d3/fac [1343081,84953] 0 2024-02-19T19:07:39.347 INFO:tasks.workunit.client.1.smithi142.stdout:9/915: write db/d10/d22/d24/f92 [4943371,63562] 0 2024-02-19T19:07:39.349 INFO:tasks.workunit.client.1.smithi142.stdout:7/783: rename d0/d13/cb1 to d0/d1b/d21/d24/d29/d44/de1/df3/c10a 0 2024-02-19T19:07:39.351 INFO:tasks.workunit.client.1.smithi142.stdout:5/929: dread d5/dd/df/d22/d41/d32/f84 [0,4194304] 0 2024-02-19T19:07:39.351 INFO:tasks.workunit.client.1.smithi142.stdout:5/930: stat d5/fe 0 2024-02-19T19:07:39.352 INFO:tasks.workunit.client.1.smithi142.stdout:5/931: write d5/dd/d8/f3d [1217053,3712] 0 2024-02-19T19:07:39.352 INFO:tasks.workunit.client.1.smithi142.stdout:5/932: creat d5/dd/df/d22/d41/f13e x:0 0 0 2024-02-19T19:07:39.352 INFO:tasks.workunit.client.1.smithi142.stdout:5/933: stat d5/dd/df/d22/d41/d32/f74 0 2024-02-19T19:07:39.352 INFO:tasks.workunit.client.1.smithi142.stdout:7/784: read d0/d1b/d21/f4c [447551,59769] 0 2024-02-19T19:07:39.352 INFO:tasks.workunit.client.1.smithi142.stdout:0/771: rename d23/f3a to d23/ff9 0 2024-02-19T19:07:39.352 INFO:tasks.workunit.client.1.smithi142.stdout:7/785: dread - d0/d1b/dbc/dcb/ff6 zero size 2024-02-19T19:07:39.355 INFO:tasks.workunit.client.1.smithi142.stdout:2/774: creat d3/d4d/d5f/ffc x:0 0 0 2024-02-19T19:07:39.355 INFO:tasks.workunit.client.1.smithi142.stdout:2/775: getdents d3/df/da4 0 2024-02-19T19:07:39.359 INFO:tasks.workunit.client.1.smithi142.stdout:5/934: mkdir d5/dd/d8/d31/df0/d13f 0 2024-02-19T19:07:39.359 INFO:tasks.workunit.client.1.smithi142.stdout:5/935: fdatasync d5/dd/d8/d2a/f90 0 2024-02-19T19:07:39.360 INFO:tasks.workunit.client.1.smithi142.stdout:0/772: mkdir d23/d32/d8a/db1/dfa 0 2024-02-19T19:07:39.361 INFO:tasks.workunit.client.1.smithi142.stdout:7/786: symlink d0/d1b/d21/d24/d29/d44/de1/l10b 0 2024-02-19T19:07:39.361 INFO:tasks.workunit.client.1.smithi142.stdout:9/916: dwrite db/d10/d27/d2f/ff7 [0,4194304] 0 2024-02-19T19:07:39.362 INFO:tasks.workunit.client.1.smithi142.stdout:2/776: truncate d3/f16 3153478 0 2024-02-19T19:07:39.364 INFO:tasks.workunit.client.1.smithi142.stdout:5/936: symlink d5/dd/d5f/l140 0 2024-02-19T19:07:39.364 INFO:tasks.workunit.client.1.smithi142.stdout:5/937: write d5/dd/df/d22/d41/d6f/f103 [1266666,11378] 0 2024-02-19T19:07:39.366 INFO:tasks.workunit.client.1.smithi142.stdout:7/787: mknod d0/d13/d72/da7/c10c 0 2024-02-19T19:07:39.370 INFO:tasks.workunit.client.1.smithi142.stdout:0/773: write d23/d28/faa [3051903,31590] 0 2024-02-19T19:07:39.370 INFO:tasks.workunit.client.1.smithi142.stdout:9/917: truncate db/d10/d22/d24/d41/dd2/dd3/fa8 1724150 0 2024-02-19T19:07:39.371 INFO:tasks.workunit.client.1.smithi142.stdout:2/777: creat d3/d35/d97/dbf/ffd x:0 0 0 2024-02-19T19:07:39.373 INFO:tasks.workunit.client.1.smithi142.stdout:7/788: mkdir d0/d1b/d21/d24/d29/d44/d49/d10d 0 2024-02-19T19:07:39.376 INFO:tasks.workunit.client.1.smithi142.stdout:0/774: rename d23/d28/d41/d78/la7 to d23/d28/d2d/d51/dc9/lfb 0 2024-02-19T19:07:39.377 INFO:tasks.workunit.client.1.smithi142.stdout:0/775: fdatasync d23/d28/d2d/d54/d85/ff0 0 2024-02-19T19:07:39.377 INFO:tasks.workunit.client.1.smithi142.stdout:7/789: dread d0/d13/d72/da7/f78 [0,4194304] 0 2024-02-19T19:07:39.378 INFO:tasks.workunit.client.1.smithi142.stdout:0/776: mkdir d23/d32/d8a/dfc 0 2024-02-19T19:07:39.379 INFO:tasks.workunit.client.1.smithi142.stdout:7/790: truncate d0/f9 1414218 0 2024-02-19T19:07:39.380 INFO:tasks.workunit.client.1.smithi142.stdout:7/791: getdents d0/d1b/d21/d107/d86 0 2024-02-19T19:07:39.382 INFO:tasks.workunit.client.1.smithi142.stdout:2/778: dread d3/db/f15 [4194304,4194304] 0 2024-02-19T19:07:39.382 INFO:tasks.workunit.client.1.smithi142.stdout:2/779: chown d3/d4d/d81/fc8 127 1 2024-02-19T19:07:39.382 INFO:tasks.workunit.client.1.smithi142.stdout:2/780: chown d3/df/da4/ff8 87773164 1 2024-02-19T19:07:39.384 INFO:tasks.workunit.client.1.smithi142.stdout:2/781: rename d3/d4b/f8c to d3/d4d/d9f/ffe 0 2024-02-19T19:07:39.398 INFO:tasks.workunit.client.1.smithi142.stdout:9/918: dwrite db/d10/d22/d24/f8b [0,4194304] 0 2024-02-19T19:07:39.419 INFO:tasks.workunit.client.1.smithi142.stdout:0/777: dwrite d23/d28/d2d/d51/dc9/f89 [0,4194304] 0 2024-02-19T19:07:39.420 INFO:tasks.workunit.client.1.smithi142.stdout:0/778: fdatasync d23/d28/f38 0 2024-02-19T19:07:39.420 INFO:tasks.workunit.client.1.smithi142.stdout:7/792: dwrite d0/d1b/d21/f8d [0,4194304] 0 2024-02-19T19:07:39.420 INFO:tasks.workunit.client.1.smithi142.stdout:7/793: write d0/d1b/d21/d24/d29/d44/d49/f64 [5490002,28699] 0 2024-02-19T19:07:39.420 INFO:tasks.workunit.client.1.smithi142.stdout:2/782: dwrite d3/db/d29/f5d [0,4194304] 0 2024-02-19T19:07:39.420 INFO:tasks.workunit.client.1.smithi142.stdout:2/783: stat d3/l26 0 2024-02-19T19:07:39.427 INFO:tasks.workunit.client.1.smithi142.stdout:0/779: dread d23/d28/fd8 [0,4194304] 0 2024-02-19T19:07:39.428 INFO:tasks.workunit.client.1.smithi142.stdout:0/780: write d23/d32/d8a/fb0 [3424530,124616] 0 2024-02-19T19:07:39.428 INFO:tasks.workunit.client.1.smithi142.stdout:7/794: mknod d0/d1b/d9d/da4/c10e 0 2024-02-19T19:07:39.429 INFO:tasks.workunit.client.1.smithi142.stdout:2/784: mknod d3/db/d29/d4c/d4e/d9a/da9/cff 0 2024-02-19T19:07:39.429 INFO:tasks.workunit.client.1.smithi142.stdout:7/795: read d0/d1b/d9d/da4/fcc [725504,53080] 0 2024-02-19T19:07:39.431 INFO:tasks.workunit.client.1.smithi142.stdout:2/785: rename d3/d68/d95/dca/fe0 to d3/d35/d97/dbf/f100 0 2024-02-19T19:07:39.432 INFO:tasks.workunit.client.1.smithi142.stdout:7/796: getdents d0/d13/d72/d47 0 2024-02-19T19:07:39.432 INFO:tasks.workunit.client.1.smithi142.stdout:7/797: readlink d0/d1b/d9d/leb 0 2024-02-19T19:07:39.434 INFO:tasks.workunit.client.1.smithi142.stdout:2/786: mknod d3/d4d/d9f/c101 0 2024-02-19T19:07:39.434 INFO:tasks.workunit.client.1.smithi142.stdout:6/880: sync 2024-02-19T19:07:39.435 INFO:tasks.workunit.client.1.smithi142.stdout:7/798: rmdir d0/d13/d72/da7/df1 0 2024-02-19T19:07:39.436 INFO:tasks.workunit.client.1.smithi142.stdout:2/787: creat d3/db/d29/d6d/f102 x:0 0 0 2024-02-19T19:07:39.446 INFO:tasks.workunit.client.1.smithi142.stdout:7/799: dread d0/d1b/f91 [0,4194304] 0 2024-02-19T19:07:39.455 INFO:tasks.workunit.client.1.smithi142.stdout:6/881: dwrite d2/d17/d33/d42/da2/da7/d55/dc0/d110/f119 [0,4194304] 0 2024-02-19T19:07:39.455 INFO:tasks.workunit.client.1.smithi142.stdout:6/882: truncate d2/d1e/d35/d66/d8d/d3e/d8c/f9f 4823448 0 2024-02-19T19:07:39.455 INFO:tasks.workunit.client.1.smithi142.stdout:0/781: dwrite d23/d28/d2d/d54/d88/fae [4194304,4194304] 0 2024-02-19T19:07:39.456 INFO:tasks.workunit.client.1.smithi142.stdout:7/800: dread d0/d13/d72/da7/faf [0,4194304] 0 2024-02-19T19:07:39.457 INFO:tasks.workunit.client.1.smithi142.stdout:6/883: mkdir d2/d1f/d20/d31/d88/d8f/d102/d12e 0 2024-02-19T19:07:39.458 INFO:tasks.workunit.client.1.smithi142.stdout:0/782: truncate d23/d7d/f92 3787570 0 2024-02-19T19:07:39.458 INFO:tasks.workunit.client.1.smithi142.stdout:0/783: fdatasync d23/d7d/fd9 0 2024-02-19T19:07:39.458 INFO:tasks.workunit.client.1.smithi142.stdout:0/784: chown d23/d32/c6c 7499368 1 2024-02-19T19:07:39.459 INFO:tasks.workunit.client.1.smithi142.stdout:7/801: symlink d0/d13/d72/d47/d69/l10f 0 2024-02-19T19:07:39.460 INFO:tasks.workunit.client.1.smithi142.stdout:6/884: creat d2/d1e/d35/d66/d8d/d3e/d8c/d10b/d10f/f12f x:0 0 0 2024-02-19T19:07:39.460 INFO:tasks.workunit.client.1.smithi142.stdout:2/788: dwrite d3/df/da4/fd8 [0,4194304] 0 2024-02-19T19:07:39.460 INFO:tasks.workunit.client.1.smithi142.stdout:2/789: readlink d3/d4d/d9f/ld5 0 2024-02-19T19:07:39.460 INFO:tasks.workunit.client.1.smithi142.stdout:2/790: write d3/d35/d97/dbf/ffd [839958,47911] 0 2024-02-19T19:07:39.461 INFO:tasks.workunit.client.1.smithi142.stdout:0/785: mknod d23/d28/d2d/d51/cfd 0 2024-02-19T19:07:39.461 INFO:tasks.workunit.client.1.smithi142.stdout:7/802: symlink d0/d1b/d21/d24/d5e/df8/l110 0 2024-02-19T19:07:39.462 INFO:tasks.workunit.client.1.smithi142.stdout:2/791: dread d3/d68/f87 [0,4194304] 0 2024-02-19T19:07:39.463 INFO:tasks.workunit.client.1.smithi142.stdout:6/885: symlink d2/d1f/d5c/l130 0 2024-02-19T19:07:39.463 INFO:tasks.workunit.client.1.smithi142.stdout:6/886: readlink d2/d17/d33/d42/da2/da7/dd2/dd3/lae 0 2024-02-19T19:07:39.465 INFO:tasks.workunit.client.1.smithi142.stdout:0/786: mknod d23/d28/d2d/d51/dc9/d58/dc1/cfe 0 2024-02-19T19:07:39.467 INFO:tasks.workunit.client.1.smithi142.stdout:2/792: symlink d3/db/d29/d4c/l103 0 2024-02-19T19:07:39.468 INFO:tasks.workunit.client.1.smithi142.stdout:2/793: mkdir d3/db/d29/d4c/df9/d104 0 2024-02-19T19:07:39.469 INFO:tasks.workunit.client.1.smithi142.stdout:2/794: chown d3/db/d29/d6d/d59/db4 45215913 1 2024-02-19T19:07:39.470 INFO:tasks.workunit.client.1.smithi142.stdout:0/787: dread d23/d28/faa [0,4194304] 0 2024-02-19T19:07:39.472 INFO:tasks.workunit.client.1.smithi142.stdout:0/788: unlink d23/d28/d2d/d51/dc9/d58/lbd 0 2024-02-19T19:07:39.478 INFO:tasks.workunit.client.1.smithi142.stdout:2/795: getdents d3/db/d29/d4c/df9 0 2024-02-19T19:07:39.478 INFO:tasks.workunit.client.1.smithi142.stdout:2/796: write d3/db/d29/d6d/d59/f78 [762738,53600] 0 2024-02-19T19:07:39.482 INFO:tasks.workunit.client.1.smithi142.stdout:2/797: rename d3/d35/d97/dbf to d3/db/d29/d4c/d4e/d9a/da9/dad/d105 0 2024-02-19T19:07:39.496 INFO:tasks.workunit.client.1.smithi142.stdout:2/798: dwrite d3/d4d/d5f/f72 [4194304,4194304] 0 2024-02-19T19:07:39.496 INFO:tasks.workunit.client.1.smithi142.stdout:2/799: chown d3/db/d29/l86 2623625 1 2024-02-19T19:07:39.496 INFO:tasks.workunit.client.1.smithi142.stdout:2/800: chown d3/d4d/d9f/lef 8686738 1 2024-02-19T19:07:39.496 INFO:tasks.workunit.client.1.smithi142.stdout:7/803: dwrite d0/d13/d72/f45 [0,4194304] 0 2024-02-19T19:07:39.496 INFO:tasks.workunit.client.1.smithi142.stdout:0/789: dwrite d23/d32/f65 [0,4194304] 0 2024-02-19T19:07:39.497 INFO:tasks.workunit.client.1.smithi142.stdout:6/887: dwrite d2/d1e/d35/d66/d8d/d3e/f107 [0,4194304] 0 2024-02-19T19:07:39.498 INFO:tasks.workunit.client.1.smithi142.stdout:0/790: unlink d23/d32/c5f 0 2024-02-19T19:07:39.498 INFO:tasks.workunit.client.1.smithi142.stdout:0/791: dread - d23/d32/d8a/db1/fc5 zero size 2024-02-19T19:07:39.502 INFO:tasks.workunit.client.1.smithi142.stdout:6/888: mkdir d2/d17/d33/d42/da2/da7/dd2/de2/d131 0 2024-02-19T19:07:39.502 INFO:tasks.workunit.client.1.smithi142.stdout:6/889: readlink d2/d17/d33/d42/d5e/lb8 0 2024-02-19T19:07:39.502 INFO:tasks.workunit.client.1.smithi142.stdout:6/890: truncate d2/d17/d33/d42/da2/da7/fe4 4607627 0 2024-02-19T19:07:39.505 INFO:tasks.workunit.client.1.smithi142.stdout:2/801: dread d3/db/d29/f41 [0,4194304] 0 2024-02-19T19:07:39.507 INFO:tasks.workunit.client.1.smithi142.stdout:2/802: rmdir d3/db/d29/d6d/d59/d64 0 2024-02-19T19:07:39.508 INFO:tasks.workunit.client.1.smithi142.stdout:0/792: dread d23/d28/d2d/d51/dc9/d58/f83 [0,4194304] 0 2024-02-19T19:07:39.509 INFO:tasks.workunit.client.1.smithi142.stdout:2/803: rename d3/d4d/d5f/db5/ld7 to d3/db/d29/d4c/d4e/d9a/da9/dad/d105/l106 0 2024-02-19T19:07:39.511 INFO:tasks.workunit.client.1.smithi142.stdout:7/804: dwrite d0/d13/d1e/fb2 [0,4194304] 0 2024-02-19T19:07:39.511 INFO:tasks.workunit.client.1.smithi142.stdout:0/793: mknod d23/d28/d2d/d54/cff 0 2024-02-19T19:07:39.511 INFO:tasks.workunit.client.1.smithi142.stdout:0/794: chown d23/d28/d2d/d51/c66 10 1 2024-02-19T19:07:39.511 INFO:tasks.workunit.client.1.smithi142.stdout:0/795: chown d23/d28/d2d/d54/d88/c94 92942263 1 2024-02-19T19:07:39.511 INFO:tasks.workunit.client.1.smithi142.stdout:2/804: mknod d3/db/d29/d4c/d4e/c107 0 2024-02-19T19:07:39.512 INFO:tasks.workunit.client.1.smithi142.stdout:9/919: sync 2024-02-19T19:07:39.512 INFO:tasks.workunit.client.1.smithi142.stdout:5/938: sync 2024-02-19T19:07:39.512 INFO:tasks.workunit.client.1.smithi142.stdout:8/932: sync 2024-02-19T19:07:39.512 INFO:tasks.workunit.client.1.smithi142.stdout:8/933: chown d9/dd/de/d14/d65/f90 704371177 1 2024-02-19T19:07:39.512 INFO:tasks.workunit.client.1.smithi142.stdout:8/934: write d9/dd/de/f24 [3321638,106901] 0 2024-02-19T19:07:39.515 INFO:tasks.workunit.client.1.smithi142.stdout:7/805: truncate d0/fc 11501559 0 2024-02-19T19:07:39.515 INFO:tasks.workunit.client.1.smithi142.stdout:2/805: getdents d3/d4d/d81 0 2024-02-19T19:07:39.516 INFO:tasks.workunit.client.1.smithi142.stdout:2/806: fdatasync d3/db/dda/fe9 0 2024-02-19T19:07:39.516 INFO:tasks.workunit.client.1.smithi142.stdout:2/807: chown d3/d4d/d5f/ca6 1 1 2024-02-19T19:07:39.517 INFO:tasks.workunit.client.1.smithi142.stdout:0/796: truncate d23/d28/faa 1507793 0 2024-02-19T19:07:39.517 INFO:tasks.workunit.client.1.smithi142.stdout:7/806: unlink d0/d1b/d21/d24/d5e/f101 0 2024-02-19T19:07:39.518 INFO:tasks.workunit.client.1.smithi142.stdout:0/797: rmdir d23/d28/d2d/d51/dc9/d58/dc1 39 2024-02-19T19:07:39.523 INFO:tasks.workunit.client.1.smithi142.stdout:0/798: rmdir d23/d28/d2d/d51/dc9/d58 39 2024-02-19T19:07:39.525 INFO:tasks.workunit.client.1.smithi142.stdout:0/799: chown d23/d28/l61 1226173969 1 2024-02-19T19:07:39.525 INFO:tasks.workunit.client.1.smithi142.stdout:8/935: dread d9/dd/d15/d31/fbb [0,4194304] 0 2024-02-19T19:07:39.526 INFO:tasks.workunit.client.1.smithi142.stdout:0/800: creat d23/d28/f100 x:0 0 0 2024-02-19T19:07:39.528 INFO:tasks.workunit.client.1.smithi142.stdout:0/801: mknod d23/d28/d2d/d54/d88/c101 0 2024-02-19T19:07:39.528 INFO:tasks.workunit.client.1.smithi142.stdout:0/802: truncate d23/d7d/d9e/fd0 4501591 0 2024-02-19T19:07:39.530 INFO:tasks.workunit.client.1.smithi142.stdout:0/803: mknod d23/d7d/d9e/dc7/df5/c102 0 2024-02-19T19:07:39.533 INFO:tasks.workunit.client.1.smithi142.stdout:5/939: dwrite d5/dd/f68 [0,4194304] 0 2024-02-19T19:07:39.533 INFO:tasks.workunit.client.1.smithi142.stdout:8/936: dread d9/f105 [0,4194304] 0 2024-02-19T19:07:39.533 INFO:tasks.workunit.client.1.smithi142.stdout:5/940: dread - d5/ffe zero size 2024-02-19T19:07:39.533 INFO:tasks.workunit.client.1.smithi142.stdout:5/941: write d5/dd/df/d22/d41/d32/fad [3020554,46951] 0 2024-02-19T19:07:39.534 INFO:tasks.workunit.client.1.smithi142.stdout:9/920: dwrite db/d10/d22/d24/d41/dd2/dd3/fa8 [0,4194304] 0 2024-02-19T19:07:39.534 INFO:tasks.workunit.client.1.smithi142.stdout:0/804: rename d23/d28/d2d/d51/dc9/l45 to d23/d28/l103 0 2024-02-19T19:07:39.536 INFO:tasks.workunit.client.1.smithi142.stdout:5/942: truncate d5/dd/d8/d31/d4d/d60/f73 3073804 0 2024-02-19T19:07:39.536 INFO:tasks.workunit.client.1.smithi142.stdout:2/808: dwrite d3/d35/d53/f6f [0,4194304] 0 2024-02-19T19:07:39.537 INFO:tasks.workunit.client.1.smithi142.stdout:9/921: rename db/d10/d32/d3f/l4a to db/d10/d22/d24/d41/dd2/l103 0 2024-02-19T19:07:39.538 INFO:tasks.workunit.client.1.smithi142.stdout:8/937: dread d9/dd/de/d2d/d2e/d73/f92 [0,4194304] 0 2024-02-19T19:07:39.538 INFO:tasks.workunit.client.1.smithi142.stdout:5/943: mkdir d5/dd/d8/d141 0 2024-02-19T19:07:39.539 INFO:tasks.workunit.client.1.smithi142.stdout:2/809: link d3/db/d29/d4c/fdb d3/db/d29/d4c/d4e/d9a/da9/f108 0 2024-02-19T19:07:39.540 INFO:tasks.workunit.client.1.smithi142.stdout:9/922: symlink db/d10/d32/d3f/db3/deb/l104 0 2024-02-19T19:07:39.541 INFO:tasks.workunit.client.1.smithi142.stdout:8/938: link d9/dd/de/d2d/d2e/d73/c10f d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/dc3/de7/c125 0 2024-02-19T19:07:39.541 INFO:tasks.workunit.client.1.smithi142.stdout:5/944: symlink d5/dd/df/d22/d41/d6f/l142 0 2024-02-19T19:07:39.542 INFO:tasks.workunit.client.1.smithi142.stdout:2/810: mkdir d3/db/d29/d4c/df9/d104/d109 0 2024-02-19T19:07:39.542 INFO:tasks.workunit.client.1.smithi142.stdout:2/811: write d3/db/dda/fe9 [1040836,62163] 0 2024-02-19T19:07:39.543 INFO:tasks.workunit.client.1.smithi142.stdout:9/923: mknod db/d10/d27/d2f/d4c/d54/c105 0 2024-02-19T19:07:39.543 INFO:tasks.workunit.client.1.smithi142.stdout:9/924: chown db/d10/d32/d91 6 1 2024-02-19T19:07:39.544 INFO:tasks.workunit.client.1.smithi142.stdout:5/945: mkdir d5/dd/df/d15/d5b/d143 0 2024-02-19T19:07:39.544 INFO:tasks.workunit.client.1.smithi142.stdout:5/946: creat d5/dd/d8/d31/d4d/d8d/d113/f144 x:0 0 0 2024-02-19T19:07:39.544 INFO:tasks.workunit.client.1.smithi142.stdout:2/812: rmdir d3/db/d29/d4c/d4e/d9a/da9/dad 39 2024-02-19T19:07:39.546 INFO:tasks.workunit.client.1.smithi142.stdout:5/947: mknod d5/dd/d8/d1c/c145 0 2024-02-19T19:07:39.547 INFO:tasks.workunit.client.1.smithi142.stdout:5/948: creat d5/dd/d95/f146 x:0 0 0 2024-02-19T19:07:39.551 INFO:tasks.workunit.client.1.smithi142.stdout:9/925: write db/d10/f4b [8155795,93526] 0 2024-02-19T19:07:39.551 INFO:tasks.workunit.client.1.smithi142.stdout:9/926: dread - db/d10/d27/d2f/dc5/fd0 zero size 2024-02-19T19:07:39.552 INFO:tasks.workunit.client.1.smithi142.stdout:9/927: truncate db/d10/d32/d3f/f63 3991641 0 2024-02-19T19:07:39.552 INFO:tasks.workunit.client.1.smithi142.stdout:9/928: stat db/d10/d32/d3f/db3/deb 0 2024-02-19T19:07:39.553 INFO:tasks.workunit.client.1.smithi142.stdout:9/929: rmdir db/d10/d22/d24 39 2024-02-19T19:07:39.554 INFO:tasks.workunit.client.1.smithi142.stdout:9/930: mkdir db/d10/d27/d106 0 2024-02-19T19:07:39.554 INFO:tasks.workunit.client.1.smithi142.stdout:0/805: dwrite d23/d28/d2d/f3b [0,4194304] 0 2024-02-19T19:07:39.554 INFO:tasks.workunit.client.1.smithi142.stdout:7/807: dwrite d0/d1b/d21/d24/d29/d44/f55 [0,4194304] 0 2024-02-19T19:07:39.555 INFO:tasks.workunit.client.1.smithi142.stdout:9/931: link db/d10/d22/cca db/d10/d27/d2f/d4c/d59/c107 0 2024-02-19T19:07:39.560 INFO:tasks.workunit.client.1.smithi142.stdout:9/932: symlink db/d10/d22/d24/l108 0 2024-02-19T19:07:39.562 INFO:tasks.workunit.client.1.smithi142.stdout:9/933: creat db/d10/d32/d91/dc1/f109 x:0 0 0 2024-02-19T19:07:39.562 INFO:tasks.workunit.client.1.smithi142.stdout:9/934: write db/d10/d22/d24/d41/dd2/dad/fe1 [5220080,54559] 0 2024-02-19T19:07:39.564 INFO:tasks.workunit.client.1.smithi142.stdout:9/935: creat db/d10/d22/d24/d41/dd2/dad/df9/f10a x:0 0 0 2024-02-19T19:07:39.564 INFO:tasks.workunit.client.1.smithi142.stdout:7/808: dread d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:39.564 INFO:tasks.workunit.client.1.smithi142.stdout:5/949: dwrite d5/dd/df/d22/d41/fea [8388608,4194304] 0 2024-02-19T19:07:39.564 INFO:tasks.workunit.client.1.smithi142.stdout:5/950: truncate d5/dd/d8/d31/d4d/d60/f108 869757 0 2024-02-19T19:07:39.564 INFO:tasks.workunit.client.1.smithi142.stdout:5/951: read - d5/dd/d8/d2a/d93/ffa zero size 2024-02-19T19:07:39.564 INFO:tasks.workunit.client.1.smithi142.stdout:5/952: truncate d5/dd/df/d15/d5b/f79 774707 0 2024-02-19T19:07:39.565 INFO:tasks.workunit.client.1.smithi142.stdout:9/936: creat db/d10/d22/d24/d41/dd2/dad/dc3/f10b x:0 0 0 2024-02-19T19:07:39.567 INFO:tasks.workunit.client.1.smithi142.stdout:7/809: rmdir d0/d13/d72 39 2024-02-19T19:07:39.567 INFO:tasks.workunit.client.1.smithi142.stdout:7/810: fsync d0/d13/f15 0 2024-02-19T19:07:39.567 INFO:tasks.workunit.client.1.smithi142.stdout:7/811: chown d0/d1b/d21/d24/d29/d44/d49/lcd 309564175 1 2024-02-19T19:07:39.567 INFO:tasks.workunit.client.1.smithi142.stdout:7/812: write d0/d1b/d21/d24/d29/d44/d49/d9b/ff5 [614953,100945] 0 2024-02-19T19:07:39.567 INFO:tasks.workunit.client.1.smithi142.stdout:7/813: chown d0/d1b/d21/d24/d29/d44/d49/f64 824427825 1 2024-02-19T19:07:39.567 INFO:tasks.workunit.client.1.smithi142.stdout:0/806: dread d23/f3d [0,4194304] 0 2024-02-19T19:07:39.567 INFO:tasks.workunit.client.1.smithi142.stdout:9/937: rmdir db/d10/d22/d81 39 2024-02-19T19:07:39.569 INFO:tasks.workunit.client.1.smithi142.stdout:7/814: creat d0/d1b/d21/d24/d29/d44/d49/d8b/d103/f111 x:0 0 0 2024-02-19T19:07:39.569 INFO:tasks.workunit.client.1.smithi142.stdout:7/815: write d0/d1b/d9d/da4/fcc [38651,19924] 0 2024-02-19T19:07:39.570 INFO:tasks.workunit.client.1.smithi142.stdout:9/938: mknod db/d10/d27/d2f/d4c/d54/c10c 0 2024-02-19T19:07:39.571 INFO:tasks.workunit.client.1.smithi142.stdout:7/816: dread d0/d1b/d21/fba [0,4194304] 0 2024-02-19T19:07:39.571 INFO:tasks.workunit.client.1.smithi142.stdout:7/817: readlink d0/d1b/d21/d24/d29/d44/led 0 2024-02-19T19:07:39.571 INFO:tasks.workunit.client.1.smithi142.stdout:7/818: stat d0/d13/c3e 0 2024-02-19T19:07:39.572 INFO:tasks.workunit.client.1.smithi142.stdout:8/939: rename d9/dd/de/d2d/d2e to d9/dd/d15/d31/d126 0 2024-02-19T19:07:39.575 INFO:tasks.workunit.client.1.smithi142.stdout:2/813: rename d3/d35/d97/lf6 to d3/db/d29/d4c/d4e/d9a/l10a 0 2024-02-19T19:07:39.576 INFO:tasks.workunit.client.1.smithi142.stdout:2/814: readlink d3/df/l30 0 2024-02-19T19:07:39.577 INFO:tasks.workunit.client.1.smithi142.stdout:8/940: symlink d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/d106/l127 0 2024-02-19T19:07:39.579 INFO:tasks.workunit.client.1.smithi142.stdout:2/815: rename d3/f16 to d3/d68/d95/f10b 0 2024-02-19T19:07:39.579 INFO:tasks.workunit.client.1.smithi142.stdout:9/939: write db/d10/f1c [2701323,129850] 0 2024-02-19T19:07:39.580 INFO:tasks.workunit.client.1.smithi142.stdout:8/941: creat d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/f128 x:0 0 0 2024-02-19T19:07:39.581 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:39 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[106707]: 2024-02-19T19:07:39.349+0000 7ff927cba7c0 -1 osd.1 54 log_to_monitors true 2024-02-19T19:07:39.585 INFO:tasks.workunit.client.1.smithi142.stdout:0/807: dwrite d23/d28/d2d/d54/ff7 [0,4194304] 0 2024-02-19T19:07:39.587 INFO:tasks.workunit.client.1.smithi142.stdout:5/953: dwrite d5/dd/d8/dd4/d116/f11f [0,4194304] 0 2024-02-19T19:07:39.587 INFO:tasks.workunit.client.1.smithi142.stdout:0/808: symlink d23/d7d/l104 0 2024-02-19T19:07:39.587 INFO:tasks.workunit.client.1.smithi142.stdout:0/809: write d23/d28/d2d/d54/d88/fcb [1039500,50185] 0 2024-02-19T19:07:39.587 INFO:tasks.workunit.client.1.smithi142.stdout:0/810: fdatasync d23/d7d/f92 0 2024-02-19T19:07:39.587 INFO:tasks.workunit.client.1.smithi142.stdout:0/811: fdatasync d23/d28/d2d/d51/f71 0 2024-02-19T19:07:39.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/940: dread db/d10/d22/d24/d41/f9b [0,4194304] 0 2024-02-19T19:07:39.589 INFO:tasks.workunit.client.1.smithi142.stdout:9/941: fdatasync db/d10/d27/d2f/ff7 0 2024-02-19T19:07:39.590 INFO:tasks.workunit.client.1.smithi142.stdout:5/954: mkdir d5/dd/d8/d31/df0/d147 0 2024-02-19T19:07:39.590 INFO:tasks.workunit.client.1.smithi142.stdout:5/955: fsync d5/dd/d5f/f81 0 2024-02-19T19:07:39.592 INFO:tasks.workunit.client.1.smithi142.stdout:5/956: unlink d5/dd/d8/d2a/d93/lf9 0 2024-02-19T19:07:39.593 INFO:tasks.workunit.client.1.smithi142.stdout:5/957: write d5/dda/f12d [359291,73474] 0 2024-02-19T19:07:39.593 INFO:tasks.workunit.client.1.smithi142.stdout:9/942: rmdir db/d10/d22/d24/d41/dd2/dd3 39 2024-02-19T19:07:39.593 INFO:tasks.workunit.client.1.smithi142.stdout:9/943: fdatasync db/d10/d27/d2f/d4c/f70 0 2024-02-19T19:07:39.595 INFO:tasks.workunit.client.1.smithi142.stdout:5/958: unlink d5/dd/d8/d2a/fc4 0 2024-02-19T19:07:39.596 INFO:tasks.workunit.client.1.smithi142.stdout:7/819: getdents d0/d1b/d21/d24/d29/d44/d49/d8b/d103 0 2024-02-19T19:07:39.596 INFO:tasks.workunit.client.1.smithi142.stdout:7/820: write d0/d1b/d21/d24/f28 [4476729,54898] 0 2024-02-19T19:07:39.597 INFO:tasks.workunit.client.1.smithi142.stdout:8/942: dwrite d9/dd/f1d [0,4194304] 0 2024-02-19T19:07:39.598 INFO:tasks.workunit.client.1.smithi142.stdout:5/959: symlink d5/dd/df/d15/d5b/l148 0 2024-02-19T19:07:39.610 INFO:tasks.workunit.client.1.smithi142.stdout:7/821: dread d0/d1b/d21/d24/f28 [0,4194304] 0 2024-02-19T19:07:39.617 INFO:tasks.workunit.client.1.smithi142.stdout:7/822: dread d0/d13/f27 [0,4194304] 0 2024-02-19T19:07:39.618 INFO:tasks.workunit.client.1.smithi142.stdout:7/823: mkdir d0/d1b/d21/d24/d29/d44/d49/d10d/d112 0 2024-02-19T19:07:39.619 INFO:tasks.workunit.client.1.smithi142.stdout:7/824: creat d0/d1b/d21/d107/d86/f113 x:0 0 0 2024-02-19T19:07:39.620 INFO:tasks.workunit.client.1.smithi142.stdout:7/825: link d0/d13/cc2 d0/d13/de4/dfc/c114 0 2024-02-19T19:07:39.620 INFO:tasks.workunit.client.1.smithi142.stdout:7/826: fsync d0/d1b/d21/d24/d29/d44/de1/fe7 0 2024-02-19T19:07:39.627 INFO:tasks.workunit.client.1.smithi142.stdout:8/943: dwrite d9/da8/fbd [0,4194304] 0 2024-02-19T19:07:39.628 INFO:tasks.workunit.client.1.smithi142.stdout:5/960: dwrite d5/dd/df/d22/d41/d32/fad [0,4194304] 0 2024-02-19T19:07:39.628 INFO:tasks.workunit.client.1.smithi142.stdout:5/961: write d5/dd/d8/d1c/d8a/fa6 [5131738,96201] 0 2024-02-19T19:07:39.628 INFO:tasks.workunit.client.1.smithi142.stdout:9/944: dwrite db/d10/d27/db9/fcf [0,4194304] 0 2024-02-19T19:07:39.629 INFO:tasks.workunit.client.1.smithi142.stdout:9/945: readlink db/d10/d27/d2f/d4c/l48 0 2024-02-19T19:07:39.663 INFO:tasks.workunit.client.1.smithi142.stdout:8/944: creat d9/dd/d15/d31/d96/dc5/f129 x:0 0 0 2024-02-19T19:07:39.663 INFO:tasks.workunit.client.1.smithi142.stdout:8/945: fdatasync d9/dd/de/d14/d65/d6c/f104 0 2024-02-19T19:07:39.664 INFO:tasks.workunit.client.1.smithi142.stdout:8/946: dread - d9/dd/de/d14/fba zero size 2024-02-19T19:07:39.671 INFO:tasks.workunit.client.1.smithi142.stdout:8/947: read d9/dd/de/d14/f60 [1044942,30806] 0 2024-02-19T19:07:39.677 INFO:tasks.workunit.client.1.smithi142.stdout:9/946: creat db/d10/d32/d91/df4/f10d x:0 0 0 2024-02-19T19:07:39.732 INFO:tasks.workunit.client.1.smithi142.stdout:7/827: getdents d0/d13 0 2024-02-19T19:07:39.735 INFO:tasks.workunit.client.1.smithi142.stdout:9/947: creat db/d10/d22/d81/f10e x:0 0 0 2024-02-19T19:07:39.737 INFO:tasks.workunit.client.1.smithi142.stdout:8/948: mknod d9/dd/d15/d31/d126/c12a 0 2024-02-19T19:07:39.738 INFO:tasks.workunit.client.1.smithi142.stdout:9/948: mknod db/d10/d22/d24/d41/db8/c10f 0 2024-02-19T19:07:39.738 INFO:tasks.workunit.client.1.smithi142.stdout:9/949: write db/d10/d27/d2f/dc5/fd0 [367851,32489] 0 2024-02-19T19:07:39.739 INFO:tasks.workunit.client.1.smithi142.stdout:9/950: symlink db/d10/d22/d24/d41/dd2/l110 0 2024-02-19T19:07:39.739 INFO:tasks.workunit.client.1.smithi142.stdout:9/951: write db/d10/d27/fe5 [670199,83261] 0 2024-02-19T19:07:39.742 INFO:tasks.workunit.client.1.smithi142.stdout:8/949: dread d9/dd/d44/d79/f53 [0,4194304] 0 2024-02-19T19:07:39.742 INFO:tasks.workunit.client.1.smithi142.stdout:8/950: dread - d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/d106/f11e zero size 2024-02-19T19:07:39.743 INFO:tasks.workunit.client.1.smithi142.stdout:8/951: stat d9/dd/de/d14/d65/d6c/da7/d10b/d50/deb 0 2024-02-19T19:07:39.755 INFO:tasks.workunit.client.1.smithi142.stdout:9/952: creat db/d10/d32/d3f/f111 x:0 0 0 2024-02-19T19:07:39.757 INFO:tasks.workunit.client.1.smithi142.stdout:9/953: creat db/d10/d22/d24/d41/dc8/f112 x:0 0 0 2024-02-19T19:07:39.757 INFO:tasks.workunit.client.1.smithi142.stdout:9/954: write db/d10/fb2 [536059,52777] 0 2024-02-19T19:07:39.757 INFO:tasks.workunit.client.1.smithi142.stdout:9/955: stat db/d10/d22/lf3 0 2024-02-19T19:07:39.762 INFO:tasks.workunit.client.1.smithi142.stdout:8/952: mkdir d9/dd/d44/d12b 0 2024-02-19T19:07:39.763 INFO:tasks.workunit.client.1.smithi142.stdout:8/953: link d9/dd/d15/d31/d96/cdf d9/dd/de/d14/d65/d94/dec/d119/c12c 0 2024-02-19T19:07:39.763 INFO:tasks.workunit.client.1.smithi142.stdout:8/954: creat d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/dc3/f12d x:0 0 0 2024-02-19T19:07:39.773 INFO:tasks.workunit.client.1.smithi142.stdout:5/962: rename d5/dd/df/d15/d5b to d5/dd/df/d22/d41/d149 0 2024-02-19T19:07:39.774 INFO:tasks.workunit.client.1.smithi142.stdout:9/956: dwrite db/d10/d22/d24/d41/dd2/fda [0,4194304] 0 2024-02-19T19:07:39.775 INFO:tasks.workunit.client.1.smithi142.stdout:8/955: rename d9/dd/d44/d79/f35 to d9/dd/d15/dd6/ddd/f12e 0 2024-02-19T19:07:39.779 INFO:tasks.workunit.client.1.smithi142.stdout:9/957: getdents db/d10/d27/d2f/d4c/d59 0 2024-02-19T19:07:39.779 INFO:tasks.workunit.client.1.smithi142.stdout:9/958: write db/d10/d22/d24/d41/d99/ffc [603592,36957] 0 2024-02-19T19:07:39.779 INFO:tasks.workunit.client.1.smithi142.stdout:9/959: truncate db/d10/d22/d24/d41/f74 1974175 0 2024-02-19T19:07:39.779 INFO:tasks.workunit.client.1.smithi142.stdout:9/960: fsync db/d10/d22/f5c 0 2024-02-19T19:07:39.782 INFO:tasks.workunit.client.1.smithi142.stdout:5/963: dread d5/dd/d8/dbc/feb [0,4194304] 0 2024-02-19T19:07:39.782 INFO:tasks.workunit.client.1.smithi142.stdout:9/961: write db/d10/d32/d91/fa1 [188128,105198] 0 2024-02-19T19:07:39.784 INFO:tasks.workunit.client.1.smithi142.stdout:5/964: mknod d5/dd/d8/d31/d4d/d75/c14a 0 2024-02-19T19:07:39.784 INFO:tasks.workunit.client.1.smithi142.stdout:5/965: readlink d5/dd/d8/d1c/lac 0 2024-02-19T19:07:39.784 INFO:tasks.workunit.client.1.smithi142.stdout:5/966: fdatasync d5/dd/d8/dd4/d116/f11f 0 2024-02-19T19:07:39.785 INFO:tasks.workunit.client.1.smithi142.stdout:7/828: dwrite d0/fc [4194304,4194304] 0 2024-02-19T19:07:39.786 INFO:tasks.workunit.client.1.smithi142.stdout:8/956: write d9/dd/de/d14/d65/d6c/f3a [4894241,10920] 0 2024-02-19T19:07:39.786 INFO:tasks.workunit.client.1.smithi142.stdout:5/967: rename d5/dd/d8/dd4/db4/d101 to d5/dd/d8/d31/d4d/d8d/d113/d14b 0 2024-02-19T19:07:39.787 INFO:tasks.workunit.client.1.smithi142.stdout:0/812: sync 2024-02-19T19:07:39.787 INFO:tasks.workunit.client.1.smithi142.stdout:2/816: sync 2024-02-19T19:07:39.787 INFO:tasks.workunit.client.1.smithi142.stdout:6/891: sync 2024-02-19T19:07:39.787 INFO:tasks.workunit.client.1.smithi142.stdout:6/892: creat d2/d17/d33/d42/d5e/d117/f132 x:0 0 0 2024-02-19T19:07:39.788 INFO:tasks.workunit.client.1.smithi142.stdout:7/829: mknod d0/d1b/d21/d107/d86/c115 0 2024-02-19T19:07:39.788 INFO:tasks.workunit.client.1.smithi142.stdout:7/830: fdatasync d0/d1b/d21/fba 0 2024-02-19T19:07:39.789 INFO:tasks.workunit.client.1.smithi142.stdout:5/968: mkdir d5/dd/d8/d31/d4d/d75/d14c 0 2024-02-19T19:07:39.790 INFO:tasks.workunit.client.1.smithi142.stdout:0/813: mknod d23/d28/d41/d78/c105 0 2024-02-19T19:07:39.791 INFO:tasks.workunit.client.1.smithi142.stdout:5/969: rmdir d5/dd/df/d22/d41 39 2024-02-19T19:07:39.791 INFO:tasks.workunit.client.1.smithi142.stdout:5/970: write d5/dd/d8/dd4/db4/fdc [457775,106777] 0 2024-02-19T19:07:39.791 INFO:tasks.workunit.client.1.smithi142.stdout:5/971: chown d5/dd/d8/d31/l122 17632782 1 2024-02-19T19:07:39.793 INFO:tasks.workunit.client.1.smithi142.stdout:5/972: symlink d5/dd/d8/d2a/l14d 0 2024-02-19T19:07:39.795 INFO:tasks.workunit.client.1.smithi142.stdout:5/973: creat d5/dd/df/f14e x:0 0 0 2024-02-19T19:07:39.795 INFO:tasks.workunit.client.1.smithi142.stdout:5/974: chown d5/dd/d8/d31/c4f 72 1 2024-02-19T19:07:39.796 INFO:tasks.workunit.client.1.smithi142.stdout:5/975: mkdir d5/dd/d14f 0 2024-02-19T19:07:39.798 INFO:tasks.workunit.client.1.smithi142.stdout:8/957: dread d9/dd/d44/d79/f25 [0,4194304] 0 2024-02-19T19:07:39.802 INFO:tasks.workunit.client.1.smithi142.stdout:6/893: dread d2/f5f [0,4194304] 0 2024-02-19T19:07:39.802 INFO:tasks.workunit.client.1.smithi142.stdout:6/894: write d2/d1f/fc3 [269902,122642] 0 2024-02-19T19:07:39.802 INFO:tasks.workunit.client.1.smithi142.stdout:6/895: creat d2/d1e/d35/d66/d8d/d3e/d8c/f133 x:0 0 0 2024-02-19T19:07:39.803 INFO:tasks.workunit.client.1.smithi142.stdout:2/817: dread d3/d4d/d5f/d7c/f7e [0,4194304] 0 2024-02-19T19:07:39.804 INFO:tasks.workunit.client.1.smithi142.stdout:2/818: mknod d3/db/d29/dba/c10c 0 2024-02-19T19:07:39.804 INFO:tasks.workunit.client.1.smithi142.stdout:2/819: chown d3/df/c92 0 1 2024-02-19T19:07:39.813 INFO:tasks.workunit.client.1.smithi142.stdout:8/958: dread d9/da8/fbd [0,4194304] 0 2024-02-19T19:07:39.813 INFO:tasks.workunit.client.1.smithi142.stdout:7/831: dwrite d0/d1b/d21/d107/ffb [0,4194304] 0 2024-02-19T19:07:39.813 INFO:tasks.workunit.client.1.smithi142.stdout:9/962: dwrite db/d10/d22/f9d [0,4194304] 0 2024-02-19T19:07:39.813 INFO:tasks.workunit.client.1.smithi142.stdout:9/963: dread - db/d10/d22/d24/d41/dd2/dad/df9/f10a zero size 2024-02-19T19:07:39.815 INFO:tasks.workunit.client.1.smithi142.stdout:6/896: dread d2/d29/d47/f4a [0,4194304] 0 2024-02-19T19:07:39.817 INFO:tasks.workunit.client.1.smithi142.stdout:7/832: symlink d0/d1b/dbc/dcb/l116 0 2024-02-19T19:07:39.819 INFO:tasks.workunit.client.1.smithi142.stdout:2/820: dread d3/db/f15 [4194304,4194304] 0 2024-02-19T19:07:39.821 INFO:tasks.workunit.client.1.smithi142.stdout:9/964: mkdir db/d10/d27/db9/d113 0 2024-02-19T19:07:39.822 INFO:tasks.workunit.client.1.smithi142.stdout:2/821: creat d3/d4d/d5f/d7c/dd6/f10d x:0 0 0 2024-02-19T19:07:39.822 INFO:tasks.workunit.client.1.smithi142.stdout:5/976: rmdir d5/dd/df 39 2024-02-19T19:07:39.839 INFO:tasks.workunit.client.1.smithi142.stdout:2/822: dread d3/f1f [0,4194304] 0 2024-02-19T19:07:39.839 INFO:tasks.workunit.client.1.smithi142.stdout:8/959: dwrite d9/dd/de/d14/d65/d6c/da7/d10b/f88 [0,4194304] 0 2024-02-19T19:07:39.840 INFO:tasks.workunit.client.1.smithi142.stdout:2/823: fsync d3/db/d29/d6d/f56 0 2024-02-19T19:07:39.841 INFO:tasks.workunit.client.1.smithi142.stdout:7/833: dwrite d0/d13/d72/f45 [0,4194304] 0 2024-02-19T19:07:39.842 INFO:tasks.workunit.client.1.smithi142.stdout:7/834: symlink d0/d13/d1e/db7/dca/l117 0 2024-02-19T19:07:39.842 INFO:tasks.workunit.client.1.smithi142.stdout:7/835: chown d0/d1b/d9d/da4 199 1 2024-02-19T19:07:39.843 INFO:tasks.workunit.client.1.smithi142.stdout:7/836: mknod d0/d1b/d21/d24/d29/d7e/dde/c118 0 2024-02-19T19:07:39.843 INFO:tasks.workunit.client.1.smithi142.stdout:7/837: creat d0/d1b/d21/d107/d86/f119 x:0 0 0 2024-02-19T19:07:39.843 INFO:tasks.workunit.client.1.smithi142.stdout:7/838: chown d0/d1b/d21/d107/d86/cc3 53 1 2024-02-19T19:07:39.844 INFO:tasks.workunit.client.1.smithi142.stdout:7/839: truncate d0/d1b/d21/d24/d29/d44/d49/d9b/fb4 1458481 0 2024-02-19T19:07:39.844 INFO:tasks.workunit.client.1.smithi142.stdout:7/840: stat d0/d1b/fd0 0 2024-02-19T19:07:39.845 INFO:tasks.workunit.client.1.smithi142.stdout:6/897: dwrite d2/d1e/d35/d66/d8d/d3e/f107 [0,4194304] 0 2024-02-19T19:07:39.845 INFO:tasks.workunit.client.1.smithi142.stdout:7/841: mkdir d0/d1b/d21/d24/ddf/d11a 0 2024-02-19T19:07:39.848 INFO:tasks.workunit.client.1.smithi142.stdout:7/842: unlink d0/d1b/d21/d24/ce5 0 2024-02-19T19:07:39.848 INFO:tasks.workunit.client.1.smithi142.stdout:7/843: chown d0/d1b/d21/d24/d29/d44/d49/lcd 0 1 2024-02-19T19:07:39.856 INFO:tasks.workunit.client.1.smithi142.stdout:7/844: dread d0/fc [8388608,4194304] 0 2024-02-19T19:07:39.856 INFO:tasks.workunit.client.1.smithi142.stdout:7/845: dread - d0/d1b/ffd zero size 2024-02-19T19:07:39.860 INFO:tasks.workunit.client.1.smithi142.stdout:7/846: write d0/d1b/d21/d24/d29/d44/d49/d9b/fb4 [566700,56597] 0 2024-02-19T19:07:39.861 INFO:tasks.workunit.client.1.smithi142.stdout:7/847: truncate d0/d13/f27 1719179 0 2024-02-19T19:07:39.862 INFO:tasks.workunit.client.1.smithi142.stdout:7/848: creat d0/d1b/d21/d24/d29/d44/d49/d10d/f11b x:0 0 0 2024-02-19T19:07:39.864 INFO:tasks.workunit.client.1.smithi142.stdout:7/849: mknod d0/d13/d72/c11c 0 2024-02-19T19:07:39.866 INFO:tasks.workunit.client.1.smithi142.stdout:7/850: rmdir d0/d1b/d9d/da4/dfa 0 2024-02-19T19:07:39.866 INFO:tasks.workunit.client.1.smithi142.stdout:7/851: fdatasync d0/d1b/d21/d24/d29/d44/d49/d8b/d103/fdc 0 2024-02-19T19:07:39.934 INFO:tasks.workunit.client.1.smithi142.stdout:9/965: sync 2024-02-19T19:07:39.935 INFO:tasks.workunit.client.1.smithi142.stdout:0/814: sync 2024-02-19T19:07:39.935 INFO:tasks.workunit.client.1.smithi142.stdout:5/977: sync 2024-02-19T19:07:39.935 INFO:tasks.workunit.client.1.smithi142.stdout:5/978: chown d5/dd/df/d15/fb1 31 1 2024-02-19T19:07:39.935 INFO:tasks.workunit.client.1.smithi142.stdout:0/815: truncate d23/d7d/fad 186122 0 2024-02-19T19:07:39.936 INFO:tasks.workunit.client.1.smithi142.stdout:0/816: write d23/d7d/d9e/fef [361826,69505] 0 2024-02-19T19:07:39.937 INFO:tasks.workunit.client.1.smithi142.stdout:5/979: rename d5/dd/d8/d31/d4d/d8d/fcc to d5/dd/df/da0/f150 0 2024-02-19T19:07:39.937 INFO:tasks.workunit.client.1.smithi142.stdout:9/966: mkdir db/d10/d32/d3f/d114 0 2024-02-19T19:07:39.938 INFO:tasks.workunit.client.1.smithi142.stdout:5/980: rename d5/dd/d8/dd4/la2 to d5/dd/df/l151 0 2024-02-19T19:07:39.939 INFO:tasks.workunit.client.1.smithi142.stdout:9/967: mknod db/d8e/c115 0 2024-02-19T19:07:39.939 INFO:tasks.workunit.client.1.smithi142.stdout:9/968: fdatasync db/d10/d27/db9/ffe 0 2024-02-19T19:07:39.940 INFO:tasks.workunit.client.1.smithi142.stdout:5/981: mkdir d5/dda/d152 0 2024-02-19T19:07:39.940 INFO:tasks.workunit.client.1.smithi142.stdout:5/982: stat d5/l48 0 2024-02-19T19:07:39.944 INFO:tasks.workunit.client.1.smithi142.stdout:0/817: write d23/d28/d2d/d54/ff7 [1761264,60017] 0 2024-02-19T19:07:39.947 INFO:tasks.workunit.client.1.smithi142.stdout:0/818: mknod d23/d7d/d9e/c106 0 2024-02-19T19:07:39.949 INFO:tasks.workunit.client.1.smithi142.stdout:0/819: symlink d23/d32/d8a/dfc/l107 0 2024-02-19T19:07:39.950 INFO:tasks.workunit.client.1.smithi142.stdout:0/820: mknod d23/d7d/c108 0 2024-02-19T19:07:39.951 INFO:tasks.workunit.client.1.smithi142.stdout:0/821: mkdir d23/d7d/d9e/d109 0 2024-02-19T19:07:39.952 INFO:tasks.workunit.client.1.smithi142.stdout:0/822: chown d23/d28/d2d/d54/d88/fa4 166 1 2024-02-19T19:07:39.952 INFO:tasks.workunit.client.1.smithi142.stdout:0/823: stat d23/d7d/d9e/fd0 0 2024-02-19T19:07:39.961 INFO:tasks.workunit.client.1.smithi142.stdout:9/969: dwrite db/d10/d27/db9/fcf [0,4194304] 0 2024-02-19T19:07:39.961 INFO:tasks.workunit.client.1.smithi142.stdout:9/970: dread - db/d10/d27/d2f/f5d zero size 2024-02-19T19:07:39.961 INFO:tasks.workunit.client.1.smithi142.stdout:5/983: dwrite d5/dd/d8/d2a/d93/ffa [0,4194304] 0 2024-02-19T19:07:39.962 INFO:tasks.workunit.client.1.smithi142.stdout:5/984: stat d5/dd/d8/d5d/d102 0 2024-02-19T19:07:39.962 INFO:tasks.workunit.client.1.smithi142.stdout:9/971: symlink db/d10/d27/d2f/dc5/l116 0 2024-02-19T19:07:39.964 INFO:tasks.workunit.client.1.smithi142.stdout:5/985: mknod d5/dda/de3/c153 0 2024-02-19T19:07:39.965 INFO:tasks.workunit.client.1.smithi142.stdout:9/972: mknod db/d10/d27/d2f/d4c/d59/c117 0 2024-02-19T19:07:39.967 INFO:tasks.workunit.client.1.smithi142.stdout:9/973: truncate db/d10/d22/d24/f92 386522 0 2024-02-19T19:07:39.967 INFO:tasks.workunit.client.1.smithi142.stdout:9/974: fsync db/d10/d22/f50 0 2024-02-19T19:07:39.968 INFO:tasks.workunit.client.1.smithi142.stdout:5/986: write d5/dd/df/d22/d41/d32/f84 [3697243,102681] 0 2024-02-19T19:07:39.968 INFO:tasks.workunit.client.1.smithi142.stdout:5/987: chown d5/fb3 332336000 1 2024-02-19T19:07:39.968 INFO:tasks.workunit.client.1.smithi142.stdout:9/975: rmdir db/d10/d32/d91/dc1 39 2024-02-19T19:07:39.968 INFO:tasks.workunit.client.1.smithi142.stdout:9/976: write db/d10/d22/d24/d41/dd2/fda [4873872,31391] 0 2024-02-19T19:07:39.970 INFO:tasks.workunit.client.1.smithi142.stdout:5/988: creat d5/dd/df/d22/d41/f154 x:0 0 0 2024-02-19T19:07:39.970 INFO:tasks.workunit.client.1.smithi142.stdout:5/989: chown d5/dd/d8/d31/d4d/d60/l10b 132058764 1 2024-02-19T19:07:39.971 INFO:tasks.workunit.client.1.smithi142.stdout:9/977: creat db/d10/d32/d3f/f118 x:0 0 0 2024-02-19T19:07:39.973 INFO:tasks.workunit.client.1.smithi142.stdout:5/990: unlink d5/dd/d8/d31/d4d/d8d/f98 0 2024-02-19T19:07:39.974 INFO:tasks.workunit.client.1.smithi142.stdout:9/978: truncate db/d10/d27/d2f/ff7 3431701 0 2024-02-19T19:07:39.975 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:39 smithi046 ceph-mon[88928]: from='osd.1 [v2:172.21.15.46:6810/2409899830,v1:172.21.15.46:6811/2409899830]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T19:07:39.976 INFO:tasks.workunit.client.1.smithi142.stdout:5/991: creat d5/dd/d8/f155 x:0 0 0 2024-02-19T19:07:39.976 INFO:tasks.workunit.client.1.smithi142.stdout:0/824: dwrite d23/d7d/f92 [0,4194304] 0 2024-02-19T19:07:39.976 INFO:tasks.workunit.client.1.smithi142.stdout:0/825: write d23/d28/d2d/d54/d88/fa4 [826883,66614] 0 2024-02-19T19:07:39.977 INFO:tasks.workunit.client.1.smithi142.stdout:5/992: truncate d5/dd/df/d22/f37 1377314 0 2024-02-19T19:07:39.983 INFO:tasks.workunit.client.1.smithi142.stdout:0/826: creat d23/d7d/d9e/dc7/f10a x:0 0 0 2024-02-19T19:07:39.986 INFO:tasks.workunit.client.1.smithi142.stdout:0/827: rename d23/d32/c52 to d23/d86/c10b 0 2024-02-19T19:07:39.986 INFO:tasks.workunit.client.1.smithi142.stdout:0/828: truncate d23/f3d 5019687 0 2024-02-19T19:07:39.987 INFO:tasks.workunit.client.1.smithi142.stdout:0/829: readlink d23/l2e 0 2024-02-19T19:07:39.987 INFO:tasks.workunit.client.1.smithi142.stdout:0/830: write d23/d28/d2d/d54/d85/fcf [201848,113478] 0 2024-02-19T19:07:39.987 INFO:tasks.workunit.client.1.smithi142.stdout:0/831: chown d23/d32/d8a/ca9 10189 1 2024-02-19T19:07:39.994 INFO:tasks.workunit.client.1.smithi142.stdout:0/832: dread d23/f31 [0,4194304] 0 2024-02-19T19:07:39.994 INFO:tasks.workunit.client.1.smithi142.stdout:0/833: chown d23/d32/d8a/dfc 3544 1 2024-02-19T19:07:39.994 INFO:tasks.workunit.client.1.smithi142.stdout:0/834: creat d23/d28/d2d/d54/d88/f10c x:0 0 0 2024-02-19T19:07:39.994 INFO:tasks.workunit.client.1.smithi142.stdout:0/835: creat d23/d28/d41/d78/f10d x:0 0 0 2024-02-19T19:07:39.994 INFO:tasks.workunit.client.1.smithi142.stdout:0/836: readlink d23/d28/l61 0 2024-02-19T19:07:39.995 INFO:tasks.workunit.client.1.smithi142.stdout:8/960: sync 2024-02-19T19:07:39.995 INFO:tasks.workunit.client.1.smithi142.stdout:2/824: sync 2024-02-19T19:07:39.995 INFO:tasks.workunit.client.1.smithi142.stdout:8/961: write d9/dd/de/d14/fe6 [276891,26305] 0 2024-02-19T19:07:39.996 INFO:tasks.workunit.client.1.smithi142.stdout:8/962: write d9/dd/de/d14/f60 [3462546,60770] 0 2024-02-19T19:07:39.996 INFO:tasks.workunit.client.1.smithi142.stdout:8/963: write d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/d106/f124 [1661710,37461] 0 2024-02-19T19:07:39.998 INFO:tasks.workunit.client.1.smithi142.stdout:0/837: creat d23/d86/f10e x:0 0 0 2024-02-19T19:07:39.998 INFO:tasks.workunit.client.1.smithi142.stdout:0/838: stat d23/d32/f30 0 2024-02-19T19:07:40.000 INFO:tasks.workunit.client.1.smithi142.stdout:5/993: dwrite d5/dd/df/d22/d41/d32/f39 [4194304,4194304] 0 2024-02-19T19:07:40.001 INFO:tasks.workunit.client.1.smithi142.stdout:0/839: mkdir d23/d28/d41/d10f 0 2024-02-19T19:07:40.001 INFO:tasks.workunit.client.1.smithi142.stdout:0/840: fsync d23/d86/f8b 0 2024-02-19T19:07:40.001 INFO:tasks.workunit.client.1.smithi142.stdout:0/841: read - d23/d28/fec zero size 2024-02-19T19:07:40.005 INFO:tasks.workunit.client.1.smithi142.stdout:5/994: mkdir d5/dd/d8/dd4/d156 0 2024-02-19T19:07:40.005 INFO:tasks.workunit.client.1.smithi142.stdout:5/995: write d5/dd/d8/d31/d4d/d8d/d113/f144 [855690,78714] 0 2024-02-19T19:07:40.007 INFO:tasks.workunit.client.1.smithi142.stdout:0/842: link d23/d32/f8f d23/d7d/d9e/dc7/f110 0 2024-02-19T19:07:40.009 INFO:tasks.workunit.client.1.smithi142.stdout:9/979: dread db/d10/d27/d2f/ff7 [0,4194304] 0 2024-02-19T19:07:40.013 INFO:tasks.workunit.client.1.smithi142.stdout:2/825: dwrite d3/d4b/f7d [0,4194304] 0 2024-02-19T19:07:40.013 INFO:tasks.workunit.client.1.smithi142.stdout:9/980: mknod db/d10/d27/d2f/d4c/d54/c119 0 2024-02-19T19:07:40.013 INFO:tasks.workunit.client.1.smithi142.stdout:9/981: write db/d10/d22/d24/d41/dd2/dd3/fed [461398,117123] 0 2024-02-19T19:07:40.016 INFO:tasks.workunit.client.1.smithi142.stdout:2/826: link d3/d68/led d3/db/dda/l10e 0 2024-02-19T19:07:40.018 INFO:tasks.workunit.client.1.smithi142.stdout:2/827: creat d3/d4d/d5f/db5/f10f x:0 0 0 2024-02-19T19:07:40.019 INFO:tasks.workunit.client.1.smithi142.stdout:9/982: mkdir db/d11a 0 2024-02-19T19:07:40.021 INFO:tasks.workunit.client.1.smithi142.stdout:9/983: mknod db/d10/d22/d24/d41/dd2/dad/dc3/c11b 0 2024-02-19T19:07:40.023 INFO:tasks.workunit.client.1.smithi142.stdout:9/984: link db/d10/d32/d3f/f118 db/d10/d27/db9/f11c 0 2024-02-19T19:07:40.024 INFO:tasks.workunit.client.1.smithi142.stdout:9/985: truncate db/d10/d22/d24/f25 1200212 0 2024-02-19T19:07:40.025 INFO:tasks.workunit.client.1.smithi142.stdout:9/986: readlink db/d10/d22/daf/l100 0 2024-02-19T19:07:40.025 INFO:tasks.workunit.client.1.smithi142.stdout:7/852: sync 2024-02-19T19:07:40.025 INFO:tasks.workunit.client.1.smithi142.stdout:6/898: sync 2024-02-19T19:07:40.026 INFO:tasks.workunit.client.1.smithi142.stdout:5/996: dwrite d5/dd/df/d22/d41/fea [8388608,4194304] 0 2024-02-19T19:07:40.027 INFO:tasks.workunit.client.1.smithi142.stdout:7/853: rename d0/d1b/d21/d24/d29/l6f to d0/d13/d1e/db7/l11d 0 2024-02-19T19:07:40.029 INFO:tasks.workunit.client.1.smithi142.stdout:5/997: getdents d5/dd/d8/d31/d4d/d75/d9e/dfc 0 2024-02-19T19:07:40.032 INFO:tasks.workunit.client.1.smithi142.stdout:6/899: dread d2/d1e/d35/d66/d76/fcd [0,4194304] 0 2024-02-19T19:07:40.033 INFO:tasks.workunit.client.1.smithi142.stdout:7/854: rename d0/d1b/d21/d24/ddf/f81 to d0/d13/de4/f11e 0 2024-02-19T19:07:40.033 INFO:tasks.workunit.client.1.smithi142.stdout:7/855: fdatasync d0/d1b/d21/d24/d29/d44/d49/d8b/f97 0 2024-02-19T19:07:40.034 INFO:tasks.workunit.client.1.smithi142.stdout:6/900: mkdir d2/d1e/d35/d66/d8d/d3e/d134 0 2024-02-19T19:07:40.034 INFO:tasks.workunit.client.1.smithi142.stdout:6/901: chown d2/d17/d33/d42/d5e 218371 1 2024-02-19T19:07:40.034 INFO:tasks.workunit.client.1.smithi142.stdout:7/856: mkdir d0/d1b/d11f 0 2024-02-19T19:07:40.035 INFO:tasks.workunit.client.1.smithi142.stdout:6/902: truncate d2/d17/d33/d42/da2/da7/dd2/dd3/ffe 4035883 0 2024-02-19T19:07:40.037 INFO:tasks.workunit.client.1.smithi142.stdout:7/857: mknod d0/d1b/d21/d24/d5e/df8/c120 0 2024-02-19T19:07:40.037 INFO:tasks.workunit.client.1.smithi142.stdout:7/858: chown d0/f16 18182735 1 2024-02-19T19:07:40.037 INFO:tasks.workunit.client.1.smithi142.stdout:7/859: truncate d0/d1b/ffd 16074 0 2024-02-19T19:07:40.039 INFO:tasks.workunit.client.1.smithi142.stdout:6/903: unlink d2/d1e/d35/d66/d8d/f50 0 2024-02-19T19:07:40.040 INFO:tasks.workunit.client.1.smithi142.stdout:7/860: getdents d0/d1b/d21/d24/d29/d44/d49/d9b 0 2024-02-19T19:07:40.041 INFO:tasks.workunit.client.1.smithi142.stdout:6/904: mkdir d2/d17/d135 0 2024-02-19T19:07:40.045 INFO:tasks.workunit.client.1.smithi142.stdout:7/861: dread d0/d13/d72/da7/f78 [0,4194304] 0 2024-02-19T19:07:40.054 INFO:tasks.workunit.client.1.smithi142.stdout:9/987: dwrite db/d10/d22/d24/f3c [0,4194304] 0 2024-02-19T19:07:40.056 INFO:tasks.workunit.client.1.smithi142.stdout:5/998: dwrite d5/dd/df/d22/dc0/f11d [0,4194304] 0 2024-02-19T19:07:40.057 INFO:tasks.workunit.client.1.smithi142.stdout:2/828: dwrite d3/f62 [0,4194304] 0 2024-02-19T19:07:40.058 INFO:tasks.workunit.client.1.smithi142.stdout:9/988: write db/d10/d22/d24/d41/dd2/dad/fb4 [1029829,84777] 0 2024-02-19T19:07:40.058 INFO:tasks.workunit.client.1.smithi142.stdout:9/989: write db/f18 [902475,35356] 0 2024-02-19T19:07:40.059 INFO:tasks.workunit.client.1.smithi142.stdout:5/999: mknod d5/dd/d8/d2a/c157 0 2024-02-19T19:07:40.062 INFO:tasks.workunit.client.1.smithi142.stdout:2/829: link d3/d4d/d5f/l9c d3/d4d/d81/l110 0 2024-02-19T19:07:40.062 INFO:tasks.workunit.client.1.smithi142.stdout:2/830: chown d3/df/f32 6928437 1 2024-02-19T19:07:40.062 INFO:tasks.workunit.client.1.smithi142.stdout:2/831: chown d3/db/d29/f5d 6 1 2024-02-19T19:07:40.063 INFO:tasks.workunit.client.1.smithi142.stdout:9/990: mkdir db/d10/d7d/d11d 0 2024-02-19T19:07:40.063 INFO:tasks.workunit.client.1.smithi142.stdout:7/862: dwrite d0/d1b/d21/d24/d29/f6e [0,4194304] 0 2024-02-19T19:07:40.065 INFO:tasks.workunit.client.1.smithi142.stdout:2/832: unlink d3/db/d29/d4c/d4e/d9a/da9/dad/d105/ffd 0 2024-02-19T19:07:40.068 INFO:tasks.workunit.client.1.smithi142.stdout:9/991: mkdir db/d10/d22/d24/d41/dd2/dad/df9/d11e 0 2024-02-19T19:07:40.068 INFO:tasks.workunit.client.1.smithi142.stdout:9/992: fsync db/d8e/f101 0 2024-02-19T19:07:40.069 INFO:tasks.workunit.client.1.smithi142.stdout:7/863: creat d0/d1b/d21/d24/d29/d44/de1/df3/f121 x:0 0 0 2024-02-19T19:07:40.071 INFO:tasks.workunit.client.1.smithi142.stdout:2/833: mknod d3/d4d/d5f/c111 0 2024-02-19T19:07:40.082 INFO:tasks.workunit.client.1.smithi142.stdout:9/993: getdents db/d10/d22/d24/d41/dd2/dad/df9 0 2024-02-19T19:07:40.084 INFO:tasks.workunit.client.1.smithi142.stdout:9/994: symlink db/d10/d27/d2f/dc5/l11f 0 2024-02-19T19:07:40.086 INFO:tasks.workunit.client.1.smithi142.stdout:9/995: rename db/d10/d32/d3f/f75 to db/d10/d22/d24/d41/dd2/dad/df9/f120 0 2024-02-19T19:07:40.095 INFO:tasks.workunit.client.1.smithi142.stdout:7/864: dwrite d0/fa1 [0,4194304] 0 2024-02-19T19:07:40.095 INFO:tasks.workunit.client.1.smithi142.stdout:7/865: chown d0/d1b/d21/d107/d86/c115 12978708 1 2024-02-19T19:07:40.098 INFO:tasks.workunit.client.1.smithi142.stdout:2/834: dwrite d3/db/d29/f41 [8388608,4194304] 0 2024-02-19T19:07:40.104 INFO:tasks.workunit.client.1.smithi142.stdout:9/996: dwrite db/d10/d22/d24/f92 [0,4194304] 0 2024-02-19T19:07:40.104 INFO:tasks.workunit.client.1.smithi142.stdout:2/835: truncate d3/d4d/d5f/d7c/f7e 2303712 0 2024-02-19T19:07:40.104 INFO:tasks.workunit.client.1.smithi142.stdout:9/997: creat db/f121 x:0 0 0 2024-02-19T19:07:40.104 INFO:tasks.workunit.client.1.smithi142.stdout:9/998: dread - db/d10/d27/d2f/f5d zero size 2024-02-19T19:07:40.104 INFO:tasks.workunit.client.1.smithi142.stdout:2/836: write d3/fac [486978,31074] 0 2024-02-19T19:07:40.104 INFO:tasks.workunit.client.1.smithi142.stdout:2/837: symlink d3/db/d29/d4c/df9/d104/l112 0 2024-02-19T19:07:40.104 INFO:tasks.workunit.client.1.smithi142.stdout:2/838: write d3/db/d29/d4c/d4e/db9/fe5 [845160,105340] 0 2024-02-19T19:07:40.106 INFO:tasks.workunit.client.1.smithi142.stdout:9/999: symlink db/l122 0 2024-02-19T19:07:40.108 INFO:tasks.workunit.client.1.smithi142.stdout:2/839: rename d3/d4d/d9f/ld5 to d3/df/da4/de7/l113 0 2024-02-19T19:07:40.108 INFO:tasks.workunit.client.1.smithi142.stdout:2/840: fsync d3/d35/d53/f83 0 2024-02-19T19:07:40.109 INFO:tasks.workunit.client.1.smithi142.stdout:2/841: mknod d3/db/d29/d6d/d59/c114 0 2024-02-19T19:07:40.109 INFO:tasks.workunit.client.1.smithi142.stdout:2/842: fsync d3/d68/fc0 0 2024-02-19T19:07:40.113 INFO:tasks.workunit.client.1.smithi142.stdout:8/964: sync 2024-02-19T19:07:40.116 INFO:tasks.workunit.client.1.smithi142.stdout:8/965: rename d9/dd/d15/d31/c6d to d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/c12f 0 2024-02-19T19:07:40.117 INFO:tasks.workunit.client.1.smithi142.stdout:8/966: rmdir d9/dd 39 2024-02-19T19:07:40.118 INFO:tasks.workunit.client.1.smithi142.stdout:8/967: rmdir d9/dd/d15/d31/d126 39 2024-02-19T19:07:40.118 INFO:tasks.workunit.client.1.smithi142.stdout:8/968: chown d9/dd/f47 2823941 1 2024-02-19T19:07:40.119 INFO:tasks.workunit.client.1.smithi142.stdout:7/866: dwrite d0/d1b/d21/d107/d86/f113 [0,4194304] 0 2024-02-19T19:07:40.119 INFO:tasks.workunit.client.1.smithi142.stdout:7/867: fdatasync d0/d1b/d21/d24/ddf/f9f 0 2024-02-19T19:07:40.119 INFO:tasks.workunit.client.1.smithi142.stdout:8/969: rmdir d9/dd/de/d14/d65/d6c/da7 39 2024-02-19T19:07:40.122 INFO:tasks.workunit.client.1.smithi142.stdout:7/868: link d0/d13/d1e/cb8 d0/d1b/d21/d24/ddf/d11a/c122 0 2024-02-19T19:07:40.122 INFO:tasks.workunit.client.1.smithi142.stdout:7/869: fsync d0/d1b/d21/d24/d29/f2c 0 2024-02-19T19:07:40.123 INFO:tasks.workunit.client.1.smithi142.stdout:7/870: stat d0/d13/fc0 0 2024-02-19T19:07:40.131 INFO:tasks.workunit.client.1.smithi142.stdout:2/843: dwrite d3/db/f47 [0,4194304] 0 2024-02-19T19:07:40.133 INFO:tasks.workunit.client.1.smithi142.stdout:2/844: creat d3/d35/f115 x:0 0 0 2024-02-19T19:07:40.134 INFO:tasks.workunit.client.1.smithi142.stdout:2/845: mkdir d3/db/dda/d116 0 2024-02-19T19:07:40.134 INFO:tasks.workunit.client.1.smithi142.stdout:2/846: chown d3/d68/d95/dca/ff0 68966872 1 2024-02-19T19:07:40.135 INFO:tasks.workunit.client.1.smithi142.stdout:7/871: dread d0/d13/de4/f11e [0,4194304] 0 2024-02-19T19:07:40.141 INFO:tasks.workunit.client.1.smithi142.stdout:0/843: sync 2024-02-19T19:07:40.141 INFO:tasks.workunit.client.1.smithi142.stdout:6/905: sync 2024-02-19T19:07:40.143 INFO:tasks.workunit.client.1.smithi142.stdout:6/906: getdents d2/d1f/d4d 0 2024-02-19T19:07:40.143 INFO:tasks.workunit.client.1.smithi142.stdout:6/907: fdatasync d2/d1f/d45/faa 0 2024-02-19T19:07:40.143 INFO:tasks.workunit.client.1.smithi142.stdout:6/908: chown d2/d1f/d56/f6b 602153095 1 2024-02-19T19:07:40.143 INFO:tasks.workunit.client.1.smithi142.stdout:6/909: chown d2/d1f/d20/d31/fa8 7955 1 2024-02-19T19:07:40.143 INFO:tasks.workunit.client.1.smithi142.stdout:6/910: readlink d2/d1f/d4d/d60/l9c 0 2024-02-19T19:07:40.145 INFO:tasks.workunit.client.1.smithi142.stdout:6/911: symlink d2/d17/d33/d42/da2/da7/de6/l136 0 2024-02-19T19:07:40.161 INFO:tasks.workunit.client.1.smithi142.stdout:2/847: dwrite d3/db/d29/d4c/d4e/fa5 [0,4194304] 0 2024-02-19T19:07:40.161 INFO:tasks.workunit.client.1.smithi142.stdout:7/872: dwrite d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:40.161 INFO:tasks.workunit.client.1.smithi142.stdout:0/844: dread f17 [0,4194304] 0 2024-02-19T19:07:40.164 INFO:tasks.workunit.client.1.smithi142.stdout:7/873: mknod d0/d13/de4/dfc/c123 0 2024-02-19T19:07:40.165 INFO:tasks.workunit.client.1.smithi142.stdout:7/874: mknod d0/d1b/d21/d24/d29/d44/de1/c124 0 2024-02-19T19:07:40.167 INFO:tasks.workunit.client.1.smithi142.stdout:7/875: creat d0/d1b/d21/d24/d29/dc5/f125 x:0 0 0 2024-02-19T19:07:40.167 INFO:tasks.workunit.client.1.smithi142.stdout:7/876: fdatasync d0/d1b/d21/d24/d29/d44/d49/fe8 0 2024-02-19T19:07:40.169 INFO:tasks.workunit.client.1.smithi142.stdout:7/877: mkdir d0/d1b/d21/d24/d29/d44/de1/df3/d126 0 2024-02-19T19:07:40.172 INFO:tasks.workunit.client.1.smithi142.stdout:7/878: dread d0/d13/f15 [0,4194304] 0 2024-02-19T19:07:40.173 INFO:tasks.workunit.client.1.smithi142.stdout:7/879: mkdir d0/d1b/d21/d24/d29/d44/d49/d10d/d112/d127 0 2024-02-19T19:07:40.174 INFO:tasks.workunit.client.1.smithi142.stdout:7/880: creat d0/d1b/f128 x:0 0 0 2024-02-19T19:07:40.177 INFO:tasks.workunit.client.1.smithi142.stdout:7/881: dread d0/d1b/d21/d24/f28 [0,4194304] 0 2024-02-19T19:07:40.177 INFO:tasks.workunit.client.1.smithi142.stdout:2/848: dwrite d3/db/d29/d6d/f102 [0,4194304] 0 2024-02-19T19:07:40.178 INFO:tasks.workunit.client.1.smithi142.stdout:7/882: symlink d0/d1b/d9d/l129 0 2024-02-19T19:07:40.180 INFO:tasks.workunit.client.1.smithi142.stdout:0/845: dwrite d23/d28/f93 [0,4194304] 0 2024-02-19T19:07:40.182 INFO:tasks.workunit.client.1.smithi142.stdout:2/849: mkdir d3/d68/d95/d117 0 2024-02-19T19:07:40.184 INFO:tasks.workunit.client.1.smithi142.stdout:7/883: rename d0/d1b/d21/d24/d29/d44/d49/d8b to d0/d1b/d21/d24/d29/d44/d49/d10d/d12a 0 2024-02-19T19:07:40.187 INFO:tasks.workunit.client.1.smithi142.stdout:0/846: symlink d23/d28/d2d/d54/d88/l111 0 2024-02-19T19:07:40.189 INFO:tasks.workunit.client.1.smithi142.stdout:2/850: mknod d3/db/d29/d6d/de6/c118 0 2024-02-19T19:07:40.189 INFO:tasks.workunit.client.1.smithi142.stdout:2/851: fdatasync d3/db/d29/d4c/d4e/d9a/da9/f108 0 2024-02-19T19:07:40.190 INFO:tasks.workunit.client.1.smithi142.stdout:7/884: symlink d0/d13/de4/l12b 0 2024-02-19T19:07:40.192 INFO:tasks.workunit.client.1.smithi142.stdout:0/847: rmdir d23/d28/d2d/d51/dc9/d58/db6/de4 0 2024-02-19T19:07:40.192 INFO:tasks.workunit.client.1.smithi142.stdout:0/848: creat d23/d28/d2d/d54/d88/f112 x:0 0 0 2024-02-19T19:07:40.192 INFO:tasks.workunit.client.1.smithi142.stdout:0/849: getdents d23/d28/d41/d10f 0 2024-02-19T19:07:40.192 INFO:tasks.workunit.client.1.smithi142.stdout:0/850: dread - d23/d32/f50 zero size 2024-02-19T19:07:40.193 INFO:tasks.workunit.client.1.smithi142.stdout:0/851: write d23/d28/faa [2429846,93163] 0 2024-02-19T19:07:40.193 INFO:tasks.workunit.client.1.smithi142.stdout:0/852: write d23/d28/d2d/d51/dc9/d58/f76 [1309388,112837] 0 2024-02-19T19:07:40.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:39 smithi142 ceph-mon[69118]: from='osd.1 [v2:172.21.15.46:6810/2409899830,v1:172.21.15.46:6811/2409899830]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T19:07:40.201 INFO:tasks.workunit.client.1.smithi142.stdout:0/853: dread d23/d28/d2d/d51/dc9/f89 [0,4194304] 0 2024-02-19T19:07:40.202 INFO:tasks.workunit.client.1.smithi142.stdout:0/854: truncate d23/d28/d2d/f60 3567671 0 2024-02-19T19:07:40.203 INFO:tasks.workunit.client.1.smithi142.stdout:7/885: dwrite d0/d1b/d21/d24/d29/f7f [0,4194304] 0 2024-02-19T19:07:40.203 INFO:tasks.workunit.client.1.smithi142.stdout:7/886: getdents d0/d1b/d21/d24/d29/d44/de1/df3/d126 0 2024-02-19T19:07:40.204 INFO:tasks.workunit.client.1.smithi142.stdout:0/855: getdents d23/d32/d8a 0 2024-02-19T19:07:40.208 INFO:tasks.workunit.client.1.smithi142.stdout:7/887: rename d0/d1b/d9d/laa to d0/d1b/d21/d24/d29/d44/d49/l12c 0 2024-02-19T19:07:40.216 INFO:tasks.workunit.client.1.smithi142.stdout:8/970: sync 2024-02-19T19:07:40.216 INFO:tasks.workunit.client.1.smithi142.stdout:8/971: readlink d9/dd/de/d14/d65/l7c 0 2024-02-19T19:07:40.216 INFO:tasks.workunit.client.1.smithi142.stdout:8/972: write d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/f76 [1083110,17416] 0 2024-02-19T19:07:40.217 INFO:tasks.workunit.client.1.smithi142.stdout:8/973: write d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/d106/f124 [5077286,130488] 0 2024-02-19T19:07:40.225 INFO:tasks.workunit.client.1.smithi142.stdout:8/974: write d9/dd/d44/d79/f25 [3767104,30696] 0 2024-02-19T19:07:40.226 INFO:tasks.workunit.client.1.smithi142.stdout:8/975: creat d9/dd/d15/d31/d126/d73/d77/d10d/f130 x:0 0 0 2024-02-19T19:07:40.227 INFO:tasks.workunit.client.1.smithi142.stdout:7/888: dwrite d0/d13/d72/da7/f57 [0,4194304] 0 2024-02-19T19:07:40.229 INFO:tasks.workunit.client.1.smithi142.stdout:7/889: mknod d0/d1b/d21/d24/d29/d7e/c12d 0 2024-02-19T19:07:40.229 INFO:tasks.workunit.client.1.smithi142.stdout:7/890: write d0/d1b/ffd [938314,16535] 0 2024-02-19T19:07:40.230 INFO:tasks.workunit.client.1.smithi142.stdout:7/891: mkdir d0/d1b/d21/d24/d29/d44/de1/df3/d126/d12e 0 2024-02-19T19:07:40.230 INFO:tasks.workunit.client.1.smithi142.stdout:7/892: truncate d0/d13/d72/d47/d69/f40 1090077 0 2024-02-19T19:07:40.244 INFO:tasks.workunit.client.1.smithi142.stdout:7/893: write d0/d1b/d21/f8d [3456034,118787] 0 2024-02-19T19:07:40.244 INFO:tasks.workunit.client.1.smithi142.stdout:7/894: chown d0/d13/de4/l109 26858 1 2024-02-19T19:07:40.254 INFO:tasks.workunit.client.1.smithi142.stdout:7/895: write d0/d1b/d21/d24/d29/d44/d49/d9b/fa0 [2647441,30391] 0 2024-02-19T19:07:40.254 INFO:tasks.workunit.client.1.smithi142.stdout:7/896: fsync d0/d13/fc0 0 2024-02-19T19:07:40.254 INFO:tasks.workunit.client.1.smithi142.stdout:8/976: dwrite d9/fee [0,4194304] 0 2024-02-19T19:07:40.260 INFO:tasks.workunit.client.1.smithi142.stdout:7/897: getdents d0/d1b/d21/d107/d86 0 2024-02-19T19:07:40.260 INFO:tasks.workunit.client.1.smithi142.stdout:7/898: chown d0/d1b/d21/d24/d29/dd6 4439 1 2024-02-19T19:07:40.261 INFO:tasks.workunit.client.1.smithi142.stdout:7/899: truncate d0/d1b/d21/f36 1654074 0 2024-02-19T19:07:40.262 INFO:tasks.workunit.client.1.smithi142.stdout:7/900: creat d0/d13/de4/f12f x:0 0 0 2024-02-19T19:07:40.263 INFO:tasks.workunit.client.1.smithi142.stdout:8/977: dread d9/dd/de/d14/d65/d6c/da7/fe2 [0,4194304] 0 2024-02-19T19:07:40.263 INFO:tasks.workunit.client.1.smithi142.stdout:8/978: write d9/dd/d15/d31/f55 [4675878,6956] 0 2024-02-19T19:07:40.267 INFO:tasks.workunit.client.1.smithi142.stdout:6/912: sync 2024-02-19T19:07:40.269 INFO:tasks.workunit.client.1.smithi142.stdout:6/913: mkdir d2/d17/d33/d42/da2/da7/dd2/dd3/d137 0 2024-02-19T19:07:40.271 INFO:tasks.workunit.client.1.smithi142.stdout:6/914: mknod d2/d17/d33/d42/c138 0 2024-02-19T19:07:40.272 INFO:tasks.workunit.client.1.smithi142.stdout:7/901: dread d0/d1b/d21/d24/d29/d44/f55 [0,4194304] 0 2024-02-19T19:07:40.273 INFO:tasks.workunit.client.1.smithi142.stdout:6/915: link d2/d1f/d45/ff5 d2/d29/d111/f139 0 2024-02-19T19:07:40.273 INFO:tasks.workunit.client.1.smithi142.stdout:6/916: chown d2/d1f/f12d 3308 1 2024-02-19T19:07:40.275 INFO:tasks.workunit.client.1.smithi142.stdout:7/902: creat d0/d1b/d21/d24/d29/d44/de1/f130 x:0 0 0 2024-02-19T19:07:40.276 INFO:tasks.workunit.client.1.smithi142.stdout:2/852: sync 2024-02-19T19:07:40.276 INFO:tasks.workunit.client.1.smithi142.stdout:0/856: sync 2024-02-19T19:07:40.282 INFO:tasks.workunit.client.1.smithi142.stdout:6/917: write d2/d1f/d20/f52 [1238360,6425] 0 2024-02-19T19:07:40.292 INFO:tasks.workunit.client.1.smithi142.stdout:8/979: dwrite d9/dd/de/f45 [0,4194304] 0 2024-02-19T19:07:40.292 INFO:tasks.workunit.client.1.smithi142.stdout:6/918: dread d2/d1e/d35/d66/f11c [0,4194304] 0 2024-02-19T19:07:40.293 INFO:tasks.workunit.client.1.smithi142.stdout:8/980: rename d9/dd/d15/d31 to d9/dd/d15/d31/d126/db3/d131 22 2024-02-19T19:07:40.294 INFO:tasks.workunit.client.1.smithi142.stdout:6/919: dread d2/d1f/d5c/f9a [0,4194304] 0 2024-02-19T19:07:40.294 INFO:tasks.workunit.client.1.smithi142.stdout:6/920: truncate d2/d1f/f2b 1501296 0 2024-02-19T19:07:40.296 INFO:tasks.workunit.client.1.smithi142.stdout:8/981: truncate d9/dd/de/d14/d65/d94/dec/ffb 1136341 0 2024-02-19T19:07:40.296 INFO:tasks.workunit.client.1.smithi142.stdout:8/982: dread - d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/dc3/f11a zero size 2024-02-19T19:07:40.297 INFO:tasks.workunit.client.1.smithi142.stdout:8/983: fsync f7 0 2024-02-19T19:07:40.298 INFO:tasks.workunit.client.1.smithi142.stdout:2/853: dwrite d3/db/d29/d4c/d4e/d9a/da9/dad/d105/f100 [0,4194304] 0 2024-02-19T19:07:40.298 INFO:tasks.workunit.client.1.smithi142.stdout:6/921: link d2/d1f/d56/d65/c80 d2/d1f/d4d/d60/c13a 0 2024-02-19T19:07:40.298 INFO:tasks.workunit.client.1.smithi142.stdout:6/922: chown d2/d1f/d5c/l130 203 1 2024-02-19T19:07:40.302 INFO:tasks.workunit.client.1.smithi142.stdout:8/984: link d9/dd/d15/d31/ca5 d9/dd/d15/c132 0 2024-02-19T19:07:40.307 INFO:tasks.workunit.client.1.smithi142.stdout:6/923: rename d2/d17/d33/d42/da2/da7/dd2/dd3 to d2/d17/d33/d42/da2/da7/de6/d13b 0 2024-02-19T19:07:40.307 INFO:tasks.workunit.client.1.smithi142.stdout:6/924: stat d2/d1f/d20/l41 0 2024-02-19T19:07:40.309 INFO:tasks.workunit.client.1.smithi142.stdout:8/985: truncate d9/dd/d15/d31/d126/d73/f92 410961 0 2024-02-19T19:07:40.309 INFO:tasks.workunit.client.1.smithi142.stdout:8/986: readlink d9/dd/de/l3f 0 2024-02-19T19:07:40.309 INFO:tasks.workunit.client.1.smithi142.stdout:8/987: fdatasync d9/dd/d15/d31/fda 0 2024-02-19T19:07:40.310 INFO:tasks.workunit.client.1.smithi142.stdout:0/857: dwrite d23/d28/d2d/d54/d88/fae [4194304,4194304] 0 2024-02-19T19:07:40.310 INFO:tasks.workunit.client.1.smithi142.stdout:0/858: fdatasync d23/d28/d2d/d54/d85/ff0 0 2024-02-19T19:07:40.310 INFO:tasks.workunit.client.1.smithi142.stdout:0/859: write d23/d7d/d9e/dc7/f10a [446488,117990] 0 2024-02-19T19:07:40.310 INFO:tasks.workunit.client.1.smithi142.stdout:0/860: write d23/d28/d2d/d51/dc9/fab [78598,25563] 0 2024-02-19T19:07:40.310 INFO:tasks.workunit.client.1.smithi142.stdout:6/925: rmdir d2/d1f/d20/d31/d88/d8f 39 2024-02-19T19:07:40.312 INFO:tasks.workunit.client.1.smithi142.stdout:8/988: creat d9/dd/de/d14/de3/f133 x:0 0 0 2024-02-19T19:07:40.315 INFO:tasks.workunit.client.1.smithi142.stdout:0/861: mknod d23/c113 0 2024-02-19T19:07:40.317 INFO:tasks.workunit.client.1.smithi142.stdout:6/926: link d2/ff2 d2/d1f/d4d/d60/df6/f13c 0 2024-02-19T19:07:40.318 INFO:tasks.workunit.client.1.smithi142.stdout:0/862: symlink d23/d28/d2d/d51/dc9/d58/db6/l114 0 2024-02-19T19:07:40.321 INFO:tasks.workunit.client.1.smithi142.stdout:8/989: dread d9/dd/d15/d31/d96/fe9 [0,4194304] 0 2024-02-19T19:07:40.326 INFO:tasks.workunit.client.1.smithi142.stdout:6/927: rename d2/d1f/d20/d31/d88/d8f to d2/d1f/d4d/d60/df6/d13d 0 2024-02-19T19:07:40.326 INFO:tasks.workunit.client.1.smithi142.stdout:6/928: fsync d2/d17/d33/d42/da2/da7/d55/d69/d100/f114 0 2024-02-19T19:07:40.326 INFO:tasks.workunit.client.1.smithi142.stdout:6/929: creat d2/d1e/d35/d66/d8d/d3e/f13e x:0 0 0 2024-02-19T19:07:40.326 INFO:tasks.workunit.client.1.smithi142.stdout:6/930: getdents d2/d1f/d4d/d60/df6/d13d/d102/d106 0 2024-02-19T19:07:40.326 INFO:tasks.workunit.client.1.smithi142.stdout:6/931: getdents d2/d1e/d35/d66/d76/db9 0 2024-02-19T19:07:40.327 INFO:tasks.workunit.client.1.smithi142.stdout:8/990: symlink d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/l134 0 2024-02-19T19:07:40.328 INFO:tasks.workunit.client.1.smithi142.stdout:0/863: dread d23/d28/d41/f5a [0,4194304] 0 2024-02-19T19:07:40.329 INFO:tasks.workunit.client.1.smithi142.stdout:0/864: getdents d23/d32/d8a/db1/dfa 0 2024-02-19T19:07:40.331 INFO:tasks.workunit.client.1.smithi142.stdout:6/932: unlink d2/d17/lfd 0 2024-02-19T19:07:40.333 INFO:tasks.workunit.client.1.smithi142.stdout:8/991: mkdir d9/dd/de/d14/d65/d6c/dfa/d135 0 2024-02-19T19:07:40.337 INFO:tasks.workunit.client.1.smithi142.stdout:0/865: dread f11 [0,4194304] 0 2024-02-19T19:07:40.338 INFO:tasks.workunit.client.1.smithi142.stdout:8/992: rename d9/dd/d15/c93 to d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/d97/dbe/dc3/c136 0 2024-02-19T19:07:40.342 INFO:tasks.workunit.client.1.smithi142.stdout:0/866: dread d23/d32/d8a/f96 [0,4194304] 0 2024-02-19T19:07:40.342 INFO:tasks.workunit.client.1.smithi142.stdout:0/867: chown d23/d28/d41/d78 10 1 2024-02-19T19:07:40.346 INFO:tasks.workunit.client.1.smithi142.stdout:6/933: dwrite d2/d1f/f12d [0,4194304] 0 2024-02-19T19:07:40.346 INFO:tasks.workunit.client.1.smithi142.stdout:8/993: dread d9/dd/d44/d79/f25 [0,4194304] 0 2024-02-19T19:07:40.356 INFO:tasks.workunit.client.1.smithi142.stdout:8/994: dread d9/dd/f68 [4194304,4194304] 0 2024-02-19T19:07:40.356 INFO:tasks.workunit.client.1.smithi142.stdout:8/995: chown d9/dd/d15/l40 50 1 2024-02-19T19:07:40.356 INFO:tasks.workunit.client.1.smithi142.stdout:8/996: chown d9/dd/de/d14/d65/d6c/da7/d10b/c5d 65826600 1 2024-02-19T19:07:40.356 INFO:tasks.workunit.client.1.smithi142.stdout:6/934: dread d2/d1f/d20/f2c [0,4194304] 0 2024-02-19T19:07:40.358 INFO:tasks.workunit.client.1.smithi142.stdout:6/935: unlink d2/ca 0 2024-02-19T19:07:40.358 INFO:tasks.workunit.client.1.smithi142.stdout:0/868: dwrite d23/ff9 [0,4194304] 0 2024-02-19T19:07:40.358 INFO:tasks.workunit.client.1.smithi142.stdout:0/869: creat d23/d28/d2d/d54/d85/f115 x:0 0 0 2024-02-19T19:07:40.364 INFO:tasks.workunit.client.1.smithi142.stdout:0/870: creat d23/d28/d41/f116 x:0 0 0 2024-02-19T19:07:40.364 INFO:tasks.workunit.client.1.smithi142.stdout:0/871: fdatasync d23/d28/d2d/d54/d88/d9f/fe5 0 2024-02-19T19:07:40.365 INFO:tasks.workunit.client.1.smithi142.stdout:6/936: mknod d2/d1f/d20/d31/d62/c13f 0 2024-02-19T19:07:40.367 INFO:tasks.workunit.client.1.smithi142.stdout:0/872: mknod d23/d7d/d9e/dc7/df5/c117 0 2024-02-19T19:07:40.368 INFO:tasks.workunit.client.1.smithi142.stdout:6/937: mknod d2/d17/d33/d42/da2/da7/de6/d13b/d137/c140 0 2024-02-19T19:07:40.368 INFO:tasks.workunit.client.1.smithi142.stdout:8/997: dwrite d9/dd/de/d14/d65/d6c/da7/d10b/d50/d59/f123 [0,4194304] 0 2024-02-19T19:07:40.369 INFO:tasks.workunit.client.1.smithi142.stdout:0/873: mkdir d23/d28/d2d/d54/d88/de0/d118 0 2024-02-19T19:07:40.372 INFO:tasks.workunit.client.1.smithi142.stdout:7/903: sync 2024-02-19T19:07:40.373 INFO:tasks.workunit.client.1.smithi142.stdout:7/904: readlink d0/d13/d72/d47/lb3 0 2024-02-19T19:07:40.373 INFO:tasks.workunit.client.1.smithi142.stdout:7/905: fsync d0/d13/d72/d47/f4b 0 2024-02-19T19:07:40.373 INFO:tasks.workunit.client.1.smithi142.stdout:6/938: chown d2/d17/d33/d42/da2/da7/d55/lcc 17539 1 2024-02-19T19:07:40.377 INFO:tasks.workunit.client.1.smithi142.stdout:8/998: truncate d9/dd/de/d14/d65/d6c/da7/fe2 3548985 0 2024-02-19T19:07:40.380 INFO:tasks.workunit.client.1.smithi142.stdout:0/874: creat d23/d28/d2d/d54/d88/de0/d118/f119 x:0 0 0 2024-02-19T19:07:40.382 INFO:tasks.workunit.client.1.smithi142.stdout:7/906: write d0/d1b/d21/d24/d29/d44/d49/d10d/d12a/fb0 [2448451,67592] 0 2024-02-19T19:07:40.383 INFO:tasks.workunit.client.1.smithi142.stdout:8/999: creat d9/dd/f137 x:0 0 0 2024-02-19T19:07:40.384 INFO:tasks.workunit.client.1.smithi142.stdout:6/939: write d2/d17/d33/d39/f49 [447208,39860] 0 2024-02-19T19:07:40.384 INFO:tasks.workunit.client.1.smithi142.stdout:6/940: dread - d2/d17/d33/d42/d5e/d117/f123 zero size 2024-02-19T19:07:40.385 INFO:tasks.workunit.client.1.smithi142.stdout:2/854: sync 2024-02-19T19:07:40.386 INFO:tasks.workunit.client.1.smithi142.stdout:7/907: mkdir d0/d1b/d21/d24/d29/d44/d49/d10d/d112/d127/d131 0 2024-02-19T19:07:40.390 INFO:tasks.workunit.client.1.smithi142.stdout:0/875: rmdir d23/d28/d2d/d54/d88/de0/d118 39 2024-02-19T19:07:40.390 INFO:tasks.workunit.client.1.smithi142.stdout:0/876: chown f11 0 1 2024-02-19T19:07:40.390 INFO:tasks.workunit.client.1.smithi142.stdout:0/877: chown d23/d28/d2d/d54/d88 50097 1 2024-02-19T19:07:40.390 INFO:tasks.workunit.client.1.smithi142.stdout:0/878: chown d23/d7d/d9e/lb2 954 1 2024-02-19T19:07:40.392 INFO:tasks.workunit.client.1.smithi142.stdout:2/855: mkdir d3/db/dda/d116/d119 0 2024-02-19T19:07:40.392 INFO:tasks.workunit.client.1.smithi142.stdout:2/856: write d3/db/d29/d6d/d59/f99 [794013,35255] 0 2024-02-19T19:07:40.393 INFO:tasks.workunit.client.1.smithi142.stdout:7/908: mknod d0/d1b/d21/d24/d29/d44/de1/df3/d126/c132 0 2024-02-19T19:07:40.395 INFO:tasks.workunit.client.1.smithi142.stdout:6/941: rename d2/d17/d33/d39/f49 to d2/d1f/d4d/d60/d87/dee/f141 0 2024-02-19T19:07:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:0/879: mknod d23/d28/d41/d10f/c11a 0 2024-02-19T19:07:40.397 INFO:tasks.workunit.client.1.smithi142.stdout:0/880: write d23/d28/d2d/d54/d85/f115 [768887,114742] 0 2024-02-19T19:07:40.399 INFO:tasks.workunit.client.1.smithi142.stdout:7/909: creat d0/d1b/d21/d24/d29/d44/f133 x:0 0 0 2024-02-19T19:07:40.400 INFO:tasks.workunit.client.1.smithi142.stdout:6/942: write d2/d1e/d35/d66/d8d/d3e/f46 [1364035,88678] 0 2024-02-19T19:07:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:0/881: creat d23/d32/d8a/f11b x:0 0 0 2024-02-19T19:07:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:0/882: read d23/d28/f70 [370524,22813] 0 2024-02-19T19:07:40.402 INFO:tasks.workunit.client.1.smithi142.stdout:0/883: fdatasync d23/d28/faa 0 2024-02-19T19:07:40.403 INFO:tasks.workunit.client.1.smithi142.stdout:6/943: readlink d2/d29/lcf 0 2024-02-19T19:07:40.403 INFO:tasks.workunit.client.1.smithi142.stdout:6/944: readlink d2/d17/l36 0 2024-02-19T19:07:40.403 INFO:tasks.workunit.client.1.smithi142.stdout:6/945: chown d2/d1e/d35/d66/d8d/d3e/d8c/d10b/d10f 3 1 2024-02-19T19:07:40.403 INFO:tasks.workunit.client.1.smithi142.stdout:6/946: fdatasync d2/d1f/f101 0 2024-02-19T19:07:40.403 INFO:tasks.workunit.client.1.smithi142.stdout:6/947: readlink d2/d29/l67 0 2024-02-19T19:07:40.403 INFO:tasks.workunit.client.1.smithi142.stdout:6/948: read d2/d1e/d35/d66/d8d/d3e/f58 [131615,94546] 0 2024-02-19T19:07:40.405 INFO:tasks.workunit.client.1.smithi142.stdout:6/949: creat d2/d17/d33/d42/d5e/f142 x:0 0 0 2024-02-19T19:07:40.405 INFO:tasks.workunit.client.1.smithi142.stdout:6/950: dread - d2/fdc zero size 2024-02-19T19:07:40.407 INFO:tasks.workunit.client.1.smithi142.stdout:6/951: symlink d2/d29/l143 0 2024-02-19T19:07:40.407 INFO:tasks.workunit.client.1.smithi142.stdout:7/910: dread d0/f6c [0,4194304] 0 2024-02-19T19:07:40.408 INFO:tasks.workunit.client.1.smithi142.stdout:6/952: symlink d2/d29/d111/l144 0 2024-02-19T19:07:40.409 INFO:tasks.workunit.client.1.smithi142.stdout:6/953: symlink d2/d17/d33/d42/da2/da7/dd2/l145 0 2024-02-19T19:07:40.411 INFO:tasks.workunit.client.1.smithi142.stdout:6/954: rename d2/d1f/d45/faa to d2/d1f/d5c/d63/f146 0 2024-02-19T19:07:40.415 INFO:tasks.workunit.client.1.smithi142.stdout:0/884: dwrite d23/d28/d41/f9d [0,4194304] 0 2024-02-19T19:07:40.440 INFO:tasks.workunit.client.1.smithi142.stdout:6/955: dwrite d2/d29/d47/f5b [0,4194304] 0 2024-02-19T19:07:40.441 INFO:tasks.workunit.client.1.smithi142.stdout:0/885: dwrite d23/d7d/d9e/fb7 [0,4194304] 0 2024-02-19T19:07:40.443 INFO:tasks.workunit.client.1.smithi142.stdout:6/956: creat d2/d1e/d35/d66/d8d/d3e/d8c/d10b/db0/f147 x:0 0 0 2024-02-19T19:07:40.446 INFO:tasks.workunit.client.1.smithi142.stdout:0/886: mknod d23/d28/d2d/d54/d88/c11c 0 2024-02-19T19:07:40.447 INFO:tasks.workunit.client.1.smithi142.stdout:6/957: symlink d2/d17/d33/d42/l148 0 2024-02-19T19:07:40.461 INFO:tasks.workunit.client.1.smithi142.stdout:0/887: dwrite d23/d7d/d9e/ff1 [0,4194304] 0 2024-02-19T19:07:40.463 INFO:tasks.workunit.client.1.smithi142.stdout:6/958: dwrite d2/d1f/d4d/d60/f90 [0,4194304] 0 2024-02-19T19:07:40.466 INFO:tasks.workunit.client.1.smithi142.stdout:6/959: symlink d2/d1e/d35/d66/d8d/d3e/d8c/d10b/db0/l149 0 2024-02-19T19:07:40.466 INFO:tasks.workunit.client.1.smithi142.stdout:6/960: truncate d2/d1e/d35/d66/d8d/d3e/d8c/d10b/db0/f147 457891 0 2024-02-19T19:07:40.466 INFO:tasks.workunit.client.1.smithi142.stdout:6/961: mknod d2/d1e/d35/d66/d8d/d3e/d8c/c14a 0 2024-02-19T19:07:40.477 INFO:tasks.workunit.client.1.smithi142.stdout:6/962: write d2/d1f/f12d [1986888,44339] 0 2024-02-19T19:07:40.477 INFO:tasks.workunit.client.1.smithi142.stdout:0/888: dwrite d23/d32/d8a/fdf [0,4194304] 0 2024-02-19T19:07:40.477 INFO:tasks.workunit.client.1.smithi142.stdout:6/963: write d2/d1f/fdf [169479,101508] 0 2024-02-19T19:07:40.478 INFO:tasks.workunit.client.1.smithi142.stdout:0/889: read d23/d28/d2d/d51/f71 [155407,53839] 0 2024-02-19T19:07:40.480 INFO:tasks.workunit.client.1.smithi142.stdout:6/964: mknod d2/d1f/d4d/d60/d87/c14b 0 2024-02-19T19:07:40.480 INFO:tasks.workunit.client.1.smithi142.stdout:6/965: truncate d2/d17/d33/d42/da2/da7/de6/d13b/ffe 4173227 0 2024-02-19T19:07:40.485 INFO:tasks.workunit.client.1.smithi142.stdout:0/890: write d23/d28/d41/f5a [2409669,25125] 0 2024-02-19T19:07:40.485 INFO:tasks.workunit.client.1.smithi142.stdout:0/891: truncate d23/d28/d41/d78/fa8 5111163 0 2024-02-19T19:07:40.485 INFO:tasks.workunit.client.1.smithi142.stdout:2/857: sync 2024-02-19T19:07:40.486 INFO:tasks.workunit.client.1.smithi142.stdout:2/858: read d3/db/f70 [20611,46844] 0 2024-02-19T19:07:40.486 INFO:tasks.workunit.client.1.smithi142.stdout:2/859: chown d3/df/f2b 2 1 2024-02-19T19:07:40.486 INFO:tasks.workunit.client.1.smithi142.stdout:2/860: fsync d3/d4d/f57 0 2024-02-19T19:07:40.487 INFO:tasks.workunit.client.1.smithi142.stdout:0/892: mknod d23/d28/d2d/d54/d88/d9f/c11d 0 2024-02-19T19:07:40.492 INFO:tasks.workunit.client.1.smithi142.stdout:7/911: sync 2024-02-19T19:07:40.492 INFO:tasks.workunit.client.1.smithi142.stdout:6/966: dread d2/f5f [0,4194304] 0 2024-02-19T19:07:40.492 INFO:tasks.workunit.client.1.smithi142.stdout:6/967: write d2/d1f/d20/f2c [4922104,101276] 0 2024-02-19T19:07:40.494 INFO:tasks.workunit.client.1.smithi142.stdout:0/893: rmdir d23/d28/d2d/d54/d88 39 2024-02-19T19:07:40.496 INFO:tasks.workunit.client.1.smithi142.stdout:0/894: mknod d23/d86/c11e 0 2024-02-19T19:07:40.497 INFO:tasks.workunit.client.1.smithi142.stdout:0/895: link d23/d28/l103 d23/d28/d2d/d54/d88/d9f/l11f 0 2024-02-19T19:07:40.498 INFO:tasks.workunit.client.1.smithi142.stdout:0/896: truncate d23/d28/f100 489098 0 2024-02-19T19:07:40.498 INFO:tasks.workunit.client.1.smithi142.stdout:0/897: fsync d23/f64 0 2024-02-19T19:07:40.498 INFO:tasks.workunit.client.1.smithi142.stdout:0/898: stat d23/d28/d41/d78 0 2024-02-19T19:07:40.498 INFO:tasks.workunit.client.1.smithi142.stdout:0/899: symlink d23/d32/d8a/l120 0 2024-02-19T19:07:40.505 INFO:tasks.workunit.client.1.smithi142.stdout:2/861: dwrite d3/db/d29/d4c/fe2 [0,4194304] 0 2024-02-19T19:07:40.508 INFO:tasks.workunit.client.1.smithi142.stdout:6/968: dread d2/d1f/d20/f2c [4194304,4194304] 0 2024-02-19T19:07:40.508 INFO:tasks.workunit.client.1.smithi142.stdout:2/862: rename d3/db/d29/d6d/d59/f78 to d3/db/d29/d4c/df9/d104/d109/f11a 0 2024-02-19T19:07:40.510 INFO:tasks.workunit.client.1.smithi142.stdout:6/969: creat d2/d1f/d4d/d60/df6/d13d/d102/d11d/f14c x:0 0 0 2024-02-19T19:07:40.510 INFO:tasks.workunit.client.1.smithi142.stdout:7/912: dwrite d0/d1b/d9d/fd8 [0,4194304] 0 2024-02-19T19:07:40.511 INFO:tasks.workunit.client.1.smithi142.stdout:6/970: chown d2/l16 3280 1 2024-02-19T19:07:40.512 INFO:tasks.workunit.client.1.smithi142.stdout:6/971: chown d2/d17/d33/d42/d5e/f142 83 1 2024-02-19T19:07:40.512 INFO:tasks.workunit.client.1.smithi142.stdout:6/972: creat d2/d1f/d45/f14d x:0 0 0 2024-02-19T19:07:40.515 INFO:tasks.workunit.client.1.smithi142.stdout:0/900: dwrite d23/d7d/d9e/dc7/f10a [0,4194304] 0 2024-02-19T19:07:40.515 INFO:tasks.workunit.client.1.smithi142.stdout:7/913: stat d0/d1b/d21/cd7 0 2024-02-19T19:07:40.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/863: write d3/db/d29/d4c/d4e/d9a/da9/dad/d105/f100 [2555451,115415] 0 2024-02-19T19:07:40.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/864: truncate d3/db/d29/d4c/d4e/db9/fe5 1935226 0 2024-02-19T19:07:40.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/865: stat d3/df/f10 0 2024-02-19T19:07:40.517 INFO:tasks.workunit.client.1.smithi142.stdout:2/866: truncate d3/db/f15 8969274 0 2024-02-19T19:07:40.520 INFO:tasks.workunit.client.1.smithi142.stdout:6/973: rename d2/d1f/fc3 to d2/d17/d33/d42/da2/da7/d55/dc0/d110/f14e 0 2024-02-19T19:07:40.522 INFO:tasks.workunit.client.1.smithi142.stdout:0/901: rmdir d23/d28/d2d/d54/d88/de0 39 2024-02-19T19:07:40.524 INFO:tasks.workunit.client.1.smithi142.stdout:7/914: unlink d0/d13/de4/fec 0 2024-02-19T19:07:40.526 INFO:tasks.workunit.client.1.smithi142.stdout:2/867: getdents d3/db/d29/d4c/df9/d104/d109 0 2024-02-19T19:07:40.528 INFO:tasks.workunit.client.1.smithi142.stdout:6/974: write d2/d1f/d20/d31/ff3 [872780,79948] 0 2024-02-19T19:07:40.528 INFO:tasks.workunit.client.1.smithi142.stdout:0/902: symlink d23/d28/d2d/d51/l121 0 2024-02-19T19:07:40.531 INFO:tasks.workunit.client.1.smithi142.stdout:2/868: rename d3/db/f79 to d3/d4d/d5f/d7c/dd6/f11b 0 2024-02-19T19:07:40.533 INFO:tasks.workunit.client.1.smithi142.stdout:0/903: unlink d23/d28/d2d/d51/dc9/l81 0 2024-02-19T19:07:40.534 INFO:tasks.workunit.client.1.smithi142.stdout:2/869: mknod d3/db/d29/d4c/c11c 0 2024-02-19T19:07:40.537 INFO:tasks.workunit.client.1.smithi142.stdout:2/870: creat d3/df/da4/de7/f11d x:0 0 0 2024-02-19T19:07:40.537 INFO:tasks.workunit.client.1.smithi142.stdout:2/871: stat d3/d4d/d9f/de1 0 2024-02-19T19:07:40.543 INFO:tasks.workunit.client.1.smithi142.stdout:2/872: dread d3/d4b/f7d [0,4194304] 0 2024-02-19T19:07:40.553 INFO:tasks.workunit.client.1.smithi142.stdout:7/915: dwrite d0/d1b/d21/d24/d29/d44/d49/d10d/f11b [0,4194304] 0 2024-02-19T19:07:40.553 INFO:tasks.workunit.client.1.smithi142.stdout:6/975: dwrite d2/d17/f7a [0,4194304] 0 2024-02-19T19:07:40.553 INFO:tasks.workunit.client.1.smithi142.stdout:0/904: write d23/d28/d2d/d54/d88/fae [1722523,68324] 0 2024-02-19T19:07:40.553 INFO:tasks.workunit.client.1.smithi142.stdout:7/916: creat d0/d1b/d21/d24/d29/dc5/f134 x:0 0 0 2024-02-19T19:07:40.561 INFO:tasks.workunit.client.1.smithi142.stdout:0/905: unlink d23/d28/d2d/d54/d88/d9f/fbc 0 2024-02-19T19:07:40.563 INFO:tasks.workunit.client.1.smithi142.stdout:6/976: mkdir d2/d17/d33/d42/da2/da7/d55/d69/d100/d14f 0 2024-02-19T19:07:40.566 INFO:tasks.workunit.client.1.smithi142.stdout:0/906: mknod d23/d28/d2d/d54/d88/de0/d118/c122 0 2024-02-19T19:07:40.566 INFO:tasks.workunit.client.1.smithi142.stdout:0/907: chown d23/d32/f65 423203266 1 2024-02-19T19:07:40.567 INFO:tasks.workunit.client.1.smithi142.stdout:6/977: creat d2/d17/d33/d42/df1/f150 x:0 0 0 2024-02-19T19:07:40.569 INFO:tasks.workunit.client.1.smithi142.stdout:0/908: symlink d23/d28/d2d/d51/dc9/l123 0 2024-02-19T19:07:40.571 INFO:tasks.workunit.client.1.smithi142.stdout:7/917: dwrite d0/d1b/d21/f36 [0,4194304] 0 2024-02-19T19:07:40.572 INFO:tasks.workunit.client.1.smithi142.stdout:0/909: mknod d23/d28/d2d/d54/d88/de0/d118/c124 0 2024-02-19T19:07:40.574 INFO:tasks.workunit.client.1.smithi142.stdout:7/918: creat d0/d1b/d21/d24/d29/d44/de1/df3/d126/d12e/f135 x:0 0 0 2024-02-19T19:07:40.575 INFO:tasks.workunit.client.1.smithi142.stdout:7/919: dread d0/d1b/d21/d24/d29/d44/de1/fe7 [0,4194304] 0 2024-02-19T19:07:40.575 INFO:tasks.workunit.client.1.smithi142.stdout:7/920: readlink d0/d13/de4/l109 0 2024-02-19T19:07:40.575 INFO:tasks.workunit.client.1.smithi142.stdout:7/921: chown d0/d1b/dbc/dcb/ff6 366979707 1 2024-02-19T19:07:40.575 INFO:tasks.workunit.client.1.smithi142.stdout:7/922: truncate d0/d1b/fd0 83189 0 2024-02-19T19:07:40.576 INFO:tasks.workunit.client.1.smithi142.stdout:0/910: creat d23/d28/d2d/f125 x:0 0 0 2024-02-19T19:07:40.576 INFO:tasks.workunit.client.1.smithi142.stdout:0/911: readlink d23/l2e 0 2024-02-19T19:07:40.577 INFO:tasks.workunit.client.1.smithi142.stdout:7/923: symlink d0/d1b/d21/d24/d29/d44/d49/d10d/d112/d127/l136 0 2024-02-19T19:07:40.577 INFO:tasks.workunit.client.1.smithi142.stdout:7/924: fsync d0/d1b/d21/d24/d29/f7f 0 2024-02-19T19:07:40.577 INFO:tasks.workunit.client.1.smithi142.stdout:7/925: dread - d0/d1b/d21/d24/ddf/f9f zero size 2024-02-19T19:07:40.577 INFO:tasks.workunit.client.1.smithi142.stdout:7/926: dread - d0/d1b/d21/d24/d5e/f106 zero size 2024-02-19T19:07:40.578 INFO:tasks.workunit.client.1.smithi142.stdout:0/912: symlink d23/d86/l126 0 2024-02-19T19:07:40.578 INFO:tasks.workunit.client.1.smithi142.stdout:0/913: chown d23/d7d/d9e/lb2 901818528 1 2024-02-19T19:07:40.592 INFO:tasks.workunit.client.1.smithi142.stdout:6/978: dwrite d2/d1e/d35/d66/f7f [0,4194304] 0 2024-02-19T19:07:40.592 INFO:tasks.workunit.client.1.smithi142.stdout:7/927: dwrite d0/d13/de4/f12f [0,4194304] 0 2024-02-19T19:07:40.600 INFO:tasks.workunit.client.1.smithi142.stdout:6/979: truncate d2/d17/d33/d42/da2/da7/d55/dc0/d110/f119 3812522 0 2024-02-19T19:07:40.602 INFO:tasks.workunit.client.1.smithi142.stdout:6/980: dread d2/d17/d33/d42/da2/da7/fe4 [4194304,4194304] 0 2024-02-19T19:07:40.602 INFO:tasks.workunit.client.1.smithi142.stdout:7/928: link d0/d1b/d9d/da4/fcc d0/d1b/d21/d24/d29/d44/d49/d10d/d112/d127/f137 0 2024-02-19T19:07:40.605 INFO:tasks.workunit.client.1.smithi142.stdout:0/914: rename d23/d28/d2d/d51/dc9 to d23/d28/d127 0 2024-02-19T19:07:40.605 INFO:tasks.workunit.client.1.smithi142.stdout:0/915: write d23/d28/d41/f116 [808004,17854] 0 2024-02-19T19:07:40.606 INFO:tasks.workunit.client.1.smithi142.stdout:7/929: dread d0/d1b/d21/d24/d29/f2c [0,4194304] 0 2024-02-19T19:07:40.606 INFO:tasks.workunit.client.1.smithi142.stdout:6/981: creat d2/d1e/d35/d66/d8d/d3e/d8c/d112/f151 x:0 0 0 2024-02-19T19:07:40.608 INFO:tasks.workunit.client.1.smithi142.stdout:7/930: mknod d0/d1b/d21/d24/d29/dd6/c138 0 2024-02-19T19:07:40.610 INFO:tasks.workunit.client.1.smithi142.stdout:6/982: link d2/d17/d33/d42/da2/da7/cde d2/d29/d47/c152 0 2024-02-19T19:07:40.611 INFO:tasks.workunit.client.1.smithi142.stdout:0/916: getdents d23/d86 0 2024-02-19T19:07:40.614 INFO:tasks.workunit.client.1.smithi142.stdout:7/931: creat d0/d13/de4/dfc/f139 x:0 0 0 2024-02-19T19:07:40.614 INFO:tasks.workunit.client.1.smithi142.stdout:7/932: chown d0/d1b/f128 3 1 2024-02-19T19:07:40.616 INFO:tasks.workunit.client.1.smithi142.stdout:7/933: dread d0/d1b/d21/d24/d29/d44/d49/d10d/d112/d127/f137 [0,4194304] 0 2024-02-19T19:07:40.616 INFO:tasks.workunit.client.1.smithi142.stdout:2/873: sync 2024-02-19T19:07:40.616 INFO:tasks.workunit.client.1.smithi142.stdout:2/874: fdatasync d3/db/d29/d4c/dae/fe3 0 2024-02-19T19:07:40.616 INFO:tasks.workunit.client.1.smithi142.stdout:0/917: mknod d23/c128 0 2024-02-19T19:07:40.617 INFO:tasks.workunit.client.1.smithi142.stdout:6/983: rmdir d2/d1f/d5c/d63 39 2024-02-19T19:07:40.619 INFO:tasks.workunit.client.1.smithi142.stdout:7/934: mknod d0/d13/d1e/db7/dca/c13a 0 2024-02-19T19:07:40.620 INFO:tasks.workunit.client.1.smithi142.stdout:7/935: fdatasync d0/d1b/d9d/da4/f102 0 2024-02-19T19:07:40.620 INFO:tasks.workunit.client.1.smithi142.stdout:7/936: fdatasync d0/d1b/d21/d107/d86/f113 0 2024-02-19T19:07:40.620 INFO:tasks.workunit.client.1.smithi142.stdout:7/937: chown d0/d1b/d21/d24/d29/d44/d49/d10d/d112/d127 7984533 1 2024-02-19T19:07:40.621 INFO:tasks.workunit.client.1.smithi142.stdout:2/875: mkdir d3/db/dda/d11e 0 2024-02-19T19:07:40.622 INFO:tasks.workunit.client.1.smithi142.stdout:2/876: truncate d3/db/d29/d4c/df9/d104/d109/f11a 969751 0 2024-02-19T19:07:40.622 INFO:tasks.workunit.client.1.smithi142.stdout:2/877: creat d3/db/d29/d6d/de6/f11f x:0 0 0 2024-02-19T19:07:40.623 INFO:tasks.workunit.client.1.smithi142.stdout:7/938: write d0/f6c [2637027,76386] 0 2024-02-19T19:07:40.623 INFO:tasks.workunit.client.1.smithi142.stdout:7/939: chown d0/d1b/d21/d24/d5e/df8/cc6 36484 1 2024-02-19T19:07:40.624 INFO:tasks.workunit.client.1.smithi142.stdout:0/918: creat d23/d28/d2d/d54/d88/de0/d118/f129 x:0 0 0 2024-02-19T19:07:40.624 INFO:tasks.workunit.client.1.smithi142.stdout:0/919: fsync d23/d28/d2d/d54/ff4 0 2024-02-19T19:07:40.626 INFO:tasks.workunit.client.1.smithi142.stdout:6/984: unlink d2/d17/d33/d42/da2/da7/d55/d69/d100/f114 0 2024-02-19T19:07:40.630 INFO:tasks.workunit.client.1.smithi142.stdout:6/985: mknod d2/d1e/d35/d66/c153 0 2024-02-19T19:07:40.630 INFO:tasks.workunit.client.1.smithi142.stdout:7/940: write d0/d1b/d21/d24/d29/d44/d49/d10d/d12a/d103/fdc [2667617,129322] 0 2024-02-19T19:07:40.630 INFO:tasks.workunit.client.1.smithi142.stdout:7/941: write d0/d13/f27 [1706462,63555] 0 2024-02-19T19:07:40.632 INFO:tasks.workunit.client.1.smithi142.stdout:0/920: dread d23/d28/f34 [0,4194304] 0 2024-02-19T19:07:40.632 INFO:tasks.workunit.client.1.smithi142.stdout:0/921: write d23/d28/f100 [1404201,85325] 0 2024-02-19T19:07:40.636 INFO:tasks.workunit.client.1.smithi142.stdout:2/878: dwrite d3/db/d29/f41 [8388608,4194304] 0 2024-02-19T19:07:40.639 INFO:tasks.workunit.client.1.smithi142.stdout:2/879: creat d3/db/d29/d4c/d4e/d9a/da9/dad/f120 x:0 0 0 2024-02-19T19:07:40.639 INFO:tasks.workunit.client.1.smithi142.stdout:2/880: creat d3/db/d29/d4c/d4e/d9a/da9/dad/f121 x:0 0 0 2024-02-19T19:07:40.639 INFO:tasks.workunit.client.1.smithi142.stdout:2/881: creat d3/db/d29/d4c/dae/f122 x:0 0 0 2024-02-19T19:07:40.639 INFO:tasks.workunit.client.1.smithi142.stdout:2/882: chown d3/db/dda/d11e 6 1 2024-02-19T19:07:40.642 INFO:tasks.workunit.client.1.smithi142.stdout:2/883: rename d3/d68/fc0 to d3/d35/d53/f123 0 2024-02-19T19:07:40.655 INFO:tasks.workunit.client.1.smithi142.stdout:6/986: dwrite d2/d1e/d35/d66/d8d/d3e/d8c/d10b/d10f/f12f [0,4194304] 0 2024-02-19T19:07:40.656 INFO:tasks.workunit.client.1.smithi142.stdout:0/922: dwrite d23/d28/d2d/d54/d88/d9f/fe5 [0,4194304] 0 2024-02-19T19:07:40.656 INFO:tasks.workunit.client.1.smithi142.stdout:7/942: dwrite d0/d1b/d21/d24/d29/d44/f133 [0,4194304] 0 2024-02-19T19:07:40.656 INFO:tasks.workunit.client.1.smithi142.stdout:7/943: readlink d0/d13/d1e/l58 0 2024-02-19T19:07:40.658 INFO:tasks.workunit.client.1.smithi142.stdout:6/987: getdents d2/d17/d33 0 2024-02-19T19:07:40.665 INFO:tasks.workunit.client.1.smithi142.stdout:7/944: creat d0/d13/d72/f13b x:0 0 0 2024-02-19T19:07:40.669 INFO:tasks.workunit.client.1.smithi142.stdout:7/945: symlink d0/d1b/d21/d24/d29/d44/d49/d10d/d112/d127/d131/l13c 0 2024-02-19T19:07:40.672 INFO:tasks.workunit.client.1.smithi142.stdout:7/946: getdents d0/d1b/d21/d24/d29/d44/de1 0 2024-02-19T19:07:40.677 INFO:tasks.workunit.client.1.smithi142.stdout:0/923: dwrite d23/f25 [4194304,4194304] 0 2024-02-19T19:07:40.678 INFO:tasks.workunit.client.1.smithi142.stdout:6/988: dwrite d2/d17/d33/d42/da2/da7/de6/d13b/fd4 [0,4194304] 0 2024-02-19T19:07:40.678 INFO:tasks.workunit.client.1.smithi142.stdout:6/989: chown d2/d17/d33/d42/da2/da7/d55/ca9 28 1 2024-02-19T19:07:40.681 INFO:tasks.workunit.client.1.smithi142.stdout:0/924: mkdir d23/d28/d2d/d12a 0 2024-02-19T19:07:40.681 INFO:tasks.workunit.client.1.smithi142.stdout:0/925: fsync d23/d28/d2d/f3b 0 2024-02-19T19:07:40.681 INFO:tasks.workunit.client.1.smithi142.stdout:0/926: fdatasync d23/d28/d2d/d54/d88/de0/d118/f129 0 2024-02-19T19:07:40.682 INFO:tasks.workunit.client.1.smithi142.stdout:6/990: fsync d2/ff2 0 2024-02-19T19:07:40.684 INFO:tasks.workunit.client.1.smithi142.stdout:0/927: unlink d23/d32/f65 0 2024-02-19T19:07:40.684 INFO:tasks.workunit.client.1.smithi142.stdout:0/928: readlink d23/d28/d127/l82 0 2024-02-19T19:07:40.685 INFO:tasks.workunit.client.1.smithi142.stdout:0/929: chown d23/d32/f6a 3622 1 2024-02-19T19:07:40.685 INFO:tasks.workunit.client.1.smithi142.stdout:0/930: read d23/d7d/fd9 [149007,31215] 0 2024-02-19T19:07:40.685 INFO:tasks.workunit.client.1.smithi142.stdout:6/991: symlink d2/d1f/d4d/d60/df6/d13d/d102/d12e/l154 0 2024-02-19T19:07:40.686 INFO:tasks.workunit.client.1.smithi142.stdout:7/947: dwrite d0/d1b/d21/d24/d29/d44/d49/d10d/f11b [0,4194304] 0 2024-02-19T19:07:40.686 INFO:tasks.workunit.client.1.smithi142.stdout:7/948: creat d0/d1b/d21/d24/d29/dc5/f13d x:0 0 0 2024-02-19T19:07:40.686 INFO:tasks.workunit.client.1.smithi142.stdout:7/949: write d0/d13/d72/da7/f78 [2141731,90453] 0 2024-02-19T19:07:40.686 INFO:tasks.workunit.client.1.smithi142.stdout:7/950: chown d0/d1b/d21/d24/d29/d44/l7d 5329070 1 2024-02-19T19:07:40.686 INFO:tasks.workunit.client.1.smithi142.stdout:0/931: truncate f11 1081081 0 2024-02-19T19:07:40.688 INFO:tasks.workunit.client.1.smithi142.stdout:6/992: unlink d2/d1e/d35/d66/d8d/d3e/d8c/d10b/db0/f147 0 2024-02-19T19:07:40.691 INFO:tasks.workunit.client.1.smithi142.stdout:7/951: mknod d0/d1b/d9d/c13e 0 2024-02-19T19:07:40.691 INFO:tasks.workunit.client.1.smithi142.stdout:7/952: chown d0/d1b/d21/d24/d29/dd6/cf4 100254 1 2024-02-19T19:07:40.691 INFO:tasks.workunit.client.1.smithi142.stdout:7/953: stat d0/d13/d1e/f96 0 2024-02-19T19:07:40.691 INFO:tasks.workunit.client.1.smithi142.stdout:7/954: readlink d0/d1b/d21/d24/d29/d44/led 0 2024-02-19T19:07:40.693 INFO:tasks.workunit.client.1.smithi142.stdout:0/932: mkdir d23/d86/d12b 0 2024-02-19T19:07:40.693 INFO:tasks.workunit.client.1.smithi142.stdout:0/933: write d23/d28/d2d/d54/d88/de0/fcd [932731,16057] 0 2024-02-19T19:07:40.694 INFO:tasks.workunit.client.1.smithi142.stdout:6/993: mkdir d2/d1f/d45/d155 0 2024-02-19T19:07:40.694 INFO:tasks.workunit.client.1.smithi142.stdout:6/994: dread - d2/fdc zero size 2024-02-19T19:07:40.695 INFO:tasks.workunit.client.1.smithi142.stdout:7/955: mkdir d0/d13/de4/d13f 0 2024-02-19T19:07:40.696 INFO:tasks.workunit.client.1.smithi142.stdout:0/934: mknod d23/d7d/d9e/dc7/c12c 0 2024-02-19T19:07:40.696 INFO:tasks.workunit.client.1.smithi142.stdout:0/935: creat d23/d28/d2d/f12d x:0 0 0 2024-02-19T19:07:40.696 INFO:tasks.workunit.client.1.smithi142.stdout:0/936: chown d23/d28/d127/d58/db6/l114 496346 1 2024-02-19T19:07:40.702 INFO:tasks.workunit.client.1.smithi142.stdout:7/956: dread d0/d1b/d21/d107/d86/f113 [0,4194304] 0 2024-02-19T19:07:40.715 INFO:tasks.workunit.client.1.smithi142.stdout:7/957: dwrite d0/d1b/d21/d24/f34 [0,4194304] 0 2024-02-19T19:07:40.719 INFO:tasks.workunit.client.1.smithi142.stdout:6/995: truncate d2/d1e/d35/d66/d8d/d3e/d8c/feb 2964758 0 2024-02-19T19:07:40.719 INFO:tasks.workunit.client.1.smithi142.stdout:6/996: write d2/d17/d33/d39/ff8 [435471,126305] 0 2024-02-19T19:07:40.722 INFO:tasks.workunit.client.1.smithi142.stdout:2/884: sync 2024-02-19T19:07:40.722 INFO:tasks.workunit.client.1.smithi142.stdout:2/885: fsync d3/df/f31 0 2024-02-19T19:07:40.722 INFO:tasks.workunit.client.1.smithi142.stdout:0/937: rename d23/d28/d2d/d54/cc3 to d23/d32/d8a/db1/c12e 0 2024-02-19T19:07:40.726 INFO:tasks.workunit.client.1.smithi142.stdout:6/997: write d2/d17/d33/d42/da2/da7/d55/dc0/d110/f119 [2965873,7933] 0 2024-02-19T19:07:40.726 INFO:tasks.workunit.client.1.smithi142.stdout:6/998: stat d2/d1f/d56/d65/f11b 0 2024-02-19T19:07:40.726 INFO:tasks.workunit.client.1.smithi142.stdout:2/886: mkdir d3/db/d29/d4c/d4e/d9a/da9/dad/d105/d124 0 2024-02-19T19:07:40.726 INFO:tasks.workunit.client.1.smithi142.stdout:2/887: creat d3/db/d29/d4c/dae/f125 x:0 0 0 2024-02-19T19:07:40.726 INFO:tasks.workunit.client.1.smithi142.stdout:2/888: write d3/df/f10 [2478049,63815] 0 2024-02-19T19:07:40.727 INFO:tasks.workunit.client.1.smithi142.stdout:0/938: rmdir d23/d28/d2d/d54/d88 39 2024-02-19T19:07:40.734 INFO:tasks.workunit.client.1.smithi142.stdout:6/999: mknod d2/d1f/d4d/d60/d87/d116/c156 0 2024-02-19T19:07:40.736 INFO:tasks.workunit.client.1.smithi142.stdout:2/889: mknod d3/d4d/d9f/c126 0 2024-02-19T19:07:40.736 INFO:tasks.workunit.client.1.smithi142.stdout:2/890: chown d3/df/da4/lb1 1914715 1 2024-02-19T19:07:40.737 INFO:tasks.workunit.client.1.smithi142.stdout:0/939: truncate d23/d28/d2d/d51/fa6 544215 0 2024-02-19T19:07:40.737 INFO:tasks.workunit.client.1.smithi142.stdout:0/940: write d23/d7d/d9e/fb7 [4882187,12101] 0 2024-02-19T19:07:40.738 INFO:tasks.workunit.client.1.smithi142.stdout:7/958: rename d0/d1b/d21/d24/d29 to d0/d1b/d21/d24/d140 0 2024-02-19T19:07:40.738 INFO:tasks.workunit.client.1.smithi142.stdout:7/959: write d0/d1b/f5a [2132702,18854] 0 2024-02-19T19:07:40.739 INFO:tasks.workunit.client.1.smithi142.stdout:2/891: symlink d3/db/dda/d11e/l127 0 2024-02-19T19:07:40.740 INFO:tasks.workunit.client.1.smithi142.stdout:0/941: stat d23/d28/d127/l82 0 2024-02-19T19:07:40.740 INFO:tasks.workunit.client.1.smithi142.stdout:0/942: readlink d23/d28/d127/lf6 0 2024-02-19T19:07:40.743 INFO:tasks.workunit.client.1.smithi142.stdout:7/960: creat d0/d1b/d21/d24/d140/d44/d49/d10d/f141 x:0 0 0 2024-02-19T19:07:40.744 INFO:tasks.workunit.client.1.smithi142.stdout:2/892: truncate d3/db/f15 2254799 0 2024-02-19T19:07:40.750 INFO:tasks.workunit.client.1.smithi142.stdout:2/893: creat d3/df/f128 x:0 0 0 2024-02-19T19:07:40.762 INFO:tasks.workunit.client.1.smithi142.stdout:2/894: dwrite d3/db/d29/d4c/df9/d104/d109/f11a [0,4194304] 0 2024-02-19T19:07:40.763 INFO:tasks.workunit.client.1.smithi142.stdout:2/895: creat d3/d4d/d5f/db5/f129 x:0 0 0 2024-02-19T19:07:40.765 INFO:tasks.workunit.client.1.smithi142.stdout:2/896: creat d3/db/d29/d4c/d4e/d9a/da9/dad/d105/d124/f12a x:0 0 0 2024-02-19T19:07:40.765 INFO:tasks.workunit.client.1.smithi142.stdout:2/897: dread - d3/d4d/d9f/ffe zero size 2024-02-19T19:07:40.766 INFO:tasks.workunit.client.1.smithi142.stdout:2/898: getdents d3/db/dda 0 2024-02-19T19:07:40.766 INFO:tasks.workunit.client.1.smithi142.stdout:2/899: getdents d3/d68/d95 0 2024-02-19T19:07:40.770 INFO:tasks.workunit.client.1.smithi142.stdout:2/900: write d3/d4d/d5f/d7c/dd6/f11b [1640652,21746] 0 2024-02-19T19:07:40.772 INFO:tasks.workunit.client.1.smithi142.stdout:2/901: mknod d3/d68/c12b 0 2024-02-19T19:07:40.819 INFO:tasks.workunit.client.1.smithi142.stdout:0/943: sync 2024-02-19T19:07:40.819 INFO:tasks.workunit.client.1.smithi142.stdout:0/944: chown d23/d28/d2d/d54/d88/d9f/c11d 75693 1 2024-02-19T19:07:40.819 INFO:tasks.workunit.client.1.smithi142.stdout:0/945: fsync d23/d28/d41/f9d 0 2024-02-19T19:07:40.820 INFO:tasks.workunit.client.1.smithi142.stdout:0/946: chown f17 113456 1 2024-02-19T19:07:40.820 INFO:tasks.workunit.client.1.smithi142.stdout:0/947: creat d23/f12f x:0 0 0 2024-02-19T19:07:40.820 INFO:tasks.workunit.client.1.smithi142.stdout:0/948: readlink d23/l2e 0 2024-02-19T19:07:40.821 INFO:tasks.workunit.client.1.smithi142.stdout:0/949: rename d23/d28/d127/f4d to d23/d28/d41/d78/f130 0 2024-02-19T19:07:40.822 INFO:tasks.workunit.client.1.smithi142.stdout:0/950: mkdir d23/d28/d2d/d131 0 2024-02-19T19:07:40.823 INFO:tasks.workunit.client.1.smithi142.stdout:0/951: rename l1e to d23/d32/d8a/db1/dc2/l132 0 2024-02-19T19:07:40.866 INFO:tasks.workunit.client.1.smithi142.stdout:7/961: sync 2024-02-19T19:07:40.866 INFO:tasks.workunit.client.1.smithi142.stdout:2/902: sync 2024-02-19T19:07:40.866 INFO:tasks.workunit.client.1.smithi142.stdout:2/903: read d3/db/f34 [410856,120963] 0 2024-02-19T19:07:40.867 INFO:tasks.workunit.client.1.smithi142.stdout:7/962: mkdir d0/d1b/d21/d24/d140/d44/d49/d10d/d112/d127/d142 0 2024-02-19T19:07:40.876 INFO:tasks.workunit.client.1.smithi142.stdout:2/904: write d3/db/d29/f41 [6986525,3376] 0 2024-02-19T19:07:40.876 INFO:tasks.workunit.client.1.smithi142.stdout:2/905: stat d3/db/d29/d4c/dae/lf2 0 2024-02-19T19:07:40.877 INFO:tasks.workunit.client.1.smithi142.stdout:2/906: mknod d3/db/d29/d4c/d4e/c12c 0 2024-02-19T19:07:40.880 INFO:tasks.workunit.client.1.smithi142.stdout:2/907: truncate d3/d4d/d5f/d7c/f7e 1426250 0 2024-02-19T19:07:40.880 INFO:tasks.workunit.client.1.smithi142.stdout:2/908: stat d3/db/d29/d4c/d4e/d9a/da9/dad/fe4 0 2024-02-19T19:07:40.880 INFO:tasks.workunit.client.1.smithi142.stdout:7/963: read d0/d1b/d21/d24/d140/f6e [2011481,31223] 0 2024-02-19T19:07:40.880 INFO:tasks.workunit.client.1.smithi142.stdout:7/964: stat d0/d13/d72/d47 0 2024-02-19T19:07:40.880 INFO:tasks.workunit.client.1.smithi142.stdout:7/965: write d0/d13/de4/f12f [4298957,92635] 0 2024-02-19T19:07:40.880 INFO:tasks.workunit.client.1.smithi142.stdout:7/966: fdatasync d0/d1b/d21/d24/d140/d44/de1/df3/d126/d12e/f135 0 2024-02-19T19:07:40.880 INFO:tasks.workunit.client.1.smithi142.stdout:7/967: read d0/d1b/fd0 [63286,72540] 0 2024-02-19T19:07:40.888 INFO:tasks.workunit.client.1.smithi142.stdout:2/909: dread d3/d35/d53/f6f [0,4194304] 0 2024-02-19T19:07:40.889 INFO:tasks.workunit.client.1.smithi142.stdout:2/910: symlink d3/d4d/d5f/d7c/dd6/l12d 0 2024-02-19T19:07:40.893 INFO:tasks.workunit.client.1.smithi142.stdout:7/968: dwrite d0/d13/de4/dfc/f139 [0,4194304] 0 2024-02-19T19:07:40.897 INFO:tasks.workunit.client.1.smithi142.stdout:7/969: creat d0/d1b/d21/d24/d140/d44/de1/df3/d126/f143 x:0 0 0 2024-02-19T19:07:40.898 INFO:tasks.workunit.client.1.smithi142.stdout:7/970: dread - d0/d1b/d21/d24/d5e/df8/fda zero size 2024-02-19T19:07:40.899 INFO:tasks.workunit.client.1.smithi142.stdout:7/971: symlink d0/d13/d72/d47/d69/l144 0 2024-02-19T19:07:40.899 INFO:tasks.workunit.client.1.smithi142.stdout:7/972: chown d0/d1b/d21/d24/d140/d7e/lb5 40181731 1 2024-02-19T19:07:40.899 INFO:tasks.workunit.client.1.smithi142.stdout:7/973: fsync d0/d1b/d9d/fc9 0 2024-02-19T19:07:40.903 INFO:tasks.workunit.client.1.smithi142.stdout:2/911: dwrite d3/d68/fc4 [0,4194304] 0 2024-02-19T19:07:40.906 INFO:tasks.workunit.client.1.smithi142.stdout:2/912: write d3/d4b/f7d [3916054,13764] 0 2024-02-19T19:07:40.908 INFO:tasks.workunit.client.1.smithi142.stdout:2/913: mkdir d3/df/da4/d12e 0 2024-02-19T19:07:40.908 INFO:tasks.workunit.client.1.smithi142.stdout:2/914: write d3/d68/f87 [1512836,91348] 0 2024-02-19T19:07:40.909 INFO:tasks.workunit.client.1.smithi142.stdout:2/915: dread - d3/d35/d53/f123 zero size 2024-02-19T19:07:40.909 INFO:tasks.workunit.client.1.smithi142.stdout:7/974: write d0/d13/d72/f45 [1834564,98293] 0 2024-02-19T19:07:40.909 INFO:tasks.workunit.client.1.smithi142.stdout:7/975: truncate d0/d1b/d9d/fd8 4772640 0 2024-02-19T19:07:40.909 INFO:tasks.workunit.client.1.smithi142.stdout:2/916: mknod d3/d68/d95/dca/c12f 0 2024-02-19T19:07:40.910 INFO:tasks.workunit.client.1.smithi142.stdout:2/917: dread d3/d4d/f57 [0,4194304] 0 2024-02-19T19:07:40.910 INFO:tasks.workunit.client.1.smithi142.stdout:2/918: chown d3/d35/d97 4026 1 2024-02-19T19:07:40.910 INFO:tasks.workunit.client.1.smithi142.stdout:2/919: chown d3/db/d29/d4c/dae/lf2 1483 1 2024-02-19T19:07:40.911 INFO:tasks.workunit.client.1.smithi142.stdout:0/952: sync 2024-02-19T19:07:40.911 INFO:tasks.workunit.client.1.smithi142.stdout:7/976: rmdir d0/d1b/d11f 0 2024-02-19T19:07:40.911 INFO:tasks.workunit.client.1.smithi142.stdout:0/953: stat d23/d28/d127/d58/c7f 0 2024-02-19T19:07:40.912 INFO:tasks.workunit.client.1.smithi142.stdout:7/977: creat d0/d13/f145 x:0 0 0 2024-02-19T19:07:40.913 INFO:tasks.workunit.client.1.smithi142.stdout:0/954: rename d23/d32/f6a to d23/d28/d2d/f133 0 2024-02-19T19:07:40.914 INFO:tasks.workunit.client.1.smithi142.stdout:0/955: creat d23/d28/d2d/d54/d88/de0/d118/f134 x:0 0 0 2024-02-19T19:07:40.914 INFO:tasks.workunit.client.1.smithi142.stdout:7/978: creat d0/d1b/d21/d107/f146 x:0 0 0 2024-02-19T19:07:40.914 INFO:tasks.workunit.client.1.smithi142.stdout:7/979: readlink d0/l17 0 2024-02-19T19:07:40.915 INFO:tasks.workunit.client.1.smithi142.stdout:0/956: readlink d23/d28/l2a 0 2024-02-19T19:07:40.920 INFO:tasks.workunit.client.1.smithi142.stdout:2/920: write d3/db/d29/d4c/d4e/d9a/da9/dad/d105/f75 [2272591,76725] 0 2024-02-19T19:07:40.920 INFO:tasks.workunit.client.1.smithi142.stdout:0/957: link d23/d32/c4a d23/d28/c135 0 2024-02-19T19:07:40.920 INFO:tasks.workunit.client.1.smithi142.stdout:2/921: mknod d3/d4b/dbb/c130 0 2024-02-19T19:07:40.920 INFO:tasks.workunit.client.1.smithi142.stdout:2/922: dread - d3/db/d29/d4c/dae/f125 zero size 2024-02-19T19:07:40.920 INFO:tasks.workunit.client.1.smithi142.stdout:0/958: mknod d23/d28/d127/d58/dc1/c136 0 2024-02-19T19:07:40.922 INFO:tasks.workunit.client.1.smithi142.stdout:0/959: dread d23/d7d/d9e/fef [0,4194304] 0 2024-02-19T19:07:40.922 INFO:tasks.workunit.client.1.smithi142.stdout:0/960: write d23/d28/d2d/d54/d85/fcf [1140409,40349] 0 2024-02-19T19:07:40.923 INFO:tasks.workunit.client.1.smithi142.stdout:2/923: unlink d3/d4d/c8b 0 2024-02-19T19:07:40.923 INFO:tasks.workunit.client.1.smithi142.stdout:2/924: readlink d3/d4d/d81/l8d 0 2024-02-19T19:07:40.923 INFO:tasks.workunit.client.1.smithi142.stdout:2/925: chown d3/fbe 36339 1 2024-02-19T19:07:40.923 INFO:tasks.workunit.client.1.smithi142.stdout:2/926: mknod d3/db/d29/d4c/d4e/db9/c131 0 2024-02-19T19:07:40.924 INFO:tasks.workunit.client.1.smithi142.stdout:0/961: write d23/d28/f100 [1347864,35374] 0 2024-02-19T19:07:40.925 INFO:tasks.workunit.client.1.smithi142.stdout:2/927: rename d3/df/lc2 to d3/d4b/dbb/l132 0 2024-02-19T19:07:40.932 INFO:tasks.workunit.client.1.smithi142.stdout:2/928: write d3/db/d29/d4c/fdb [815186,53575] 0 2024-02-19T19:07:40.932 INFO:tasks.workunit.client.1.smithi142.stdout:2/929: write d3/db/d29/d6d/de6/f11f [251485,36727] 0 2024-02-19T19:07:40.933 INFO:tasks.workunit.client.1.smithi142.stdout:2/930: truncate d3/db/f3a 3663685 0 2024-02-19T19:07:40.933 INFO:tasks.workunit.client.1.smithi142.stdout:2/931: truncate d3/db/d29/d4c/dae/f125 374681 0 2024-02-19T19:07:40.933 INFO:tasks.workunit.client.1.smithi142.stdout:2/932: fdatasync d3/db/d29/d4c/d4e/d9a/da9/dad/fe4 0 2024-02-19T19:07:40.933 INFO:tasks.workunit.client.1.smithi142.stdout:2/933: stat d3/db/d29/d4c/d4e/c5b 0 2024-02-19T19:07:40.934 INFO:tasks.workunit.client.1.smithi142.stdout:2/934: truncate d3/d35/d53/f6f 3537476 0 2024-02-19T19:07:40.935 INFO:tasks.workunit.client.1.smithi142.stdout:2/935: mknod d3/db/d29/d4c/d4e/db9/c133 0 2024-02-19T19:07:40.936 INFO:tasks.workunit.client.1.smithi142.stdout:2/936: dread d3/db/f20 [0,4194304] 0 2024-02-19T19:07:40.936 INFO:tasks.workunit.client.1.smithi142.stdout:0/962: dwrite d23/d32/f30 [0,4194304] 0 2024-02-19T19:07:40.937 INFO:tasks.workunit.client.1.smithi142.stdout:2/937: mknod d3/d35/c134 0 2024-02-19T19:07:40.939 INFO:tasks.workunit.client.1.smithi142.stdout:2/938: creat d3/d4d/f135 x:0 0 0 2024-02-19T19:07:40.940 INFO:tasks.workunit.client.1.smithi142.stdout:0/963: rmdir d23/d28/d2d/d54/d88/de0/d118 39 2024-02-19T19:07:40.942 INFO:tasks.workunit.client.1.smithi142.stdout:0/964: creat d23/d32/d8a/db1/dfa/f137 x:0 0 0 2024-02-19T19:07:40.944 INFO:tasks.workunit.client.1.smithi142.stdout:0/965: symlink d23/d28/d2d/d54/d88/d9f/l138 0 2024-02-19T19:07:40.944 INFO:tasks.workunit.client.1.smithi142.stdout:0/966: fsync d23/d28/d2d/d54/ff4 0 2024-02-19T19:07:40.945 INFO:tasks.workunit.client.1.smithi142.stdout:0/967: rename d23/d28/d2d/d54/d88/d9f/fe5 to d23/d32/d8a/dfc/f139 0 2024-02-19T19:07:40.946 INFO:tasks.workunit.client.1.smithi142.stdout:0/968: mkdir d23/d28/d41/d10f/d13a 0 2024-02-19T19:07:40.949 INFO:tasks.workunit.client.1.smithi142.stdout:2/939: dread d3/d35/d53/f6f [0,4194304] 0 2024-02-19T19:07:40.950 INFO:tasks.workunit.client.1.smithi142.stdout:2/940: getdents d3/d4d/d9f 0 2024-02-19T19:07:40.950 INFO:tasks.workunit.client.1.smithi142.stdout:2/941: write d3/db/d29/d6d/de6/f11f [481435,71546] 0 2024-02-19T19:07:40.952 INFO:tasks.workunit.client.1.smithi142.stdout:2/942: creat d3/d68/f136 x:0 0 0 2024-02-19T19:07:40.954 INFO:tasks.workunit.client.1.smithi142.stdout:2/943: truncate d3/df/f2b 1452919 0 2024-02-19T19:07:40.954 INFO:tasks.workunit.client.1.smithi142.stdout:2/944: readlink d3/d4d/d81/l110 0 2024-02-19T19:07:40.954 INFO:tasks.workunit.client.1.smithi142.stdout:0/969: dread d23/d28/d2d/f3b [0,4194304] 0 2024-02-19T19:07:40.954 INFO:tasks.workunit.client.1.smithi142.stdout:0/970: truncate d23/d28/d2d/f125 122469 0 2024-02-19T19:07:40.954 INFO:tasks.workunit.client.1.smithi142.stdout:2/945: getdents d3/d4d/d5f/d7c 0 2024-02-19T19:07:40.955 INFO:tasks.workunit.client.1.smithi142.stdout:0/971: symlink d23/d28/d2d/d131/l13b 0 2024-02-19T19:07:40.955 INFO:tasks.workunit.client.1.smithi142.stdout:0/972: chown d23/c113 23 1 2024-02-19T19:07:40.956 INFO:tasks.workunit.client.1.smithi142.stdout:0/973: dread d23/d32/f8f [0,4194304] 0 2024-02-19T19:07:40.956 INFO:tasks.workunit.client.1.smithi142.stdout:0/974: creat d23/d7d/d9e/f13c x:0 0 0 2024-02-19T19:07:40.957 INFO:tasks.workunit.client.1.smithi142.stdout:2/946: rename d3/db/d29/d6d/de6 to d3/db/d29/d6d/d59/d137 0 2024-02-19T19:07:40.960 INFO:tasks.workunit.client.1.smithi142.stdout:0/975: mkdir d23/d32/d13d 0 2024-02-19T19:07:40.960 INFO:tasks.workunit.client.1.smithi142.stdout:0/976: creat d23/d7d/f13e x:0 0 0 2024-02-19T19:07:40.962 INFO:tasks.workunit.client.1.smithi142.stdout:0/977: rename d23/d28/d41/d78/lac to d23/d32/d8a/l13f 0 2024-02-19T19:07:40.963 INFO:tasks.workunit.client.1.smithi142.stdout:0/978: chown d23/d28/d127 29273735 1 2024-02-19T19:07:40.963 INFO:tasks.workunit.client.1.smithi142.stdout:0/979: mkdir d23/d28/d2d/d54/d88/de0/d140 0 2024-02-19T19:07:40.964 INFO:tasks.workunit.client.1.smithi142.stdout:0/980: creat d23/d28/d2d/d54/d88/de0/d118/f141 x:0 0 0 2024-02-19T19:07:40.964 INFO:tasks.workunit.client.1.smithi142.stdout:2/947: dread d3/d68/d95/ff5 [0,4194304] 0 2024-02-19T19:07:40.965 INFO:tasks.workunit.client.1.smithi142.stdout:0/981: mkdir d23/d28/d127/d58/d142 0 2024-02-19T19:07:40.974 INFO:tasks.workunit.client.1.smithi142.stdout:0/982: dread d23/d28/d127/d58/f76 [0,4194304] 0 2024-02-19T19:07:40.974 INFO:tasks.workunit.client.1.smithi142.stdout:0/983: creat d23/f143 x:0 0 0 2024-02-19T19:07:40.974 INFO:tasks.workunit.client.1.smithi142.stdout:0/984: dread - d23/d86/f10e zero size 2024-02-19T19:07:40.977 INFO:tasks.workunit.client.1.smithi142.stdout:0/985: write d23/d28/d2d/d54/d88/fa4 [182989,63457] 0 2024-02-19T19:07:40.991 INFO:tasks.workunit.client.1.smithi142.stdout:2/948: dwrite d3/db/d29/d4c/d4e/d9a/da9/dad/d105/fb6 [0,4194304] 0 2024-02-19T19:07:40.994 INFO:tasks.workunit.client.1.smithi142.stdout:2/949: rmdir d3/d4b/dbb 39 2024-02-19T19:07:40.994 INFO:tasks.workunit.client.1.smithi142.stdout:2/950: readlink d3/d35/d53/lb7 0 2024-02-19T19:07:41.008 INFO:tasks.workunit.client.1.smithi142.stdout:2/951: dwrite d3/d4d/d5f/d7c/f7e [0,4194304] 0 2024-02-19T19:07:41.009 INFO:tasks.workunit.client.1.smithi142.stdout:2/952: truncate d3/d35/f66 2190490 0 2024-02-19T19:07:41.010 INFO:tasks.workunit.client.1.smithi142.stdout:2/953: write d3/d4d/d5f/d7c/fea [1338702,61595] 0 2024-02-19T19:07:41.021 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 19:07:40 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[106707]: 2024-02-19T19:07:40.733+0000 7ff91510a700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:07:41.021 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:40 smithi046 ceph-mon[88928]: pgmap v82: 65 pgs: 9 active+clean+remapped, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 1.9 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 323 MiB/s rd, 363 MiB/s wr, 501 op/s; 5733/33933 objects degraded (16.895%); 1413/33933 objects misplaced (4.164%); 3.2 MiB/s, 78 objects/s recovering 2024-02-19T19:07:41.021 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:40 smithi046 ceph-mon[88928]: from='osd.1 [v2:172.21.15.46:6810/2409899830,v1:172.21.15.46:6811/2409899830]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T19:07:41.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:40 smithi046 ceph-mon[88928]: osdmap e63: 6 total, 5 up, 6 in 2024-02-19T19:07:41.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:40 smithi046 ceph-mon[88928]: from='osd.1 [v2:172.21.15.46:6810/2409899830,v1:172.21.15.46:6811/2409899830]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T19:07:41.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:40 smithi046 ceph-mon[88928]: from='osd.1 [v2:172.21.15.46:6810/2409899830,v1:172.21.15.46:6811/2409899830]' entity='osd.1' 2024-02-19T19:07:41.023 INFO:tasks.workunit.client.1.smithi142.stdout:2/954: dwrite d3/d4d/fee [0,4194304] 0 2024-02-19T19:07:41.025 INFO:tasks.workunit.client.1.smithi142.stdout:2/955: mkdir d3/d35/d53/d138 0 2024-02-19T19:07:41.025 INFO:tasks.workunit.client.1.smithi142.stdout:2/956: chown d3/db/d29/d6d/d59/f6e 2726580 1 2024-02-19T19:07:41.034 INFO:tasks.workunit.client.1.smithi142.stdout:2/957: write d3/db/d29/d4c/d4e/d9a/da9/fd3 [799865,38177] 0 2024-02-19T19:07:41.035 INFO:tasks.workunit.client.1.smithi142.stdout:2/958: creat d3/d4d/d9f/de1/f139 x:0 0 0 2024-02-19T19:07:41.059 INFO:tasks.workunit.client.1.smithi142.stdout:2/959: dwrite d3/db/d29/d4c/d4e/d9a/da9/dad/d105/fb6 [0,4194304] 0 2024-02-19T19:07:41.067 INFO:tasks.workunit.client.1.smithi142.stdout:2/960: dread d3/db/d29/d6d/d59/f99 [0,4194304] 0 2024-02-19T19:07:41.068 INFO:tasks.workunit.client.1.smithi142.stdout:2/961: creat d3/df/da4/d12e/f13a x:0 0 0 2024-02-19T19:07:41.069 INFO:tasks.workunit.client.1.smithi142.stdout:2/962: symlink d3/db/d29/d4c/d4e/d9a/da9/dad/d105/d124/l13b 0 2024-02-19T19:07:41.069 INFO:tasks.workunit.client.1.smithi142.stdout:2/963: write d3/d35/f115 [948444,74674] 0 2024-02-19T19:07:41.070 INFO:tasks.workunit.client.1.smithi142.stdout:2/964: symlink d3/d4d/d5f/db5/l13c 0 2024-02-19T19:07:41.070 INFO:tasks.workunit.client.1.smithi142.stdout:2/965: creat d3/db/d29/d4c/d4e/d9a/da9/dad/d105/d124/f13d x:0 0 0 2024-02-19T19:07:41.082 INFO:tasks.workunit.client.1.smithi142.stdout:7/980: sync 2024-02-19T19:07:41.084 INFO:tasks.workunit.client.1.smithi142.stdout:7/981: mkdir d0/d1b/d21/d24/d140/d44/de1/df3/d126/d12e/d147 0 2024-02-19T19:07:41.084 INFO:tasks.workunit.client.1.smithi142.stdout:7/982: fsync d0/d1b/d21/d24/f34 0 2024-02-19T19:07:41.084 INFO:tasks.workunit.client.1.smithi142.stdout:7/983: dread - d0/d1b/d21/d24/d5e/fdd zero size 2024-02-19T19:07:41.084 INFO:tasks.workunit.client.1.smithi142.stdout:7/984: stat d0/d13/d72/f45 0 2024-02-19T19:07:41.084 INFO:tasks.workunit.client.1.smithi142.stdout:7/985: chown d0/d1b/d21/d24/d5e/f63 1231798 1 2024-02-19T19:07:41.084 INFO:tasks.workunit.client.1.smithi142.stdout:7/986: creat d0/d1b/d21/d24/ddf/f148 x:0 0 0 2024-02-19T19:07:41.086 INFO:tasks.workunit.client.1.smithi142.stdout:7/987: rename d0/d1b/d21/d24/d140/d44/de1/df3/d126/d12e/f135 to d0/d13/d72/da7/f149 0 2024-02-19T19:07:41.087 INFO:tasks.workunit.client.1.smithi142.stdout:7/988: link d0/d13/d72/c84 d0/d13/de4/c14a 0 2024-02-19T19:07:41.087 INFO:tasks.workunit.client.1.smithi142.stdout:7/989: readlink d0/d13/d72/d47/lb3 0 2024-02-19T19:07:41.087 INFO:tasks.workunit.client.1.smithi142.stdout:7/990: chown d0/d13/d72/d47 852481825 1 2024-02-19T19:07:41.142 INFO:tasks.workunit.client.1.smithi142.stdout:0/986: sync 2024-02-19T19:07:41.142 INFO:tasks.workunit.client.1.smithi142.stdout:0/987: read - d23/d7d/d9e/f13c zero size 2024-02-19T19:07:41.142 INFO:tasks.workunit.client.1.smithi142.stdout:0/988: write d23/d28/d2d/f79 [674792,31729] 0 2024-02-19T19:07:41.142 INFO:tasks.workunit.client.1.smithi142.stdout:0/989: fsync d23/d32/d8a/fdf 0 2024-02-19T19:07:41.142 INFO:tasks.workunit.client.1.smithi142.stdout:0/990: write d23/d28/d2d/d54/ff4 [378819,35025] 0 2024-02-19T19:07:41.143 INFO:tasks.workunit.client.1.smithi142.stdout:0/991: unlink d23/d28/d127/d58/dc1/lc4 0 2024-02-19T19:07:41.143 INFO:tasks.workunit.client.1.smithi142.stdout:0/992: truncate d23/d28/d2d/d54/ff4 595489 0 2024-02-19T19:07:41.143 INFO:tasks.workunit.client.1.smithi142.stdout:0/993: write d23/d32/d8a/db1/fc5 [316792,18925] 0 2024-02-19T19:07:41.144 INFO:tasks.workunit.client.1.smithi142.stdout:0/994: creat d23/d86/d12b/f144 x:0 0 0 2024-02-19T19:07:41.152 INFO:tasks.workunit.client.1.smithi142.stdout:0/995: dread d23/f25 [0,4194304] 0 2024-02-19T19:07:41.153 INFO:tasks.workunit.client.1.smithi142.stdout:0/996: mkdir d23/d32/d8a/dfc/d145 0 2024-02-19T19:07:41.154 INFO:tasks.workunit.client.1.smithi142.stdout:0/997: unlink d23/c3c 0 2024-02-19T19:07:41.161 INFO:tasks.workunit.client.1.smithi142.stdout:0/998: dread d23/d28/d41/f9d [0,4194304] 0 2024-02-19T19:07:41.162 INFO:tasks.workunit.client.1.smithi142.stdout:0/999: dread d23/f64 [0,4194304] 0 2024-02-19T19:07:41.175 INFO:tasks.workunit.client.1.smithi142.stdout:2/966: sync 2024-02-19T19:07:41.177 INFO:tasks.workunit.client.1.smithi142.stdout:2/967: rename d3/d35/d53/ld9 to d3/d4d/d5f/db5/l13e 0 2024-02-19T19:07:41.177 INFO:tasks.workunit.client.1.smithi142.stdout:2/968: chown d3/d4b/ca3 3 1 2024-02-19T19:07:41.182 INFO:tasks.workunit.client.1.smithi142.stdout:2/969: write d3/d4b/f58 [856232,74470] 0 2024-02-19T19:07:41.183 INFO:tasks.workunit.client.1.smithi142.stdout:2/970: symlink d3/d4d/l13f 0 2024-02-19T19:07:41.183 INFO:tasks.workunit.client.1.smithi142.stdout:2/971: chown d3/df/da4/fd8 21568656 1 2024-02-19T19:07:41.184 INFO:tasks.workunit.client.1.smithi142.stdout:2/972: chown d3/db/d29/d4c/dae/cd0 40 1 2024-02-19T19:07:41.184 INFO:tasks.workunit.client.1.smithi142.stdout:2/973: creat d3/d4d/f140 x:0 0 0 2024-02-19T19:07:41.184 INFO:tasks.workunit.client.1.smithi142.stdout:2/974: creat d3/db/d29/d4c/d4e/d9a/da9/dad/f141 x:0 0 0 2024-02-19T19:07:41.184 INFO:tasks.workunit.client.1.smithi142.stdout:2/975: readlink d3/l22 0 2024-02-19T19:07:41.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:40 smithi142 ceph-mon[69118]: pgmap v82: 65 pgs: 9 active+clean+remapped, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 1.9 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 323 MiB/s rd, 363 MiB/s wr, 501 op/s; 5733/33933 objects degraded (16.895%); 1413/33933 objects misplaced (4.164%); 3.2 MiB/s, 78 objects/s recovering 2024-02-19T19:07:41.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:40 smithi142 ceph-mon[69118]: from='osd.1 [v2:172.21.15.46:6810/2409899830,v1:172.21.15.46:6811/2409899830]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T19:07:41.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:40 smithi142 ceph-mon[69118]: osdmap e63: 6 total, 5 up, 6 in 2024-02-19T19:07:41.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:40 smithi142 ceph-mon[69118]: from='osd.1 [v2:172.21.15.46:6810/2409899830,v1:172.21.15.46:6811/2409899830]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T19:07:41.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:40 smithi142 ceph-mon[69118]: from='osd.1 [v2:172.21.15.46:6810/2409899830,v1:172.21.15.46:6811/2409899830]' entity='osd.1' 2024-02-19T19:07:41.205 INFO:tasks.workunit.client.1.smithi142.stdout:7/991: sync 2024-02-19T19:07:41.207 INFO:tasks.workunit.client.1.smithi142.stdout:7/992: link d0/d13/d1e/db7/dca/l117 d0/d13/de4/dfc/l14b 0 2024-02-19T19:07:41.209 INFO:tasks.workunit.client.1.smithi142.stdout:7/993: rename d0/d1b/d21/c6d to d0/c14c 0 2024-02-19T19:07:41.223 INFO:tasks.workunit.client.1.smithi142.stdout:7/994: dwrite d0/f9 [0,4194304] 0 2024-02-19T19:07:41.223 INFO:tasks.workunit.client.1.smithi142.stdout:7/995: dread - d0/d13/d72/da7/f149 zero size 2024-02-19T19:07:41.225 INFO:tasks.workunit.client.1.smithi142.stdout:7/996: symlink d0/d1b/d21/d24/d140/d44/de1/df3/l14d 0 2024-02-19T19:07:41.225 INFO:tasks.workunit.client.1.smithi142.stdout:7/997: write d0/fa1 [4817419,26584] 0 2024-02-19T19:07:41.225 INFO:tasks.workunit.client.1.smithi142.stdout:7/998: chown d0/d1b/d21 247430 1 2024-02-19T19:07:41.225 INFO:tasks.workunit.client.1.smithi142.stdout:7/999: mknod d0/d1b/d21/d107/c14e 0 2024-02-19T19:07:41.254 INFO:tasks.workunit.client.1.smithi142.stdout:2/976: sync 2024-02-19T19:07:41.262 INFO:tasks.workunit.client.1.smithi142.stdout:2/977: dread d3/df/f31 [0,4194304] 0 2024-02-19T19:07:41.263 INFO:tasks.workunit.client.1.smithi142.stdout:2/978: mknod d3/db/d29/d4c/d4e/db9/c142 0 2024-02-19T19:07:41.276 INFO:tasks.workunit.client.1.smithi142.stdout:2/979: dwrite d3/d4d/f6c [0,4194304] 0 2024-02-19T19:07:41.277 INFO:tasks.workunit.client.1.smithi142.stdout:2/980: symlink d3/db/d29/d4c/l143 0 2024-02-19T19:07:41.278 INFO:tasks.workunit.client.1.smithi142.stdout:2/981: mkdir d3/df/da4/de7/d144 0 2024-02-19T19:07:41.279 INFO:tasks.workunit.client.1.smithi142.stdout:2/982: chown d3/d35/d53 362 1 2024-02-19T19:07:41.345 INFO:tasks.workunit.client.1.smithi142.stdout:2/983: sync 2024-02-19T19:07:41.345 INFO:tasks.workunit.client.1.smithi142.stdout:2/984: dread - d3/d4d/d9f/fc1 zero size 2024-02-19T19:07:41.346 INFO:tasks.workunit.client.1.smithi142.stdout:2/985: symlink d3/d35/d53/l145 0 2024-02-19T19:07:41.353 INFO:tasks.workunit.client.1.smithi142.stdout:2/986: dread d3/d4d/d5f/f72 [4194304,4194304] 0 2024-02-19T19:07:41.353 INFO:tasks.workunit.client.1.smithi142.stdout:2/987: chown d3/db/d29/f5d 30507510 1 2024-02-19T19:07:41.354 INFO:tasks.workunit.client.1.smithi142.stdout:2/988: truncate d3/d4d/f69 258704 0 2024-02-19T19:07:41.363 INFO:tasks.workunit.client.1.smithi142.stdout:2/989: dread d3/f5 [4194304,4194304] 0 2024-02-19T19:07:41.364 INFO:tasks.workunit.client.1.smithi142.stdout:2/990: mkdir d3/d4d/d146 0 2024-02-19T19:07:41.366 INFO:tasks.workunit.client.1.smithi142.stdout:2/991: symlink d3/db/d29/d4c/df9/d104/d109/l147 0 2024-02-19T19:07:41.366 INFO:tasks.workunit.client.1.smithi142.stdout:2/992: truncate d3/db/d29/d4c/d4e/d9a/da9/dad/d105/d124/f13d 522849 0 2024-02-19T19:07:41.366 INFO:tasks.workunit.client.1.smithi142.stdout:2/993: fdatasync d3/d35/f115 0 2024-02-19T19:07:41.367 INFO:tasks.workunit.client.1.smithi142.stdout:2/994: rename d3/db/d29/d6d/d59/d137/c118 to d3/db/d29/d4c/df9/d104/d109/c148 0 2024-02-19T19:07:41.418 INFO:tasks.workunit.client.1.smithi142.stdout:2/995: sync 2024-02-19T19:07:41.418 INFO:tasks.workunit.client.1.smithi142.stdout:2/996: creat d3/df/da4/de7/f149 x:0 0 0 2024-02-19T19:07:41.426 INFO:tasks.workunit.client.1.smithi142.stdout:2/997: write d3/db/d29/d4c/d4e/d9a/da9/dad/d105/fb6 [1916900,128626] 0 2024-02-19T19:07:41.428 INFO:tasks.workunit.client.1.smithi142.stdout:2/998: mkdir d3/db/dda/d11e/d14a 0 2024-02-19T19:07:41.428 INFO:tasks.workunit.client.1.smithi142.stdout:2/999: read - d3/db/d29/d4c/d4e/d9a/da9/dad/fe4 zero size 2024-02-19T19:07:41.430 INFO:tasks.workunit.client.1.smithi142.stderr:+ rm -rf -- ./tmp.xU5MEvGV4m 2024-02-19T19:07:42.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:41 smithi142 ceph-mon[69118]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:07:42.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:41 smithi142 ceph-mon[69118]: osd.1 [v2:172.21.15.46:6810/2409899830,v1:172.21.15.46:6811/2409899830] boot 2024-02-19T19:07:42.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:41 smithi142 ceph-mon[69118]: osdmap e64: 6 total, 6 up, 6 in 2024-02-19T19:07:42.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:41 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:07:42.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:41 smithi046 ceph-mon[88928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:07:42.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:41 smithi046 ceph-mon[88928]: osd.1 [v2:172.21.15.46:6810/2409899830,v1:172.21.15.46:6811/2409899830] boot 2024-02-19T19:07:42.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:41 smithi046 ceph-mon[88928]: osdmap e64: 6 total, 6 up, 6 in 2024-02-19T19:07:42.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:07:43.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:43 smithi142 ceph-mon[69118]: pgmap v84: 65 pgs: 9 active+clean+remapped, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 1.9 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 277 MiB/s rd, 306 MiB/s wr, 431 op/s; 5733/33933 objects degraded (16.895%); 1413/33933 objects misplaced (4.164%); 2.8 MiB/s, 70 objects/s recovering 2024-02-19T19:07:43.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:43.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:43.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:43.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:43.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:43 smithi142 ceph-mon[69118]: osdmap e65: 6 total, 6 up, 6 in 2024-02-19T19:07:43.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:43 smithi046 ceph-mon[88928]: pgmap v84: 65 pgs: 9 active+clean+remapped, 29 active+undersized+degraded, 2 active+undersized, 25 active+clean; 1.9 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 277 MiB/s rd, 306 MiB/s wr, 431 op/s; 5733/33933 objects degraded (16.895%); 1413/33933 objects misplaced (4.164%); 2.8 MiB/s, 70 objects/s recovering 2024-02-19T19:07:43.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:43.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:43.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:43.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:43.776 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:43 smithi046 ceph-mon[88928]: osdmap e65: 6 total, 6 up, 6 in 2024-02-19T19:07:44.989 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:44 smithi046 ceph-mon[88928]: pgmap v87: 65 pgs: 6 active+recovery_wait+degraded, 2 activating+degraded, 33 active+clean, 1 active+undersized, 8 active+undersized+degraded, 2 peering, 3 active+clean+remapped, 10 remapped+peering; 2.1 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 355 MiB/s rd, 392 MiB/s wr, 591 op/s; 915/34254 objects degraded (2.671%); 326/34254 objects misplaced (0.952%); 17 MiB/s, 6 objects/s recovering 2024-02-19T19:07:44.990 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:44 smithi046 ceph-mon[88928]: osdmap e66: 6 total, 6 up, 6 in 2024-02-19T19:07:44.990 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:44 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:44.990 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:44 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:44.990 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:44 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 5733/33933 objects degraded (16.895%), 29 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:44.990 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:44 smithi046 ceph-mon[88928]: osdmap e67: 6 total, 6 up, 6 in 2024-02-19T19:07:45.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:44 smithi142 ceph-mon[69118]: pgmap v87: 65 pgs: 6 active+recovery_wait+degraded, 2 activating+degraded, 33 active+clean, 1 active+undersized, 8 active+undersized+degraded, 2 peering, 3 active+clean+remapped, 10 remapped+peering; 2.1 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 355 MiB/s rd, 392 MiB/s wr, 591 op/s; 915/34254 objects degraded (2.671%); 326/34254 objects misplaced (0.952%); 17 MiB/s, 6 objects/s recovering 2024-02-19T19:07:45.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:44 smithi142 ceph-mon[69118]: osdmap e66: 6 total, 6 up, 6 in 2024-02-19T19:07:45.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:44 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:45.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:44 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:45.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:44 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 5733/33933 objects degraded (16.895%), 29 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:45.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:44 smithi142 ceph-mon[69118]: osdmap e67: 6 total, 6 up, 6 in 2024-02-19T19:07:46.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:46 smithi046 ceph-mon[88928]: osdmap e68: 6 total, 6 up, 6 in 2024-02-19T19:07:46.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:46 smithi142 ceph-mon[69118]: osdmap e68: 6 total, 6 up, 6 in 2024-02-19T19:07:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:47 smithi046 ceph-mon[88928]: pgmap v91: 65 pgs: 6 active+recovery_wait+degraded, 2 activating+degraded, 45 active+clean, 4 peering, 8 remapped+peering; 2.1 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 147 MiB/s rd, 167 MiB/s wr, 356 op/s; 185/34266 objects degraded (0.540%); 71 MiB/s, 1.02k keys/s, 29 objects/s recovering 2024-02-19T19:07:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:47 smithi046 ceph-mon[88928]: osdmap e69: 6 total, 6 up, 6 in 2024-02-19T19:07:47.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:47 smithi142 ceph-mon[69118]: pgmap v91: 65 pgs: 6 active+recovery_wait+degraded, 2 activating+degraded, 45 active+clean, 4 peering, 8 remapped+peering; 2.1 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 147 MiB/s rd, 167 MiB/s wr, 356 op/s; 185/34266 objects degraded (0.540%); 71 MiB/s, 1.02k keys/s, 29 objects/s recovering 2024-02-19T19:07:47.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:47 smithi142 ceph-mon[69118]: osdmap e69: 6 total, 6 up, 6 in 2024-02-19T19:07:48.393 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:48 smithi046 ceph-mon[88928]: osdmap e70: 6 total, 6 up, 6 in 2024-02-19T19:07:48.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:48 smithi142 ceph-mon[69118]: osdmap e70: 6 total, 6 up, 6 in 2024-02-19T19:07:49.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: pgmap v94: 65 pgs: 6 active+recovery_wait+degraded, 2 activating+degraded, 45 active+clean, 4 peering, 8 remapped+peering; 2.1 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 15 MiB/s rd, 15 MiB/s wr, 61 op/s; 185/34266 objects degraded (0.540%); 46 MiB/s, 1.02k keys/s, 20 objects/s recovering 2024-02-19T19:07:49.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: osdmap e71: 6 total, 6 up, 6 in 2024-02-19T19:07:49.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:49.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:49.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:49.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:07:49.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:49.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:49.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:07:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 185/34266 objects degraded (0.540%), 8 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:49 smithi142 ceph-mon[69118]: osdmap e72: 6 total, 6 up, 6 in 2024-02-19T19:07:49.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: pgmap v94: 65 pgs: 6 active+recovery_wait+degraded, 2 activating+degraded, 45 active+clean, 4 peering, 8 remapped+peering; 2.1 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 15 MiB/s rd, 15 MiB/s wr, 61 op/s; 185/34266 objects degraded (0.540%); 46 MiB/s, 1.02k keys/s, 20 objects/s recovering 2024-02-19T19:07:49.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: osdmap e71: 6 total, 6 up, 6 in 2024-02-19T19:07:49.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:49.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:49.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:49.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:07:49.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:49.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:49.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:49.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:49.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:49.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:07:49.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 185/34266 objects degraded (0.540%), 8 pgs degraded (PG_DEGRADED) 2024-02-19T19:07:49.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:49 smithi046 ceph-mon[88928]: osdmap e72: 6 total, 6 up, 6 in 2024-02-19T19:07:50.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:50 smithi142 ceph-mon[69118]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:07:50.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:50 smithi142 ceph-mon[69118]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-02-19T19:07:50.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:50 smithi142 ceph-mon[69118]: osdmap e73: 6 total, 6 up, 6 in 2024-02-19T19:07:50.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:50 smithi046 ceph-mon[88928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:07:50.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:50 smithi046 ceph-mon[88928]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-02-19T19:07:50.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:50 smithi046 ceph-mon[88928]: osdmap e73: 6 total, 6 up, 6 in 2024-02-19T19:07:51.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:51 smithi142 ceph-mon[69118]: pgmap v97: 65 pgs: 1 active+undersized+remapped, 59 active+clean, 2 peering, 3 remapped+peering; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 38 KiB/s rd, 437 KiB/s wr, 89 op/s; 185 MiB/s, 161 objects/s recovering 2024-02-19T19:07:51.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:51 smithi142 ceph-mon[69118]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 185/34266 objects degraded (0.540%), 8 pgs degraded) 2024-02-19T19:07:51.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:51 smithi142 ceph-mon[69118]: Cluster is now healthy 2024-02-19T19:07:51.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:51 smithi046 ceph-mon[88928]: pgmap v97: 65 pgs: 1 active+undersized+remapped, 59 active+clean, 2 peering, 3 remapped+peering; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 38 KiB/s rd, 437 KiB/s wr, 89 op/s; 185 MiB/s, 161 objects/s recovering 2024-02-19T19:07:51.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:51 smithi046 ceph-mon[88928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 185/34266 objects degraded (0.540%), 8 pgs degraded) 2024-02-19T19:07:51.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:51 smithi046 ceph-mon[88928]: Cluster is now healthy 2024-02-19T19:07:51.767 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-19T19:07:51.768 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-19T19:07:53.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:53 smithi142 ceph-mon[69118]: pgmap v99: 65 pgs: 1 creating+peering, 64 active+clean; 1.1 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 33 KiB/s rd, 939 KiB/s wr, 130 op/s; 187 MiB/s, 153 objects/s recovering 2024-02-19T19:07:53.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:53 smithi046 ceph-mon[88928]: pgmap v99: 65 pgs: 1 creating+peering, 64 active+clean; 1.1 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 33 KiB/s rd, 939 KiB/s wr, 130 op/s; 187 MiB/s, 153 objects/s recovering 2024-02-19T19:07:53.789 INFO:tasks.workunit.client.0.smithi046.stderr:+ tar xzf ltp-full.tgz 2024-02-19T19:07:55.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:55 smithi142 ceph-mon[69118]: pgmap v100: 65 pgs: 1 creating+peering, 64 active+clean; 337 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 2.8 MiB/s wr, 240 op/s; 144 MiB/s, 117 objects/s recovering 2024-02-19T19:07:55.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:55 smithi046 ceph-mon[88928]: pgmap v100: 65 pgs: 1 creating+peering, 64 active+clean; 337 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 2.8 MiB/s wr, 240 op/s; 144 MiB/s, 117 objects/s recovering 2024-02-19T19:07:57.383 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:57 smithi046 ceph-mon[88928]: pgmap v101: 65 pgs: 65 active+clean; 158 MiB data, 957 MiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 212 op/s; 102 MiB/s, 87 objects/s recovering 2024-02-19T19:07:57.451 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:57 smithi142 ceph-mon[69118]: pgmap v101: 65 pgs: 65 active+clean; 158 MiB data, 957 MiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 212 op/s; 102 MiB/s, 87 objects/s recovering 2024-02-19T19:07:57.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.907+0000 7f0490be3700 1 -- 172.21.15.46:0/1821073175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f048c1038b0 msgr2=0x7f048c103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:57.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.907+0000 7f0490be3700 1 --2- 172.21.15.46:0/1821073175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f048c1038b0 0x7f048c103c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f047c009910 tx=0x7f047c009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:57.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.908+0000 7f0490be3700 1 -- 172.21.15.46:0/1821073175 shutdown_connections 2024-02-19T19:07:57.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.908+0000 7f0490be3700 1 --2- 172.21.15.46:0/1821073175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f048c0ff350 0x7f048c0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.908+0000 7f0490be3700 1 --2- 172.21.15.46:0/1821073175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f048c1038b0 0x7f048c103c80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.908+0000 7f0490be3700 1 -- 172.21.15.46:0/1821073175 >> 172.21.15.46:0/1821073175 conn(0x7f048c0748b0 msgr2=0x7f048c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.908+0000 7f0490be3700 1 -- 172.21.15.46:0/1821073175 shutdown_connections 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.908+0000 7f0490be3700 1 -- 172.21.15.46:0/1821073175 wait complete. 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0490be3700 1 Processor -- start 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0490be3700 1 -- start start 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0490be3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f048c0ff350 0x7f048c193d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0490be3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f048c1038b0 0x7f048c194250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0490be3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c194930 con 0x7f048c1038b0 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0490be3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048c1986c0 con 0x7f048c0ff350 2024-02-19T19:07:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0489d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f048c1038b0 0x7f048c194250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0489d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f048c1038b0 0x7f048c194250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45600/0 (socket says 172.21.15.46:45600) 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0489d9b700 1 -- 172.21.15.46:0/3390123405 learned_addr learned my addr 172.21.15.46:0/3390123405 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f048a59c700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f048c0ff350 0x7f048c193d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0489d9b700 1 -- 172.21.15.46:0/3390123405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f048c0ff350 msgr2=0x7f048c193d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0489d9b700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f048c0ff350 0x7f048c193d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.909+0000 7f0489d9b700 1 -- 172.21.15.46:0/3390123405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c0095f0 con 0x7f048c1038b0 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.910+0000 7f0489d9b700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f048c1038b0 0x7f048c194250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f047400b4b0 tx=0x7f047400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.910+0000 7f04837fe700 1 -- 172.21.15.46:0/3390123405 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0474011800 con 0x7f048c1038b0 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.910+0000 7f04837fe700 1 -- 172.21.15.46:0/3390123405 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0474011e20 con 0x7f048c1038b0 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.910+0000 7f0490be3700 1 -- 172.21.15.46:0/3390123405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048c1989a0 con 0x7f048c1038b0 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.910+0000 7f04837fe700 1 -- 172.21.15.46:0/3390123405 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f047400f2e0 con 0x7f048c1038b0 2024-02-19T19:07:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.910+0000 7f0490be3700 1 -- 172.21.15.46:0/3390123405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048c198ef0 con 0x7f048c1038b0 2024-02-19T19:07:57.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.911+0000 7f0490be3700 1 -- 172.21.15.46:0/3390123405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048c106e20 con 0x7f048c1038b0 2024-02-19T19:07:57.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.912+0000 7f04837fe700 1 -- 172.21.15.46:0/3390123405 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0474010380 con 0x7f048c1038b0 2024-02-19T19:07:57.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.912+0000 7f04837fe700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047806e9b0 0x7f0478070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:57.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.913+0000 7f04837fe700 1 -- 172.21.15.46:0/3390123405 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f047408d000 con 0x7f048c1038b0 2024-02-19T19:07:57.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.913+0000 7f048a59c700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047806e9b0 0x7f0478070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:57.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.913+0000 7f048a59c700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047806e9b0 0x7f0478070e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f047c000c00 tx=0x7f047c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:57.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:57.918+0000 7f04837fe700 1 -- 172.21.15.46:0/3390123405 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f04740567d0 con 0x7f048c1038b0 2024-02-19T19:07:58.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.230+0000 7f0490be3700 1 -- 172.21.15.46:0/3390123405 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f048c199230 con 0x7f047806e9b0 2024-02-19T19:07:58.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.231+0000 7f04837fe700 1 -- 172.21.15.46:0/3390123405 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f048c199230 con 0x7f047806e9b0 2024-02-19T19:07:58.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.233+0000 7f0490be3700 1 -- 172.21.15.46:0/3390123405 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047806e9b0 msgr2=0x7f0478070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:58.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.233+0000 7f0490be3700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047806e9b0 0x7f0478070e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f047c000c00 tx=0x7f047c01a040 comp rx=0 tx=0).stop 2024-02-19T19:07:58.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.233+0000 7f0490be3700 1 -- 172.21.15.46:0/3390123405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f048c1038b0 msgr2=0x7f048c194250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:58.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.233+0000 7f0490be3700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f048c1038b0 0x7f048c194250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f047400b4b0 tx=0x7f047400b7c0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.233+0000 7f0490be3700 1 -- 172.21.15.46:0/3390123405 shutdown_connections 2024-02-19T19:07:58.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.233+0000 7f0490be3700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047806e9b0 0x7f0478070e60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.233+0000 7f0490be3700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f048c0ff350 0x7f048c193d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.233+0000 7f0490be3700 1 --2- 172.21.15.46:0/3390123405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f048c1038b0 0x7f048c194250 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.233+0000 7f0490be3700 1 -- 172.21.15.46:0/3390123405 >> 172.21.15.46:0/3390123405 conn(0x7f048c0748b0 msgr2=0x7f048c0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:58.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.234+0000 7f0490be3700 1 -- 172.21.15.46:0/3390123405 shutdown_connections 2024-02-19T19:07:58.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.234+0000 7f0490be3700 1 -- 172.21.15.46:0/3390123405 wait complete. 2024-02-19T19:07:58.266 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.356+0000 7f23ff9a7700 1 -- 172.21.15.46:0/4195827643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80687a0 msgr2=0x7f23f8068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.356+0000 7f23ff9a7700 1 --2- 172.21.15.46:0/4195827643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80687a0 0x7f23f8068b70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009910 tx=0x7f23f4009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.356+0000 7f23ff9a7700 1 -- 172.21.15.46:0/4195827643 shutdown_connections 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.356+0000 7f23ff9a7700 1 --2- 172.21.15.46:0/4195827643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23f8069140 0x7f23f8104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.356+0000 7f23ff9a7700 1 --2- 172.21.15.46:0/4195827643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80687a0 0x7f23f8068b70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.356+0000 7f23ff9a7700 1 -- 172.21.15.46:0/4195827643 >> 172.21.15.46:0/4195827643 conn(0x7f23f8075130 msgr2=0x7f23f8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.356+0000 7f23ff9a7700 1 -- 172.21.15.46:0/4195827643 shutdown_connections 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.356+0000 7f23ff9a7700 1 -- 172.21.15.46:0/4195827643 wait complete. 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23ff9a7700 1 Processor -- start 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23ff9a7700 1 -- start start 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23ff9a7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80687a0 0x7f23f8195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:58.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23ff9a7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23f8069140 0x7f23f81964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:58.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23ff9a7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f8196b80 con 0x7f23f80687a0 2024-02-19T19:07:58.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23ff9a7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f819a910 con 0x7f23f8069140 2024-02-19T19:07:58.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23fd743700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80687a0 0x7f23f8195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:58.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23fd743700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80687a0 0x7f23f8195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45620/0 (socket says 172.21.15.46:45620) 2024-02-19T19:07:58.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23fd743700 1 -- 172.21.15.46:0/3859083705 learned_addr learned my addr 172.21.15.46:0/3859083705 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23fcf42700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23f8069140 0x7f23f81964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23fd743700 1 -- 172.21.15.46:0/3859083705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23f8069140 msgr2=0x7f23f81964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23fd743700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23f8069140 0x7f23f81964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23fd743700 1 -- 172.21.15.46:0/3859083705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f40095f0 con 0x7f23f80687a0 2024-02-19T19:07:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23fcf42700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23f8069140 0x7f23f81964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:07:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.357+0000 7f23fd743700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80687a0 0x7f23f8195f60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f23f4006010 tx=0x7f23f400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.358+0000 7f23ee7fc700 1 -- 172.21.15.46:0/3859083705 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23f401d070 con 0x7f23f80687a0 2024-02-19T19:07:58.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.358+0000 7f23ee7fc700 1 -- 172.21.15.46:0/3859083705 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23f4004fb0 con 0x7f23f80687a0 2024-02-19T19:07:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.358+0000 7f23ff9a7700 1 -- 172.21.15.46:0/3859083705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f819ab90 con 0x7f23f80687a0 2024-02-19T19:07:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.358+0000 7f23ee7fc700 1 -- 172.21.15.46:0/3859083705 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23f4022ea0 con 0x7f23f80687a0 2024-02-19T19:07:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.358+0000 7f23ff9a7700 1 -- 172.21.15.46:0/3859083705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f819b080 con 0x7f23f80687a0 2024-02-19T19:07:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.359+0000 7f23ff9a7700 1 -- 172.21.15.46:0/3859083705 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f8108790 con 0x7f23f80687a0 2024-02-19T19:07:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.359+0000 7f23ee7fc700 1 -- 172.21.15.46:0/3859083705 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f23f4022470 con 0x7f23f80687a0 2024-02-19T19:07:58.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.360+0000 7f23ee7fc700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f23e406d8a0 0x7f23e406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:58.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.360+0000 7f23ee7fc700 1 -- 172.21.15.46:0/3859083705 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f23f408ec90 con 0x7f23f80687a0 2024-02-19T19:07:58.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.360+0000 7f23fcf42700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f23e406d8a0 0x7f23e406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:58.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.360+0000 7f23fcf42700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f23e406d8a0 0x7f23e406fd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23f8197580 tx=0x7f23e8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:58.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.367+0000 7f23ee7fc700 1 -- 172.21.15.46:0/3859083705 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f23f4058630 con 0x7f23f80687a0 2024-02-19T19:07:58.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.698+0000 7f23ff9a7700 1 -- 172.21.15.46:0/3859083705 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23f819b2f0 con 0x7f23e406d8a0 2024-02-19T19:07:58.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.700+0000 7f23ee7fc700 1 -- 172.21.15.46:0/3859083705 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f23f819b2f0 con 0x7f23e406d8a0 2024-02-19T19:07:58.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 -- 172.21.15.46:0/3859083705 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f23e406d8a0 msgr2=0x7f23e406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:58.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f23e406d8a0 0x7f23e406fd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23f8197580 tx=0x7f23e8008040 comp rx=0 tx=0).stop 2024-02-19T19:07:58.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 -- 172.21.15.46:0/3859083705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80687a0 msgr2=0x7f23f8195f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:58.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80687a0 0x7f23f8195f60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f23f4006010 tx=0x7f23f400be20 comp rx=0 tx=0).stop 2024-02-19T19:07:58.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 -- 172.21.15.46:0/3859083705 shutdown_connections 2024-02-19T19:07:58.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f23e406d8a0 0x7f23e406fd50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23f80687a0 0x7f23f8195f60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 --2- 172.21.15.46:0/3859083705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23f8069140 0x7f23f81964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 -- 172.21.15.46:0/3859083705 >> 172.21.15.46:0/3859083705 conn(0x7f23f8075130 msgr2=0x7f23f80fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:58.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 -- 172.21.15.46:0/3859083705 shutdown_connections 2024-02-19T19:07:58.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.703+0000 7f23ff9a7700 1 -- 172.21.15.46:0/3859083705 wait complete. 2024-02-19T19:07:58.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.852+0000 7f53947c9700 1 -- 172.21.15.46:0/1914148897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f538c0ffbd0 msgr2=0x7f538c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:58.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.852+0000 7f53947c9700 1 --2- 172.21.15.46:0/1914148897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f538c0ffbd0 0x7f538c100040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f537c009910 tx=0x7f537c009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:58.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.853+0000 7f53947c9700 1 -- 172.21.15.46:0/1914148897 shutdown_connections 2024-02-19T19:07:58.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.853+0000 7f53947c9700 1 --2- 172.21.15.46:0/1914148897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f538c0ffbd0 0x7f538c100040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.853+0000 7f53947c9700 1 --2- 172.21.15.46:0/1914148897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c104130 0x7f538c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.853+0000 7f53947c9700 1 -- 172.21.15.46:0/1914148897 >> 172.21.15.46:0/1914148897 conn(0x7f538c075130 msgr2=0x7f538c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:58.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.853+0000 7f53947c9700 1 -- 172.21.15.46:0/1914148897 shutdown_connections 2024-02-19T19:07:58.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.853+0000 7f53947c9700 1 -- 172.21.15.46:0/1914148897 wait complete. 2024-02-19T19:07:58.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.853+0000 7f53947c9700 1 Processor -- start 2024-02-19T19:07:58.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.853+0000 7f53947c9700 1 -- start start 2024-02-19T19:07:58.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f53947c9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c0ffbd0 0x7f538c195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:58.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f53947c9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f538c104130 0x7f538c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:58.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f53947c9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c196a90 con 0x7f538c104130 2024-02-19T19:07:58.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f53947c9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c19a820 con 0x7f538c0ffbd0 2024-02-19T19:07:58.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f5391d64700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f538c104130 0x7f538c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f5391d64700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f538c104130 0x7f538c1963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45634/0 (socket says 172.21.15.46:45634) 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f5391d64700 1 -- 172.21.15.46:0/3774664688 learned_addr learned my addr 172.21.15.46:0/3774664688 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f5392565700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c0ffbd0 0x7f538c195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f5391d64700 1 -- 172.21.15.46:0/3774664688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c0ffbd0 msgr2=0x7f538c195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f5391d64700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c0ffbd0 0x7f538c195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f5391d64700 1 -- 172.21.15.46:0/3774664688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c0095f0 con 0x7f538c104130 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f5392565700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c0ffbd0 0x7f538c195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.854+0000 7f5391d64700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f538c104130 0x7f538c1963b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f537c00b7d0 tx=0x7f537c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.855+0000 7f53837fe700 1 -- 172.21.15.46:0/3774664688 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f537c01d070 con 0x7f538c104130 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.855+0000 7f53837fe700 1 -- 172.21.15.46:0/3774664688 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f537c0052a0 con 0x7f538c104130 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.855+0000 7f53947c9700 1 -- 172.21.15.46:0/3774664688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c19aaa0 con 0x7f538c104130 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.855+0000 7f53837fe700 1 -- 172.21.15.46:0/3774664688 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f537c022470 con 0x7f538c104130 2024-02-19T19:07:58.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.855+0000 7f53947c9700 1 -- 172.21.15.46:0/3774664688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c19af90 con 0x7f538c104130 2024-02-19T19:07:58.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.856+0000 7f53947c9700 1 -- 172.21.15.46:0/3774664688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c1086a0 con 0x7f538c104130 2024-02-19T19:07:58.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.856+0000 7f53837fe700 1 -- 172.21.15.46:0/3774664688 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f537c00f850 con 0x7f538c104130 2024-02-19T19:07:58.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.857+0000 7f53837fe700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f537806d8a0 0x7f537806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:58.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.857+0000 7f53837fe700 1 -- 172.21.15.46:0/3774664688 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f537c08e950 con 0x7f538c104130 2024-02-19T19:07:58.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.857+0000 7f5392565700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f537806d8a0 0x7f537806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:58.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.857+0000 7f5392565700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f537806d8a0 0x7f537806fd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5388011490 tx=0x7f5388009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:58.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:58.862+0000 7f53837fe700 1 -- 172.21.15.46:0/3774664688 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f537c058120 con 0x7f538c104130 2024-02-19T19:07:58.972 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:58 smithi046 ceph-mon[88928]: pgmap v102: 65 pgs: 65 active+clean; 158 MiB data, 957 MiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 150 op/s; 14 MiB/s, 7 objects/s recovering 2024-02-19T19:07:58.972 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:58.972 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:58.972 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:58 smithi046 ceph-mon[88928]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:59.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.132+0000 7f53947c9700 1 -- 172.21.15.46:0/3774664688 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f538c19b2d0 con 0x7f537806d8a0 2024-02-19T19:07:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.147+0000 7f53837fe700 1 -- 172.21.15.46:0/3774664688 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f538c19b2d0 con 0x7f537806d8a0 2024-02-19T19:07:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:07:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (4m) 16s ago 14m 26.2M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:07:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (14m) 16s ago 14m 8312k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:07:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (13m) 79s ago 13m 7960k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:07:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (88s) 16s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:07:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (83s) 79s ago 13m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:07:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (3m) 16s ago 13m 87.3M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:07:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (8m) 16s ago 8m 113M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:07:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (8m) 16s ago 8m 16.6M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:07:59.169 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (8m) 79s ago 8m 16.6M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (8m) 79s ago 8m 25.4M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (5m) 16s ago 16m 504M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (5m) 79s ago 13m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (2m) 16s ago 16m 47.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (2m) 79s ago 12m 34.1M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (5m) 16s ago 14m 17.0M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (4m) 79s ago 13m 16.8M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (60s) 16s ago 12m 158M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (24s) 16s ago 11m 12.8M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 974e56511c36 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (11m) 16s ago 11m 173M 1217M 18.2.0 dc2bc1663786 645ebc798db3 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (10m) 79s ago 10m 49.8M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (10m) 79s ago 10m 47.8M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (10m) 79s ago 10m 48.8M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:07:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (4m) 16s ago 13m 63.5M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:07:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 -- 172.21.15.46:0/3774664688 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f537806d8a0 msgr2=0x7f537806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f537806d8a0 0x7f537806fd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5388011490 tx=0x7f5388009260 comp rx=0 tx=0).stop 2024-02-19T19:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 -- 172.21.15.46:0/3774664688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f538c104130 msgr2=0x7f538c1963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f538c104130 0x7f538c1963b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f537c00b7d0 tx=0x7f537c00bf90 comp rx=0 tx=0).stop 2024-02-19T19:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 -- 172.21.15.46:0/3774664688 shutdown_connections 2024-02-19T19:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f537806d8a0 0x7f537806fd50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c0ffbd0 0x7f538c195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 --2- 172.21.15.46:0/3774664688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f538c104130 0x7f538c1963b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 -- 172.21.15.46:0/3774664688 >> 172.21.15.46:0/3774664688 conn(0x7f538c075130 msgr2=0x7f538c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 -- 172.21.15.46:0/3774664688 shutdown_connections 2024-02-19T19:07:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.149+0000 7f53947c9700 1 -- 172.21.15.46:0/3774664688 wait complete. 2024-02-19T19:07:59.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:58 smithi142 ceph-mon[69118]: pgmap v102: 65 pgs: 65 active+clean; 158 MiB data, 957 MiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 150 op/s; 14 MiB/s, 7 objects/s recovering 2024-02-19T19:07:59.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:07:59.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:59.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:58 smithi142 ceph-mon[69118]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:59.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.287+0000 7f9ec382b700 1 -- 172.21.15.46:0/2047584291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ebc0ff220 msgr2=0x7f9ebc0ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:59.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.287+0000 7f9ec382b700 1 --2- 172.21.15.46:0/2047584291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ebc0ff220 0x7f9ebc0ff690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009910 tx=0x7f9eac009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:59.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.287+0000 7f9ec382b700 1 -- 172.21.15.46:0/2047584291 shutdown_connections 2024-02-19T19:07:59.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.287+0000 7f9ec382b700 1 --2- 172.21.15.46:0/2047584291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ebc0ff220 0x7f9ebc0ff690 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.287+0000 7f9ec382b700 1 --2- 172.21.15.46:0/2047584291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ebc104870 0x7f9ebc104c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.287+0000 7f9ec382b700 1 -- 172.21.15.46:0/2047584291 >> 172.21.15.46:0/2047584291 conn(0x7f9ebc0747e0 msgr2=0x7f9ebc074be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:59.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.288+0000 7f9ec382b700 1 -- 172.21.15.46:0/2047584291 shutdown_connections 2024-02-19T19:07:59.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.288+0000 7f9ec382b700 1 -- 172.21.15.46:0/2047584291 wait complete. 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.288+0000 7f9ec382b700 1 Processor -- start 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.288+0000 7f9ec382b700 1 -- start start 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec382b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ebc0ff220 0x7f9ebc19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec382b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ebc104870 0x7f9ebc19bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec382b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc19c610 con 0x7f9ebc0ff220 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec382b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc195ac0 con 0x7f9ebc104870 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec15c7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ebc0ff220 0x7f9ebc19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec15c7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ebc0ff220 0x7f9ebc19ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45650/0 (socket says 172.21.15.46:45650) 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec15c7700 1 -- 172.21.15.46:0/787032268 learned_addr learned my addr 172.21.15.46:0/787032268 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec0dc6700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ebc104870 0x7f9ebc19bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec15c7700 1 -- 172.21.15.46:0/787032268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ebc104870 msgr2=0x7f9ebc19bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:59.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec15c7700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ebc104870 0x7f9ebc19bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec15c7700 1 -- 172.21.15.46:0/787032268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0095f0 con 0x7f9ebc0ff220 2024-02-19T19:07:59.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec0dc6700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ebc104870 0x7f9ebc19bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:07:59.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.289+0000 7f9ec15c7700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ebc0ff220 0x7f9ebc19ba40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800c300 tx=0x7f9eb800c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:59.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.290+0000 7f9eb27fc700 1 -- 172.21.15.46:0/787032268 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb800f070 con 0x7f9ebc0ff220 2024-02-19T19:07:59.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.290+0000 7f9ec382b700 1 -- 172.21.15.46:0/787032268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc195da0 con 0x7f9ebc0ff220 2024-02-19T19:07:59.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.290+0000 7f9eb27fc700 1 -- 172.21.15.46:0/787032268 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9eb800a2a0 con 0x7f9ebc0ff220 2024-02-19T19:07:59.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.290+0000 7f9eb27fc700 1 -- 172.21.15.46:0/787032268 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb8005020 con 0x7f9ebc0ff220 2024-02-19T19:07:59.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.290+0000 7f9ec382b700 1 -- 172.21.15.46:0/787032268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc1962a0 con 0x7f9ebc0ff220 2024-02-19T19:07:59.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.291+0000 7f9ec382b700 1 -- 172.21.15.46:0/787032268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc04f2a0 con 0x7f9ebc0ff220 2024-02-19T19:07:59.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.292+0000 7f9eb27fc700 1 -- 172.21.15.46:0/787032268 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9eb8004ad0 con 0x7f9ebc0ff220 2024-02-19T19:07:59.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.292+0000 7f9eb27fc700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9ea806d8a0 0x7f9ea806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:59.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.292+0000 7f9eb27fc700 1 -- 172.21.15.46:0/787032268 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f9eb808d3d0 con 0x7f9ebc0ff220 2024-02-19T19:07:59.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.292+0000 7f9ec0dc6700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9ea806d8a0 0x7f9ea806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:59.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.293+0000 7f9ec0dc6700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9ea806d8a0 0x7f9ea806fd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0059d0 tx=0x7f9eac01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:59.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.297+0000 7f9eb27fc700 1 -- 172.21.15.46:0/787032268 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9eb805a650 con 0x7f9ebc0ff220 2024-02-19T19:07:59.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.677+0000 7f9ec382b700 1 -- 172.21.15.46:0/787032268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ebc196790 con 0x7f9ebc0ff220 2024-02-19T19:07:59.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.677+0000 7f9eb27fc700 1 -- 172.21.15.46:0/787032268 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f9eb805a1e0 con 0x7f9ebc0ff220 2024-02-19T19:07:59.699 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:07:59.699 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:07:59.700 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-02-19T19:07:59.701 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:07:59.701 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:07:59.701 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 -- 172.21.15.46:0/787032268 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9ea806d8a0 msgr2=0x7f9ea806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9ea806d8a0 0x7f9ea806fd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0059d0 tx=0x7f9eac01a040 comp rx=0 tx=0).stop 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 -- 172.21.15.46:0/787032268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ebc0ff220 msgr2=0x7f9ebc19ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ebc0ff220 0x7f9ebc19ba40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800c300 tx=0x7f9eb800c6c0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 -- 172.21.15.46:0/787032268 shutdown_connections 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9ea806d8a0 0x7f9ea806fd50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ebc0ff220 0x7f9ebc19ba40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 --2- 172.21.15.46:0/787032268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ebc104870 0x7f9ebc19bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 -- 172.21.15.46:0/787032268 >> 172.21.15.46:0/787032268 conn(0x7f9ebc0747e0 msgr2=0x7f9ebc0fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 -- 172.21.15.46:0/787032268 shutdown_connections 2024-02-19T19:07:59.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.680+0000 7f9ec382b700 1 -- 172.21.15.46:0/787032268 wait complete. 2024-02-19T19:07:59.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.801+0000 7fb49854d700 1 -- 172.21.15.46:0/399218204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb490100ed0 msgr2=0x7fb490104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:59.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.801+0000 7fb49854d700 1 --2- 172.21.15.46:0/399218204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb490100ed0 0x7fb490104ea0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb480009910 tx=0x7fb480009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:59.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.801+0000 7fb49854d700 1 -- 172.21.15.46:0/399218204 shutdown_connections 2024-02-19T19:07:59.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.801+0000 7fb49854d700 1 --2- 172.21.15.46:0/399218204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb490100ed0 0x7fb490104ea0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.801+0000 7fb49854d700 1 --2- 172.21.15.46:0/399218204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb490100530 0x7fb490100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.801+0000 7fb49854d700 1 -- 172.21.15.46:0/399218204 >> 172.21.15.46:0/399218204 conn(0x7fb4900fbe10 msgr2=0x7fb4900fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:59.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.801+0000 7fb49854d700 1 -- 172.21.15.46:0/399218204 shutdown_connections 2024-02-19T19:07:59.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.801+0000 7fb49854d700 1 -- 172.21.15.46:0/399218204 wait complete. 2024-02-19T19:07:59.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.802+0000 7fb49854d700 1 Processor -- start 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.802+0000 7fb49854d700 1 -- start start 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.802+0000 7fb49854d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb490100530 0x7fb490073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.802+0000 7fb49854d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb490100ed0 0x7fb490073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.802+0000 7fb49854d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb490073ad0 con 0x7fb490100530 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.802+0000 7fb49854d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb490073c10 con 0x7fb490100ed0 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.802+0000 7fb4962e9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb490100530 0x7fb490073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.802+0000 7fb4962e9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb490100530 0x7fb490073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45670/0 (socket says 172.21.15.46:45670) 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.802+0000 7fb4962e9700 1 -- 172.21.15.46:0/2417874550 learned_addr learned my addr 172.21.15.46:0/2417874550 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.802+0000 7fb495ae8700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb490100ed0 0x7fb490073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.803+0000 7fb4962e9700 1 -- 172.21.15.46:0/2417874550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb490100ed0 msgr2=0x7fb490073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.803+0000 7fb4962e9700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb490100ed0 0x7fb490073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.803+0000 7fb4962e9700 1 -- 172.21.15.46:0/2417874550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800095f0 con 0x7fb490100530 2024-02-19T19:07:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.803+0000 7fb4962e9700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb490100530 0x7fb490073050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00e920 tx=0x7fb48c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.803+0000 7fb4877fe700 1 -- 172.21.15.46:0/2417874550 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48c00c9d0 con 0x7fb490100530 2024-02-19T19:07:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.803+0000 7fb49854d700 1 -- 172.21.15.46:0/2417874550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4901a20c0 con 0x7fb490100530 2024-02-19T19:07:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.803+0000 7fb4877fe700 1 -- 172.21.15.46:0/2417874550 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb48c010430 con 0x7fb490100530 2024-02-19T19:07:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.803+0000 7fb4877fe700 1 -- 172.21.15.46:0/2417874550 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48c018630 con 0x7fb490100530 2024-02-19T19:07:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.803+0000 7fb49854d700 1 -- 172.21.15.46:0/2417874550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4901a2470 con 0x7fb490100530 2024-02-19T19:07:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.804+0000 7fb49854d700 1 -- 172.21.15.46:0/2417874550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4901088a0 con 0x7fb490100530 2024-02-19T19:07:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.805+0000 7fb4877fe700 1 -- 172.21.15.46:0/2417874550 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb48c0105a0 con 0x7fb490100530 2024-02-19T19:07:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.805+0000 7fb4877fe700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47c06d8a0 0x7fb47c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.805+0000 7fb4877fe700 1 -- 172.21.15.46:0/2417874550 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fb48c014070 con 0x7fb490100530 2024-02-19T19:07:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.806+0000 7fb495ae8700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47c06d8a0 0x7fb47c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.806+0000 7fb495ae8700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47c06d8a0 0x7fb47c06fd50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4800059d0 tx=0x7fb480005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:59.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:07:59.810+0000 7fb4877fe700 1 -- 172.21.15.46:0/2417874550 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb48c052d20 con 0x7fb490100530 2024-02-19T19:08:00.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:59 smithi046 ceph-mon[88928]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:00.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:59 smithi046 ceph-mon[88928]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:00.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:07:59 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/787032268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:00.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.136+0000 7fb49854d700 1 -- 172.21.15.46:0/2417874550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb4900746c0 con 0x7fb490100530 2024-02-19T19:08:00.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.137+0000 7fb4877fe700 1 -- 172.21.15.46:0/2417874550 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1873 (secure 0 0 0) 0x7fb48c056fa0 con 0x7fb490100530 2024-02-19T19:08:00.160 INFO:teuthology.orchestra.run.smithi046.stdout:e18 2024-02-19T19:08:00.160 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:08:00.160 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:08:00.160 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:08:00.160 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:08:00.160 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:08:00.160 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:08:00.160 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 18 2024-02-19T19:08:00.160 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T19:07:04.634090+0000 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:08:00.161 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:00.162 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:08:00.163 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:08:00.163 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:08:00.163 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:08:00.163 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:00.163 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 -- 172.21.15.46:0/2417874550 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47c06d8a0 msgr2=0x7fb47c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47c06d8a0 0x7fb47c06fd50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4800059d0 tx=0x7fb480005940 comp rx=0 tx=0).stop 2024-02-19T19:08:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 -- 172.21.15.46:0/2417874550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb490100530 msgr2=0x7fb490073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb490100530 0x7fb490073050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00e920 tx=0x7fb48c00ec30 comp rx=0 tx=0).stop 2024-02-19T19:08:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 -- 172.21.15.46:0/2417874550 shutdown_connections 2024-02-19T19:08:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47c06d8a0 0x7fb47c06fd50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb490100530 0x7fb490073050 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 --2- 172.21.15.46:0/2417874550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb490100ed0 0x7fb490073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 -- 172.21.15.46:0/2417874550 >> 172.21.15.46:0/2417874550 conn(0x7fb4900fbe10 msgr2=0x7fb4900fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 -- 172.21.15.46:0/2417874550 shutdown_connections 2024-02-19T19:08:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.140+0000 7fb49854d700 1 -- 172.21.15.46:0/2417874550 wait complete. 2024-02-19T19:08:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-02-19T19:08:00.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:59 smithi142 ceph-mon[69118]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:00.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:59 smithi142 ceph-mon[69118]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:00.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:07:59 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/787032268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.250+0000 7f2102ec2700 1 -- 172.21.15.46:0/3253929378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0ff3c0 msgr2=0x7f20fc0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.250+0000 7f2102ec2700 1 --2- 172.21.15.46:0/3253929378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0ff3c0 0x7f20fc0ff790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009910 tx=0x7f20ec009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.250+0000 7f2102ec2700 1 -- 172.21.15.46:0/3253929378 shutdown_connections 2024-02-19T19:08:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.250+0000 7f2102ec2700 1 --2- 172.21.15.46:0/3253929378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc0ffd60 0x7f20fc103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.250+0000 7f2102ec2700 1 --2- 172.21.15.46:0/3253929378 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0ff3c0 0x7f20fc0ff790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.250+0000 7f2102ec2700 1 -- 172.21.15.46:0/3253929378 >> 172.21.15.46:0/3253929378 conn(0x7f20fc0fac80 msgr2=0x7f20fc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.250+0000 7f2102ec2700 1 -- 172.21.15.46:0/3253929378 shutdown_connections 2024-02-19T19:08:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.250+0000 7f2102ec2700 1 -- 172.21.15.46:0/3253929378 wait complete. 2024-02-19T19:08:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.250+0000 7f2102ec2700 1 Processor -- start 2024-02-19T19:08:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f2102ec2700 1 -- start start 2024-02-19T19:08:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f2102ec2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc0ff3c0 0x7f20fc100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f2102ec2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0ffd60 0x7f20fc101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f2102ec2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc101850 con 0x7f20fc0ffd60 2024-02-19T19:08:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f2102ec2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc101990 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f20fbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0ffd60 0x7f20fc101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f20fbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0ffd60 0x7f20fc101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45692/0 (socket says 172.21.15.46:45692) 2024-02-19T19:08:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f20fbfff700 1 -- 172.21.15.46:0/1566576946 learned_addr learned my addr 172.21.15.46:0/1566576946 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:08:00.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f2100c5e700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc0ff3c0 0x7f20fc100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f2100c5e700 1 -- 172.21.15.46:0/1566576946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0ffd60 msgr2=0x7f20fc101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f2100c5e700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0ffd60 0x7f20fc101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f2100c5e700 1 -- 172.21.15.46:0/1566576946 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0095f0 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f20fbfff700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0ffd60 0x7f20fc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:08:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.251+0000 7f2100c5e700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc0ff3c0 0x7f20fc100dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009fd0 tx=0x7f20ec00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.252+0000 7f20f9ffb700 1 -- 172.21.15.46:0/1566576946 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20ec01d070 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.252+0000 7f2102ec2700 1 -- 172.21.15.46:0/1566576946 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc101c10 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.252+0000 7f20f9ffb700 1 -- 172.21.15.46:0/1566576946 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20ec00b610 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.252+0000 7f20f9ffb700 1 -- 172.21.15.46:0/1566576946 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20ec022470 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.252+0000 7f2102ec2700 1 -- 172.21.15.46:0/1566576946 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc1a2400 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.253+0000 7f2102ec2700 1 -- 172.21.15.46:0/1566576946 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc04f2a0 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.253+0000 7f20f9ffb700 1 -- 172.21.15.46:0/1566576946 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f20ec0050d0 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.254+0000 7f20f9ffb700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f20e406d8a0 0x7f20e406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.254+0000 7f20f9ffb700 1 -- 172.21.15.46:0/1566576946 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f20ec08e9f0 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.254+0000 7f20fbfff700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f20e406d8a0 0x7f20e406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.254+0000 7f20fbfff700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f20e406d8a0 0x7f20e406fd50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f20fc1025c0 tx=0x7f20f0009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.260+0000 7f20f9ffb700 1 -- 172.21.15.46:0/1566576946 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f20ec090e60 con 0x7f20fc0ff3c0 2024-02-19T19:08:00.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.550+0000 7f2102ec2700 1 -- 172.21.15.46:0/1566576946 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f20fc0fb9f0 con 0x7f20e406d8a0 2024-02-19T19:08:00.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.552+0000 7f20f9ffb700 1 -- 172.21.15.46:0/1566576946 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f20fc0fb9f0 con 0x7f20e406d8a0 2024-02-19T19:08:00.574 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:08:00.574 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:08:00.574 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:08:00.574 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:08:00.574 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:08:00.574 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:08:00.574 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-02-19T19:08:00.574 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:08:00.574 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:08:00.575 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "8/23 daemons upgraded", 2024-02-19T19:08:00.575 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:08:00.575 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:08:00.575 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.555+0000 7f2102ec2700 1 -- 172.21.15.46:0/1566576946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f20e406d8a0 msgr2=0x7f20e406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.555+0000 7f2102ec2700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f20e406d8a0 0x7f20e406fd50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f20fc1025c0 tx=0x7f20f0009260 comp rx=0 tx=0).stop 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.555+0000 7f2102ec2700 1 -- 172.21.15.46:0/1566576946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc0ff3c0 msgr2=0x7f20fc100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.555+0000 7f2102ec2700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc0ff3c0 0x7f20fc100dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009fd0 tx=0x7f20ec00f690 comp rx=0 tx=0).stop 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.556+0000 7f2102ec2700 1 -- 172.21.15.46:0/1566576946 shutdown_connections 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.556+0000 7f2102ec2700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f20e406d8a0 0x7f20e406fd50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.556+0000 7f2102ec2700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20fc0ff3c0 0x7f20fc100dd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.556+0000 7f2102ec2700 1 --2- 172.21.15.46:0/1566576946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20fc0ffd60 0x7f20fc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.556+0000 7f2102ec2700 1 -- 172.21.15.46:0/1566576946 >> 172.21.15.46:0/1566576946 conn(0x7f20fc0fac80 msgr2=0x7f20fc1034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.556+0000 7f2102ec2700 1 -- 172.21.15.46:0/1566576946 shutdown_connections 2024-02-19T19:08:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.556+0000 7f2102ec2700 1 -- 172.21.15.46:0/1566576946 wait complete. 2024-02-19T19:08:00.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.667+0000 7f590462b700 1 -- 172.21.15.46:0/3518732527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58fc1012f0 msgr2=0x7f58fc1016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:00.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.667+0000 7f590462b700 1 --2- 172.21.15.46:0/3518732527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58fc1012f0 0x7f58fc1016c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009910 tx=0x7f58f8009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:00.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.667+0000 7f590462b700 1 -- 172.21.15.46:0/3518732527 shutdown_connections 2024-02-19T19:08:00.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.667+0000 7f590462b700 1 --2- 172.21.15.46:0/3518732527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc101c00 0x7f58fc10a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.667+0000 7f590462b700 1 --2- 172.21.15.46:0/3518732527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58fc1012f0 0x7f58fc1016c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.667+0000 7f590462b700 1 -- 172.21.15.46:0/3518732527 >> 172.21.15.46:0/3518732527 conn(0x7f58fc0fac60 msgr2=0x7f58fc0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:00.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.667+0000 7f590462b700 1 -- 172.21.15.46:0/3518732527 shutdown_connections 2024-02-19T19:08:00.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.667+0000 7f590462b700 1 -- 172.21.15.46:0/3518732527 wait complete. 2024-02-19T19:08:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.667+0000 7f590462b700 1 Processor -- start 2024-02-19T19:08:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.667+0000 7f590462b700 1 -- start start 2024-02-19T19:08:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f590462b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc1012f0 0x7f58fc195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f590462b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58fc101c00 0x7f58fc196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f590462b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc196a50 con 0x7f58fc101c00 2024-02-19T19:08:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f590462b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc196b90 con 0x7f58fc1012f0 2024-02-19T19:08:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f5901bc6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58fc101c00 0x7f58fc196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f5901bc6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58fc101c00 0x7f58fc196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45712/0 (socket says 172.21.15.46:45712) 2024-02-19T19:08:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f59023c7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc1012f0 0x7f58fc195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f5901bc6700 1 -- 172.21.15.46:0/3253786681 learned_addr learned my addr 172.21.15.46:0/3253786681 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:08:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f5901bc6700 1 -- 172.21.15.46:0/3253786681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc1012f0 msgr2=0x7f58fc195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f5901bc6700 1 --2- 172.21.15.46:0/3253786681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc1012f0 0x7f58fc195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f5901bc6700 1 -- 172.21.15.46:0/3253786681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f80095f0 con 0x7f58fc101c00 2024-02-19T19:08:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.668+0000 7f5901bc6700 1 --2- 172.21.15.46:0/3253786681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58fc101c00 0x7f58fc196400 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00c930 tx=0x7f58ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.669+0000 7f58f37fe700 1 -- 172.21.15.46:0/3253786681 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58ec007ad0 con 0x7f58fc101c00 2024-02-19T19:08:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.669+0000 7f58f37fe700 1 -- 172.21.15.46:0/3253786681 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58ec00ce80 con 0x7f58fc101c00 2024-02-19T19:08:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.669+0000 7f590462b700 1 -- 172.21.15.46:0/3253786681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc19a990 con 0x7f58fc101c00 2024-02-19T19:08:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.669+0000 7f58f37fe700 1 -- 172.21.15.46:0/3253786681 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58ec018630 con 0x7f58fc101c00 2024-02-19T19:08:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.669+0000 7f590462b700 1 -- 172.21.15.46:0/3253786681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc19aee0 con 0x7f58fc101c00 2024-02-19T19:08:00.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.670+0000 7f590462b700 1 -- 172.21.15.46:0/3253786681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc107970 con 0x7f58fc101c00 2024-02-19T19:08:00.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.670+0000 7f58f37fe700 1 -- 172.21.15.46:0/3253786681 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f58ec007c30 con 0x7f58fc101c00 2024-02-19T19:08:00.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.671+0000 7f58f37fe700 1 --2- 172.21.15.46:0/3253786681 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58e806d8a0 0x7f58e806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:00.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.671+0000 7f58f37fe700 1 -- 172.21.15.46:0/3253786681 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f58ec08d5c0 con 0x7f58fc101c00 2024-02-19T19:08:00.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.671+0000 7f59023c7700 1 --2- 172.21.15.46:0/3253786681 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58e806d8a0 0x7f58e806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:00.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.671+0000 7f59023c7700 1 --2- 172.21.15.46:0/3253786681 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58e806d8a0 0x7f58e806fd50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f58f8006010 tx=0x7f58f801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:00.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:00.676+0000 7f58f37fe700 1 -- 172.21.15.46:0/3253786681 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f58ec056d10 con 0x7f58fc101c00 2024-02-19T19:08:00.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:00 smithi046 ceph-mon[88928]: pgmap v103: 65 pgs: 65 active+clean; 167 MiB data, 890 MiB used, 536 GiB / 536 GiB avail; 21 KiB/s rd, 2.6 MiB/s wr, 205 op/s; 12 MiB/s, 6 objects/s recovering 2024-02-19T19:08:00.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:00 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2417874550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:08:00.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:00 smithi046 ceph-mon[88928]: from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:01.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.131+0000 7f590462b700 1 -- 172.21.15.46:0/3253786681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f58fc04f2a0 con 0x7f58fc101c00 2024-02-19T19:08:01.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.133+0000 7f58f37fe700 1 -- 172.21.15.46:0/3253786681 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f58ec05a3d0 con 0x7f58fc101c00 2024-02-19T19:08:01.156 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_OK 2024-02-19T19:08:01.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.138+0000 7f590462b700 1 -- 172.21.15.46:0/3253786681 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58e806d8a0 msgr2=0x7f58e806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:01.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.138+0000 7f590462b700 1 --2- 172.21.15.46:0/3253786681 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58e806d8a0 0x7f58e806fd50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f58f8006010 tx=0x7f58f801a040 comp rx=0 tx=0).stop 2024-02-19T19:08:01.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.138+0000 7f590462b700 1 -- 172.21.15.46:0/3253786681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58fc101c00 msgr2=0x7f58fc196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:01.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.138+0000 7f590462b700 1 --2- 172.21.15.46:0/3253786681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58fc101c00 0x7f58fc196400 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00c930 tx=0x7f58ec00cc40 comp rx=0 tx=0).stop 2024-02-19T19:08:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.140+0000 7f590462b700 1 -- 172.21.15.46:0/3253786681 shutdown_connections 2024-02-19T19:08:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.140+0000 7f590462b700 1 --2- 172.21.15.46:0/3253786681 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58e806d8a0 0x7f58e806fd50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.140+0000 7f590462b700 1 --2- 172.21.15.46:0/3253786681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58fc1012f0 0x7f58fc195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.140+0000 7f590462b700 1 --2- 172.21.15.46:0/3253786681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58fc101c00 0x7f58fc196400 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.140+0000 7f590462b700 1 -- 172.21.15.46:0/3253786681 >> 172.21.15.46:0/3253786681 conn(0x7f58fc0fac60 msgr2=0x7f58fc104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.140+0000 7f590462b700 1 -- 172.21.15.46:0/3253786681 shutdown_connections 2024-02-19T19:08:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:01.140+0000 7f590462b700 1 -- 172.21.15.46:0/3253786681 wait complete. 2024-02-19T19:08:01.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:00 smithi142 ceph-mon[69118]: pgmap v103: 65 pgs: 65 active+clean; 167 MiB data, 890 MiB used, 536 GiB / 536 GiB avail; 21 KiB/s rd, 2.6 MiB/s wr, 205 op/s; 12 MiB/s, 6 objects/s recovering 2024-02-19T19:08:01.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:00 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2417874550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:08:01.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:00 smithi142 ceph-mon[69118]: from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:02.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:01 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3253786681' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:08:02.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:01 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3253786681' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:08:03.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:02 smithi046 ceph-mon[88928]: pgmap v104: 65 pgs: 65 active+clean; 167 MiB data, 893 MiB used, 536 GiB / 536 GiB avail; 18 KiB/s rd, 2.0 MiB/s wr, 163 op/s 2024-02-19T19:08:03.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:02 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:03.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:02 smithi142 ceph-mon[69118]: pgmap v104: 65 pgs: 65 active+clean; 167 MiB data, 893 MiB used, 536 GiB / 536 GiB avail; 18 KiB/s rd, 2.0 MiB/s wr, 163 op/s 2024-02-19T19:08:03.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:02 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:04.038 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:03 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:08:04.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:03 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:08:05.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:04 smithi046 ceph-mon[88928]: pgmap v105: 65 pgs: 65 active+clean; 202 MiB data, 990 MiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 5.1 MiB/s wr, 492 op/s 2024-02-19T19:08:05.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:04 smithi046 ceph-mon[88928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:08:05.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:04 smithi046 ceph-mon[88928]: Upgrade: osd.2 is safe to restart 2024-02-19T19:08:05.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:04 smithi142 ceph-mon[69118]: pgmap v105: 65 pgs: 65 active+clean; 202 MiB data, 990 MiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 5.1 MiB/s wr, 492 op/s 2024-02-19T19:08:05.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:04 smithi142 ceph-mon[69118]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:08:05.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:04 smithi142 ceph-mon[69118]: Upgrade: osd.2 is safe to restart 2024-02-19T19:08:06.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:06 smithi142 ceph-mon[69118]: Upgrade: Updating osd.2 2024-02-19T19:08:06.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:06 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:06.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:06 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T19:08:06.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:06 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:06.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:06 smithi142 ceph-mon[69118]: Deploying daemon osd.2 on smithi046 2024-02-19T19:08:06.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:06 smithi142 ceph-mon[69118]: pgmap v106: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.9 KiB/s rd, 4.8 MiB/s wr, 530 op/s 2024-02-19T19:08:07.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:06 smithi046 ceph-mon[88928]: Upgrade: Updating osd.2 2024-02-19T19:08:07.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:06 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:07.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:06 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T19:08:07.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:06 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:07.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:06 smithi046 ceph-mon[88928]: Deploying daemon osd.2 on smithi046 2024-02-19T19:08:07.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:06 smithi046 ceph-mon[88928]: pgmap v106: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.9 KiB/s rd, 4.8 MiB/s wr, 530 op/s 2024-02-19T19:08:08.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:08 smithi046 ceph-mon[88928]: pgmap v107: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.9 KiB/s rd, 4.8 MiB/s wr, 513 op/s 2024-02-19T19:08:09.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:08 smithi142 ceph-mon[69118]: pgmap v107: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.9 KiB/s rd, 4.8 MiB/s wr, 513 op/s 2024-02-19T19:08:09.677 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:09 smithi046 systemd[1]: Stopping Ceph osd.2 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:08:10.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:09 smithi046 ceph-mon[88928]: osd.2 marked itself down and dead 2024-02-19T19:08:10.082 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:09 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[55708]: 2024-02-19T19:08:09.656+0000 7f0eb2858700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:08:10.082 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:09 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[55708]: 2024-02-19T19:08:09.656+0000 7f0eb2858700 -1 osd.2 73 *** Got signal Terminated *** 2024-02-19T19:08:10.082 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:09 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[55708]: 2024-02-19T19:08:09.656+0000 7f0eb2858700 -1 osd.2 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:08:10.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:09 smithi142 ceph-mon[69118]: osd.2 marked itself down and dead 2024-02-19T19:08:10.581 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:10 smithi046 podman[112090]: 2024-02-19 19:08:10.306856569 +0000 UTC m=+0.781358847 container died 645ebc798db364c90a2bcd340f87e110697c0e7f33e992b520fda98a7301d939 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0) 2024-02-19T19:08:10.903 INFO:tasks.workunit.client.0.smithi046.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-19T19:08:10.917 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-19T19:08:10.917 INFO:tasks.workunit.client.0.smithi046.stderr:+ make 2024-02-19T19:08:10.947 INFO:tasks.workunit.client.0.smithi046.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-19T19:08:10.979 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:10 smithi046 ceph-mon[88928]: pgmap v108: 65 pgs: 65 active+clean; 207 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 5.1 MiB/s wr, 620 op/s 2024-02-19T19:08:10.979 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:10 smithi046 ceph-mon[88928]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:08:10.979 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:10 smithi046 ceph-mon[88928]: osdmap e74: 6 total, 5 up, 6 in 2024-02-19T19:08:10.979 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:10 smithi046 podman[112090]: 2024-02-19 19:08:10.690378695 +0000 UTC m=+1.164880974 container cleanup 645ebc798db364c90a2bcd340f87e110697c0e7f33e992b520fda98a7301d939 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-19T19:08:10.979 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:10 smithi046 bash[112090]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2 2024-02-19T19:08:11.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:10 smithi142 ceph-mon[69118]: pgmap v108: 65 pgs: 65 active+clean; 207 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 5.1 MiB/s wr, 620 op/s 2024-02-19T19:08:11.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:10 smithi142 ceph-mon[69118]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:08:11.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:10 smithi142 ceph-mon[69118]: osdmap e74: 6 total, 5 up, 6 in 2024-02-19T19:08:11.276 INFO:tasks.workunit.client.0.smithi046.stderr:++ readlink -f fsstress 2024-02-19T19:08:11.277 INFO:tasks.workunit.client.0.smithi046.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-19T19:08:11.277 INFO:tasks.workunit.client.0.smithi046.stderr:+ popd 2024-02-19T19:08:11.281 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-19T19:08:11.281 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-19T19:08:11.281 INFO:tasks.workunit.client.0.smithi046.stderr:+ popd 2024-02-19T19:08:11.281 INFO:tasks.workunit.client.0.smithi046.stderr:++ mktemp -d -p . 2024-02-19T19:08:11.284 INFO:tasks.workunit.client.0.smithi046.stderr:+ T=./tmp.cMgmsMQCOp 2024-02-19T19:08:11.284 INFO:tasks.workunit.client.0.smithi046.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.cMgmsMQCOp -l 1 -n 1000 -p 10 -v 2024-02-19T19:08:11.285 INFO:tasks.workunit.client.0.smithi046.stdout:seed = 1708632216 2024-02-19T19:08:11.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/0: stat - no entries 2024-02-19T19:08:11.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/1: unlink - no file 2024-02-19T19:08:11.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/2: dwrite - no filename 2024-02-19T19:08:11.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/3: dwrite - no filename 2024-02-19T19:08:11.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/4: write - no filename 2024-02-19T19:08:11.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/5: write - no filename 2024-02-19T19:08:11.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/6: chown . 923744 1 2024-02-19T19:08:11.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/7: write - no filename 2024-02-19T19:08:11.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/8: write - no filename 2024-02-19T19:08:11.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/9: chown . 798 1 2024-02-19T19:08:11.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/10: chown . 3239 1 2024-02-19T19:08:11.289 INFO:tasks.workunit.client.0.smithi046.stdout:1/0: unlink - no file 2024-02-19T19:08:11.289 INFO:tasks.workunit.client.0.smithi046.stdout:1/1: write - no filename 2024-02-19T19:08:11.289 INFO:tasks.workunit.client.0.smithi046.stdout:1/2: fdatasync - no filename 2024-02-19T19:08:11.289 INFO:tasks.workunit.client.0.smithi046.stdout:1/3: write - no filename 2024-02-19T19:08:11.290 INFO:tasks.workunit.client.0.smithi046.stdout:0/11: mkdir d0 0 2024-02-19T19:08:11.292 INFO:tasks.workunit.client.0.smithi046.stdout:1/4: mknod c0 0 2024-02-19T19:08:11.292 INFO:tasks.workunit.client.0.smithi046.stdout:1/5: fdatasync - no filename 2024-02-19T19:08:11.292 INFO:tasks.workunit.client.0.smithi046.stdout:1/6: stat c0 0 2024-02-19T19:08:11.292 INFO:tasks.workunit.client.0.smithi046.stdout:1/7: dread - no filename 2024-02-19T19:08:11.292 INFO:tasks.workunit.client.0.smithi046.stdout:1/8: fsync - no filename 2024-02-19T19:08:11.293 INFO:tasks.workunit.client.0.smithi046.stdout:0/12: creat d0/f1 x:0 0 0 2024-02-19T19:08:11.293 INFO:tasks.workunit.client.0.smithi046.stdout:0/13: creat d0/f2 x:0 0 0 2024-02-19T19:08:11.293 INFO:tasks.workunit.client.0.smithi046.stdout:2/0: symlink l0 0 2024-02-19T19:08:11.293 INFO:tasks.workunit.client.0.smithi046.stdout:2/1: dwrite - no filename 2024-02-19T19:08:11.293 INFO:tasks.workunit.client.0.smithi046.stdout:2/2: write - no filename 2024-02-19T19:08:11.294 INFO:tasks.workunit.client.0.smithi046.stdout:2/3: dwrite - no filename 2024-02-19T19:08:11.295 INFO:tasks.workunit.client.0.smithi046.stdout:3/0: truncate - no filename 2024-02-19T19:08:11.295 INFO:tasks.workunit.client.0.smithi046.stdout:3/1: dwrite - no filename 2024-02-19T19:08:11.296 INFO:tasks.workunit.client.0.smithi046.stdout:1/9: unlink c0 0 2024-02-19T19:08:11.296 INFO:tasks.workunit.client.0.smithi046.stdout:1/10: chown . 290 1 2024-02-19T19:08:11.296 INFO:tasks.workunit.client.0.smithi046.stdout:1/11: readlink - no filename 2024-02-19T19:08:11.296 INFO:tasks.workunit.client.0.smithi046.stdout:1/12: write - no filename 2024-02-19T19:08:11.296 INFO:tasks.workunit.client.0.smithi046.stdout:1/13: dread - no filename 2024-02-19T19:08:11.296 INFO:tasks.workunit.client.0.smithi046.stdout:1/14: readlink - no filename 2024-02-19T19:08:11.296 INFO:tasks.workunit.client.0.smithi046.stdout:1/15: read - no filename 2024-02-19T19:08:11.298 INFO:tasks.workunit.client.0.smithi046.stdout:0/14: link d0/f1 d0/f3 0 2024-02-19T19:08:11.299 INFO:tasks.workunit.client.0.smithi046.stdout:2/4: creat f1 x:0 0 0 2024-02-19T19:08:11.300 INFO:tasks.workunit.client.0.smithi046.stdout:4/0: truncate - no filename 2024-02-19T19:08:11.300 INFO:tasks.workunit.client.0.smithi046.stdout:3/2: symlink l0 0 2024-02-19T19:08:11.302 INFO:tasks.workunit.client.0.smithi046.stdout:2/5: mkdir d2 0 2024-02-19T19:08:11.302 INFO:tasks.workunit.client.0.smithi046.stdout:2/6: readlink l0 0 2024-02-19T19:08:11.303 INFO:tasks.workunit.client.0.smithi046.stdout:2/7: write f1 [964887,123257] 0 2024-02-19T19:08:11.303 INFO:tasks.workunit.client.0.smithi046.stdout:4/1: mknod c0 0 2024-02-19T19:08:11.303 INFO:tasks.workunit.client.0.smithi046.stdout:4/2: read - no filename 2024-02-19T19:08:11.303 INFO:tasks.workunit.client.0.smithi046.stdout:4/3: dwrite - no filename 2024-02-19T19:08:11.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/0: dread - no filename 2024-02-19T19:08:11.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/1: dwrite - no filename 2024-02-19T19:08:11.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/2: write - no filename 2024-02-19T19:08:11.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/3: rename - no filename 2024-02-19T19:08:11.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/4: dread - no filename 2024-02-19T19:08:11.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/5: rmdir - no directory 2024-02-19T19:08:11.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/6: dread - no filename 2024-02-19T19:08:11.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/7: write - no filename 2024-02-19T19:08:11.331 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:10 smithi046 podman[112107]: 2024-02-19 19:08:10.958647281 +0000 UTC m=+0.651891123 container remove 645ebc798db364c90a2bcd340f87e110697c0e7f33e992b520fda98a7301d939 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-19T19:08:11.350 INFO:tasks.workunit.client.0.smithi046.stdout:3/3: rename l0 to l1 0 2024-02-19T19:08:11.350 INFO:tasks.workunit.client.0.smithi046.stdout:4/4: mkdir d1 0 2024-02-19T19:08:11.350 INFO:tasks.workunit.client.0.smithi046.stdout:1/16: getdents . 0 2024-02-19T19:08:11.350 INFO:tasks.workunit.client.0.smithi046.stdout:1/17: chown . 153463 1 2024-02-19T19:08:11.350 INFO:tasks.workunit.client.0.smithi046.stdout:1/18: rename - no filename 2024-02-19T19:08:11.350 INFO:tasks.workunit.client.0.smithi046.stdout:1/19: dread - no filename 2024-02-19T19:08:11.351 INFO:tasks.workunit.client.0.smithi046.stdout:2/8: rmdir d2 0 2024-02-19T19:08:11.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/8: creat f0 x:0 0 0 2024-02-19T19:08:11.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/9: truncate f0 484627 0 2024-02-19T19:08:11.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/10: rmdir - no directory 2024-02-19T19:08:11.355 INFO:tasks.workunit.client.0.smithi046.stdout:6/0: fsync - no filename 2024-02-19T19:08:11.355 INFO:tasks.workunit.client.0.smithi046.stdout:6/1: write - no filename 2024-02-19T19:08:11.355 INFO:tasks.workunit.client.0.smithi046.stdout:6/2: truncate - no filename 2024-02-19T19:08:11.355 INFO:tasks.workunit.client.0.smithi046.stdout:6/3: read - no filename 2024-02-19T19:08:11.364 INFO:tasks.workunit.client.0.smithi046.stdout:3/4: mknod c2 0 2024-02-19T19:08:11.364 INFO:tasks.workunit.client.0.smithi046.stdout:3/5: chown l1 58728 1 2024-02-19T19:08:11.367 INFO:tasks.workunit.client.0.smithi046.stdout:4/5: rmdir d1 0 2024-02-19T19:08:11.367 INFO:tasks.workunit.client.0.smithi046.stdout:1/20: mknod c1 0 2024-02-19T19:08:11.367 INFO:tasks.workunit.client.0.smithi046.stdout:1/21: write - no filename 2024-02-19T19:08:11.367 INFO:tasks.workunit.client.0.smithi046.stdout:1/22: dwrite - no filename 2024-02-19T19:08:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:1/23: stat c1 0 2024-02-19T19:08:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:1/24: dread - no filename 2024-02-19T19:08:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:1/25: readlink - no filename 2024-02-19T19:08:11.374 INFO:tasks.workunit.client.0.smithi046.stdout:6/4: symlink l0 0 2024-02-19T19:08:11.374 INFO:tasks.workunit.client.0.smithi046.stdout:6/5: truncate - no filename 2024-02-19T19:08:11.391 INFO:tasks.workunit.client.0.smithi046.stdout:4/6: rename c0 to c2 0 2024-02-19T19:08:11.391 INFO:tasks.workunit.client.0.smithi046.stdout:4/7: read - no filename 2024-02-19T19:08:11.391 INFO:tasks.workunit.client.0.smithi046.stdout:4/8: dwrite - no filename 2024-02-19T19:08:11.392 INFO:tasks.workunit.client.0.smithi046.stdout:1/26: rename c1 to c2 0 2024-02-19T19:08:11.392 INFO:tasks.workunit.client.0.smithi046.stdout:1/27: write - no filename 2024-02-19T19:08:11.397 INFO:tasks.workunit.client.0.smithi046.stdout:6/6: creat f1 x:0 0 0 2024-02-19T19:08:11.435 INFO:tasks.workunit.client.0.smithi046.stdout:1/28: stat c2 0 2024-02-19T19:08:11.436 INFO:tasks.workunit.client.0.smithi046.stdout:1/29: truncate - no filename 2024-02-19T19:08:11.436 INFO:tasks.workunit.client.0.smithi046.stdout:1/30: readlink - no filename 2024-02-19T19:08:11.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/7: symlink l2 0 2024-02-19T19:08:11.574 INFO:tasks.workunit.client.0.smithi046.stdout:1/31: stat c2 0 2024-02-19T19:08:11.582 INFO:tasks.workunit.client.0.smithi046.stdout:6/8: rename f1 to f3 0 2024-02-19T19:08:11.780 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:11 smithi046 podman[112209]: 2024-02-19 19:08:11.33100376 +0000 UTC m=+0.036367198 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:08:12.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:11 smithi046 ceph-mon[88928]: osdmap e75: 6 total, 5 up, 6 in 2024-02-19T19:08:12.109 INFO:tasks.workunit.client.0.smithi046.stdout:4/9: link c2 c3 0 2024-02-19T19:08:12.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:11 smithi142 ceph-mon[69118]: osdmap e75: 6 total, 5 up, 6 in 2024-02-19T19:08:12.240 INFO:tasks.workunit.client.0.smithi046.stdout:1/32: mknod c3 0 2024-02-19T19:08:12.302 INFO:tasks.workunit.client.0.smithi046.stdout:6/9: mkdir d4 0 2024-02-19T19:08:12.302 INFO:tasks.workunit.client.0.smithi046.stdout:6/10: dread - f3 zero size 2024-02-19T19:08:12.750 INFO:tasks.workunit.client.0.smithi046.stdout:2/9: write f1 [887113,51612] 0 2024-02-19T19:08:12.750 INFO:tasks.workunit.client.0.smithi046.stdout:2/10: read f1 [1045537,88249] 0 2024-02-19T19:08:12.751 INFO:tasks.workunit.client.0.smithi046.stdout:2/11: creat f3 x:0 0 0 2024-02-19T19:08:12.751 INFO:tasks.workunit.client.0.smithi046.stdout:2/12: read - f3 zero size 2024-02-19T19:08:12.751 INFO:tasks.workunit.client.0.smithi046.stdout:2/13: dread - f3 zero size 2024-02-19T19:08:12.789 INFO:tasks.workunit.client.0.smithi046.stdout:5/11: dwrite f0 [0,4194304] 0 2024-02-19T19:08:12.789 INFO:tasks.workunit.client.0.smithi046.stdout:5/12: chown f0 445 1 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/0: dwrite - no filename 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/0: link - no file 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/1: truncate - no filename 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/2: chown . 7769218 1 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/3: link - no file 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/4: stat - no entries 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/5: chown . 616975 1 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/6: read - no filename 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/7: read - no filename 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/8: write - no filename 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/9: write - no filename 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/10: getdents . 0 2024-02-19T19:08:12.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/11: fdatasync - no filename 2024-02-19T19:08:12.877 INFO:tasks.workunit.client.0.smithi046.stdout:7/12: chown . 472723856 1 2024-02-19T19:08:12.877 INFO:tasks.workunit.client.0.smithi046.stdout:7/13: fdatasync - no filename 2024-02-19T19:08:12.877 INFO:tasks.workunit.client.0.smithi046.stdout:8/1: chown . 121 1 2024-02-19T19:08:12.877 INFO:tasks.workunit.client.0.smithi046.stdout:8/2: fsync - no filename 2024-02-19T19:08:12.877 INFO:tasks.workunit.client.0.smithi046.stdout:8/3: rename - no filename 2024-02-19T19:08:12.906 INFO:tasks.workunit.client.0.smithi046.stdout:5/13: write f0 [1907079,68163] 0 2024-02-19T19:08:12.906 INFO:tasks.workunit.client.0.smithi046.stdout:5/14: readlink - no filename 2024-02-19T19:08:12.908 INFO:tasks.workunit.client.0.smithi046.stdout:5/15: fsync f0 0 2024-02-19T19:08:13.074 INFO:tasks.workunit.client.0.smithi046.stdout:2/14: dwrite f1 [0,4194304] 0 2024-02-19T19:08:13.074 INFO:tasks.workunit.client.0.smithi046.stdout:2/15: chown l0 7394 1 2024-02-19T19:08:13.074 INFO:tasks.workunit.client.0.smithi046.stdout:2/16: creat f4 x:0 0 0 2024-02-19T19:08:13.074 INFO:tasks.workunit.client.0.smithi046.stdout:2/17: write f3 [622819,41401] 0 2024-02-19T19:08:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:12 smithi046 ceph-mon[88928]: pgmap v111: 65 pgs: 11 peering, 5 stale+active+clean, 49 active+clean; 219 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s wr, 379 op/s 2024-02-19T19:08:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:12 smithi046 ceph-mon[88928]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-19T19:08:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:13.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:13.090 INFO:tasks.workunit.client.0.smithi046.stdout:2/18: dwrite f4 [0,4194304] 0 2024-02-19T19:08:13.090 INFO:tasks.workunit.client.0.smithi046.stdout:2/19: chown l0 14384 1 2024-02-19T19:08:13.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:12 smithi142 ceph-mon[69118]: pgmap v111: 65 pgs: 11 peering, 5 stale+active+clean, 49 active+clean; 219 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s wr, 379 op/s 2024-02-19T19:08:13.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:12 smithi142 ceph-mon[69118]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-19T19:08:13.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:13.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:14.069 INFO:tasks.workunit.client.0.smithi046.stdout:4/10: creat f4 x:0 0 0 2024-02-19T19:08:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:13 smithi046 ceph-mon[88928]: Health check failed: Degraded data redundancy: 5416/47832 objects degraded (11.323%), 16 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:14.082 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:13 smithi046 podman[112209]: 2024-02-19 19:08:13.752399417 +0000 UTC m=+2.457762826 container create c70e9fff41d15d5d324919b4d0462f69d0359b61f8c6f141327a6521b459b717 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214) 2024-02-19T19:08:14.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:13 smithi142 ceph-mon[69118]: Health check failed: Degraded data redundancy: 5416/47832 objects degraded (11.323%), 16 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:14.363 INFO:tasks.workunit.client.0.smithi046.stdout:1/33: creat f4 x:0 0 0 2024-02-19T19:08:14.364 INFO:tasks.workunit.client.0.smithi046.stdout:1/34: write f4 [598392,10288] 0 2024-02-19T19:08:14.513 INFO:tasks.workunit.client.0.smithi046.stdout:6/11: rename f3 to d4/f5 0 2024-02-19T19:08:14.531 INFO:tasks.workunit.client.0.smithi046.stdout:6/12: dwrite d4/f5 [0,4194304] 0 2024-02-19T19:08:15.011 INFO:tasks.workunit.client.0.smithi046.stdout:4/11: fsync f4 0 2024-02-19T19:08:15.011 INFO:tasks.workunit.client.0.smithi046.stdout:4/12: fdatasync f4 0 2024-02-19T19:08:15.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/13: dwrite f4 [0,4194304] 0 2024-02-19T19:08:15.036 INFO:tasks.workunit.client.0.smithi046.stdout:4/14: write f4 [2215081,46037] 0 2024-02-19T19:08:15.036 INFO:tasks.workunit.client.0.smithi046.stdout:4/15: creat f5 x:0 0 0 2024-02-19T19:08:15.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:14 smithi142 ceph-mon[69118]: pgmap v112: 65 pgs: 2 active+undersized, 16 active+undersized+degraded, 11 peering, 36 active+clean; 267 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 9.2 MiB/s wr, 898 op/s; 5416/47832 objects degraded (11.323%) 2024-02-19T19:08:15.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:14 smithi046 ceph-mon[88928]: pgmap v112: 65 pgs: 2 active+undersized, 16 active+undersized+degraded, 11 peering, 36 active+clean; 267 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 9.2 MiB/s wr, 898 op/s; 5416/47832 objects degraded (11.323%) 2024-02-19T19:08:15.922 INFO:tasks.workunit.client.0.smithi046.stdout:9/0: creat f0 x:0 0 0 2024-02-19T19:08:15.925 INFO:tasks.workunit.client.0.smithi046.stdout:8/4: mknod c0 0 2024-02-19T19:08:15.925 INFO:tasks.workunit.client.0.smithi046.stdout:7/14: mkdir d0 0 2024-02-19T19:08:15.925 INFO:tasks.workunit.client.0.smithi046.stdout:8/5: stat c0 0 2024-02-19T19:08:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:5/16: symlink l1 0 2024-02-19T19:08:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:5/17: rmdir - no directory 2024-02-19T19:08:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:1/35: mkdir d5 0 2024-02-19T19:08:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/13: mkdir d4/d6 0 2024-02-19T19:08:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/14: chown d4/d6 50696 1 2024-02-19T19:08:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:4/16: mkdir d6 0 2024-02-19T19:08:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:4/17: write f5 [778113,99906] 0 2024-02-19T19:08:15.956 INFO:tasks.workunit.client.0.smithi046.stdout:9/1: mknod c1 0 2024-02-19T19:08:15.956 INFO:tasks.workunit.client.0.smithi046.stdout:9/2: creat f2 x:0 0 0 2024-02-19T19:08:15.956 INFO:tasks.workunit.client.0.smithi046.stdout:9/3: chown f0 0 1 2024-02-19T19:08:15.957 INFO:tasks.workunit.client.0.smithi046.stdout:7/15: creat d0/f1 x:0 0 0 2024-02-19T19:08:15.958 INFO:tasks.workunit.client.0.smithi046.stdout:8/6: mknod c1 0 2024-02-19T19:08:15.958 INFO:tasks.workunit.client.0.smithi046.stdout:8/7: write - no filename 2024-02-19T19:08:15.960 INFO:tasks.workunit.client.0.smithi046.stdout:1/36: unlink f4 0 2024-02-19T19:08:15.960 INFO:tasks.workunit.client.0.smithi046.stdout:1/37: stat c3 0 2024-02-19T19:08:15.961 INFO:tasks.workunit.client.0.smithi046.stdout:1/38: fdatasync - no filename 2024-02-19T19:08:15.961 INFO:tasks.workunit.client.0.smithi046.stdout:5/18: dwrite f0 [0,4194304] 0 2024-02-19T19:08:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:6/15: creat d4/f7 x:0 0 0 2024-02-19T19:08:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:6/16: fdatasync d4/f5 0 2024-02-19T19:08:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:4/18: unlink f5 0 2024-02-19T19:08:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:7/16: unlink d0/f1 0 2024-02-19T19:08:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:7/17: dwrite - no filename 2024-02-19T19:08:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:7/18: rename d0 to d0/d2 22 2024-02-19T19:08:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:7/19: dwrite - no filename 2024-02-19T19:08:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:7/20: creat d0/f3 x:0 0 0 2024-02-19T19:08:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:8/8: rename c0 to c2 0 2024-02-19T19:08:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:8/9: write - no filename 2024-02-19T19:08:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:1/39: creat d5/f6 x:0 0 0 2024-02-19T19:08:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:1/40: readlink - no filename 2024-02-19T19:08:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:1/41: rename d5 to d5/d7 22 2024-02-19T19:08:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:1/42: creat d5/f8 x:0 0 0 2024-02-19T19:08:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:1/43: read - d5/f8 zero size 2024-02-19T19:08:15.972 INFO:tasks.workunit.client.0.smithi046.stdout:6/17: link d4/f7 d4/f8 0 2024-02-19T19:08:15.972 INFO:tasks.workunit.client.0.smithi046.stdout:6/18: dread - d4/f8 zero size 2024-02-19T19:08:15.972 INFO:tasks.workunit.client.0.smithi046.stdout:6/19: dread - d4/f7 zero size 2024-02-19T19:08:15.973 INFO:tasks.workunit.client.0.smithi046.stdout:5/19: write f0 [2967471,46065] 0 2024-02-19T19:08:15.973 INFO:tasks.workunit.client.0.smithi046.stdout:4/19: symlink d6/l7 0 2024-02-19T19:08:15.973 INFO:tasks.workunit.client.0.smithi046.stdout:4/20: rename d6 to d6/d8 22 2024-02-19T19:08:15.975 INFO:tasks.workunit.client.0.smithi046.stdout:7/21: mkdir d0/d4 0 2024-02-19T19:08:15.975 INFO:tasks.workunit.client.0.smithi046.stdout:9/4: dwrite f0 [0,4194304] 0 2024-02-19T19:08:15.976 INFO:tasks.workunit.client.0.smithi046.stdout:9/5: fdatasync f0 0 2024-02-19T19:08:15.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/10: mkdir d3 0 2024-02-19T19:08:15.977 INFO:tasks.workunit.client.0.smithi046.stdout:1/44: symlink d5/l9 0 2024-02-19T19:08:15.979 INFO:tasks.workunit.client.0.smithi046.stdout:5/20: mkdir d2 0 2024-02-19T19:08:15.980 INFO:tasks.workunit.client.0.smithi046.stdout:4/21: creat d6/f9 x:0 0 0 2024-02-19T19:08:15.980 INFO:tasks.workunit.client.0.smithi046.stdout:4/22: chown d6/f9 4 1 2024-02-19T19:08:15.980 INFO:tasks.workunit.client.0.smithi046.stdout:4/23: dread - d6/f9 zero size 2024-02-19T19:08:15.982 INFO:tasks.workunit.client.0.smithi046.stdout:7/22: mknod d0/c5 0 2024-02-19T19:08:15.982 INFO:tasks.workunit.client.0.smithi046.stdout:7/23: write d0/f3 [382007,59268] 0 2024-02-19T19:08:15.982 INFO:tasks.workunit.client.0.smithi046.stdout:7/24: chown d0/d4 6 1 2024-02-19T19:08:15.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/25: read d0/f3 [104223,65998] 0 2024-02-19T19:08:15.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/26: rename d0 to d0/d4/d6 22 2024-02-19T19:08:15.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/27: write d0/f3 [860350,92147] 0 2024-02-19T19:08:15.987 INFO:tasks.workunit.client.0.smithi046.stdout:9/6: mknod c3 0 2024-02-19T19:08:15.987 INFO:tasks.workunit.client.0.smithi046.stdout:9/7: truncate f0 4554177 0 2024-02-19T19:08:15.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/11: creat d3/f4 x:0 0 0 2024-02-19T19:08:15.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/12: readlink - no filename 2024-02-19T19:08:15.990 INFO:tasks.workunit.client.0.smithi046.stdout:4/24: stat c2 0 2024-02-19T19:08:15.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/21: dread f0 [0,4194304] 0 2024-02-19T19:08:15.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/22: stat f0 0 2024-02-19T19:08:15.992 INFO:tasks.workunit.client.0.smithi046.stdout:7/28: creat d0/d4/f7 x:0 0 0 2024-02-19T19:08:15.992 INFO:tasks.workunit.client.0.smithi046.stdout:7/29: chown d0/f3 69 1 2024-02-19T19:08:15.992 INFO:tasks.workunit.client.0.smithi046.stdout:7/30: creat d0/d4/f8 x:0 0 0 2024-02-19T19:08:15.994 INFO:tasks.workunit.client.0.smithi046.stdout:1/45: dwrite d5/f8 [0,4194304] 0 2024-02-19T19:08:15.994 INFO:tasks.workunit.client.0.smithi046.stdout:1/46: fdatasync d5/f6 0 2024-02-19T19:08:15.996 INFO:tasks.workunit.client.0.smithi046.stdout:4/25: symlink d6/la 0 2024-02-19T19:08:15.996 INFO:tasks.workunit.client.0.smithi046.stdout:4/26: creat d6/fb x:0 0 0 2024-02-19T19:08:16.002 INFO:tasks.workunit.client.0.smithi046.stdout:1/47: write d5/f8 [956485,106013] 0 2024-02-19T19:08:16.007 INFO:tasks.workunit.client.0.smithi046.stdout:1/48: mknod d5/ca 0 2024-02-19T19:08:16.007 INFO:tasks.workunit.client.0.smithi046.stdout:1/49: write d5/f6 [272098,34965] 0 2024-02-19T19:08:16.008 INFO:tasks.workunit.client.0.smithi046.stdout:7/31: dwrite d0/d4/f8 [0,4194304] 0 2024-02-19T19:08:16.009 INFO:tasks.workunit.client.0.smithi046.stdout:1/50: symlink d5/lb 0 2024-02-19T19:08:16.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:15 smithi142 ceph-mon[69118]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-19T19:08:16.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:15 smithi046 ceph-mon[88928]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-19T19:08:16.378 INFO:tasks.workunit.client.0.smithi046.stdout:9/8: fsync f0 0 2024-02-19T19:08:16.388 INFO:tasks.workunit.client.0.smithi046.stdout:2/20: truncate f3 20009 0 2024-02-19T19:08:16.390 INFO:tasks.workunit.client.0.smithi046.stdout:8/13: unlink c2 0 2024-02-19T19:08:16.390 INFO:tasks.workunit.client.0.smithi046.stdout:8/14: write d3/f4 [156579,40834] 0 2024-02-19T19:08:16.394 INFO:tasks.workunit.client.0.smithi046.stdout:5/23: truncate f0 4166693 0 2024-02-19T19:08:16.394 INFO:tasks.workunit.client.0.smithi046.stdout:8/15: dread d3/f4 [0,4194304] 0 2024-02-19T19:08:16.396 INFO:tasks.workunit.client.0.smithi046.stdout:8/16: mknod d3/c5 0 2024-02-19T19:08:16.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/17: write d3/f4 [52729,76720] 0 2024-02-19T19:08:16.397 INFO:tasks.workunit.client.0.smithi046.stdout:2/21: dread f1 [0,4194304] 0 2024-02-19T19:08:16.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/9: write f0 [5063029,124913] 0 2024-02-19T19:08:16.399 INFO:tasks.workunit.client.0.smithi046.stdout:2/22: mkdir d5 0 2024-02-19T19:08:16.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/23: mkdir d5/d6 0 2024-02-19T19:08:16.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/24: chown d5/d6 29217 1 2024-02-19T19:08:16.402 INFO:tasks.workunit.client.0.smithi046.stdout:9/10: fsync f0 0 2024-02-19T19:08:16.402 INFO:tasks.workunit.client.0.smithi046.stdout:9/11: write f2 [165792,46142] 0 2024-02-19T19:08:16.403 INFO:tasks.workunit.client.0.smithi046.stdout:2/25: creat d5/d6/f7 x:0 0 0 2024-02-19T19:08:16.403 INFO:tasks.workunit.client.0.smithi046.stdout:2/26: chown f1 6548 1 2024-02-19T19:08:16.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/32: getdents d0/d4 0 2024-02-19T19:08:16.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/33: symlink d0/d4/l9 0 2024-02-19T19:08:16.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/34: creat d0/fa x:0 0 0 2024-02-19T19:08:16.414 INFO:tasks.workunit.client.0.smithi046.stdout:9/12: write f0 [1713513,38109] 0 2024-02-19T19:08:16.414 INFO:tasks.workunit.client.0.smithi046.stdout:5/24: rename f0 to d2/f3 0 2024-02-19T19:08:16.414 INFO:tasks.workunit.client.0.smithi046.stdout:2/27: rename d5 to d5/d6/d8 22 2024-02-19T19:08:16.416 INFO:tasks.workunit.client.0.smithi046.stdout:9/13: mknod c4 0 2024-02-19T19:08:16.418 INFO:tasks.workunit.client.0.smithi046.stdout:8/18: dwrite d3/f4 [0,4194304] 0 2024-02-19T19:08:16.418 INFO:tasks.workunit.client.0.smithi046.stdout:5/25: creat d2/f4 x:0 0 0 2024-02-19T19:08:16.419 INFO:tasks.workunit.client.0.smithi046.stdout:8/19: fsync d3/f4 0 2024-02-19T19:08:16.420 INFO:tasks.workunit.client.0.smithi046.stdout:2/28: rmdir d5/d6 39 2024-02-19T19:08:16.424 INFO:tasks.workunit.client.0.smithi046.stdout:5/26: rename d2/f4 to d2/f5 0 2024-02-19T19:08:16.424 INFO:tasks.workunit.client.0.smithi046.stdout:5/27: chown d2/f5 12084518 1 2024-02-19T19:08:16.426 INFO:tasks.workunit.client.0.smithi046.stdout:2/29: symlink d5/d6/l9 0 2024-02-19T19:08:16.426 INFO:tasks.workunit.client.0.smithi046.stdout:2/30: readlink d5/d6/l9 0 2024-02-19T19:08:16.430 INFO:tasks.workunit.client.0.smithi046.stdout:1/51: dwrite d5/f8 [4194304,4194304] 0 2024-02-19T19:08:16.430 INFO:tasks.workunit.client.0.smithi046.stdout:1/52: creat d5/fc x:0 0 0 2024-02-19T19:08:16.430 INFO:tasks.workunit.client.0.smithi046.stdout:7/35: dwrite d0/f3 [0,4194304] 0 2024-02-19T19:08:16.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/36: mknod d0/cb 0 2024-02-19T19:08:16.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/37: dread - d0/fa zero size 2024-02-19T19:08:16.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/38: chown d0/f3 192 1 2024-02-19T19:08:16.437 INFO:tasks.workunit.client.0.smithi046.stdout:7/39: chown d0/d4/f8 0 1 2024-02-19T19:08:16.437 INFO:tasks.workunit.client.0.smithi046.stdout:7/40: write d0/fa [689092,77359] 0 2024-02-19T19:08:16.438 INFO:tasks.workunit.client.0.smithi046.stdout:7/41: creat d0/d4/fc x:0 0 0 2024-02-19T19:08:16.438 INFO:tasks.workunit.client.0.smithi046.stdout:1/53: dread d5/f8 [4194304,4194304] 0 2024-02-19T19:08:16.439 INFO:tasks.workunit.client.0.smithi046.stdout:7/42: mkdir d0/d4/dd 0 2024-02-19T19:08:16.439 INFO:tasks.workunit.client.0.smithi046.stdout:7/43: readlink d0/d4/l9 0 2024-02-19T19:08:16.447 INFO:tasks.workunit.client.0.smithi046.stdout:9/14: dwrite f2 [0,4194304] 0 2024-02-19T19:08:16.447 INFO:tasks.workunit.client.0.smithi046.stdout:9/15: chown c3 6 1 2024-02-19T19:08:16.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/28: dwrite d2/f3 [0,4194304] 0 2024-02-19T19:08:16.450 INFO:tasks.workunit.client.0.smithi046.stdout:5/29: getdents d2 0 2024-02-19T19:08:16.450 INFO:tasks.workunit.client.0.smithi046.stdout:5/30: dread - d2/f5 zero size 2024-02-19T19:08:16.450 INFO:tasks.workunit.client.0.smithi046.stdout:5/31: fsync d2/f5 0 2024-02-19T19:08:16.458 INFO:tasks.workunit.client.0.smithi046.stdout:9/16: dread f0 [0,4194304] 0 2024-02-19T19:08:16.460 INFO:tasks.workunit.client.0.smithi046.stdout:9/17: getdents . 0 2024-02-19T19:08:16.462 INFO:tasks.workunit.client.0.smithi046.stdout:5/32: dread d2/f3 [0,4194304] 0 2024-02-19T19:08:16.465 INFO:tasks.workunit.client.0.smithi046.stdout:7/44: dwrite d0/d4/f7 [0,4194304] 0 2024-02-19T19:08:16.466 INFO:tasks.workunit.client.0.smithi046.stdout:1/54: dwrite d5/f6 [0,4194304] 0 2024-02-19T19:08:16.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/45: write d0/d4/f7 [1543227,73119] 0 2024-02-19T19:08:16.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/46: write d0/d4/f8 [5045785,29799] 0 2024-02-19T19:08:16.480 INFO:tasks.workunit.client.0.smithi046.stdout:2/31: dwrite f4 [4194304,4194304] 0 2024-02-19T19:08:16.481 INFO:tasks.workunit.client.0.smithi046.stdout:2/32: truncate f4 8561081 0 2024-02-19T19:08:16.482 INFO:tasks.workunit.client.0.smithi046.stdout:2/33: creat d5/d6/fa x:0 0 0 2024-02-19T19:08:16.489 INFO:tasks.workunit.client.0.smithi046.stdout:9/18: dwrite f2 [0,4194304] 0 2024-02-19T19:08:16.490 INFO:tasks.workunit.client.0.smithi046.stdout:7/47: dwrite d0/f3 [4194304,4194304] 0 2024-02-19T19:08:16.493 INFO:tasks.workunit.client.0.smithi046.stdout:7/48: dread d0/fa [0,4194304] 0 2024-02-19T19:08:16.493 INFO:tasks.workunit.client.0.smithi046.stdout:7/49: write d0/d4/f8 [5096434,58117] 0 2024-02-19T19:08:16.495 INFO:tasks.workunit.client.0.smithi046.stdout:7/50: link d0/d4/f7 d0/fe 0 2024-02-19T19:08:16.495 INFO:tasks.workunit.client.0.smithi046.stdout:7/51: creat d0/ff x:0 0 0 2024-02-19T19:08:16.497 INFO:tasks.workunit.client.0.smithi046.stdout:2/34: write f1 [1867186,107053] 0 2024-02-19T19:08:16.497 INFO:tasks.workunit.client.0.smithi046.stdout:2/35: chown d5/d6/fa 31782283 1 2024-02-19T19:08:16.497 INFO:tasks.workunit.client.0.smithi046.stdout:2/36: write d5/d6/fa [207286,40383] 0 2024-02-19T19:08:16.497 INFO:tasks.workunit.client.0.smithi046.stdout:2/37: write f3 [110330,57256] 0 2024-02-19T19:08:16.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/52: unlink d0/c5 0 2024-02-19T19:08:16.506 INFO:tasks.workunit.client.0.smithi046.stdout:9/19: read f2 [1091131,73096] 0 2024-02-19T19:08:16.506 INFO:tasks.workunit.client.0.smithi046.stdout:9/20: rmdir - no directory 2024-02-19T19:08:16.507 INFO:tasks.workunit.client.0.smithi046.stdout:9/21: write f0 [4737356,67264] 0 2024-02-19T19:08:16.507 INFO:tasks.workunit.client.0.smithi046.stdout:9/22: readlink - no filename 2024-02-19T19:08:16.507 INFO:tasks.workunit.client.0.smithi046.stdout:9/23: getdents . 0 2024-02-19T19:08:16.508 INFO:tasks.workunit.client.0.smithi046.stdout:9/24: symlink l5 0 2024-02-19T19:08:16.508 INFO:tasks.workunit.client.0.smithi046.stdout:9/25: stat f2 0 2024-02-19T19:08:16.511 INFO:tasks.workunit.client.0.smithi046.stdout:7/53: write d0/f3 [8183009,57543] 0 2024-02-19T19:08:16.511 INFO:tasks.workunit.client.0.smithi046.stdout:2/38: dread d5/d6/fa [0,4194304] 0 2024-02-19T19:08:16.512 INFO:tasks.workunit.client.0.smithi046.stdout:2/39: symlink d5/d6/lb 0 2024-02-19T19:08:16.514 INFO:tasks.workunit.client.0.smithi046.stdout:9/26: dread f2 [0,4194304] 0 2024-02-19T19:08:16.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/40: dread d5/d6/fa [0,4194304] 0 2024-02-19T19:08:16.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/27: unlink c3 0 2024-02-19T19:08:16.524 INFO:tasks.workunit.client.0.smithi046.stdout:2/41: write f4 [3960181,11297] 0 2024-02-19T19:08:16.524 INFO:tasks.workunit.client.0.smithi046.stdout:2/42: stat d5/d6/fa 0 2024-02-19T19:08:16.543 INFO:tasks.workunit.client.0.smithi046.stdout:2/43: dwrite f3 [0,4194304] 0 2024-02-19T19:08:16.543 INFO:tasks.workunit.client.0.smithi046.stdout:2/44: creat d5/d6/fc x:0 0 0 2024-02-19T19:08:16.543 INFO:tasks.workunit.client.0.smithi046.stdout:2/45: truncate f4 8581805 0 2024-02-19T19:08:16.543 INFO:tasks.workunit.client.0.smithi046.stdout:2/46: dread - d5/d6/fc zero size 2024-02-19T19:08:16.544 INFO:tasks.workunit.client.0.smithi046.stdout:2/47: dread d5/d6/fa [0,4194304] 0 2024-02-19T19:08:16.604 INFO:tasks.workunit.client.0.smithi046.stdout:7/54: dwrite d0/fa [0,4194304] 0 2024-02-19T19:08:16.604 INFO:tasks.workunit.client.0.smithi046.stdout:7/55: read d0/f3 [4396834,11440] 0 2024-02-19T19:08:16.612 INFO:tasks.workunit.client.0.smithi046.stdout:9/28: getdents . 0 2024-02-19T19:08:16.612 INFO:tasks.workunit.client.0.smithi046.stdout:9/29: write f0 [2927068,42042] 0 2024-02-19T19:08:16.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/48: dwrite f4 [8388608,4194304] 0 2024-02-19T19:08:16.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/49: creat d5/d6/fd x:0 0 0 2024-02-19T19:08:16.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/50: dread - d5/d6/fd zero size 2024-02-19T19:08:16.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/51: dread - d5/d6/fd zero size 2024-02-19T19:08:16.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/52: write f1 [2573708,58526] 0 2024-02-19T19:08:16.638 INFO:tasks.workunit.client.0.smithi046.stdout:7/56: dwrite d0/d4/f7 [4194304,4194304] 0 2024-02-19T19:08:16.639 INFO:tasks.workunit.client.0.smithi046.stdout:7/57: fdatasync d0/ff 0 2024-02-19T19:08:16.639 INFO:tasks.workunit.client.0.smithi046.stdout:7/58: chown d0/ff 4685172 1 2024-02-19T19:08:16.646 INFO:tasks.workunit.client.0.smithi046.stdout:9/30: dwrite f2 [0,4194304] 0 2024-02-19T19:08:16.648 INFO:tasks.workunit.client.0.smithi046.stdout:2/53: dwrite f4 [12582912,4194304] 0 2024-02-19T19:08:16.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/54: dwrite d5/d6/fa [0,4194304] 0 2024-02-19T19:08:16.736 INFO:tasks.workunit.client.0.smithi046.stdout:7/59: creat d0/d4/dd/f10 x:0 0 0 2024-02-19T19:08:16.758 INFO:tasks.workunit.client.0.smithi046.stdout:9/31: creat f6 x:0 0 0 2024-02-19T19:08:16.762 INFO:tasks.workunit.client.0.smithi046.stdout:2/55: link l0 d5/d6/le 0 2024-02-19T19:08:16.773 INFO:tasks.workunit.client.0.smithi046.stdout:2/56: dread f1 [0,4194304] 0 2024-02-19T19:08:16.773 INFO:tasks.workunit.client.0.smithi046.stdout:2/57: write f1 [4323353,93693] 0 2024-02-19T19:08:16.789 INFO:tasks.workunit.client.0.smithi046.stdout:2/58: dwrite d5/d6/fd [0,4194304] 0 2024-02-19T19:08:16.789 INFO:tasks.workunit.client.0.smithi046.stdout:2/59: fsync d5/d6/fd 0 2024-02-19T19:08:16.791 INFO:tasks.workunit.client.0.smithi046.stdout:2/60: mkdir d5/df 0 2024-02-19T19:08:16.796 INFO:tasks.workunit.client.0.smithi046.stdout:7/60: truncate d0/fe 1693114 0 2024-02-19T19:08:16.796 INFO:tasks.workunit.client.0.smithi046.stdout:7/61: chown d0/fe 71742107 1 2024-02-19T19:08:16.801 INFO:tasks.workunit.client.0.smithi046.stdout:7/62: unlink d0/f3 0 2024-02-19T19:08:16.802 INFO:tasks.workunit.client.0.smithi046.stdout:2/61: write f3 [1785105,130065] 0 2024-02-19T19:08:16.804 INFO:tasks.workunit.client.0.smithi046.stdout:7/63: mknod d0/c11 0 2024-02-19T19:08:16.805 INFO:tasks.workunit.client.0.smithi046.stdout:2/62: creat d5/df/f10 x:0 0 0 2024-02-19T19:08:16.805 INFO:tasks.workunit.client.0.smithi046.stdout:2/63: chown d5/d6/fd 0 1 2024-02-19T19:08:16.805 INFO:tasks.workunit.client.0.smithi046.stdout:2/64: chown d5/df/f10 2538864 1 2024-02-19T19:08:16.805 INFO:tasks.workunit.client.0.smithi046.stdout:2/65: stat d5 0 2024-02-19T19:08:16.807 INFO:tasks.workunit.client.0.smithi046.stdout:2/66: creat d5/f11 x:0 0 0 2024-02-19T19:08:16.807 INFO:tasks.workunit.client.0.smithi046.stdout:2/67: chown d5/df 768074767 1 2024-02-19T19:08:16.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/64: symlink d0/d4/l12 0 2024-02-19T19:08:16.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/65: read - d0/ff zero size 2024-02-19T19:08:16.809 INFO:tasks.workunit.client.0.smithi046.stdout:2/68: symlink d5/df/l12 0 2024-02-19T19:08:16.812 INFO:tasks.workunit.client.0.smithi046.stdout:7/66: dread d0/fe [0,4194304] 0 2024-02-19T19:08:16.812 INFO:tasks.workunit.client.0.smithi046.stdout:7/67: fsync d0/d4/f7 0 2024-02-19T19:08:16.812 INFO:tasks.workunit.client.0.smithi046.stdout:7/68: fdatasync d0/ff 0 2024-02-19T19:08:16.812 INFO:tasks.workunit.client.0.smithi046.stdout:7/69: rmdir d0/d4/dd 39 2024-02-19T19:08:16.829 INFO:tasks.workunit.client.0.smithi046.stdout:7/70: dwrite d0/d4/f7 [0,4194304] 0 2024-02-19T19:08:16.829 INFO:tasks.workunit.client.0.smithi046.stdout:7/71: dread - d0/d4/fc zero size 2024-02-19T19:08:16.836 INFO:tasks.workunit.client.0.smithi046.stdout:7/72: dread d0/d4/f7 [0,4194304] 0 2024-02-19T19:08:16.838 INFO:tasks.workunit.client.0.smithi046.stdout:7/73: getdents d0/d4 0 2024-02-19T19:08:16.838 INFO:tasks.workunit.client.0.smithi046.stdout:7/74: write d0/ff [438314,32100] 0 2024-02-19T19:08:16.838 INFO:tasks.workunit.client.0.smithi046.stdout:7/75: write d0/d4/fc [792453,129857] 0 2024-02-19T19:08:16.839 INFO:tasks.workunit.client.0.smithi046.stdout:7/76: write d0/ff [233978,44001] 0 2024-02-19T19:08:16.839 INFO:tasks.workunit.client.0.smithi046.stdout:7/77: symlink d0/d4/l13 0 2024-02-19T19:08:16.839 INFO:tasks.workunit.client.0.smithi046.stdout:7/78: dread - d0/d4/dd/f10 zero size 2024-02-19T19:08:16.841 INFO:tasks.workunit.client.0.smithi046.stdout:7/79: link d0/c11 d0/d4/c14 0 2024-02-19T19:08:16.841 INFO:tasks.workunit.client.0.smithi046.stdout:7/80: readlink d0/d4/l13 0 2024-02-19T19:08:16.841 INFO:tasks.workunit.client.0.smithi046.stdout:7/81: stat d0/cb 0 2024-02-19T19:08:16.841 INFO:tasks.workunit.client.0.smithi046.stdout:7/82: write d0/ff [590732,69566] 0 2024-02-19T19:08:16.841 INFO:tasks.workunit.client.0.smithi046.stdout:7/83: chown d0/d4/fc 39 1 2024-02-19T19:08:16.844 INFO:tasks.workunit.client.0.smithi046.stdout:7/84: dread d0/ff [0,4194304] 0 2024-02-19T19:08:16.848 INFO:tasks.workunit.client.0.smithi046.stdout:7/85: getdents d0/d4 0 2024-02-19T19:08:16.849 INFO:tasks.workunit.client.0.smithi046.stdout:7/86: symlink d0/d4/l15 0 2024-02-19T19:08:16.850 INFO:tasks.workunit.client.0.smithi046.stdout:7/87: dread - d0/d4/dd/f10 zero size 2024-02-19T19:08:16.850 INFO:tasks.workunit.client.0.smithi046.stdout:7/88: creat d0/f16 x:0 0 0 2024-02-19T19:08:16.850 INFO:tasks.workunit.client.0.smithi046.stdout:7/89: dread - d0/f16 zero size 2024-02-19T19:08:16.851 INFO:tasks.workunit.client.0.smithi046.stdout:7/90: readlink d0/d4/l12 0 2024-02-19T19:08:16.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/91: unlink d0/fe 0 2024-02-19T19:08:16.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/92: mknod d0/c17 0 2024-02-19T19:08:16.859 INFO:tasks.workunit.client.0.smithi046.stdout:7/93: write d0/fa [907634,69814] 0 2024-02-19T19:08:16.859 INFO:tasks.workunit.client.0.smithi046.stdout:7/94: write d0/ff [249168,73374] 0 2024-02-19T19:08:16.867 INFO:tasks.workunit.client.0.smithi046.stdout:7/95: dread d0/d4/fc [0,4194304] 0 2024-02-19T19:08:16.867 INFO:tasks.workunit.client.0.smithi046.stdout:7/96: dread - d0/d4/dd/f10 zero size 2024-02-19T19:08:16.867 INFO:tasks.workunit.client.0.smithi046.stdout:7/97: creat d0/f18 x:0 0 0 2024-02-19T19:08:16.868 INFO:tasks.workunit.client.0.smithi046.stdout:7/98: unlink d0/d4/fc 0 2024-02-19T19:08:16.869 INFO:tasks.workunit.client.0.smithi046.stdout:7/99: chown d0/d4/f8 22150292 1 2024-02-19T19:08:16.871 INFO:tasks.workunit.client.0.smithi046.stdout:7/100: rename d0/d4/c14 to d0/d4/c19 0 2024-02-19T19:08:16.872 INFO:tasks.workunit.client.0.smithi046.stdout:7/101: rename d0/fa to d0/d4/f1a 0 2024-02-19T19:08:16.892 INFO:tasks.workunit.client.0.smithi046.stdout:7/102: dwrite d0/d4/f8 [0,4194304] 0 2024-02-19T19:08:16.894 INFO:tasks.workunit.client.0.smithi046.stdout:7/103: rename d0/f16 to d0/f1b 0 2024-02-19T19:08:16.894 INFO:tasks.workunit.client.0.smithi046.stdout:7/104: mknod d0/c1c 0 2024-02-19T19:08:16.896 INFO:tasks.workunit.client.0.smithi046.stdout:7/105: rename d0/c1c to d0/d4/c1d 0 2024-02-19T19:08:16.896 INFO:tasks.workunit.client.0.smithi046.stdout:7/106: read - d0/f1b zero size 2024-02-19T19:08:16.896 INFO:tasks.workunit.client.0.smithi046.stdout:7/107: mknod d0/d4/dd/c1e 0 2024-02-19T19:08:16.904 INFO:tasks.workunit.client.0.smithi046.stdout:7/108: rmdir d0/d4 39 2024-02-19T19:08:16.904 INFO:tasks.workunit.client.0.smithi046.stdout:7/109: truncate d0/f18 533231 0 2024-02-19T19:08:17.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:16 smithi142 ceph-mon[69118]: pgmap v113: 65 pgs: 2 active+undersized, 27 active+undersized+degraded, 36 active+clean; 272 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 549 KiB/s rd, 10 MiB/s wr, 1.17k op/s; 8082/51924 objects degraded (15.565%) 2024-02-19T19:08:17.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:16 smithi046 ceph-mon[88928]: pgmap v113: 65 pgs: 2 active+undersized, 27 active+undersized+degraded, 36 active+clean; 272 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 549 KiB/s rd, 10 MiB/s wr, 1.17k op/s; 8082/51924 objects degraded (15.565%) 2024-02-19T19:08:17.332 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:17 smithi046 podman[112209]: 2024-02-19 19:08:17.098994987 +0000 UTC m=+5.804358397 container init c70e9fff41d15d5d324919b4d0462f69d0359b61f8c6f141327a6521b459b717 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-02-19T19:08:17.332 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:17 smithi046 podman[112209]: 2024-02-19 19:08:17.105156757 +0000 UTC m=+5.810520173 container start c70e9fff41d15d5d324919b4d0462f69d0359b61f8c6f141327a6521b459b717 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-19T19:08:18.831 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:18 smithi046 podman[112209]: 2024-02-19 19:08:18.424758767 +0000 UTC m=+7.130122221 container attach c70e9fff41d15d5d324919b4d0462f69d0359b61f8c6f141327a6521b459b717 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:08:18.832 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:18 smithi046 podman[112209]: 2024-02-19 19:08:18.425417894 +0000 UTC m=+7.130781304 container died c70e9fff41d15d5d324919b4d0462f69d0359b61f8c6f141327a6521b459b717 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-19T19:08:19.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:18 smithi142 ceph-mon[69118]: pgmap v114: 65 pgs: 2 active+undersized, 27 active+undersized+degraded, 36 active+clean; 272 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 9.9 MiB/s wr, 1.01k op/s; 8082/51924 objects degraded (15.565%) 2024-02-19T19:08:19.231 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:18 smithi046 ceph-mon[88928]: pgmap v114: 65 pgs: 2 active+undersized, 27 active+undersized+degraded, 36 active+clean; 272 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 9.9 MiB/s wr, 1.01k op/s; 8082/51924 objects degraded (15.565%) 2024-02-19T19:08:20.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:19 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 8082/51924 objects degraded (15.565%), 27 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:9/32: sync 2024-02-19T19:08:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:1/55: sync 2024-02-19T19:08:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/33: sync 2024-02-19T19:08:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/20: sync 2024-02-19T19:08:20.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/21: readlink - no filename 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/20: sync 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:4/27: sync 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/6: sync 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/7: dwrite - no filename 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/8: read - no filename 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:0/15: sync 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:7/110: sync 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:1/56: creat d5/fd x:0 0 0 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:9/33: creat f7 x:0 0 0 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:4/28: write d6/f9 [702470,87594] 0 2024-02-19T19:08:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/69: sync 2024-02-19T19:08:20.175 INFO:tasks.workunit.client.0.smithi046.stdout:5/34: link d2/f5 d2/f6 0 2024-02-19T19:08:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:6/21: creat d4/d6/f9 x:0 0 0 2024-02-19T19:08:20.181 INFO:tasks.workunit.client.0.smithi046.stdout:3/9: creat f3 x:0 0 0 2024-02-19T19:08:20.181 INFO:tasks.workunit.client.0.smithi046.stdout:3/10: read - f3 zero size 2024-02-19T19:08:20.181 INFO:tasks.workunit.client.0.smithi046.stdout:2/70: dread f3 [0,4194304] 0 2024-02-19T19:08:20.183 INFO:tasks.workunit.client.0.smithi046.stdout:8/22: dread d3/f4 [0,4194304] 0 2024-02-19T19:08:20.189 INFO:tasks.workunit.client.0.smithi046.stdout:8/23: dread d3/f4 [0,4194304] 0 2024-02-19T19:08:20.190 INFO:tasks.workunit.client.0.smithi046.stdout:0/16: mkdir d0/d4 0 2024-02-19T19:08:20.190 INFO:tasks.workunit.client.0.smithi046.stdout:0/17: creat d0/f5 x:0 0 0 2024-02-19T19:08:20.190 INFO:tasks.workunit.client.0.smithi046.stdout:0/18: write d0/f3 [558590,16376] 0 2024-02-19T19:08:20.190 INFO:tasks.workunit.client.0.smithi046.stdout:4/29: truncate f4 2526758 0 2024-02-19T19:08:20.191 INFO:tasks.workunit.client.0.smithi046.stdout:0/19: chown d0/f2 4552 1 2024-02-19T19:08:20.191 INFO:tasks.workunit.client.0.smithi046.stdout:0/20: stat d0/f2 0 2024-02-19T19:08:20.191 INFO:tasks.workunit.client.0.smithi046.stdout:7/111: dwrite d0/f1b [0,4194304] 0 2024-02-19T19:08:20.192 INFO:tasks.workunit.client.0.smithi046.stdout:1/57: symlink d5/le 0 2024-02-19T19:08:20.194 INFO:tasks.workunit.client.0.smithi046.stdout:5/35: rmdir d2 39 2024-02-19T19:08:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:7/112: dread d0/f1b [0,4194304] 0 2024-02-19T19:08:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:7/113: write d0/d4/dd/f10 [830769,68582] 0 2024-02-19T19:08:20.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:19 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 8082/51924 objects degraded (15.565%), 27 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:20.202 INFO:tasks.workunit.client.0.smithi046.stdout:0/21: creat d0/d4/f6 x:0 0 0 2024-02-19T19:08:20.202 INFO:tasks.workunit.client.0.smithi046.stdout:0/22: stat d0/d4/f6 0 2024-02-19T19:08:20.202 INFO:tasks.workunit.client.0.smithi046.stdout:0/23: creat d0/f7 x:0 0 0 2024-02-19T19:08:20.202 INFO:tasks.workunit.client.0.smithi046.stdout:4/30: link c2 d6/cc 0 2024-02-19T19:08:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:5/36: symlink d2/l7 0 2024-02-19T19:08:20.207 INFO:tasks.workunit.client.0.smithi046.stdout:5/37: chown d2/f3 115866 1 2024-02-19T19:08:20.210 INFO:tasks.workunit.client.0.smithi046.stdout:2/71: rmdir d5 39 2024-02-19T19:08:20.211 INFO:tasks.workunit.client.0.smithi046.stdout:3/11: dwrite f3 [0,4194304] 0 2024-02-19T19:08:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/22: dwrite d4/f7 [0,4194304] 0 2024-02-19T19:08:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:8/24: dwrite d3/f4 [0,4194304] 0 2024-02-19T19:08:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:8/25: chown d3/c5 565494 1 2024-02-19T19:08:20.212 INFO:tasks.workunit.client.0.smithi046.stdout:7/114: unlink d0/d4/c19 0 2024-02-19T19:08:20.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/115: write d0/f18 [1046986,18825] 0 2024-02-19T19:08:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:0/24: mkdir d0/d4/d8 0 2024-02-19T19:08:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:0/25: read - d0/d4/f6 zero size 2024-02-19T19:08:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:8/26: write d3/f4 [4162584,120887] 0 2024-02-19T19:08:20.218 INFO:tasks.workunit.client.0.smithi046.stdout:0/26: write d0/f3 [427922,43675] 0 2024-02-19T19:08:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:4/31: rename d6/cc to d6/cd 0 2024-02-19T19:08:20.219 INFO:tasks.workunit.client.0.smithi046.stdout:4/32: dread - d6/fb zero size 2024-02-19T19:08:20.222 INFO:tasks.workunit.client.0.smithi046.stdout:5/38: mknod d2/c8 0 2024-02-19T19:08:20.225 INFO:tasks.workunit.client.0.smithi046.stdout:2/72: mkdir d5/d6/d13 0 2024-02-19T19:08:20.225 INFO:tasks.workunit.client.0.smithi046.stdout:1/58: getdents d5 0 2024-02-19T19:08:20.225 INFO:tasks.workunit.client.0.smithi046.stdout:1/59: dread - d5/fd zero size 2024-02-19T19:08:20.229 INFO:tasks.workunit.client.0.smithi046.stdout:3/12: symlink l4 0 2024-02-19T19:08:20.229 INFO:tasks.workunit.client.0.smithi046.stdout:3/13: truncate f3 4835162 0 2024-02-19T19:08:20.237 INFO:tasks.workunit.client.0.smithi046.stdout:7/116: truncate d0/d4/f1a 3991455 0 2024-02-19T19:08:20.239 INFO:tasks.workunit.client.0.smithi046.stdout:3/14: dread f3 [0,4194304] 0 2024-02-19T19:08:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:8/27: unlink c1 0 2024-02-19T19:08:20.240 INFO:tasks.workunit.client.0.smithi046.stdout:0/27: rename d0/f7 to d0/d4/d8/f9 0 2024-02-19T19:08:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:7/117: rename d0 to d0/d4/dd/d1f 22 2024-02-19T19:08:20.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/60: mknod d5/cf 0 2024-02-19T19:08:20.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/61: stat d5/fc 0 2024-02-19T19:08:20.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/62: chown d5 2114721577 1 2024-02-19T19:08:20.248 INFO:tasks.workunit.client.0.smithi046.stdout:8/28: symlink d3/l6 0 2024-02-19T19:08:20.248 INFO:tasks.workunit.client.0.smithi046.stdout:8/29: creat d3/f7 x:0 0 0 2024-02-19T19:08:20.248 INFO:tasks.workunit.client.0.smithi046.stdout:8/30: readlink d3/l6 0 2024-02-19T19:08:20.248 INFO:tasks.workunit.client.0.smithi046.stdout:5/39: dwrite d2/f6 [0,4194304] 0 2024-02-19T19:08:20.249 INFO:tasks.workunit.client.0.smithi046.stdout:0/28: mkdir d0/da 0 2024-02-19T19:08:20.249 INFO:tasks.workunit.client.0.smithi046.stdout:0/29: dread - d0/d4/d8/f9 zero size 2024-02-19T19:08:20.249 INFO:tasks.workunit.client.0.smithi046.stdout:3/15: write f3 [2657441,47191] 0 2024-02-19T19:08:20.250 INFO:tasks.workunit.client.0.smithi046.stdout:1/63: mkdir d5/d10 0 2024-02-19T19:08:20.251 INFO:tasks.workunit.client.0.smithi046.stdout:7/118: dread d0/d4/f8 [0,4194304] 0 2024-02-19T19:08:20.251 INFO:tasks.workunit.client.0.smithi046.stdout:7/119: chown d0/d4/l12 99 1 2024-02-19T19:08:20.251 INFO:tasks.workunit.client.0.smithi046.stdout:2/73: dwrite f4 [12582912,4194304] 0 2024-02-19T19:08:20.251 INFO:tasks.workunit.client.0.smithi046.stdout:2/74: chown f1 2205 1 2024-02-19T19:08:20.251 INFO:tasks.workunit.client.0.smithi046.stdout:2/75: stat d5/d6/fd 0 2024-02-19T19:08:20.253 INFO:tasks.workunit.client.0.smithi046.stdout:4/33: rename d6/cd to d6/ce 0 2024-02-19T19:08:20.255 INFO:tasks.workunit.client.0.smithi046.stdout:8/31: symlink d3/l8 0 2024-02-19T19:08:20.255 INFO:tasks.workunit.client.0.smithi046.stdout:8/32: chown d3/l6 117 1 2024-02-19T19:08:20.255 INFO:tasks.workunit.client.0.smithi046.stdout:8/33: creat d3/f9 x:0 0 0 2024-02-19T19:08:20.255 INFO:tasks.workunit.client.0.smithi046.stdout:8/34: write d3/f7 [340758,76476] 0 2024-02-19T19:08:20.255 INFO:tasks.workunit.client.0.smithi046.stdout:8/35: write d3/f7 [1456742,108038] 0 2024-02-19T19:08:20.260 INFO:tasks.workunit.client.0.smithi046.stdout:5/40: getdents d2 0 2024-02-19T19:08:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:0/30: mkdir d0/d4/db 0 2024-02-19T19:08:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:0/31: write d0/d4/d8/f9 [1033701,75577] 0 2024-02-19T19:08:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:0/32: chown d0/da 161680 1 2024-02-19T19:08:20.263 INFO:tasks.workunit.client.0.smithi046.stdout:0/33: truncate d0/d4/f6 786701 0 2024-02-19T19:08:20.264 INFO:tasks.workunit.client.0.smithi046.stdout:6/23: truncate d4/f7 33595 0 2024-02-19T19:08:20.267 INFO:tasks.workunit.client.0.smithi046.stdout:3/16: dwrite f3 [4194304,4194304] 0 2024-02-19T19:08:20.267 INFO:tasks.workunit.client.0.smithi046.stdout:3/17: chown f3 901 1 2024-02-19T19:08:20.267 INFO:tasks.workunit.client.0.smithi046.stdout:1/64: symlink d5/l11 0 2024-02-19T19:08:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/76: dwrite f3 [0,4194304] 0 2024-02-19T19:08:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/77: fdatasync d5/d6/fd 0 2024-02-19T19:08:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:7/120: readlink d0/d4/l13 0 2024-02-19T19:08:20.272 INFO:tasks.workunit.client.0.smithi046.stdout:7/121: chown d0/c11 221 1 2024-02-19T19:08:20.276 INFO:tasks.workunit.client.0.smithi046.stdout:5/41: write d2/f5 [245271,130131] 0 2024-02-19T19:08:20.280 INFO:tasks.workunit.client.0.smithi046.stdout:4/34: unlink d6/ce 0 2024-02-19T19:08:20.282 INFO:tasks.workunit.client.0.smithi046.stdout:8/36: link d3/l8 d3/la 0 2024-02-19T19:08:20.283 INFO:tasks.workunit.client.0.smithi046.stdout:0/34: unlink d0/f5 0 2024-02-19T19:08:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:3/18: rename c2 to c5 0 2024-02-19T19:08:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:1/65: link d5/f6 d5/f12 0 2024-02-19T19:08:20.287 INFO:tasks.workunit.client.0.smithi046.stdout:2/78: symlink d5/l14 0 2024-02-19T19:08:20.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/42: creat d2/f9 x:0 0 0 2024-02-19T19:08:20.292 INFO:tasks.workunit.client.0.smithi046.stdout:4/35: mkdir d6/df 0 2024-02-19T19:08:20.292 INFO:tasks.workunit.client.0.smithi046.stdout:3/19: dread f3 [0,4194304] 0 2024-02-19T19:08:20.293 INFO:tasks.workunit.client.0.smithi046.stdout:6/24: read d4/f7 [13934,120587] 0 2024-02-19T19:08:20.293 INFO:tasks.workunit.client.0.smithi046.stdout:6/25: chown l2 0 1 2024-02-19T19:08:20.293 INFO:tasks.workunit.client.0.smithi046.stdout:0/35: creat d0/d4/db/fc x:0 0 0 2024-02-19T19:08:20.294 INFO:tasks.workunit.client.0.smithi046.stdout:0/36: write d0/d4/f6 [702354,5024] 0 2024-02-19T19:08:20.294 INFO:tasks.workunit.client.0.smithi046.stdout:0/37: chown d0/d4/db/fc 0 1 2024-02-19T19:08:20.294 INFO:tasks.workunit.client.0.smithi046.stdout:0/38: creat d0/d4/fd x:0 0 0 2024-02-19T19:08:20.296 INFO:tasks.workunit.client.0.smithi046.stdout:1/66: unlink d5/f8 0 2024-02-19T19:08:20.296 INFO:tasks.workunit.client.0.smithi046.stdout:1/67: getdents d5/d10 0 2024-02-19T19:08:20.297 INFO:tasks.workunit.client.0.smithi046.stdout:7/122: getdents d0 0 2024-02-19T19:08:20.298 INFO:tasks.workunit.client.0.smithi046.stdout:5/43: mknod d2/ca 0 2024-02-19T19:08:20.298 INFO:tasks.workunit.client.0.smithi046.stdout:5/44: chown d2 3685 1 2024-02-19T19:08:20.299 INFO:tasks.workunit.client.0.smithi046.stdout:7/123: dread d0/ff [0,4194304] 0 2024-02-19T19:08:20.300 INFO:tasks.workunit.client.0.smithi046.stdout:7/124: fdatasync d0/d4/f1a 0 2024-02-19T19:08:20.301 INFO:tasks.workunit.client.0.smithi046.stdout:8/37: dwrite d3/f4 [0,4194304] 0 2024-02-19T19:08:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:3/20: mknod c6 0 2024-02-19T19:08:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:3/21: chown f3 7 1 2024-02-19T19:08:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:3/22: chown c5 113339966 1 2024-02-19T19:08:20.309 INFO:tasks.workunit.client.0.smithi046.stdout:4/36: dread f4 [0,4194304] 0 2024-02-19T19:08:20.309 INFO:tasks.workunit.client.0.smithi046.stdout:4/37: truncate d6/fb 871569 0 2024-02-19T19:08:20.309 INFO:tasks.workunit.client.0.smithi046.stdout:0/39: symlink d0/le 0 2024-02-19T19:08:20.309 INFO:tasks.workunit.client.0.smithi046.stdout:0/40: fsync d0/d4/d8/f9 0 2024-02-19T19:08:20.311 INFO:tasks.workunit.client.0.smithi046.stdout:1/68: mkdir d5/d13 0 2024-02-19T19:08:20.311 INFO:tasks.workunit.client.0.smithi046.stdout:1/69: truncate d5/fd 623839 0 2024-02-19T19:08:20.312 INFO:tasks.workunit.client.0.smithi046.stdout:5/45: link d2/f6 d2/fb 0 2024-02-19T19:08:20.312 INFO:tasks.workunit.client.0.smithi046.stdout:0/41: dread d0/f3 [0,4194304] 0 2024-02-19T19:08:20.312 INFO:tasks.workunit.client.0.smithi046.stdout:0/42: write d0/d4/db/fc [274232,49682] 0 2024-02-19T19:08:20.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/125: rename d0/d4/l13 to d0/l20 0 2024-02-19T19:08:20.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/38: mknod d3/cb 0 2024-02-19T19:08:20.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/39: fsync d3/f7 0 2024-02-19T19:08:20.314 INFO:tasks.workunit.client.0.smithi046.stdout:6/26: rmdir d4 39 2024-02-19T19:08:20.318 INFO:tasks.workunit.client.0.smithi046.stdout:5/46: mknod d2/cc 0 2024-02-19T19:08:20.318 INFO:tasks.workunit.client.0.smithi046.stdout:5/47: read - d2/f9 zero size 2024-02-19T19:08:20.318 INFO:tasks.workunit.client.0.smithi046.stdout:5/48: chown d2/cc 57316 1 2024-02-19T19:08:20.320 INFO:tasks.workunit.client.0.smithi046.stdout:0/43: rmdir d0/da 0 2024-02-19T19:08:20.321 INFO:tasks.workunit.client.0.smithi046.stdout:0/44: dread d0/f1 [0,4194304] 0 2024-02-19T19:08:20.321 INFO:tasks.workunit.client.0.smithi046.stdout:0/45: dread - d0/d4/fd zero size 2024-02-19T19:08:20.322 INFO:tasks.workunit.client.0.smithi046.stdout:7/126: creat d0/f21 x:0 0 0 2024-02-19T19:08:20.322 INFO:tasks.workunit.client.0.smithi046.stdout:7/127: chown d0/l20 369688 1 2024-02-19T19:08:20.322 INFO:tasks.workunit.client.0.smithi046.stdout:8/40: symlink d3/lc 0 2024-02-19T19:08:20.324 INFO:tasks.workunit.client.0.smithi046.stdout:6/27: mknod d4/ca 0 2024-02-19T19:08:20.325 INFO:tasks.workunit.client.0.smithi046.stdout:4/38: rmdir d6 39 2024-02-19T19:08:20.327 INFO:tasks.workunit.client.0.smithi046.stdout:4/39: read d6/f9 [498624,40918] 0 2024-02-19T19:08:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:1/70: dwrite d5/fd [0,4194304] 0 2024-02-19T19:08:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:5/49: mkdir d2/dd 0 2024-02-19T19:08:20.328 INFO:tasks.workunit.client.0.smithi046.stdout:5/50: write d2/f6 [690145,106857] 0 2024-02-19T19:08:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:3/23: dwrite f3 [0,4194304] 0 2024-02-19T19:08:20.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/128: mkdir d0/d22 0 2024-02-19T19:08:20.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/41: mkdir d3/dd 0 2024-02-19T19:08:20.334 INFO:tasks.workunit.client.0.smithi046.stdout:7/129: dread d0/d4/f8 [0,4194304] 0 2024-02-19T19:08:20.336 INFO:tasks.workunit.client.0.smithi046.stdout:7/130: dread d0/f18 [0,4194304] 0 2024-02-19T19:08:20.342 INFO:tasks.workunit.client.0.smithi046.stdout:1/71: creat d5/d13/f14 x:0 0 0 2024-02-19T19:08:20.345 INFO:tasks.workunit.client.0.smithi046.stdout:3/24: mknod c7 0 2024-02-19T19:08:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:8/42: creat d3/dd/fe x:0 0 0 2024-02-19T19:08:20.347 INFO:tasks.workunit.client.0.smithi046.stdout:8/43: creat d3/dd/ff x:0 0 0 2024-02-19T19:08:20.349 INFO:tasks.workunit.client.0.smithi046.stdout:7/131: creat d0/d4/f23 x:0 0 0 2024-02-19T19:08:20.351 INFO:tasks.workunit.client.0.smithi046.stdout:4/40: dwrite d6/f9 [0,4194304] 0 2024-02-19T19:08:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:0/46: dwrite d0/f2 [0,4194304] 0 2024-02-19T19:08:20.352 INFO:tasks.workunit.client.0.smithi046.stdout:1/72: truncate d5/f6 1948489 0 2024-02-19T19:08:20.355 INFO:tasks.workunit.client.0.smithi046.stdout:3/25: dwrite f3 [4194304,4194304] 0 2024-02-19T19:08:20.356 INFO:tasks.workunit.client.0.smithi046.stdout:7/132: fdatasync d0/d4/f7 0 2024-02-19T19:08:20.356 INFO:tasks.workunit.client.0.smithi046.stdout:7/133: write d0/f21 [221654,105748] 0 2024-02-19T19:08:20.359 INFO:tasks.workunit.client.0.smithi046.stdout:4/41: creat d6/f10 x:0 0 0 2024-02-19T19:08:20.363 INFO:tasks.workunit.client.0.smithi046.stdout:0/47: mkdir d0/d4/df 0 2024-02-19T19:08:20.364 INFO:tasks.workunit.client.0.smithi046.stdout:1/73: rename d5/lb to d5/d13/l15 0 2024-02-19T19:08:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:8/44: getdents d3 0 2024-02-19T19:08:20.365 INFO:tasks.workunit.client.0.smithi046.stdout:8/45: dread - d3/f9 zero size 2024-02-19T19:08:20.366 INFO:tasks.workunit.client.0.smithi046.stdout:3/26: rename f3 to f8 0 2024-02-19T19:08:20.368 INFO:tasks.workunit.client.0.smithi046.stdout:7/134: unlink d0/d4/f1a 0 2024-02-19T19:08:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:0/48: symlink d0/d4/db/l10 0 2024-02-19T19:08:20.372 INFO:tasks.workunit.client.0.smithi046.stdout:8/46: dread d3/f4 [0,4194304] 0 2024-02-19T19:08:20.372 INFO:tasks.workunit.client.0.smithi046.stdout:1/74: mknod d5/c16 0 2024-02-19T19:08:20.373 INFO:tasks.workunit.client.0.smithi046.stdout:0/49: dread d0/f1 [0,4194304] 0 2024-02-19T19:08:20.374 INFO:tasks.workunit.client.0.smithi046.stdout:8/47: creat d3/f10 x:0 0 0 2024-02-19T19:08:20.375 INFO:tasks.workunit.client.0.smithi046.stdout:1/75: write d5/f12 [2184192,85246] 0 2024-02-19T19:08:20.375 INFO:tasks.workunit.client.0.smithi046.stdout:3/27: read f8 [3150873,86547] 0 2024-02-19T19:08:20.375 INFO:tasks.workunit.client.0.smithi046.stdout:8/48: mkdir d3/dd/d11 0 2024-02-19T19:08:20.384 INFO:tasks.workunit.client.0.smithi046.stdout:1/76: read d5/f12 [542385,96482] 0 2024-02-19T19:08:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:7/135: rmdir d0/d4 39 2024-02-19T19:08:20.390 INFO:tasks.workunit.client.0.smithi046.stdout:7/136: dread - d0/d4/f23 zero size 2024-02-19T19:08:20.393 INFO:tasks.workunit.client.0.smithi046.stdout:3/28: dwrite f8 [4194304,4194304] 0 2024-02-19T19:08:20.394 INFO:tasks.workunit.client.0.smithi046.stdout:8/49: dwrite d3/f4 [0,4194304] 0 2024-02-19T19:08:20.394 INFO:tasks.workunit.client.0.smithi046.stdout:8/50: creat d3/dd/f12 x:0 0 0 2024-02-19T19:08:20.395 INFO:tasks.workunit.client.0.smithi046.stdout:7/137: rename d0/d22 to d0/d4/d24 0 2024-02-19T19:08:20.403 INFO:tasks.workunit.client.0.smithi046.stdout:8/51: write d3/f4 [2988569,35248] 0 2024-02-19T19:08:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:1/77: dwrite d5/f12 [0,4194304] 0 2024-02-19T19:08:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:1/78: chown d5/l11 1036473588 1 2024-02-19T19:08:20.408 INFO:tasks.workunit.client.0.smithi046.stdout:8/52: mkdir d3/dd/d13 0 2024-02-19T19:08:20.412 INFO:tasks.workunit.client.0.smithi046.stdout:3/29: dwrite f8 [0,4194304] 0 2024-02-19T19:08:20.415 INFO:tasks.workunit.client.0.smithi046.stdout:1/79: creat d5/f17 x:0 0 0 2024-02-19T19:08:20.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/53: dread d3/f4 [0,4194304] 0 2024-02-19T19:08:20.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/54: getdents d3/dd/d11 0 2024-02-19T19:08:20.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/55: creat d3/dd/f14 x:0 0 0 2024-02-19T19:08:20.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/56: truncate d3/f10 607194 0 2024-02-19T19:08:20.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/57: truncate d3/dd/f14 33875 0 2024-02-19T19:08:20.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/58: write d3/f4 [3695439,55322] 0 2024-02-19T19:08:20.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/59: creat d3/dd/f15 x:0 0 0 2024-02-19T19:08:20.419 INFO:tasks.workunit.client.0.smithi046.stdout:1/80: symlink d5/d10/l18 0 2024-02-19T19:08:20.419 INFO:tasks.workunit.client.0.smithi046.stdout:1/81: write d5/fc [994530,37129] 0 2024-02-19T19:08:20.420 INFO:tasks.workunit.client.0.smithi046.stdout:7/138: dwrite d0/d4/f8 [4194304,4194304] 0 2024-02-19T19:08:20.425 INFO:tasks.workunit.client.0.smithi046.stdout:8/60: link d3/cb d3/dd/c16 0 2024-02-19T19:08:20.425 INFO:tasks.workunit.client.0.smithi046.stdout:8/61: chown d3/lc 27 1 2024-02-19T19:08:20.426 INFO:tasks.workunit.client.0.smithi046.stdout:1/82: write d5/fd [3073132,56549] 0 2024-02-19T19:08:20.426 INFO:tasks.workunit.client.0.smithi046.stdout:1/83: chown d5/f12 724500 1 2024-02-19T19:08:20.426 INFO:tasks.workunit.client.0.smithi046.stdout:3/30: getdents . 0 2024-02-19T19:08:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:7/139: symlink d0/d4/dd/l25 0 2024-02-19T19:08:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:1/84: read d5/fc [122112,123171] 0 2024-02-19T19:08:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:1/85: fdatasync d5/d13/f14 0 2024-02-19T19:08:20.428 INFO:tasks.workunit.client.0.smithi046.stdout:1/86: creat d5/d13/f19 x:0 0 0 2024-02-19T19:08:20.441 INFO:tasks.workunit.client.0.smithi046.stdout:7/140: write d0/f1b [131932,109505] 0 2024-02-19T19:08:20.441 INFO:tasks.workunit.client.0.smithi046.stdout:7/141: fdatasync d0/d4/f7 0 2024-02-19T19:08:20.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/62: dwrite d3/dd/f12 [0,4194304] 0 2024-02-19T19:08:20.443 INFO:tasks.workunit.client.0.smithi046.stdout:7/142: symlink d0/d4/dd/l26 0 2024-02-19T19:08:20.446 INFO:tasks.workunit.client.0.smithi046.stdout:9/34: sync 2024-02-19T19:08:20.446 INFO:tasks.workunit.client.0.smithi046.stdout:9/35: dread - f6 zero size 2024-02-19T19:08:20.446 INFO:tasks.workunit.client.0.smithi046.stdout:9/36: chown f6 52562072 1 2024-02-19T19:08:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:8/63: mknod d3/c17 0 2024-02-19T19:08:20.449 INFO:tasks.workunit.client.0.smithi046.stdout:8/64: readlink d3/la 0 2024-02-19T19:08:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:7/143: symlink d0/d4/dd/l27 0 2024-02-19T19:08:20.453 INFO:tasks.workunit.client.0.smithi046.stdout:9/37: symlink l8 0 2024-02-19T19:08:20.467 INFO:tasks.workunit.client.0.smithi046.stdout:9/38: dwrite f7 [0,4194304] 0 2024-02-19T19:08:20.469 INFO:tasks.workunit.client.0.smithi046.stdout:8/65: dwrite d3/dd/f12 [4194304,4194304] 0 2024-02-19T19:08:20.470 INFO:tasks.workunit.client.0.smithi046.stdout:9/39: symlink l9 0 2024-02-19T19:08:20.474 INFO:tasks.workunit.client.0.smithi046.stdout:8/66: mkdir d3/d18 0 2024-02-19T19:08:20.474 INFO:tasks.workunit.client.0.smithi046.stdout:8/67: truncate d3/dd/f14 141066 0 2024-02-19T19:08:20.476 INFO:tasks.workunit.client.0.smithi046.stdout:9/40: link f7 fa 0 2024-02-19T19:08:20.483 INFO:tasks.workunit.client.0.smithi046.stdout:8/68: dread d3/dd/f12 [0,4194304] 0 2024-02-19T19:08:20.485 INFO:tasks.workunit.client.0.smithi046.stdout:8/69: mknod d3/c19 0 2024-02-19T19:08:20.485 INFO:tasks.workunit.client.0.smithi046.stdout:8/70: truncate d3/dd/fe 959254 0 2024-02-19T19:08:20.485 INFO:tasks.workunit.client.0.smithi046.stdout:8/71: write d3/dd/f15 [406942,49302] 0 2024-02-19T19:08:20.491 INFO:tasks.workunit.client.0.smithi046.stdout:9/41: dwrite f0 [4194304,4194304] 0 2024-02-19T19:08:20.499 INFO:tasks.workunit.client.0.smithi046.stdout:8/72: dwrite d3/f4 [0,4194304] 0 2024-02-19T19:08:20.502 INFO:tasks.workunit.client.0.smithi046.stdout:9/42: fsync fa 0 2024-02-19T19:08:20.502 INFO:tasks.workunit.client.0.smithi046.stdout:9/43: write f2 [4772753,31587] 0 2024-02-19T19:08:20.502 INFO:tasks.workunit.client.0.smithi046.stdout:8/73: creat d3/d18/f1a x:0 0 0 2024-02-19T19:08:20.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/74: chown d3/dd/f15 2 1 2024-02-19T19:08:20.505 INFO:tasks.workunit.client.0.smithi046.stdout:8/75: unlink d3/c17 0 2024-02-19T19:08:20.505 INFO:tasks.workunit.client.0.smithi046.stdout:8/76: write d3/dd/f14 [191820,33821] 0 2024-02-19T19:08:20.517 INFO:tasks.workunit.client.0.smithi046.stdout:9/44: dwrite fa [0,4194304] 0 2024-02-19T19:08:20.517 INFO:tasks.workunit.client.0.smithi046.stdout:9/45: write f6 [1012738,85490] 0 2024-02-19T19:08:20.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/46: read fa [1351410,105093] 0 2024-02-19T19:08:20.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/47: stat f7 0 2024-02-19T19:08:20.527 INFO:tasks.workunit.client.0.smithi046.stdout:9/48: mkdir db 0 2024-02-19T19:08:20.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/49: mknod db/cc 0 2024-02-19T19:08:20.534 INFO:tasks.workunit.client.0.smithi046.stdout:9/50: dread f6 [0,4194304] 0 2024-02-19T19:08:20.545 INFO:tasks.workunit.client.0.smithi046.stdout:9/51: mknod db/cd 0 2024-02-19T19:08:20.545 INFO:tasks.workunit.client.0.smithi046.stdout:9/52: fdatasync f7 0 2024-02-19T19:08:20.547 INFO:tasks.workunit.client.0.smithi046.stdout:9/53: symlink db/le 0 2024-02-19T19:08:20.548 INFO:tasks.workunit.client.0.smithi046.stdout:9/54: write f2 [4473584,632] 0 2024-02-19T19:08:20.551 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:20 smithi046 podman[112239]: 2024-02-19 19:08:20.199743806 +0000 UTC m=+2.646887184 container remove c70e9fff41d15d5d324919b4d0462f69d0359b61f8c6f141327a6521b459b717 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux ) 2024-02-19T19:08:20.551 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:20 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-19T19:08:20.551 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:20 smithi046 systemd[1]: Stopped Ceph osd.2 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:08:20.551 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:20 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.2.service: Consumed 25.776s CPU time. 2024-02-19T19:08:20.555 INFO:tasks.workunit.client.0.smithi046.stdout:5/51: sync 2024-02-19T19:08:20.555 INFO:tasks.workunit.client.0.smithi046.stdout:2/79: sync 2024-02-19T19:08:20.555 INFO:tasks.workunit.client.0.smithi046.stdout:0/50: sync 2024-02-19T19:08:20.556 INFO:tasks.workunit.client.0.smithi046.stdout:4/42: sync 2024-02-19T19:08:20.556 INFO:tasks.workunit.client.0.smithi046.stdout:6/28: sync 2024-02-19T19:08:20.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/52: fsync d2/f5 0 2024-02-19T19:08:20.556 INFO:tasks.workunit.client.0.smithi046.stdout:0/51: write d0/d4/fd [596946,107134] 0 2024-02-19T19:08:20.557 INFO:tasks.workunit.client.0.smithi046.stdout:4/43: unlink d6/f10 0 2024-02-19T19:08:20.557 INFO:tasks.workunit.client.0.smithi046.stdout:4/44: fdatasync f4 0 2024-02-19T19:08:20.558 INFO:tasks.workunit.client.0.smithi046.stdout:6/29: mkdir d4/db 0 2024-02-19T19:08:20.558 INFO:tasks.workunit.client.0.smithi046.stdout:6/30: chown l2 7 1 2024-02-19T19:08:20.560 INFO:tasks.workunit.client.0.smithi046.stdout:0/52: link d0/d4/db/l10 d0/l11 0 2024-02-19T19:08:20.562 INFO:tasks.workunit.client.0.smithi046.stdout:2/80: dread d5/d6/fd [0,4194304] 0 2024-02-19T19:08:20.562 INFO:tasks.workunit.client.0.smithi046.stdout:2/81: getdents d5/d6/d13 0 2024-02-19T19:08:20.565 INFO:tasks.workunit.client.0.smithi046.stdout:4/45: mkdir d6/d11 0 2024-02-19T19:08:20.565 INFO:tasks.workunit.client.0.smithi046.stdout:6/31: creat d4/db/fc x:0 0 0 2024-02-19T19:08:20.565 INFO:tasks.workunit.client.0.smithi046.stdout:6/32: fdatasync d4/f8 0 2024-02-19T19:08:20.566 INFO:tasks.workunit.client.0.smithi046.stdout:5/53: write d2/f3 [1743231,120199] 0 2024-02-19T19:08:20.568 INFO:tasks.workunit.client.0.smithi046.stdout:2/82: mknod d5/d6/c15 0 2024-02-19T19:08:20.572 INFO:tasks.workunit.client.0.smithi046.stdout:5/54: rename d2/cc to d2/dd/ce 0 2024-02-19T19:08:20.573 INFO:tasks.workunit.client.0.smithi046.stdout:0/53: rmdir d0/d4/db 39 2024-02-19T19:08:20.578 INFO:tasks.workunit.client.0.smithi046.stdout:5/55: link d2/f5 d2/dd/ff 0 2024-02-19T19:08:20.578 INFO:tasks.workunit.client.0.smithi046.stdout:5/56: chown d2/fb 192 1 2024-02-19T19:08:20.579 INFO:tasks.workunit.client.0.smithi046.stdout:0/54: mknod d0/d4/db/c12 0 2024-02-19T19:08:20.579 INFO:tasks.workunit.client.0.smithi046.stdout:4/46: dread d6/f9 [0,4194304] 0 2024-02-19T19:08:20.581 INFO:tasks.workunit.client.0.smithi046.stdout:0/55: rename d0/f1 to d0/f13 0 2024-02-19T19:08:20.581 INFO:tasks.workunit.client.0.smithi046.stdout:0/56: rename d0/d4/db to d0/d4/db/d14 22 2024-02-19T19:08:20.582 INFO:tasks.workunit.client.0.smithi046.stdout:0/57: write d0/d4/d8/f9 [614657,71800] 0 2024-02-19T19:08:20.582 INFO:tasks.workunit.client.0.smithi046.stdout:4/47: symlink d6/df/l12 0 2024-02-19T19:08:20.583 INFO:tasks.workunit.client.0.smithi046.stdout:4/48: chown d6 221 1 2024-02-19T19:08:20.583 INFO:tasks.workunit.client.0.smithi046.stdout:4/49: creat d6/f13 x:0 0 0 2024-02-19T19:08:20.584 INFO:tasks.workunit.client.0.smithi046.stdout:0/58: creat d0/d4/d8/f15 x:0 0 0 2024-02-19T19:08:20.584 INFO:tasks.workunit.client.0.smithi046.stdout:0/59: truncate d0/d4/d8/f9 1352871 0 2024-02-19T19:08:20.586 INFO:tasks.workunit.client.0.smithi046.stdout:5/57: dread d2/dd/ff [0,4194304] 0 2024-02-19T19:08:20.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/58: chown d2/dd/ff 51628 1 2024-02-19T19:08:20.587 INFO:tasks.workunit.client.0.smithi046.stdout:4/50: rename f4 to d6/df/f14 0 2024-02-19T19:08:20.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/60: rmdir d0/d4/df 0 2024-02-19T19:08:20.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/61: truncate d0/d4/d8/f15 942513 0 2024-02-19T19:08:20.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/62: creat d0/d4/f16 x:0 0 0 2024-02-19T19:08:20.590 INFO:tasks.workunit.client.0.smithi046.stdout:0/63: chown d0/d4/db/l10 452 1 2024-02-19T19:08:20.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/51: unlink d6/f13 0 2024-02-19T19:08:20.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/52: chown c2 4441 1 2024-02-19T19:08:20.591 INFO:tasks.workunit.client.0.smithi046.stdout:6/33: dwrite d4/db/fc [0,4194304] 0 2024-02-19T19:08:20.595 INFO:tasks.workunit.client.0.smithi046.stdout:4/53: mkdir d6/d15 0 2024-02-19T19:08:20.596 INFO:tasks.workunit.client.0.smithi046.stdout:2/83: dwrite f1 [0,4194304] 0 2024-02-19T19:08:20.600 INFO:tasks.workunit.client.0.smithi046.stdout:4/54: mknod d6/df/c16 0 2024-02-19T19:08:20.605 INFO:tasks.workunit.client.0.smithi046.stdout:2/84: creat d5/d6/d13/f16 x:0 0 0 2024-02-19T19:08:20.605 INFO:tasks.workunit.client.0.smithi046.stdout:6/34: dread d4/f5 [0,4194304] 0 2024-02-19T19:08:20.605 INFO:tasks.workunit.client.0.smithi046.stdout:4/55: mkdir d6/d15/d17 0 2024-02-19T19:08:20.605 INFO:tasks.workunit.client.0.smithi046.stdout:4/56: chown d6/la 288687263 1 2024-02-19T19:08:20.605 INFO:tasks.workunit.client.0.smithi046.stdout:4/57: write d6/fb [672019,106109] 0 2024-02-19T19:08:20.608 INFO:tasks.workunit.client.0.smithi046.stdout:6/35: mkdir d4/d6/dd 0 2024-02-19T19:08:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:5/59: dwrite d2/f6 [0,4194304] 0 2024-02-19T19:08:20.609 INFO:tasks.workunit.client.0.smithi046.stdout:5/60: chown d2/dd/ff 1160480024 1 2024-02-19T19:08:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:2/85: dread d5/d6/fd [0,4194304] 0 2024-02-19T19:08:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:0/64: dwrite d0/d4/f6 [0,4194304] 0 2024-02-19T19:08:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/61: unlink d2/dd/ff 0 2024-02-19T19:08:20.616 INFO:tasks.workunit.client.0.smithi046.stdout:2/86: rename l0 to d5/l17 0 2024-02-19T19:08:20.616 INFO:tasks.workunit.client.0.smithi046.stdout:2/87: chown d5/f11 14433 1 2024-02-19T19:08:20.626 INFO:tasks.workunit.client.0.smithi046.stdout:2/88: mknod d5/df/c18 0 2024-02-19T19:08:20.626 INFO:tasks.workunit.client.0.smithi046.stdout:2/89: chown d5/df/c18 3481632 1 2024-02-19T19:08:20.628 INFO:tasks.workunit.client.0.smithi046.stdout:2/90: mknod d5/df/c19 0 2024-02-19T19:08:20.628 INFO:tasks.workunit.client.0.smithi046.stdout:2/91: truncate d5/d6/fc 941266 0 2024-02-19T19:08:20.628 INFO:tasks.workunit.client.0.smithi046.stdout:2/92: chown d5/df/c19 1 1 2024-02-19T19:08:20.665 INFO:tasks.workunit.client.0.smithi046.stdout:3/31: sync 2024-02-19T19:08:20.666 INFO:tasks.workunit.client.0.smithi046.stdout:3/32: link l4 l9 0 2024-02-19T19:08:20.667 INFO:tasks.workunit.client.0.smithi046.stdout:3/33: mkdir da 0 2024-02-19T19:08:20.667 INFO:tasks.workunit.client.0.smithi046.stdout:3/34: chown l1 62967 1 2024-02-19T19:08:20.668 INFO:tasks.workunit.client.0.smithi046.stdout:7/144: sync 2024-02-19T19:08:20.668 INFO:tasks.workunit.client.0.smithi046.stdout:1/87: sync 2024-02-19T19:08:20.669 INFO:tasks.workunit.client.0.smithi046.stdout:1/88: symlink d5/d13/l1a 0 2024-02-19T19:08:20.670 INFO:tasks.workunit.client.0.smithi046.stdout:1/89: mknod d5/d10/c1b 0 2024-02-19T19:08:20.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/90: rename d5/d10/c1b to d5/d10/c1c 0 2024-02-19T19:08:20.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/91: chown c2 83 1 2024-02-19T19:08:20.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/92: unlink c2 0 2024-02-19T19:08:20.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/93: write d5/d13/f14 [551934,19355] 0 2024-02-19T19:08:20.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/94: fsync d5/f12 0 2024-02-19T19:08:20.675 INFO:tasks.workunit.client.0.smithi046.stdout:1/95: symlink d5/d10/l1d 0 2024-02-19T19:08:20.675 INFO:tasks.workunit.client.0.smithi046.stdout:1/96: dread - d5/f17 zero size 2024-02-19T19:08:20.675 INFO:tasks.workunit.client.0.smithi046.stdout:1/97: rename d5/d10 to d5/d10/d1e 22 2024-02-19T19:08:20.676 INFO:tasks.workunit.client.0.smithi046.stdout:3/35: write f8 [6421559,40081] 0 2024-02-19T19:08:20.681 INFO:tasks.workunit.client.0.smithi046.stdout:7/145: dwrite d0/d4/dd/f10 [0,4194304] 0 2024-02-19T19:08:20.681 INFO:tasks.workunit.client.0.smithi046.stdout:7/146: chown d0/c17 490 1 2024-02-19T19:08:20.681 INFO:tasks.workunit.client.0.smithi046.stdout:7/147: chown d0/l20 645106 1 2024-02-19T19:08:20.681 INFO:tasks.workunit.client.0.smithi046.stdout:7/148: chown d0/c17 380554827 1 2024-02-19T19:08:20.681 INFO:tasks.workunit.client.0.smithi046.stdout:7/149: readlink d0/d4/l12 0 2024-02-19T19:08:20.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/98: getdents d5/d13 0 2024-02-19T19:08:20.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/99: creat d5/f1f x:0 0 0 2024-02-19T19:08:20.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/100: write d5/f17 [11344,80502] 0 2024-02-19T19:08:20.685 INFO:tasks.workunit.client.0.smithi046.stdout:7/150: unlink d0/f21 0 2024-02-19T19:08:20.685 INFO:tasks.workunit.client.0.smithi046.stdout:7/151: stat d0/f1b 0 2024-02-19T19:08:20.687 INFO:tasks.workunit.client.0.smithi046.stdout:7/152: dread d0/f18 [0,4194304] 0 2024-02-19T19:08:20.695 INFO:tasks.workunit.client.0.smithi046.stdout:1/101: mknod d5/c20 0 2024-02-19T19:08:20.697 INFO:tasks.workunit.client.0.smithi046.stdout:1/102: mkdir d5/d21 0 2024-02-19T19:08:20.698 INFO:tasks.workunit.client.0.smithi046.stdout:3/36: truncate f8 8092137 0 2024-02-19T19:08:20.701 INFO:tasks.workunit.client.0.smithi046.stdout:1/103: symlink d5/l22 0 2024-02-19T19:08:20.701 INFO:tasks.workunit.client.0.smithi046.stdout:1/104: stat d5/l9 0 2024-02-19T19:08:20.702 INFO:tasks.workunit.client.0.smithi046.stdout:3/37: stat l9 0 2024-02-19T19:08:20.705 INFO:tasks.workunit.client.0.smithi046.stdout:7/153: rename d0/d4/l9 to d0/d4/l28 0 2024-02-19T19:08:20.705 INFO:tasks.workunit.client.0.smithi046.stdout:7/154: stat d0/d4/f7 0 2024-02-19T19:08:20.707 INFO:tasks.workunit.client.0.smithi046.stdout:1/105: dread d5/f6 [0,4194304] 0 2024-02-19T19:08:20.711 INFO:tasks.workunit.client.0.smithi046.stdout:1/106: unlink d5/d13/l1a 0 2024-02-19T19:08:20.711 INFO:tasks.workunit.client.0.smithi046.stdout:1/107: write d5/fc [1788481,13404] 0 2024-02-19T19:08:20.714 INFO:tasks.workunit.client.0.smithi046.stdout:7/155: link d0/f1b d0/d4/f29 0 2024-02-19T19:08:20.719 INFO:tasks.workunit.client.0.smithi046.stdout:7/156: mkdir d0/d4/d2a 0 2024-02-19T19:08:20.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/38: write f8 [3429483,123370] 0 2024-02-19T19:08:20.720 INFO:tasks.workunit.client.0.smithi046.stdout:7/157: stat d0/c11 0 2024-02-19T19:08:20.722 INFO:tasks.workunit.client.0.smithi046.stdout:7/158: dread d0/ff [0,4194304] 0 2024-02-19T19:08:20.726 INFO:tasks.workunit.client.0.smithi046.stdout:7/159: symlink d0/d4/l2b 0 2024-02-19T19:08:20.730 INFO:tasks.workunit.client.0.smithi046.stdout:7/160: creat d0/d4/d2a/f2c x:0 0 0 2024-02-19T19:08:20.731 INFO:tasks.workunit.client.0.smithi046.stdout:7/161: mknod d0/d4/d2a/c2d 0 2024-02-19T19:08:20.731 INFO:tasks.workunit.client.0.smithi046.stdout:7/162: chown d0/d4/dd 2668 1 2024-02-19T19:08:20.734 INFO:tasks.workunit.client.0.smithi046.stdout:1/108: dwrite d5/f17 [0,4194304] 0 2024-02-19T19:08:20.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/39: dwrite f8 [0,4194304] 0 2024-02-19T19:08:20.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/40: chown c5 10943091 1 2024-02-19T19:08:20.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/41: write f8 [8346966,56785] 0 2024-02-19T19:08:20.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/42: write f8 [6558288,24071] 0 2024-02-19T19:08:20.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/43: chown l9 702180951 1 2024-02-19T19:08:20.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/44: truncate f8 8488924 0 2024-02-19T19:08:20.739 INFO:tasks.workunit.client.0.smithi046.stdout:1/109: write d5/f12 [1249885,107543] 0 2024-02-19T19:08:20.739 INFO:tasks.workunit.client.0.smithi046.stdout:1/110: dread - d5/f1f zero size 2024-02-19T19:08:20.746 INFO:tasks.workunit.client.0.smithi046.stdout:3/45: read f8 [368814,73225] 0 2024-02-19T19:08:20.746 INFO:tasks.workunit.client.0.smithi046.stdout:3/46: chown c6 74 1 2024-02-19T19:08:20.746 INFO:tasks.workunit.client.0.smithi046.stdout:7/163: rmdir d0 39 2024-02-19T19:08:20.748 INFO:tasks.workunit.client.0.smithi046.stdout:3/47: unlink l9 0 2024-02-19T19:08:20.750 INFO:tasks.workunit.client.0.smithi046.stdout:7/164: rename d0/d4/f23 to d0/d4/d24/f2e 0 2024-02-19T19:08:20.750 INFO:tasks.workunit.client.0.smithi046.stdout:7/165: fsync d0/d4/f7 0 2024-02-19T19:08:20.750 INFO:tasks.workunit.client.0.smithi046.stdout:7/166: stat d0/d4/d2a 0 2024-02-19T19:08:20.752 INFO:tasks.workunit.client.0.smithi046.stdout:3/48: symlink da/lb 0 2024-02-19T19:08:20.753 INFO:tasks.workunit.client.0.smithi046.stdout:7/167: mknod d0/c2f 0 2024-02-19T19:08:20.755 INFO:tasks.workunit.client.0.smithi046.stdout:7/168: creat d0/f30 x:0 0 0 2024-02-19T19:08:20.756 INFO:tasks.workunit.client.0.smithi046.stdout:1/111: dwrite d5/f12 [4194304,4194304] 0 2024-02-19T19:08:20.761 INFO:tasks.workunit.client.0.smithi046.stdout:1/112: unlink c3 0 2024-02-19T19:08:20.762 INFO:tasks.workunit.client.0.smithi046.stdout:7/169: dread d0/d4/f29 [0,4194304] 0 2024-02-19T19:08:20.762 INFO:tasks.workunit.client.0.smithi046.stdout:7/170: truncate d0/f18 1099201 0 2024-02-19T19:08:20.763 INFO:tasks.workunit.client.0.smithi046.stdout:1/113: unlink d5/l11 0 2024-02-19T19:08:20.764 INFO:tasks.workunit.client.0.smithi046.stdout:7/171: truncate d0/d4/dd/f10 805172 0 2024-02-19T19:08:20.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/172: symlink d0/d4/d2a/l31 0 2024-02-19T19:08:20.776 INFO:tasks.workunit.client.0.smithi046.stdout:3/49: dwrite f8 [0,4194304] 0 2024-02-19T19:08:20.778 INFO:tasks.workunit.client.0.smithi046.stdout:1/114: dwrite d5/f1f [0,4194304] 0 2024-02-19T19:08:20.778 INFO:tasks.workunit.client.0.smithi046.stdout:1/115: dread - d5/d13/f19 zero size 2024-02-19T19:08:20.779 INFO:tasks.workunit.client.0.smithi046.stdout:3/50: mknod da/cc 0 2024-02-19T19:08:20.785 INFO:tasks.workunit.client.0.smithi046.stdout:1/116: creat d5/d21/f23 x:0 0 0 2024-02-19T19:08:20.807 INFO:tasks.workunit.client.0.smithi046.stdout:7/173: read d0/d4/dd/f10 [261347,65748] 0 2024-02-19T19:08:20.808 INFO:tasks.workunit.client.0.smithi046.stdout:1/117: dwrite d5/d13/f19 [0,4194304] 0 2024-02-19T19:08:20.811 INFO:tasks.workunit.client.0.smithi046.stdout:7/174: getdents d0/d4/d2a 0 2024-02-19T19:08:20.815 INFO:tasks.workunit.client.0.smithi046.stdout:4/58: sync 2024-02-19T19:08:20.815 INFO:tasks.workunit.client.0.smithi046.stdout:8/77: sync 2024-02-19T19:08:20.815 INFO:tasks.workunit.client.0.smithi046.stdout:4/59: read d6/df/f14 [2380322,10309] 0 2024-02-19T19:08:20.815 INFO:tasks.workunit.client.0.smithi046.stdout:8/78: write d3/dd/f14 [697709,91098] 0 2024-02-19T19:08:20.815 INFO:tasks.workunit.client.0.smithi046.stdout:8/79: truncate d3/f10 1549975 0 2024-02-19T19:08:20.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/118: mknod d5/d13/c24 0 2024-02-19T19:08:20.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/119: read d5/fc [724338,59586] 0 2024-02-19T19:08:20.817 INFO:tasks.workunit.client.0.smithi046.stdout:9/55: sync 2024-02-19T19:08:20.817 INFO:tasks.workunit.client.0.smithi046.stdout:9/56: fdatasync f7 0 2024-02-19T19:08:20.817 INFO:tasks.workunit.client.0.smithi046.stdout:9/57: chown db/le 0 1 2024-02-19T19:08:20.820 INFO:tasks.workunit.client.0.smithi046.stdout:3/51: truncate f8 4511571 0 2024-02-19T19:08:20.822 INFO:tasks.workunit.client.0.smithi046.stdout:8/80: truncate d3/dd/f12 4748101 0 2024-02-19T19:08:20.822 INFO:tasks.workunit.client.0.smithi046.stdout:8/81: read - d3/f9 zero size 2024-02-19T19:08:20.823 INFO:tasks.workunit.client.0.smithi046.stdout:8/82: write d3/dd/f15 [303082,101816] 0 2024-02-19T19:08:20.826 INFO:tasks.workunit.client.0.smithi046.stdout:1/120: write d5/d13/f19 [1680142,10219] 0 2024-02-19T19:08:20.829 INFO:tasks.workunit.client.0.smithi046.stdout:9/58: rename db/le to db/lf 0 2024-02-19T19:08:20.830 INFO:tasks.workunit.client.0.smithi046.stdout:8/83: creat d3/dd/d13/f1b x:0 0 0 2024-02-19T19:08:20.830 INFO:tasks.workunit.client.0.smithi046.stdout:8/84: fdatasync d3/f7 0 2024-02-19T19:08:20.831 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:20 smithi046 systemd[1]: Starting Ceph osd.2 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:08:20.831 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:20 smithi046 podman[112339]: 2024-02-19 19:08:20.6720666 +0000 UTC m=+0.023109481 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:08:20.831 INFO:tasks.workunit.client.0.smithi046.stdout:1/121: mknod d5/d21/c25 0 2024-02-19T19:08:20.834 INFO:tasks.workunit.client.0.smithi046.stdout:8/85: mkdir d3/dd/d1c 0 2024-02-19T19:08:20.834 INFO:tasks.workunit.client.0.smithi046.stdout:8/86: readlink d3/l6 0 2024-02-19T19:08:20.836 INFO:tasks.workunit.client.0.smithi046.stdout:1/122: rename d5/f6 to d5/f26 0 2024-02-19T19:08:20.836 INFO:tasks.workunit.client.0.smithi046.stdout:1/123: write d5/d13/f14 [1266576,28356] 0 2024-02-19T19:08:20.843 INFO:tasks.workunit.client.0.smithi046.stdout:7/175: dwrite d0/d4/dd/f10 [0,4194304] 0 2024-02-19T19:08:20.843 INFO:tasks.workunit.client.0.smithi046.stdout:7/176: chown d0/d4 44020502 1 2024-02-19T19:08:20.844 INFO:tasks.workunit.client.0.smithi046.stdout:9/59: dread f2 [0,4194304] 0 2024-02-19T19:08:20.846 INFO:tasks.workunit.client.0.smithi046.stdout:8/87: dread d3/f7 [0,4194304] 0 2024-02-19T19:08:20.846 INFO:tasks.workunit.client.0.smithi046.stdout:4/60: dwrite d6/f9 [0,4194304] 0 2024-02-19T19:08:20.863 INFO:tasks.workunit.client.0.smithi046.stdout:8/88: mkdir d3/dd/d11/d1d 0 2024-02-19T19:08:20.863 INFO:tasks.workunit.client.0.smithi046.stdout:8/89: creat d3/d18/f1e x:0 0 0 2024-02-19T19:08:20.864 INFO:tasks.workunit.client.0.smithi046.stdout:8/90: creat d3/dd/d13/f1f x:0 0 0 2024-02-19T19:08:20.864 INFO:tasks.workunit.client.0.smithi046.stdout:8/91: write d3/f4 [4911333,69162] 0 2024-02-19T19:08:20.864 INFO:tasks.workunit.client.0.smithi046.stdout:8/92: creat d3/d18/f20 x:0 0 0 2024-02-19T19:08:20.864 INFO:tasks.workunit.client.0.smithi046.stdout:4/61: creat d6/d11/f18 x:0 0 0 2024-02-19T19:08:20.867 INFO:tasks.workunit.client.0.smithi046.stdout:9/60: dwrite fa [0,4194304] 0 2024-02-19T19:08:20.868 INFO:tasks.workunit.client.0.smithi046.stdout:7/177: dwrite d0/f1b [0,4194304] 0 2024-02-19T19:08:20.870 INFO:tasks.workunit.client.0.smithi046.stdout:9/61: symlink db/l10 0 2024-02-19T19:08:20.887 INFO:tasks.workunit.client.0.smithi046.stdout:9/62: dread f2 [0,4194304] 0 2024-02-19T19:08:20.889 INFO:tasks.workunit.client.0.smithi046.stdout:1/124: truncate d5/d13/f14 991990 0 2024-02-19T19:08:20.890 INFO:tasks.workunit.client.0.smithi046.stdout:1/125: creat d5/f27 x:0 0 0 2024-02-19T19:08:20.897 INFO:tasks.workunit.client.0.smithi046.stdout:3/52: dwrite f8 [4194304,4194304] 0 2024-02-19T19:08:20.903 INFO:tasks.workunit.client.0.smithi046.stdout:3/53: read f8 [4674136,67207] 0 2024-02-19T19:08:20.904 INFO:tasks.workunit.client.0.smithi046.stdout:3/54: mkdir da/dd 0 2024-02-19T19:08:20.912 INFO:tasks.workunit.client.0.smithi046.stdout:8/93: dwrite d3/f9 [0,4194304] 0 2024-02-19T19:08:20.912 INFO:tasks.workunit.client.0.smithi046.stdout:4/62: dwrite d6/d11/f18 [0,4194304] 0 2024-02-19T19:08:20.913 INFO:tasks.workunit.client.0.smithi046.stdout:7/178: dwrite d0/d4/d2a/f2c [0,4194304] 0 2024-02-19T19:08:20.914 INFO:tasks.workunit.client.0.smithi046.stdout:9/63: dwrite f0 [0,4194304] 0 2024-02-19T19:08:20.914 INFO:tasks.workunit.client.0.smithi046.stdout:1/126: fsync d5/fc 0 2024-02-19T19:08:20.918 INFO:tasks.workunit.client.0.smithi046.stdout:8/94: mknod d3/dd/c21 0 2024-02-19T19:08:20.918 INFO:tasks.workunit.client.0.smithi046.stdout:8/95: truncate d3/dd/d13/f1f 256623 0 2024-02-19T19:08:20.923 INFO:tasks.workunit.client.0.smithi046.stdout:7/179: symlink d0/d4/d24/l32 0 2024-02-19T19:08:20.923 INFO:tasks.workunit.client.0.smithi046.stdout:7/180: chown d0/f1b 98398 1 2024-02-19T19:08:20.925 INFO:tasks.workunit.client.0.smithi046.stdout:9/64: rename l8 to db/l11 0 2024-02-19T19:08:20.927 INFO:tasks.workunit.client.0.smithi046.stdout:7/181: creat d0/d4/d2a/f33 x:0 0 0 2024-02-19T19:08:20.930 INFO:tasks.workunit.client.0.smithi046.stdout:4/63: read d6/d11/f18 [407001,91057] 0 2024-02-19T19:08:20.931 INFO:tasks.workunit.client.0.smithi046.stdout:8/96: rename d3/dd/c16 to d3/dd/d1c/c22 0 2024-02-19T19:08:20.931 INFO:tasks.workunit.client.0.smithi046.stdout:1/127: fsync d5/f27 0 2024-02-19T19:08:20.932 INFO:tasks.workunit.client.0.smithi046.stdout:4/64: dread d6/fb [0,4194304] 0 2024-02-19T19:08:20.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/65: mknod db/c12 0 2024-02-19T19:08:20.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/66: chown c1 0 1 2024-02-19T19:08:20.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/67: fsync f7 0 2024-02-19T19:08:20.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/68: chown db/l11 96664010 1 2024-02-19T19:08:20.933 INFO:tasks.workunit.client.0.smithi046.stdout:2/93: sync 2024-02-19T19:08:20.933 INFO:tasks.workunit.client.0.smithi046.stdout:6/36: sync 2024-02-19T19:08:20.933 INFO:tasks.workunit.client.0.smithi046.stdout:5/62: sync 2024-02-19T19:08:20.933 INFO:tasks.workunit.client.0.smithi046.stdout:0/65: sync 2024-02-19T19:08:20.933 INFO:tasks.workunit.client.0.smithi046.stdout:5/63: creat d2/f10 x:0 0 0 2024-02-19T19:08:20.933 INFO:tasks.workunit.client.0.smithi046.stdout:0/66: creat d0/f17 x:0 0 0 2024-02-19T19:08:20.937 INFO:tasks.workunit.client.0.smithi046.stdout:3/55: truncate f8 490470 0 2024-02-19T19:08:20.940 INFO:tasks.workunit.client.0.smithi046.stdout:9/69: dread f0 [4194304,4194304] 0 2024-02-19T19:08:20.941 INFO:tasks.workunit.client.0.smithi046.stdout:9/70: fsync f6 0 2024-02-19T19:08:20.942 INFO:tasks.workunit.client.0.smithi046.stdout:0/67: write d0/f2 [564906,39123] 0 2024-02-19T19:08:20.942 INFO:tasks.workunit.client.0.smithi046.stdout:8/97: mknod d3/dd/d1c/c23 0 2024-02-19T19:08:20.942 INFO:tasks.workunit.client.0.smithi046.stdout:8/98: creat d3/dd/f24 x:0 0 0 2024-02-19T19:08:20.942 INFO:tasks.workunit.client.0.smithi046.stdout:8/99: fdatasync d3/dd/d13/f1b 0 2024-02-19T19:08:20.944 INFO:tasks.workunit.client.0.smithi046.stdout:1/128: unlink d5/fd 0 2024-02-19T19:08:20.944 INFO:tasks.workunit.client.0.smithi046.stdout:1/129: write d5/fc [136666,47060] 0 2024-02-19T19:08:20.945 INFO:tasks.workunit.client.0.smithi046.stdout:4/65: write d6/f9 [680812,44218] 0 2024-02-19T19:08:20.945 INFO:tasks.workunit.client.0.smithi046.stdout:4/66: chown d6/fb 4 1 2024-02-19T19:08:20.946 INFO:tasks.workunit.client.0.smithi046.stdout:2/94: creat d5/df/f1a x:0 0 0 2024-02-19T19:08:20.946 INFO:tasks.workunit.client.0.smithi046.stdout:2/95: dread - d5/df/f1a zero size 2024-02-19T19:08:20.947 INFO:tasks.workunit.client.0.smithi046.stdout:2/96: dread - d5/df/f1a zero size 2024-02-19T19:08:20.947 INFO:tasks.workunit.client.0.smithi046.stdout:2/97: creat d5/df/f1b x:0 0 0 2024-02-19T19:08:20.951 INFO:tasks.workunit.client.0.smithi046.stdout:6/37: truncate d4/f5 3468964 0 2024-02-19T19:08:20.956 INFO:tasks.workunit.client.0.smithi046.stdout:9/71: dread f7 [0,4194304] 0 2024-02-19T19:08:20.958 INFO:tasks.workunit.client.0.smithi046.stdout:5/64: symlink d2/l11 0 2024-02-19T19:08:20.961 INFO:tasks.workunit.client.0.smithi046.stdout:7/182: mkdir d0/d4/d34 0 2024-02-19T19:08:20.961 INFO:tasks.workunit.client.0.smithi046.stdout:7/183: chown d0/f18 2471 1 2024-02-19T19:08:20.962 INFO:tasks.workunit.client.0.smithi046.stdout:3/56: mknod da/dd/ce 0 2024-02-19T19:08:20.963 INFO:tasks.workunit.client.0.smithi046.stdout:7/184: dread d0/f18 [0,4194304] 0 2024-02-19T19:08:20.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/68: dwrite d0/f3 [0,4194304] 0 2024-02-19T19:08:20.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/69: fsync d0/d4/d8/f15 0 2024-02-19T19:08:20.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/70: readlink d0/l11 0 2024-02-19T19:08:20.966 INFO:tasks.workunit.client.0.smithi046.stdout:8/100: link d3/la d3/dd/d1c/l25 0 2024-02-19T19:08:20.968 INFO:tasks.workunit.client.0.smithi046.stdout:1/130: link d5/d10/l1d d5/d10/l28 0 2024-02-19T19:08:20.968 INFO:tasks.workunit.client.0.smithi046.stdout:1/131: write d5/f27 [650064,51452] 0 2024-02-19T19:08:20.969 INFO:tasks.workunit.client.0.smithi046.stdout:4/67: mknod d6/d11/c19 0 2024-02-19T19:08:20.969 INFO:tasks.workunit.client.0.smithi046.stdout:4/68: creat d6/f1a x:0 0 0 2024-02-19T19:08:20.971 INFO:tasks.workunit.client.0.smithi046.stdout:7/185: dread d0/d4/dd/f10 [0,4194304] 0 2024-02-19T19:08:20.974 INFO:tasks.workunit.client.0.smithi046.stdout:6/38: creat d4/d6/fe x:0 0 0 2024-02-19T19:08:20.974 INFO:tasks.workunit.client.0.smithi046.stdout:3/57: dread f8 [0,4194304] 0 2024-02-19T19:08:20.975 INFO:tasks.workunit.client.0.smithi046.stdout:9/72: mknod db/c13 0 2024-02-19T19:08:20.976 INFO:tasks.workunit.client.0.smithi046.stdout:2/98: dwrite d5/df/f1b [0,4194304] 0 2024-02-19T19:08:20.976 INFO:tasks.workunit.client.0.smithi046.stdout:2/99: dread - d5/d6/f7 zero size 2024-02-19T19:08:20.977 INFO:tasks.workunit.client.0.smithi046.stdout:5/65: symlink d2/dd/l12 0 2024-02-19T19:08:20.977 INFO:tasks.workunit.client.0.smithi046.stdout:5/66: creat d2/f13 x:0 0 0 2024-02-19T19:08:20.983 INFO:tasks.workunit.client.0.smithi046.stdout:6/39: read d4/db/fc [1043856,40227] 0 2024-02-19T19:08:20.986 INFO:tasks.workunit.client.0.smithi046.stdout:0/71: link d0/f17 d0/f18 0 2024-02-19T19:08:20.988 INFO:tasks.workunit.client.0.smithi046.stdout:8/101: mknod d3/dd/d11/c26 0 2024-02-19T19:08:20.996 INFO:tasks.workunit.client.0.smithi046.stdout:1/132: dwrite d5/f1f [0,4194304] 0 2024-02-19T19:08:20.999 INFO:tasks.workunit.client.0.smithi046.stdout:7/186: mknod d0/d4/dd/c35 0 2024-02-19T19:08:21.002 INFO:tasks.workunit.client.0.smithi046.stdout:3/58: symlink da/lf 0 2024-02-19T19:08:21.004 INFO:tasks.workunit.client.0.smithi046.stdout:9/73: symlink db/l14 0 2024-02-19T19:08:21.010 INFO:tasks.workunit.client.0.smithi046.stdout:9/74: read f0 [7957348,126582] 0 2024-02-19T19:08:21.010 INFO:tasks.workunit.client.0.smithi046.stdout:0/72: dwrite d0/d4/f6 [4194304,4194304] 0 2024-02-19T19:08:21.029 INFO:tasks.workunit.client.0.smithi046.stdout:6/40: mknod d4/cf 0 2024-02-19T19:08:21.029 INFO:tasks.workunit.client.0.smithi046.stdout:6/41: dread - d4/d6/fe zero size 2024-02-19T19:08:21.033 INFO:tasks.workunit.client.0.smithi046.stdout:8/102: symlink d3/dd/d13/l27 0 2024-02-19T19:08:21.038 INFO:tasks.workunit.client.0.smithi046.stdout:7/187: rename d0/d4/dd/c35 to d0/d4/dd/c36 0 2024-02-19T19:08:21.039 INFO:tasks.workunit.client.0.smithi046.stdout:5/67: dwrite d2/f6 [0,4194304] 0 2024-02-19T19:08:21.039 INFO:tasks.workunit.client.0.smithi046.stdout:5/68: write d2/f3 [4270903,98063] 0 2024-02-19T19:08:21.039 INFO:tasks.workunit.client.0.smithi046.stdout:3/59: getdents da/dd 0 2024-02-19T19:08:21.047 INFO:tasks.workunit.client.0.smithi046.stdout:2/100: getdents d5/d6/d13 0 2024-02-19T19:08:21.047 INFO:tasks.workunit.client.0.smithi046.stdout:2/101: stat d5/d6 0 2024-02-19T19:08:21.052 INFO:tasks.workunit.client.0.smithi046.stdout:8/103: creat d3/dd/d1c/f28 x:0 0 0 2024-02-19T19:08:21.056 INFO:tasks.workunit.client.0.smithi046.stdout:1/133: getdents d5/d21 0 2024-02-19T19:08:21.056 INFO:tasks.workunit.client.0.smithi046.stdout:2/102: dread f3 [0,4194304] 0 2024-02-19T19:08:21.056 INFO:tasks.workunit.client.0.smithi046.stdout:2/103: stat f1 0 2024-02-19T19:08:21.056 INFO:tasks.workunit.client.0.smithi046.stdout:2/104: fsync f4 0 2024-02-19T19:08:21.056 INFO:tasks.workunit.client.0.smithi046.stdout:7/188: rmdir d0/d4 39 2024-02-19T19:08:21.057 INFO:tasks.workunit.client.0.smithi046.stdout:1/134: dread d5/d13/f14 [0,4194304] 0 2024-02-19T19:08:21.060 INFO:tasks.workunit.client.0.smithi046.stdout:5/69: getdents d2/dd 0 2024-02-19T19:08:21.062 INFO:tasks.workunit.client.0.smithi046.stdout:3/60: unlink l1 0 2024-02-19T19:08:21.073 INFO:tasks.workunit.client.0.smithi046.stdout:5/70: dread d2/f3 [0,4194304] 0 2024-02-19T19:08:21.073 INFO:tasks.workunit.client.0.smithi046.stdout:5/71: dread - d2/f13 zero size 2024-02-19T19:08:21.073 INFO:tasks.workunit.client.0.smithi046.stdout:5/72: dread - d2/f9 zero size 2024-02-19T19:08:21.074 INFO:tasks.workunit.client.0.smithi046.stdout:8/104: unlink d3/dd/c21 0 2024-02-19T19:08:21.075 INFO:tasks.workunit.client.0.smithi046.stdout:8/105: write d3/dd/d1c/f28 [86212,59307] 0 2024-02-19T19:08:21.075 INFO:tasks.workunit.client.0.smithi046.stdout:8/106: readlink d3/la 0 2024-02-19T19:08:21.075 INFO:tasks.workunit.client.0.smithi046.stdout:8/107: readlink d3/dd/d13/l27 0 2024-02-19T19:08:21.075 INFO:tasks.workunit.client.0.smithi046.stdout:2/105: symlink d5/d6/d13/l1c 0 2024-02-19T19:08:21.076 INFO:tasks.workunit.client.0.smithi046.stdout:3/61: mkdir da/dd/d10 0 2024-02-19T19:08:21.077 INFO:tasks.workunit.client.0.smithi046.stdout:0/73: rename d0/d4 to d0/d19 0 2024-02-19T19:08:21.080 INFO:tasks.workunit.client.0.smithi046.stdout:6/42: rename d4/db to d4/d6/dd/d10 0 2024-02-19T19:08:21.081 INFO:tasks.workunit.client.0.smithi046.stdout:3/62: rmdir da 39 2024-02-19T19:08:21.081 INFO:tasks.workunit.client.0.smithi046.stdout:3/63: chown da/dd 1 1 2024-02-19T19:08:21.081 INFO:tasks.workunit.client.0.smithi046.stdout:3/64: fdatasync f8 0 2024-02-19T19:08:21.081 INFO:tasks.workunit.client.0.smithi046.stdout:3/65: getdents da/dd/d10 0 2024-02-19T19:08:21.082 INFO:tasks.workunit.client.0.smithi046.stdout:3/66: getdents da/dd/d10 0 2024-02-19T19:08:21.082 INFO:tasks.workunit.client.0.smithi046.stdout:3/67: fsync f8 0 2024-02-19T19:08:21.082 INFO:tasks.workunit.client.0.smithi046.stdout:3/68: stat f8 0 2024-02-19T19:08:21.082 INFO:tasks.workunit.client.0.smithi046.stdout:2/106: read d5/d6/fd [1651689,44143] 0 2024-02-19T19:08:21.083 INFO:tasks.workunit.client.0.smithi046.stdout:1/135: dwrite d5/f12 [0,4194304] 0 2024-02-19T19:08:21.083 INFO:tasks.workunit.client.0.smithi046.stdout:0/74: creat d0/d19/f1a x:0 0 0 2024-02-19T19:08:21.085 INFO:tasks.workunit.client.0.smithi046.stdout:7/189: rename d0/d4/d24/l32 to d0/d4/d34/l37 0 2024-02-19T19:08:21.085 INFO:tasks.workunit.client.0.smithi046.stdout:7/190: fdatasync d0/d4/dd/f10 0 2024-02-19T19:08:21.088 INFO:tasks.workunit.client.0.smithi046.stdout:1/136: unlink d5/l9 0 2024-02-19T19:08:21.089 INFO:tasks.workunit.client.0.smithi046.stdout:5/73: dread d2/fb [0,4194304] 0 2024-02-19T19:08:21.092 INFO:tasks.workunit.client.0.smithi046.stdout:2/107: write f3 [584568,124654] 0 2024-02-19T19:08:21.094 INFO:tasks.workunit.client.0.smithi046.stdout:5/74: rmdir d2/dd 39 2024-02-19T19:08:21.096 INFO:tasks.workunit.client.0.smithi046.stdout:2/108: symlink d5/d6/l1d 0 2024-02-19T19:08:21.096 INFO:tasks.workunit.client.0.smithi046.stdout:2/109: chown d5 6 1 2024-02-19T19:08:21.097 INFO:tasks.workunit.client.0.smithi046.stdout:8/108: dwrite d3/dd/f15 [0,4194304] 0 2024-02-19T19:08:21.097 INFO:tasks.workunit.client.0.smithi046.stdout:8/109: write d3/dd/d13/f1f [1016030,73404] 0 2024-02-19T19:08:21.097 INFO:tasks.workunit.client.0.smithi046.stdout:8/110: creat d3/dd/d1c/f29 x:0 0 0 2024-02-19T19:08:21.140 INFO:tasks.workunit.client.0.smithi046.stdout:2/110: write f1 [2734663,3776] 0 2024-02-19T19:08:21.144 INFO:tasks.workunit.client.0.smithi046.stdout:5/75: dwrite d2/f3 [0,4194304] 0 2024-02-19T19:08:21.144 INFO:tasks.workunit.client.0.smithi046.stdout:6/43: dwrite d4/d6/f9 [0,4194304] 0 2024-02-19T19:08:21.144 INFO:tasks.workunit.client.0.smithi046.stdout:1/137: dwrite d5/d21/f23 [0,4194304] 0 2024-02-19T19:08:21.144 INFO:tasks.workunit.client.0.smithi046.stdout:1/138: stat d5/d21 0 2024-02-19T19:08:21.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/75: dwrite d0/f2 [0,4194304] 0 2024-02-19T19:08:21.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/76: creat d0/f1b x:0 0 0 2024-02-19T19:08:21.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/77: write d0/f1b [290607,89048] 0 2024-02-19T19:08:21.144 INFO:tasks.workunit.client.0.smithi046.stdout:7/191: dwrite d0/d4/d2a/f2c [0,4194304] 0 2024-02-19T19:08:21.144 INFO:tasks.workunit.client.0.smithi046.stdout:7/192: chown d0/d4/d34/l37 4524847 1 2024-02-19T19:08:21.145 INFO:tasks.workunit.client.0.smithi046.stdout:1/139: write d5/fc [1294133,92111] 0 2024-02-19T19:08:21.145 INFO:tasks.workunit.client.0.smithi046.stdout:1/140: readlink d5/d10/l28 0 2024-02-19T19:08:21.151 INFO:tasks.workunit.client.0.smithi046.stdout:7/193: write d0/d4/f8 [7976402,1495] 0 2024-02-19T19:08:21.158 INFO:tasks.workunit.client.0.smithi046.stdout:6/44: dread d4/d6/f9 [0,4194304] 0 2024-02-19T19:08:21.158 INFO:tasks.workunit.client.0.smithi046.stdout:2/111: dwrite d5/d6/fd [4194304,4194304] 0 2024-02-19T19:08:21.159 INFO:tasks.workunit.client.0.smithi046.stdout:2/112: readlink d5/d6/lb 0 2024-02-19T19:08:21.159 INFO:tasks.workunit.client.0.smithi046.stdout:2/113: fdatasync d5/d6/d13/f16 0 2024-02-19T19:08:21.159 INFO:tasks.workunit.client.0.smithi046.stdout:2/114: stat d5/d6 0 2024-02-19T19:08:21.159 INFO:tasks.workunit.client.0.smithi046.stdout:8/111: getdents d3/dd 0 2024-02-19T19:08:21.165 INFO:tasks.workunit.client.0.smithi046.stdout:2/115: write f4 [9076003,11876] 0 2024-02-19T19:08:21.165 INFO:tasks.workunit.client.0.smithi046.stdout:2/116: write d5/d6/f7 [429772,17349] 0 2024-02-19T19:08:21.165 INFO:tasks.workunit.client.0.smithi046.stdout:0/78: unlink d0/le 0 2024-02-19T19:08:21.166 INFO:tasks.workunit.client.0.smithi046.stdout:0/79: creat d0/f1c x:0 0 0 2024-02-19T19:08:21.166 INFO:tasks.workunit.client.0.smithi046.stdout:0/80: dread - d0/f1c zero size 2024-02-19T19:08:21.166 INFO:tasks.workunit.client.0.smithi046.stdout:1/141: creat d5/d13/f29 x:0 0 0 2024-02-19T19:08:21.167 INFO:tasks.workunit.client.0.smithi046.stdout:8/112: dread d3/dd/f12 [0,4194304] 0 2024-02-19T19:08:21.167 INFO:tasks.workunit.client.0.smithi046.stdout:8/113: stat d3/dd/f12 0 2024-02-19T19:08:21.170 INFO:tasks.workunit.client.0.smithi046.stdout:5/76: getdents d2 0 2024-02-19T19:08:21.176 INFO:tasks.workunit.client.0.smithi046.stdout:7/194: symlink d0/d4/d34/l38 0 2024-02-19T19:08:21.177 INFO:tasks.workunit.client.0.smithi046.stdout:1/142: read d5/d21/f23 [2171281,47257] 0 2024-02-19T19:08:21.177 INFO:tasks.workunit.client.0.smithi046.stdout:1/143: write d5/d21/f23 [1285807,65364] 0 2024-02-19T19:08:21.183 INFO:tasks.workunit.client.0.smithi046.stdout:6/45: creat d4/d6/dd/f11 x:0 0 0 2024-02-19T19:08:21.184 INFO:tasks.workunit.client.0.smithi046.stdout:8/114: dwrite d3/f7 [0,4194304] 0 2024-02-19T19:08:21.184 INFO:tasks.workunit.client.0.smithi046.stdout:7/195: write d0/d4/f29 [2126825,102134] 0 2024-02-19T19:08:21.184 INFO:tasks.workunit.client.0.smithi046.stdout:7/196: write d0/f1b [2774732,31492] 0 2024-02-19T19:08:21.186 INFO:tasks.workunit.client.0.smithi046.stdout:2/117: mknod d5/d6/c1e 0 2024-02-19T19:08:21.190 INFO:tasks.workunit.client.0.smithi046.stdout:7/197: write d0/d4/f7 [1412700,43897] 0 2024-02-19T19:08:21.190 INFO:tasks.workunit.client.0.smithi046.stdout:7/198: creat d0/d4/d2a/f39 x:0 0 0 2024-02-19T19:08:21.191 INFO:tasks.workunit.client.0.smithi046.stdout:0/81: creat d0/d19/d8/f1d x:0 0 0 2024-02-19T19:08:21.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/46: symlink d4/d6/dd/d10/l12 0 2024-02-19T19:08:21.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/118: write d5/df/f1b [1552007,4652] 0 2024-02-19T19:08:21.198 INFO:tasks.workunit.client.0.smithi046.stdout:8/115: dwrite d3/f4 [0,4194304] 0 2024-02-19T19:08:21.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:20 smithi142 ceph-mon[69118]: pgmap v115: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 14 MiB/s wr, 929 op/s; 7636/48672 objects degraded (15.689%) 2024-02-19T19:08:21.205 INFO:tasks.workunit.client.0.smithi046.stdout:8/116: read d3/f9 [1657230,25153] 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/199: creat d0/d4/dd/f3a x:0 0 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/200: stat d0/d4/d2a/f33 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/201: read d0/d4/f7 [3082922,70827] 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/202: fsync d0/d4/f8 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/203: chown d0/d4/d34/l37 405 1 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/204: write d0/d4/f8 [4718650,54837] 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/205: fsync d0/d4/d2a/f33 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/206: chown d0/c11 25 1 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:0/82: dwrite d0/f13 [0,4194304] 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:0/83: readlink d0/d19/db/l10 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:2/119: dwrite d5/f11 [0,4194304] 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:5/77: truncate d2/f5 4022831 0 2024-02-19T19:08:21.213 INFO:tasks.workunit.client.0.smithi046.stdout:5/78: chown d2/dd/l12 3310955 1 2024-02-19T19:08:21.220 INFO:tasks.workunit.client.0.smithi046.stdout:6/47: rename d4/d6/f9 to d4/d6/dd/d10/f13 0 2024-02-19T19:08:21.220 INFO:tasks.workunit.client.0.smithi046.stdout:6/48: chown l0 1 1 2024-02-19T19:08:21.220 INFO:tasks.workunit.client.0.smithi046.stdout:6/49: stat d4/cf 0 2024-02-19T19:08:21.224 INFO:tasks.workunit.client.0.smithi046.stdout:7/207: creat d0/d4/f3b x:0 0 0 2024-02-19T19:08:21.225 INFO:tasks.workunit.client.0.smithi046.stdout:7/208: write d0/d4/f29 [3258033,9572] 0 2024-02-19T19:08:21.229 INFO:tasks.workunit.client.0.smithi046.stdout:0/84: mknod d0/d19/db/c1e 0 2024-02-19T19:08:21.230 INFO:tasks.workunit.client.0.smithi046.stdout:0/85: write d0/f18 [378861,79980] 0 2024-02-19T19:08:21.234 INFO:tasks.workunit.client.0.smithi046.stdout:5/79: mknod d2/c14 0 2024-02-19T19:08:21.240 INFO:tasks.workunit.client.0.smithi046.stdout:6/50: dwrite d4/f8 [0,4194304] 0 2024-02-19T19:08:21.240 INFO:tasks.workunit.client.0.smithi046.stdout:6/51: chown d4/d6/dd/d10/l12 395 1 2024-02-19T19:08:21.252 INFO:tasks.workunit.client.0.smithi046.stdout:8/117: rename d3/la to d3/dd/d11/l2a 0 2024-02-19T19:08:21.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/209: creat d0/d4/f3c x:0 0 0 2024-02-19T19:08:21.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/210: creat d0/f3d x:0 0 0 2024-02-19T19:08:21.261 INFO:tasks.workunit.client.0.smithi046.stdout:0/86: dwrite d0/f17 [0,4194304] 0 2024-02-19T19:08:21.261 INFO:tasks.workunit.client.0.smithi046.stdout:0/87: chown d0/f1b 109271 1 2024-02-19T19:08:21.262 INFO:tasks.workunit.client.0.smithi046.stdout:8/118: symlink d3/l2b 0 2024-02-19T19:08:21.262 INFO:tasks.workunit.client.0.smithi046.stdout:8/119: read - d3/dd/f24 zero size 2024-02-19T19:08:21.262 INFO:tasks.workunit.client.0.smithi046.stdout:8/120: stat d3/dd/d13/l27 0 2024-02-19T19:08:21.262 INFO:tasks.workunit.client.0.smithi046.stdout:8/121: fdatasync d3/dd/d1c/f28 0 2024-02-19T19:08:21.263 INFO:tasks.workunit.client.0.smithi046.stdout:8/122: fdatasync d3/f9 0 2024-02-19T19:08:21.263 INFO:tasks.workunit.client.0.smithi046.stdout:6/52: dwrite d4/f8 [4194304,4194304] 0 2024-02-19T19:08:21.266 INFO:tasks.workunit.client.0.smithi046.stdout:0/88: unlink d0/d19/db/fc 0 2024-02-19T19:08:21.267 INFO:tasks.workunit.client.0.smithi046.stdout:0/89: truncate d0/d19/d8/f15 1344090 0 2024-02-19T19:08:21.268 INFO:tasks.workunit.client.0.smithi046.stdout:8/123: rename d3/dd/d1c/c23 to d3/dd/d13/c2c 0 2024-02-19T19:08:21.269 INFO:tasks.workunit.client.0.smithi046.stdout:8/124: chown d3/dd/d11/d1d 834 1 2024-02-19T19:08:21.273 INFO:tasks.workunit.client.0.smithi046.stdout:6/53: unlink l2 0 2024-02-19T19:08:21.277 INFO:tasks.workunit.client.0.smithi046.stdout:8/125: write d3/f4 [3895994,88042] 0 2024-02-19T19:08:21.280 INFO:tasks.workunit.client.0.smithi046.stdout:0/90: dwrite d0/f17 [0,4194304] 0 2024-02-19T19:08:21.294 INFO:tasks.workunit.client.0.smithi046.stdout:0/91: rename d0/f13 to d0/d19/f1f 0 2024-02-19T19:08:21.298 INFO:tasks.workunit.client.0.smithi046.stdout:0/92: getdents d0/d19/d8 0 2024-02-19T19:08:21.301 INFO:tasks.workunit.client.0.smithi046.stdout:8/126: dwrite d3/dd/d13/f1f [0,4194304] 0 2024-02-19T19:08:21.302 INFO:tasks.workunit.client.0.smithi046.stdout:6/54: dwrite d4/d6/dd/d10/f13 [4194304,4194304] 0 2024-02-19T19:08:21.302 INFO:tasks.workunit.client.0.smithi046.stdout:0/93: mkdir d0/d19/db/d20 0 2024-02-19T19:08:21.302 INFO:tasks.workunit.client.0.smithi046.stdout:6/55: write d4/d6/fe [982787,56598] 0 2024-02-19T19:08:21.308 INFO:tasks.workunit.client.0.smithi046.stdout:8/127: creat d3/dd/d11/f2d x:0 0 0 2024-02-19T19:08:21.308 INFO:tasks.workunit.client.0.smithi046.stdout:8/128: creat d3/dd/d11/f2e x:0 0 0 2024-02-19T19:08:21.308 INFO:tasks.workunit.client.0.smithi046.stdout:8/129: write d3/dd/d1c/f29 [746475,31960] 0 2024-02-19T19:08:21.309 INFO:tasks.workunit.client.0.smithi046.stdout:5/80: truncate d2/fb 4091823 0 2024-02-19T19:08:21.309 INFO:tasks.workunit.client.0.smithi046.stdout:5/81: write d2/f10 [188383,121184] 0 2024-02-19T19:08:21.317 INFO:tasks.workunit.client.0.smithi046.stdout:0/94: unlink d0/f3 0 2024-02-19T19:08:21.324 INFO:tasks.workunit.client.0.smithi046.stdout:8/130: link d3/c5 d3/dd/d13/c2f 0 2024-02-19T19:08:21.324 INFO:tasks.workunit.client.0.smithi046.stdout:8/131: truncate d3/d18/f20 266894 0 2024-02-19T19:08:21.327 INFO:tasks.workunit.client.0.smithi046.stdout:0/95: symlink d0/d19/d8/l21 0 2024-02-19T19:08:21.328 INFO:tasks.workunit.client.0.smithi046.stdout:8/132: mknod d3/dd/c30 0 2024-02-19T19:08:21.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:20 smithi046 ceph-mon[88928]: pgmap v115: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 14 MiB/s wr, 929 op/s; 7636/48672 objects degraded (15.689%) 2024-02-19T19:08:21.331 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:21 smithi046 podman[112339]: 2024-02-19 19:08:21.119985402 +0000 UTC m=+0.471028274 container create b0d22d02dde4af485cd8c33c1c532ea32d932240a82ec89a9dba21ecb08874ed (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:08:21.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/211: fsync d0/f3d 0 2024-02-19T19:08:21.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/212: creat d0/f3e x:0 0 0 2024-02-19T19:08:21.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/213: write d0/ff [557865,28034] 0 2024-02-19T19:08:21.363 INFO:tasks.workunit.client.0.smithi046.stdout:7/214: mkdir d0/d3f 0 2024-02-19T19:08:21.366 INFO:tasks.workunit.client.0.smithi046.stdout:7/215: link d0/d4/f8 d0/d4/dd/f40 0 2024-02-19T19:08:21.368 INFO:tasks.workunit.client.0.smithi046.stdout:7/216: unlink d0/d4/d34/l37 0 2024-02-19T19:08:21.371 INFO:tasks.workunit.client.0.smithi046.stdout:7/217: mkdir d0/d4/d34/d41 0 2024-02-19T19:08:21.372 INFO:tasks.workunit.client.0.smithi046.stdout:7/218: write d0/f3d [509341,47187] 0 2024-02-19T19:08:21.380 INFO:tasks.workunit.client.0.smithi046.stdout:7/219: dread d0/d4/d2a/f2c [0,4194304] 0 2024-02-19T19:08:21.397 INFO:tasks.workunit.client.0.smithi046.stdout:7/220: write d0/d4/dd/f10 [1204009,57492] 0 2024-02-19T19:08:21.397 INFO:tasks.workunit.client.0.smithi046.stdout:7/221: creat d0/d4/d2a/f42 x:0 0 0 2024-02-19T19:08:21.400 INFO:tasks.workunit.client.0.smithi046.stdout:0/96: write d0/d19/f1f [3098741,29794] 0 2024-02-19T19:08:21.401 INFO:tasks.workunit.client.0.smithi046.stdout:5/82: truncate d2/f6 1804829 0 2024-02-19T19:08:21.409 INFO:tasks.workunit.client.0.smithi046.stdout:5/83: creat d2/dd/f15 x:0 0 0 2024-02-19T19:08:21.409 INFO:tasks.workunit.client.0.smithi046.stdout:5/84: chown d2/dd 12356 1 2024-02-19T19:08:21.409 INFO:tasks.workunit.client.0.smithi046.stdout:5/85: chown d2/dd/l12 58 1 2024-02-19T19:08:21.418 INFO:tasks.workunit.client.0.smithi046.stdout:8/133: dwrite d3/dd/f15 [0,4194304] 0 2024-02-19T19:08:21.418 INFO:tasks.workunit.client.0.smithi046.stdout:0/97: dwrite d0/f1b [0,4194304] 0 2024-02-19T19:08:21.418 INFO:tasks.workunit.client.0.smithi046.stdout:8/134: write d3/d18/f1e [227979,123149] 0 2024-02-19T19:08:21.421 INFO:tasks.workunit.client.0.smithi046.stdout:3/69: sync 2024-02-19T19:08:21.421 INFO:tasks.workunit.client.0.smithi046.stdout:4/69: sync 2024-02-19T19:08:21.421 INFO:tasks.workunit.client.0.smithi046.stdout:2/120: sync 2024-02-19T19:08:21.421 INFO:tasks.workunit.client.0.smithi046.stdout:1/144: sync 2024-02-19T19:08:21.421 INFO:tasks.workunit.client.0.smithi046.stdout:4/70: chown d6/d11 459112 1 2024-02-19T19:08:21.421 INFO:tasks.workunit.client.0.smithi046.stdout:9/75: sync 2024-02-19T19:08:21.429 INFO:tasks.workunit.client.0.smithi046.stdout:0/98: rename d0/d19/f16 to d0/d19/d8/f22 0 2024-02-19T19:08:21.429 INFO:tasks.workunit.client.0.smithi046.stdout:0/99: readlink d0/d19/d8/l21 0 2024-02-19T19:08:21.429 INFO:tasks.workunit.client.0.smithi046.stdout:8/135: mknod d3/d18/c31 0 2024-02-19T19:08:21.430 INFO:tasks.workunit.client.0.smithi046.stdout:0/100: write d0/d19/d8/f15 [448802,105648] 0 2024-02-19T19:08:21.431 INFO:tasks.workunit.client.0.smithi046.stdout:1/145: dread d5/f1f [0,4194304] 0 2024-02-19T19:08:21.431 INFO:tasks.workunit.client.0.smithi046.stdout:1/146: rename d5 to d5/d21/d2a 22 2024-02-19T19:08:21.433 INFO:tasks.workunit.client.0.smithi046.stdout:9/76: rmdir db 39 2024-02-19T19:08:21.434 INFO:tasks.workunit.client.0.smithi046.stdout:2/121: mknod d5/df/c1f 0 2024-02-19T19:08:21.441 INFO:tasks.workunit.client.0.smithi046.stdout:0/101: creat d0/d19/db/d20/f23 x:0 0 0 2024-02-19T19:08:21.442 INFO:tasks.workunit.client.0.smithi046.stdout:1/147: creat d5/d21/f2b x:0 0 0 2024-02-19T19:08:21.442 INFO:tasks.workunit.client.0.smithi046.stdout:1/148: chown d5/cf 0 1 2024-02-19T19:08:21.444 INFO:tasks.workunit.client.0.smithi046.stdout:3/70: dwrite f8 [0,4194304] 0 2024-02-19T19:08:21.445 INFO:tasks.workunit.client.0.smithi046.stdout:9/77: symlink db/l15 0 2024-02-19T19:08:21.445 INFO:tasks.workunit.client.0.smithi046.stdout:4/71: dwrite d6/f9 [0,4194304] 0 2024-02-19T19:08:21.446 INFO:tasks.workunit.client.0.smithi046.stdout:2/122: truncate f3 787401 0 2024-02-19T19:08:21.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/78: read fa [1005617,117204] 0 2024-02-19T19:08:21.454 INFO:tasks.workunit.client.0.smithi046.stdout:1/149: unlink d5/d21/f2b 0 2024-02-19T19:08:21.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/71: dwrite f8 [0,4194304] 0 2024-02-19T19:08:21.462 INFO:tasks.workunit.client.0.smithi046.stdout:9/79: symlink db/l16 0 2024-02-19T19:08:21.462 INFO:tasks.workunit.client.0.smithi046.stdout:9/80: chown db/c13 497155334 1 2024-02-19T19:08:21.462 INFO:tasks.workunit.client.0.smithi046.stdout:9/81: write fa [2151694,557] 0 2024-02-19T19:08:21.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/82: creat db/f17 x:0 0 0 2024-02-19T19:08:21.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/83: creat db/f18 x:0 0 0 2024-02-19T19:08:21.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/84: creat db/f19 x:0 0 0 2024-02-19T19:08:21.468 INFO:tasks.workunit.client.0.smithi046.stdout:3/72: read f8 [3113007,39379] 0 2024-02-19T19:08:21.468 INFO:tasks.workunit.client.0.smithi046.stdout:3/73: read f8 [3142538,12549] 0 2024-02-19T19:08:21.468 INFO:tasks.workunit.client.0.smithi046.stdout:1/150: getdents d5/d13 0 2024-02-19T19:08:21.475 INFO:tasks.workunit.client.0.smithi046.stdout:3/74: unlink f8 0 2024-02-19T19:08:21.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/75: chown da/lf 639 1 2024-02-19T19:08:21.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/76: write - no filename 2024-02-19T19:08:21.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/77: read - no filename 2024-02-19T19:08:21.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/78: dwrite - no filename 2024-02-19T19:08:21.479 INFO:tasks.workunit.client.0.smithi046.stdout:1/151: mknod d5/d10/c2c 0 2024-02-19T19:08:21.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/79: link da/cc da/dd/c11 0 2024-02-19T19:08:21.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/80: stat c6 0 2024-02-19T19:08:21.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/81: dread - no filename 2024-02-19T19:08:21.483 INFO:tasks.workunit.client.0.smithi046.stdout:1/152: rmdir d5/d10 39 2024-02-19T19:08:21.483 INFO:tasks.workunit.client.0.smithi046.stdout:1/153: read - d5/d13/f29 zero size 2024-02-19T19:08:21.488 INFO:tasks.workunit.client.0.smithi046.stdout:3/82: mknod da/c12 0 2024-02-19T19:08:21.489 INFO:tasks.workunit.client.0.smithi046.stdout:1/154: mkdir d5/d10/d2d 0 2024-02-19T19:08:21.489 INFO:tasks.workunit.client.0.smithi046.stdout:1/155: chown d5/d10/c2c 13 1 2024-02-19T19:08:21.492 INFO:tasks.workunit.client.0.smithi046.stdout:3/83: symlink da/l13 0 2024-02-19T19:08:21.492 INFO:tasks.workunit.client.0.smithi046.stdout:3/84: chown c5 18193686 1 2024-02-19T19:08:21.493 INFO:tasks.workunit.client.0.smithi046.stdout:1/156: creat d5/d10/f2e x:0 0 0 2024-02-19T19:08:21.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/85: symlink da/l14 0 2024-02-19T19:08:21.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/86: readlink l4 0 2024-02-19T19:08:21.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/87: dread - no filename 2024-02-19T19:08:21.496 INFO:tasks.workunit.client.0.smithi046.stdout:1/157: mkdir d5/d2f 0 2024-02-19T19:08:21.499 INFO:tasks.workunit.client.0.smithi046.stdout:3/88: unlink c6 0 2024-02-19T19:08:21.499 INFO:tasks.workunit.client.0.smithi046.stdout:3/89: read - no filename 2024-02-19T19:08:21.499 INFO:tasks.workunit.client.0.smithi046.stdout:3/90: write - no filename 2024-02-19T19:08:21.499 INFO:tasks.workunit.client.0.smithi046.stdout:3/91: dwrite - no filename 2024-02-19T19:08:21.499 INFO:tasks.workunit.client.0.smithi046.stdout:3/92: dread - no filename 2024-02-19T19:08:21.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/93: dwrite - no filename 2024-02-19T19:08:21.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/94: fsync - no filename 2024-02-19T19:08:21.502 INFO:tasks.workunit.client.0.smithi046.stdout:1/158: mknod d5/d2f/c30 0 2024-02-19T19:08:21.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/95: creat da/f15 x:0 0 0 2024-02-19T19:08:21.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/96: dread - da/f15 zero size 2024-02-19T19:08:21.506 INFO:tasks.workunit.client.0.smithi046.stdout:1/159: creat d5/d13/f31 x:0 0 0 2024-02-19T19:08:21.508 INFO:tasks.workunit.client.0.smithi046.stdout:3/97: rmdir da/dd 39 2024-02-19T19:08:21.509 INFO:tasks.workunit.client.0.smithi046.stdout:3/98: read - da/f15 zero size 2024-02-19T19:08:21.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/160: creat d5/d2f/f32 x:0 0 0 2024-02-19T19:08:21.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/161: creat d5/f33 x:0 0 0 2024-02-19T19:08:21.511 INFO:tasks.workunit.client.0.smithi046.stdout:5/86: truncate d2/f6 2512749 0 2024-02-19T19:08:21.515 INFO:tasks.workunit.client.0.smithi046.stdout:5/87: creat d2/f16 x:0 0 0 2024-02-19T19:08:21.522 INFO:tasks.workunit.client.0.smithi046.stdout:3/99: dwrite da/f15 [0,4194304] 0 2024-02-19T19:08:21.526 INFO:tasks.workunit.client.0.smithi046.stdout:3/100: mknod da/dd/d10/c16 0 2024-02-19T19:08:21.528 INFO:tasks.workunit.client.0.smithi046.stdout:3/101: symlink da/dd/l17 0 2024-02-19T19:08:21.530 INFO:tasks.workunit.client.0.smithi046.stdout:3/102: unlink da/dd/c11 0 2024-02-19T19:08:21.531 INFO:tasks.workunit.client.0.smithi046.stdout:3/103: truncate da/f15 4596563 0 2024-02-19T19:08:21.532 INFO:tasks.workunit.client.0.smithi046.stdout:3/104: link da/c12 da/c18 0 2024-02-19T19:08:21.535 INFO:tasks.workunit.client.0.smithi046.stdout:3/105: mknod da/dd/c19 0 2024-02-19T19:08:21.540 INFO:tasks.workunit.client.0.smithi046.stdout:8/136: rmdir d3/d18 39 2024-02-19T19:08:21.540 INFO:tasks.workunit.client.0.smithi046.stdout:8/137: chown d3/dd/d11/c26 58 1 2024-02-19T19:08:21.546 INFO:tasks.workunit.client.0.smithi046.stdout:8/138: rmdir d3/dd/d13 39 2024-02-19T19:08:21.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/139: creat d3/dd/d13/f32 x:0 0 0 2024-02-19T19:08:21.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/140: fsync d3/dd/d11/f2d 0 2024-02-19T19:08:21.551 INFO:tasks.workunit.client.0.smithi046.stdout:8/141: creat d3/d18/f33 x:0 0 0 2024-02-19T19:08:21.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/142: symlink d3/l34 0 2024-02-19T19:08:21.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/143: chown d3/f10 221258 1 2024-02-19T19:08:21.554 INFO:tasks.workunit.client.0.smithi046.stdout:3/106: dwrite da/f15 [0,4194304] 0 2024-02-19T19:08:21.555 INFO:tasks.workunit.client.0.smithi046.stdout:0/102: rename d0/d19/db/d20 to d0/d24 0 2024-02-19T19:08:21.558 INFO:tasks.workunit.client.0.smithi046.stdout:8/144: link d3/c19 d3/dd/c35 0 2024-02-19T19:08:21.558 INFO:tasks.workunit.client.0.smithi046.stdout:8/145: fdatasync d3/f9 0 2024-02-19T19:08:21.559 INFO:tasks.workunit.client.0.smithi046.stdout:2/123: rename d5/d6/l9 to d5/d6/d13/l20 0 2024-02-19T19:08:21.561 INFO:tasks.workunit.client.0.smithi046.stdout:3/107: dread da/f15 [0,4194304] 0 2024-02-19T19:08:21.562 INFO:tasks.workunit.client.0.smithi046.stdout:0/103: creat d0/d24/f25 x:0 0 0 2024-02-19T19:08:21.562 INFO:tasks.workunit.client.0.smithi046.stdout:0/104: write d0/f1c [603758,50447] 0 2024-02-19T19:08:21.562 INFO:tasks.workunit.client.0.smithi046.stdout:0/105: dread - d0/d19/d8/f1d zero size 2024-02-19T19:08:21.564 INFO:tasks.workunit.client.0.smithi046.stdout:5/88: rename l1 to d2/l17 0 2024-02-19T19:08:21.565 INFO:tasks.workunit.client.0.smithi046.stdout:3/108: write da/f15 [3924658,101027] 0 2024-02-19T19:08:21.566 INFO:tasks.workunit.client.0.smithi046.stdout:2/124: mknod d5/c21 0 2024-02-19T19:08:21.567 INFO:tasks.workunit.client.0.smithi046.stdout:2/125: write f4 [8445483,95267] 0 2024-02-19T19:08:21.569 INFO:tasks.workunit.client.0.smithi046.stdout:0/106: creat d0/d24/f26 x:0 0 0 2024-02-19T19:08:21.572 INFO:tasks.workunit.client.0.smithi046.stdout:3/109: unlink l4 0 2024-02-19T19:08:21.572 INFO:tasks.workunit.client.0.smithi046.stdout:3/110: write da/f15 [3173419,47365] 0 2024-02-19T19:08:21.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/89: dread d2/f3 [0,4194304] 0 2024-02-19T19:08:21.582 INFO:tasks.workunit.client.0.smithi046.stdout:9/85: rmdir db 39 2024-02-19T19:08:21.582 INFO:tasks.workunit.client.0.smithi046.stdout:9/86: chown f7 10 1 2024-02-19T19:08:21.586 INFO:tasks.workunit.client.0.smithi046.stdout:9/87: mknod db/c1a 0 2024-02-19T19:08:21.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/90: dwrite d2/f13 [0,4194304] 0 2024-02-19T19:08:21.589 INFO:tasks.workunit.client.0.smithi046.stdout:9/88: unlink db/c13 0 2024-02-19T19:08:21.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/107: getdents d0 0 2024-02-19T19:08:21.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/108: getdents d0 0 2024-02-19T19:08:21.668 INFO:tasks.workunit.client.0.smithi046.stdout:0/109: mkdir d0/d19/db/d27 0 2024-02-19T19:08:21.670 INFO:tasks.workunit.client.0.smithi046.stdout:0/110: unlink d0/l11 0 2024-02-19T19:08:21.671 INFO:tasks.workunit.client.0.smithi046.stdout:2/126: getdents d5/d6/d13 0 2024-02-19T19:08:21.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/127: read - d5/df/f10 zero size 2024-02-19T19:08:21.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/128: write f4 [3349878,23546] 0 2024-02-19T19:08:21.675 INFO:tasks.workunit.client.0.smithi046.stdout:5/91: unlink d2/l17 0 2024-02-19T19:08:21.675 INFO:tasks.workunit.client.0.smithi046.stdout:5/92: write d2/f16 [391321,109179] 0 2024-02-19T19:08:21.675 INFO:tasks.workunit.client.0.smithi046.stdout:5/93: fdatasync d2/f13 0 2024-02-19T19:08:21.675 INFO:tasks.workunit.client.0.smithi046.stdout:5/94: readlink d2/l7 0 2024-02-19T19:08:21.686 INFO:tasks.workunit.client.0.smithi046.stdout:9/89: getdents db 0 2024-02-19T19:08:21.703 INFO:tasks.workunit.client.0.smithi046.stdout:9/90: dwrite fa [0,4194304] 0 2024-02-19T19:08:21.706 INFO:tasks.workunit.client.0.smithi046.stdout:9/91: creat db/f1b x:0 0 0 2024-02-19T19:08:21.706 INFO:tasks.workunit.client.0.smithi046.stdout:9/92: truncate db/f19 624320 0 2024-02-19T19:08:21.706 INFO:tasks.workunit.client.0.smithi046.stdout:9/93: dread - db/f1b zero size 2024-02-19T19:08:21.714 INFO:tasks.workunit.client.0.smithi046.stdout:9/94: dread f2 [0,4194304] 0 2024-02-19T19:08:21.714 INFO:tasks.workunit.client.0.smithi046.stdout:9/95: readlink db/l10 0 2024-02-19T19:08:21.714 INFO:tasks.workunit.client.0.smithi046.stdout:9/96: creat db/f1c x:0 0 0 2024-02-19T19:08:21.714 INFO:tasks.workunit.client.0.smithi046.stdout:9/97: readlink db/l16 0 2024-02-19T19:08:21.714 INFO:tasks.workunit.client.0.smithi046.stdout:9/98: write db/f1c [333031,36503] 0 2024-02-19T19:08:21.729 INFO:tasks.workunit.client.0.smithi046.stdout:0/111: getdents d0/d19/db 0 2024-02-19T19:08:21.736 INFO:tasks.workunit.client.0.smithi046.stdout:5/95: dwrite d2/f6 [0,4194304] 0 2024-02-19T19:08:21.736 INFO:tasks.workunit.client.0.smithi046.stdout:5/96: dread - d2/dd/f15 zero size 2024-02-19T19:08:21.738 INFO:tasks.workunit.client.0.smithi046.stdout:0/112: dwrite d0/d24/f23 [0,4194304] 0 2024-02-19T19:08:21.739 INFO:tasks.workunit.client.0.smithi046.stdout:5/97: dread d2/f10 [0,4194304] 0 2024-02-19T19:08:21.740 INFO:tasks.workunit.client.0.smithi046.stdout:5/98: chown d2/dd 398 1 2024-02-19T19:08:21.750 INFO:tasks.workunit.client.0.smithi046.stdout:9/99: dwrite db/f18 [0,4194304] 0 2024-02-19T19:08:21.750 INFO:tasks.workunit.client.0.smithi046.stdout:9/100: truncate db/f17 755376 0 2024-02-19T19:08:21.757 INFO:tasks.workunit.client.0.smithi046.stdout:9/101: getdents db 0 2024-02-19T19:08:21.771 INFO:tasks.workunit.client.0.smithi046.stdout:0/113: dwrite d0/f1b [0,4194304] 0 2024-02-19T19:08:21.771 INFO:tasks.workunit.client.0.smithi046.stdout:0/114: stat d0/d24/f26 0 2024-02-19T19:08:21.773 INFO:tasks.workunit.client.0.smithi046.stdout:5/99: dwrite d2/f9 [0,4194304] 0 2024-02-19T19:08:21.773 INFO:tasks.workunit.client.0.smithi046.stdout:0/115: dread d0/d19/d8/f15 [0,4194304] 0 2024-02-19T19:08:21.774 INFO:tasks.workunit.client.0.smithi046.stdout:9/102: dwrite f7 [0,4194304] 0 2024-02-19T19:08:21.777 INFO:tasks.workunit.client.0.smithi046.stdout:0/116: link d0/d19/fd d0/d19/db/d27/f28 0 2024-02-19T19:08:21.778 INFO:tasks.workunit.client.0.smithi046.stdout:9/103: mknod db/c1d 0 2024-02-19T19:08:21.780 INFO:tasks.workunit.client.0.smithi046.stdout:0/117: symlink d0/d19/l29 0 2024-02-19T19:08:21.783 INFO:tasks.workunit.client.0.smithi046.stdout:1/162: sync 2024-02-19T19:08:21.783 INFO:tasks.workunit.client.0.smithi046.stdout:1/163: creat d5/d21/f34 x:0 0 0 2024-02-19T19:08:21.783 INFO:tasks.workunit.client.0.smithi046.stdout:3/111: sync 2024-02-19T19:08:21.783 INFO:tasks.workunit.client.0.smithi046.stdout:8/146: sync 2024-02-19T19:08:21.783 INFO:tasks.workunit.client.0.smithi046.stdout:4/72: sync 2024-02-19T19:08:21.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/222: sync 2024-02-19T19:08:21.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/223: dread - d0/f3e zero size 2024-02-19T19:08:21.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/224: fsync d0/d4/d24/f2e 0 2024-02-19T19:08:21.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/225: chown d0/c2f 1 1 2024-02-19T19:08:21.784 INFO:tasks.workunit.client.0.smithi046.stdout:6/56: sync 2024-02-19T19:08:21.784 INFO:tasks.workunit.client.0.smithi046.stdout:6/57: chown d4/cf 21363392 1 2024-02-19T19:08:21.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/100: dread d2/f3 [0,4194304] 0 2024-02-19T19:08:21.784 INFO:tasks.workunit.client.0.smithi046.stdout:1/164: read d5/d13/f14 [369670,72402] 0 2024-02-19T19:08:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:4/73: rmdir d6/d15 39 2024-02-19T19:08:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:4/74: write d6/fb [126694,123094] 0 2024-02-19T19:08:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:4/75: fdatasync d6/f1a 0 2024-02-19T19:08:21.789 INFO:tasks.workunit.client.0.smithi046.stdout:0/118: write d0/f18 [2120902,111439] 0 2024-02-19T19:08:21.789 INFO:tasks.workunit.client.0.smithi046.stdout:0/119: truncate d0/f17 4212799 0 2024-02-19T19:08:21.789 INFO:tasks.workunit.client.0.smithi046.stdout:7/226: symlink d0/d4/d24/l43 0 2024-02-19T19:08:21.791 INFO:tasks.workunit.client.0.smithi046.stdout:5/101: symlink d2/dd/l18 0 2024-02-19T19:08:21.791 INFO:tasks.workunit.client.0.smithi046.stdout:5/102: fdatasync d2/f16 0 2024-02-19T19:08:21.792 INFO:tasks.workunit.client.0.smithi046.stdout:1/165: mkdir d5/d13/d35 0 2024-02-19T19:08:21.792 INFO:tasks.workunit.client.0.smithi046.stdout:1/166: readlink d5/l22 0 2024-02-19T19:08:21.793 INFO:tasks.workunit.client.0.smithi046.stdout:1/167: getdents d5/d13/d35 0 2024-02-19T19:08:21.793 INFO:tasks.workunit.client.0.smithi046.stdout:1/168: readlink d5/d10/l1d 0 2024-02-19T19:08:21.793 INFO:tasks.workunit.client.0.smithi046.stdout:1/169: truncate d5/d21/f34 1007270 0 2024-02-19T19:08:21.794 INFO:tasks.workunit.client.0.smithi046.stdout:6/58: dread d4/d6/dd/d10/fc [0,4194304] 0 2024-02-19T19:08:21.796 INFO:tasks.workunit.client.0.smithi046.stdout:8/147: rmdir d3/d18 39 2024-02-19T19:08:21.799 INFO:tasks.workunit.client.0.smithi046.stdout:0/120: rename d0/d19/d8/f15 to d0/d24/f2a 0 2024-02-19T19:08:21.799 INFO:tasks.workunit.client.0.smithi046.stdout:0/121: write d0/d19/f1a [458496,83595] 0 2024-02-19T19:08:21.800 INFO:tasks.workunit.client.0.smithi046.stdout:7/227: mknod d0/d4/d24/c44 0 2024-02-19T19:08:21.800 INFO:tasks.workunit.client.0.smithi046.stdout:7/228: truncate d0/d4/d24/f2e 703949 0 2024-02-19T19:08:21.802 INFO:tasks.workunit.client.0.smithi046.stdout:5/103: mknod d2/c19 0 2024-02-19T19:08:21.803 INFO:tasks.workunit.client.0.smithi046.stdout:6/59: symlink d4/d6/dd/d10/l14 0 2024-02-19T19:08:21.804 INFO:tasks.workunit.client.0.smithi046.stdout:8/148: mkdir d3/dd/d1c/d36 0 2024-02-19T19:08:21.807 INFO:tasks.workunit.client.0.smithi046.stdout:1/170: rename d5/d13/f14 to d5/d13/d35/f36 0 2024-02-19T19:08:21.807 INFO:tasks.workunit.client.0.smithi046.stdout:8/149: dread d3/d18/f1e [0,4194304] 0 2024-02-19T19:08:21.807 INFO:tasks.workunit.client.0.smithi046.stdout:8/150: chown d3/cb 811 1 2024-02-19T19:08:21.807 INFO:tasks.workunit.client.0.smithi046.stdout:8/151: chown d3/dd/d13/f1f 480 1 2024-02-19T19:08:21.807 INFO:tasks.workunit.client.0.smithi046.stdout:0/122: getdents d0 0 2024-02-19T19:08:21.807 INFO:tasks.workunit.client.0.smithi046.stdout:0/123: getdents d0/d19/db 0 2024-02-19T19:08:21.807 INFO:tasks.workunit.client.0.smithi046.stdout:0/124: read d0/f18 [1698199,71038] 0 2024-02-19T19:08:21.807 INFO:tasks.workunit.client.0.smithi046.stdout:0/125: read - d0/d24/f25 zero size 2024-02-19T19:08:21.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/229: mkdir d0/d45 0 2024-02-19T19:08:21.810 INFO:tasks.workunit.client.0.smithi046.stdout:4/76: dwrite d6/fb [0,4194304] 0 2024-02-19T19:08:21.810 INFO:tasks.workunit.client.0.smithi046.stdout:4/77: chown d6/fb 4 1 2024-02-19T19:08:21.810 INFO:tasks.workunit.client.0.smithi046.stdout:4/78: fdatasync d6/f9 0 2024-02-19T19:08:21.810 INFO:tasks.workunit.client.0.smithi046.stdout:4/79: write d6/d11/f18 [2718500,21194] 0 2024-02-19T19:08:21.811 INFO:tasks.workunit.client.0.smithi046.stdout:6/60: creat d4/d6/dd/d10/f15 x:0 0 0 2024-02-19T19:08:21.816 INFO:tasks.workunit.client.0.smithi046.stdout:4/80: creat d6/d15/d17/f1b x:0 0 0 2024-02-19T19:08:21.816 INFO:tasks.workunit.client.0.smithi046.stdout:4/81: chown c3 62 1 2024-02-19T19:08:21.818 INFO:tasks.workunit.client.0.smithi046.stdout:5/104: dread d2/f9 [0,4194304] 0 2024-02-19T19:08:21.818 INFO:tasks.workunit.client.0.smithi046.stdout:5/105: creat d2/dd/f1a x:0 0 0 2024-02-19T19:08:21.819 INFO:tasks.workunit.client.0.smithi046.stdout:6/61: symlink d4/l16 0 2024-02-19T19:08:21.819 INFO:tasks.workunit.client.0.smithi046.stdout:7/230: getdents d0/d4/d34 0 2024-02-19T19:08:21.824 INFO:tasks.workunit.client.0.smithi046.stdout:7/231: read d0/f18 [287967,11101] 0 2024-02-19T19:08:21.824 INFO:tasks.workunit.client.0.smithi046.stdout:7/232: chown d0/d4/d24/f2e 3976 1 2024-02-19T19:08:21.824 INFO:tasks.workunit.client.0.smithi046.stdout:8/152: rename d3/dd/d11 to d3/d37 0 2024-02-19T19:08:21.824 INFO:tasks.workunit.client.0.smithi046.stdout:8/153: fdatasync d3/dd/fe 0 2024-02-19T19:08:21.824 INFO:tasks.workunit.client.0.smithi046.stdout:7/233: rmdir d0/d4/d34 39 2024-02-19T19:08:21.825 INFO:tasks.workunit.client.0.smithi046.stdout:8/154: mknod d3/d37/c38 0 2024-02-19T19:08:21.826 INFO:tasks.workunit.client.0.smithi046.stdout:8/155: rmdir d3/dd 39 2024-02-19T19:08:21.827 INFO:tasks.workunit.client.0.smithi046.stdout:8/156: chown d3/d18/f33 2751 1 2024-02-19T19:08:21.829 INFO:tasks.workunit.client.0.smithi046.stdout:8/157: creat d3/dd/f39 x:0 0 0 2024-02-19T19:08:21.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/106: dread d2/f6 [0,4194304] 0 2024-02-19T19:08:21.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/107: fdatasync d2/fb 0 2024-02-19T19:08:21.838 INFO:tasks.workunit.client.0.smithi046.stdout:5/108: rename d2/l7 to d2/dd/l1b 0 2024-02-19T19:08:21.843 INFO:tasks.workunit.client.0.smithi046.stdout:1/171: dwrite d5/f17 [0,4194304] 0 2024-02-19T19:08:21.845 INFO:tasks.workunit.client.0.smithi046.stdout:0/126: getdents d0/d19/db/d27 0 2024-02-19T19:08:21.845 INFO:tasks.workunit.client.0.smithi046.stdout:0/127: fdatasync d0/d19/d8/f1d 0 2024-02-19T19:08:21.846 INFO:tasks.workunit.client.0.smithi046.stdout:1/172: mkdir d5/d13/d35/d37 0 2024-02-19T19:08:21.848 INFO:tasks.workunit.client.0.smithi046.stdout:0/128: creat d0/d19/db/d27/f2b x:0 0 0 2024-02-19T19:08:21.850 INFO:tasks.workunit.client.0.smithi046.stdout:1/173: link d5/c20 d5/d10/d2d/c38 0 2024-02-19T19:08:21.851 INFO:tasks.workunit.client.0.smithi046.stdout:0/129: truncate d0/f1b 767704 0 2024-02-19T19:08:21.852 INFO:tasks.workunit.client.0.smithi046.stdout:1/174: mknod d5/c39 0 2024-02-19T19:08:21.852 INFO:tasks.workunit.client.0.smithi046.stdout:0/130: rmdir d0/d19 39 2024-02-19T19:08:21.852 INFO:tasks.workunit.client.0.smithi046.stdout:0/131: dread - d0/d24/f26 zero size 2024-02-19T19:08:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:1/175: link d5/d2f/c30 d5/d13/d35/d37/c3a 0 2024-02-19T19:08:21.854 INFO:tasks.workunit.client.0.smithi046.stdout:1/176: mkdir d5/d10/d3b 0 2024-02-19T19:08:21.857 INFO:tasks.workunit.client.0.smithi046.stdout:4/82: dwrite d6/f1a [0,4194304] 0 2024-02-19T19:08:21.857 INFO:tasks.workunit.client.0.smithi046.stdout:4/83: creat d6/d15/d17/f1c x:0 0 0 2024-02-19T19:08:21.857 INFO:tasks.workunit.client.0.smithi046.stdout:6/62: dwrite d4/f5 [0,4194304] 0 2024-02-19T19:08:21.858 INFO:tasks.workunit.client.0.smithi046.stdout:7/234: dwrite d0/d4/f7 [4194304,4194304] 0 2024-02-19T19:08:21.858 INFO:tasks.workunit.client.0.smithi046.stdout:7/235: chown d0/d4/d24 475 1 2024-02-19T19:08:21.858 INFO:tasks.workunit.client.0.smithi046.stdout:7/236: readlink d0/d4/l28 0 2024-02-19T19:08:21.858 INFO:tasks.workunit.client.0.smithi046.stdout:7/237: write d0/f1b [144686,94759] 0 2024-02-19T19:08:21.858 INFO:tasks.workunit.client.0.smithi046.stdout:8/158: dwrite d3/d37/f2e [0,4194304] 0 2024-02-19T19:08:21.859 INFO:tasks.workunit.client.0.smithi046.stdout:8/159: read d3/dd/d1c/f28 [57798,122697] 0 2024-02-19T19:08:21.859 INFO:tasks.workunit.client.0.smithi046.stdout:8/160: readlink d3/l2b 0 2024-02-19T19:08:21.862 INFO:tasks.workunit.client.0.smithi046.stdout:0/132: dread d0/d19/f1a [0,4194304] 0 2024-02-19T19:08:21.862 INFO:tasks.workunit.client.0.smithi046.stdout:0/133: fdatasync d0/d19/db/d27/f2b 0 2024-02-19T19:08:21.864 INFO:tasks.workunit.client.0.smithi046.stdout:7/238: dread d0/f3d [0,4194304] 0 2024-02-19T19:08:21.865 INFO:tasks.workunit.client.0.smithi046.stdout:7/239: write d0/d4/d2a/f39 [169605,70482] 0 2024-02-19T19:08:21.865 INFO:tasks.workunit.client.0.smithi046.stdout:7/240: write d0/d4/dd/f10 [4730878,24193] 0 2024-02-19T19:08:21.874 INFO:tasks.workunit.client.0.smithi046.stdout:4/84: dread d6/d11/f18 [0,4194304] 0 2024-02-19T19:08:21.874 INFO:tasks.workunit.client.0.smithi046.stdout:4/85: stat d6/df/l12 0 2024-02-19T19:08:21.877 INFO:tasks.workunit.client.0.smithi046.stdout:0/134: symlink d0/d19/d8/l2c 0 2024-02-19T19:08:21.877 INFO:tasks.workunit.client.0.smithi046.stdout:0/135: chown d0/d24/f25 134029826 1 2024-02-19T19:08:21.877 INFO:tasks.workunit.client.0.smithi046.stdout:0/136: write d0/d19/f1f [3289609,27236] 0 2024-02-19T19:08:21.879 INFO:tasks.workunit.client.0.smithi046.stdout:4/86: unlink d6/d11/c19 0 2024-02-19T19:08:21.880 INFO:tasks.workunit.client.0.smithi046.stdout:1/177: getdents d5/d13 0 2024-02-19T19:08:21.884 INFO:tasks.workunit.client.0.smithi046.stdout:0/137: rename d0/d24/f25 to d0/d19/f2d 0 2024-02-19T19:08:21.885 INFO:tasks.workunit.client.0.smithi046.stdout:0/138: write d0/d19/d8/f22 [494794,9815] 0 2024-02-19T19:08:21.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/139: creat d0/d19/db/d27/f2e x:0 0 0 2024-02-19T19:08:21.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/140: chown d0/d19/f6 1283212 1 2024-02-19T19:08:21.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/141: readlink d0/d19/d8/l21 0 2024-02-19T19:08:21.887 INFO:tasks.workunit.client.0.smithi046.stdout:0/142: read d0/d19/fd [430965,11248] 0 2024-02-19T19:08:21.887 INFO:tasks.workunit.client.0.smithi046.stdout:0/143: write d0/d19/f1a [1321313,39864] 0 2024-02-19T19:08:21.887 INFO:tasks.workunit.client.0.smithi046.stdout:1/178: dread d5/f12 [4194304,4194304] 0 2024-02-19T19:08:21.888 INFO:tasks.workunit.client.0.smithi046.stdout:0/144: mkdir d0/d24/d2f 0 2024-02-19T19:08:21.888 INFO:tasks.workunit.client.0.smithi046.stdout:0/145: chown d0/d19/d8/f9 3495 1 2024-02-19T19:08:21.888 INFO:tasks.workunit.client.0.smithi046.stdout:0/146: fdatasync d0/f17 0 2024-02-19T19:08:21.889 INFO:tasks.workunit.client.0.smithi046.stdout:1/179: mkdir d5/d10/d3b/d3c 0 2024-02-19T19:08:21.890 INFO:tasks.workunit.client.0.smithi046.stdout:1/180: dread - d5/d10/f2e zero size 2024-02-19T19:08:21.891 INFO:tasks.workunit.client.0.smithi046.stdout:6/63: dwrite d4/f7 [0,4194304] 0 2024-02-19T19:08:21.891 INFO:tasks.workunit.client.0.smithi046.stdout:8/161: dwrite d3/f9 [4194304,4194304] 0 2024-02-19T19:08:21.893 INFO:tasks.workunit.client.0.smithi046.stdout:6/64: dread d4/d6/fe [0,4194304] 0 2024-02-19T19:08:21.893 INFO:tasks.workunit.client.0.smithi046.stdout:6/65: fdatasync d4/d6/dd/d10/f13 0 2024-02-19T19:08:21.893 INFO:tasks.workunit.client.0.smithi046.stdout:1/181: rename d5/cf to d5/d10/c3d 0 2024-02-19T19:08:21.893 INFO:tasks.workunit.client.0.smithi046.stdout:1/182: chown d5/l22 156690823 1 2024-02-19T19:08:21.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/66: dread d4/d6/fe [0,4194304] 0 2024-02-19T19:08:21.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/67: fdatasync d4/d6/dd/f11 0 2024-02-19T19:08:21.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/68: creat d4/d6/dd/f17 x:0 0 0 2024-02-19T19:08:21.911 INFO:tasks.workunit.client.0.smithi046.stdout:4/87: fsync d6/d15/d17/f1c 0 2024-02-19T19:08:21.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/147: dwrite d0/d19/f1f [0,4194304] 0 2024-02-19T19:08:21.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/148: stat d0/d19/d8/f9 0 2024-02-19T19:08:21.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/149: read d0/f18 [4161249,8983] 0 2024-02-19T19:08:21.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/150: read d0/d24/f2a [233807,7822] 0 2024-02-19T19:08:21.921 INFO:tasks.workunit.client.0.smithi046.stdout:4/88: rename d6/la to d6/l1d 0 2024-02-19T19:08:21.922 INFO:tasks.workunit.client.0.smithi046.stdout:6/69: dwrite d4/d6/fe [0,4194304] 0 2024-02-19T19:08:21.922 INFO:tasks.workunit.client.0.smithi046.stdout:6/70: dread - d4/d6/dd/d10/f15 zero size 2024-02-19T19:08:21.923 INFO:tasks.workunit.client.0.smithi046.stdout:1/183: dwrite d5/d21/f34 [0,4194304] 0 2024-02-19T19:08:21.923 INFO:tasks.workunit.client.0.smithi046.stdout:8/162: getdents d3/dd/d13 0 2024-02-19T19:08:21.923 INFO:tasks.workunit.client.0.smithi046.stdout:8/163: chown d3/c19 630 1 2024-02-19T19:08:21.923 INFO:tasks.workunit.client.0.smithi046.stdout:8/164: creat d3/f3a x:0 0 0 2024-02-19T19:08:21.927 INFO:tasks.workunit.client.0.smithi046.stdout:0/151: creat d0/d19/d8/f30 x:0 0 0 2024-02-19T19:08:21.930 INFO:tasks.workunit.client.0.smithi046.stdout:4/89: rename d6/df to d6/d15/d17/d1e 0 2024-02-19T19:08:21.939 INFO:tasks.workunit.client.0.smithi046.stdout:6/71: dwrite d4/d6/dd/d10/fc [0,4194304] 0 2024-02-19T19:08:21.944 INFO:tasks.workunit.client.0.smithi046.stdout:1/184: symlink d5/d13/d35/l3e 0 2024-02-19T19:08:21.944 INFO:tasks.workunit.client.0.smithi046.stdout:1/185: write d5/d13/f19 [2337804,21370] 0 2024-02-19T19:08:21.947 INFO:tasks.workunit.client.0.smithi046.stdout:8/165: symlink d3/dd/d1c/d36/l3b 0 2024-02-19T19:08:21.949 INFO:tasks.workunit.client.0.smithi046.stdout:0/152: symlink d0/d19/d8/l31 0 2024-02-19T19:08:21.950 INFO:tasks.workunit.client.0.smithi046.stdout:1/186: dread d5/f12 [4194304,4194304] 0 2024-02-19T19:08:21.953 INFO:tasks.workunit.client.0.smithi046.stdout:4/90: rename c3 to d6/c1f 0 2024-02-19T19:08:21.953 INFO:tasks.workunit.client.0.smithi046.stdout:6/72: dread d4/d6/dd/d10/f13 [4194304,4194304] 0 2024-02-19T19:08:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:0/153: link d0/f1c d0/d24/f32 0 2024-02-19T19:08:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:4/91: getdents d6/d15 0 2024-02-19T19:08:21.963 INFO:tasks.workunit.client.0.smithi046.stdout:1/187: dread d5/d21/f34 [0,4194304] 0 2024-02-19T19:08:21.963 INFO:tasks.workunit.client.0.smithi046.stdout:1/188: fsync d5/d2f/f32 0 2024-02-19T19:08:21.963 INFO:tasks.workunit.client.0.smithi046.stdout:1/189: write d5/fc [615493,10551] 0 2024-02-19T19:08:21.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/154: link d0/d19/d8/l31 d0/l33 0 2024-02-19T19:08:21.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/155: truncate d0/d19/d8/f9 1417329 0 2024-02-19T19:08:21.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/156: write d0/d19/fd [1534140,64878] 0 2024-02-19T19:08:21.965 INFO:tasks.workunit.client.0.smithi046.stdout:4/92: unlink d6/d15/d17/d1e/f14 0 2024-02-19T19:08:21.966 INFO:tasks.workunit.client.0.smithi046.stdout:8/166: dwrite d3/dd/d1c/f28 [0,4194304] 0 2024-02-19T19:08:21.966 INFO:tasks.workunit.client.0.smithi046.stdout:1/190: mkdir d5/d10/d3b/d3c/d3f 0 2024-02-19T19:08:21.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/157: truncate d0/f1b 354493 0 2024-02-19T19:08:21.968 INFO:tasks.workunit.client.0.smithi046.stdout:6/73: write d4/f8 [6380417,26256] 0 2024-02-19T19:08:21.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/167: mkdir d3/d37/d1d/d3c 0 2024-02-19T19:08:21.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/168: dread - d3/dd/f24 zero size 2024-02-19T19:08:21.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/169: dread - d3/dd/f24 zero size 2024-02-19T19:08:21.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/170: dread - d3/dd/d13/f32 zero size 2024-02-19T19:08:21.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/171: chown d3/d37/c38 33590 1 2024-02-19T19:08:21.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/191: mknod d5/d13/d35/d37/c40 0 2024-02-19T19:08:21.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/192: truncate d5/d13/d35/f36 1172994 0 2024-02-19T19:08:21.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/93: write d6/f1a [3468247,123276] 0 2024-02-19T19:08:21.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/94: write d6/d15/d17/f1b [212169,3835] 0 2024-02-19T19:08:21.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/95: stat d6/fb 0 2024-02-19T19:08:21.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/96: fdatasync d6/f9 0 2024-02-19T19:08:21.976 INFO:tasks.workunit.client.0.smithi046.stdout:6/74: truncate d4/d6/dd/d10/f13 3428556 0 2024-02-19T19:08:21.977 INFO:tasks.workunit.client.0.smithi046.stdout:8/172: symlink d3/dd/d1c/l3d 0 2024-02-19T19:08:21.979 INFO:tasks.workunit.client.0.smithi046.stdout:1/193: rename d5/f33 to d5/d13/d35/f41 0 2024-02-19T19:08:21.981 INFO:tasks.workunit.client.0.smithi046.stdout:6/75: truncate d4/d6/fe 3706012 0 2024-02-19T19:08:21.982 INFO:tasks.workunit.client.0.smithi046.stdout:4/97: rename d6/d11/f18 to d6/d15/d17/f20 0 2024-02-19T19:08:21.983 INFO:tasks.workunit.client.0.smithi046.stdout:0/158: dwrite d0/d24/f2a [0,4194304] 0 2024-02-19T19:08:21.984 INFO:tasks.workunit.client.0.smithi046.stdout:1/194: link d5/d13/d35/l3e d5/d21/l42 0 2024-02-19T19:08:21.985 INFO:tasks.workunit.client.0.smithi046.stdout:8/173: dread d3/dd/d13/f1f [0,4194304] 0 2024-02-19T19:08:21.986 INFO:tasks.workunit.client.0.smithi046.stdout:6/76: unlink d4/d6/dd/d10/l12 0 2024-02-19T19:08:21.989 INFO:tasks.workunit.client.0.smithi046.stdout:4/98: symlink d6/d15/d17/d1e/l21 0 2024-02-19T19:08:22.002 INFO:tasks.workunit.client.0.smithi046.stdout:1/195: getdents d5/d10/d2d 0 2024-02-19T19:08:22.003 INFO:tasks.workunit.client.0.smithi046.stdout:8/174: creat d3/d37/d1d/d3c/f3e x:0 0 0 2024-02-19T19:08:22.004 INFO:tasks.workunit.client.0.smithi046.stdout:8/175: dread - d3/d18/f33 zero size 2024-02-19T19:08:22.006 INFO:tasks.workunit.client.0.smithi046.stdout:4/99: mknod d6/d15/c22 0 2024-02-19T19:08:22.007 INFO:tasks.workunit.client.0.smithi046.stdout:0/159: dwrite d0/d19/db/d27/f28 [0,4194304] 0 2024-02-19T19:08:22.007 INFO:tasks.workunit.client.0.smithi046.stdout:0/160: creat d0/d19/d8/f34 x:0 0 0 2024-02-19T19:08:22.008 INFO:tasks.workunit.client.0.smithi046.stdout:1/196: rename d5/d2f/f32 to d5/d10/d3b/d3c/d3f/f43 0 2024-02-19T19:08:22.013 INFO:tasks.workunit.client.0.smithi046.stdout:6/77: rmdir d4/d6 39 2024-02-19T19:08:22.015 INFO:tasks.workunit.client.0.smithi046.stdout:4/100: symlink d6/d15/d17/d1e/l23 0 2024-02-19T19:08:22.015 INFO:tasks.workunit.client.0.smithi046.stdout:4/101: stat d6/f9 0 2024-02-19T19:08:22.015 INFO:tasks.workunit.client.0.smithi046.stdout:0/161: write d0/d19/fd [2402000,126679] 0 2024-02-19T19:08:22.017 INFO:tasks.workunit.client.0.smithi046.stdout:1/197: mknod d5/d13/c44 0 2024-02-19T19:08:22.017 INFO:tasks.workunit.client.0.smithi046.stdout:0/162: dread d0/d19/f1a [0,4194304] 0 2024-02-19T19:08:22.018 INFO:tasks.workunit.client.0.smithi046.stdout:6/78: mknod d4/c18 0 2024-02-19T19:08:22.018 INFO:tasks.workunit.client.0.smithi046.stdout:6/79: write d4/d6/dd/d10/fc [4731233,69284] 0 2024-02-19T19:08:22.019 INFO:tasks.workunit.client.0.smithi046.stdout:4/102: mknod d6/d11/c24 0 2024-02-19T19:08:22.019 INFO:tasks.workunit.client.0.smithi046.stdout:4/103: read - d6/d15/d17/f1c zero size 2024-02-19T19:08:22.019 INFO:tasks.workunit.client.0.smithi046.stdout:0/163: dread d0/f1b [0,4194304] 0 2024-02-19T19:08:22.020 INFO:tasks.workunit.client.0.smithi046.stdout:1/198: mkdir d5/d10/d45 0 2024-02-19T19:08:22.022 INFO:tasks.workunit.client.0.smithi046.stdout:3/112: sync 2024-02-19T19:08:22.022 INFO:tasks.workunit.client.0.smithi046.stdout:2/129: sync 2024-02-19T19:08:22.022 INFO:tasks.workunit.client.0.smithi046.stdout:9/104: sync 2024-02-19T19:08:22.023 INFO:tasks.workunit.client.0.smithi046.stdout:4/104: mkdir d6/d15/d17/d1e/d25 0 2024-02-19T19:08:22.023 INFO:tasks.workunit.client.0.smithi046.stdout:4/105: fdatasync d6/d15/d17/f20 0 2024-02-19T19:08:22.024 INFO:tasks.workunit.client.0.smithi046.stdout:0/164: rename d0/d19/d8/f30 to d0/d19/f35 0 2024-02-19T19:08:22.027 INFO:tasks.workunit.client.0.smithi046.stdout:6/80: write d4/d6/dd/d10/fc [3552248,28520] 0 2024-02-19T19:08:22.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/113: unlink da/cc 0 2024-02-19T19:08:22.027 INFO:tasks.workunit.client.0.smithi046.stdout:8/176: dwrite d3/f9 [4194304,4194304] 0 2024-02-19T19:08:22.028 INFO:tasks.workunit.client.0.smithi046.stdout:2/130: mknod d5/df/c22 0 2024-02-19T19:08:22.029 INFO:tasks.workunit.client.0.smithi046.stdout:5/109: sync 2024-02-19T19:08:22.029 INFO:tasks.workunit.client.0.smithi046.stdout:7/241: sync 2024-02-19T19:08:22.029 INFO:tasks.workunit.client.0.smithi046.stdout:7/242: dread - d0/f3e zero size 2024-02-19T19:08:22.030 INFO:tasks.workunit.client.0.smithi046.stdout:5/110: creat d2/dd/f1c x:0 0 0 2024-02-19T19:08:22.030 INFO:tasks.workunit.client.0.smithi046.stdout:7/243: write d0/f3e [557363,46905] 0 2024-02-19T19:08:22.030 INFO:tasks.workunit.client.0.smithi046.stdout:7/244: truncate d0/d4/d2a/f2c 4647596 0 2024-02-19T19:08:22.030 INFO:tasks.workunit.client.0.smithi046.stdout:7/245: write d0/d4/f8 [5897408,88739] 0 2024-02-19T19:08:22.034 INFO:tasks.workunit.client.0.smithi046.stdout:6/81: link d4/f5 d4/f19 0 2024-02-19T19:08:22.036 INFO:tasks.workunit.client.0.smithi046.stdout:3/114: rename da/dd/ce to da/c1a 0 2024-02-19T19:08:22.036 INFO:tasks.workunit.client.0.smithi046.stdout:3/115: chown da/lb 7681 1 2024-02-19T19:08:22.036 INFO:tasks.workunit.client.0.smithi046.stdout:3/116: stat da/dd/d10/c16 0 2024-02-19T19:08:22.037 INFO:tasks.workunit.client.0.smithi046.stdout:3/117: stat da/f15 0 2024-02-19T19:08:22.037 INFO:tasks.workunit.client.0.smithi046.stdout:3/118: read da/f15 [3650593,130598] 0 2024-02-19T19:08:22.037 INFO:tasks.workunit.client.0.smithi046.stdout:3/119: write da/f15 [3034987,103938] 0 2024-02-19T19:08:22.037 INFO:tasks.workunit.client.0.smithi046.stdout:8/177: mkdir d3/dd/d3f 0 2024-02-19T19:08:22.038 INFO:tasks.workunit.client.0.smithi046.stdout:2/131: creat d5/d6/f23 x:0 0 0 2024-02-19T19:08:22.038 INFO:tasks.workunit.client.0.smithi046.stdout:2/132: dread - d5/df/f10 zero size 2024-02-19T19:08:22.039 INFO:tasks.workunit.client.0.smithi046.stdout:2/133: creat d5/df/f24 x:0 0 0 2024-02-19T19:08:22.041 INFO:tasks.workunit.client.0.smithi046.stdout:5/111: symlink d2/l1d 0 2024-02-19T19:08:22.045 INFO:tasks.workunit.client.0.smithi046.stdout:7/246: unlink d0/d4/d2a/f2c 0 2024-02-19T19:08:22.045 INFO:tasks.workunit.client.0.smithi046.stdout:7/247: dread - d0/f30 zero size 2024-02-19T19:08:22.046 INFO:tasks.workunit.client.0.smithi046.stdout:7/248: write d0/f3e [770014,5306] 0 2024-02-19T19:08:22.046 INFO:tasks.workunit.client.0.smithi046.stdout:4/106: getdents d6/d11 0 2024-02-19T19:08:22.046 INFO:tasks.workunit.client.0.smithi046.stdout:4/107: chown d6/c1f 1985087 1 2024-02-19T19:08:22.047 INFO:tasks.workunit.client.0.smithi046.stdout:3/120: creat da/dd/d10/f1b x:0 0 0 2024-02-19T19:08:22.048 INFO:tasks.workunit.client.0.smithi046.stdout:5/112: mknod d2/dd/c1e 0 2024-02-19T19:08:22.049 INFO:tasks.workunit.client.0.smithi046.stdout:4/108: mkdir d6/d11/d26 0 2024-02-19T19:08:22.049 INFO:tasks.workunit.client.0.smithi046.stdout:5/113: symlink d2/l1f 0 2024-02-19T19:08:22.050 INFO:tasks.workunit.client.0.smithi046.stdout:5/114: chown d2/dd/c1e 127262 1 2024-02-19T19:08:22.050 INFO:tasks.workunit.client.0.smithi046.stdout:4/109: symlink d6/d15/d17/l27 0 2024-02-19T19:08:22.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/110: creat d6/d11/d26/f28 x:0 0 0 2024-02-19T19:08:22.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/111: write d6/f9 [4458870,43421] 0 2024-02-19T19:08:22.053 INFO:tasks.workunit.client.0.smithi046.stdout:8/178: dwrite d3/d37/f2d [0,4194304] 0 2024-02-19T19:08:22.053 INFO:tasks.workunit.client.0.smithi046.stdout:8/179: chown d3/d37/f2d 569 1 2024-02-19T19:08:22.055 INFO:tasks.workunit.client.0.smithi046.stdout:8/180: creat d3/dd/d3f/f40 x:0 0 0 2024-02-19T19:08:22.081 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:21 smithi046 podman[112339]: 2024-02-19 19:08:21.749977118 +0000 UTC m=+1.101019991 container init b0d22d02dde4af485cd8c33c1c532ea32d932240a82ec89a9dba21ecb08874ed (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:08:22.081 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:21 smithi046 podman[112339]: 2024-02-19 19:08:21.75470263 +0000 UTC m=+1.105745509 container start b0d22d02dde4af485cd8c33c1c532ea32d932240a82ec89a9dba21ecb08874ed (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:08:22.082 INFO:tasks.workunit.client.0.smithi046.stdout:8/181: dwrite d3/dd/d13/f1b [0,4194304] 0 2024-02-19T19:08:22.189 INFO:tasks.workunit.client.0.smithi046.stdout:1/199: dwrite d5/d10/d3b/d3c/d3f/f43 [0,4194304] 0 2024-02-19T19:08:22.189 INFO:tasks.workunit.client.0.smithi046.stdout:1/200: write d5/fc [614760,6484] 0 2024-02-19T19:08:22.189 INFO:tasks.workunit.client.0.smithi046.stdout:1/201: write d5/f17 [4265618,24637] 0 2024-02-19T19:08:22.189 INFO:tasks.workunit.client.0.smithi046.stdout:6/82: fsync d4/d6/dd/d10/fc 0 2024-02-19T19:08:22.190 INFO:tasks.workunit.client.0.smithi046.stdout:1/202: truncate d5/f12 8020488 0 2024-02-19T19:08:22.191 INFO:tasks.workunit.client.0.smithi046.stdout:6/83: creat d4/d6/f1a x:0 0 0 2024-02-19T19:08:22.192 INFO:tasks.workunit.client.0.smithi046.stdout:6/84: readlink d4/l16 0 2024-02-19T19:08:22.192 INFO:tasks.workunit.client.0.smithi046.stdout:6/85: chown l0 531877 1 2024-02-19T19:08:22.194 INFO:tasks.workunit.client.0.smithi046.stdout:2/134: dread d5/d6/fd [0,4194304] 0 2024-02-19T19:08:22.194 INFO:tasks.workunit.client.0.smithi046.stdout:1/203: unlink d5/d13/l15 0 2024-02-19T19:08:22.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/86: symlink d4/d6/l1b 0 2024-02-19T19:08:22.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/87: write d4/f7 [5093851,26494] 0 2024-02-19T19:08:22.197 INFO:tasks.workunit.client.0.smithi046.stdout:2/135: symlink d5/d6/d13/l25 0 2024-02-19T19:08:22.198 INFO:tasks.workunit.client.0.smithi046.stdout:7/249: dread d0/f3e [0,4194304] 0 2024-02-19T19:08:22.200 INFO:tasks.workunit.client.0.smithi046.stdout:6/88: mkdir d4/d6/d1c 0 2024-02-19T19:08:22.201 INFO:tasks.workunit.client.0.smithi046.stdout:6/89: readlink d4/l16 0 2024-02-19T19:08:22.201 INFO:tasks.workunit.client.0.smithi046.stdout:6/90: chown d4/cf 0 1 2024-02-19T19:08:22.201 INFO:tasks.workunit.client.0.smithi046.stdout:6/91: readlink l0 0 2024-02-19T19:08:22.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/112: dwrite d6/f9 [0,4194304] 0 2024-02-19T19:08:22.206 INFO:tasks.workunit.client.0.smithi046.stdout:8/182: dwrite d3/dd/d3f/f40 [0,4194304] 0 2024-02-19T19:08:22.209 INFO:tasks.workunit.client.0.smithi046.stdout:2/136: rmdir d5/d6/d13 39 2024-02-19T19:08:22.211 INFO:tasks.workunit.client.0.smithi046.stdout:7/250: symlink d0/d45/l46 0 2024-02-19T19:08:22.212 INFO:tasks.workunit.client.0.smithi046.stdout:1/204: dwrite d5/f1f [0,4194304] 0 2024-02-19T19:08:22.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/92: mknod d4/d6/dd/d10/c1d 0 2024-02-19T19:08:22.213 INFO:tasks.workunit.client.0.smithi046.stdout:4/113: rename d6/l7 to d6/d11/d26/l29 0 2024-02-19T19:08:22.215 INFO:tasks.workunit.client.0.smithi046.stdout:3/121: dwrite da/f15 [0,4194304] 0 2024-02-19T19:08:22.216 INFO:tasks.workunit.client.0.smithi046.stdout:8/183: link d3/dd/f39 d3/d37/d1d/d3c/f41 0 2024-02-19T19:08:22.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/137: symlink d5/l26 0 2024-02-19T19:08:22.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/114: write d6/fb [1150889,61073] 0 2024-02-19T19:08:22.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/115: stat d6/d15/d17/f1b 0 2024-02-19T19:08:22.223 INFO:tasks.workunit.client.0.smithi046.stdout:1/205: dwrite d5/d13/d35/f36 [0,4194304] 0 2024-02-19T19:08:22.223 INFO:tasks.workunit.client.0.smithi046.stdout:1/206: fsync d5/d10/d3b/d3c/d3f/f43 0 2024-02-19T19:08:22.236 INFO:tasks.workunit.client.0.smithi046.stdout:7/251: rmdir d0/d4/d24 39 2024-02-19T19:08:22.300 INFO:tasks.workunit.client.0.smithi046.stdout:8/184: mkdir d3/dd/d13/d42 0 2024-02-19T19:08:22.300 INFO:tasks.workunit.client.0.smithi046.stdout:8/185: creat d3/d37/d1d/d3c/f43 x:0 0 0 2024-02-19T19:08:22.301 INFO:tasks.workunit.client.0.smithi046.stdout:2/138: truncate d5/d6/fd 6791657 0 2024-02-19T19:08:22.302 INFO:tasks.workunit.client.0.smithi046.stdout:2/139: readlink d5/d6/le 0 2024-02-19T19:08:22.305 INFO:tasks.workunit.client.0.smithi046.stdout:4/116: creat d6/d15/d17/d1e/f2a x:0 0 0 2024-02-19T19:08:22.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/207: getdents d5/d10/d3b 0 2024-02-19T19:08:22.311 INFO:tasks.workunit.client.0.smithi046.stdout:7/252: symlink d0/l47 0 2024-02-19T19:08:22.314 INFO:tasks.workunit.client.0.smithi046.stdout:6/93: truncate d4/f8 7170215 0 2024-02-19T19:08:22.314 INFO:tasks.workunit.client.0.smithi046.stdout:6/94: readlink d4/d6/l1b 0 2024-02-19T19:08:22.316 INFO:tasks.workunit.client.0.smithi046.stdout:8/186: truncate d3/dd/d1c/f28 2731126 0 2024-02-19T19:08:22.317 INFO:tasks.workunit.client.0.smithi046.stdout:4/117: mknod d6/d15/d17/d1e/d25/c2b 0 2024-02-19T19:08:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:6/95: link d4/d6/l1b d4/d6/d1c/l1e 0 2024-02-19T19:08:22.321 INFO:tasks.workunit.client.0.smithi046.stdout:2/140: dwrite d5/df/f24 [0,4194304] 0 2024-02-19T19:08:22.321 INFO:tasks.workunit.client.0.smithi046.stdout:2/141: write d5/df/f1a [295560,74192] 0 2024-02-19T19:08:22.321 INFO:tasks.workunit.client.0.smithi046.stdout:2/142: readlink d5/d6/lb 0 2024-02-19T19:08:22.321 INFO:tasks.workunit.client.0.smithi046.stdout:8/187: rename d3/dd/d3f/f40 to d3/f44 0 2024-02-19T19:08:22.322 INFO:tasks.workunit.client.0.smithi046.stdout:8/188: stat d3/dd 0 2024-02-19T19:08:22.322 INFO:tasks.workunit.client.0.smithi046.stdout:8/189: truncate d3/dd/d1c/f29 1674650 0 2024-02-19T19:08:22.322 INFO:tasks.workunit.client.0.smithi046.stdout:6/96: mknod d4/d6/dd/d10/c1f 0 2024-02-19T19:08:22.327 INFO:tasks.workunit.client.0.smithi046.stdout:4/118: rename d6/d15/d17/f1c to d6/d15/d17/d1e/d25/f2c 0 2024-02-19T19:08:22.328 INFO:tasks.workunit.client.0.smithi046.stdout:4/119: write d6/fb [4675260,98376] 0 2024-02-19T19:08:22.329 INFO:tasks.workunit.client.0.smithi046.stdout:8/190: mkdir d3/dd/d13/d42/d45 0 2024-02-19T19:08:22.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/253: dwrite d0/d4/f8 [0,4194304] 0 2024-02-19T19:08:22.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/254: dread - d0/d4/f3c zero size 2024-02-19T19:08:22.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/255: readlink d0/d4/l2b 0 2024-02-19T19:08:22.330 INFO:tasks.workunit.client.0.smithi046.stdout:4/120: fsync d6/fb 0 2024-02-19T19:08:22.330 INFO:tasks.workunit.client.0.smithi046.stdout:4/121: dread - d6/d15/d17/d1e/d25/f2c zero size 2024-02-19T19:08:22.330 INFO:tasks.workunit.client.0.smithi046.stdout:4/122: stat d6/d11 0 2024-02-19T19:08:22.330 INFO:tasks.workunit.client.0.smithi046.stdout:6/97: mkdir d4/d6/d1c/d20 0 2024-02-19T19:08:22.332 INFO:tasks.workunit.client.0.smithi046.stdout:4/123: dread d6/fb [4194304,4194304] 0 2024-02-19T19:08:22.332 INFO:tasks.workunit.client.0.smithi046.stdout:2/143: getdents d5/df 0 2024-02-19T19:08:22.332 INFO:tasks.workunit.client.0.smithi046.stdout:2/144: write f3 [1615645,76036] 0 2024-02-19T19:08:22.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/191: mkdir d3/dd/d1c/d46 0 2024-02-19T19:08:22.334 INFO:tasks.workunit.client.0.smithi046.stdout:8/192: write d3/d18/f1e [1125050,120350] 0 2024-02-19T19:08:22.341 INFO:tasks.workunit.client.0.smithi046.stdout:6/98: dread d4/f5 [0,4194304] 0 2024-02-19T19:08:22.342 INFO:tasks.workunit.client.0.smithi046.stdout:6/99: dread - d4/d6/dd/f11 zero size 2024-02-19T19:08:22.342 INFO:tasks.workunit.client.0.smithi046.stdout:6/100: chown d4/d6/dd/d10/fc 105 1 2024-02-19T19:08:22.342 INFO:tasks.workunit.client.0.smithi046.stdout:6/101: read - d4/d6/f1a zero size 2024-02-19T19:08:22.386 INFO:tasks.workunit.client.0.smithi046.stdout:7/256: creat d0/f48 x:0 0 0 2024-02-19T19:08:22.387 INFO:tasks.workunit.client.0.smithi046.stdout:2/145: symlink d5/l27 0 2024-02-19T19:08:22.388 INFO:tasks.workunit.client.0.smithi046.stdout:8/193: creat d3/dd/d13/d42/f47 x:0 0 0 2024-02-19T19:08:22.388 INFO:tasks.workunit.client.0.smithi046.stdout:8/194: dread - d3/dd/f39 zero size 2024-02-19T19:08:22.389 INFO:tasks.workunit.client.0.smithi046.stdout:8/195: creat d3/dd/d1c/f48 x:0 0 0 2024-02-19T19:08:22.390 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate[112354]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T19:08:22.390 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate[112354]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-19T19:08:22.390 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate[112354]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-19T19:08:22.390 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate[112354]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-19T19:08:22.390 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate[112354]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-19T19:08:22.390 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate[112354]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T19:08:22.390 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate[112354]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-19T19:08:22.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/102: creat d4/d6/dd/f21 x:0 0 0 2024-02-19T19:08:22.392 INFO:tasks.workunit.client.0.smithi046.stdout:6/103: stat d4/d6/d1c/d20 0 2024-02-19T19:08:22.392 INFO:tasks.workunit.client.0.smithi046.stdout:6/104: write d4/d6/dd/d10/fc [5565721,70744] 0 2024-02-19T19:08:22.398 INFO:tasks.workunit.client.0.smithi046.stdout:2/146: dread d5/d6/fa [0,4194304] 0 2024-02-19T19:08:22.417 INFO:tasks.workunit.client.0.smithi046.stdout:4/124: truncate d6/f9 4464468 0 2024-02-19T19:08:22.420 INFO:tasks.workunit.client.0.smithi046.stdout:8/196: mkdir d3/dd/d3f/d49 0 2024-02-19T19:08:22.420 INFO:tasks.workunit.client.0.smithi046.stdout:8/197: stat d3/d37/d1d/d3c/f3e 0 2024-02-19T19:08:22.420 INFO:tasks.workunit.client.0.smithi046.stdout:8/198: dread - d3/d37/d1d/d3c/f3e zero size 2024-02-19T19:08:22.420 INFO:tasks.workunit.client.0.smithi046.stdout:8/199: write d3/dd/ff [884050,87774] 0 2024-02-19T19:08:22.420 INFO:tasks.workunit.client.0.smithi046.stdout:8/200: fsync d3/f10 0 2024-02-19T19:08:22.422 INFO:tasks.workunit.client.0.smithi046.stdout:6/105: mkdir d4/d6/d22 0 2024-02-19T19:08:22.422 INFO:tasks.workunit.client.0.smithi046.stdout:6/106: fsync d4/f8 0 2024-02-19T19:08:22.424 INFO:tasks.workunit.client.0.smithi046.stdout:4/125: dread d6/d15/d17/f20 [0,4194304] 0 2024-02-19T19:08:22.435 INFO:tasks.workunit.client.0.smithi046.stdout:7/257: fsync d0/f48 0 2024-02-19T19:08:22.435 INFO:tasks.workunit.client.0.smithi046.stdout:7/258: creat d0/f49 x:0 0 0 2024-02-19T19:08:22.435 INFO:tasks.workunit.client.0.smithi046.stdout:7/259: dread d0/f3d [0,4194304] 0 2024-02-19T19:08:22.435 INFO:tasks.workunit.client.0.smithi046.stdout:7/260: dread - d0/f48 zero size 2024-02-19T19:08:22.438 INFO:tasks.workunit.client.0.smithi046.stdout:9/105: sync 2024-02-19T19:08:22.444 INFO:tasks.workunit.client.0.smithi046.stdout:5/115: sync 2024-02-19T19:08:22.444 INFO:tasks.workunit.client.0.smithi046.stdout:3/122: sync 2024-02-19T19:08:22.444 INFO:tasks.workunit.client.0.smithi046.stdout:0/165: sync 2024-02-19T19:08:22.444 INFO:tasks.workunit.client.0.smithi046.stdout:5/116: chown d2/l11 1361 1 2024-02-19T19:08:22.444 INFO:tasks.workunit.client.0.smithi046.stdout:3/123: fsync da/dd/d10/f1b 0 2024-02-19T19:08:22.444 INFO:tasks.workunit.client.0.smithi046.stdout:5/117: chown d2/l1f 316 1 2024-02-19T19:08:22.445 INFO:tasks.workunit.client.0.smithi046.stdout:5/118: creat d2/dd/f20 x:0 0 0 2024-02-19T19:08:22.490 INFO:tasks.workunit.client.0.smithi046.stdout:2/147: creat d5/df/f28 x:0 0 0 2024-02-19T19:08:22.619 INFO:tasks.workunit.client.0.smithi046.stdout:8/201: rename d3/f4 to d3/dd/d1c/d36/f4a 0 2024-02-19T19:08:22.620 INFO:tasks.workunit.client.0.smithi046.stdout:6/107: rename d4/d6/d1c to d4/d6/d1c/d23 22 2024-02-19T19:08:22.620 INFO:tasks.workunit.client.0.smithi046.stdout:8/202: dread - d3/d37/d1d/d3c/f41 zero size 2024-02-19T19:08:22.620 INFO:tasks.workunit.client.0.smithi046.stdout:4/126: symlink d6/d11/l2d 0 2024-02-19T19:08:22.622 INFO:tasks.workunit.client.0.smithi046.stdout:7/261: mkdir d0/d45/d4a 0 2024-02-19T19:08:22.622 INFO:tasks.workunit.client.0.smithi046.stdout:7/262: chown d0/d4/dd/f40 168071011 1 2024-02-19T19:08:22.622 INFO:tasks.workunit.client.0.smithi046.stdout:9/106: mkdir db/d1e 0 2024-02-19T19:08:22.623 INFO:tasks.workunit.client.0.smithi046.stdout:0/166: rmdir d0 39 2024-02-19T19:08:22.626 INFO:tasks.workunit.client.0.smithi046.stdout:5/119: rename d2/f6 to d2/f21 0 2024-02-19T19:08:22.627 INFO:tasks.workunit.client.0.smithi046.stdout:2/148: rmdir d5/d6/d13 39 2024-02-19T19:08:22.627 INFO:tasks.workunit.client.0.smithi046.stdout:2/149: write d5/df/f1a [694269,76499] 0 2024-02-19T19:08:22.628 INFO:tasks.workunit.client.0.smithi046.stdout:8/203: stat d3/d37/l2a 0 2024-02-19T19:08:22.628 INFO:tasks.workunit.client.0.smithi046.stdout:8/204: stat d3/l8 0 2024-02-19T19:08:22.629 INFO:tasks.workunit.client.0.smithi046.stdout:7/263: mkdir d0/d4/d34/d4b 0 2024-02-19T19:08:22.630 INFO:tasks.workunit.client.0.smithi046.stdout:7/264: readlink d0/d4/d2a/l31 0 2024-02-19T19:08:22.630 INFO:tasks.workunit.client.0.smithi046.stdout:7/265: fsync d0/d4/d2a/f39 0 2024-02-19T19:08:22.631 INFO:tasks.workunit.client.0.smithi046.stdout:3/124: getdents da/dd/d10 0 2024-02-19T19:08:22.631 INFO:tasks.workunit.client.0.smithi046.stdout:3/125: dread - da/dd/d10/f1b zero size 2024-02-19T19:08:22.632 INFO:tasks.workunit.client.0.smithi046.stdout:3/126: chown da/dd/l17 1304970 1 2024-02-19T19:08:22.632 INFO:tasks.workunit.client.0.smithi046.stdout:3/127: getdents da/dd/d10 0 2024-02-19T19:08:22.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/108: dread d4/f8 [0,4194304] 0 2024-02-19T19:08:22.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/109: stat d4/f7 0 2024-02-19T19:08:22.633 INFO:tasks.workunit.client.0.smithi046.stdout:9/107: write f2 [552238,17795] 0 2024-02-19T19:08:22.633 INFO:tasks.workunit.client.0.smithi046.stdout:9/108: fsync fa 0 2024-02-19T19:08:22.633 INFO:tasks.workunit.client.0.smithi046.stdout:8/205: dread d3/dd/fe [0,4194304] 0 2024-02-19T19:08:22.633 INFO:tasks.workunit.client.0.smithi046.stdout:8/206: dread - d3/d37/d1d/d3c/f43 zero size 2024-02-19T19:08:22.635 INFO:tasks.workunit.client.0.smithi046.stdout:7/266: rename d0/f3d to d0/d4/d34/f4c 0 2024-02-19T19:08:22.637 INFO:tasks.workunit.client.0.smithi046.stdout:0/167: symlink d0/d19/db/d27/l36 0 2024-02-19T19:08:22.641 INFO:tasks.workunit.client.0.smithi046.stdout:8/207: read d3/d37/f2d [1051628,76984] 0 2024-02-19T19:08:22.641 INFO:tasks.workunit.client.0.smithi046.stdout:8/208: write d3/d37/d1d/d3c/f3e [66067,12822] 0 2024-02-19T19:08:22.642 INFO:tasks.workunit.client.0.smithi046.stdout:8/209: dread d3/d18/f20 [0,4194304] 0 2024-02-19T19:08:22.642 INFO:tasks.workunit.client.0.smithi046.stdout:8/210: chown d3/dd/d13 35537 1 2024-02-19T19:08:22.643 INFO:tasks.workunit.client.0.smithi046.stdout:7/267: unlink d0/d4/d2a/f33 0 2024-02-19T19:08:22.645 INFO:tasks.workunit.client.0.smithi046.stdout:0/168: mkdir d0/d19/d8/d37 0 2024-02-19T19:08:22.645 INFO:tasks.workunit.client.0.smithi046.stdout:0/169: chown d0/d19/db/c1e 1259074 1 2024-02-19T19:08:22.646 INFO:tasks.workunit.client.0.smithi046.stdout:2/150: getdents d5/df 0 2024-02-19T19:08:22.647 INFO:tasks.workunit.client.0.smithi046.stdout:3/128: rmdir da 39 2024-02-19T19:08:22.648 INFO:tasks.workunit.client.0.smithi046.stdout:4/127: getdents d6/d11 0 2024-02-19T19:08:22.649 INFO:tasks.workunit.client.0.smithi046.stdout:9/109: dwrite f0 [4194304,4194304] 0 2024-02-19T19:08:22.651 INFO:tasks.workunit.client.0.smithi046.stdout:6/110: getdents d4/d6 0 2024-02-19T19:08:22.651 INFO:tasks.workunit.client.0.smithi046.stdout:0/170: write d0/f2 [3114459,1286] 0 2024-02-19T19:08:22.653 INFO:tasks.workunit.client.0.smithi046.stdout:5/120: getdents d2/dd 0 2024-02-19T19:08:22.653 INFO:tasks.workunit.client.0.smithi046.stdout:5/121: getdents d2/dd 0 2024-02-19T19:08:22.653 INFO:tasks.workunit.client.0.smithi046.stdout:5/122: creat d2/f22 x:0 0 0 2024-02-19T19:08:22.653 INFO:tasks.workunit.client.0.smithi046.stdout:5/123: chown d2/l1f 7 1 2024-02-19T19:08:22.654 INFO:tasks.workunit.client.0.smithi046.stdout:7/268: symlink d0/d3f/l4d 0 2024-02-19T19:08:22.656 INFO:tasks.workunit.client.0.smithi046.stdout:2/151: truncate f1 820725 0 2024-02-19T19:08:22.656 INFO:tasks.workunit.client.0.smithi046.stdout:2/152: chown d5/df/f24 11 1 2024-02-19T19:08:22.658 INFO:tasks.workunit.client.0.smithi046.stdout:4/128: read d6/f9 [2491962,30047] 0 2024-02-19T19:08:22.659 INFO:tasks.workunit.client.0.smithi046.stdout:0/171: dread d0/d24/f2a [0,4194304] 0 2024-02-19T19:08:22.662 INFO:tasks.workunit.client.0.smithi046.stdout:1/208: sync 2024-02-19T19:08:22.723 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 bash[112339]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T19:08:22.723 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 bash[112339]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-19T19:08:22.723 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 bash[112339]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-19T19:08:22.723 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 bash[112339]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-19T19:08:22.723 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 bash[112339]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-19T19:08:22.723 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 bash[112339]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T19:08:22.723 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 bash[112339]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-19T19:08:22.723 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 podman[112339]: 2024-02-19 19:08:22.373335673 +0000 UTC m=+1.724378554 container attach b0d22d02dde4af485cd8c33c1c532ea32d932240a82ec89a9dba21ecb08874ed (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:08:22.723 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:22 smithi046 podman[112339]: 2024-02-19 19:08:22.373820332 +0000 UTC m=+1.724863216 container died b0d22d02dde4af485cd8c33c1c532ea32d932240a82ec89a9dba21ecb08874ed (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-19T19:08:22.933 INFO:tasks.workunit.client.0.smithi046.stdout:3/129: truncate da/f15 1802905 0 2024-02-19T19:08:22.933 INFO:tasks.workunit.client.0.smithi046.stdout:3/130: fsync da/dd/d10/f1b 0 2024-02-19T19:08:22.933 INFO:tasks.workunit.client.0.smithi046.stdout:3/131: truncate da/dd/d10/f1b 433995 0 2024-02-19T19:08:22.936 INFO:tasks.workunit.client.0.smithi046.stdout:9/110: creat db/d1e/f1f x:0 0 0 2024-02-19T19:08:22.938 INFO:tasks.workunit.client.0.smithi046.stdout:6/111: symlink d4/d6/d1c/l24 0 2024-02-19T19:08:22.940 INFO:tasks.workunit.client.0.smithi046.stdout:2/153: write f1 [707461,8232] 0 2024-02-19T19:08:22.940 INFO:tasks.workunit.client.0.smithi046.stdout:2/154: write d5/d6/fa [4194995,116655] 0 2024-02-19T19:08:22.944 INFO:tasks.workunit.client.0.smithi046.stdout:8/211: rmdir d3/dd/d13/d42 39 2024-02-19T19:08:22.949 INFO:tasks.workunit.client.0.smithi046.stdout:2/155: read d5/df/f24 [169738,31138] 0 2024-02-19T19:08:22.949 INFO:tasks.workunit.client.0.smithi046.stdout:2/156: chown d5/df/c1f 14965074 1 2024-02-19T19:08:22.974 INFO:tasks.workunit.client.0.smithi046.stdout:2/157: dwrite d5/df/f28 [0,4194304] 0 2024-02-19T19:08:22.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/158: dread f3 [0,4194304] 0 2024-02-19T19:08:22.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/159: chown d5/d6/c1e 759 1 2024-02-19T19:08:23.011 INFO:tasks.workunit.client.0.smithi046.stdout:5/124: symlink d2/l23 0 2024-02-19T19:08:23.012 INFO:tasks.workunit.client.0.smithi046.stdout:7/269: creat d0/d45/d4a/f4e x:0 0 0 2024-02-19T19:08:23.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/129: rmdir d6/d11 39 2024-02-19T19:08:23.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/130: write d6/d15/d17/f1b [509217,108161] 0 2024-02-19T19:08:23.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/131: dread - d6/d15/d17/d1e/d25/f2c zero size 2024-02-19T19:08:23.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/132: chown d6/d15/d17/d1e/l12 92542 1 2024-02-19T19:08:23.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/133: stat d6/d15/d17/d1e/f2a 0 2024-02-19T19:08:23.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/134: stat d6/d15/d17/d1e/l12 0 2024-02-19T19:08:23.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/135: dread - d6/d11/d26/f28 zero size 2024-02-19T19:08:23.013 INFO:tasks.workunit.client.0.smithi046.stdout:0/172: rmdir d0/d24 39 2024-02-19T19:08:23.015 INFO:tasks.workunit.client.0.smithi046.stdout:1/209: rename d5/ca to d5/d10/d3b/d3c/c46 0 2024-02-19T19:08:23.015 INFO:tasks.workunit.client.0.smithi046.stdout:1/210: chown d5/d10/d3b/d3c/d3f/f43 3 1 2024-02-19T19:08:23.015 INFO:tasks.workunit.client.0.smithi046.stdout:1/211: write d5/f26 [8582861,6570] 0 2024-02-19T19:08:23.017 INFO:tasks.workunit.client.0.smithi046.stdout:9/111: mkdir db/d20 0 2024-02-19T19:08:23.020 INFO:tasks.workunit.client.0.smithi046.stdout:8/212: mkdir d3/dd/d4b 0 2024-02-19T19:08:23.025 INFO:tasks.workunit.client.0.smithi046.stdout:2/160: symlink d5/d6/d13/l29 0 2024-02-19T19:08:23.027 INFO:tasks.workunit.client.0.smithi046.stdout:7/270: mknod d0/d4/d34/c4f 0 2024-02-19T19:08:23.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/136: getdents d6/d15/d17/d1e/d25 0 2024-02-19T19:08:23.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/137: chown d6/d15/d17/d1e/l23 39992 1 2024-02-19T19:08:23.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/138: write d6/fb [2829314,10189] 0 2024-02-19T19:08:23.029 INFO:tasks.workunit.client.0.smithi046.stdout:0/173: rename d0/d19/db/d27 to d0/d19/db/d27/d38 22 2024-02-19T19:08:23.029 INFO:tasks.workunit.client.0.smithi046.stdout:0/174: chown d0/d19/db/d27/f28 999605447 1 2024-02-19T19:08:23.029 INFO:tasks.workunit.client.0.smithi046.stdout:0/175: chown d0/d19/f6 1299260434 1 2024-02-19T19:08:23.030 INFO:tasks.workunit.client.0.smithi046.stdout:0/176: readlink d0/d19/db/d27/l36 0 2024-02-19T19:08:23.030 INFO:tasks.workunit.client.0.smithi046.stdout:3/132: truncate da/f15 879271 0 2024-02-19T19:08:23.030 INFO:tasks.workunit.client.0.smithi046.stdout:1/212: dread d5/f17 [0,4194304] 0 2024-02-19T19:08:23.032 INFO:tasks.workunit.client.0.smithi046.stdout:8/213: dread d3/d37/f2d [0,4194304] 0 2024-02-19T19:08:23.033 INFO:tasks.workunit.client.0.smithi046.stdout:7/271: mknod d0/d4/d34/c50 0 2024-02-19T19:08:23.034 INFO:tasks.workunit.client.0.smithi046.stdout:5/125: rmdir d2 39 2024-02-19T19:08:23.034 INFO:tasks.workunit.client.0.smithi046.stdout:5/126: write d2/f13 [4260519,23637] 0 2024-02-19T19:08:23.034 INFO:tasks.workunit.client.0.smithi046.stdout:9/112: read f0 [1277525,118013] 0 2024-02-19T19:08:23.036 INFO:tasks.workunit.client.0.smithi046.stdout:4/139: unlink d6/d11/c24 0 2024-02-19T19:08:23.036 INFO:tasks.workunit.client.0.smithi046.stdout:4/140: creat d6/d11/d26/f2e x:0 0 0 2024-02-19T19:08:23.036 INFO:tasks.workunit.client.0.smithi046.stdout:4/141: fdatasync d6/d11/d26/f2e 0 2024-02-19T19:08:23.036 INFO:tasks.workunit.client.0.smithi046.stdout:4/142: chown d6/d15/d17/d1e/f2a 1961062 1 2024-02-19T19:08:23.036 INFO:tasks.workunit.client.0.smithi046.stdout:3/133: mknod da/dd/c1c 0 2024-02-19T19:08:23.039 INFO:tasks.workunit.client.0.smithi046.stdout:1/213: creat d5/d10/d2d/f47 x:0 0 0 2024-02-19T19:08:23.039 INFO:tasks.workunit.client.0.smithi046.stdout:1/214: fdatasync d5/fc 0 2024-02-19T19:08:23.040 INFO:tasks.workunit.client.0.smithi046.stdout:0/177: write d0/d19/f6 [3085721,38430] 0 2024-02-19T19:08:23.047 INFO:tasks.workunit.client.0.smithi046.stdout:8/214: link d3/l2b d3/d37/l4c 0 2024-02-19T19:08:23.047 INFO:tasks.workunit.client.0.smithi046.stdout:7/272: creat d0/d4/d24/f51 x:0 0 0 2024-02-19T19:08:23.047 INFO:tasks.workunit.client.0.smithi046.stdout:7/273: readlink d0/d4/dd/l27 0 2024-02-19T19:08:23.047 INFO:tasks.workunit.client.0.smithi046.stdout:7/274: dread d0/d4/d24/f2e [0,4194304] 0 2024-02-19T19:08:23.048 INFO:tasks.workunit.client.0.smithi046.stdout:7/275: truncate d0/d4/dd/f10 4783531 0 2024-02-19T19:08:23.049 INFO:tasks.workunit.client.0.smithi046.stdout:9/113: symlink db/d20/l21 0 2024-02-19T19:08:23.051 INFO:tasks.workunit.client.0.smithi046.stdout:5/127: dwrite d2/dd/f20 [0,4194304] 0 2024-02-19T19:08:23.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/143: creat d6/d15/d17/d1e/d25/f2f x:0 0 0 2024-02-19T19:08:23.053 INFO:tasks.workunit.client.0.smithi046.stdout:1/215: mknod d5/d10/d3b/c48 0 2024-02-19T19:08:23.055 INFO:tasks.workunit.client.0.smithi046.stdout:0/178: creat d0/d24/f39 x:0 0 0 2024-02-19T19:08:23.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/215: symlink d3/dd/d3f/d49/l4d 0 2024-02-19T19:08:23.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/276: link d0/d4/f29 d0/d3f/f52 0 2024-02-19T19:08:23.060 INFO:tasks.workunit.client.0.smithi046.stdout:9/114: write db/f18 [3568920,94115] 0 2024-02-19T19:08:23.062 INFO:tasks.workunit.client.0.smithi046.stdout:2/161: rmdir d5/d6 39 2024-02-19T19:08:23.063 INFO:tasks.workunit.client.0.smithi046.stdout:5/128: truncate d2/f9 2596436 0 2024-02-19T19:08:23.064 INFO:tasks.workunit.client.0.smithi046.stdout:8/216: write d3/dd/d13/f1f [1004640,90876] 0 2024-02-19T19:08:23.065 INFO:tasks.workunit.client.0.smithi046.stdout:4/144: link d6/l1d d6/d15/l30 0 2024-02-19T19:08:23.066 INFO:tasks.workunit.client.0.smithi046.stdout:1/216: rename d5/l22 to d5/l49 0 2024-02-19T19:08:23.067 INFO:tasks.workunit.client.0.smithi046.stdout:0/179: creat d0/d19/f3a x:0 0 0 2024-02-19T19:08:23.067 INFO:tasks.workunit.client.0.smithi046.stdout:7/277: symlink d0/d4/d34/d41/l53 0 2024-02-19T19:08:23.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/217: symlink d3/d18/l4e 0 2024-02-19T19:08:23.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/218: chown d3/f10 40283 1 2024-02-19T19:08:23.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/219: write d3/dd/fe [1081236,23888] 0 2024-02-19T19:08:23.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/220: chown d3/d37/c38 235676564 1 2024-02-19T19:08:23.071 INFO:tasks.workunit.client.0.smithi046.stdout:3/134: dread da/f15 [0,4194304] 0 2024-02-19T19:08:23.072 INFO:tasks.workunit.client.0.smithi046.stdout:1/217: symlink d5/d10/d45/l4a 0 2024-02-19T19:08:23.072 INFO:tasks.workunit.client.0.smithi046.stdout:4/145: rmdir d6/d15 39 2024-02-19T19:08:23.072 INFO:tasks.workunit.client.0.smithi046.stdout:4/146: creat d6/f31 x:0 0 0 2024-02-19T19:08:23.073 INFO:tasks.workunit.client.0.smithi046.stdout:2/162: dread f4 [12582912,4194304] 0 2024-02-19T19:08:23.075 INFO:tasks.workunit.client.0.smithi046.stdout:5/129: dread d2/dd/f20 [0,4194304] 0 2024-02-19T19:08:23.075 INFO:tasks.workunit.client.0.smithi046.stdout:5/130: fdatasync d2/f5 0 2024-02-19T19:08:23.075 INFO:tasks.workunit.client.0.smithi046.stdout:5/131: readlink d2/l11 0 2024-02-19T19:08:23.077 INFO:tasks.workunit.client.0.smithi046.stdout:0/180: rename d0/d19/d8/f9 to d0/d24/f3b 0 2024-02-19T19:08:23.077 INFO:tasks.workunit.client.0.smithi046.stdout:9/115: getdents db/d1e 0 2024-02-19T19:08:23.077 INFO:tasks.workunit.client.0.smithi046.stdout:0/181: chown d0/d19/db/d27/f28 26167404 1 2024-02-19T19:08:23.077 INFO:tasks.workunit.client.0.smithi046.stdout:9/116: write db/d1e/f1f [890655,63179] 0 2024-02-19T19:08:23.080 INFO:tasks.workunit.client.0.smithi046.stdout:3/135: dread da/f15 [0,4194304] 0 2024-02-19T19:08:23.081 INFO:tasks.workunit.client.0.smithi046.stdout:4/147: stat c2 0 2024-02-19T19:08:23.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:22 smithi046 ceph-mon[88928]: pgmap v116: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 356 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 7.9 MiB/s rd, 17 MiB/s wr, 872 op/s; 7384/47304 objects degraded (15.610%) 2024-02-19T19:08:23.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:22 smithi046 ceph-mon[88928]: fsmap cephfs:2 {0=cephfs.smithi046.bwvkwa=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T19:08:23.082 INFO:tasks.workunit.client.0.smithi046.stdout:5/132: getdents d2 0 2024-02-19T19:08:23.083 INFO:tasks.workunit.client.0.smithi046.stdout:5/133: readlink d2/dd/l1b 0 2024-02-19T19:08:23.084 INFO:tasks.workunit.client.0.smithi046.stdout:0/182: creat d0/f3c x:0 0 0 2024-02-19T19:08:23.084 INFO:tasks.workunit.client.0.smithi046.stdout:0/183: write d0/d19/db/d27/f2b [844406,36134] 0 2024-02-19T19:08:23.086 INFO:tasks.workunit.client.0.smithi046.stdout:2/163: rename f4 to d5/f2a 0 2024-02-19T19:08:23.088 INFO:tasks.workunit.client.0.smithi046.stdout:4/148: mknod d6/d15/d17/c32 0 2024-02-19T19:08:23.089 INFO:tasks.workunit.client.0.smithi046.stdout:5/134: mknod d2/c24 0 2024-02-19T19:08:23.093 INFO:tasks.workunit.client.0.smithi046.stdout:9/117: rename f6 to db/d1e/f22 0 2024-02-19T19:08:23.093 INFO:tasks.workunit.client.0.smithi046.stdout:9/118: write f0 [4048806,54658] 0 2024-02-19T19:08:23.094 INFO:tasks.workunit.client.0.smithi046.stdout:7/278: dwrite d0/d4/dd/f40 [0,4194304] 0 2024-02-19T19:08:23.094 INFO:tasks.workunit.client.0.smithi046.stdout:2/164: symlink d5/df/l2b 0 2024-02-19T19:08:23.094 INFO:tasks.workunit.client.0.smithi046.stdout:2/165: dread - d5/d6/d13/f16 zero size 2024-02-19T19:08:23.094 INFO:tasks.workunit.client.0.smithi046.stdout:2/166: stat d5/d6/fc 0 2024-02-19T19:08:23.095 INFO:tasks.workunit.client.0.smithi046.stdout:4/149: truncate d6/f1a 3702326 0 2024-02-19T19:08:23.097 INFO:tasks.workunit.client.0.smithi046.stdout:5/135: unlink d2/f13 0 2024-02-19T19:08:23.097 INFO:tasks.workunit.client.0.smithi046.stdout:0/184: symlink d0/d19/db/d27/l3d 0 2024-02-19T19:08:23.098 INFO:tasks.workunit.client.0.smithi046.stdout:9/119: getdents db 0 2024-02-19T19:08:23.100 INFO:tasks.workunit.client.0.smithi046.stdout:7/279: symlink d0/d3f/l54 0 2024-02-19T19:08:23.100 INFO:tasks.workunit.client.0.smithi046.stdout:7/280: chown d0/d4/dd/l26 609490 1 2024-02-19T19:08:23.100 INFO:tasks.workunit.client.0.smithi046.stdout:5/136: unlink d2/f9 0 2024-02-19T19:08:23.101 INFO:tasks.workunit.client.0.smithi046.stdout:0/185: creat d0/d19/d8/d37/f3e x:0 0 0 2024-02-19T19:08:23.101 INFO:tasks.workunit.client.0.smithi046.stdout:0/186: dread - d0/d19/f2d zero size 2024-02-19T19:08:23.102 INFO:tasks.workunit.client.0.smithi046.stdout:7/281: link d0/d4/dd/c1e d0/d4/dd/c55 0 2024-02-19T19:08:23.103 INFO:tasks.workunit.client.0.smithi046.stdout:5/137: mkdir d2/dd/d25 0 2024-02-19T19:08:23.103 INFO:tasks.workunit.client.0.smithi046.stdout:5/138: dread - d2/dd/f1a zero size 2024-02-19T19:08:23.103 INFO:tasks.workunit.client.0.smithi046.stdout:5/139: fdatasync d2/f3 0 2024-02-19T19:08:23.103 INFO:tasks.workunit.client.0.smithi046.stdout:0/187: symlink d0/d24/d2f/l3f 0 2024-02-19T19:08:23.104 INFO:tasks.workunit.client.0.smithi046.stdout:0/188: write d0/d19/db/d27/f28 [4565461,66037] 0 2024-02-19T19:08:23.104 INFO:tasks.workunit.client.0.smithi046.stdout:0/189: fsync d0/d24/f39 0 2024-02-19T19:08:23.104 INFO:tasks.workunit.client.0.smithi046.stdout:7/282: mkdir d0/d45/d56 0 2024-02-19T19:08:23.104 INFO:tasks.workunit.client.0.smithi046.stdout:5/140: mkdir d2/dd/d26 0 2024-02-19T19:08:23.106 INFO:tasks.workunit.client.0.smithi046.stdout:0/190: mkdir d0/d19/d8/d37/d40 0 2024-02-19T19:08:23.106 INFO:tasks.workunit.client.0.smithi046.stdout:5/141: rename d2/dd/d25 to d2/d27 0 2024-02-19T19:08:23.107 INFO:tasks.workunit.client.0.smithi046.stdout:5/142: creat d2/f28 x:0 0 0 2024-02-19T19:08:23.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:22 smithi142 ceph-mon[69118]: pgmap v116: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 356 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 7.9 MiB/s rd, 17 MiB/s wr, 872 op/s; 7384/47304 objects degraded (15.610%) 2024-02-19T19:08:23.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:22 smithi142 ceph-mon[69118]: fsmap cephfs:2 {0=cephfs.smithi046.bwvkwa=up:active,1=cephfs.smithi142.maazlq=up:active} 2 up:standby 2024-02-19T19:08:23.223 INFO:tasks.workunit.client.0.smithi046.stdout:7/283: dread d0/f3e [0,4194304] 0 2024-02-19T19:08:23.223 INFO:tasks.workunit.client.0.smithi046.stdout:7/284: write d0/d4/f29 [5208344,13667] 0 2024-02-19T19:08:23.223 INFO:tasks.workunit.client.0.smithi046.stdout:7/285: read - d0/d45/d4a/f4e zero size 2024-02-19T19:08:23.223 INFO:tasks.workunit.client.0.smithi046.stdout:7/286: write d0/f30 [25633,83922] 0 2024-02-19T19:08:23.224 INFO:tasks.workunit.client.0.smithi046.stdout:7/287: write d0/d4/d2a/f39 [580815,41269] 0 2024-02-19T19:08:23.224 INFO:tasks.workunit.client.0.smithi046.stdout:7/288: fsync d0/d4/f8 0 2024-02-19T19:08:23.224 INFO:tasks.workunit.client.0.smithi046.stdout:7/289: chown d0/l20 69061 1 2024-02-19T19:08:23.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/191: dread d0/d24/f32 [0,4194304] 0 2024-02-19T19:08:23.241 INFO:tasks.workunit.client.0.smithi046.stdout:8/221: dwrite d3/dd/ff [0,4194304] 0 2024-02-19T19:08:23.241 INFO:tasks.workunit.client.0.smithi046.stdout:1/218: dwrite d5/d10/f2e [0,4194304] 0 2024-02-19T19:08:23.241 INFO:tasks.workunit.client.0.smithi046.stdout:1/219: creat d5/d10/d2d/f4b x:0 0 0 2024-02-19T19:08:23.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/150: dwrite d6/d11/d26/f28 [0,4194304] 0 2024-02-19T19:08:23.249 INFO:tasks.workunit.client.0.smithi046.stdout:3/136: dwrite da/dd/d10/f1b [0,4194304] 0 2024-02-19T19:08:23.252 INFO:tasks.workunit.client.0.smithi046.stdout:5/143: dwrite d2/f28 [0,4194304] 0 2024-02-19T19:08:23.252 INFO:tasks.workunit.client.0.smithi046.stdout:7/290: dwrite d0/d4/dd/f3a [0,4194304] 0 2024-02-19T19:08:23.253 INFO:tasks.workunit.client.0.smithi046.stdout:7/291: readlink d0/d4/l28 0 2024-02-19T19:08:23.256 INFO:tasks.workunit.client.0.smithi046.stdout:0/192: getdents d0/d19/db/d27 0 2024-02-19T19:08:23.258 INFO:tasks.workunit.client.0.smithi046.stdout:7/292: creat d0/d4/d34/d4b/f57 x:0 0 0 2024-02-19T19:08:23.258 INFO:tasks.workunit.client.0.smithi046.stdout:7/293: stat d0/l47 0 2024-02-19T19:08:23.258 INFO:tasks.workunit.client.0.smithi046.stdout:7/294: stat d0/d3f/l4d 0 2024-02-19T19:08:23.260 INFO:tasks.workunit.client.0.smithi046.stdout:0/193: creat d0/d19/db/d27/f41 x:0 0 0 2024-02-19T19:08:23.261 INFO:tasks.workunit.client.0.smithi046.stdout:3/137: read da/dd/d10/f1b [2713375,92014] 0 2024-02-19T19:08:23.263 INFO:tasks.workunit.client.0.smithi046.stdout:5/144: dread d2/f28 [0,4194304] 0 2024-02-19T19:08:23.263 INFO:tasks.workunit.client.0.smithi046.stdout:5/145: fdatasync d2/dd/f15 0 2024-02-19T19:08:23.263 INFO:tasks.workunit.client.0.smithi046.stdout:5/146: chown d2/dd/f1c 1736 1 2024-02-19T19:08:23.263 INFO:tasks.workunit.client.0.smithi046.stdout:0/194: symlink d0/d19/d8/d37/l42 0 2024-02-19T19:08:23.264 INFO:tasks.workunit.client.0.smithi046.stdout:8/222: dwrite d3/d18/f1e [0,4194304] 0 2024-02-19T19:08:23.266 INFO:tasks.workunit.client.0.smithi046.stdout:1/220: dwrite d5/f27 [0,4194304] 0 2024-02-19T19:08:23.267 INFO:tasks.workunit.client.0.smithi046.stdout:5/147: unlink d2/f10 0 2024-02-19T19:08:23.269 INFO:tasks.workunit.client.0.smithi046.stdout:0/195: mknod d0/c43 0 2024-02-19T19:08:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:8/223: mknod d3/dd/d4b/c4f 0 2024-02-19T19:08:23.274 INFO:tasks.workunit.client.0.smithi046.stdout:1/221: mknod d5/d10/d45/c4c 0 2024-02-19T19:08:23.275 INFO:tasks.workunit.client.0.smithi046.stdout:7/295: rename d0/d4/d2a to d0/d45/d4a/d58 0 2024-02-19T19:08:23.276 INFO:tasks.workunit.client.0.smithi046.stdout:0/196: unlink d0/l33 0 2024-02-19T19:08:23.278 INFO:tasks.workunit.client.0.smithi046.stdout:1/222: link d5/d21/l42 d5/l4d 0 2024-02-19T19:08:23.278 INFO:tasks.workunit.client.0.smithi046.stdout:1/223: stat d5/d10/d45 0 2024-02-19T19:08:23.279 INFO:tasks.workunit.client.0.smithi046.stdout:4/151: dwrite d6/d15/d17/f20 [4194304,4194304] 0 2024-02-19T19:08:23.279 INFO:tasks.workunit.client.0.smithi046.stdout:7/296: getdents d0/d45/d4a/d58 0 2024-02-19T19:08:23.279 INFO:tasks.workunit.client.0.smithi046.stdout:3/138: dwrite da/dd/d10/f1b [0,4194304] 0 2024-02-19T19:08:23.280 INFO:tasks.workunit.client.0.smithi046.stdout:1/224: rmdir d5/d13/d35 39 2024-02-19T19:08:23.282 INFO:tasks.workunit.client.0.smithi046.stdout:4/152: mkdir d6/d15/d17/d1e/d33 0 2024-02-19T19:08:23.285 INFO:tasks.workunit.client.0.smithi046.stdout:3/139: rename da/dd to da/d1d 0 2024-02-19T19:08:23.288 INFO:tasks.workunit.client.0.smithi046.stdout:1/225: rmdir d5/d2f 39 2024-02-19T19:08:23.290 INFO:tasks.workunit.client.0.smithi046.stdout:5/148: dwrite d2/f22 [0,4194304] 0 2024-02-19T19:08:23.292 INFO:tasks.workunit.client.0.smithi046.stdout:7/297: getdents d0/d4/d34/d4b 0 2024-02-19T19:08:23.294 INFO:tasks.workunit.client.0.smithi046.stdout:0/197: dread d0/f2 [0,4194304] 0 2024-02-19T19:08:23.294 INFO:tasks.workunit.client.0.smithi046.stdout:8/224: dwrite d3/d18/f33 [0,4194304] 0 2024-02-19T19:08:23.294 INFO:tasks.workunit.client.0.smithi046.stdout:5/149: mkdir d2/dd/d29 0 2024-02-19T19:08:23.296 INFO:tasks.workunit.client.0.smithi046.stdout:3/140: write da/d1d/d10/f1b [2143340,66083] 0 2024-02-19T19:08:23.300 INFO:tasks.workunit.client.0.smithi046.stdout:4/153: dwrite d6/d11/d26/f28 [0,4194304] 0 2024-02-19T19:08:23.300 INFO:tasks.workunit.client.0.smithi046.stdout:4/154: creat d6/d11/d26/f34 x:0 0 0 2024-02-19T19:08:23.300 INFO:tasks.workunit.client.0.smithi046.stdout:5/150: creat d2/dd/d29/f2a x:0 0 0 2024-02-19T19:08:23.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/155: stat d6/d15/d17/d1e/d33 0 2024-02-19T19:08:23.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/156: fsync d6/d15/d17/f1b 0 2024-02-19T19:08:23.301 INFO:tasks.workunit.client.0.smithi046.stdout:5/151: chown d2/dd/c1e 856 1 2024-02-19T19:08:23.301 INFO:tasks.workunit.client.0.smithi046.stdout:5/152: creat d2/f2b x:0 0 0 2024-02-19T19:08:23.301 INFO:tasks.workunit.client.0.smithi046.stdout:5/153: fdatasync d2/f3 0 2024-02-19T19:08:23.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/157: write d6/f31 [806338,82450] 0 2024-02-19T19:08:23.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/158: stat d6/f1a 0 2024-02-19T19:08:23.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/159: chown d6/f9 48364572 1 2024-02-19T19:08:23.305 INFO:tasks.workunit.client.0.smithi046.stdout:7/298: getdents d0/d45/d4a 0 2024-02-19T19:08:23.305 INFO:tasks.workunit.client.0.smithi046.stdout:7/299: chown d0/d4/dd/l25 1449006 1 2024-02-19T19:08:23.305 INFO:tasks.workunit.client.0.smithi046.stdout:8/225: write d3/dd/f15 [2697616,90020] 0 2024-02-19T19:08:23.305 INFO:tasks.workunit.client.0.smithi046.stdout:8/226: creat d3/d37/d1d/d3c/f50 x:0 0 0 2024-02-19T19:08:23.310 INFO:tasks.workunit.client.0.smithi046.stdout:8/227: rename d3/dd/d1c/f29 to d3/f51 0 2024-02-19T19:08:23.310 INFO:tasks.workunit.client.0.smithi046.stdout:4/160: dread d6/fb [0,4194304] 0 2024-02-19T19:08:23.312 INFO:tasks.workunit.client.0.smithi046.stdout:4/161: link d6/d11/d26/f34 d6/d11/f35 0 2024-02-19T19:08:23.313 INFO:tasks.workunit.client.0.smithi046.stdout:4/162: chown d6/d15/d17/d1e/d25/f2c 1658570 1 2024-02-19T19:08:23.313 INFO:tasks.workunit.client.0.smithi046.stdout:4/163: chown d6/d15/d17/d1e/f2a 30977424 1 2024-02-19T19:08:23.315 INFO:tasks.workunit.client.0.smithi046.stdout:1/226: dwrite d5/d21/f23 [0,4194304] 0 2024-02-19T19:08:23.315 INFO:tasks.workunit.client.0.smithi046.stdout:4/164: dread d6/d15/d17/f1b [0,4194304] 0 2024-02-19T19:08:23.315 INFO:tasks.workunit.client.0.smithi046.stdout:8/228: fdatasync d3/dd/f15 0 2024-02-19T19:08:23.316 INFO:tasks.workunit.client.0.smithi046.stdout:1/227: rename d5/d10/d45 to d5/d10/d3b/d4e 0 2024-02-19T19:08:23.318 INFO:tasks.workunit.client.0.smithi046.stdout:4/165: unlink d6/d15/d17/d1e/d25/c2b 0 2024-02-19T19:08:23.320 INFO:tasks.workunit.client.0.smithi046.stdout:8/229: creat d3/d37/d1d/f52 x:0 0 0 2024-02-19T19:08:23.321 INFO:tasks.workunit.client.0.smithi046.stdout:4/166: mknod d6/d15/d17/d1e/c36 0 2024-02-19T19:08:23.321 INFO:tasks.workunit.client.0.smithi046.stdout:4/167: read d6/fb [2642676,109340] 0 2024-02-19T19:08:23.321 INFO:tasks.workunit.client.0.smithi046.stdout:4/168: dread - d6/d15/d17/d1e/d25/f2c zero size 2024-02-19T19:08:23.325 INFO:tasks.workunit.client.0.smithi046.stdout:3/141: dwrite da/d1d/d10/f1b [0,4194304] 0 2024-02-19T19:08:23.327 INFO:tasks.workunit.client.0.smithi046.stdout:8/230: truncate d3/dd/f15 1498386 0 2024-02-19T19:08:23.328 INFO:tasks.workunit.client.0.smithi046.stdout:8/231: mkdir d3/dd/d3f/d49/d53 0 2024-02-19T19:08:23.330 INFO:tasks.workunit.client.0.smithi046.stdout:1/228: write d5/f12 [956272,107273] 0 2024-02-19T19:08:23.330 INFO:tasks.workunit.client.0.smithi046.stdout:7/300: dread d0/d4/f29 [0,4194304] 0 2024-02-19T19:08:23.330 INFO:tasks.workunit.client.0.smithi046.stdout:7/301: stat d0/d45/d4a/d58/l31 0 2024-02-19T19:08:23.330 INFO:tasks.workunit.client.0.smithi046.stdout:7/302: chown d0/d4/d24 867 1 2024-02-19T19:08:23.331 INFO:tasks.workunit.client.0.smithi046.stdout:0/198: dwrite d0/d19/fd [0,4194304] 0 2024-02-19T19:08:23.331 INFO:tasks.workunit.client.0.smithi046.stdout:7/303: mknod d0/d4/d34/d41/c59 0 2024-02-19T19:08:23.331 INFO:tasks.workunit.client.0.smithi046.stdout:7/304: write d0/d4/f29 [3686949,127122] 0 2024-02-19T19:08:23.332 INFO:tasks.workunit.client.0.smithi046.stdout:7/305: fdatasync d0/d4/f3c 0 2024-02-19T19:08:23.332 INFO:tasks.workunit.client.0.smithi046.stdout:7/306: write d0/d4/f3b [1011228,113398] 0 2024-02-19T19:08:23.333 INFO:tasks.workunit.client.0.smithi046.stdout:0/199: link d0/d19/d8/l31 d0/d19/l44 0 2024-02-19T19:08:23.335 INFO:tasks.workunit.client.0.smithi046.stdout:3/142: dread da/d1d/d10/f1b [0,4194304] 0 2024-02-19T19:08:23.335 INFO:tasks.workunit.client.0.smithi046.stdout:3/143: chown da/lb 98 1 2024-02-19T19:08:23.336 INFO:tasks.workunit.client.0.smithi046.stdout:0/200: rename d0/d19/db/d27/f2b to d0/f45 0 2024-02-19T19:08:23.336 INFO:tasks.workunit.client.0.smithi046.stdout:0/201: write d0/f2 [2725182,84274] 0 2024-02-19T19:08:23.337 INFO:tasks.workunit.client.0.smithi046.stdout:4/169: dwrite d6/d15/d17/d1e/d25/f2c [0,4194304] 0 2024-02-19T19:08:23.339 INFO:tasks.workunit.client.0.smithi046.stdout:3/144: creat da/d1d/d10/f1e x:0 0 0 2024-02-19T19:08:23.339 INFO:tasks.workunit.client.0.smithi046.stdout:3/145: dread - da/d1d/d10/f1e zero size 2024-02-19T19:08:23.339 INFO:tasks.workunit.client.0.smithi046.stdout:3/146: write da/f15 [961426,98374] 0 2024-02-19T19:08:23.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/202: link d0/d19/db/d27/f41 d0/d24/d2f/f46 0 2024-02-19T19:08:23.343 INFO:tasks.workunit.client.0.smithi046.stdout:1/229: read d5/d13/d35/f36 [3735783,89808] 0 2024-02-19T19:08:23.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/230: symlink d5/d10/d3b/d3c/l4f 0 2024-02-19T19:08:23.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/231: chown d5/fc 44885 1 2024-02-19T19:08:23.347 INFO:tasks.workunit.client.0.smithi046.stdout:1/232: getdents d5/d13 0 2024-02-19T19:08:23.347 INFO:tasks.workunit.client.0.smithi046.stdout:1/233: chown d5/f26 128 1 2024-02-19T19:08:23.348 INFO:tasks.workunit.client.0.smithi046.stdout:1/234: getdents d5/d21 0 2024-02-19T19:08:23.349 INFO:tasks.workunit.client.0.smithi046.stdout:1/235: symlink d5/d10/d3b/d3c/d3f/l50 0 2024-02-19T19:08:23.350 INFO:tasks.workunit.client.0.smithi046.stdout:1/236: getdents d5/d13/d35/d37 0 2024-02-19T19:08:23.352 INFO:tasks.workunit.client.0.smithi046.stdout:0/203: dread d0/d19/d8/f22 [0,4194304] 0 2024-02-19T19:08:23.352 INFO:tasks.workunit.client.0.smithi046.stdout:8/232: dwrite d3/dd/d1c/f48 [0,4194304] 0 2024-02-19T19:08:23.353 INFO:tasks.workunit.client.0.smithi046.stdout:7/307: dwrite d0/d4/d24/f51 [0,4194304] 0 2024-02-19T19:08:23.354 INFO:tasks.workunit.client.0.smithi046.stdout:0/204: rename d0/d19/db/l10 to d0/d19/db/l47 0 2024-02-19T19:08:23.354 INFO:tasks.workunit.client.0.smithi046.stdout:0/205: creat d0/f48 x:0 0 0 2024-02-19T19:08:23.355 INFO:tasks.workunit.client.0.smithi046.stdout:8/233: mkdir d3/dd/d1c/d46/d54 0 2024-02-19T19:08:23.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/234: write d3/dd/f24 [37492,126582] 0 2024-02-19T19:08:23.357 INFO:tasks.workunit.client.0.smithi046.stdout:7/308: mkdir d0/d45/d5a 0 2024-02-19T19:08:23.359 INFO:tasks.workunit.client.0.smithi046.stdout:8/235: rename d3/d37/d1d/f52 to d3/dd/d1c/d36/f55 0 2024-02-19T19:08:23.362 INFO:tasks.workunit.client.0.smithi046.stdout:4/170: dwrite d6/d15/d17/d1e/d25/f2c [0,4194304] 0 2024-02-19T19:08:23.362 INFO:tasks.workunit.client.0.smithi046.stdout:3/147: dwrite da/d1d/d10/f1e [0,4194304] 0 2024-02-19T19:08:23.362 INFO:tasks.workunit.client.0.smithi046.stdout:3/148: chown da/l13 12692 1 2024-02-19T19:08:23.363 INFO:tasks.workunit.client.0.smithi046.stdout:0/206: rmdir d0/d24 39 2024-02-19T19:08:23.364 INFO:tasks.workunit.client.0.smithi046.stdout:4/171: dread d6/d15/d17/f1b [0,4194304] 0 2024-02-19T19:08:23.366 INFO:tasks.workunit.client.0.smithi046.stdout:3/149: link da/c18 da/d1d/c1f 0 2024-02-19T19:08:23.368 INFO:tasks.workunit.client.0.smithi046.stdout:7/309: dread d0/d4/f3b [0,4194304] 0 2024-02-19T19:08:23.368 INFO:tasks.workunit.client.0.smithi046.stdout:1/237: dwrite d5/d13/d35/f36 [0,4194304] 0 2024-02-19T19:08:23.368 INFO:tasks.workunit.client.0.smithi046.stdout:1/238: readlink d5/le 0 2024-02-19T19:08:23.368 INFO:tasks.workunit.client.0.smithi046.stdout:1/239: read d5/fc [1203246,88316] 0 2024-02-19T19:08:23.368 INFO:tasks.workunit.client.0.smithi046.stdout:1/240: chown d5/d10/l18 0 1 2024-02-19T19:08:23.369 INFO:tasks.workunit.client.0.smithi046.stdout:0/207: rename d0/f48 to d0/d19/f49 0 2024-02-19T19:08:23.369 INFO:tasks.workunit.client.0.smithi046.stdout:0/208: chown d0/f3c 10721087 1 2024-02-19T19:08:23.370 INFO:tasks.workunit.client.0.smithi046.stdout:0/209: write d0/d24/f32 [9085,118100] 0 2024-02-19T19:08:23.370 INFO:tasks.workunit.client.0.smithi046.stdout:4/172: rename d6/d15/d17/d1e/l21 to d6/d15/d17/d1e/l37 0 2024-02-19T19:08:23.375 INFO:tasks.workunit.client.0.smithi046.stdout:1/241: dread d5/f17 [0,4194304] 0 2024-02-19T19:08:23.375 INFO:tasks.workunit.client.0.smithi046.stdout:0/210: symlink d0/d19/d8/d37/d40/l4a 0 2024-02-19T19:08:23.375 INFO:tasks.workunit.client.0.smithi046.stdout:0/211: readlink d0/d19/db/l47 0 2024-02-19T19:08:23.375 INFO:tasks.workunit.client.0.smithi046.stdout:8/236: dwrite d3/d37/f2e [0,4194304] 0 2024-02-19T19:08:23.376 INFO:tasks.workunit.client.0.smithi046.stdout:4/173: rename d6/d15/d17/f1b to d6/d15/d17/d1e/d33/f38 0 2024-02-19T19:08:23.377 INFO:tasks.workunit.client.0.smithi046.stdout:1/242: symlink d5/d10/l51 0 2024-02-19T19:08:23.380 INFO:tasks.workunit.client.0.smithi046.stdout:4/174: mknod d6/d15/d17/d1e/c39 0 2024-02-19T19:08:23.381 INFO:tasks.workunit.client.0.smithi046.stdout:4/175: rmdir d6/d15 39 2024-02-19T19:08:23.382 INFO:tasks.workunit.client.0.smithi046.stdout:7/310: dwrite d0/d4/d24/f2e [0,4194304] 0 2024-02-19T19:08:23.384 INFO:tasks.workunit.client.0.smithi046.stdout:4/176: mknod d6/c3a 0 2024-02-19T19:08:23.384 INFO:tasks.workunit.client.0.smithi046.stdout:4/177: dread - d6/d11/d26/f2e zero size 2024-02-19T19:08:23.388 INFO:tasks.workunit.client.0.smithi046.stdout:7/311: rename d0/f1b to d0/d4/d34/f5b 0 2024-02-19T19:08:23.389 INFO:tasks.workunit.client.0.smithi046.stdout:1/243: dread d5/f12 [4194304,4194304] 0 2024-02-19T19:08:23.389 INFO:tasks.workunit.client.0.smithi046.stdout:1/244: chown d5/d21/l42 0 1 2024-02-19T19:08:23.392 INFO:tasks.workunit.client.0.smithi046.stdout:0/212: dwrite d0/d24/f3b [0,4194304] 0 2024-02-19T19:08:23.392 INFO:tasks.workunit.client.0.smithi046.stdout:0/213: write d0/d19/f3a [981126,70422] 0 2024-02-19T19:08:23.392 INFO:tasks.workunit.client.0.smithi046.stdout:4/178: symlink d6/d15/d17/d1e/l3b 0 2024-02-19T19:08:23.393 INFO:tasks.workunit.client.0.smithi046.stdout:7/312: rename d0/d3f/f52 to d0/d3f/f5c 0 2024-02-19T19:08:23.395 INFO:tasks.workunit.client.0.smithi046.stdout:1/245: dread d5/f26 [4194304,4194304] 0 2024-02-19T19:08:23.395 INFO:tasks.workunit.client.0.smithi046.stdout:1/246: read - d5/d10/d2d/f4b zero size 2024-02-19T19:08:23.395 INFO:tasks.workunit.client.0.smithi046.stdout:1/247: read - d5/d13/f29 zero size 2024-02-19T19:08:23.398 INFO:tasks.workunit.client.0.smithi046.stdout:0/214: creat d0/d24/f4b x:0 0 0 2024-02-19T19:08:23.399 INFO:tasks.workunit.client.0.smithi046.stdout:3/150: dwrite da/d1d/d10/f1e [4194304,4194304] 0 2024-02-19T19:08:23.400 INFO:tasks.workunit.client.0.smithi046.stdout:4/179: rename d6/d15/d17/c32 to d6/d15/d17/c3c 0 2024-02-19T19:08:23.401 INFO:tasks.workunit.client.0.smithi046.stdout:7/313: rmdir d0/d4/d34/d4b 39 2024-02-19T19:08:23.401 INFO:tasks.workunit.client.0.smithi046.stdout:7/314: dread - d0/f48 zero size 2024-02-19T19:08:23.403 INFO:tasks.workunit.client.0.smithi046.stdout:1/248: creat d5/d10/d3b/f52 x:0 0 0 2024-02-19T19:08:23.403 INFO:tasks.workunit.client.0.smithi046.stdout:0/215: rmdir d0/d19/db 39 2024-02-19T19:08:23.661 INFO:tasks.workunit.client.0.smithi046.stdout:4/180: symlink d6/d15/l3d 0 2024-02-19T19:08:23.662 INFO:tasks.workunit.client.0.smithi046.stdout:4/181: truncate d6/d15/d17/d1e/d25/f2f 779302 0 2024-02-19T19:08:23.662 INFO:tasks.workunit.client.0.smithi046.stdout:7/315: mknod d0/d3f/c5d 0 2024-02-19T19:08:23.664 INFO:tasks.workunit.client.0.smithi046.stdout:1/249: mknod d5/d13/d35/c53 0 2024-02-19T19:08:23.664 INFO:tasks.workunit.client.0.smithi046.stdout:1/250: truncate d5/d10/d2d/f47 6151 0 2024-02-19T19:08:23.664 INFO:tasks.workunit.client.0.smithi046.stdout:1/251: stat d5/fc 0 2024-02-19T19:08:23.664 INFO:tasks.workunit.client.0.smithi046.stdout:1/252: dread - d5/d13/f29 zero size 2024-02-19T19:08:23.665 INFO:tasks.workunit.client.0.smithi046.stdout:0/216: symlink d0/d19/d8/l4c 0 2024-02-19T19:08:23.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/151: truncate da/f15 404341 0 2024-02-19T19:08:23.672 INFO:tasks.workunit.client.0.smithi046.stdout:7/316: mkdir d0/d3f/d5e 0 2024-02-19T19:08:23.672 INFO:tasks.workunit.client.0.smithi046.stdout:7/317: dread - d0/f48 zero size 2024-02-19T19:08:23.673 INFO:tasks.workunit.client.0.smithi046.stdout:0/217: mkdir d0/d19/d4d 0 2024-02-19T19:08:23.674 INFO:tasks.workunit.client.0.smithi046.stdout:7/318: mkdir d0/d4/d34/d41/d5f 0 2024-02-19T19:08:23.674 INFO:tasks.workunit.client.0.smithi046.stdout:3/152: getdents da/d1d/d10 0 2024-02-19T19:08:23.680 INFO:tasks.workunit.client.0.smithi046.stdout:4/182: dwrite d6/fb [0,4194304] 0 2024-02-19T19:08:23.680 INFO:tasks.workunit.client.0.smithi046.stdout:4/183: readlink d6/d15/d17/d1e/l12 0 2024-02-19T19:08:23.681 INFO:tasks.workunit.client.0.smithi046.stdout:1/253: dwrite d5/d13/d35/f36 [0,4194304] 0 2024-02-19T19:08:23.681 INFO:tasks.workunit.client.0.smithi046.stdout:4/184: symlink d6/d15/d17/d1e/l3e 0 2024-02-19T19:08:23.681 INFO:tasks.workunit.client.0.smithi046.stdout:4/185: chown d6/f9 24 1 2024-02-19T19:08:23.681 INFO:tasks.workunit.client.0.smithi046.stdout:4/186: creat d6/d15/d17/f3f x:0 0 0 2024-02-19T19:08:23.681 INFO:tasks.workunit.client.0.smithi046.stdout:4/187: chown d6/d15 106994 1 2024-02-19T19:08:23.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/254: link d5/c16 d5/d13/d35/c54 0 2024-02-19T19:08:23.687 INFO:tasks.workunit.client.0.smithi046.stdout:4/188: mkdir d6/d11/d40 0 2024-02-19T19:08:23.687 INFO:tasks.workunit.client.0.smithi046.stdout:4/189: write d6/d15/d17/d1e/d25/f2f [1808298,120203] 0 2024-02-19T19:08:23.687 INFO:tasks.workunit.client.0.smithi046.stdout:4/190: creat d6/d15/d17/f41 x:0 0 0 2024-02-19T19:08:23.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/255: stat d5/d10/c1c 0 2024-02-19T19:08:23.689 INFO:tasks.workunit.client.0.smithi046.stdout:7/319: dwrite d0/d4/dd/f40 [0,4194304] 0 2024-02-19T19:08:23.689 INFO:tasks.workunit.client.0.smithi046.stdout:7/320: stat d0/d4/dd/l26 0 2024-02-19T19:08:23.689 INFO:tasks.workunit.client.0.smithi046.stdout:7/321: readlink d0/d4/l12 0 2024-02-19T19:08:23.690 INFO:tasks.workunit.client.0.smithi046.stdout:7/322: write d0/d4/f3b [942905,100734] 0 2024-02-19T19:08:23.690 INFO:tasks.workunit.client.0.smithi046.stdout:1/256: mkdir d5/d10/d55 0 2024-02-19T19:08:23.693 INFO:tasks.workunit.client.0.smithi046.stdout:7/323: truncate d0/d4/f7 547214 0 2024-02-19T19:08:23.694 INFO:tasks.workunit.client.0.smithi046.stdout:3/153: dread da/f15 [0,4194304] 0 2024-02-19T19:08:23.694 INFO:tasks.workunit.client.0.smithi046.stdout:1/257: link d5/d10/d3b/c48 d5/d10/d55/c56 0 2024-02-19T19:08:23.694 INFO:tasks.workunit.client.0.smithi046.stdout:1/258: creat d5/d10/d2d/f57 x:0 0 0 2024-02-19T19:08:23.695 INFO:tasks.workunit.client.0.smithi046.stdout:1/259: readlink d5/d13/d35/l3e 0 2024-02-19T19:08:23.697 INFO:tasks.workunit.client.0.smithi046.stdout:7/324: mkdir d0/d45/d4a/d58/d60 0 2024-02-19T19:08:23.699 INFO:tasks.workunit.client.0.smithi046.stdout:3/154: creat da/f20 x:0 0 0 2024-02-19T19:08:23.699 INFO:tasks.workunit.client.0.smithi046.stdout:3/155: chown da/d1d/c1c 94734055 1 2024-02-19T19:08:23.703 INFO:tasks.workunit.client.0.smithi046.stdout:1/260: rename d5/d10/d3b/d3c/l4f to d5/d13/d35/d37/l58 0 2024-02-19T19:08:23.703 INFO:tasks.workunit.client.0.smithi046.stdout:1/261: chown d5/l4d 145394301 1 2024-02-19T19:08:23.703 INFO:tasks.workunit.client.0.smithi046.stdout:1/262: dread - d5/d13/f31 zero size 2024-02-19T19:08:23.703 INFO:tasks.workunit.client.0.smithi046.stdout:1/263: creat d5/d10/d2d/f59 x:0 0 0 2024-02-19T19:08:23.703 INFO:tasks.workunit.client.0.smithi046.stdout:1/264: dread - d5/d10/d2d/f57 zero size 2024-02-19T19:08:23.704 INFO:tasks.workunit.client.0.smithi046.stdout:7/325: rmdir d0/d45/d5a 0 2024-02-19T19:08:23.704 INFO:tasks.workunit.client.0.smithi046.stdout:7/326: readlink d0/l47 0 2024-02-19T19:08:23.705 INFO:tasks.workunit.client.0.smithi046.stdout:3/156: creat da/d1d/d10/f21 x:0 0 0 2024-02-19T19:08:23.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/265: mknod d5/d10/d3b/d3c/c5a 0 2024-02-19T19:08:23.711 INFO:tasks.workunit.client.0.smithi046.stdout:3/157: fsync da/d1d/d10/f21 0 2024-02-19T19:08:23.712 INFO:tasks.workunit.client.0.smithi046.stdout:3/158: symlink da/d1d/l22 0 2024-02-19T19:08:23.712 INFO:tasks.workunit.client.0.smithi046.stdout:7/327: read d0/d4/dd/f40 [3587106,121862] 0 2024-02-19T19:08:23.712 INFO:tasks.workunit.client.0.smithi046.stdout:7/328: read - d0/d4/d34/d4b/f57 zero size 2024-02-19T19:08:23.714 INFO:tasks.workunit.client.0.smithi046.stdout:3/159: rmdir da/d1d/d10 39 2024-02-19T19:08:23.714 INFO:tasks.workunit.client.0.smithi046.stdout:7/329: dread d0/ff [0,4194304] 0 2024-02-19T19:08:23.715 INFO:tasks.workunit.client.0.smithi046.stdout:3/160: mknod da/d1d/c23 0 2024-02-19T19:08:23.716 INFO:tasks.workunit.client.0.smithi046.stdout:7/330: creat d0/d4/d34/d4b/f61 x:0 0 0 2024-02-19T19:08:23.716 INFO:tasks.workunit.client.0.smithi046.stdout:7/331: dread - d0/f48 zero size 2024-02-19T19:08:23.716 INFO:tasks.workunit.client.0.smithi046.stdout:1/266: write d5/d21/f23 [3886779,72592] 0 2024-02-19T19:08:23.716 INFO:tasks.workunit.client.0.smithi046.stdout:1/267: creat d5/f5b x:0 0 0 2024-02-19T19:08:23.717 INFO:tasks.workunit.client.0.smithi046.stdout:7/332: rmdir d0/d3f/d5e 0 2024-02-19T19:08:23.719 INFO:tasks.workunit.client.0.smithi046.stdout:7/333: mkdir d0/d4/dd/d62 0 2024-02-19T19:08:23.720 INFO:tasks.workunit.client.0.smithi046.stdout:7/334: truncate d0/d4/d34/f4c 1288574 0 2024-02-19T19:08:23.720 INFO:tasks.workunit.client.0.smithi046.stdout:7/335: symlink d0/d45/d56/l63 0 2024-02-19T19:08:23.720 INFO:tasks.workunit.client.0.smithi046.stdout:7/336: getdents d0/d45/d4a/d58/d60 0 2024-02-19T19:08:23.721 INFO:tasks.workunit.client.0.smithi046.stdout:7/337: mknod d0/d3f/c64 0 2024-02-19T19:08:23.722 INFO:tasks.workunit.client.0.smithi046.stdout:7/338: unlink d0/f3e 0 2024-02-19T19:08:23.723 INFO:tasks.workunit.client.0.smithi046.stdout:7/339: dread - d0/d4/d34/d4b/f61 zero size 2024-02-19T19:08:23.723 INFO:tasks.workunit.client.0.smithi046.stdout:7/340: dread - d0/d4/d34/d4b/f61 zero size 2024-02-19T19:08:23.723 INFO:tasks.workunit.client.0.smithi046.stdout:3/161: read da/d1d/d10/f1e [2267430,125095] 0 2024-02-19T19:08:23.723 INFO:tasks.workunit.client.0.smithi046.stdout:3/162: write da/d1d/d10/f21 [716191,101807] 0 2024-02-19T19:08:23.725 INFO:tasks.workunit.client.0.smithi046.stdout:1/268: getdents d5 0 2024-02-19T19:08:23.725 INFO:tasks.workunit.client.0.smithi046.stdout:1/269: dread - d5/d10/d2d/f4b zero size 2024-02-19T19:08:23.731 INFO:tasks.workunit.client.0.smithi046.stdout:3/163: write da/d1d/d10/f1b [1241870,101313] 0 2024-02-19T19:08:23.731 INFO:tasks.workunit.client.0.smithi046.stdout:3/164: write da/d1d/d10/f1e [9060206,97707] 0 2024-02-19T19:08:23.733 INFO:tasks.workunit.client.0.smithi046.stdout:1/270: write d5/d13/d35/f36 [1629596,108266] 0 2024-02-19T19:08:23.735 INFO:tasks.workunit.client.0.smithi046.stdout:7/341: dwrite d0/d3f/f5c [0,4194304] 0 2024-02-19T19:08:23.735 INFO:tasks.workunit.client.0.smithi046.stdout:7/342: dread - d0/d4/d34/d4b/f57 zero size 2024-02-19T19:08:23.735 INFO:tasks.workunit.client.0.smithi046.stdout:1/271: getdents d5/d10/d3b/d3c/d3f 0 2024-02-19T19:08:23.735 INFO:tasks.workunit.client.0.smithi046.stdout:1/272: creat d5/d10/d3b/f5c x:0 0 0 2024-02-19T19:08:23.735 INFO:tasks.workunit.client.0.smithi046.stdout:1/273: creat d5/d10/d2d/f5d x:0 0 0 2024-02-19T19:08:23.735 INFO:tasks.workunit.client.0.smithi046.stdout:1/274: truncate d5/f5b 304734 0 2024-02-19T19:08:23.736 INFO:tasks.workunit.client.0.smithi046.stdout:3/165: fsync da/d1d/d10/f1b 0 2024-02-19T19:08:23.736 INFO:tasks.workunit.client.0.smithi046.stdout:3/166: stat da/d1d/l22 0 2024-02-19T19:08:23.736 INFO:tasks.workunit.client.0.smithi046.stdout:7/343: symlink d0/d4/d34/d41/d5f/l65 0 2024-02-19T19:08:23.737 INFO:tasks.workunit.client.0.smithi046.stdout:1/275: mkdir d5/d2f/d5e 0 2024-02-19T19:08:23.738 INFO:tasks.workunit.client.0.smithi046.stdout:3/167: mknod da/d1d/d10/c24 0 2024-02-19T19:08:23.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/168: fsync da/d1d/d10/f1b 0 2024-02-19T19:08:23.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/169: creat da/f25 x:0 0 0 2024-02-19T19:08:23.739 INFO:tasks.workunit.client.0.smithi046.stdout:7/344: getdents d0/d45/d4a/d58 0 2024-02-19T19:08:23.741 INFO:tasks.workunit.client.0.smithi046.stdout:3/170: creat da/d1d/d10/f26 x:0 0 0 2024-02-19T19:08:23.741 INFO:tasks.workunit.client.0.smithi046.stdout:3/171: chown da/f20 23195 1 2024-02-19T19:08:23.741 INFO:tasks.workunit.client.0.smithi046.stdout:3/172: write da/f15 [799621,24766] 0 2024-02-19T19:08:23.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/345: unlink d0/d45/d56/l63 0 2024-02-19T19:08:23.745 INFO:tasks.workunit.client.0.smithi046.stdout:3/173: symlink da/d1d/l27 0 2024-02-19T19:08:23.745 INFO:tasks.workunit.client.0.smithi046.stdout:3/174: readlink da/l14 0 2024-02-19T19:08:23.746 INFO:tasks.workunit.client.0.smithi046.stdout:3/175: write da/f20 [805508,68242] 0 2024-02-19T19:08:23.746 INFO:tasks.workunit.client.0.smithi046.stdout:7/346: symlink d0/d45/d4a/d58/d60/l66 0 2024-02-19T19:08:23.747 INFO:tasks.workunit.client.0.smithi046.stdout:3/176: creat da/d1d/f28 x:0 0 0 2024-02-19T19:08:23.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/347: creat d0/d45/d4a/d58/d60/f67 x:0 0 0 2024-02-19T19:08:23.749 INFO:tasks.workunit.client.0.smithi046.stdout:3/177: mknod da/c29 0 2024-02-19T19:08:23.749 INFO:tasks.workunit.client.0.smithi046.stdout:3/178: chown da/l13 980229566 1 2024-02-19T19:08:23.750 INFO:tasks.workunit.client.0.smithi046.stdout:3/179: mknod da/c2a 0 2024-02-19T19:08:23.750 INFO:tasks.workunit.client.0.smithi046.stdout:3/180: creat da/d1d/d10/f2b x:0 0 0 2024-02-19T19:08:23.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/181: write da/f20 [172281,116839] 0 2024-02-19T19:08:23.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/182: dread - da/d1d/d10/f26 zero size 2024-02-19T19:08:23.755 INFO:tasks.workunit.client.0.smithi046.stdout:3/183: dread da/d1d/d10/f21 [0,4194304] 0 2024-02-19T19:08:23.760 INFO:tasks.workunit.client.0.smithi046.stdout:7/348: dwrite d0/f18 [0,4194304] 0 2024-02-19T19:08:23.760 INFO:tasks.workunit.client.0.smithi046.stdout:7/349: write d0/f48 [250701,66126] 0 2024-02-19T19:08:23.776 INFO:tasks.workunit.client.0.smithi046.stdout:7/350: dwrite d0/d45/d4a/f4e [0,4194304] 0 2024-02-19T19:08:23.777 INFO:tasks.workunit.client.0.smithi046.stdout:7/351: stat d0/f30 0 2024-02-19T19:08:23.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/352: dread d0/d4/dd/f3a [0,4194304] 0 2024-02-19T19:08:23.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/353: stat d0/d3f/l54 0 2024-02-19T19:08:23.785 INFO:tasks.workunit.client.0.smithi046.stdout:7/354: mkdir d0/d4/d68 0 2024-02-19T19:08:23.785 INFO:tasks.workunit.client.0.smithi046.stdout:7/355: symlink d0/d4/d68/l69 0 2024-02-19T19:08:23.787 INFO:tasks.workunit.client.0.smithi046.stdout:7/356: rename d0/d4/f8 to d0/d45/d56/f6a 0 2024-02-19T19:08:23.787 INFO:tasks.workunit.client.0.smithi046.stdout:7/357: creat d0/d3f/f6b x:0 0 0 2024-02-19T19:08:23.800 INFO:tasks.workunit.client.0.smithi046.stdout:7/358: dwrite d0/d3f/f5c [0,4194304] 0 2024-02-19T19:08:23.806 INFO:tasks.workunit.client.0.smithi046.stdout:7/359: read d0/d4/dd/f3a [4047667,7894] 0 2024-02-19T19:08:23.812 INFO:tasks.workunit.client.0.smithi046.stdout:7/360: dread d0/d4/d24/f2e [0,4194304] 0 2024-02-19T19:08:23.813 INFO:tasks.workunit.client.0.smithi046.stdout:7/361: symlink d0/d45/l6c 0 2024-02-19T19:08:23.814 INFO:tasks.workunit.client.0.smithi046.stdout:7/362: fsync d0/d4/d24/f2e 0 2024-02-19T19:08:23.814 INFO:tasks.workunit.client.0.smithi046.stdout:7/363: chown d0/d45/d4a/d58/d60 1 1 2024-02-19T19:08:23.847 INFO:tasks.workunit.client.0.smithi046.stdout:6/112: sync 2024-02-19T19:08:23.847 INFO:tasks.workunit.client.0.smithi046.stdout:2/167: sync 2024-02-19T19:08:23.848 INFO:tasks.workunit.client.0.smithi046.stdout:2/168: mkdir d5/d2c 0 2024-02-19T19:08:23.853 INFO:tasks.workunit.client.0.smithi046.stdout:6/113: read d4/f8 [4170871,53348] 0 2024-02-19T19:08:23.855 INFO:tasks.workunit.client.0.smithi046.stdout:6/114: symlink d4/d6/dd/l25 0 2024-02-19T19:08:23.860 INFO:tasks.workunit.client.0.smithi046.stdout:6/115: dread d4/f5 [0,4194304] 0 2024-02-19T19:08:23.860 INFO:tasks.workunit.client.0.smithi046.stdout:6/116: chown d4/f19 11899 1 2024-02-19T19:08:23.861 INFO:tasks.workunit.client.0.smithi046.stdout:6/117: rmdir d4/d6 39 2024-02-19T19:08:23.861 INFO:tasks.workunit.client.0.smithi046.stdout:6/118: write d4/f8 [4774513,84303] 0 2024-02-19T19:08:23.862 INFO:tasks.workunit.client.0.smithi046.stdout:6/119: rename d4/f8 to d4/f26 0 2024-02-19T19:08:23.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/120: rename l0 to d4/d6/d22/l27 0 2024-02-19T19:08:23.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/121: write d4/d6/dd/f17 [937438,74578] 0 2024-02-19T19:08:23.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/122: read - d4/d6/dd/d10/f15 zero size 2024-02-19T19:08:23.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/123: chown d4/d6/l1b 2686236 1 2024-02-19T19:08:23.881 INFO:tasks.workunit.client.0.smithi046.stdout:6/124: dwrite d4/d6/dd/f17 [0,4194304] 0 2024-02-19T19:08:23.881 INFO:tasks.workunit.client.0.smithi046.stdout:6/125: write d4/d6/fe [3929453,110703] 0 2024-02-19T19:08:23.883 INFO:tasks.workunit.client.0.smithi046.stdout:6/126: fdatasync d4/f26 0 2024-02-19T19:08:23.884 INFO:tasks.workunit.client.0.smithi046.stdout:6/127: chown d4/d6/d22/l27 2781016 1 2024-02-19T19:08:23.884 INFO:tasks.workunit.client.0.smithi046.stdout:6/128: dread - d4/d6/dd/f11 zero size 2024-02-19T19:08:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:6/129: dread d4/d6/dd/d10/f13 [0,4194304] 0 2024-02-19T19:08:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:6/130: chown d4/d6 497621992 1 2024-02-19T19:08:23.894 INFO:tasks.workunit.client.0.smithi046.stdout:6/131: chown d4/d6/dd 1003498746 1 2024-02-19T19:08:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/132: link d4/d6/dd/f11 d4/f28 0 2024-02-19T19:08:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:6/133: mkdir d4/d6/dd/d10/d29 0 2024-02-19T19:08:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:6/134: rename d4/d6/dd to d4/d6/dd/d2a 22 2024-02-19T19:08:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:6/135: write d4/f28 [999754,70495] 0 2024-02-19T19:08:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:6/136: stat d4/d6/dd/d10 0 2024-02-19T19:08:23.897 INFO:tasks.workunit.client.0.smithi046.stdout:6/137: truncate d4/f5 4412212 0 2024-02-19T19:08:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:6/138: link d4/d6/d22/l27 d4/d6/d1c/d20/l2b 0 2024-02-19T19:08:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:6/139: symlink d4/d6/d22/l2c 0 2024-02-19T19:08:23.898 INFO:tasks.workunit.client.0.smithi046.stdout:6/140: fdatasync d4/d6/dd/d10/f13 0 2024-02-19T19:08:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:6/141: mkdir d4/d6/dd/d10/d29/d2d 0 2024-02-19T19:08:23.916 INFO:tasks.workunit.client.0.smithi046.stdout:6/142: dwrite d4/d6/dd/d10/f15 [0,4194304] 0 2024-02-19T19:08:23.918 INFO:tasks.workunit.client.0.smithi046.stdout:6/143: mknod d4/d6/d22/c2e 0 2024-02-19T19:08:23.923 INFO:tasks.workunit.client.0.smithi046.stdout:6/144: write d4/f19 [1277526,8439] 0 2024-02-19T19:08:23.939 INFO:tasks.workunit.client.0.smithi046.stdout:6/145: dwrite d4/d6/dd/d10/f15 [0,4194304] 0 2024-02-19T19:08:23.946 INFO:tasks.workunit.client.0.smithi046.stdout:6/146: truncate d4/d6/dd/f11 963319 0 2024-02-19T19:08:23.947 INFO:tasks.workunit.client.0.smithi046.stdout:6/147: unlink d4/d6/d22/l27 0 2024-02-19T19:08:23.948 INFO:tasks.workunit.client.0.smithi046.stdout:6/148: chown d4/d6 2 1 2024-02-19T19:08:23.949 INFO:tasks.workunit.client.0.smithi046.stdout:6/149: symlink d4/d6/d22/l2f 0 2024-02-19T19:08:23.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/150: read d4/d6/dd/f11 [227664,104178] 0 2024-02-19T19:08:23.951 INFO:tasks.workunit.client.0.smithi046.stdout:6/151: creat d4/d6/f30 x:0 0 0 2024-02-19T19:08:23.954 INFO:tasks.workunit.client.0.smithi046.stdout:6/152: mknod d4/d6/dd/d10/c31 0 2024-02-19T19:08:23.963 INFO:tasks.workunit.client.0.smithi046.stdout:6/153: dread d4/d6/fe [0,4194304] 0 2024-02-19T19:08:23.964 INFO:tasks.workunit.client.0.smithi046.stdout:6/154: truncate d4/d6/dd/d10/f13 4111045 0 2024-02-19T19:08:23.979 INFO:tasks.workunit.client.0.smithi046.stdout:6/155: dwrite d4/d6/dd/f17 [0,4194304] 0 2024-02-19T19:08:23.979 INFO:tasks.workunit.client.0.smithi046.stdout:6/156: fsync d4/d6/dd/d10/f13 0 2024-02-19T19:08:23.985 INFO:tasks.workunit.client.0.smithi046.stdout:6/157: dread d4/f7 [0,4194304] 0 2024-02-19T19:08:23.986 INFO:tasks.workunit.client.0.smithi046.stdout:6/158: symlink d4/d6/d1c/d20/l32 0 2024-02-19T19:08:23.987 INFO:tasks.workunit.client.0.smithi046.stdout:6/159: rename d4/d6/d1c/l1e to d4/d6/l33 0 2024-02-19T19:08:23.988 INFO:tasks.workunit.client.0.smithi046.stdout:6/160: symlink d4/d6/dd/d10/d29/d2d/l34 0 2024-02-19T19:08:23.989 INFO:tasks.workunit.client.0.smithi046.stdout:6/161: mkdir d4/d6/dd/d10/d29/d2d/d35 0 2024-02-19T19:08:23.990 INFO:tasks.workunit.client.0.smithi046.stdout:6/162: creat d4/d6/dd/d10/d29/f36 x:0 0 0 2024-02-19T19:08:23.991 INFO:tasks.workunit.client.0.smithi046.stdout:6/163: rmdir d4 39 2024-02-19T19:08:24.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/164: dwrite d4/f7 [0,4194304] 0 2024-02-19T19:08:24.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/165: write d4/f19 [773449,82822] 0 2024-02-19T19:08:24.018 INFO:tasks.workunit.client.0.smithi046.stdout:6/166: mkdir d4/d6/dd/d10/d29/d37 0 2024-02-19T19:08:24.020 INFO:tasks.workunit.client.0.smithi046.stdout:6/167: unlink d4/d6/dd/l25 0 2024-02-19T19:08:24.021 INFO:tasks.workunit.client.0.smithi046.stdout:6/168: rmdir d4/d6/dd/d10/d29/d37 0 2024-02-19T19:08:24.109 INFO:tasks.workunit.client.0.smithi046.stdout:5/154: sync 2024-02-19T19:08:24.110 INFO:tasks.workunit.client.0.smithi046.stdout:8/237: sync 2024-02-19T19:08:24.110 INFO:tasks.workunit.client.0.smithi046.stdout:9/120: sync 2024-02-19T19:08:24.110 INFO:tasks.workunit.client.0.smithi046.stdout:8/238: fdatasync d3/dd/d1c/f48 0 2024-02-19T19:08:24.111 INFO:tasks.workunit.client.0.smithi046.stdout:5/155: mkdir d2/dd/d29/d2c 0 2024-02-19T19:08:24.111 INFO:tasks.workunit.client.0.smithi046.stdout:5/156: dread - d2/f2b zero size 2024-02-19T19:08:24.112 INFO:tasks.workunit.client.0.smithi046.stdout:8/239: creat d3/dd/d1c/d46/d54/f56 x:0 0 0 2024-02-19T19:08:24.112 INFO:tasks.workunit.client.0.smithi046.stdout:8/240: fdatasync d3/dd/ff 0 2024-02-19T19:08:24.112 INFO:tasks.workunit.client.0.smithi046.stdout:8/241: chown d3/dd/d3f/d49 4090064 1 2024-02-19T19:08:24.120 INFO:tasks.workunit.client.0.smithi046.stdout:9/121: dread db/f18 [0,4194304] 0 2024-02-19T19:08:24.122 INFO:tasks.workunit.client.0.smithi046.stdout:9/122: read db/d1e/f1f [592395,130100] 0 2024-02-19T19:08:24.122 INFO:tasks.workunit.client.0.smithi046.stdout:5/157: write d2/f5 [1349060,113661] 0 2024-02-19T19:08:24.123 INFO:tasks.workunit.client.0.smithi046.stdout:9/123: symlink db/d1e/l23 0 2024-02-19T19:08:24.124 INFO:tasks.workunit.client.0.smithi046.stdout:9/124: creat db/f24 x:0 0 0 2024-02-19T19:08:24.125 INFO:tasks.workunit.client.0.smithi046.stdout:8/242: dwrite d3/dd/f24 [0,4194304] 0 2024-02-19T19:08:24.126 INFO:tasks.workunit.client.0.smithi046.stdout:9/125: rename db/l11 to db/l25 0 2024-02-19T19:08:24.129 INFO:tasks.workunit.client.0.smithi046.stdout:9/126: creat db/d1e/f26 x:0 0 0 2024-02-19T19:08:24.137 INFO:tasks.workunit.client.0.smithi046.stdout:5/158: dread d2/fb [0,4194304] 0 2024-02-19T19:08:24.139 INFO:tasks.workunit.client.0.smithi046.stdout:5/159: rmdir d2/dd/d29/d2c 0 2024-02-19T19:08:24.139 INFO:tasks.workunit.client.0.smithi046.stdout:5/160: write d2/dd/f1c [38143,75308] 0 2024-02-19T19:08:24.139 INFO:tasks.workunit.client.0.smithi046.stdout:5/161: read - d2/dd/f1a zero size 2024-02-19T19:08:24.139 INFO:tasks.workunit.client.0.smithi046.stdout:5/162: write d2/dd/f1a [658615,62518] 0 2024-02-19T19:08:24.139 INFO:tasks.workunit.client.0.smithi046.stdout:5/163: creat d2/f2d x:0 0 0 2024-02-19T19:08:24.139 INFO:tasks.workunit.client.0.smithi046.stdout:5/164: read d2/fb [1493802,66989] 0 2024-02-19T19:08:24.139 INFO:tasks.workunit.client.0.smithi046.stdout:5/165: truncate d2/dd/d29/f2a 2222 0 2024-02-19T19:08:24.140 INFO:tasks.workunit.client.0.smithi046.stdout:5/166: chown d2/c19 15652172 1 2024-02-19T19:08:24.140 INFO:tasks.workunit.client.0.smithi046.stdout:8/243: write d3/dd/d1c/f48 [1584013,9941] 0 2024-02-19T19:08:24.142 INFO:tasks.workunit.client.0.smithi046.stdout:5/167: creat d2/dd/d26/f2e x:0 0 0 2024-02-19T19:08:24.142 INFO:tasks.workunit.client.0.smithi046.stdout:5/168: getdents d2/d27 0 2024-02-19T19:08:24.142 INFO:tasks.workunit.client.0.smithi046.stdout:5/169: write d2/dd/d29/f2a [192955,55497] 0 2024-02-19T19:08:24.144 INFO:tasks.workunit.client.0.smithi046.stdout:8/244: creat d3/dd/d13/d42/f57 x:0 0 0 2024-02-19T19:08:24.144 INFO:tasks.workunit.client.0.smithi046.stdout:5/170: mkdir d2/dd/d2f 0 2024-02-19T19:08:24.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/245: rmdir d3/dd/d3f/d49 39 2024-02-19T19:08:24.146 INFO:tasks.workunit.client.0.smithi046.stdout:5/171: mknod d2/dd/d29/c30 0 2024-02-19T19:08:24.147 INFO:tasks.workunit.client.0.smithi046.stdout:8/246: link d3/dd/f14 d3/dd/f58 0 2024-02-19T19:08:24.148 INFO:tasks.workunit.client.0.smithi046.stdout:5/172: link d2/c14 d2/d27/c31 0 2024-02-19T19:08:24.149 INFO:tasks.workunit.client.0.smithi046.stdout:5/173: mknod d2/dd/c32 0 2024-02-19T19:08:24.149 INFO:tasks.workunit.client.0.smithi046.stdout:5/174: write d2/dd/d26/f2e [714939,53695] 0 2024-02-19T19:08:24.150 INFO:tasks.workunit.client.0.smithi046.stdout:5/175: symlink d2/dd/d29/l33 0 2024-02-19T19:08:24.151 INFO:tasks.workunit.client.0.smithi046.stdout:5/176: mkdir d2/dd/d2f/d34 0 2024-02-19T19:08:24.151 INFO:tasks.workunit.client.0.smithi046.stdout:9/127: dwrite fa [4194304,4194304] 0 2024-02-19T19:08:24.153 INFO:tasks.workunit.client.0.smithi046.stdout:9/128: dread db/f1c [0,4194304] 0 2024-02-19T19:08:24.159 INFO:tasks.workunit.client.0.smithi046.stdout:8/247: dread d3/f7 [0,4194304] 0 2024-02-19T19:08:24.160 INFO:tasks.workunit.client.0.smithi046.stdout:8/248: mkdir d3/d37/d1d/d59 0 2024-02-19T19:08:24.162 INFO:tasks.workunit.client.0.smithi046.stdout:8/249: symlink d3/dd/d1c/d36/l5a 0 2024-02-19T19:08:24.164 INFO:tasks.workunit.client.0.smithi046.stdout:9/129: write f7 [7818313,77201] 0 2024-02-19T19:08:24.164 INFO:tasks.workunit.client.0.smithi046.stdout:9/130: chown db/d1e/f1f 6254 1 2024-02-19T19:08:24.164 INFO:tasks.workunit.client.0.smithi046.stdout:9/131: readlink db/l10 0 2024-02-19T19:08:24.164 INFO:tasks.workunit.client.0.smithi046.stdout:5/177: dwrite d2/dd/f15 [0,4194304] 0 2024-02-19T19:08:24.164 INFO:tasks.workunit.client.0.smithi046.stdout:8/250: mkdir d3/dd/d3f/d49/d5b 0 2024-02-19T19:08:24.165 INFO:tasks.workunit.client.0.smithi046.stdout:9/132: unlink c4 0 2024-02-19T19:08:24.165 INFO:tasks.workunit.client.0.smithi046.stdout:9/133: creat db/d1e/f27 x:0 0 0 2024-02-19T19:08:24.170 INFO:tasks.workunit.client.0.smithi046.stdout:8/251: unlink d3/dd/f12 0 2024-02-19T19:08:24.171 INFO:tasks.workunit.client.0.smithi046.stdout:5/178: read d2/dd/f20 [294930,22677] 0 2024-02-19T19:08:24.171 INFO:tasks.workunit.client.0.smithi046.stdout:5/179: stat d2/l1d 0 2024-02-19T19:08:24.175 INFO:tasks.workunit.client.0.smithi046.stdout:8/252: mknod d3/dd/d1c/d46/c5c 0 2024-02-19T19:08:24.177 INFO:tasks.workunit.client.0.smithi046.stdout:5/180: unlink d2/f3 0 2024-02-19T19:08:24.177 INFO:tasks.workunit.client.0.smithi046.stdout:5/181: truncate d2/dd/d29/f2a 635054 0 2024-02-19T19:08:24.177 INFO:tasks.workunit.client.0.smithi046.stdout:5/182: creat d2/dd/d29/f35 x:0 0 0 2024-02-19T19:08:24.177 INFO:tasks.workunit.client.0.smithi046.stdout:5/183: write d2/f2d [170971,92209] 0 2024-02-19T19:08:24.179 INFO:tasks.workunit.client.0.smithi046.stdout:8/253: rename d3/l6 to d3/l5d 0 2024-02-19T19:08:24.179 INFO:tasks.workunit.client.0.smithi046.stdout:8/254: read d3/d18/f20 [135148,18822] 0 2024-02-19T19:08:24.179 INFO:tasks.workunit.client.0.smithi046.stdout:8/255: fdatasync d3/dd/d13/f32 0 2024-02-19T19:08:24.179 INFO:tasks.workunit.client.0.smithi046.stdout:8/256: chown d3/dd/f24 95 1 2024-02-19T19:08:24.180 INFO:tasks.workunit.client.0.smithi046.stdout:5/184: creat d2/dd/f36 x:0 0 0 2024-02-19T19:08:24.182 INFO:tasks.workunit.client.0.smithi046.stdout:8/257: rename d3/d37/d1d/d3c/f50 to d3/dd/d3f/d49/d53/f5e 0 2024-02-19T19:08:24.183 INFO:tasks.workunit.client.0.smithi046.stdout:8/258: mkdir d3/dd/d3f/d49/d5b/d5f 0 2024-02-19T19:08:24.185 INFO:tasks.workunit.client.0.smithi046.stdout:8/259: unlink d3/dd/d1c/l25 0 2024-02-19T19:08:24.185 INFO:tasks.workunit.client.0.smithi046.stdout:8/260: creat d3/dd/d3f/f60 x:0 0 0 2024-02-19T19:08:24.185 INFO:tasks.workunit.client.0.smithi046.stdout:8/261: readlink d3/dd/d13/l27 0 2024-02-19T19:08:24.186 INFO:tasks.workunit.client.0.smithi046.stdout:8/262: truncate d3/d18/f33 3303975 0 2024-02-19T19:08:24.187 INFO:tasks.workunit.client.0.smithi046.stdout:8/263: fdatasync d3/dd/d3f/f60 0 2024-02-19T19:08:24.187 INFO:tasks.workunit.client.0.smithi046.stdout:8/264: creat d3/dd/d1c/d46/d54/f61 x:0 0 0 2024-02-19T19:08:24.187 INFO:tasks.workunit.client.0.smithi046.stdout:8/265: creat d3/dd/d1c/f62 x:0 0 0 2024-02-19T19:08:24.187 INFO:tasks.workunit.client.0.smithi046.stdout:8/266: write d3/f10 [1947838,21836] 0 2024-02-19T19:08:24.187 INFO:tasks.workunit.client.0.smithi046.stdout:8/267: write d3/dd/d1c/d36/f55 [687323,8571] 0 2024-02-19T19:08:24.191 INFO:tasks.workunit.client.0.smithi046.stdout:5/185: fsync d2/dd/d29/f35 0 2024-02-19T19:08:24.192 INFO:tasks.workunit.client.0.smithi046.stdout:5/186: dread d2/dd/d26/f2e [0,4194304] 0 2024-02-19T19:08:24.192 INFO:tasks.workunit.client.0.smithi046.stdout:5/187: creat d2/dd/f37 x:0 0 0 2024-02-19T19:08:24.194 INFO:tasks.workunit.client.0.smithi046.stdout:5/188: symlink d2/dd/d2f/d34/l38 0 2024-02-19T19:08:24.194 INFO:tasks.workunit.client.0.smithi046.stdout:5/189: fsync d2/f21 0 2024-02-19T19:08:24.194 INFO:tasks.workunit.client.0.smithi046.stdout:5/190: fdatasync d2/dd/f36 0 2024-02-19T19:08:24.194 INFO:tasks.workunit.client.0.smithi046.stdout:5/191: write d2/dd/d29/f35 [271550,86885] 0 2024-02-19T19:08:24.195 INFO:tasks.workunit.client.0.smithi046.stdout:5/192: dread - d2/dd/f37 zero size 2024-02-19T19:08:24.195 INFO:tasks.workunit.client.0.smithi046.stdout:5/193: symlink d2/dd/d2f/l39 0 2024-02-19T19:08:24.195 INFO:tasks.workunit.client.0.smithi046.stdout:5/194: read - d2/dd/f37 zero size 2024-02-19T19:08:24.196 INFO:tasks.workunit.client.0.smithi046.stdout:5/195: dread d2/dd/f1a [0,4194304] 0 2024-02-19T19:08:24.197 INFO:tasks.workunit.client.0.smithi046.stdout:5/196: write d2/dd/f36 [269125,79268] 0 2024-02-19T19:08:24.214 INFO:tasks.workunit.client.0.smithi046.stdout:5/197: dwrite d2/fb [0,4194304] 0 2024-02-19T19:08:24.226 INFO:tasks.workunit.client.0.smithi046.stdout:5/198: write d2/fb [3159281,52647] 0 2024-02-19T19:08:24.231 INFO:tasks.workunit.client.0.smithi046.stdout:5/199: dread d2/dd/d29/f35 [0,4194304] 0 2024-02-19T19:08:24.235 INFO:tasks.workunit.client.0.smithi046.stdout:5/200: dread d2/dd/f36 [0,4194304] 0 2024-02-19T19:08:24.236 INFO:tasks.workunit.client.0.smithi046.stdout:5/201: mkdir d2/d3a 0 2024-02-19T19:08:24.236 INFO:tasks.workunit.client.0.smithi046.stdout:5/202: write d2/f2b [96100,47035] 0 2024-02-19T19:08:24.237 INFO:tasks.workunit.client.0.smithi046.stdout:5/203: mkdir d2/dd/d29/d3b 0 2024-02-19T19:08:24.237 INFO:tasks.workunit.client.0.smithi046.stdout:5/204: creat d2/f3c x:0 0 0 2024-02-19T19:08:24.238 INFO:tasks.workunit.client.0.smithi046.stdout:5/205: unlink d2/c8 0 2024-02-19T19:08:24.245 INFO:tasks.workunit.client.0.smithi046.stdout:5/206: dread d2/dd/f15 [0,4194304] 0 2024-02-19T19:08:24.245 INFO:tasks.workunit.client.0.smithi046.stdout:5/207: write d2/f21 [2412214,79194] 0 2024-02-19T19:08:24.250 INFO:tasks.workunit.client.0.smithi046.stdout:5/208: dread d2/dd/f20 [0,4194304] 0 2024-02-19T19:08:24.251 INFO:tasks.workunit.client.0.smithi046.stdout:5/209: creat d2/dd/d26/f3d x:0 0 0 2024-02-19T19:08:24.251 INFO:tasks.workunit.client.0.smithi046.stdout:5/210: write d2/dd/f36 [2714,110569] 0 2024-02-19T19:08:24.272 INFO:tasks.workunit.client.0.smithi046.stdout:5/211: dwrite d2/f5 [0,4194304] 0 2024-02-19T19:08:24.284 INFO:tasks.workunit.client.0.smithi046.stdout:5/212: dwrite d2/f21 [4194304,4194304] 0 2024-02-19T19:08:24.300 INFO:tasks.workunit.client.0.smithi046.stdout:5/213: dwrite d2/dd/d26/f3d [0,4194304] 0 2024-02-19T19:08:24.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/214: truncate d2/f5 3659397 0 2024-02-19T19:08:24.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/215: chown d2/dd/f20 51113130 1 2024-02-19T19:08:24.306 INFO:tasks.workunit.client.0.smithi046.stdout:5/216: creat d2/dd/d2f/d34/f3e x:0 0 0 2024-02-19T19:08:24.307 INFO:tasks.workunit.client.0.smithi046.stdout:5/217: mkdir d2/dd/d3f 0 2024-02-19T19:08:24.308 INFO:tasks.workunit.client.0.smithi046.stdout:0/218: sync 2024-02-19T19:08:24.308 INFO:tasks.workunit.client.0.smithi046.stdout:4/191: sync 2024-02-19T19:08:24.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/276: sync 2024-02-19T19:08:24.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/277: getdents d5/d21 0 2024-02-19T19:08:24.308 INFO:tasks.workunit.client.0.smithi046.stdout:4/192: creat d6/f42 x:0 0 0 2024-02-19T19:08:24.308 INFO:tasks.workunit.client.0.smithi046.stdout:4/193: chown d6/d15/d17/d1e/l23 0 1 2024-02-19T19:08:24.308 INFO:tasks.workunit.client.0.smithi046.stdout:4/194: fdatasync d6/f1a 0 2024-02-19T19:08:24.316 INFO:tasks.workunit.client.0.smithi046.stdout:5/218: read d2/f22 [460198,119515] 0 2024-02-19T19:08:24.316 INFO:tasks.workunit.client.0.smithi046.stdout:5/219: write d2/f2d [733993,42989] 0 2024-02-19T19:08:24.316 INFO:tasks.workunit.client.0.smithi046.stdout:5/220: chown d2/c24 16 1 2024-02-19T19:08:24.316 INFO:tasks.workunit.client.0.smithi046.stdout:5/221: chown d2/l1f 10692 1 2024-02-19T19:08:24.321 INFO:tasks.workunit.client.0.smithi046.stdout:1/278: dread d5/f1f [0,4194304] 0 2024-02-19T19:08:24.321 INFO:tasks.workunit.client.0.smithi046.stdout:1/279: chown d5/d10/d3b/d3c/c46 96 1 2024-02-19T19:08:24.322 INFO:tasks.workunit.client.0.smithi046.stdout:1/280: mknod d5/d10/d2d/c5f 0 2024-02-19T19:08:24.326 INFO:tasks.workunit.client.0.smithi046.stdout:4/195: dwrite d6/d11/f35 [0,4194304] 0 2024-02-19T19:08:24.326 INFO:tasks.workunit.client.0.smithi046.stdout:4/196: write d6/f31 [1160533,104823] 0 2024-02-19T19:08:24.330 INFO:tasks.workunit.client.0.smithi046.stdout:1/281: dread d5/f1f [0,4194304] 0 2024-02-19T19:08:24.331 INFO:tasks.workunit.client.0.smithi046.stdout:1/282: chown d5/d10/d2d/c38 576767206 1 2024-02-19T19:08:24.336 INFO:tasks.workunit.client.0.smithi046.stdout:0/219: dwrite d0/f1c [0,4194304] 0 2024-02-19T19:08:24.336 INFO:tasks.workunit.client.0.smithi046.stdout:0/220: creat d0/f4e x:0 0 0 2024-02-19T19:08:24.336 INFO:tasks.workunit.client.0.smithi046.stdout:0/221: creat d0/f4f x:0 0 0 2024-02-19T19:08:24.336 INFO:tasks.workunit.client.0.smithi046.stdout:0/222: write d0/f18 [4520376,60416] 0 2024-02-19T19:08:24.336 INFO:tasks.workunit.client.0.smithi046.stdout:5/222: dwrite d2/f16 [0,4194304] 0 2024-02-19T19:08:24.337 INFO:tasks.workunit.client.0.smithi046.stdout:5/223: chown d2/dd/l18 313396767 1 2024-02-19T19:08:24.337 INFO:tasks.workunit.client.0.smithi046.stdout:5/224: chown d2/dd/c1e 6 1 2024-02-19T19:08:24.340 INFO:tasks.workunit.client.0.smithi046.stdout:0/223: creat d0/d19/db/f50 x:0 0 0 2024-02-19T19:08:24.341 INFO:tasks.workunit.client.0.smithi046.stdout:4/197: dread d6/d11/d26/f34 [0,4194304] 0 2024-02-19T19:08:24.341 INFO:tasks.workunit.client.0.smithi046.stdout:4/198: readlink d6/l1d 0 2024-02-19T19:08:24.345 INFO:tasks.workunit.client.0.smithi046.stdout:5/225: link d2/dd/f36 d2/f40 0 2024-02-19T19:08:24.346 INFO:tasks.workunit.client.0.smithi046.stdout:0/224: mknod d0/d19/d4d/c51 0 2024-02-19T19:08:24.347 INFO:tasks.workunit.client.0.smithi046.stdout:4/199: link d6/d15/d17/d1e/f2a d6/d11/f43 0 2024-02-19T19:08:24.349 INFO:tasks.workunit.client.0.smithi046.stdout:5/226: creat d2/dd/d2f/f41 x:0 0 0 2024-02-19T19:08:24.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/227: creat d2/dd/d29/d3b/f42 x:0 0 0 2024-02-19T19:08:24.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/228: chown d2/d27 57848 1 2024-02-19T19:08:24.352 INFO:tasks.workunit.client.0.smithi046.stdout:5/229: link d2/f2b d2/d3a/f43 0 2024-02-19T19:08:24.354 INFO:tasks.workunit.client.0.smithi046.stdout:1/283: dwrite d5/d13/f19 [0,4194304] 0 2024-02-19T19:08:24.354 INFO:tasks.workunit.client.0.smithi046.stdout:1/284: stat d5/d2f/d5e 0 2024-02-19T19:08:24.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/230: link d2/dd/d29/f2a d2/dd/f44 0 2024-02-19T19:08:24.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/231: write d2/f21 [4551216,80666] 0 2024-02-19T19:08:24.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/232: creat d2/dd/d29/f45 x:0 0 0 2024-02-19T19:08:24.356 INFO:tasks.workunit.client.0.smithi046.stdout:1/285: symlink d5/d13/l60 0 2024-02-19T19:08:24.357 INFO:tasks.workunit.client.0.smithi046.stdout:5/233: dread d2/dd/d26/f2e [0,4194304] 0 2024-02-19T19:08:24.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/200: dwrite d6/d15/d17/f3f [0,4194304] 0 2024-02-19T19:08:24.359 INFO:tasks.workunit.client.0.smithi046.stdout:5/234: truncate d2/dd/d26/f2e 765745 0 2024-02-19T19:08:24.359 INFO:tasks.workunit.client.0.smithi046.stdout:5/235: dread - d2/dd/f37 zero size 2024-02-19T19:08:24.361 INFO:tasks.workunit.client.0.smithi046.stdout:5/236: symlink d2/dd/d3f/l46 0 2024-02-19T19:08:24.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/237: mkdir d2/d27/d47 0 2024-02-19T19:08:24.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/238: creat d2/dd/d26/f48 x:0 0 0 2024-02-19T19:08:24.364 INFO:tasks.workunit.client.0.smithi046.stdout:0/225: dwrite d0/d19/f3a [0,4194304] 0 2024-02-19T19:08:24.364 INFO:tasks.workunit.client.0.smithi046.stdout:0/226: chown d0/d19/l44 60 1 2024-02-19T19:08:24.364 INFO:tasks.workunit.client.0.smithi046.stdout:0/227: creat d0/f52 x:0 0 0 2024-02-19T19:08:24.368 INFO:tasks.workunit.client.0.smithi046.stdout:1/286: dread d5/d10/d3b/d3c/d3f/f43 [0,4194304] 0 2024-02-19T19:08:24.372 INFO:tasks.workunit.client.0.smithi046.stdout:5/239: write d2/f28 [2921342,507] 0 2024-02-19T19:08:24.374 INFO:tasks.workunit.client.0.smithi046.stdout:0/228: write d0/d19/f1f [3509320,80367] 0 2024-02-19T19:08:24.376 INFO:tasks.workunit.client.0.smithi046.stdout:9/134: sync 2024-02-19T19:08:24.376 INFO:tasks.workunit.client.0.smithi046.stdout:3/184: sync 2024-02-19T19:08:24.376 INFO:tasks.workunit.client.0.smithi046.stdout:8/268: sync 2024-02-19T19:08:24.376 INFO:tasks.workunit.client.0.smithi046.stdout:2/169: sync 2024-02-19T19:08:24.376 INFO:tasks.workunit.client.0.smithi046.stdout:0/229: stat d0/d19/db/l47 0 2024-02-19T19:08:24.376 INFO:tasks.workunit.client.0.smithi046.stdout:7/364: sync 2024-02-19T19:08:24.376 INFO:tasks.workunit.client.0.smithi046.stdout:7/365: dread - d0/d45/d4a/d58/d60/f67 zero size 2024-02-19T19:08:24.377 INFO:tasks.workunit.client.0.smithi046.stdout:7/366: fsync d0/d4/dd/f40 0 2024-02-19T19:08:24.377 INFO:tasks.workunit.client.0.smithi046.stdout:7/367: fdatasync d0/d3f/f5c 0 2024-02-19T19:08:24.377 INFO:tasks.workunit.client.0.smithi046.stdout:6/169: sync 2024-02-19T19:08:24.378 INFO:tasks.workunit.client.0.smithi046.stdout:9/135: symlink db/d20/l28 0 2024-02-19T19:08:24.378 INFO:tasks.workunit.client.0.smithi046.stdout:8/269: symlink d3/dd/d1c/d36/l63 0 2024-02-19T19:08:24.379 INFO:tasks.workunit.client.0.smithi046.stdout:9/136: write db/f1b [26701,129711] 0 2024-02-19T19:08:24.379 INFO:tasks.workunit.client.0.smithi046.stdout:2/170: mknod d5/c2d 0 2024-02-19T19:08:24.380 INFO:tasks.workunit.client.0.smithi046.stdout:0/230: mkdir d0/d24/d2f/d53 0 2024-02-19T19:08:24.382 INFO:tasks.workunit.client.0.smithi046.stdout:4/201: dwrite d6/d11/d26/f28 [0,4194304] 0 2024-02-19T19:08:24.382 INFO:tasks.workunit.client.0.smithi046.stdout:6/170: link d4/d6/dd/f21 d4/d6/dd/d10/f38 0 2024-02-19T19:08:24.382 INFO:tasks.workunit.client.0.smithi046.stdout:6/171: dread - d4/d6/dd/f21 zero size 2024-02-19T19:08:24.382 INFO:tasks.workunit.client.0.smithi046.stdout:6/172: readlink d4/d6/l1b 0 2024-02-19T19:08:24.385 INFO:tasks.workunit.client.0.smithi046.stdout:8/270: rename d3/dd/d4b to d3/d37/d64 0 2024-02-19T19:08:24.385 INFO:tasks.workunit.client.0.smithi046.stdout:8/271: stat d3/d37/c26 0 2024-02-19T19:08:24.387 INFO:tasks.workunit.client.0.smithi046.stdout:2/171: creat d5/d2c/f2e x:0 0 0 2024-02-19T19:08:24.388 INFO:tasks.workunit.client.0.smithi046.stdout:0/231: symlink d0/d19/db/d27/l54 0 2024-02-19T19:08:24.390 INFO:tasks.workunit.client.0.smithi046.stdout:4/202: mknod d6/d15/d17/c44 0 2024-02-19T19:08:24.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/173: creat d4/f39 x:0 0 0 2024-02-19T19:08:24.393 INFO:tasks.workunit.client.0.smithi046.stdout:8/272: mkdir d3/d37/d1d/d3c/d65 0 2024-02-19T19:08:24.393 INFO:tasks.workunit.client.0.smithi046.stdout:8/273: write d3/dd/fe [1882025,99787] 0 2024-02-19T19:08:24.394 INFO:tasks.workunit.client.0.smithi046.stdout:2/172: rename d5/f11 to d5/d6/f2f 0 2024-02-19T19:08:24.395 INFO:tasks.workunit.client.0.smithi046.stdout:8/274: rmdir d3/dd/d13/d42/d45 0 2024-02-19T19:08:24.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/232: rename d0/d19/f49 to d0/d19/db/d27/f55 0 2024-02-19T19:08:24.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/233: write d0/d19/d8/d37/f3e [763960,19407] 0 2024-02-19T19:08:24.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/234: write d0/f1b [1086425,36110] 0 2024-02-19T19:08:24.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/235: getdents d0/d24/d2f/d53 0 2024-02-19T19:08:24.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/236: chown d0/d19 0 1 2024-02-19T19:08:24.397 INFO:tasks.workunit.client.0.smithi046.stdout:7/368: dwrite d0/d4/f3c [0,4194304] 0 2024-02-19T19:08:24.398 INFO:tasks.workunit.client.0.smithi046.stdout:7/369: truncate d0/d45/d4a/d58/f39 1326774 0 2024-02-19T19:08:24.398 INFO:tasks.workunit.client.0.smithi046.stdout:7/370: chown d0/d45/d56 16 1 2024-02-19T19:08:24.398 INFO:tasks.workunit.client.0.smithi046.stdout:2/173: creat d5/f30 x:0 0 0 2024-02-19T19:08:24.398 INFO:tasks.workunit.client.0.smithi046.stdout:2/174: chown d5/d6/c1e 12 1 2024-02-19T19:08:24.399 INFO:tasks.workunit.client.0.smithi046.stdout:5/240: dwrite d2/dd/d26/f3d [4194304,4194304] 0 2024-02-19T19:08:24.399 INFO:tasks.workunit.client.0.smithi046.stdout:5/241: write d2/dd/d29/d3b/f42 [115558,103861] 0 2024-02-19T19:08:24.399 INFO:tasks.workunit.client.0.smithi046.stdout:3/185: dwrite da/d1d/d10/f21 [0,4194304] 0 2024-02-19T19:08:24.399 INFO:tasks.workunit.client.0.smithi046.stdout:3/186: creat da/f2c x:0 0 0 2024-02-19T19:08:24.400 INFO:tasks.workunit.client.0.smithi046.stdout:6/174: rename d4/d6/dd/d10/fc to d4/d6/dd/d10/d29/d2d/d35/f3a 0 2024-02-19T19:08:24.400 INFO:tasks.workunit.client.0.smithi046.stdout:6/175: read - d4/d6/f30 zero size 2024-02-19T19:08:24.400 INFO:tasks.workunit.client.0.smithi046.stdout:6/176: creat d4/d6/f3b x:0 0 0 2024-02-19T19:08:24.400 INFO:tasks.workunit.client.0.smithi046.stdout:6/177: chown d4/d6/dd 852 1 2024-02-19T19:08:24.400 INFO:tasks.workunit.client.0.smithi046.stdout:0/237: mkdir d0/d24/d56 0 2024-02-19T19:08:24.402 INFO:tasks.workunit.client.0.smithi046.stdout:7/371: creat d0/d4/d34/d41/f6d x:0 0 0 2024-02-19T19:08:24.406 INFO:tasks.workunit.client.0.smithi046.stdout:4/203: dread d6/d15/d17/f3f [0,4194304] 0 2024-02-19T19:08:24.407 INFO:tasks.workunit.client.0.smithi046.stdout:8/275: rename d3/d37/d1d/d3c/d65 to d3/dd/d13/d66 0 2024-02-19T19:08:24.409 INFO:tasks.workunit.client.0.smithi046.stdout:6/178: mkdir d4/d6/dd/d10/d29/d2d/d35/d3c 0 2024-02-19T19:08:24.409 INFO:tasks.workunit.client.0.smithi046.stdout:0/238: mknod d0/d24/d56/c57 0 2024-02-19T19:08:24.409 INFO:tasks.workunit.client.0.smithi046.stdout:0/239: chown d0/d19/db/d27/f2e 324580 1 2024-02-19T19:08:24.410 INFO:tasks.workunit.client.0.smithi046.stdout:7/372: mknod d0/d4/d34/d41/d5f/c6e 0 2024-02-19T19:08:24.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/242: getdents d2/dd/d29/d3b 0 2024-02-19T19:08:24.413 INFO:tasks.workunit.client.0.smithi046.stdout:4/204: symlink d6/l45 0 2024-02-19T19:08:24.413 INFO:tasks.workunit.client.0.smithi046.stdout:6/179: read d4/d6/dd/d10/f13 [2252846,119357] 0 2024-02-19T19:08:24.414 INFO:tasks.workunit.client.0.smithi046.stdout:2/175: dwrite d5/df/f24 [0,4194304] 0 2024-02-19T19:08:24.416 INFO:tasks.workunit.client.0.smithi046.stdout:0/240: mkdir d0/d19/d8/d37/d58 0 2024-02-19T19:08:24.416 INFO:tasks.workunit.client.0.smithi046.stdout:0/241: dread - d0/d19/db/d27/f2e zero size 2024-02-19T19:08:24.417 INFO:tasks.workunit.client.0.smithi046.stdout:7/373: mkdir d0/d4/d34/d4b/d6f 0 2024-02-19T19:08:24.419 INFO:tasks.workunit.client.0.smithi046.stdout:5/243: symlink d2/dd/l49 0 2024-02-19T19:08:24.419 INFO:tasks.workunit.client.0.smithi046.stdout:5/244: creat d2/f4a x:0 0 0 2024-02-19T19:08:24.419 INFO:tasks.workunit.client.0.smithi046.stdout:5/245: stat d2/dd/d29/f35 0 2024-02-19T19:08:24.424 INFO:tasks.workunit.client.0.smithi046.stdout:0/242: symlink d0/d19/l59 0 2024-02-19T19:08:24.424 INFO:tasks.workunit.client.0.smithi046.stdout:7/374: mknod d0/d45/c70 0 2024-02-19T19:08:24.426 INFO:tasks.workunit.client.0.smithi046.stdout:5/246: mkdir d2/d27/d4b 0 2024-02-19T19:08:24.430 INFO:tasks.workunit.client.0.smithi046.stdout:4/205: rmdir d6/d15/d17/d1e 39 2024-02-19T19:08:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:6/180: rmdir d4/d6/d22 39 2024-02-19T19:08:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:6/181: truncate d4/d6/dd/d10/f38 568546 0 2024-02-19T19:08:24.431 INFO:tasks.workunit.client.0.smithi046.stdout:6/182: stat d4/ca 0 2024-02-19T19:08:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/176: getdents d5 0 2024-02-19T19:08:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/177: dread - d5/f30 zero size 2024-02-19T19:08:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/178: chown d5/d6/f2f 188628 1 2024-02-19T19:08:24.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/179: write d5/d6/fd [2705773,121656] 0 2024-02-19T19:08:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/243: symlink d0/d24/l5a 0 2024-02-19T19:08:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/244: chown d0/f2 1 1 2024-02-19T19:08:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/245: readlink d0/d19/l29 0 2024-02-19T19:08:24.436 INFO:tasks.workunit.client.0.smithi046.stdout:2/180: mknod d5/d2c/c31 0 2024-02-19T19:08:24.438 INFO:tasks.workunit.client.0.smithi046.stdout:0/246: mkdir d0/d24/d5b 0 2024-02-19T19:08:24.438 INFO:tasks.workunit.client.0.smithi046.stdout:0/247: creat d0/f5c x:0 0 0 2024-02-19T19:08:24.438 INFO:tasks.workunit.client.0.smithi046.stdout:0/248: chown d0/f18 698 1 2024-02-19T19:08:24.438 INFO:tasks.workunit.client.0.smithi046.stdout:0/249: write d0/d24/f2a [4582673,1455] 0 2024-02-19T19:08:24.442 INFO:tasks.workunit.client.0.smithi046.stdout:6/183: write d4/d6/dd/f17 [3982108,119091] 0 2024-02-19T19:08:24.442 INFO:tasks.workunit.client.0.smithi046.stdout:6/184: write d4/f5 [428475,5366] 0 2024-02-19T19:08:24.442 INFO:tasks.workunit.client.0.smithi046.stdout:6/185: stat d4/d6/dd/d10/c1d 0 2024-02-19T19:08:24.442 INFO:tasks.workunit.client.0.smithi046.stdout:4/206: dwrite d6/d11/f43 [0,4194304] 0 2024-02-19T19:08:24.444 INFO:tasks.workunit.client.0.smithi046.stdout:0/250: rename d0/d19/fd to d0/d19/d8/d37/f5d 0 2024-02-19T19:08:24.445 INFO:tasks.workunit.client.0.smithi046.stdout:5/247: dwrite d2/f16 [0,4194304] 0 2024-02-19T19:08:24.446 INFO:tasks.workunit.client.0.smithi046.stdout:6/186: mknod d4/d6/dd/d10/d29/d2d/c3d 0 2024-02-19T19:08:24.446 INFO:tasks.workunit.client.0.smithi046.stdout:2/181: dread d5/d6/f2f [0,4194304] 0 2024-02-19T19:08:24.449 INFO:tasks.workunit.client.0.smithi046.stdout:4/207: mknod d6/d15/d17/c46 0 2024-02-19T19:08:24.449 INFO:tasks.workunit.client.0.smithi046.stdout:4/208: truncate d6/d11/d26/f2e 143452 0 2024-02-19T19:08:24.449 INFO:tasks.workunit.client.0.smithi046.stdout:4/209: chown d6/d15/d17/d1e/c36 467 1 2024-02-19T19:08:24.449 INFO:tasks.workunit.client.0.smithi046.stdout:4/210: chown d6/d15 11436170 1 2024-02-19T19:08:24.450 INFO:tasks.workunit.client.0.smithi046.stdout:0/251: symlink d0/d24/d2f/l5e 0 2024-02-19T19:08:24.451 INFO:tasks.workunit.client.0.smithi046.stdout:7/375: rmdir d0/d4 39 2024-02-19T19:08:24.452 INFO:tasks.workunit.client.0.smithi046.stdout:4/211: creat d6/d15/d17/d1e/d25/f47 x:0 0 0 2024-02-19T19:08:24.454 INFO:tasks.workunit.client.0.smithi046.stdout:7/376: rename d0/d4/d34 to d0/d45/d71 0 2024-02-19T19:08:24.457 INFO:tasks.workunit.client.0.smithi046.stdout:4/212: creat d6/d15/f48 x:0 0 0 2024-02-19T19:08:24.457 INFO:tasks.workunit.client.0.smithi046.stdout:4/213: creat d6/f49 x:0 0 0 2024-02-19T19:08:24.458 INFO:tasks.workunit.client.0.smithi046.stdout:0/252: dread d0/d19/d8/d37/f5d [0,4194304] 0 2024-02-19T19:08:24.461 INFO:tasks.workunit.client.0.smithi046.stdout:4/214: mkdir d6/d15/d17/d4a 0 2024-02-19T19:08:24.461 INFO:tasks.workunit.client.0.smithi046.stdout:4/215: stat d6/d15/d17/d1e/l3b 0 2024-02-19T19:08:24.462 INFO:tasks.workunit.client.0.smithi046.stdout:6/187: dwrite d4/d6/dd/d10/f38 [0,4194304] 0 2024-02-19T19:08:24.462 INFO:tasks.workunit.client.0.smithi046.stdout:6/188: chown d4/d6/dd/d10/c1d 0 1 2024-02-19T19:08:24.462 INFO:tasks.workunit.client.0.smithi046.stdout:5/248: write d2/f16 [1765394,81431] 0 2024-02-19T19:08:24.465 INFO:tasks.workunit.client.0.smithi046.stdout:6/189: symlink d4/d6/dd/d10/d29/d2d/d35/d3c/l3e 0 2024-02-19T19:08:24.465 INFO:tasks.workunit.client.0.smithi046.stdout:6/190: truncate d4/d6/dd/d10/d29/f36 904368 0 2024-02-19T19:08:24.465 INFO:tasks.workunit.client.0.smithi046.stdout:6/191: readlink d4/d6/dd/d10/l14 0 2024-02-19T19:08:24.468 INFO:tasks.workunit.client.0.smithi046.stdout:5/249: symlink d2/dd/d3f/l4c 0 2024-02-19T19:08:24.468 INFO:tasks.workunit.client.0.smithi046.stdout:5/250: truncate d2/dd/d29/f45 423595 0 2024-02-19T19:08:24.468 INFO:tasks.workunit.client.0.smithi046.stdout:5/251: write d2/d3a/f43 [409156,64517] 0 2024-02-19T19:08:24.471 INFO:tasks.workunit.client.0.smithi046.stdout:5/252: getdents d2 0 2024-02-19T19:08:24.471 INFO:tasks.workunit.client.0.smithi046.stdout:5/253: write d2/d3a/f43 [30390,48841] 0 2024-02-19T19:08:24.473 INFO:tasks.workunit.client.0.smithi046.stdout:0/253: read d0/d24/f23 [3945199,124920] 0 2024-02-19T19:08:24.473 INFO:tasks.workunit.client.0.smithi046.stdout:7/377: dwrite d0/d4/f29 [0,4194304] 0 2024-02-19T19:08:24.474 INFO:tasks.workunit.client.0.smithi046.stdout:5/254: rename d2/dd/d3f/l46 to d2/dd/l4d 0 2024-02-19T19:08:24.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/254: mkdir d0/d5f 0 2024-02-19T19:08:24.476 INFO:tasks.workunit.client.0.smithi046.stdout:0/255: creat d0/d5f/f60 x:0 0 0 2024-02-19T19:08:24.477 INFO:tasks.workunit.client.0.smithi046.stdout:4/216: dwrite d6/d15/d17/f41 [0,4194304] 0 2024-02-19T19:08:24.478 INFO:tasks.workunit.client.0.smithi046.stdout:0/256: creat d0/d24/d2f/d53/f61 x:0 0 0 2024-02-19T19:08:24.480 INFO:tasks.workunit.client.0.smithi046.stdout:4/217: rmdir d6/d15/d17/d1e/d33 39 2024-02-19T19:08:24.480 INFO:tasks.workunit.client.0.smithi046.stdout:4/218: chown d6/d15/d17/d1e/d33 419 1 2024-02-19T19:08:24.480 INFO:tasks.workunit.client.0.smithi046.stdout:4/219: readlink d6/l45 0 2024-02-19T19:08:24.481 INFO:tasks.workunit.client.0.smithi046.stdout:0/257: symlink d0/d5f/l62 0 2024-02-19T19:08:24.482 INFO:tasks.workunit.client.0.smithi046.stdout:6/192: dwrite d4/d6/dd/d10/d29/f36 [0,4194304] 0 2024-02-19T19:08:24.482 INFO:tasks.workunit.client.0.smithi046.stdout:6/193: chown d4/d6/d22 2108395788 1 2024-02-19T19:08:24.484 INFO:tasks.workunit.client.0.smithi046.stdout:4/220: link d6/fb d6/d15/d17/d1e/d25/f4b 0 2024-02-19T19:08:24.488 INFO:tasks.workunit.client.0.smithi046.stdout:6/194: rmdir d4/d6/d22 39 2024-02-19T19:08:24.488 INFO:tasks.workunit.client.0.smithi046.stdout:6/195: read d4/d6/dd/f11 [678494,128078] 0 2024-02-19T19:08:24.489 INFO:tasks.workunit.client.0.smithi046.stdout:7/378: dwrite d0/d45/d71/f5b [0,4194304] 0 2024-02-19T19:08:24.490 INFO:tasks.workunit.client.0.smithi046.stdout:4/221: mknod d6/d15/d17/d1e/d25/c4c 0 2024-02-19T19:08:24.490 INFO:tasks.workunit.client.0.smithi046.stdout:4/222: chown d6/d15/d17/d1e/l3b 6347 1 2024-02-19T19:08:24.494 INFO:tasks.workunit.client.0.smithi046.stdout:7/379: creat d0/d45/d71/d4b/f72 x:0 0 0 2024-02-19T19:08:24.496 INFO:tasks.workunit.client.0.smithi046.stdout:6/196: dread d4/d6/dd/f17 [0,4194304] 0 2024-02-19T19:08:24.497 INFO:tasks.workunit.client.0.smithi046.stdout:4/223: getdents d6/d11 0 2024-02-19T19:08:24.499 INFO:tasks.workunit.client.0.smithi046.stdout:7/380: symlink d0/d4/l73 0 2024-02-19T19:08:24.499 INFO:tasks.workunit.client.0.smithi046.stdout:7/381: chown d0/d4/dd/c1e 1642 1 2024-02-19T19:08:24.499 INFO:tasks.workunit.client.0.smithi046.stdout:7/382: truncate d0/d4/f7 1559939 0 2024-02-19T19:08:24.500 INFO:tasks.workunit.client.0.smithi046.stdout:6/197: mknod d4/d6/dd/d10/d29/d2d/c3f 0 2024-02-19T19:08:24.501 INFO:tasks.workunit.client.0.smithi046.stdout:4/224: mknod d6/d15/d17/d1e/d33/c4d 0 2024-02-19T19:08:24.502 INFO:tasks.workunit.client.0.smithi046.stdout:4/225: chown d6/d11/f43 7031320 1 2024-02-19T19:08:24.503 INFO:tasks.workunit.client.0.smithi046.stdout:5/255: dwrite d2/dd/d2f/f41 [0,4194304] 0 2024-02-19T19:08:24.503 INFO:tasks.workunit.client.0.smithi046.stdout:5/256: write d2/dd/f1c [88428,9622] 0 2024-02-19T19:08:24.503 INFO:tasks.workunit.client.0.smithi046.stdout:5/257: write d2/dd/f1a [751299,6915] 0 2024-02-19T19:08:24.504 INFO:tasks.workunit.client.0.smithi046.stdout:7/383: rename d0/d4/dd/c36 to d0/d4/d68/c74 0 2024-02-19T19:08:24.504 INFO:tasks.workunit.client.0.smithi046.stdout:6/198: rename d4/d6/dd to d4/d6/dd/d10/d29/d2d/d35/d3c/d40 22 2024-02-19T19:08:24.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/226: symlink d6/d15/d17/d1e/d33/l4e 0 2024-02-19T19:08:24.506 INFO:tasks.workunit.client.0.smithi046.stdout:6/199: dread d4/d6/dd/f11 [0,4194304] 0 2024-02-19T19:08:24.506 INFO:tasks.workunit.client.0.smithi046.stdout:0/258: dwrite d0/f4f [0,4194304] 0 2024-02-19T19:08:24.506 INFO:tasks.workunit.client.0.smithi046.stdout:0/259: chown d0/d19/db/d27/f28 445319 1 2024-02-19T19:08:24.507 INFO:tasks.workunit.client.0.smithi046.stdout:5/258: symlink d2/dd/d2f/d34/l4e 0 2024-02-19T19:08:24.507 INFO:tasks.workunit.client.0.smithi046.stdout:5/259: fsync d2/dd/d26/f2e 0 2024-02-19T19:08:24.508 INFO:tasks.workunit.client.0.smithi046.stdout:4/227: mknod d6/d15/d17/d1e/c4f 0 2024-02-19T19:08:24.509 INFO:tasks.workunit.client.0.smithi046.stdout:6/200: mknod d4/d6/dd/d10/d29/d2d/d35/c41 0 2024-02-19T19:08:24.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/260: creat d0/d19/d8/d37/d58/f63 x:0 0 0 2024-02-19T19:08:24.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/261: write d0/f52 [86533,101615] 0 2024-02-19T19:08:24.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/262: readlink d0/d24/l5a 0 2024-02-19T19:08:24.514 INFO:tasks.workunit.client.0.smithi046.stdout:7/384: dwrite d0/f49 [0,4194304] 0 2024-02-19T19:08:24.514 INFO:tasks.workunit.client.0.smithi046.stdout:7/385: read d0/f30 [64597,88027] 0 2024-02-19T19:08:24.522 INFO:tasks.workunit.client.0.smithi046.stdout:4/228: mkdir d6/d50 0 2024-02-19T19:08:24.524 INFO:tasks.workunit.client.0.smithi046.stdout:5/260: dwrite d2/dd/f1c [0,4194304] 0 2024-02-19T19:08:24.524 INFO:tasks.workunit.client.0.smithi046.stdout:5/261: fdatasync d2/f40 0 2024-02-19T19:08:24.524 INFO:tasks.workunit.client.0.smithi046.stdout:5/262: truncate d2/dd/f1a 1442976 0 2024-02-19T19:08:24.524 INFO:tasks.workunit.client.0.smithi046.stdout:6/201: rename d4/d6/l33 to d4/d6/dd/d10/d29/l42 0 2024-02-19T19:08:24.525 INFO:tasks.workunit.client.0.smithi046.stdout:0/263: mknod d0/d24/c64 0 2024-02-19T19:08:24.530 INFO:tasks.workunit.client.0.smithi046.stdout:4/229: link c2 d6/d15/d17/c51 0 2024-02-19T19:08:24.532 INFO:tasks.workunit.client.0.smithi046.stdout:5/263: creat d2/d27/f4f x:0 0 0 2024-02-19T19:08:24.532 INFO:tasks.workunit.client.0.smithi046.stdout:5/264: creat d2/dd/d26/f50 x:0 0 0 2024-02-19T19:08:24.532 INFO:tasks.workunit.client.0.smithi046.stdout:5/265: readlink d2/dd/l4d 0 2024-02-19T19:08:24.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/202: getdents d4/d6/d22 0 2024-02-19T19:08:24.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/203: write d4/f19 [2087783,118586] 0 2024-02-19T19:08:24.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/204: creat d4/f43 x:0 0 0 2024-02-19T19:08:24.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/205: chown d4/l16 53 1 2024-02-19T19:08:24.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/206: fdatasync d4/d6/fe 0 2024-02-19T19:08:24.536 INFO:tasks.workunit.client.0.smithi046.stdout:7/386: mkdir d0/d4/d75 0 2024-02-19T19:08:24.536 INFO:tasks.workunit.client.0.smithi046.stdout:7/387: chown d0/d45/d4a/d58/f42 50758 1 2024-02-19T19:08:24.539 INFO:tasks.workunit.client.0.smithi046.stdout:0/264: dwrite d0/d19/db/d27/f28 [0,4194304] 0 2024-02-19T19:08:24.539 INFO:tasks.workunit.client.0.smithi046.stdout:0/265: fdatasync d0/d19/f2d 0 2024-02-19T19:08:24.539 INFO:tasks.workunit.client.0.smithi046.stdout:4/230: dread d6/fb [0,4194304] 0 2024-02-19T19:08:24.540 INFO:tasks.workunit.client.0.smithi046.stdout:6/207: rename d4/f7 to d4/d6/dd/f44 0 2024-02-19T19:08:24.540 INFO:tasks.workunit.client.0.smithi046.stdout:6/208: chown d4/d6/d1c 9732 1 2024-02-19T19:08:24.542 INFO:tasks.workunit.client.0.smithi046.stdout:7/388: creat d0/d45/d71/d41/d5f/f76 x:0 0 0 2024-02-19T19:08:24.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/266: rmdir d0/d19/d8/d37/d40 39 2024-02-19T19:08:24.543 INFO:tasks.workunit.client.0.smithi046.stdout:5/266: dwrite d2/dd/d26/f50 [0,4194304] 0 2024-02-19T19:08:24.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/267: write d0/d24/d2f/f46 [1727,34442] 0 2024-02-19T19:08:24.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/268: fsync d0/d19/d8/f1d 0 2024-02-19T19:08:24.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/269: read - d0/d19/d8/f34 zero size 2024-02-19T19:08:24.543 INFO:tasks.workunit.client.0.smithi046.stdout:4/231: stat d6/d15/d17/c3c 0 2024-02-19T19:08:24.544 INFO:tasks.workunit.client.0.smithi046.stdout:6/209: rmdir d4/d6/dd/d10 39 2024-02-19T19:08:24.545 INFO:tasks.workunit.client.0.smithi046.stdout:6/210: truncate d4/d6/dd/d10/d29/f36 4425779 0 2024-02-19T19:08:24.546 INFO:tasks.workunit.client.0.smithi046.stdout:7/389: creat d0/d45/d71/d41/f77 x:0 0 0 2024-02-19T19:08:24.549 INFO:tasks.workunit.client.0.smithi046.stdout:0/270: unlink d0/d19/db/d27/f55 0 2024-02-19T19:08:24.550 INFO:tasks.workunit.client.0.smithi046.stdout:6/211: dread d4/d6/dd/d10/f13 [0,4194304] 0 2024-02-19T19:08:24.550 INFO:tasks.workunit.client.0.smithi046.stdout:6/212: chown d4/d6/d22/c2e 5 1 2024-02-19T19:08:24.550 INFO:tasks.workunit.client.0.smithi046.stdout:6/213: write d4/d6/f1a [607807,78948] 0 2024-02-19T19:08:24.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/232: symlink d6/d11/d40/l52 0 2024-02-19T19:08:24.551 INFO:tasks.workunit.client.0.smithi046.stdout:7/390: mkdir d0/d45/d4a/d78 0 2024-02-19T19:08:24.552 INFO:tasks.workunit.client.0.smithi046.stdout:5/267: dread d2/f21 [0,4194304] 0 2024-02-19T19:08:24.552 INFO:tasks.workunit.client.0.smithi046.stdout:5/268: getdents d2/d27/d47 0 2024-02-19T19:08:24.552 INFO:tasks.workunit.client.0.smithi046.stdout:0/271: unlink d0/d19/db/c1e 0 2024-02-19T19:08:24.554 INFO:tasks.workunit.client.0.smithi046.stdout:6/214: link d4/d6/dd/d10/d29/l42 d4/d6/dd/d10/d29/l45 0 2024-02-19T19:08:24.554 INFO:tasks.workunit.client.0.smithi046.stdout:7/391: mknod d0/d45/d4a/d58/c79 0 2024-02-19T19:08:24.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/269: rename d2/l1d to d2/dd/d29/d3b/l51 0 2024-02-19T19:08:24.558 INFO:tasks.workunit.client.0.smithi046.stdout:0/272: mkdir d0/d5f/d65 0 2024-02-19T19:08:24.558 INFO:tasks.workunit.client.0.smithi046.stdout:0/273: chown d0/d19/f1f 3 1 2024-02-19T19:08:24.558 INFO:tasks.workunit.client.0.smithi046.stdout:0/274: creat d0/d19/db/d27/f66 x:0 0 0 2024-02-19T19:08:24.558 INFO:tasks.workunit.client.0.smithi046.stdout:0/275: truncate d0/d24/f4b 809217 0 2024-02-19T19:08:24.558 INFO:tasks.workunit.client.0.smithi046.stdout:6/215: symlink d4/d6/l46 0 2024-02-19T19:08:24.559 INFO:tasks.workunit.client.0.smithi046.stdout:4/233: read d6/d11/f43 [3783356,53080] 0 2024-02-19T19:08:24.559 INFO:tasks.workunit.client.0.smithi046.stdout:7/392: rmdir d0/d4/d24 39 2024-02-19T19:08:24.561 INFO:tasks.workunit.client.0.smithi046.stdout:7/393: creat d0/d4/d24/f7a x:0 0 0 2024-02-19T19:08:24.562 INFO:tasks.workunit.client.0.smithi046.stdout:4/234: symlink d6/d15/d17/d1e/d33/l53 0 2024-02-19T19:08:24.565 INFO:tasks.workunit.client.0.smithi046.stdout:7/394: mkdir d0/d4/d7b 0 2024-02-19T19:08:24.566 INFO:tasks.workunit.client.0.smithi046.stdout:5/270: dread d2/f28 [0,4194304] 0 2024-02-19T19:08:24.580 INFO:tasks.workunit.client.0.smithi046.stdout:0/276: dwrite d0/f52 [0,4194304] 0 2024-02-19T19:08:24.581 INFO:tasks.workunit.client.0.smithi046.stdout:5/271: dwrite d2/dd/d29/d3b/f42 [0,4194304] 0 2024-02-19T19:08:24.581 INFO:tasks.workunit.client.0.smithi046.stdout:5/272: fdatasync d2/dd/d26/f2e 0 2024-02-19T19:08:24.581 INFO:tasks.workunit.client.0.smithi046.stdout:5/273: stat d2/dd/f15 0 2024-02-19T19:08:24.583 INFO:tasks.workunit.client.0.smithi046.stdout:0/277: symlink d0/d5f/d65/l67 0 2024-02-19T19:08:24.583 INFO:tasks.workunit.client.0.smithi046.stdout:0/278: write d0/f4e [742214,129777] 0 2024-02-19T19:08:24.583 INFO:tasks.workunit.client.0.smithi046.stdout:0/279: chown d0/d24/d2f/d53/f61 0 1 2024-02-19T19:08:24.588 INFO:tasks.workunit.client.0.smithi046.stdout:0/280: rename d0/d24/l5a to d0/l68 0 2024-02-19T19:08:24.597 INFO:tasks.workunit.client.0.smithi046.stdout:7/395: dwrite d0/d3f/f5c [0,4194304] 0 2024-02-19T19:08:24.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/396: dread d0/f30 [0,4194304] 0 2024-02-19T19:08:24.600 INFO:tasks.workunit.client.0.smithi046.stdout:5/274: dwrite d2/d27/f4f [0,4194304] 0 2024-02-19T19:08:24.601 INFO:tasks.workunit.client.0.smithi046.stdout:4/235: dwrite d6/d15/d17/f41 [0,4194304] 0 2024-02-19T19:08:24.601 INFO:tasks.workunit.client.0.smithi046.stdout:4/236: fdatasync d6/d15/d17/d1e/f2a 0 2024-02-19T19:08:24.601 INFO:tasks.workunit.client.0.smithi046.stdout:7/397: symlink d0/d45/d71/d4b/d6f/l7c 0 2024-02-19T19:08:24.611 INFO:tasks.workunit.client.0.smithi046.stdout:0/281: dwrite d0/f2 [0,4194304] 0 2024-02-19T19:08:24.611 INFO:tasks.workunit.client.0.smithi046.stdout:0/282: creat d0/d5f/f69 x:0 0 0 2024-02-19T19:08:24.614 INFO:tasks.workunit.client.0.smithi046.stdout:0/283: truncate d0/f18 86545 0 2024-02-19T19:08:24.615 INFO:tasks.workunit.client.0.smithi046.stdout:0/284: dread d0/d24/d2f/f46 [0,4194304] 0 2024-02-19T19:08:24.618 INFO:tasks.workunit.client.0.smithi046.stdout:0/285: mkdir d0/d19/db/d6a 0 2024-02-19T19:08:24.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/286: mkdir d0/d24/d2f/d53/d6b 0 2024-02-19T19:08:24.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/287: chown d0/d19/db/d27/l3d 0 1 2024-02-19T19:08:24.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/288: chown d0/d24/d2f/d53 59379768 1 2024-02-19T19:08:24.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/289: readlink d0/d24/d2f/l3f 0 2024-02-19T19:08:24.620 INFO:tasks.workunit.client.0.smithi046.stdout:0/290: mkdir d0/d6c 0 2024-02-19T19:08:24.623 INFO:tasks.workunit.client.0.smithi046.stdout:4/237: dwrite d6/d11/d26/f34 [0,4194304] 0 2024-02-19T19:08:24.624 INFO:tasks.workunit.client.0.smithi046.stdout:4/238: getdents d6/d11 0 2024-02-19T19:08:24.624 INFO:tasks.workunit.client.0.smithi046.stdout:4/239: truncate d6/d15/d17/d1e/d33/f38 695640 0 2024-02-19T19:08:24.624 INFO:tasks.workunit.client.0.smithi046.stdout:5/275: dwrite d2/dd/d26/f48 [0,4194304] 0 2024-02-19T19:08:24.624 INFO:tasks.workunit.client.0.smithi046.stdout:5/276: creat d2/dd/d2f/f52 x:0 0 0 2024-02-19T19:08:24.625 INFO:tasks.workunit.client.0.smithi046.stdout:4/240: rename d6/d15/c22 to d6/d15/d17/d1e/c54 0 2024-02-19T19:08:24.625 INFO:tasks.workunit.client.0.smithi046.stdout:4/241: chown d6/d15/f48 624489 1 2024-02-19T19:08:24.639 INFO:tasks.workunit.client.0.smithi046.stdout:0/291: dwrite d0/d19/d8/f34 [0,4194304] 0 2024-02-19T19:08:24.639 INFO:tasks.workunit.client.0.smithi046.stdout:0/292: creat d0/d5f/f6d x:0 0 0 2024-02-19T19:08:24.639 INFO:tasks.workunit.client.0.smithi046.stdout:0/293: truncate d0/d24/f39 975526 0 2024-02-19T19:08:24.640 INFO:tasks.workunit.client.0.smithi046.stdout:0/294: chown d0/d19/db/l47 7512 1 2024-02-19T19:08:24.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/295: dread d0/f18 [0,4194304] 0 2024-02-19T19:08:24.695 INFO:tasks.workunit.client.0.smithi046.stdout:4/242: rmdir d6/d15/d17 39 2024-02-19T19:08:24.696 INFO:tasks.workunit.client.0.smithi046.stdout:4/243: mkdir d6/d15/d17/d1e/d33/d55 0 2024-02-19T19:08:24.696 INFO:tasks.workunit.client.0.smithi046.stdout:4/244: truncate d6/f49 665612 0 2024-02-19T19:08:24.696 INFO:tasks.workunit.client.0.smithi046.stdout:4/245: fsync d6/f42 0 2024-02-19T19:08:24.696 INFO:tasks.workunit.client.0.smithi046.stdout:4/246: fdatasync d6/d15/d17/d1e/d25/f47 0 2024-02-19T19:08:24.699 INFO:tasks.workunit.client.0.smithi046.stdout:4/247: dread d6/f49 [0,4194304] 0 2024-02-19T19:08:24.701 INFO:tasks.workunit.client.0.smithi046.stdout:4/248: dread d6/f31 [0,4194304] 0 2024-02-19T19:08:24.702 INFO:tasks.workunit.client.0.smithi046.stdout:4/249: mknod d6/d15/c56 0 2024-02-19T19:08:24.712 INFO:tasks.workunit.client.0.smithi046.stdout:4/250: read d6/d11/d26/f34 [1021956,106667] 0 2024-02-19T19:08:24.712 INFO:tasks.workunit.client.0.smithi046.stdout:4/251: creat d6/d11/d26/f57 x:0 0 0 2024-02-19T19:08:24.714 INFO:tasks.workunit.client.0.smithi046.stdout:5/277: dwrite d2/dd/d26/f48 [4194304,4194304] 0 2024-02-19T19:08:24.715 INFO:tasks.workunit.client.0.smithi046.stdout:4/252: link d6/l45 d6/d15/d17/d1e/d33/l58 0 2024-02-19T19:08:24.717 INFO:tasks.workunit.client.0.smithi046.stdout:4/253: rename d6/d15/d17/d1e/d25/f47 to d6/d15/d17/d1e/d25/f59 0 2024-02-19T19:08:24.723 INFO:tasks.workunit.client.0.smithi046.stdout:4/254: truncate d6/f49 614675 0 2024-02-19T19:08:24.724 INFO:tasks.workunit.client.0.smithi046.stdout:4/255: dread - d6/d15/d17/d1e/d25/f59 zero size 2024-02-19T19:08:24.724 INFO:tasks.workunit.client.0.smithi046.stdout:4/256: creat d6/d15/d17/d4a/f5a x:0 0 0 2024-02-19T19:08:24.732 INFO:tasks.workunit.client.0.smithi046.stdout:4/257: write d6/d15/d17/f41 [1521313,36257] 0 2024-02-19T19:08:24.732 INFO:tasks.workunit.client.0.smithi046.stdout:5/278: dwrite d2/d27/f4f [4194304,4194304] 0 2024-02-19T19:08:24.732 INFO:tasks.workunit.client.0.smithi046.stdout:5/279: chown d2/l1f 34 1 2024-02-19T19:08:24.734 INFO:tasks.workunit.client.0.smithi046.stdout:4/258: creat d6/d15/d17/f5b x:0 0 0 2024-02-19T19:08:24.735 INFO:tasks.workunit.client.0.smithi046.stdout:5/280: unlink d2/l11 0 2024-02-19T19:08:24.735 INFO:tasks.workunit.client.0.smithi046.stdout:5/281: write d2/dd/d2f/d34/f3e [995256,42694] 0 2024-02-19T19:08:24.740 INFO:tasks.workunit.client.0.smithi046.stdout:4/259: dread d6/d11/f43 [0,4194304] 0 2024-02-19T19:08:24.740 INFO:tasks.workunit.client.0.smithi046.stdout:4/260: readlink d6/d15/d17/d1e/l3b 0 2024-02-19T19:08:24.741 INFO:tasks.workunit.client.0.smithi046.stdout:4/261: creat d6/d15/f5c x:0 0 0 2024-02-19T19:08:24.758 INFO:tasks.workunit.client.0.smithi046.stdout:5/282: dwrite d2/d3a/f43 [0,4194304] 0 2024-02-19T19:08:24.760 INFO:tasks.workunit.client.0.smithi046.stdout:5/283: creat d2/d27/f53 x:0 0 0 2024-02-19T19:08:24.761 INFO:tasks.workunit.client.0.smithi046.stdout:5/284: mkdir d2/d27/d47/d54 0 2024-02-19T19:08:24.770 INFO:tasks.workunit.client.0.smithi046.stdout:5/285: read d2/d27/f4f [2865958,31698] 0 2024-02-19T19:08:24.771 INFO:tasks.workunit.client.0.smithi046.stdout:5/286: truncate d2/dd/f15 2966383 0 2024-02-19T19:08:24.788 INFO:tasks.workunit.client.0.smithi046.stdout:5/287: dwrite d2/dd/d29/f45 [0,4194304] 0 2024-02-19T19:08:24.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/288: mkdir d2/dd/d3f/d55 0 2024-02-19T19:08:24.791 INFO:tasks.workunit.client.0.smithi046.stdout:5/289: creat d2/d27/d47/d54/f56 x:0 0 0 2024-02-19T19:08:24.792 INFO:tasks.workunit.client.0.smithi046.stdout:5/290: truncate d2/f2b 4144213 0 2024-02-19T19:08:24.792 INFO:tasks.workunit.client.0.smithi046.stdout:5/291: chown d2/dd/f36 15 1 2024-02-19T19:08:24.792 INFO:tasks.workunit.client.0.smithi046.stdout:5/292: readlink d2/dd/l4d 0 2024-02-19T19:08:24.792 INFO:tasks.workunit.client.0.smithi046.stdout:5/293: readlink d2/dd/d2f/d34/l4e 0 2024-02-19T19:08:24.793 INFO:tasks.workunit.client.0.smithi046.stdout:5/294: rmdir d2/d27/d47 39 2024-02-19T19:08:24.793 INFO:tasks.workunit.client.0.smithi046.stdout:5/295: readlink d2/l23 0 2024-02-19T19:08:24.806 INFO:tasks.workunit.client.0.smithi046.stdout:5/296: read d2/f2b [18995,1351] 0 2024-02-19T19:08:24.806 INFO:tasks.workunit.client.0.smithi046.stdout:5/297: readlink d2/dd/d3f/l4c 0 2024-02-19T19:08:24.807 INFO:tasks.workunit.client.0.smithi046.stdout:5/298: dread d2/dd/f36 [0,4194304] 0 2024-02-19T19:08:24.809 INFO:tasks.workunit.client.0.smithi046.stdout:5/299: dread d2/dd/f36 [0,4194304] 0 2024-02-19T19:08:24.809 INFO:tasks.workunit.client.0.smithi046.stdout:5/300: truncate d2/dd/d26/f2e 1277224 0 2024-02-19T19:08:24.809 INFO:tasks.workunit.client.0.smithi046.stdout:5/301: stat d2/fb 0 2024-02-19T19:08:24.810 INFO:tasks.workunit.client.0.smithi046.stdout:5/302: dread d2/dd/f36 [0,4194304] 0 2024-02-19T19:08:24.811 INFO:tasks.workunit.client.0.smithi046.stdout:5/303: mkdir d2/d27/d47/d54/d57 0 2024-02-19T19:08:24.811 INFO:tasks.workunit.client.0.smithi046.stdout:5/304: chown d2 433313698 1 2024-02-19T19:08:24.811 INFO:tasks.workunit.client.0.smithi046.stdout:5/305: truncate d2/f16 3309236 0 2024-02-19T19:08:24.817 INFO:tasks.workunit.client.0.smithi046.stdout:5/306: dread d2/dd/f20 [0,4194304] 0 2024-02-19T19:08:24.817 INFO:tasks.workunit.client.0.smithi046.stdout:5/307: chown d2/d27 3427 1 2024-02-19T19:08:24.831 INFO:tasks.workunit.client.0.smithi046.stdout:5/308: dread d2/dd/d26/f3d [4194304,4194304] 0 2024-02-19T19:08:24.832 INFO:tasks.workunit.client.0.smithi046.stdout:5/309: creat d2/d27/d47/f58 x:0 0 0 2024-02-19T19:08:24.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/310: rename d2/ca to d2/d27/d47/d54/c59 0 2024-02-19T19:08:24.835 INFO:tasks.workunit.client.0.smithi046.stdout:5/311: rename d2/dd/c1e to d2/dd/d3f/c5a 0 2024-02-19T19:08:24.835 INFO:tasks.workunit.client.0.smithi046.stdout:5/312: chown d2/dd/f44 201884 1 2024-02-19T19:08:24.847 INFO:tasks.workunit.client.0.smithi046.stdout:5/313: dwrite d2/dd/d2f/f52 [0,4194304] 0 2024-02-19T19:08:24.855 INFO:tasks.workunit.client.0.smithi046.stdout:5/314: dread d2/dd/d29/d3b/f42 [0,4194304] 0 2024-02-19T19:08:24.856 INFO:tasks.workunit.client.0.smithi046.stdout:5/315: unlink d2/dd/d2f/f52 0 2024-02-19T19:08:24.856 INFO:tasks.workunit.client.0.smithi046.stdout:5/316: chown d2/dd/l49 78171 1 2024-02-19T19:08:24.856 INFO:tasks.workunit.client.0.smithi046.stdout:5/317: chown d2/f21 12524 1 2024-02-19T19:08:24.858 INFO:tasks.workunit.client.0.smithi046.stdout:5/318: link d2/dd/d26/f3d d2/dd/d2f/d34/f5b 0 2024-02-19T19:08:24.858 INFO:tasks.workunit.client.0.smithi046.stdout:5/319: fsync d2/f21 0 2024-02-19T19:08:24.858 INFO:tasks.workunit.client.0.smithi046.stdout:5/320: readlink d2/dd/l49 0 2024-02-19T19:08:24.858 INFO:tasks.workunit.client.0.smithi046.stdout:5/321: creat d2/dd/f5c x:0 0 0 2024-02-19T19:08:24.860 INFO:tasks.workunit.client.0.smithi046.stdout:5/322: rename d2/d3a to d2/dd/d2f/d34/d5d 0 2024-02-19T19:08:24.861 INFO:tasks.workunit.client.0.smithi046.stdout:5/323: mkdir d2/d5e 0 2024-02-19T19:08:24.863 INFO:tasks.workunit.client.0.smithi046.stdout:5/324: mkdir d2/dd/d3f/d55/d5f 0 2024-02-19T19:08:24.863 INFO:tasks.workunit.client.0.smithi046.stdout:5/325: creat d2/d27/d47/f60 x:0 0 0 2024-02-19T19:08:24.863 INFO:tasks.workunit.client.0.smithi046.stdout:5/326: fsync d2/d27/d47/f58 0 2024-02-19T19:08:24.867 INFO:tasks.workunit.client.0.smithi046.stdout:5/327: write d2/dd/f15 [1206408,27559] 0 2024-02-19T19:08:24.868 INFO:tasks.workunit.client.0.smithi046.stdout:5/328: readlink d2/dd/l12 0 2024-02-19T19:08:24.869 INFO:tasks.workunit.client.0.smithi046.stdout:5/329: creat d2/dd/d2f/d34/d5d/f61 x:0 0 0 2024-02-19T19:08:24.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/330: rmdir d2/dd/d3f 39 2024-02-19T19:08:24.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/276: sync 2024-02-19T19:08:24.876 INFO:tasks.workunit.client.0.smithi046.stdout:3/187: sync 2024-02-19T19:08:24.876 INFO:tasks.workunit.client.0.smithi046.stdout:9/137: sync 2024-02-19T19:08:24.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/277: chown d3/d37/d1d/d3c 17999 1 2024-02-19T19:08:24.876 INFO:tasks.workunit.client.0.smithi046.stdout:9/138: fsync db/d1e/f27 0 2024-02-19T19:08:24.876 INFO:tasks.workunit.client.0.smithi046.stdout:9/139: chown db/d1e 1 1 2024-02-19T19:08:24.877 INFO:tasks.workunit.client.0.smithi046.stdout:1/287: sync 2024-02-19T19:08:24.877 INFO:tasks.workunit.client.0.smithi046.stdout:1/288: chown d5/f26 30451430 1 2024-02-19T19:08:24.879 INFO:tasks.workunit.client.0.smithi046.stdout:8/278: dread d3/dd/f58 [0,4194304] 0 2024-02-19T19:08:24.887 INFO:tasks.workunit.client.0.smithi046.stdout:5/331: dwrite d2/f3c [0,4194304] 0 2024-02-19T19:08:24.889 INFO:tasks.workunit.client.0.smithi046.stdout:5/332: mknod d2/dd/d2f/d34/c62 0 2024-02-19T19:08:24.891 INFO:tasks.workunit.client.0.smithi046.stdout:5/333: rename d2/dd/d29/d3b/f42 to d2/dd/d3f/d55/f63 0 2024-02-19T19:08:24.892 INFO:tasks.workunit.client.0.smithi046.stdout:5/334: mkdir d2/dd/d3f/d55/d64 0 2024-02-19T19:08:24.895 INFO:tasks.workunit.client.0.smithi046.stdout:9/140: dread f0 [0,4194304] 0 2024-02-19T19:08:24.895 INFO:tasks.workunit.client.0.smithi046.stdout:9/141: dread - db/f24 zero size 2024-02-19T19:08:24.896 INFO:tasks.workunit.client.0.smithi046.stdout:9/142: getdents db/d1e 0 2024-02-19T19:08:24.896 INFO:tasks.workunit.client.0.smithi046.stdout:9/143: write db/f1c [530165,50133] 0 2024-02-19T19:08:24.899 INFO:tasks.workunit.client.0.smithi046.stdout:5/335: write d2/dd/d26/f48 [6674583,34312] 0 2024-02-19T19:08:24.907 INFO:tasks.workunit.client.0.smithi046.stdout:1/289: dwrite d5/d13/f31 [0,4194304] 0 2024-02-19T19:08:24.907 INFO:tasks.workunit.client.0.smithi046.stdout:1/290: write d5/d10/d3b/f5c [797830,59677] 0 2024-02-19T19:08:24.909 INFO:tasks.workunit.client.0.smithi046.stdout:1/291: mknod d5/d13/d35/d37/c61 0 2024-02-19T19:08:24.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/279: dwrite d3/dd/d13/d42/f47 [0,4194304] 0 2024-02-19T19:08:24.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/280: readlink d3/l8 0 2024-02-19T19:08:24.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/281: readlink d3/dd/d1c/d36/l63 0 2024-02-19T19:08:24.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/282: fsync d3/f10 0 2024-02-19T19:08:24.910 INFO:tasks.workunit.client.0.smithi046.stdout:1/292: creat d5/d2f/d5e/f62 x:0 0 0 2024-02-19T19:08:24.910 INFO:tasks.workunit.client.0.smithi046.stdout:1/293: readlink d5/d10/d3b/d4e/l4a 0 2024-02-19T19:08:24.913 INFO:tasks.workunit.client.0.smithi046.stdout:1/294: creat d5/d10/d55/f63 x:0 0 0 2024-02-19T19:08:24.914 INFO:tasks.workunit.client.0.smithi046.stdout:9/144: dwrite db/f18 [0,4194304] 0 2024-02-19T19:08:24.915 INFO:tasks.workunit.client.0.smithi046.stdout:1/295: mkdir d5/d13/d35/d37/d64 0 2024-02-19T19:08:24.915 INFO:tasks.workunit.client.0.smithi046.stdout:1/296: readlink d5/d10/l1d 0 2024-02-19T19:08:24.916 INFO:tasks.workunit.client.0.smithi046.stdout:5/336: rename d2/dd/d3f/d55 to d2/dd/d26/d65 0 2024-02-19T19:08:24.919 INFO:tasks.workunit.client.0.smithi046.stdout:1/297: rename d5/d10/c3d to d5/d13/d35/c65 0 2024-02-19T19:08:24.921 INFO:tasks.workunit.client.0.smithi046.stdout:1/298: creat d5/d13/d35/d37/f66 x:0 0 0 2024-02-19T19:08:24.923 INFO:tasks.workunit.client.0.smithi046.stdout:1/299: getdents d5/d10/d3b/d4e 0 2024-02-19T19:08:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:8/283: dread d3/d18/f1e [0,4194304] 0 2024-02-19T19:08:24.924 INFO:tasks.workunit.client.0.smithi046.stdout:1/300: symlink d5/d13/d35/d37/d64/l67 0 2024-02-19T19:08:24.935 INFO:tasks.workunit.client.0.smithi046.stdout:1/301: read d5/f17 [1453441,130778] 0 2024-02-19T19:08:24.936 INFO:tasks.workunit.client.0.smithi046.stdout:1/302: mknod d5/d21/c68 0 2024-02-19T19:08:24.951 INFO:tasks.workunit.client.0.smithi046.stdout:9/145: dwrite db/f17 [0,4194304] 0 2024-02-19T19:08:24.960 INFO:tasks.workunit.client.0.smithi046.stdout:5/337: dwrite d2/dd/d2f/d34/f3e [0,4194304] 0 2024-02-19T19:08:24.960 INFO:tasks.workunit.client.0.smithi046.stdout:8/284: dwrite d3/dd/d13/f1b [0,4194304] 0 2024-02-19T19:08:24.961 INFO:tasks.workunit.client.0.smithi046.stdout:1/303: dwrite d5/d21/f34 [4194304,4194304] 0 2024-02-19T19:08:24.963 INFO:tasks.workunit.client.0.smithi046.stdout:5/338: mknod d2/d27/c66 0 2024-02-19T19:08:24.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/304: creat d5/d21/f69 x:0 0 0 2024-02-19T19:08:24.968 INFO:tasks.workunit.client.0.smithi046.stdout:8/285: dread d3/f44 [0,4194304] 0 2024-02-19T19:08:24.969 INFO:tasks.workunit.client.0.smithi046.stdout:5/339: rename d2/dd/d29/l33 to d2/d27/d47/l67 0 2024-02-19T19:08:24.969 INFO:tasks.workunit.client.0.smithi046.stdout:5/340: stat d2/dd/d29/c30 0 2024-02-19T19:08:24.969 INFO:tasks.workunit.client.0.smithi046.stdout:5/341: dread - d2/dd/d2f/d34/d5d/f61 zero size 2024-02-19T19:08:24.969 INFO:tasks.workunit.client.0.smithi046.stdout:1/305: mkdir d5/d2f/d5e/d6a 0 2024-02-19T19:08:24.970 INFO:tasks.workunit.client.0.smithi046.stdout:1/306: stat d5/d10/d3b 0 2024-02-19T19:08:24.972 INFO:tasks.workunit.client.0.smithi046.stdout:5/342: link d2/dd/d2f/d34/c62 d2/d27/d47/c68 0 2024-02-19T19:08:24.972 INFO:tasks.workunit.client.0.smithi046.stdout:9/146: truncate db/f17 2981742 0 2024-02-19T19:08:24.972 INFO:tasks.workunit.client.0.smithi046.stdout:9/147: truncate db/d1e/f26 533677 0 2024-02-19T19:08:24.977 INFO:tasks.workunit.client.0.smithi046.stdout:1/307: dread d5/d13/f19 [0,4194304] 0 2024-02-19T19:08:24.979 INFO:tasks.workunit.client.0.smithi046.stdout:1/308: creat d5/d13/d35/d37/d64/f6b x:0 0 0 2024-02-19T19:08:24.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/343: dread d2/f3c [0,4194304] 0 2024-02-19T19:08:24.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/344: truncate d2/dd/f37 75330 0 2024-02-19T19:08:24.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/345: dread - d2/d27/f53 zero size 2024-02-19T19:08:24.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/346: write d2/f4a [809680,76205] 0 2024-02-19T19:08:24.984 INFO:tasks.workunit.client.0.smithi046.stdout:9/148: dread f0 [4194304,4194304] 0 2024-02-19T19:08:24.985 INFO:tasks.workunit.client.0.smithi046.stdout:8/286: dwrite d3/f44 [0,4194304] 0 2024-02-19T19:08:24.986 INFO:tasks.workunit.client.0.smithi046.stdout:5/347: rename d2/dd/c32 to d2/d27/d47/d54/d57/c69 0 2024-02-19T19:08:24.986 INFO:tasks.workunit.client.0.smithi046.stdout:5/348: dread - d2/dd/d2f/d34/d5d/f61 zero size 2024-02-19T19:08:24.987 INFO:tasks.workunit.client.0.smithi046.stdout:9/149: truncate db/f18 2926331 0 2024-02-19T19:08:24.990 INFO:tasks.workunit.client.0.smithi046.stdout:8/287: mknod d3/d18/c67 0 2024-02-19T19:08:24.991 INFO:tasks.workunit.client.0.smithi046.stdout:8/288: rmdir d3/dd/d13/d42 39 2024-02-19T19:08:24.993 INFO:tasks.workunit.client.0.smithi046.stdout:8/289: symlink d3/dd/d1c/l68 0 2024-02-19T19:08:24.993 INFO:tasks.workunit.client.0.smithi046.stdout:8/290: fdatasync d3/f9 0 2024-02-19T19:08:24.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/309: dread d5/f26 [4194304,4194304] 0 2024-02-19T19:08:24.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/310: dread - d5/d21/f69 zero size 2024-02-19T19:08:24.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/311: creat d5/d13/d35/d37/f6c x:0 0 0 2024-02-19T19:08:24.996 INFO:tasks.workunit.client.0.smithi046.stdout:5/349: dread d2/dd/d2f/d34/d5d/f43 [0,4194304] 0 2024-02-19T19:08:24.996 INFO:tasks.workunit.client.0.smithi046.stdout:8/291: link d3/f9 d3/dd/d13/d42/f69 0 2024-02-19T19:08:24.996 INFO:tasks.workunit.client.0.smithi046.stdout:8/292: fdatasync d3/d37/d1d/d3c/f41 0 2024-02-19T19:08:25.001 INFO:tasks.workunit.client.0.smithi046.stdout:8/293: write d3/d18/f1e [1541654,85586] 0 2024-02-19T19:08:25.001 INFO:tasks.workunit.client.0.smithi046.stdout:8/294: write d3/dd/f15 [2294761,17091] 0 2024-02-19T19:08:25.003 INFO:tasks.workunit.client.0.smithi046.stdout:5/350: unlink d2/d27/d47/f58 0 2024-02-19T19:08:25.003 INFO:tasks.workunit.client.0.smithi046.stdout:5/351: read d2/f16 [920158,13206] 0 2024-02-19T19:08:25.003 INFO:tasks.workunit.client.0.smithi046.stdout:5/352: chown d2/dd/d29 3 1 2024-02-19T19:08:25.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/353: mknod d2/d27/d47/c6a 0 2024-02-19T19:08:25.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/354: truncate d2/dd/d2f/d34/d5d/f61 98648 0 2024-02-19T19:08:25.006 INFO:tasks.workunit.client.0.smithi046.stdout:8/295: getdents d3 0 2024-02-19T19:08:25.007 INFO:tasks.workunit.client.0.smithi046.stdout:8/296: mkdir d3/dd/d1c/d46/d6a 0 2024-02-19T19:08:25.014 INFO:tasks.workunit.client.0.smithi046.stdout:9/150: dwrite f0 [4194304,4194304] 0 2024-02-19T19:08:25.015 INFO:tasks.workunit.client.0.smithi046.stdout:9/151: stat db/f24 0 2024-02-19T19:08:25.015 INFO:tasks.workunit.client.0.smithi046.stdout:9/152: fsync db/f18 0 2024-02-19T19:08:25.015 INFO:tasks.workunit.client.0.smithi046.stdout:9/153: chown db/c12 78 1 2024-02-19T19:08:25.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/312: dwrite d5/d10/d2d/f59 [0,4194304] 0 2024-02-19T19:08:25.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/313: truncate d5/d2f/d5e/f62 558836 0 2024-02-19T19:08:25.022 INFO:tasks.workunit.client.0.smithi046.stdout:8/297: dread d3/dd/d1c/f48 [0,4194304] 0 2024-02-19T19:08:25.024 INFO:tasks.workunit.client.0.smithi046.stdout:8/298: rmdir d3/d37/d1d/d59 0 2024-02-19T19:08:25.025 INFO:tasks.workunit.client.0.smithi046.stdout:1/314: dwrite d5/d13/d35/f41 [0,4194304] 0 2024-02-19T19:08:25.033 INFO:tasks.workunit.client.0.smithi046.stdout:2/182: sync 2024-02-19T19:08:25.033 INFO:tasks.workunit.client.0.smithi046.stdout:2/183: mknod d5/d2c/c32 0 2024-02-19T19:08:25.036 INFO:tasks.workunit.client.0.smithi046.stdout:9/154: dread f7 [4194304,4194304] 0 2024-02-19T19:08:25.037 INFO:tasks.workunit.client.0.smithi046.stdout:9/155: symlink db/d1e/l29 0 2024-02-19T19:08:25.037 INFO:tasks.workunit.client.0.smithi046.stdout:1/315: dread d5/f1f [0,4194304] 0 2024-02-19T19:08:25.037 INFO:tasks.workunit.client.0.smithi046.stdout:9/156: mkdir db/d2a 0 2024-02-19T19:08:25.039 INFO:tasks.workunit.client.0.smithi046.stdout:1/316: mknod d5/d21/c6d 0 2024-02-19T19:08:25.039 INFO:tasks.workunit.client.0.smithi046.stdout:1/317: write d5/d2f/d5e/f62 [1314594,68339] 0 2024-02-19T19:08:25.040 INFO:tasks.workunit.client.0.smithi046.stdout:1/318: creat d5/d10/d3b/d4e/f6e x:0 0 0 2024-02-19T19:08:25.043 INFO:tasks.workunit.client.0.smithi046.stdout:1/319: rename d5/d10/d3b/d4e/c4c to d5/d13/c6f 0 2024-02-19T19:08:25.056 INFO:tasks.workunit.client.0.smithi046.stdout:1/320: rmdir d5/d10/d3b/d4e 39 2024-02-19T19:08:25.056 INFO:tasks.workunit.client.0.smithi046.stdout:1/321: write d5/f5b [1217106,5942] 0 2024-02-19T19:08:25.056 INFO:tasks.workunit.client.0.smithi046.stdout:1/322: write d5/d10/d2d/f5d [289811,112958] 0 2024-02-19T19:08:25.057 INFO:tasks.workunit.client.0.smithi046.stdout:2/184: dwrite d5/d6/f7 [0,4194304] 0 2024-02-19T19:08:25.057 INFO:tasks.workunit.client.0.smithi046.stdout:2/185: readlink d5/l17 0 2024-02-19T19:08:25.057 INFO:tasks.workunit.client.0.smithi046.stdout:9/157: dwrite f7 [0,4194304] 0 2024-02-19T19:08:25.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/299: dwrite d3/f3a [0,4194304] 0 2024-02-19T19:08:25.065 INFO:tasks.workunit.client.0.smithi046.stdout:2/186: getdents d5/d2c 0 2024-02-19T19:08:25.069 INFO:tasks.workunit.client.0.smithi046.stdout:8/300: rename d3/dd/d1c to d3/dd/d13/d6b 0 2024-02-19T19:08:25.070 INFO:tasks.workunit.client.0.smithi046.stdout:8/301: creat d3/d37/d64/f6c x:0 0 0 2024-02-19T19:08:25.072 INFO:tasks.workunit.client.0.smithi046.stdout:8/302: rename d3/f51 to d3/dd/d3f/d49/d5b/f6d 0 2024-02-19T19:08:25.073 INFO:tasks.workunit.client.0.smithi046.stdout:8/303: symlink d3/d37/d64/l6e 0 2024-02-19T19:08:25.074 INFO:tasks.workunit.client.0.smithi046.stdout:9/158: dwrite db/f18 [0,4194304] 0 2024-02-19T19:08:25.074 INFO:tasks.workunit.client.0.smithi046.stdout:9/159: write db/d1e/f22 [1621015,72195] 0 2024-02-19T19:08:25.074 INFO:tasks.workunit.client.0.smithi046.stdout:9/160: fsync f2 0 2024-02-19T19:08:25.077 INFO:tasks.workunit.client.0.smithi046.stdout:9/161: rmdir db/d2a 0 2024-02-19T19:08:25.079 INFO:tasks.workunit.client.0.smithi046.stdout:8/304: dread d3/dd/fe [0,4194304] 0 2024-02-19T19:08:25.079 INFO:tasks.workunit.client.0.smithi046.stdout:9/162: rename db/d1e/l23 to db/d1e/l2b 0 2024-02-19T19:08:25.079 INFO:tasks.workunit.client.0.smithi046.stdout:9/163: fdatasync db/d1e/f27 0 2024-02-19T19:08:25.081 INFO:tasks.workunit.client.0.smithi046.stdout:8/305: write d3/dd/d3f/d49/d5b/f6d [653727,47170] 0 2024-02-19T19:08:25.091 INFO:tasks.workunit.client.0.smithi046.stdout:2/187: dwrite d5/d6/fa [0,4194304] 0 2024-02-19T19:08:25.092 INFO:tasks.workunit.client.0.smithi046.stdout:2/188: chown d5/d6/c15 53587259 1 2024-02-19T19:08:25.093 INFO:tasks.workunit.client.0.smithi046.stdout:2/189: rename d5/df/c19 to d5/d2c/c33 0 2024-02-19T19:08:25.094 INFO:tasks.workunit.client.0.smithi046.stdout:2/190: write d5/df/f1a [149939,23652] 0 2024-02-19T19:08:25.097 INFO:tasks.workunit.client.0.smithi046.stdout:2/191: link d5/d6/d13/l25 d5/df/l34 0 2024-02-19T19:08:25.097 INFO:tasks.workunit.client.0.smithi046.stdout:2/192: chown d5/d6/d13/f16 1880540 1 2024-02-19T19:08:25.105 INFO:tasks.workunit.client.0.smithi046.stdout:8/306: dwrite d3/dd/d13/d6b/d46/d54/f61 [0,4194304] 0 2024-02-19T19:08:25.120 INFO:tasks.workunit.client.0.smithi046.stdout:2/193: dwrite d5/df/f28 [0,4194304] 0 2024-02-19T19:08:25.122 INFO:tasks.workunit.client.0.smithi046.stdout:2/194: mkdir d5/d2c/d35 0 2024-02-19T19:08:25.124 INFO:tasks.workunit.client.0.smithi046.stdout:2/195: creat d5/d6/d13/f36 x:0 0 0 2024-02-19T19:08:25.124 INFO:tasks.workunit.client.0.smithi046.stdout:2/196: write d5/d6/f7 [4235512,26339] 0 2024-02-19T19:08:25.126 INFO:tasks.workunit.client.0.smithi046.stdout:2/197: creat d5/df/f37 x:0 0 0 2024-02-19T19:08:25.129 INFO:tasks.workunit.client.0.smithi046.stdout:2/198: rename d5/d6/d13/f36 to d5/f38 0 2024-02-19T19:08:25.153 INFO:tasks.workunit.client.0.smithi046.stdout:2/199: dwrite d5/df/f28 [0,4194304] 0 2024-02-19T19:08:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:2/200: dread d5/df/f28 [0,4194304] 0 2024-02-19T19:08:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:2/201: symlink d5/d6/l39 0 2024-02-19T19:08:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:2/202: fdatasync d5/df/f1a 0 2024-02-19T19:08:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:2/203: read - d5/d6/d13/f16 zero size 2024-02-19T19:08:25.185 INFO:tasks.workunit.client.0.smithi046.stdout:2/204: dwrite d5/f2a [0,4194304] 0 2024-02-19T19:08:25.186 INFO:tasks.workunit.client.0.smithi046.stdout:2/205: symlink d5/d2c/l3a 0 2024-02-19T19:08:25.187 INFO:tasks.workunit.client.0.smithi046.stdout:2/206: symlink d5/d6/l3b 0 2024-02-19T19:08:25.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/207: creat d5/d2c/f3c x:0 0 0 2024-02-19T19:08:25.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/208: chown d5/d2c/d35 639254866 1 2024-02-19T19:08:25.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/209: mkdir d5/df/d3d 0 2024-02-19T19:08:25.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/210: getdents d5/d2c/d35 0 2024-02-19T19:08:25.190 INFO:tasks.workunit.client.0.smithi046.stdout:2/211: symlink d5/d6/l3e 0 2024-02-19T19:08:25.191 INFO:tasks.workunit.client.0.smithi046.stdout:2/212: mkdir d5/df/d3f 0 2024-02-19T19:08:25.192 INFO:tasks.workunit.client.0.smithi046.stdout:2/213: rename d5/d6/f2f to d5/df/f40 0 2024-02-19T19:08:25.194 INFO:tasks.workunit.client.0.smithi046.stdout:3/188: sync 2024-02-19T19:08:25.194 INFO:tasks.workunit.client.0.smithi046.stdout:7/398: sync 2024-02-19T19:08:25.194 INFO:tasks.workunit.client.0.smithi046.stdout:4/262: sync 2024-02-19T19:08:25.194 INFO:tasks.workunit.client.0.smithi046.stdout:6/216: sync 2024-02-19T19:08:25.194 INFO:tasks.workunit.client.0.smithi046.stdout:3/189: readlink da/d1d/l22 0 2024-02-19T19:08:25.194 INFO:tasks.workunit.client.0.smithi046.stdout:0/296: sync 2024-02-19T19:08:25.195 INFO:tasks.workunit.client.0.smithi046.stdout:3/190: mknod da/c2d 0 2024-02-19T19:08:25.195 INFO:tasks.workunit.client.0.smithi046.stdout:2/214: dread d5/df/f1a [0,4194304] 0 2024-02-19T19:08:25.195 INFO:tasks.workunit.client.0.smithi046.stdout:3/191: write da/d1d/d10/f1b [3522491,429] 0 2024-02-19T19:08:25.195 INFO:tasks.workunit.client.0.smithi046.stdout:3/192: dread - da/d1d/d10/f2b zero size 2024-02-19T19:08:25.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/217: rename d4/d6/dd/f17 to d4/d6/dd/d10/d29/d2d/f47 0 2024-02-19T19:08:25.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/218: chown d4/d6/dd/d10/d29 1703200 1 2024-02-19T19:08:25.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/219: creat d4/d6/dd/d10/d29/f48 x:0 0 0 2024-02-19T19:08:25.196 INFO:tasks.workunit.client.0.smithi046.stdout:0/297: truncate d0/f2 2417666 0 2024-02-19T19:08:25.197 INFO:tasks.workunit.client.0.smithi046.stdout:3/193: truncate da/f15 564201 0 2024-02-19T19:08:25.198 INFO:tasks.workunit.client.0.smithi046.stdout:3/194: creat da/d1d/d10/f2e x:0 0 0 2024-02-19T19:08:25.199 INFO:tasks.workunit.client.0.smithi046.stdout:6/220: creat d4/d6/dd/d10/d29/d2d/f49 x:0 0 0 2024-02-19T19:08:25.201 INFO:tasks.workunit.client.0.smithi046.stdout:0/298: creat d0/d24/d2f/d53/d6b/f6e x:0 0 0 2024-02-19T19:08:25.201 INFO:tasks.workunit.client.0.smithi046.stdout:0/299: chown d0/d19/db/c12 14 1 2024-02-19T19:08:25.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:24 smithi142 ceph-mon[69118]: pgmap v117: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 505 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31 MiB/s rd, 41 MiB/s wr, 895 op/s; 7067/45129 objects degraded (15.660%) 2024-02-19T19:08:25.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:24 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 7067/45129 objects degraded (15.660%), 28 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:25.202 INFO:tasks.workunit.client.0.smithi046.stdout:3/195: symlink da/l2f 0 2024-02-19T19:08:25.203 INFO:tasks.workunit.client.0.smithi046.stdout:6/221: creat d4/d6/dd/d10/d29/d2d/d35/d3c/f4a x:0 0 0 2024-02-19T19:08:25.205 INFO:tasks.workunit.client.0.smithi046.stdout:0/300: unlink d0/d5f/l62 0 2024-02-19T19:08:25.205 INFO:tasks.workunit.client.0.smithi046.stdout:6/222: creat d4/d6/dd/d10/f4b x:0 0 0 2024-02-19T19:08:25.207 INFO:tasks.workunit.client.0.smithi046.stdout:0/301: rename d0/d19/db/c12 to d0/d24/d5b/c6f 0 2024-02-19T19:08:25.209 INFO:tasks.workunit.client.0.smithi046.stdout:0/302: mkdir d0/d19/d70 0 2024-02-19T19:08:25.209 INFO:tasks.workunit.client.0.smithi046.stdout:0/303: stat d0/d19/f6 0 2024-02-19T19:08:25.211 INFO:tasks.workunit.client.0.smithi046.stdout:0/304: truncate d0/f4e 18688 0 2024-02-19T19:08:25.211 INFO:tasks.workunit.client.0.smithi046.stdout:0/305: chown d0/d19/db/f50 1330759532 1 2024-02-19T19:08:25.211 INFO:tasks.workunit.client.0.smithi046.stdout:4/263: dwrite d6/d15/d17/d1e/f2a [0,4194304] 0 2024-02-19T19:08:25.212 INFO:tasks.workunit.client.0.smithi046.stdout:0/306: truncate d0/d24/f3b 337309 0 2024-02-19T19:08:25.215 INFO:tasks.workunit.client.0.smithi046.stdout:4/264: link d6/d15/f48 d6/d15/d17/d1e/d33/d55/f5d 0 2024-02-19T19:08:25.222 INFO:tasks.workunit.client.0.smithi046.stdout:7/399: dwrite d0/d45/d71/f5b [0,4194304] 0 2024-02-19T19:08:25.222 INFO:tasks.workunit.client.0.smithi046.stdout:7/400: readlink d0/d4/d68/l69 0 2024-02-19T19:08:25.230 INFO:tasks.workunit.client.0.smithi046.stdout:0/307: rmdir d0/d19 39 2024-02-19T19:08:25.231 INFO:tasks.workunit.client.0.smithi046.stdout:0/308: fsync d0/d24/f3b 0 2024-02-19T19:08:25.231 INFO:tasks.workunit.client.0.smithi046.stdout:0/309: truncate d0/f5c 776779 0 2024-02-19T19:08:25.233 INFO:tasks.workunit.client.0.smithi046.stdout:0/310: link d0/f1b d0/d5f/d65/f71 0 2024-02-19T19:08:25.233 INFO:tasks.workunit.client.0.smithi046.stdout:4/265: dwrite d6/fb [0,4194304] 0 2024-02-19T19:08:25.234 INFO:tasks.workunit.client.0.smithi046.stdout:0/311: symlink d0/d6c/l72 0 2024-02-19T19:08:25.234 INFO:tasks.workunit.client.0.smithi046.stdout:0/312: creat d0/d5f/f73 x:0 0 0 2024-02-19T19:08:25.234 INFO:tasks.workunit.client.0.smithi046.stdout:0/313: chown d0/f3c 8050 1 2024-02-19T19:08:25.234 INFO:tasks.workunit.client.0.smithi046.stdout:2/215: dwrite d5/f2a [12582912,4194304] 0 2024-02-19T19:08:25.234 INFO:tasks.workunit.client.0.smithi046.stdout:2/216: stat d5/df/l12 0 2024-02-19T19:08:25.236 INFO:tasks.workunit.client.0.smithi046.stdout:0/314: read d0/f1b [492578,117930] 0 2024-02-19T19:08:25.236 INFO:tasks.workunit.client.0.smithi046.stdout:0/315: write d0/d19/f2d [469059,123560] 0 2024-02-19T19:08:25.237 INFO:tasks.workunit.client.0.smithi046.stdout:0/316: getdents d0/d24/d56 0 2024-02-19T19:08:25.237 INFO:tasks.workunit.client.0.smithi046.stdout:6/223: dwrite d4/d6/fe [0,4194304] 0 2024-02-19T19:08:25.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/401: dwrite d0/d45/d71/d4b/f61 [0,4194304] 0 2024-02-19T19:08:25.242 INFO:tasks.workunit.client.0.smithi046.stdout:0/317: mkdir d0/d5f/d74 0 2024-02-19T19:08:25.242 INFO:tasks.workunit.client.0.smithi046.stdout:0/318: chown d0/d19/f6 0 1 2024-02-19T19:08:25.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/319: dread - d0/d19/db/d27/f66 zero size 2024-02-19T19:08:25.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/320: truncate d0/d24/d2f/d53/f61 857101 0 2024-02-19T19:08:25.245 INFO:tasks.workunit.client.0.smithi046.stdout:7/402: mknod d0/d45/d71/c7d 0 2024-02-19T19:08:25.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/266: dwrite d6/d15/f5c [0,4194304] 0 2024-02-19T19:08:25.246 INFO:tasks.workunit.client.0.smithi046.stdout:4/267: fsync d6/d15/d17/f3f 0 2024-02-19T19:08:25.246 INFO:tasks.workunit.client.0.smithi046.stdout:0/321: symlink d0/d19/db/d27/l75 0 2024-02-19T19:08:25.246 INFO:tasks.workunit.client.0.smithi046.stdout:6/224: getdents d4/d6/dd/d10/d29 0 2024-02-19T19:08:25.248 INFO:tasks.workunit.client.0.smithi046.stdout:4/268: unlink d6/d15/d17/d1e/c4f 0 2024-02-19T19:08:25.249 INFO:tasks.workunit.client.0.smithi046.stdout:0/322: mkdir d0/d76 0 2024-02-19T19:08:25.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/225: rename d4/d6/dd/f11 to d4/d6/f4c 0 2024-02-19T19:08:25.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/226: chown d4/f19 77085403 1 2024-02-19T19:08:25.253 INFO:tasks.workunit.client.0.smithi046.stdout:7/403: dread d0/f18 [0,4194304] 0 2024-02-19T19:08:25.253 INFO:tasks.workunit.client.0.smithi046.stdout:0/323: fdatasync d0/d19/f2d 0 2024-02-19T19:08:25.253 INFO:tasks.workunit.client.0.smithi046.stdout:0/324: readlink d0/d24/d2f/l5e 0 2024-02-19T19:08:25.253 INFO:tasks.workunit.client.0.smithi046.stdout:6/227: creat d4/d6/d1c/d20/f4d x:0 0 0 2024-02-19T19:08:25.253 INFO:tasks.workunit.client.0.smithi046.stdout:6/228: chown d4/d6/d22/c2e 485766 1 2024-02-19T19:08:25.254 INFO:tasks.workunit.client.0.smithi046.stdout:4/269: dread d6/d11/f35 [0,4194304] 0 2024-02-19T19:08:25.254 INFO:tasks.workunit.client.0.smithi046.stdout:0/325: symlink d0/d5f/l77 0 2024-02-19T19:08:25.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/404: dread d0/d4/f3b [0,4194304] 0 2024-02-19T19:08:25.255 INFO:tasks.workunit.client.0.smithi046.stdout:6/229: mknod d4/d6/d1c/c4e 0 2024-02-19T19:08:25.256 INFO:tasks.workunit.client.0.smithi046.stdout:4/270: rename d6/l1d to d6/d15/d17/d1e/d33/l5e 0 2024-02-19T19:08:25.257 INFO:tasks.workunit.client.0.smithi046.stdout:4/271: write d6/d15/d17/f41 [3066365,53952] 0 2024-02-19T19:08:25.257 INFO:tasks.workunit.client.0.smithi046.stdout:4/272: read d6/f9 [567570,89738] 0 2024-02-19T19:08:25.257 INFO:tasks.workunit.client.0.smithi046.stdout:0/326: symlink d0/d24/d5b/l78 0 2024-02-19T19:08:25.259 INFO:tasks.workunit.client.0.smithi046.stdout:6/230: rename d4/d6/dd/d10/f38 to d4/d6/dd/d10/d29/d2d/d35/f4f 0 2024-02-19T19:08:25.260 INFO:tasks.workunit.client.0.smithi046.stdout:4/273: mknod d6/c5f 0 2024-02-19T19:08:25.260 INFO:tasks.workunit.client.0.smithi046.stdout:4/274: fdatasync d6/d15/d17/d1e/d33/d55/f5d 0 2024-02-19T19:08:25.260 INFO:tasks.workunit.client.0.smithi046.stdout:4/275: fsync d6/f9 0 2024-02-19T19:08:25.261 INFO:tasks.workunit.client.0.smithi046.stdout:6/231: link d4/d6/dd/d10/d29/d2d/c3d d4/d6/dd/d10/c50 0 2024-02-19T19:08:25.269 INFO:tasks.workunit.client.0.smithi046.stdout:6/232: write d4/d6/fe [1857335,85621] 0 2024-02-19T19:08:25.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/276: dread d6/f9 [0,4194304] 0 2024-02-19T19:08:25.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/277: write d6/d11/d26/f34 [2507098,120601] 0 2024-02-19T19:08:25.270 INFO:tasks.workunit.client.0.smithi046.stdout:7/405: dwrite d0/d4/d24/f7a [0,4194304] 0 2024-02-19T19:08:25.271 INFO:tasks.workunit.client.0.smithi046.stdout:6/233: creat d4/d6/d1c/f51 x:0 0 0 2024-02-19T19:08:25.271 INFO:tasks.workunit.client.0.smithi046.stdout:6/234: dread - d4/d6/f30 zero size 2024-02-19T19:08:25.271 INFO:tasks.workunit.client.0.smithi046.stdout:6/235: stat d4/d6/d22/c2e 0 2024-02-19T19:08:25.271 INFO:tasks.workunit.client.0.smithi046.stdout:6/236: dread - d4/d6/dd/d10/d29/f48 zero size 2024-02-19T19:08:25.273 INFO:tasks.workunit.client.0.smithi046.stdout:7/406: mknod d0/d45/d4a/d78/c7e 0 2024-02-19T19:08:25.274 INFO:tasks.workunit.client.0.smithi046.stdout:6/237: rename d4/d6/dd/d10/d29/l45 to d4/l52 0 2024-02-19T19:08:25.279 INFO:tasks.workunit.client.0.smithi046.stdout:0/327: dwrite d0/f45 [0,4194304] 0 2024-02-19T19:08:25.281 INFO:tasks.workunit.client.0.smithi046.stdout:7/407: read d0/d45/d71/d4b/f61 [3104989,8782] 0 2024-02-19T19:08:25.282 INFO:tasks.workunit.client.0.smithi046.stdout:7/408: dread - d0/d45/d4a/d58/f42 zero size 2024-02-19T19:08:25.282 INFO:tasks.workunit.client.0.smithi046.stdout:7/409: truncate d0/f48 1237040 0 2024-02-19T19:08:25.283 INFO:tasks.workunit.client.0.smithi046.stdout:7/410: mknod d0/d45/d71/c7f 0 2024-02-19T19:08:25.284 INFO:tasks.workunit.client.0.smithi046.stdout:7/411: mknod d0/d45/c80 0 2024-02-19T19:08:25.285 INFO:tasks.workunit.client.0.smithi046.stdout:7/412: read - d0/d45/d4a/d58/d60/f67 zero size 2024-02-19T19:08:25.286 INFO:tasks.workunit.client.0.smithi046.stdout:7/413: mknod d0/d45/d71/d4b/c81 0 2024-02-19T19:08:25.288 INFO:tasks.workunit.client.0.smithi046.stdout:7/414: link d0/d45/d4a/d58/l31 d0/d4/dd/d62/l82 0 2024-02-19T19:08:25.288 INFO:tasks.workunit.client.0.smithi046.stdout:7/415: fsync d0/d45/d71/d41/f6d 0 2024-02-19T19:08:25.289 INFO:tasks.workunit.client.0.smithi046.stdout:7/416: dread d0/ff [0,4194304] 0 2024-02-19T19:08:25.289 INFO:tasks.workunit.client.0.smithi046.stdout:7/417: write d0/ff [148516,27073] 0 2024-02-19T19:08:25.291 INFO:tasks.workunit.client.0.smithi046.stdout:6/238: dwrite d4/d6/dd/d10/f15 [4194304,4194304] 0 2024-02-19T19:08:25.291 INFO:tasks.workunit.client.0.smithi046.stdout:6/239: read - d4/d6/dd/d10/f4b zero size 2024-02-19T19:08:25.291 INFO:tasks.workunit.client.0.smithi046.stdout:6/240: fsync d4/d6/dd/f44 0 2024-02-19T19:08:25.293 INFO:tasks.workunit.client.0.smithi046.stdout:6/241: symlink d4/d6/dd/l53 0 2024-02-19T19:08:25.293 INFO:tasks.workunit.client.0.smithi046.stdout:6/242: write d4/d6/fe [3065117,66632] 0 2024-02-19T19:08:25.293 INFO:tasks.workunit.client.0.smithi046.stdout:6/243: dread - d4/f39 zero size 2024-02-19T19:08:25.293 INFO:tasks.workunit.client.0.smithi046.stdout:6/244: truncate d4/d6/dd/d10/d29/f36 5067613 0 2024-02-19T19:08:25.294 INFO:tasks.workunit.client.0.smithi046.stdout:6/245: symlink d4/d6/dd/d10/l54 0 2024-02-19T19:08:25.294 INFO:tasks.workunit.client.0.smithi046.stdout:6/246: stat d4/d6/dd/d10/f13 0 2024-02-19T19:08:25.295 INFO:tasks.workunit.client.0.smithi046.stdout:6/247: creat d4/d6/dd/d10/d29/d2d/d35/d3c/f55 x:0 0 0 2024-02-19T19:08:25.310 INFO:tasks.workunit.client.0.smithi046.stdout:6/248: dwrite d4/d6/f3b [0,4194304] 0 2024-02-19T19:08:25.310 INFO:tasks.workunit.client.0.smithi046.stdout:6/249: fsync d4/d6/dd/d10/d29/f36 0 2024-02-19T19:08:25.312 INFO:tasks.workunit.client.0.smithi046.stdout:7/418: dwrite d0/d45/d71/d41/d5f/f76 [0,4194304] 0 2024-02-19T19:08:25.322 INFO:tasks.workunit.client.0.smithi046.stdout:7/419: read d0/d45/d71/d41/d5f/f76 [2892841,89974] 0 2024-02-19T19:08:25.322 INFO:tasks.workunit.client.0.smithi046.stdout:6/250: dwrite d4/d6/dd/d10/d29/f48 [0,4194304] 0 2024-02-19T19:08:25.323 INFO:tasks.workunit.client.0.smithi046.stdout:7/420: mkdir d0/d4/d75/d83 0 2024-02-19T19:08:25.325 INFO:tasks.workunit.client.0.smithi046.stdout:7/421: truncate d0/d4/f29 2338646 0 2024-02-19T19:08:25.327 INFO:tasks.workunit.client.0.smithi046.stdout:1/323: sync 2024-02-19T19:08:25.327 INFO:tasks.workunit.client.0.smithi046.stdout:5/355: sync 2024-02-19T19:08:25.328 INFO:tasks.workunit.client.0.smithi046.stdout:1/324: truncate d5/d13/f19 1777038 0 2024-02-19T19:08:25.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/422: write d0/d45/d71/f5b [2826610,44047] 0 2024-02-19T19:08:25.330 INFO:tasks.workunit.client.0.smithi046.stdout:5/356: symlink d2/dd/d3f/l6b 0 2024-02-19T19:08:25.330 INFO:tasks.workunit.client.0.smithi046.stdout:5/357: mknod d2/dd/d2f/d34/d5d/c6c 0 2024-02-19T19:08:25.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:24 smithi046 ceph-mon[88928]: pgmap v117: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 505 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31 MiB/s rd, 41 MiB/s wr, 895 op/s; 7067/45129 objects degraded (15.660%) 2024-02-19T19:08:25.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:24 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 7067/45129 objects degraded (15.660%), 28 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:25.332 INFO:tasks.workunit.client.0.smithi046.stdout:5/358: creat d2/d5e/f6d x:0 0 0 2024-02-19T19:08:25.332 INFO:tasks.workunit.client.0.smithi046.stdout:5/359: symlink d2/dd/d26/d65/l6e 0 2024-02-19T19:08:25.332 INFO:tasks.workunit.client.0.smithi046.stdout:5/360: fsync d2/f5 0 2024-02-19T19:08:25.333 INFO:tasks.workunit.client.0.smithi046.stdout:6/251: dread d4/d6/fe [0,4194304] 0 2024-02-19T19:08:25.333 INFO:tasks.workunit.client.0.smithi046.stdout:6/252: chown d4/d6/d22/c2e 27977532 1 2024-02-19T19:08:25.341 INFO:tasks.workunit.client.0.smithi046.stdout:5/361: dread d2/dd/f20 [0,4194304] 0 2024-02-19T19:08:25.345 INFO:tasks.workunit.client.0.smithi046.stdout:7/423: read d0/d45/d4a/f4e [3857936,117560] 0 2024-02-19T19:08:25.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/325: dwrite d5/d21/f34 [8388608,4194304] 0 2024-02-19T19:08:25.346 INFO:tasks.workunit.client.0.smithi046.stdout:1/326: creat d5/d13/f70 x:0 0 0 2024-02-19T19:08:25.348 INFO:tasks.workunit.client.0.smithi046.stdout:1/327: rmdir d5/d2f/d5e 39 2024-02-19T19:08:25.350 INFO:tasks.workunit.client.0.smithi046.stdout:1/328: creat d5/d13/d35/f71 x:0 0 0 2024-02-19T19:08:25.352 INFO:tasks.workunit.client.0.smithi046.stdout:1/329: truncate d5/d21/f23 2309652 0 2024-02-19T19:08:25.353 INFO:tasks.workunit.client.0.smithi046.stdout:1/330: fdatasync d5/f12 0 2024-02-19T19:08:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/253: dwrite d4/d6/f30 [0,4194304] 0 2024-02-19T19:08:25.355 INFO:tasks.workunit.client.0.smithi046.stdout:6/254: truncate d4/f19 1957285 0 2024-02-19T19:08:25.361 INFO:tasks.workunit.client.0.smithi046.stdout:1/331: read d5/d21/f23 [1524887,120062] 0 2024-02-19T19:08:25.361 INFO:tasks.workunit.client.0.smithi046.stdout:5/362: dwrite d2/dd/d29/f45 [0,4194304] 0 2024-02-19T19:08:25.363 INFO:tasks.workunit.client.0.smithi046.stdout:1/332: rename d5/d2f/d5e/d6a to d5/d10/d3b/d3c/d3f/d72 0 2024-02-19T19:08:25.366 INFO:tasks.workunit.client.0.smithi046.stdout:5/363: symlink d2/dd/d2f/d34/l6f 0 2024-02-19T19:08:25.366 INFO:tasks.workunit.client.0.smithi046.stdout:5/364: read d2/dd/f36 [276121,51892] 0 2024-02-19T19:08:25.366 INFO:tasks.workunit.client.0.smithi046.stdout:5/365: readlink d2/l1f 0 2024-02-19T19:08:25.366 INFO:tasks.workunit.client.0.smithi046.stdout:5/366: stat d2/dd/f15 0 2024-02-19T19:08:25.367 INFO:tasks.workunit.client.0.smithi046.stdout:1/333: link d5/d10/d3b/d3c/c5a d5/d10/d3b/d3c/d3f/d72/c73 0 2024-02-19T19:08:25.369 INFO:tasks.workunit.client.0.smithi046.stdout:5/367: creat d2/f70 x:0 0 0 2024-02-19T19:08:25.370 INFO:tasks.workunit.client.0.smithi046.stdout:1/334: mknod d5/d10/d3b/d3c/d3f/d72/c74 0 2024-02-19T19:08:25.370 INFO:tasks.workunit.client.0.smithi046.stdout:1/335: fdatasync d5/d10/d3b/f52 0 2024-02-19T19:08:25.371 INFO:tasks.workunit.client.0.smithi046.stdout:1/336: mkdir d5/d13/d35/d37/d64/d75 0 2024-02-19T19:08:25.371 INFO:tasks.workunit.client.0.smithi046.stdout:1/337: read - d5/d13/f29 zero size 2024-02-19T19:08:25.371 INFO:tasks.workunit.client.0.smithi046.stdout:6/255: dwrite d4/d6/dd/d10/d29/d2d/d35/d3c/f4a [0,4194304] 0 2024-02-19T19:08:25.371 INFO:tasks.workunit.client.0.smithi046.stdout:1/338: mkdir d5/d10/d3b/d4e/d76 0 2024-02-19T19:08:25.386 INFO:tasks.workunit.client.0.smithi046.stdout:8/307: sync 2024-02-19T19:08:25.386 INFO:tasks.workunit.client.0.smithi046.stdout:9/164: sync 2024-02-19T19:08:25.386 INFO:tasks.workunit.client.0.smithi046.stdout:8/308: chown d3/dd/d13/d6b/d36/l63 0 1 2024-02-19T19:08:25.386 INFO:tasks.workunit.client.0.smithi046.stdout:8/309: chown d3/dd/c30 7591966 1 2024-02-19T19:08:25.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/310: creat d3/dd/d13/d6b/d46/d54/f6f x:0 0 0 2024-02-19T19:08:25.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/311: chown d3/dd/d3f/d49/d53 65859 1 2024-02-19T19:08:25.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/312: truncate d3/dd/d13/d6b/f62 68915 0 2024-02-19T19:08:25.390 INFO:tasks.workunit.client.0.smithi046.stdout:8/313: dread d3/dd/d13/d6b/d36/f55 [0,4194304] 0 2024-02-19T19:08:25.390 INFO:tasks.workunit.client.0.smithi046.stdout:8/314: write d3/d37/d1d/d3c/f41 [832530,75425] 0 2024-02-19T19:08:25.390 INFO:tasks.workunit.client.0.smithi046.stdout:8/315: readlink d3/d37/d64/l6e 0 2024-02-19T19:08:25.390 INFO:tasks.workunit.client.0.smithi046.stdout:8/316: read - d3/dd/d13/d42/f57 zero size 2024-02-19T19:08:25.395 INFO:tasks.workunit.client.0.smithi046.stdout:6/256: dwrite d4/d6/dd/f21 [0,4194304] 0 2024-02-19T19:08:25.400 INFO:tasks.workunit.client.0.smithi046.stdout:8/317: dread d3/dd/d13/d6b/f28 [0,4194304] 0 2024-02-19T19:08:25.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/318: fsync d3/dd/f14 0 2024-02-19T19:08:25.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/319: symlink d3/d37/d1d/l70 0 2024-02-19T19:08:25.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/320: fdatasync d3/dd/f15 0 2024-02-19T19:08:25.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/321: readlink d3/d37/l4c 0 2024-02-19T19:08:25.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/339: dwrite d5/f5b [0,4194304] 0 2024-02-19T19:08:25.403 INFO:tasks.workunit.client.0.smithi046.stdout:8/322: creat d3/d37/f71 x:0 0 0 2024-02-19T19:08:25.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/257: dread d4/d6/dd/d10/d29/d2d/d35/d3c/f4a [0,4194304] 0 2024-02-19T19:08:25.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/258: write d4/f39 [208354,49484] 0 2024-02-19T19:08:25.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/259: creat d4/d6/dd/f56 x:0 0 0 2024-02-19T19:08:25.405 INFO:tasks.workunit.client.0.smithi046.stdout:9/165: dwrite db/d1e/f27 [0,4194304] 0 2024-02-19T19:08:25.406 INFO:tasks.workunit.client.0.smithi046.stdout:1/340: creat d5/d13/d35/d37/d64/d75/f77 x:0 0 0 2024-02-19T19:08:25.408 INFO:tasks.workunit.client.0.smithi046.stdout:6/260: chown d4/d6/d1c/d20/l2b 106 1 2024-02-19T19:08:25.408 INFO:tasks.workunit.client.0.smithi046.stdout:6/261: chown d4/l16 5609991 1 2024-02-19T19:08:25.408 INFO:tasks.workunit.client.0.smithi046.stdout:6/262: write d4/d6/dd/d10/d29/d2d/d35/d3c/f55 [419061,113220] 0 2024-02-19T19:08:25.408 INFO:tasks.workunit.client.0.smithi046.stdout:6/263: creat d4/d6/dd/f57 x:0 0 0 2024-02-19T19:08:25.408 INFO:tasks.workunit.client.0.smithi046.stdout:6/264: dread - d4/d6/dd/d10/f4b zero size 2024-02-19T19:08:25.412 INFO:tasks.workunit.client.0.smithi046.stdout:6/265: link d4/d6/dd/d10/c1d d4/d6/dd/d10/d29/d2d/c58 0 2024-02-19T19:08:25.421 INFO:tasks.workunit.client.0.smithi046.stdout:6/266: rmdir d4/d6/dd 39 2024-02-19T19:08:25.424 INFO:tasks.workunit.client.0.smithi046.stdout:8/323: dwrite d3/dd/fe [0,4194304] 0 2024-02-19T19:08:25.424 INFO:tasks.workunit.client.0.smithi046.stdout:8/324: fdatasync d3/d37/d1d/d3c/f3e 0 2024-02-19T19:08:25.424 INFO:tasks.workunit.client.0.smithi046.stdout:8/325: write d3/d37/f71 [876366,70902] 0 2024-02-19T19:08:25.425 INFO:tasks.workunit.client.0.smithi046.stdout:1/341: dwrite d5/d13/d35/f41 [0,4194304] 0 2024-02-19T19:08:25.427 INFO:tasks.workunit.client.0.smithi046.stdout:9/166: dwrite f0 [8388608,4194304] 0 2024-02-19T19:08:25.427 INFO:tasks.workunit.client.0.smithi046.stdout:1/342: mknod d5/d10/d3b/d3c/d3f/d72/c78 0 2024-02-19T19:08:25.427 INFO:tasks.workunit.client.0.smithi046.stdout:1/343: write d5/d13/d35/d37/f6c [173886,95655] 0 2024-02-19T19:08:25.428 INFO:tasks.workunit.client.0.smithi046.stdout:8/326: getdents d3/d37 0 2024-02-19T19:08:25.428 INFO:tasks.workunit.client.0.smithi046.stdout:8/327: write d3/d37/d1d/d3c/f3e [1116701,54039] 0 2024-02-19T19:08:25.429 INFO:tasks.workunit.client.0.smithi046.stdout:8/328: stat d3/dd/d13/d42 0 2024-02-19T19:08:25.429 INFO:tasks.workunit.client.0.smithi046.stdout:8/329: stat d3/dd/d3f/d49/d5b 0 2024-02-19T19:08:25.429 INFO:tasks.workunit.client.0.smithi046.stdout:8/330: fsync d3/dd/f24 0 2024-02-19T19:08:25.429 INFO:tasks.workunit.client.0.smithi046.stdout:8/331: read d3/d37/f2d [3650612,61701] 0 2024-02-19T19:08:25.432 INFO:tasks.workunit.client.0.smithi046.stdout:9/167: rename db/f17 to db/d20/f2c 0 2024-02-19T19:08:25.432 INFO:tasks.workunit.client.0.smithi046.stdout:9/168: chown f7 13363562 1 2024-02-19T19:08:25.432 INFO:tasks.workunit.client.0.smithi046.stdout:9/169: write fa [6904159,51406] 0 2024-02-19T19:08:25.434 INFO:tasks.workunit.client.0.smithi046.stdout:8/332: mkdir d3/dd/d13/d42/d72 0 2024-02-19T19:08:25.446 INFO:tasks.workunit.client.0.smithi046.stdout:6/267: dwrite d4/d6/dd/d10/d29/f48 [0,4194304] 0 2024-02-19T19:08:25.446 INFO:tasks.workunit.client.0.smithi046.stdout:6/268: chown d4/d6/d22/l2f 7 1 2024-02-19T19:08:25.446 INFO:tasks.workunit.client.0.smithi046.stdout:6/269: write d4/d6/dd/d10/d29/d2d/f49 [148318,15648] 0 2024-02-19T19:08:25.446 INFO:tasks.workunit.client.0.smithi046.stdout:6/270: rmdir d4/d6/dd/d10/d29/d2d/d35/d3c 39 2024-02-19T19:08:25.447 INFO:tasks.workunit.client.0.smithi046.stdout:6/271: symlink d4/d6/dd/d10/d29/d2d/d35/d3c/l59 0 2024-02-19T19:08:25.448 INFO:tasks.workunit.client.0.smithi046.stdout:6/272: write d4/d6/f4c [1080238,117427] 0 2024-02-19T19:08:25.448 INFO:tasks.workunit.client.0.smithi046.stdout:8/333: dread d3/dd/d13/f1b [0,4194304] 0 2024-02-19T19:08:25.448 INFO:tasks.workunit.client.0.smithi046.stdout:9/170: dwrite f0 [4194304,4194304] 0 2024-02-19T19:08:25.448 INFO:tasks.workunit.client.0.smithi046.stdout:1/344: dwrite d5/d10/d2d/f4b [0,4194304] 0 2024-02-19T19:08:25.449 INFO:tasks.workunit.client.0.smithi046.stdout:8/334: mknod d3/d37/d1d/d3c/c73 0 2024-02-19T19:08:25.449 INFO:tasks.workunit.client.0.smithi046.stdout:8/335: chown d3/dd/fe 0 1 2024-02-19T19:08:25.450 INFO:tasks.workunit.client.0.smithi046.stdout:6/273: rmdir d4/d6/d1c 39 2024-02-19T19:08:25.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/171: unlink fa 0 2024-02-19T19:08:25.455 INFO:tasks.workunit.client.0.smithi046.stdout:8/336: truncate d3/f10 810051 0 2024-02-19T19:08:25.457 INFO:tasks.workunit.client.0.smithi046.stdout:6/274: symlink d4/d6/dd/d10/d29/d2d/d35/d3c/l5a 0 2024-02-19T19:08:25.457 INFO:tasks.workunit.client.0.smithi046.stdout:6/275: dread - d4/f43 zero size 2024-02-19T19:08:25.462 INFO:tasks.workunit.client.0.smithi046.stdout:8/337: write d3/f7 [535896,59660] 0 2024-02-19T19:08:25.463 INFO:tasks.workunit.client.0.smithi046.stdout:6/276: symlink d4/d6/dd/d10/d29/l5b 0 2024-02-19T19:08:25.464 INFO:tasks.workunit.client.0.smithi046.stdout:6/277: mknod d4/d6/d1c/c5c 0 2024-02-19T19:08:25.464 INFO:tasks.workunit.client.0.smithi046.stdout:6/278: write d4/d6/dd/d10/d29/d2d/f47 [515624,93595] 0 2024-02-19T19:08:25.465 INFO:tasks.workunit.client.0.smithi046.stdout:6/279: readlink d4/d6/d22/l2c 0 2024-02-19T19:08:25.466 INFO:tasks.workunit.client.0.smithi046.stdout:6/280: creat d4/d6/dd/d10/d29/d2d/d35/f5d x:0 0 0 2024-02-19T19:08:25.466 INFO:tasks.workunit.client.0.smithi046.stdout:6/281: fdatasync d4/f26 0 2024-02-19T19:08:25.466 INFO:tasks.workunit.client.0.smithi046.stdout:8/338: dread d3/dd/d13/d6b/f28 [0,4194304] 0 2024-02-19T19:08:25.467 INFO:tasks.workunit.client.0.smithi046.stdout:8/339: creat d3/dd/d13/d6b/d46/f74 x:0 0 0 2024-02-19T19:08:25.467 INFO:tasks.workunit.client.0.smithi046.stdout:8/340: write d3/d37/f2d [292974,77008] 0 2024-02-19T19:08:25.470 INFO:tasks.workunit.client.0.smithi046.stdout:8/341: mknod d3/d18/c75 0 2024-02-19T19:08:25.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/342: mknod d3/d37/c76 0 2024-02-19T19:08:25.472 INFO:tasks.workunit.client.0.smithi046.stdout:8/343: rename d3/d18/l4e to d3/dd/d13/d6b/l77 0 2024-02-19T19:08:25.473 INFO:tasks.workunit.client.0.smithi046.stdout:6/282: rmdir d4 39 2024-02-19T19:08:25.504 INFO:tasks.workunit.client.0.smithi046.stdout:6/283: dwrite d4/f26 [0,4194304] 0 2024-02-19T19:08:25.504 INFO:tasks.workunit.client.0.smithi046.stdout:8/344: dwrite d3/dd/d13/d42/f57 [0,4194304] 0 2024-02-19T19:08:25.504 INFO:tasks.workunit.client.0.smithi046.stdout:8/345: getdents d3/dd/d13/d42/d72 0 2024-02-19T19:08:25.507 INFO:tasks.workunit.client.0.smithi046.stdout:8/346: rename d3/lc to d3/d37/d1d/d3c/l78 0 2024-02-19T19:08:25.509 INFO:tasks.workunit.client.0.smithi046.stdout:6/284: dread d4/f5 [0,4194304] 0 2024-02-19T19:08:25.511 INFO:tasks.workunit.client.0.smithi046.stdout:6/285: creat d4/d6/f5e x:0 0 0 2024-02-19T19:08:25.512 INFO:tasks.workunit.client.0.smithi046.stdout:6/286: rmdir d4/d6/d1c/d20 39 2024-02-19T19:08:25.514 INFO:tasks.workunit.client.0.smithi046.stdout:6/287: dread d4/d6/dd/d10/d29/d2d/d35/d3c/f55 [0,4194304] 0 2024-02-19T19:08:25.515 INFO:tasks.workunit.client.0.smithi046.stdout:8/347: dread d3/d37/f2e [0,4194304] 0 2024-02-19T19:08:25.515 INFO:tasks.workunit.client.0.smithi046.stdout:8/348: fdatasync d3/d37/f2d 0 2024-02-19T19:08:25.515 INFO:tasks.workunit.client.0.smithi046.stdout:8/349: fdatasync d3/dd/d13/d6b/d36/f55 0 2024-02-19T19:08:25.515 INFO:tasks.workunit.client.0.smithi046.stdout:6/288: mknod d4/d6/dd/d10/d29/d2d/d35/c5f 0 2024-02-19T19:08:25.515 INFO:tasks.workunit.client.0.smithi046.stdout:6/289: write d4/d6/d1c/d20/f4d [737573,99701] 0 2024-02-19T19:08:25.516 INFO:tasks.workunit.client.0.smithi046.stdout:6/290: mkdir d4/d6/d1c/d60 0 2024-02-19T19:08:25.516 INFO:tasks.workunit.client.0.smithi046.stdout:6/291: creat d4/d6/d1c/d60/f61 x:0 0 0 2024-02-19T19:08:25.516 INFO:tasks.workunit.client.0.smithi046.stdout:6/292: dread - d4/d6/f5e zero size 2024-02-19T19:08:25.517 INFO:tasks.workunit.client.0.smithi046.stdout:6/293: mknod d4/d6/d22/c62 0 2024-02-19T19:08:25.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/350: write d3/dd/d13/f1b [3561239,11612] 0 2024-02-19T19:08:25.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/351: readlink d3/dd/d13/d6b/d36/l3b 0 2024-02-19T19:08:25.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/352: readlink d3/d37/d1d/l70 0 2024-02-19T19:08:25.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/353: readlink d3/d37/l2a 0 2024-02-19T19:08:25.522 INFO:tasks.workunit.client.0.smithi046.stdout:8/354: link d3/d37/l4c d3/l79 0 2024-02-19T19:08:25.524 INFO:tasks.workunit.client.0.smithi046.stdout:8/355: rmdir d3/d37/d1d 39 2024-02-19T19:08:25.524 INFO:tasks.workunit.client.0.smithi046.stdout:8/356: creat d3/d37/d64/f7a x:0 0 0 2024-02-19T19:08:25.525 INFO:tasks.workunit.client.0.smithi046.stdout:8/357: link d3/d37/d1d/d3c/f43 d3/dd/d13/d66/f7b 0 2024-02-19T19:08:25.525 INFO:tasks.workunit.client.0.smithi046.stdout:8/358: chown d3/d18 62 1 2024-02-19T19:08:25.526 INFO:tasks.workunit.client.0.smithi046.stdout:8/359: mknod d3/dd/d13/d6b/d46/d6a/c7c 0 2024-02-19T19:08:25.526 INFO:tasks.workunit.client.0.smithi046.stdout:8/360: write d3/dd/d13/d6b/f48 [1865792,100563] 0 2024-02-19T19:08:25.526 INFO:tasks.workunit.client.0.smithi046.stdout:6/294: write d4/d6/dd/f21 [1846940,7233] 0 2024-02-19T19:08:25.526 INFO:tasks.workunit.client.0.smithi046.stdout:6/295: write d4/d6/dd/d10/d29/d2d/f47 [1892443,3951] 0 2024-02-19T19:08:25.527 INFO:tasks.workunit.client.0.smithi046.stdout:8/361: unlink d3/cb 0 2024-02-19T19:08:25.528 INFO:tasks.workunit.client.0.smithi046.stdout:6/296: link d4/d6/d1c/d20/l32 d4/d6/dd/d10/d29/d2d/d35/l63 0 2024-02-19T19:08:25.528 INFO:tasks.workunit.client.0.smithi046.stdout:6/297: readlink d4/l52 0 2024-02-19T19:08:25.530 INFO:tasks.workunit.client.0.smithi046.stdout:8/362: dread d3/dd/f39 [0,4194304] 0 2024-02-19T19:08:25.530 INFO:tasks.workunit.client.0.smithi046.stdout:8/363: fdatasync d3/d37/d64/f6c 0 2024-02-19T19:08:25.530 INFO:tasks.workunit.client.0.smithi046.stdout:6/298: stat d4/d6/dd/d10/d29/d2d/c58 0 2024-02-19T19:08:25.531 INFO:tasks.workunit.client.0.smithi046.stdout:6/299: mkdir d4/d6/d1c/d64 0 2024-02-19T19:08:25.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/364: symlink d3/dd/d13/d42/l7d 0 2024-02-19T19:08:25.534 INFO:tasks.workunit.client.0.smithi046.stdout:6/300: symlink d4/d6/d1c/l65 0 2024-02-19T19:08:25.534 INFO:tasks.workunit.client.0.smithi046.stdout:6/301: fsync d4/d6/f4c 0 2024-02-19T19:08:25.534 INFO:tasks.workunit.client.0.smithi046.stdout:6/302: dread - d4/d6/dd/d10/f4b zero size 2024-02-19T19:08:25.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/365: truncate d3/dd/d13/d42/f69 2421285 0 2024-02-19T19:08:25.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/366: fdatasync d3/d37/d1d/d3c/f41 0 2024-02-19T19:08:25.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/367: creat d3/dd/d3f/f7e x:0 0 0 2024-02-19T19:08:25.538 INFO:tasks.workunit.client.0.smithi046.stdout:6/303: mkdir d4/d6/dd/d10/d29/d2d/d35/d66 0 2024-02-19T19:08:25.538 INFO:tasks.workunit.client.0.smithi046.stdout:6/304: stat d4/d6/dd/d10/f13 0 2024-02-19T19:08:25.539 INFO:tasks.workunit.client.0.smithi046.stdout:8/368: unlink d3/dd/d13/d6b/l68 0 2024-02-19T19:08:25.541 INFO:tasks.workunit.client.0.smithi046.stdout:6/305: link d4/d6/d22/c62 d4/d6/dd/d10/d29/d2d/d35/d3c/c67 0 2024-02-19T19:08:25.541 INFO:tasks.workunit.client.0.smithi046.stdout:6/306: fdatasync d4/d6/d1c/f51 0 2024-02-19T19:08:25.542 INFO:tasks.workunit.client.0.smithi046.stdout:8/369: link d3/d37/l2a d3/dd/d3f/d49/d5b/d5f/l7f 0 2024-02-19T19:08:25.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/307: symlink d4/d6/d1c/l68 0 2024-02-19T19:08:25.548 INFO:tasks.workunit.client.0.smithi046.stdout:8/370: mknod d3/dd/d3f/d49/d5b/c80 0 2024-02-19T19:08:25.564 INFO:tasks.workunit.client.0.smithi046.stdout:6/308: dwrite d4/d6/f4c [0,4194304] 0 2024-02-19T19:08:25.564 INFO:tasks.workunit.client.0.smithi046.stdout:6/309: truncate d4/d6/f1a 1107233 0 2024-02-19T19:08:25.564 INFO:tasks.workunit.client.0.smithi046.stdout:6/310: chown d4/d6/dd/d10/c1f 5729 1 2024-02-19T19:08:25.564 INFO:tasks.workunit.client.0.smithi046.stdout:6/311: truncate d4/d6/dd/d10/d29/d2d/f49 532775 0 2024-02-19T19:08:25.566 INFO:tasks.workunit.client.0.smithi046.stdout:6/312: link d4/d6/dd/d10/d29/d2d/d35/c41 d4/d6/d1c/c69 0 2024-02-19T19:08:25.566 INFO:tasks.workunit.client.0.smithi046.stdout:6/313: rmdir d4/d6/dd/d10 39 2024-02-19T19:08:25.571 INFO:tasks.workunit.client.0.smithi046.stdout:8/371: dwrite d3/dd/f15 [0,4194304] 0 2024-02-19T19:08:25.572 INFO:tasks.workunit.client.0.smithi046.stdout:8/372: chown d3/dd/d13/d6b/d36/f4a 72625 1 2024-02-19T19:08:25.572 INFO:tasks.workunit.client.0.smithi046.stdout:2/217: sync 2024-02-19T19:08:25.572 INFO:tasks.workunit.client.0.smithi046.stdout:3/196: sync 2024-02-19T19:08:25.572 INFO:tasks.workunit.client.0.smithi046.stdout:4/278: sync 2024-02-19T19:08:25.572 INFO:tasks.workunit.client.0.smithi046.stdout:3/197: read da/d1d/d10/f1b [1616448,14013] 0 2024-02-19T19:08:25.572 INFO:tasks.workunit.client.0.smithi046.stdout:4/279: write d6/d15/f48 [999685,89013] 0 2024-02-19T19:08:25.574 INFO:tasks.workunit.client.0.smithi046.stdout:8/373: rename d3/d37/l2a to d3/d37/d64/l81 0 2024-02-19T19:08:25.574 INFO:tasks.workunit.client.0.smithi046.stdout:8/374: write d3/d37/d1d/d3c/f3e [178275,42517] 0 2024-02-19T19:08:25.575 INFO:tasks.workunit.client.0.smithi046.stdout:3/198: mkdir da/d30 0 2024-02-19T19:08:25.575 INFO:tasks.workunit.client.0.smithi046.stdout:3/199: fsync da/d1d/d10/f1b 0 2024-02-19T19:08:25.576 INFO:tasks.workunit.client.0.smithi046.stdout:8/375: mknod d3/dd/d3f/d49/c82 0 2024-02-19T19:08:25.576 INFO:tasks.workunit.client.0.smithi046.stdout:8/376: write d3/d18/f1a [452702,58183] 0 2024-02-19T19:08:25.577 INFO:tasks.workunit.client.0.smithi046.stdout:3/200: mknod da/d30/c31 0 2024-02-19T19:08:25.577 INFO:tasks.workunit.client.0.smithi046.stdout:3/201: stat da/d1d/d10/f1e 0 2024-02-19T19:08:25.577 INFO:tasks.workunit.client.0.smithi046.stdout:3/202: truncate da/f25 34054 0 2024-02-19T19:08:25.577 INFO:tasks.workunit.client.0.smithi046.stdout:3/203: readlink da/d1d/l27 0 2024-02-19T19:08:25.577 INFO:tasks.workunit.client.0.smithi046.stdout:3/204: chown da/d1d/d10/f1b 46276738 1 2024-02-19T19:08:25.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/205: mknod da/d1d/d10/c32 0 2024-02-19T19:08:25.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/377: symlink d3/dd/d13/d6b/d46/d6a/l83 0 2024-02-19T19:08:25.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/280: write d6/d15/d17/d1e/d25/f4b [2766608,114512] 0 2024-02-19T19:08:25.581 INFO:tasks.workunit.client.0.smithi046.stdout:8/378: dread d3/d37/d1d/d3c/f41 [0,4194304] 0 2024-02-19T19:08:25.589 INFO:tasks.workunit.client.0.smithi046.stdout:2/218: dwrite f3 [0,4194304] 0 2024-02-19T19:08:25.589 INFO:tasks.workunit.client.0.smithi046.stdout:4/281: dread d6/d15/f5c [0,4194304] 0 2024-02-19T19:08:25.597 INFO:tasks.workunit.client.0.smithi046.stdout:3/206: dwrite da/d1d/d10/f26 [0,4194304] 0 2024-02-19T19:08:25.600 INFO:tasks.workunit.client.0.smithi046.stdout:3/207: truncate da/d1d/d10/f1b 2214273 0 2024-02-19T19:08:25.601 INFO:tasks.workunit.client.0.smithi046.stdout:3/208: stat da/d1d/l22 0 2024-02-19T19:08:25.603 INFO:tasks.workunit.client.0.smithi046.stdout:3/209: symlink da/d1d/l33 0 2024-02-19T19:08:25.603 INFO:tasks.workunit.client.0.smithi046.stdout:3/210: write da/f2c [596036,99469] 0 2024-02-19T19:08:25.603 INFO:tasks.workunit.client.0.smithi046.stdout:3/211: fsync da/d1d/d10/f2b 0 2024-02-19T19:08:25.604 INFO:tasks.workunit.client.0.smithi046.stdout:3/212: mknod da/d1d/c34 0 2024-02-19T19:08:25.610 INFO:tasks.workunit.client.0.smithi046.stdout:2/219: dwrite d5/d6/f7 [0,4194304] 0 2024-02-19T19:08:25.610 INFO:tasks.workunit.client.0.smithi046.stdout:4/282: dwrite d6/f49 [0,4194304] 0 2024-02-19T19:08:25.613 INFO:tasks.workunit.client.0.smithi046.stdout:2/220: rename f3 to d5/df/d3d/f41 0 2024-02-19T19:08:25.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/283: unlink d6/d15/d17/d4a/f5a 0 2024-02-19T19:08:25.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/284: truncate d6/d11/d26/f57 124965 0 2024-02-19T19:08:25.618 INFO:tasks.workunit.client.0.smithi046.stdout:4/285: write d6/d15/f48 [996370,60851] 0 2024-02-19T19:08:25.618 INFO:tasks.workunit.client.0.smithi046.stdout:4/286: chown d6/d15/d17/c46 1672 1 2024-02-19T19:08:25.618 INFO:tasks.workunit.client.0.smithi046.stdout:4/287: creat d6/d11/d26/f60 x:0 0 0 2024-02-19T19:08:25.618 INFO:tasks.workunit.client.0.smithi046.stdout:2/221: symlink d5/df/l42 0 2024-02-19T19:08:25.618 INFO:tasks.workunit.client.0.smithi046.stdout:2/222: stat d5/d2c 0 2024-02-19T19:08:25.618 INFO:tasks.workunit.client.0.smithi046.stdout:2/223: write d5/d6/f23 [215089,67802] 0 2024-02-19T19:08:25.619 INFO:tasks.workunit.client.0.smithi046.stdout:4/288: mknod d6/d50/c61 0 2024-02-19T19:08:25.619 INFO:tasks.workunit.client.0.smithi046.stdout:4/289: truncate d6/f49 4373105 0 2024-02-19T19:08:25.619 INFO:tasks.workunit.client.0.smithi046.stdout:4/290: dread - d6/d15/d17/f5b zero size 2024-02-19T19:08:25.620 INFO:tasks.workunit.client.0.smithi046.stdout:2/224: creat d5/f43 x:0 0 0 2024-02-19T19:08:25.621 INFO:tasks.workunit.client.0.smithi046.stdout:4/291: unlink d6/d15/d17/d1e/l37 0 2024-02-19T19:08:25.621 INFO:tasks.workunit.client.0.smithi046.stdout:4/292: fsync d6/d11/f43 0 2024-02-19T19:08:25.621 INFO:tasks.workunit.client.0.smithi046.stdout:4/293: stat d6/d15/d17 0 2024-02-19T19:08:25.621 INFO:tasks.workunit.client.0.smithi046.stdout:4/294: write d6/d11/d26/f2e [544579,15198] 0 2024-02-19T19:08:25.621 INFO:tasks.workunit.client.0.smithi046.stdout:4/295: write d6/d15/d17/d1e/d25/f59 [993731,99212] 0 2024-02-19T19:08:25.622 INFO:tasks.workunit.client.0.smithi046.stdout:2/225: mknod d5/d2c/d35/c44 0 2024-02-19T19:08:25.622 INFO:tasks.workunit.client.0.smithi046.stdout:2/226: truncate d5/f2a 16695044 0 2024-02-19T19:08:25.623 INFO:tasks.workunit.client.0.smithi046.stdout:2/227: readlink d5/l26 0 2024-02-19T19:08:25.624 INFO:tasks.workunit.client.0.smithi046.stdout:2/228: mkdir d5/d2c/d45 0 2024-02-19T19:08:25.629 INFO:tasks.workunit.client.0.smithi046.stdout:4/296: dread d6/f1a [0,4194304] 0 2024-02-19T19:08:25.631 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:25 smithi046 podman[112493]: 2024-02-19 19:08:25.348621242 +0000 UTC m=+2.987958483 container remove b0d22d02dde4af485cd8c33c1c532ea32d932240a82ec89a9dba21ecb08874ed (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-activate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-19T19:08:25.631 INFO:tasks.workunit.client.0.smithi046.stdout:2/229: dread d5/df/f24 [0,4194304] 0 2024-02-19T19:08:25.637 INFO:tasks.workunit.client.0.smithi046.stdout:3/213: dwrite da/f2c [0,4194304] 0 2024-02-19T19:08:25.639 INFO:tasks.workunit.client.0.smithi046.stdout:3/214: symlink da/l35 0 2024-02-19T19:08:25.639 INFO:tasks.workunit.client.0.smithi046.stdout:2/230: dread d5/d6/f7 [0,4194304] 0 2024-02-19T19:08:25.640 INFO:tasks.workunit.client.0.smithi046.stdout:3/215: truncate da/d1d/d10/f1b 1080819 0 2024-02-19T19:08:25.640 INFO:tasks.workunit.client.0.smithi046.stdout:3/216: fsync da/f15 0 2024-02-19T19:08:25.641 INFO:tasks.workunit.client.0.smithi046.stdout:3/217: link da/c29 da/d30/c36 0 2024-02-19T19:08:25.642 INFO:tasks.workunit.client.0.smithi046.stdout:3/218: write da/d1d/d10/f2b [899452,35918] 0 2024-02-19T19:08:25.642 INFO:tasks.workunit.client.0.smithi046.stdout:3/219: creat da/f37 x:0 0 0 2024-02-19T19:08:25.642 INFO:tasks.workunit.client.0.smithi046.stdout:2/231: rmdir d5/df 39 2024-02-19T19:08:25.644 INFO:tasks.workunit.client.0.smithi046.stdout:3/220: mkdir da/d30/d38 0 2024-02-19T19:08:25.646 INFO:tasks.workunit.client.0.smithi046.stdout:3/221: rename da/c2a to da/d30/c39 0 2024-02-19T19:08:25.653 INFO:tasks.workunit.client.0.smithi046.stdout:3/222: dread da/d1d/d10/f1b [0,4194304] 0 2024-02-19T19:08:25.653 INFO:tasks.workunit.client.0.smithi046.stdout:3/223: chown da/d1d 3 1 2024-02-19T19:08:25.660 INFO:tasks.workunit.client.0.smithi046.stdout:4/297: dwrite d6/d11/d26/f2e [0,4194304] 0 2024-02-19T19:08:25.660 INFO:tasks.workunit.client.0.smithi046.stdout:4/298: write d6/d11/f43 [4790304,70545] 0 2024-02-19T19:08:25.660 INFO:tasks.workunit.client.0.smithi046.stdout:2/232: dwrite d5/df/f10 [0,4194304] 0 2024-02-19T19:08:25.660 INFO:tasks.workunit.client.0.smithi046.stdout:2/233: stat d5/l26 0 2024-02-19T19:08:25.663 INFO:tasks.workunit.client.0.smithi046.stdout:4/299: link d6/l45 d6/d50/l62 0 2024-02-19T19:08:25.665 INFO:tasks.workunit.client.0.smithi046.stdout:3/224: dread da/d1d/d10/f21 [0,4194304] 0 2024-02-19T19:08:25.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/234: rename d5/d6/lb to d5/d2c/l46 0 2024-02-19T19:08:25.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/235: fdatasync d5/df/f1a 0 2024-02-19T19:08:25.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/236: write d5/f30 [546391,32348] 0 2024-02-19T19:08:25.667 INFO:tasks.workunit.client.0.smithi046.stdout:4/300: mknod d6/d15/d17/d1e/d33/d55/c63 0 2024-02-19T19:08:25.668 INFO:tasks.workunit.client.0.smithi046.stdout:2/237: mknod d5/d6/c47 0 2024-02-19T19:08:25.669 INFO:tasks.workunit.client.0.smithi046.stdout:4/301: creat d6/d11/f64 x:0 0 0 2024-02-19T19:08:25.671 INFO:tasks.workunit.client.0.smithi046.stdout:2/238: rename d5/d6/le to d5/df/d3f/l48 0 2024-02-19T19:08:25.671 INFO:tasks.workunit.client.0.smithi046.stdout:2/239: creat d5/d2c/f49 x:0 0 0 2024-02-19T19:08:25.671 INFO:tasks.workunit.client.0.smithi046.stdout:2/240: write d5/df/f40 [4373122,104626] 0 2024-02-19T19:08:25.671 INFO:tasks.workunit.client.0.smithi046.stdout:2/241: readlink d5/df/l34 0 2024-02-19T19:08:25.671 INFO:tasks.workunit.client.0.smithi046.stdout:2/242: truncate d5/df/f1a 1301081 0 2024-02-19T19:08:25.673 INFO:tasks.workunit.client.0.smithi046.stdout:2/243: creat d5/d2c/d45/f4a x:0 0 0 2024-02-19T19:08:25.674 INFO:tasks.workunit.client.0.smithi046.stdout:2/244: write d5/f30 [53052,109217] 0 2024-02-19T19:08:25.675 INFO:tasks.workunit.client.0.smithi046.stdout:3/225: dread da/f2c [0,4194304] 0 2024-02-19T19:08:25.675 INFO:tasks.workunit.client.0.smithi046.stdout:2/245: mknod d5/df/c4b 0 2024-02-19T19:08:25.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/302: dread d6/d15/d17/f41 [0,4194304] 0 2024-02-19T19:08:25.676 INFO:tasks.workunit.client.0.smithi046.stdout:4/303: symlink d6/l65 0 2024-02-19T19:08:25.676 INFO:tasks.workunit.client.0.smithi046.stdout:4/304: creat d6/d11/f66 x:0 0 0 2024-02-19T19:08:25.676 INFO:tasks.workunit.client.0.smithi046.stdout:3/226: write da/f15 [84907,128570] 0 2024-02-19T19:08:25.676 INFO:tasks.workunit.client.0.smithi046.stdout:3/227: fdatasync da/d1d/d10/f26 0 2024-02-19T19:08:25.678 INFO:tasks.workunit.client.0.smithi046.stdout:3/228: rename da/lf to da/d30/d38/l3a 0 2024-02-19T19:08:25.678 INFO:tasks.workunit.client.0.smithi046.stdout:3/229: write da/f15 [187893,119547] 0 2024-02-19T19:08:25.678 INFO:tasks.workunit.client.0.smithi046.stdout:3/230: dread - da/d1d/f28 zero size 2024-02-19T19:08:25.679 INFO:tasks.workunit.client.0.smithi046.stdout:3/231: mkdir da/d3b 0 2024-02-19T19:08:25.679 INFO:tasks.workunit.client.0.smithi046.stdout:3/232: write da/d1d/f28 [946774,56968] 0 2024-02-19T19:08:25.680 INFO:tasks.workunit.client.0.smithi046.stdout:3/233: mknod da/d1d/c3c 0 2024-02-19T19:08:25.680 INFO:tasks.workunit.client.0.smithi046.stdout:4/305: fdatasync d6/d11/f43 0 2024-02-19T19:08:25.680 INFO:tasks.workunit.client.0.smithi046.stdout:4/306: truncate d6/f49 4994353 0 2024-02-19T19:08:25.680 INFO:tasks.workunit.client.0.smithi046.stdout:4/307: write d6/d15/d17/d1e/d25/f2c [4864060,58570] 0 2024-02-19T19:08:25.681 INFO:tasks.workunit.client.0.smithi046.stdout:4/308: symlink d6/l67 0 2024-02-19T19:08:25.687 INFO:tasks.workunit.client.0.smithi046.stdout:4/309: dread d6/d15/d17/d1e/d33/f38 [0,4194304] 0 2024-02-19T19:08:25.687 INFO:tasks.workunit.client.0.smithi046.stdout:4/310: creat d6/d11/f68 x:0 0 0 2024-02-19T19:08:25.688 INFO:tasks.workunit.client.0.smithi046.stdout:4/311: chown d6/d15/d17/c51 28 1 2024-02-19T19:08:25.689 INFO:tasks.workunit.client.0.smithi046.stdout:4/312: dread d6/d15/d17/d1e/d33/f38 [0,4194304] 0 2024-02-19T19:08:25.690 INFO:tasks.workunit.client.0.smithi046.stdout:2/246: dwrite d5/d2c/f2e [0,4194304] 0 2024-02-19T19:08:25.690 INFO:tasks.workunit.client.0.smithi046.stdout:2/247: fdatasync d5/d2c/d45/f4a 0 2024-02-19T19:08:25.692 INFO:tasks.workunit.client.0.smithi046.stdout:4/313: rename d6/d15/d17/d1e/c39 to d6/d15/c69 0 2024-02-19T19:08:25.695 INFO:tasks.workunit.client.0.smithi046.stdout:3/234: dwrite da/d1d/d10/f26 [4194304,4194304] 0 2024-02-19T19:08:25.699 INFO:tasks.workunit.client.0.smithi046.stdout:2/248: write d5/df/d3d/f41 [46809,99927] 0 2024-02-19T19:08:25.704 INFO:tasks.workunit.client.0.smithi046.stdout:4/314: dread d6/d15/d17/d1e/d25/f2c [0,4194304] 0 2024-02-19T19:08:25.704 INFO:tasks.workunit.client.0.smithi046.stdout:4/315: stat d6/d15/d17/c3c 0 2024-02-19T19:08:25.704 INFO:tasks.workunit.client.0.smithi046.stdout:4/316: write d6/d15/d17/d1e/d33/d55/f5d [891754,110035] 0 2024-02-19T19:08:25.704 INFO:tasks.workunit.client.0.smithi046.stdout:4/317: write d6/d15/d17/d1e/d33/f38 [874555,4322] 0 2024-02-19T19:08:25.704 INFO:tasks.workunit.client.0.smithi046.stdout:3/235: creat da/d30/d38/f3d x:0 0 0 2024-02-19T19:08:25.705 INFO:tasks.workunit.client.0.smithi046.stdout:2/249: mkdir d5/df/d4c 0 2024-02-19T19:08:25.707 INFO:tasks.workunit.client.0.smithi046.stdout:4/318: mknod d6/d15/d17/c6a 0 2024-02-19T19:08:25.707 INFO:tasks.workunit.client.0.smithi046.stdout:4/319: readlink d6/d11/d26/l29 0 2024-02-19T19:08:25.707 INFO:tasks.workunit.client.0.smithi046.stdout:4/320: write d6/d11/d26/f34 [2396678,33833] 0 2024-02-19T19:08:25.708 INFO:tasks.workunit.client.0.smithi046.stdout:3/236: unlink da/c12 0 2024-02-19T19:08:25.708 INFO:tasks.workunit.client.0.smithi046.stdout:3/237: stat da/d1d/d10/f2e 0 2024-02-19T19:08:25.709 INFO:tasks.workunit.client.0.smithi046.stdout:2/250: mknod d5/d2c/d45/c4d 0 2024-02-19T19:08:25.709 INFO:tasks.workunit.client.0.smithi046.stdout:2/251: chown d5/c2d 1113 1 2024-02-19T19:08:25.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/321: rmdir d6/d15/d17/d1e/d25 39 2024-02-19T19:08:25.715 INFO:tasks.workunit.client.0.smithi046.stdout:3/238: dread da/d1d/d10/f21 [0,4194304] 0 2024-02-19T19:08:25.715 INFO:tasks.workunit.client.0.smithi046.stdout:3/239: chown da/d1d/l22 59399540 1 2024-02-19T19:08:25.717 INFO:tasks.workunit.client.0.smithi046.stdout:3/240: link da/f25 da/d30/d38/f3e 0 2024-02-19T19:08:25.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/241: mkdir da/d1d/d3f 0 2024-02-19T19:08:25.719 INFO:tasks.workunit.client.0.smithi046.stdout:7/424: sync 2024-02-19T19:08:25.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/328: sync 2024-02-19T19:08:25.720 INFO:tasks.workunit.client.0.smithi046.stdout:5/368: sync 2024-02-19T19:08:25.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/345: sync 2024-02-19T19:08:25.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/346: fsync d5/d10/d3b/d3c/d3f/f43 0 2024-02-19T19:08:25.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/347: creat d5/d13/d35/d37/f79 x:0 0 0 2024-02-19T19:08:25.722 INFO:tasks.workunit.client.0.smithi046.stdout:7/425: link d0/d4/dd/l25 d0/d4/d75/d83/l84 0 2024-02-19T19:08:25.724 INFO:tasks.workunit.client.0.smithi046.stdout:5/369: rmdir d2/dd/d26/d65/d64 0 2024-02-19T19:08:25.724 INFO:tasks.workunit.client.0.smithi046.stdout:5/370: write d2/f22 [3085217,13886] 0 2024-02-19T19:08:25.724 INFO:tasks.workunit.client.0.smithi046.stdout:5/371: write d2/dd/d2f/d34/d5d/f61 [851495,21882] 0 2024-02-19T19:08:25.725 INFO:tasks.workunit.client.0.smithi046.stdout:0/329: mkdir d0/d5f/d65/d79 0 2024-02-19T19:08:25.727 INFO:tasks.workunit.client.0.smithi046.stdout:1/348: symlink d5/d13/d35/d37/d64/d75/l7a 0 2024-02-19T19:08:25.728 INFO:tasks.workunit.client.0.smithi046.stdout:3/242: rmdir da/d1d/d10 39 2024-02-19T19:08:25.729 INFO:tasks.workunit.client.0.smithi046.stdout:3/243: stat da/l13 0 2024-02-19T19:08:25.729 INFO:tasks.workunit.client.0.smithi046.stdout:3/244: chown da/c18 0 1 2024-02-19T19:08:25.732 INFO:tasks.workunit.client.0.smithi046.stdout:7/426: mkdir d0/d45/d71/d41/d5f/d85 0 2024-02-19T19:08:25.733 INFO:tasks.workunit.client.0.smithi046.stdout:5/372: rename d2/c19 to d2/dd/c71 0 2024-02-19T19:08:25.733 INFO:tasks.workunit.client.0.smithi046.stdout:5/373: fsync d2/d5e/f6d 0 2024-02-19T19:08:25.734 INFO:tasks.workunit.client.0.smithi046.stdout:0/330: unlink d0/d5f/l77 0 2024-02-19T19:08:25.735 INFO:tasks.workunit.client.0.smithi046.stdout:1/349: link d5/d13/d35/d37/d64/l67 d5/d2f/l7b 0 2024-02-19T19:08:25.738 INFO:tasks.workunit.client.0.smithi046.stdout:5/374: mkdir d2/dd/d29/d72 0 2024-02-19T19:08:25.739 INFO:tasks.workunit.client.0.smithi046.stdout:0/331: symlink d0/d19/l7a 0 2024-02-19T19:08:25.739 INFO:tasks.workunit.client.0.smithi046.stdout:2/252: dwrite d5/d6/fa [4194304,4194304] 0 2024-02-19T19:08:25.740 INFO:tasks.workunit.client.0.smithi046.stdout:4/322: dwrite d6/d15/d17/d1e/d25/f2f [0,4194304] 0 2024-02-19T19:08:25.740 INFO:tasks.workunit.client.0.smithi046.stdout:4/323: write d6/d15/d17/d1e/d25/f4b [4970967,99824] 0 2024-02-19T19:08:25.740 INFO:tasks.workunit.client.0.smithi046.stdout:4/324: write d6/d15/d17/f41 [3278177,115991] 0 2024-02-19T19:08:25.742 INFO:tasks.workunit.client.0.smithi046.stdout:5/375: rename d2/f21 to d2/d27/d4b/f73 0 2024-02-19T19:08:25.742 INFO:tasks.workunit.client.0.smithi046.stdout:5/376: dread - d2/dd/f5c zero size 2024-02-19T19:08:25.744 INFO:tasks.workunit.client.0.smithi046.stdout:2/253: mknod d5/df/d4c/c4e 0 2024-02-19T19:08:25.745 INFO:tasks.workunit.client.0.smithi046.stdout:3/245: write da/d1d/d10/f1e [5094595,49233] 0 2024-02-19T19:08:25.747 INFO:tasks.workunit.client.0.smithi046.stdout:7/427: dwrite d0/d4/f7 [0,4194304] 0 2024-02-19T19:08:25.749 INFO:tasks.workunit.client.0.smithi046.stdout:1/350: read d5/f1f [3844799,42153] 0 2024-02-19T19:08:25.750 INFO:tasks.workunit.client.0.smithi046.stdout:2/254: link d5/d6/c1e d5/d2c/d35/c4f 0 2024-02-19T19:08:25.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/246: write da/d30/d38/f3d [984029,46636] 0 2024-02-19T19:08:25.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/325: dread d6/d15/d17/f3f [0,4194304] 0 2024-02-19T19:08:25.756 INFO:tasks.workunit.client.0.smithi046.stdout:0/332: dwrite d0/d19/f1f [0,4194304] 0 2024-02-19T19:08:25.757 INFO:tasks.workunit.client.0.smithi046.stdout:0/333: dread d0/f5c [0,4194304] 0 2024-02-19T19:08:25.758 INFO:tasks.workunit.client.0.smithi046.stdout:5/377: fsync d2/d27/d4b/f73 0 2024-02-19T19:08:25.764 INFO:tasks.workunit.client.0.smithi046.stdout:7/428: symlink d0/l86 0 2024-02-19T19:08:25.765 INFO:tasks.workunit.client.0.smithi046.stdout:3/247: write da/d1d/d10/f1b [247682,124791] 0 2024-02-19T19:08:25.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/326: symlink d6/l6b 0 2024-02-19T19:08:25.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/327: fdatasync d6/d15/d17/f20 0 2024-02-19T19:08:25.766 INFO:tasks.workunit.client.0.smithi046.stdout:0/334: unlink d0/d6c/l72 0 2024-02-19T19:08:25.767 INFO:tasks.workunit.client.0.smithi046.stdout:1/351: dwrite d5/d13/d35/f71 [0,4194304] 0 2024-02-19T19:08:25.767 INFO:tasks.workunit.client.0.smithi046.stdout:1/352: fsync d5/f1f 0 2024-02-19T19:08:25.767 INFO:tasks.workunit.client.0.smithi046.stdout:1/353: write d5/d13/f29 [511368,99673] 0 2024-02-19T19:08:25.767 INFO:tasks.workunit.client.0.smithi046.stdout:1/354: chown d5/d10/d3b/d4e/l4a 32199 1 2024-02-19T19:08:25.768 INFO:tasks.workunit.client.0.smithi046.stdout:1/355: write d5/f17 [1198542,34080] 0 2024-02-19T19:08:25.768 INFO:tasks.workunit.client.0.smithi046.stdout:5/378: link d2/dd/d29/f45 d2/dd/d2f/d34/f74 0 2024-02-19T19:08:25.769 INFO:tasks.workunit.client.0.smithi046.stdout:0/335: dread d0/d19/d8/d37/f3e [0,4194304] 0 2024-02-19T19:08:25.769 INFO:tasks.workunit.client.0.smithi046.stdout:2/255: getdents d5/d6/d13 0 2024-02-19T19:08:25.772 INFO:tasks.workunit.client.0.smithi046.stdout:3/248: truncate da/f37 82761 0 2024-02-19T19:08:25.772 INFO:tasks.workunit.client.0.smithi046.stdout:3/249: getdents da/d1d/d3f 0 2024-02-19T19:08:25.773 INFO:tasks.workunit.client.0.smithi046.stdout:4/328: unlink d6/d15/d17/d1e/c16 0 2024-02-19T19:08:25.773 INFO:tasks.workunit.client.0.smithi046.stdout:4/329: write d6/d15/d17/d1e/d33/f38 [970122,101732] 0 2024-02-19T19:08:25.773 INFO:tasks.workunit.client.0.smithi046.stdout:4/330: chown d6/d15/l30 5 1 2024-02-19T19:08:25.773 INFO:tasks.workunit.client.0.smithi046.stdout:7/429: dread d0/d45/d71/d4b/f61 [0,4194304] 0 2024-02-19T19:08:25.773 INFO:tasks.workunit.client.0.smithi046.stdout:5/379: write d2/fb [2281137,29709] 0 2024-02-19T19:08:25.774 INFO:tasks.workunit.client.0.smithi046.stdout:2/256: dread d5/d6/f23 [0,4194304] 0 2024-02-19T19:08:25.777 INFO:tasks.workunit.client.0.smithi046.stdout:1/356: mknod d5/d13/d35/d37/d64/d75/c7c 0 2024-02-19T19:08:25.777 INFO:tasks.workunit.client.0.smithi046.stdout:1/357: read d5/f17 [673976,17581] 0 2024-02-19T19:08:25.777 INFO:tasks.workunit.client.0.smithi046.stdout:1/358: chown d5/d10/d2d/f47 26964 1 2024-02-19T19:08:25.781 INFO:tasks.workunit.client.0.smithi046.stdout:4/331: link d6/d15/d17/c6a d6/d15/d17/d1e/c6c 0 2024-02-19T19:08:25.781 INFO:tasks.workunit.client.0.smithi046.stdout:7/430: symlink d0/d4/d24/l87 0 2024-02-19T19:08:25.782 INFO:tasks.workunit.client.0.smithi046.stdout:3/250: dread da/f25 [0,4194304] 0 2024-02-19T19:08:25.782 INFO:tasks.workunit.client.0.smithi046.stdout:5/380: creat d2/dd/d3f/f75 x:0 0 0 2024-02-19T19:08:25.783 INFO:tasks.workunit.client.0.smithi046.stdout:2/257: rename d5/d6/f7 to d5/d6/f50 0 2024-02-19T19:08:25.783 INFO:tasks.workunit.client.0.smithi046.stdout:2/258: write d5/f38 [318920,9138] 0 2024-02-19T19:08:25.784 INFO:tasks.workunit.client.0.smithi046.stdout:0/336: dwrite d0/d19/db/f50 [0,4194304] 0 2024-02-19T19:08:25.784 INFO:tasks.workunit.client.0.smithi046.stdout:4/332: truncate d6/f49 1877419 0 2024-02-19T19:08:25.786 INFO:tasks.workunit.client.0.smithi046.stdout:7/431: creat d0/d4/d7b/f88 x:0 0 0 2024-02-19T19:08:25.786 INFO:tasks.workunit.client.0.smithi046.stdout:7/432: stat d0/d45/l46 0 2024-02-19T19:08:25.786 INFO:tasks.workunit.client.0.smithi046.stdout:7/433: chown d0/d45/d71/d41/l53 87202 1 2024-02-19T19:08:25.786 INFO:tasks.workunit.client.0.smithi046.stdout:7/434: creat d0/d45/d4a/d58/d60/f89 x:0 0 0 2024-02-19T19:08:25.787 INFO:tasks.workunit.client.0.smithi046.stdout:3/251: chown da/c1a 4 1 2024-02-19T19:08:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:5/381: rename d2/dd/d26/d65/l6e to d2/dd/l76 0 2024-02-19T19:08:25.789 INFO:tasks.workunit.client.0.smithi046.stdout:5/382: creat d2/dd/f77 x:0 0 0 2024-02-19T19:08:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:2/259: rmdir d5/df 39 2024-02-19T19:08:25.792 INFO:tasks.workunit.client.0.smithi046.stdout:0/337: creat d0/d19/db/d27/f7b x:0 0 0 2024-02-19T19:08:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:0/338: dread d0/d19/d8/d37/f3e [0,4194304] 0 2024-02-19T19:08:25.794 INFO:tasks.workunit.client.0.smithi046.stdout:0/339: creat d0/f7c x:0 0 0 2024-02-19T19:08:25.795 INFO:tasks.workunit.client.0.smithi046.stdout:5/383: rename d2/d27/d47/d54/d57/c69 to d2/dd/d2f/c78 0 2024-02-19T19:08:25.797 INFO:tasks.workunit.client.0.smithi046.stdout:0/340: creat d0/d19/d8/d37/f7d x:0 0 0 2024-02-19T19:08:25.797 INFO:tasks.workunit.client.0.smithi046.stdout:0/341: fdatasync d0/d19/db/d27/f28 0 2024-02-19T19:08:25.797 INFO:tasks.workunit.client.0.smithi046.stdout:0/342: creat d0/d5f/f7e x:0 0 0 2024-02-19T19:08:25.797 INFO:tasks.workunit.client.0.smithi046.stdout:5/384: mknod d2/dd/d26/d65/c79 0 2024-02-19T19:08:25.798 INFO:tasks.workunit.client.0.smithi046.stdout:0/343: mkdir d0/d24/d5b/d7f 0 2024-02-19T19:08:25.798 INFO:tasks.workunit.client.0.smithi046.stdout:0/344: fdatasync d0/f17 0 2024-02-19T19:08:25.799 INFO:tasks.workunit.client.0.smithi046.stdout:5/385: mknod d2/dd/d26/d65/c7a 0 2024-02-19T19:08:25.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/345: mkdir d0/d19/d8/d37/d80 0 2024-02-19T19:08:25.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/346: write d0/d24/d2f/d53/d6b/f6e [858575,53056] 0 2024-02-19T19:08:25.800 INFO:tasks.workunit.client.0.smithi046.stdout:5/386: truncate d2/dd/f1a 1361868 0 2024-02-19T19:08:25.800 INFO:tasks.workunit.client.0.smithi046.stdout:5/387: creat d2/dd/d3f/f7b x:0 0 0 2024-02-19T19:08:25.801 INFO:tasks.workunit.client.0.smithi046.stdout:5/388: chown d2/d27/d47/d54/d57 251 1 2024-02-19T19:08:25.801 INFO:tasks.workunit.client.0.smithi046.stdout:0/347: creat d0/d24/d56/f81 x:0 0 0 2024-02-19T19:08:25.801 INFO:tasks.workunit.client.0.smithi046.stdout:0/348: fdatasync d0/d19/d8/d37/f7d 0 2024-02-19T19:08:25.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/349: rename d0/d24/d56/c57 to d0/d19/db/d6a/c82 0 2024-02-19T19:08:25.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/350: write d0/d5f/f69 [157180,4711] 0 2024-02-19T19:08:25.811 INFO:tasks.workunit.client.0.smithi046.stdout:0/351: dread d0/d19/d8/f34 [0,4194304] 0 2024-02-19T19:08:25.863 INFO:tasks.workunit.client.0.smithi046.stdout:9/172: sync 2024-02-19T19:08:25.864 INFO:tasks.workunit.client.0.smithi046.stdout:9/173: mknod db/d20/c2d 0 2024-02-19T19:08:25.865 INFO:tasks.workunit.client.0.smithi046.stdout:9/174: mknod db/d20/c2e 0 2024-02-19T19:08:25.865 INFO:tasks.workunit.client.0.smithi046.stdout:9/175: write db/f24 [733872,16543] 0 2024-02-19T19:08:25.867 INFO:tasks.workunit.client.0.smithi046.stdout:3/252: dread da/d1d/d10/f26 [0,4194304] 0 2024-02-19T19:08:25.867 INFO:tasks.workunit.client.0.smithi046.stdout:4/333: dwrite d6/d15/d17/f3f [0,4194304] 0 2024-02-19T19:08:25.869 INFO:tasks.workunit.client.0.smithi046.stdout:6/314: sync 2024-02-19T19:08:25.869 INFO:tasks.workunit.client.0.smithi046.stdout:8/379: sync 2024-02-19T19:08:25.869 INFO:tasks.workunit.client.0.smithi046.stdout:6/315: read d4/f5 [822878,101079] 0 2024-02-19T19:08:25.870 INFO:tasks.workunit.client.0.smithi046.stdout:8/380: write d3/d37/d1d/d3c/f3e [248283,73905] 0 2024-02-19T19:08:25.872 INFO:tasks.workunit.client.0.smithi046.stdout:4/334: creat d6/d15/d17/d1e/f6d x:0 0 0 2024-02-19T19:08:25.873 INFO:tasks.workunit.client.0.smithi046.stdout:2/260: dread d5/d6/fa [4194304,4194304] 0 2024-02-19T19:08:25.875 INFO:tasks.workunit.client.0.smithi046.stdout:8/381: unlink d3/c19 0 2024-02-19T19:08:25.876 INFO:tasks.workunit.client.0.smithi046.stdout:2/261: write d5/d6/f23 [175620,48819] 0 2024-02-19T19:08:25.877 INFO:tasks.workunit.client.0.smithi046.stdout:2/262: mknod d5/d6/d13/c51 0 2024-02-19T19:08:25.879 INFO:tasks.workunit.client.0.smithi046.stdout:2/263: creat d5/d2c/d35/f52 x:0 0 0 2024-02-19T19:08:25.879 INFO:tasks.workunit.client.0.smithi046.stdout:3/253: read da/d1d/d10/f26 [7811471,66896] 0 2024-02-19T19:08:25.880 INFO:tasks.workunit.client.0.smithi046.stdout:2/264: getdents d5/df/d3f 0 2024-02-19T19:08:25.881 INFO:tasks.workunit.client.0.smithi046.stdout:3/254: mkdir da/d30/d38/d40 0 2024-02-19T19:08:25.882 INFO:tasks.workunit.client.0.smithi046.stdout:3/255: write da/f20 [1605447,21432] 0 2024-02-19T19:08:25.884 INFO:tasks.workunit.client.0.smithi046.stdout:4/335: read d6/d11/d26/f28 [2976205,105056] 0 2024-02-19T19:08:25.884 INFO:tasks.workunit.client.0.smithi046.stdout:3/256: mkdir da/d30/d38/d41 0 2024-02-19T19:08:25.887 INFO:tasks.workunit.client.0.smithi046.stdout:8/382: write d3/d18/f33 [1487602,47893] 0 2024-02-19T19:08:25.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/383: symlink d3/d37/d1d/d3c/l84 0 2024-02-19T19:08:25.890 INFO:tasks.workunit.client.0.smithi046.stdout:9/176: dwrite f0 [0,4194304] 0 2024-02-19T19:08:25.891 INFO:tasks.workunit.client.0.smithi046.stdout:8/384: creat d3/dd/d13/d42/d72/f85 x:0 0 0 2024-02-19T19:08:25.893 INFO:tasks.workunit.client.0.smithi046.stdout:6/316: dwrite d4/d6/f3b [0,4194304] 0 2024-02-19T19:08:25.895 INFO:tasks.workunit.client.0.smithi046.stdout:6/317: creat d4/f6a x:0 0 0 2024-02-19T19:08:25.897 INFO:tasks.workunit.client.0.smithi046.stdout:3/257: dread da/f20 [0,4194304] 0 2024-02-19T19:08:25.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/265: dwrite d5/d2c/d35/f52 [0,4194304] 0 2024-02-19T19:08:25.902 INFO:tasks.workunit.client.0.smithi046.stdout:3/258: getdents da/d3b 0 2024-02-19T19:08:25.902 INFO:tasks.workunit.client.0.smithi046.stdout:3/259: chown da/d1d/d10/c16 2 1 2024-02-19T19:08:25.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/266: link d5/d6/c15 d5/d6/d13/c53 0 2024-02-19T19:08:25.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/267: creat d5/d2c/d45/f54 x:0 0 0 2024-02-19T19:08:25.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/268: creat d5/d2c/d35/f55 x:0 0 0 2024-02-19T19:08:25.905 INFO:tasks.workunit.client.0.smithi046.stdout:4/336: dwrite d6/d11/f43 [0,4194304] 0 2024-02-19T19:08:25.910 INFO:tasks.workunit.client.0.smithi046.stdout:6/318: write d4/d6/f30 [209607,72] 0 2024-02-19T19:08:25.910 INFO:tasks.workunit.client.0.smithi046.stdout:6/319: chown d4/d6/d1c/l68 37274484 1 2024-02-19T19:08:25.912 INFO:tasks.workunit.client.0.smithi046.stdout:6/320: unlink d4/d6/d22/l2c 0 2024-02-19T19:08:25.914 INFO:tasks.workunit.client.0.smithi046.stdout:6/321: symlink d4/d6/d1c/d60/l6b 0 2024-02-19T19:08:25.916 INFO:tasks.workunit.client.0.smithi046.stdout:9/177: dwrite db/d1e/f27 [0,4194304] 0 2024-02-19T19:08:25.916 INFO:tasks.workunit.client.0.smithi046.stdout:2/269: dread d5/df/d3d/f41 [0,4194304] 0 2024-02-19T19:08:25.916 INFO:tasks.workunit.client.0.smithi046.stdout:8/385: dwrite d3/d18/f33 [0,4194304] 0 2024-02-19T19:08:25.920 INFO:tasks.workunit.client.0.smithi046.stdout:9/178: rename l5 to db/d1e/l2f 0 2024-02-19T19:08:25.921 INFO:tasks.workunit.client.0.smithi046.stdout:4/337: dwrite d6/d11/d26/f60 [0,4194304] 0 2024-02-19T19:08:25.925 INFO:tasks.workunit.client.0.smithi046.stdout:9/179: rename db/d20/l28 to db/d20/l30 0 2024-02-19T19:08:25.928 INFO:tasks.workunit.client.0.smithi046.stdout:2/270: rmdir d5/d2c/d35 39 2024-02-19T19:08:25.928 INFO:tasks.workunit.client.0.smithi046.stdout:2/271: chown d5/df/f37 0 1 2024-02-19T19:08:25.928 INFO:tasks.workunit.client.0.smithi046.stdout:4/338: dread d6/d15/d17/d1e/d25/f2f [0,4194304] 0 2024-02-19T19:08:25.929 INFO:tasks.workunit.client.0.smithi046.stdout:2/272: mkdir d5/d2c/d56 0 2024-02-19T19:08:25.930 INFO:tasks.workunit.client.0.smithi046.stdout:4/339: mkdir d6/d15/d6e 0 2024-02-19T19:08:25.931 INFO:tasks.workunit.client.0.smithi046.stdout:2/273: truncate d5/d6/fa 608206 0 2024-02-19T19:08:25.937 INFO:tasks.workunit.client.0.smithi046.stdout:8/386: dread d3/dd/d13/d6b/f28 [0,4194304] 0 2024-02-19T19:08:25.937 INFO:tasks.workunit.client.0.smithi046.stdout:2/274: dread d5/f38 [0,4194304] 0 2024-02-19T19:08:25.937 INFO:tasks.workunit.client.0.smithi046.stdout:8/387: chown d3/dd/f58 188 1 2024-02-19T19:08:25.937 INFO:tasks.workunit.client.0.smithi046.stdout:8/388: chown d3/d37/c38 28102573 1 2024-02-19T19:08:25.938 INFO:tasks.workunit.client.0.smithi046.stdout:8/389: truncate d3/dd/d13/d6b/d36/f55 345255 0 2024-02-19T19:08:25.939 INFO:tasks.workunit.client.0.smithi046.stdout:2/275: dread d5/f38 [0,4194304] 0 2024-02-19T19:08:25.939 INFO:tasks.workunit.client.0.smithi046.stdout:2/276: write d5/df/f1a [1908344,88047] 0 2024-02-19T19:08:25.939 INFO:tasks.workunit.client.0.smithi046.stdout:4/340: dread d6/d15/d17/d1e/d25/f2c [0,4194304] 0 2024-02-19T19:08:25.940 INFO:tasks.workunit.client.0.smithi046.stdout:2/277: symlink d5/df/l57 0 2024-02-19T19:08:25.940 INFO:tasks.workunit.client.0.smithi046.stdout:4/341: mknod d6/c6f 0 2024-02-19T19:08:25.941 INFO:tasks.workunit.client.0.smithi046.stdout:4/342: read - d6/d11/f64 zero size 2024-02-19T19:08:25.943 INFO:tasks.workunit.client.0.smithi046.stdout:4/343: rename d6/d15/d17/c46 to d6/d15/d17/d4a/c70 0 2024-02-19T19:08:25.945 INFO:tasks.workunit.client.0.smithi046.stdout:4/344: rmdir d6/d15/d17/d1e/d33/d55 39 2024-02-19T19:08:25.945 INFO:tasks.workunit.client.0.smithi046.stdout:4/345: truncate d6/f1a 4291986 0 2024-02-19T19:08:25.946 INFO:tasks.workunit.client.0.smithi046.stdout:9/180: dwrite db/f1c [0,4194304] 0 2024-02-19T19:08:25.948 INFO:tasks.workunit.client.0.smithi046.stdout:4/346: link d6/d15/d17/d1e/d33/l53 d6/d15/l71 0 2024-02-19T19:08:25.951 INFO:tasks.workunit.client.0.smithi046.stdout:9/181: rename db/c1a to db/c31 0 2024-02-19T19:08:25.963 INFO:tasks.workunit.client.0.smithi046.stdout:9/182: dread f0 [0,4194304] 0 2024-02-19T19:08:25.965 INFO:tasks.workunit.client.0.smithi046.stdout:8/390: dwrite d3/dd/d13/d6b/d46/f74 [0,4194304] 0 2024-02-19T19:08:25.968 INFO:tasks.workunit.client.0.smithi046.stdout:8/391: creat d3/d18/f86 x:0 0 0 2024-02-19T19:08:25.969 INFO:tasks.workunit.client.0.smithi046.stdout:2/278: dwrite d5/d2c/f49 [0,4194304] 0 2024-02-19T19:08:25.971 INFO:tasks.workunit.client.0.smithi046.stdout:8/392: rename d3/dd/d13/d42/f69 to d3/d37/d1d/d3c/f87 0 2024-02-19T19:08:25.971 INFO:tasks.workunit.client.0.smithi046.stdout:8/393: readlink d3/dd/d13/d6b/d36/l63 0 2024-02-19T19:08:25.971 INFO:tasks.workunit.client.0.smithi046.stdout:8/394: write d3/d37/d1d/d3c/f41 [1906279,71323] 0 2024-02-19T19:08:25.974 INFO:tasks.workunit.client.0.smithi046.stdout:4/347: dwrite d6/d15/f48 [0,4194304] 0 2024-02-19T19:08:25.975 INFO:tasks.workunit.client.0.smithi046.stdout:2/279: creat d5/d2c/d56/f58 x:0 0 0 2024-02-19T19:08:25.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/280: symlink d5/d6/l59 0 2024-02-19T19:08:25.980 INFO:tasks.workunit.client.0.smithi046.stdout:8/395: mkdir d3/dd/d3f/d49/d88 0 2024-02-19T19:08:25.980 INFO:tasks.workunit.client.0.smithi046.stdout:8/396: fsync d3/d18/f20 0 2024-02-19T19:08:25.983 INFO:tasks.workunit.client.0.smithi046.stdout:8/397: rename d3/d37/d1d/d3c/f41 to d3/dd/d3f/d49/d5b/d5f/f89 0 2024-02-19T19:08:25.984 INFO:tasks.workunit.client.0.smithi046.stdout:8/398: mkdir d3/dd/d13/d6b/d46/d54/d8a 0 2024-02-19T19:08:26.029 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:25 smithi046 podman[112566]: 2024-02-19 19:08:25.514227094 +0000 UTC m=+0.023369029 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:08:26.036 INFO:tasks.workunit.client.0.smithi046.stdout:9/183: dwrite db/f24 [0,4194304] 0 2024-02-19T19:08:26.037 INFO:tasks.workunit.client.0.smithi046.stdout:9/184: read db/d1e/f1f [732888,45302] 0 2024-02-19T19:08:26.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/185: mkdir db/d1e/d32 0 2024-02-19T19:08:26.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/186: dread db/f19 [0,4194304] 0 2024-02-19T19:08:26.041 INFO:tasks.workunit.client.0.smithi046.stdout:4/348: dread d6/d15/d17/d1e/d33/d55/f5d [0,4194304] 0 2024-02-19T19:08:26.043 INFO:tasks.workunit.client.0.smithi046.stdout:9/187: truncate db/f1c 3213514 0 2024-02-19T19:08:26.049 INFO:tasks.workunit.client.0.smithi046.stdout:2/281: dread d5/df/f28 [0,4194304] 0 2024-02-19T19:08:26.049 INFO:tasks.workunit.client.0.smithi046.stdout:2/282: write d5/f30 [1345630,32316] 0 2024-02-19T19:08:26.051 INFO:tasks.workunit.client.0.smithi046.stdout:2/283: mkdir d5/d2c/d56/d5a 0 2024-02-19T19:08:26.052 INFO:tasks.workunit.client.0.smithi046.stdout:8/399: dwrite d3/dd/d3f/f60 [0,4194304] 0 2024-02-19T19:08:26.052 INFO:tasks.workunit.client.0.smithi046.stdout:2/284: rename d5/d6/l3e to d5/d2c/d56/d5a/l5b 0 2024-02-19T19:08:26.052 INFO:tasks.workunit.client.0.smithi046.stdout:2/285: readlink d5/d6/l3b 0 2024-02-19T19:08:26.057 INFO:tasks.workunit.client.0.smithi046.stdout:9/188: dread db/f18 [0,4194304] 0 2024-02-19T19:08:26.057 INFO:tasks.workunit.client.0.smithi046.stdout:8/400: mkdir d3/d8b 0 2024-02-19T19:08:26.057 INFO:tasks.workunit.client.0.smithi046.stdout:4/349: dwrite d6/d11/d26/f28 [0,4194304] 0 2024-02-19T19:08:26.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/401: creat d3/dd/d13/d6b/d46/d54/d8a/f8c x:0 0 0 2024-02-19T19:08:26.059 INFO:tasks.workunit.client.0.smithi046.stdout:4/350: rename d6/d15/d17/f20 to d6/d15/f72 0 2024-02-19T19:08:26.061 INFO:tasks.workunit.client.0.smithi046.stdout:8/402: truncate d3/dd/f24 5149460 0 2024-02-19T19:08:26.061 INFO:tasks.workunit.client.0.smithi046.stdout:9/189: write db/d20/f2c [2530012,21149] 0 2024-02-19T19:08:26.063 INFO:tasks.workunit.client.0.smithi046.stdout:9/190: getdents db/d1e 0 2024-02-19T19:08:26.064 INFO:tasks.workunit.client.0.smithi046.stdout:9/191: readlink db/d20/l21 0 2024-02-19T19:08:26.064 INFO:tasks.workunit.client.0.smithi046.stdout:9/192: readlink db/d1e/l2f 0 2024-02-19T19:08:26.068 INFO:tasks.workunit.client.0.smithi046.stdout:4/351: read d6/d15/d17/f3f [4090104,23212] 0 2024-02-19T19:08:26.070 INFO:tasks.workunit.client.0.smithi046.stdout:4/352: rename d6/d15/d17/f5b to d6/d15/d17/d1e/d33/d55/f73 0 2024-02-19T19:08:26.070 INFO:tasks.workunit.client.0.smithi046.stdout:4/353: chown d6/d15/d17/d1e/d33/d55/f5d 78 1 2024-02-19T19:08:26.072 INFO:tasks.workunit.client.0.smithi046.stdout:4/354: rename d6/f9 to d6/d11/d26/f74 0 2024-02-19T19:08:26.072 INFO:tasks.workunit.client.0.smithi046.stdout:4/355: write d6/f42 [170231,56734] 0 2024-02-19T19:08:26.072 INFO:tasks.workunit.client.0.smithi046.stdout:4/356: chown d6/d15/f5c 163393 1 2024-02-19T19:08:26.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/357: mknod d6/d15/d17/d1e/d33/c75 0 2024-02-19T19:08:26.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/358: chown d6/d15/c69 36 1 2024-02-19T19:08:26.076 INFO:tasks.workunit.client.0.smithi046.stdout:2/286: dwrite d5/df/f1a [0,4194304] 0 2024-02-19T19:08:26.076 INFO:tasks.workunit.client.0.smithi046.stdout:8/403: dread d3/dd/d13/d42/f57 [0,4194304] 0 2024-02-19T19:08:26.078 INFO:tasks.workunit.client.0.smithi046.stdout:9/193: dread db/d1e/f27 [0,4194304] 0 2024-02-19T19:08:26.078 INFO:tasks.workunit.client.0.smithi046.stdout:9/194: creat db/f33 x:0 0 0 2024-02-19T19:08:26.078 INFO:tasks.workunit.client.0.smithi046.stdout:2/287: mkdir d5/df/d3f/d5c 0 2024-02-19T19:08:26.080 INFO:tasks.workunit.client.0.smithi046.stdout:4/359: dread d6/d15/f48 [0,4194304] 0 2024-02-19T19:08:26.080 INFO:tasks.workunit.client.0.smithi046.stdout:4/360: getdents d6/d50 0 2024-02-19T19:08:26.081 INFO:tasks.workunit.client.0.smithi046.stdout:4/361: symlink d6/d15/d17/d1e/d25/l76 0 2024-02-19T19:08:26.087 INFO:tasks.workunit.client.0.smithi046.stdout:2/288: dread d5/d2c/f2e [0,4194304] 0 2024-02-19T19:08:26.088 INFO:tasks.workunit.client.0.smithi046.stdout:9/195: read db/f18 [1994835,48163] 0 2024-02-19T19:08:26.088 INFO:tasks.workunit.client.0.smithi046.stdout:9/196: rename db to db/d1e/d34 22 2024-02-19T19:08:26.089 INFO:tasks.workunit.client.0.smithi046.stdout:8/404: read d3/dd/d13/d6b/d46/f74 [1835369,29307] 0 2024-02-19T19:08:26.089 INFO:tasks.workunit.client.0.smithi046.stdout:9/197: mknod db/d1e/c35 0 2024-02-19T19:08:26.089 INFO:tasks.workunit.client.0.smithi046.stdout:9/198: write db/d20/f2c [3289809,26556] 0 2024-02-19T19:08:26.090 INFO:tasks.workunit.client.0.smithi046.stdout:8/405: mknod d3/dd/d3f/d49/d5b/c8d 0 2024-02-19T19:08:26.091 INFO:tasks.workunit.client.0.smithi046.stdout:8/406: mknod d3/dd/d13/c8e 0 2024-02-19T19:08:26.092 INFO:tasks.workunit.client.0.smithi046.stdout:2/289: dread d5/d6/fa [0,4194304] 0 2024-02-19T19:08:26.097 INFO:tasks.workunit.client.0.smithi046.stdout:9/199: fsync db/f33 0 2024-02-19T19:08:26.099 INFO:tasks.workunit.client.0.smithi046.stdout:8/407: write d3/dd/d13/d6b/d46/d54/f61 [3114404,28969] 0 2024-02-19T19:08:26.101 INFO:tasks.workunit.client.0.smithi046.stdout:8/408: symlink d3/dd/d13/d6b/d36/l8f 0 2024-02-19T19:08:26.102 INFO:tasks.workunit.client.0.smithi046.stdout:8/409: mknod d3/dd/d13/d42/c90 0 2024-02-19T19:08:26.105 INFO:tasks.workunit.client.0.smithi046.stdout:4/362: dwrite d6/d11/d26/f34 [0,4194304] 0 2024-02-19T19:08:26.105 INFO:tasks.workunit.client.0.smithi046.stdout:2/290: dwrite d5/d2c/d45/f54 [0,4194304] 0 2024-02-19T19:08:26.105 INFO:tasks.workunit.client.0.smithi046.stdout:4/363: creat d6/d15/f77 x:0 0 0 2024-02-19T19:08:26.107 INFO:tasks.workunit.client.0.smithi046.stdout:4/364: dread d6/f31 [0,4194304] 0 2024-02-19T19:08:26.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/291: rename d5/l14 to d5/df/d4c/l5d 0 2024-02-19T19:08:26.110 INFO:tasks.workunit.client.0.smithi046.stdout:4/365: rename d6/d11/f43 to d6/d15/d17/f78 0 2024-02-19T19:08:26.110 INFO:tasks.workunit.client.0.smithi046.stdout:4/366: dread - d6/d15/d17/d1e/d33/d55/f73 zero size 2024-02-19T19:08:26.110 INFO:tasks.workunit.client.0.smithi046.stdout:4/367: stat d6/d15/d17/d1e/d33 0 2024-02-19T19:08:26.111 INFO:tasks.workunit.client.0.smithi046.stdout:2/292: creat d5/df/d3f/f5e x:0 0 0 2024-02-19T19:08:26.112 INFO:tasks.workunit.client.0.smithi046.stdout:4/368: link d6/d11/d26/f74 d6/d11/d40/f79 0 2024-02-19T19:08:26.113 INFO:tasks.workunit.client.0.smithi046.stdout:2/293: rmdir d5/df/d3d 39 2024-02-19T19:08:26.113 INFO:tasks.workunit.client.0.smithi046.stdout:2/294: creat d5/d2c/f5f x:0 0 0 2024-02-19T19:08:26.116 INFO:tasks.workunit.client.0.smithi046.stdout:9/200: dwrite db/f18 [0,4194304] 0 2024-02-19T19:08:26.116 INFO:tasks.workunit.client.0.smithi046.stdout:2/295: creat d5/df/d3f/d5c/f60 x:0 0 0 2024-02-19T19:08:26.116 INFO:tasks.workunit.client.0.smithi046.stdout:2/296: stat d5/df/d3d/f41 0 2024-02-19T19:08:26.116 INFO:tasks.workunit.client.0.smithi046.stdout:2/297: dread - d5/d2c/f3c zero size 2024-02-19T19:08:26.117 INFO:tasks.workunit.client.0.smithi046.stdout:9/201: write f7 [4642111,10288] 0 2024-02-19T19:08:26.117 INFO:tasks.workunit.client.0.smithi046.stdout:2/298: getdents d5/df/d3d 0 2024-02-19T19:08:26.117 INFO:tasks.workunit.client.0.smithi046.stdout:2/299: fdatasync d5/d2c/d35/f52 0 2024-02-19T19:08:26.118 INFO:tasks.workunit.client.0.smithi046.stdout:2/300: dread - d5/d6/d13/f16 zero size 2024-02-19T19:08:26.119 INFO:tasks.workunit.client.0.smithi046.stdout:9/202: rename f7 to db/f36 0 2024-02-19T19:08:26.120 INFO:tasks.workunit.client.0.smithi046.stdout:2/301: creat d5/d6/d13/f61 x:0 0 0 2024-02-19T19:08:26.120 INFO:tasks.workunit.client.0.smithi046.stdout:2/302: truncate d5/d2c/d35/f55 433471 0 2024-02-19T19:08:26.121 INFO:tasks.workunit.client.0.smithi046.stdout:9/203: mknod db/d1e/c37 0 2024-02-19T19:08:26.121 INFO:tasks.workunit.client.0.smithi046.stdout:9/204: readlink db/d1e/l2f 0 2024-02-19T19:08:26.122 INFO:tasks.workunit.client.0.smithi046.stdout:2/303: mknod d5/d2c/d56/c62 0 2024-02-19T19:08:26.122 INFO:tasks.workunit.client.0.smithi046.stdout:8/410: dwrite d3/dd/d13/d6b/d46/d54/f61 [4194304,4194304] 0 2024-02-19T19:08:26.124 INFO:tasks.workunit.client.0.smithi046.stdout:8/411: creat d3/dd/d13/d6b/d46/d6a/f91 x:0 0 0 2024-02-19T19:08:26.125 INFO:tasks.workunit.client.0.smithi046.stdout:8/412: mknod d3/d37/d64/c92 0 2024-02-19T19:08:26.126 INFO:tasks.workunit.client.0.smithi046.stdout:8/413: rename d3/dd/d13/d6b/d36/l8f to d3/dd/d13/d6b/d46/d54/d8a/l93 0 2024-02-19T19:08:26.127 INFO:tasks.workunit.client.0.smithi046.stdout:8/414: dread d3/d18/f20 [0,4194304] 0 2024-02-19T19:08:26.128 INFO:tasks.workunit.client.0.smithi046.stdout:8/415: truncate d3/f7 1245614 0 2024-02-19T19:08:26.129 INFO:tasks.workunit.client.0.smithi046.stdout:8/416: rename d3/d37/d1d/l70 to d3/d18/l94 0 2024-02-19T19:08:26.129 INFO:tasks.workunit.client.0.smithi046.stdout:2/304: dread d5/d6/fd [0,4194304] 0 2024-02-19T19:08:26.130 INFO:tasks.workunit.client.0.smithi046.stdout:8/417: symlink d3/dd/l95 0 2024-02-19T19:08:26.130 INFO:tasks.workunit.client.0.smithi046.stdout:8/418: chown d3/d37/d64/f6c 5822 1 2024-02-19T19:08:26.130 INFO:tasks.workunit.client.0.smithi046.stdout:8/419: stat d3/d37/d64/f7a 0 2024-02-19T19:08:26.131 INFO:tasks.workunit.client.0.smithi046.stdout:2/305: link d5/d2c/c31 d5/df/d3f/d5c/c63 0 2024-02-19T19:08:26.132 INFO:tasks.workunit.client.0.smithi046.stdout:2/306: readlink d5/d6/l59 0 2024-02-19T19:08:26.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/420: creat d3/dd/f96 x:0 0 0 2024-02-19T19:08:26.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/421: chown d3/dd/d13/d6b/f28 2 1 2024-02-19T19:08:26.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/422: chown d3/dd/d13/d6b/d46/d54/d8a/l93 867 1 2024-02-19T19:08:26.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/423: creat d3/dd/d13/d6b/d46/d54/f97 x:0 0 0 2024-02-19T19:08:26.134 INFO:tasks.workunit.client.0.smithi046.stdout:2/307: truncate d5/d6/f50 2996337 0 2024-02-19T19:08:26.134 INFO:tasks.workunit.client.0.smithi046.stdout:4/369: dwrite d6/d11/d40/f79 [0,4194304] 0 2024-02-19T19:08:26.134 INFO:tasks.workunit.client.0.smithi046.stdout:9/205: dread f2 [0,4194304] 0 2024-02-19T19:08:26.134 INFO:tasks.workunit.client.0.smithi046.stdout:9/206: chown db/f18 1560 1 2024-02-19T19:08:26.135 INFO:tasks.workunit.client.0.smithi046.stdout:9/207: chown db/c1d 3930567 1 2024-02-19T19:08:26.136 INFO:tasks.workunit.client.0.smithi046.stdout:8/424: mknod d3/d37/d1d/c98 0 2024-02-19T19:08:26.137 INFO:tasks.workunit.client.0.smithi046.stdout:8/425: write d3/d37/f2d [994832,95738] 0 2024-02-19T19:08:26.137 INFO:tasks.workunit.client.0.smithi046.stdout:8/426: fsync d3/d18/f33 0 2024-02-19T19:08:26.137 INFO:tasks.workunit.client.0.smithi046.stdout:8/427: creat d3/dd/d13/d6b/d46/d54/d8a/f99 x:0 0 0 2024-02-19T19:08:26.138 INFO:tasks.workunit.client.0.smithi046.stdout:4/370: link d6/d15/d17/d1e/d25/f2f d6/d15/d17/d1e/f7a 0 2024-02-19T19:08:26.143 INFO:tasks.workunit.client.0.smithi046.stdout:8/428: unlink d3/dd/d13/d6b/d36/f55 0 2024-02-19T19:08:26.143 INFO:tasks.workunit.client.0.smithi046.stdout:8/429: dread - d3/dd/d13/d66/f7b zero size 2024-02-19T19:08:26.144 INFO:tasks.workunit.client.0.smithi046.stdout:2/308: dwrite d5/d2c/d56/f58 [0,4194304] 0 2024-02-19T19:08:26.144 INFO:tasks.workunit.client.0.smithi046.stdout:4/371: stat d6/d15/d17/d1e/d33/l5e 0 2024-02-19T19:08:26.146 INFO:tasks.workunit.client.0.smithi046.stdout:2/309: mknod d5/df/d3f/d5c/c64 0 2024-02-19T19:08:26.146 INFO:tasks.workunit.client.0.smithi046.stdout:2/310: stat d5/d2c/l3a 0 2024-02-19T19:08:26.148 INFO:tasks.workunit.client.0.smithi046.stdout:2/311: symlink d5/d2c/d35/l65 0 2024-02-19T19:08:26.148 INFO:tasks.workunit.client.0.smithi046.stdout:2/312: write d5/f30 [1844979,88905] 0 2024-02-19T19:08:26.149 INFO:tasks.workunit.client.0.smithi046.stdout:4/372: rmdir d6/d11 39 2024-02-19T19:08:26.150 INFO:tasks.workunit.client.0.smithi046.stdout:9/208: dwrite db/f1c [0,4194304] 0 2024-02-19T19:08:26.152 INFO:tasks.workunit.client.0.smithi046.stdout:2/313: creat d5/d2c/d56/d5a/f66 x:0 0 0 2024-02-19T19:08:26.152 INFO:tasks.workunit.client.0.smithi046.stdout:2/314: dread - d5/df/f37 zero size 2024-02-19T19:08:26.152 INFO:tasks.workunit.client.0.smithi046.stdout:2/315: truncate d5/df/d3f/d5c/f60 1027066 0 2024-02-19T19:08:26.152 INFO:tasks.workunit.client.0.smithi046.stdout:2/316: creat d5/d2c/f67 x:0 0 0 2024-02-19T19:08:26.152 INFO:tasks.workunit.client.0.smithi046.stdout:2/317: fdatasync d5/df/f40 0 2024-02-19T19:08:26.156 INFO:tasks.workunit.client.0.smithi046.stdout:9/209: mkdir db/d1e/d32/d38 0 2024-02-19T19:08:26.156 INFO:tasks.workunit.client.0.smithi046.stdout:9/210: fsync db/d1e/f22 0 2024-02-19T19:08:26.156 INFO:tasks.workunit.client.0.smithi046.stdout:9/211: fsync db/d1e/f1f 0 2024-02-19T19:08:26.157 INFO:tasks.workunit.client.0.smithi046.stdout:8/430: write d3/f3a [3031337,129723] 0 2024-02-19T19:08:26.157 INFO:tasks.workunit.client.0.smithi046.stdout:8/431: chown d3/dd 51 1 2024-02-19T19:08:26.161 INFO:tasks.workunit.client.0.smithi046.stdout:9/212: creat db/d20/f39 x:0 0 0 2024-02-19T19:08:26.161 INFO:tasks.workunit.client.0.smithi046.stdout:2/318: dread d5/df/f40 [0,4194304] 0 2024-02-19T19:08:26.161 INFO:tasks.workunit.client.0.smithi046.stdout:4/373: write d6/d11/d26/f74 [2254867,118486] 0 2024-02-19T19:08:26.171 INFO:tasks.workunit.client.0.smithi046.stdout:9/213: rename db/d20/c2d to db/c3a 0 2024-02-19T19:08:26.172 INFO:tasks.workunit.client.0.smithi046.stdout:2/319: symlink d5/d6/d13/l68 0 2024-02-19T19:08:26.173 INFO:tasks.workunit.client.0.smithi046.stdout:4/374: creat d6/d15/d17/d1e/d33/d55/f7b x:0 0 0 2024-02-19T19:08:26.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/320: creat d5/d2c/d35/f69 x:0 0 0 2024-02-19T19:08:26.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/321: chown d5/d2c/d56/c62 1554 1 2024-02-19T19:08:26.176 INFO:tasks.workunit.client.0.smithi046.stdout:2/322: mkdir d5/d6a 0 2024-02-19T19:08:26.176 INFO:tasks.workunit.client.0.smithi046.stdout:2/323: write d5/df/d3d/f41 [2862117,38395] 0 2024-02-19T19:08:26.178 INFO:tasks.workunit.client.0.smithi046.stdout:2/324: unlink d5/df/d3f/d5c/c64 0 2024-02-19T19:08:26.190 INFO:tasks.workunit.client.0.smithi046.stdout:8/432: dwrite d3/dd/fe [0,4194304] 0 2024-02-19T19:08:26.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/433: mkdir d3/d37/d64/d9a 0 2024-02-19T19:08:26.193 INFO:tasks.workunit.client.0.smithi046.stdout:8/434: mkdir d3/d37/d9b 0 2024-02-19T19:08:26.195 INFO:tasks.workunit.client.0.smithi046.stdout:8/435: rename d3/dd/ff to d3/dd/d13/d6b/d36/f9c 0 2024-02-19T19:08:26.196 INFO:tasks.workunit.client.0.smithi046.stdout:8/436: getdents d3/dd/d3f 0 2024-02-19T19:08:26.197 INFO:tasks.workunit.client.0.smithi046.stdout:8/437: truncate d3/dd/d13/d6b/f62 413146 0 2024-02-19T19:08:26.197 INFO:tasks.workunit.client.0.smithi046.stdout:8/438: readlink d3/dd/d13/d6b/d46/d6a/l83 0 2024-02-19T19:08:26.197 INFO:tasks.workunit.client.0.smithi046.stdout:8/439: write d3/dd/d13/d6b/f62 [1081356,27443] 0 2024-02-19T19:08:26.198 INFO:tasks.workunit.client.0.smithi046.stdout:8/440: getdents d3/dd/d13/d42/d72 0 2024-02-19T19:08:26.198 INFO:tasks.workunit.client.0.smithi046.stdout:8/441: chown d3/dd/d3f/d49/c82 260796513 1 2024-02-19T19:08:26.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/442: mkdir d3/d9d 0 2024-02-19T19:08:26.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/443: write d3/dd/d13/d6b/f28 [3465769,4771] 0 2024-02-19T19:08:26.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/444: truncate d3/dd/f96 881175 0 2024-02-19T19:08:26.205 INFO:tasks.workunit.client.0.smithi046.stdout:4/375: dwrite d6/d11/d26/f60 [0,4194304] 0 2024-02-19T19:08:26.206 INFO:tasks.workunit.client.0.smithi046.stdout:4/376: dread - d6/d15/d17/d1e/d33/d55/f73 zero size 2024-02-19T19:08:26.206 INFO:tasks.workunit.client.0.smithi046.stdout:4/377: chown d6/d15/d17/d1e/d33/d55 24432 1 2024-02-19T19:08:26.206 INFO:tasks.workunit.client.0.smithi046.stdout:8/445: write d3/d37/f2e [1815882,43869] 0 2024-02-19T19:08:26.207 INFO:tasks.workunit.client.0.smithi046.stdout:9/214: dwrite db/f24 [0,4194304] 0 2024-02-19T19:08:26.208 INFO:tasks.workunit.client.0.smithi046.stdout:8/446: mknod d3/dd/d3f/d49/d5b/d5f/c9e 0 2024-02-19T19:08:26.208 INFO:tasks.workunit.client.0.smithi046.stdout:8/447: readlink d3/d37/d64/l81 0 2024-02-19T19:08:26.208 INFO:tasks.workunit.client.0.smithi046.stdout:8/448: fsync d3/dd/d13/d6b/d46/d54/f61 0 2024-02-19T19:08:26.208 INFO:tasks.workunit.client.0.smithi046.stdout:8/449: fsync d3/dd/d13/d6b/d36/f4a 0 2024-02-19T19:08:26.208 INFO:tasks.workunit.client.0.smithi046.stdout:2/325: dwrite d5/df/f28 [0,4194304] 0 2024-02-19T19:08:26.208 INFO:tasks.workunit.client.0.smithi046.stdout:4/378: getdents d6/d15/d17 0 2024-02-19T19:08:26.208 INFO:tasks.workunit.client.0.smithi046.stdout:4/379: readlink d6/d15/d17/d1e/l23 0 2024-02-19T19:08:26.212 INFO:tasks.workunit.client.0.smithi046.stdout:9/215: symlink db/l3b 0 2024-02-19T19:08:26.212 INFO:tasks.workunit.client.0.smithi046.stdout:9/216: dread - db/d20/f39 zero size 2024-02-19T19:08:26.212 INFO:tasks.workunit.client.0.smithi046.stdout:8/450: creat d3/d37/d64/d9a/f9f x:0 0 0 2024-02-19T19:08:26.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/380: symlink d6/d15/d6e/l7c 0 2024-02-19T19:08:26.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/217: dwrite db/f36 [0,4194304] 0 2024-02-19T19:08:26.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/218: fsync db/d1e/f26 0 2024-02-19T19:08:26.230 INFO:tasks.workunit.client.0.smithi046.stdout:8/451: dwrite d3/dd/d3f/f7e [0,4194304] 0 2024-02-19T19:08:26.232 INFO:tasks.workunit.client.0.smithi046.stdout:8/452: mkdir d3/dd/d3f/d49/d5b/d5f/da0 0 2024-02-19T19:08:26.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/219: rmdir db 39 2024-02-19T19:08:26.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/220: chown db/d1e 643453980 1 2024-02-19T19:08:26.236 INFO:tasks.workunit.client.0.smithi046.stdout:4/381: dwrite d6/d11/d26/f60 [4194304,4194304] 0 2024-02-19T19:08:26.236 INFO:tasks.workunit.client.0.smithi046.stdout:4/382: write d6/d11/f35 [4406490,72172] 0 2024-02-19T19:08:26.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/383: truncate d6/d11/d26/f34 3685695 0 2024-02-19T19:08:26.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/384: fdatasync d6/d15/d17/d1e/f7a 0 2024-02-19T19:08:26.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/385: readlink d6/d11/d26/l29 0 2024-02-19T19:08:26.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/386: truncate d6/d11/d26/f28 5158778 0 2024-02-19T19:08:26.254 INFO:tasks.workunit.client.0.smithi046.stdout:4/387: write d6/d11/d26/f60 [1686289,109279] 0 2024-02-19T19:08:26.255 INFO:tasks.workunit.client.0.smithi046.stdout:4/388: mknod d6/d15/c7d 0 2024-02-19T19:08:26.257 INFO:tasks.workunit.client.0.smithi046.stdout:8/453: dwrite d3/dd/d13/d6b/f62 [0,4194304] 0 2024-02-19T19:08:26.257 INFO:tasks.workunit.client.0.smithi046.stdout:8/454: readlink d3/d37/d1d/d3c/l78 0 2024-02-19T19:08:26.257 INFO:tasks.workunit.client.0.smithi046.stdout:9/221: dwrite db/f18 [4194304,4194304] 0 2024-02-19T19:08:26.257 INFO:tasks.workunit.client.0.smithi046.stdout:9/222: write db/f36 [4995135,85285] 0 2024-02-19T19:08:26.259 INFO:tasks.workunit.client.0.smithi046.stdout:8/455: write d3/dd/d3f/d49/d5b/d5f/f89 [400191,128579] 0 2024-02-19T19:08:26.262 INFO:tasks.workunit.client.0.smithi046.stdout:9/223: creat db/d20/f3c x:0 0 0 2024-02-19T19:08:26.263 INFO:tasks.workunit.client.0.smithi046.stdout:8/456: link d3/dd/d13/d6b/d36/l5a d3/dd/d13/d6b/d46/d6a/la1 0 2024-02-19T19:08:26.263 INFO:tasks.workunit.client.0.smithi046.stdout:8/457: write d3/d37/d64/d9a/f9f [1036122,68039] 0 2024-02-19T19:08:26.265 INFO:tasks.workunit.client.0.smithi046.stdout:8/458: rename d3/d37/d1d to d3/d37/d64/da2 0 2024-02-19T19:08:26.268 INFO:tasks.workunit.client.0.smithi046.stdout:4/389: dwrite d6/d15/f5c [0,4194304] 0 2024-02-19T19:08:26.274 INFO:tasks.workunit.client.0.smithi046.stdout:9/224: dread db/f1c [0,4194304] 0 2024-02-19T19:08:26.276 INFO:tasks.workunit.client.0.smithi046.stdout:9/225: symlink db/l3d 0 2024-02-19T19:08:26.276 INFO:tasks.workunit.client.0.smithi046.stdout:9/226: truncate db/f1b 217267 0 2024-02-19T19:08:26.277 INFO:tasks.workunit.client.0.smithi046.stdout:8/459: dread d3/dd/d3f/f7e [0,4194304] 0 2024-02-19T19:08:26.279 INFO:tasks.workunit.client.0.smithi046.stdout:9/227: unlink db/f33 0 2024-02-19T19:08:26.281 INFO:tasks.workunit.client.0.smithi046.stdout:9/228: symlink db/d1e/d32/d38/l3e 0 2024-02-19T19:08:26.282 INFO:tasks.workunit.client.0.smithi046.stdout:9/229: creat db/d20/f3f x:0 0 0 2024-02-19T19:08:26.289 INFO:tasks.workunit.client.0.smithi046.stdout:9/230: dread db/d1e/f26 [0,4194304] 0 2024-02-19T19:08:26.289 INFO:tasks.workunit.client.0.smithi046.stdout:9/231: chown db/c3a 0 1 2024-02-19T19:08:26.289 INFO:tasks.workunit.client.0.smithi046.stdout:9/232: chown db/d1e/l2b 9501638 1 2024-02-19T19:08:26.290 INFO:tasks.workunit.client.0.smithi046.stdout:9/233: dread db/f19 [0,4194304] 0 2024-02-19T19:08:26.295 INFO:tasks.workunit.client.0.smithi046.stdout:4/390: dwrite d6/d15/d17/f41 [0,4194304] 0 2024-02-19T19:08:26.296 INFO:tasks.workunit.client.0.smithi046.stdout:4/391: mknod d6/d15/d6e/c7e 0 2024-02-19T19:08:26.298 INFO:tasks.workunit.client.0.smithi046.stdout:8/460: dwrite d3/d37/d64/f6c [0,4194304] 0 2024-02-19T19:08:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:8/461: symlink d3/dd/d13/d42/la3 0 2024-02-19T19:08:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:9/234: dread f0 [4194304,4194304] 0 2024-02-19T19:08:26.301 INFO:tasks.workunit.client.0.smithi046.stdout:8/462: creat d3/dd/d13/d6b/d46/d54/fa4 x:0 0 0 2024-02-19T19:08:26.303 INFO:tasks.workunit.client.0.smithi046.stdout:8/463: creat d3/d37/d64/da2/d3c/fa5 x:0 0 0 2024-02-19T19:08:26.305 INFO:tasks.workunit.client.0.smithi046.stdout:8/464: unlink d3/d37/d64/da2/d3c/l78 0 2024-02-19T19:08:26.315 INFO:tasks.workunit.client.0.smithi046.stdout:9/235: dread db/f18 [4194304,4194304] 0 2024-02-19T19:08:26.319 INFO:tasks.workunit.client.0.smithi046.stdout:9/236: write db/d1e/f22 [1425512,88615] 0 2024-02-19T19:08:26.321 INFO:tasks.workunit.client.0.smithi046.stdout:9/237: mknod db/d1e/d32/d38/c40 0 2024-02-19T19:08:26.323 INFO:tasks.workunit.client.0.smithi046.stdout:1/359: sync 2024-02-19T19:08:26.323 INFO:tasks.workunit.client.0.smithi046.stdout:5/389: sync 2024-02-19T19:08:26.323 INFO:tasks.workunit.client.0.smithi046.stdout:7/435: sync 2024-02-19T19:08:26.323 INFO:tasks.workunit.client.0.smithi046.stdout:6/322: sync 2024-02-19T19:08:26.325 INFO:tasks.workunit.client.0.smithi046.stdout:5/390: unlink d2/dd/d26/d65/c7a 0 2024-02-19T19:08:26.325 INFO:tasks.workunit.client.0.smithi046.stdout:5/391: getdents d2/dd/d29/d72 0 2024-02-19T19:08:26.325 INFO:tasks.workunit.client.0.smithi046.stdout:5/392: fsync d2/dd/f77 0 2024-02-19T19:08:26.325 INFO:tasks.workunit.client.0.smithi046.stdout:5/393: dread - d2/dd/f5c zero size 2024-02-19T19:08:26.325 INFO:tasks.workunit.client.0.smithi046.stdout:5/394: truncate d2/dd/d29/f35 1025061 0 2024-02-19T19:08:26.326 INFO:tasks.workunit.client.0.smithi046.stdout:1/360: link d5/d10/d3b/d4e/f6e d5/d10/d3b/f7d 0 2024-02-19T19:08:26.327 INFO:tasks.workunit.client.0.smithi046.stdout:4/392: dwrite d6/d15/d17/d1e/d25/f2f [0,4194304] 0 2024-02-19T19:08:26.327 INFO:tasks.workunit.client.0.smithi046.stdout:4/393: creat d6/f7f x:0 0 0 2024-02-19T19:08:26.327 INFO:tasks.workunit.client.0.smithi046.stdout:4/394: creat d6/f80 x:0 0 0 2024-02-19T19:08:26.328 INFO:tasks.workunit.client.0.smithi046.stdout:7/436: rmdir d0/d4/d75 39 2024-02-19T19:08:26.328 INFO:tasks.workunit.client.0.smithi046.stdout:7/437: fsync d0/d4/d24/f2e 0 2024-02-19T19:08:26.328 INFO:tasks.workunit.client.0.smithi046.stdout:7/438: chown d0/c2f 3418515 1 2024-02-19T19:08:26.328 INFO:tasks.workunit.client.0.smithi046.stdout:7/439: chown d0/d45/d71/d4b/f72 41826884 1 2024-02-19T19:08:26.328 INFO:tasks.workunit.client.0.smithi046.stdout:7/440: chown d0/d4/c1d 2 1 2024-02-19T19:08:26.328 INFO:tasks.workunit.client.0.smithi046.stdout:0/352: sync 2024-02-19T19:08:26.328 INFO:tasks.workunit.client.0.smithi046.stdout:3/260: sync 2024-02-19T19:08:26.329 INFO:tasks.workunit.client.0.smithi046.stdout:3/261: write da/f25 [31783,113259] 0 2024-02-19T19:08:26.329 INFO:tasks.workunit.client.0.smithi046.stdout:3/262: chown da/d30/c39 109767673 1 2024-02-19T19:08:26.329 INFO:tasks.workunit.client.0.smithi046.stdout:6/323: rename d4/d6/dd/d10/l54 to d4/d6/dd/d10/l6c 0 2024-02-19T19:08:26.329 INFO:tasks.workunit.client.0.smithi046.stdout:6/324: write d4/f39 [689642,44475] 0 2024-02-19T19:08:26.329 INFO:tasks.workunit.client.0.smithi046.stdout:6/325: chown d4/d6/dd/d10/d29/d2d/d35/d3c 343005 1 2024-02-19T19:08:26.331 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:26 smithi046 podman[112566]: 2024-02-19 19:08:26.009107318 +0000 UTC m=+0.518249253 container create a31225ea4dec5652e7294f5f748038ddd30c3c69cb8db11b07039884e06ddebf (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, io.buildah.version=1.33.5) 2024-02-19T19:08:26.332 INFO:tasks.workunit.client.0.smithi046.stdout:4/395: unlink d6/d15/d17/d1e/c36 0 2024-02-19T19:08:26.332 INFO:tasks.workunit.client.0.smithi046.stdout:8/465: dwrite d3/dd/f39 [0,4194304] 0 2024-02-19T19:08:26.332 INFO:tasks.workunit.client.0.smithi046.stdout:8/466: chown d3/dd/d3f/d49/d53/f5e 41565 1 2024-02-19T19:08:26.333 INFO:tasks.workunit.client.0.smithi046.stdout:7/441: rename d0/f49 to d0/d45/d71/d41/d5f/d85/f8a 0 2024-02-19T19:08:26.335 INFO:tasks.workunit.client.0.smithi046.stdout:3/263: mknod da/d30/d38/c42 0 2024-02-19T19:08:26.335 INFO:tasks.workunit.client.0.smithi046.stdout:6/326: truncate d4/d6/f1a 253 0 2024-02-19T19:08:26.335 INFO:tasks.workunit.client.0.smithi046.stdout:3/264: write da/d1d/d10/f2b [1195302,101576] 0 2024-02-19T19:08:26.335 INFO:tasks.workunit.client.0.smithi046.stdout:3/265: chown da/d1d/d10/c32 0 1 2024-02-19T19:08:26.337 INFO:tasks.workunit.client.0.smithi046.stdout:4/396: creat d6/d11/d26/f81 x:0 0 0 2024-02-19T19:08:26.339 INFO:tasks.workunit.client.0.smithi046.stdout:7/442: symlink d0/l8b 0 2024-02-19T19:08:26.339 INFO:tasks.workunit.client.0.smithi046.stdout:7/443: write d0/d45/d56/f6a [8576684,104106] 0 2024-02-19T19:08:26.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/266: symlink da/d30/l43 0 2024-02-19T19:08:26.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/267: write da/d1d/d10/f1e [7320819,90078] 0 2024-02-19T19:08:26.341 INFO:tasks.workunit.client.0.smithi046.stdout:3/268: dread da/f37 [0,4194304] 0 2024-02-19T19:08:26.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/397: rename d6/d15/d17/d1e/d25/l76 to d6/d11/d26/l82 0 2024-02-19T19:08:26.343 INFO:tasks.workunit.client.0.smithi046.stdout:4/398: chown d6/d15/f77 701558870 1 2024-02-19T19:08:26.344 INFO:tasks.workunit.client.0.smithi046.stdout:7/444: truncate d0/d4/f29 208313 0 2024-02-19T19:08:26.350 INFO:tasks.workunit.client.0.smithi046.stdout:8/467: dread d3/d37/d64/f6c [0,4194304] 0 2024-02-19T19:08:26.350 INFO:tasks.workunit.client.0.smithi046.stdout:9/238: dwrite db/d1e/f26 [0,4194304] 0 2024-02-19T19:08:26.352 INFO:tasks.workunit.client.0.smithi046.stdout:5/395: dwrite d2/d27/f4f [0,4194304] 0 2024-02-19T19:08:26.352 INFO:tasks.workunit.client.0.smithi046.stdout:5/396: readlink d2/dd/l12 0 2024-02-19T19:08:26.354 INFO:tasks.workunit.client.0.smithi046.stdout:3/269: unlink da/f15 0 2024-02-19T19:08:26.354 INFO:tasks.workunit.client.0.smithi046.stdout:3/270: write da/d1d/d10/f2e [908172,63183] 0 2024-02-19T19:08:26.356 INFO:tasks.workunit.client.0.smithi046.stdout:7/445: symlink d0/d45/d71/d41/l8c 0 2024-02-19T19:08:26.357 INFO:tasks.workunit.client.0.smithi046.stdout:1/361: fsync d5/d10/d3b/f7d 0 2024-02-19T19:08:26.357 INFO:tasks.workunit.client.0.smithi046.stdout:1/362: dread - d5/d10/d3b/f52 zero size 2024-02-19T19:08:26.371 INFO:tasks.workunit.client.0.smithi046.stdout:1/363: write d5/d13/f31 [3036825,79875] 0 2024-02-19T19:08:26.373 INFO:tasks.workunit.client.0.smithi046.stdout:4/399: dwrite d6/d11/f66 [0,4194304] 0 2024-02-19T19:08:26.374 INFO:tasks.workunit.client.0.smithi046.stdout:5/397: dwrite d2/f2b [4194304,4194304] 0 2024-02-19T19:08:26.377 INFO:tasks.workunit.client.0.smithi046.stdout:3/271: creat da/d30/f44 x:0 0 0 2024-02-19T19:08:26.378 INFO:tasks.workunit.client.0.smithi046.stdout:7/446: mkdir d0/d45/d71/d4b/d8d 0 2024-02-19T19:08:26.380 INFO:tasks.workunit.client.0.smithi046.stdout:8/468: symlink d3/dd/la6 0 2024-02-19T19:08:26.382 INFO:tasks.workunit.client.0.smithi046.stdout:9/239: rmdir db 39 2024-02-19T19:08:26.382 INFO:tasks.workunit.client.0.smithi046.stdout:4/400: write d6/d15/d17/f41 [2868979,69891] 0 2024-02-19T19:08:26.389 INFO:tasks.workunit.client.0.smithi046.stdout:3/272: symlink da/d1d/d3f/l45 0 2024-02-19T19:08:26.389 INFO:tasks.workunit.client.0.smithi046.stdout:3/273: write da/f25 [646248,90600] 0 2024-02-19T19:08:26.391 INFO:tasks.workunit.client.0.smithi046.stdout:3/274: write da/d1d/d10/f2e [799646,30142] 0 2024-02-19T19:08:26.392 INFO:tasks.workunit.client.0.smithi046.stdout:8/469: symlink d3/d37/la7 0 2024-02-19T19:08:26.392 INFO:tasks.workunit.client.0.smithi046.stdout:9/240: truncate f2 2677014 0 2024-02-19T19:08:26.392 INFO:tasks.workunit.client.0.smithi046.stdout:1/364: rmdir d5/d13/d35/d37/d64/d75 39 2024-02-19T19:08:26.395 INFO:tasks.workunit.client.0.smithi046.stdout:5/398: getdents d2/dd/d2f/d34 0 2024-02-19T19:08:26.396 INFO:tasks.workunit.client.0.smithi046.stdout:7/447: getdents d0/d3f 0 2024-02-19T19:08:26.396 INFO:tasks.workunit.client.0.smithi046.stdout:7/448: write d0/d4/f29 [451399,96643] 0 2024-02-19T19:08:26.399 INFO:tasks.workunit.client.0.smithi046.stdout:8/470: unlink d3/dd/d13/d6b/d36/f9c 0 2024-02-19T19:08:26.402 INFO:tasks.workunit.client.0.smithi046.stdout:9/241: creat db/f41 x:0 0 0 2024-02-19T19:08:26.403 INFO:tasks.workunit.client.0.smithi046.stdout:3/275: dread da/d1d/d10/f26 [4194304,4194304] 0 2024-02-19T19:08:26.403 INFO:tasks.workunit.client.0.smithi046.stdout:3/276: write da/f37 [545781,118158] 0 2024-02-19T19:08:26.404 INFO:tasks.workunit.client.0.smithi046.stdout:7/449: unlink d0/f30 0 2024-02-19T19:08:26.406 INFO:tasks.workunit.client.0.smithi046.stdout:8/471: symlink d3/d37/d64/la8 0 2024-02-19T19:08:26.408 INFO:tasks.workunit.client.0.smithi046.stdout:9/242: mknod db/d20/c42 0 2024-02-19T19:08:26.408 INFO:tasks.workunit.client.0.smithi046.stdout:9/243: fdatasync db/f41 0 2024-02-19T19:08:26.408 INFO:tasks.workunit.client.0.smithi046.stdout:9/244: creat db/f43 x:0 0 0 2024-02-19T19:08:26.409 INFO:tasks.workunit.client.0.smithi046.stdout:4/401: dwrite d6/f1a [0,4194304] 0 2024-02-19T19:08:26.409 INFO:tasks.workunit.client.0.smithi046.stdout:3/277: symlink da/d30/l46 0 2024-02-19T19:08:26.412 INFO:tasks.workunit.client.0.smithi046.stdout:1/365: dwrite d5/d13/d35/d37/f66 [0,4194304] 0 2024-02-19T19:08:26.414 INFO:tasks.workunit.client.0.smithi046.stdout:7/450: creat d0/d45/d4a/d78/f8e x:0 0 0 2024-02-19T19:08:26.414 INFO:tasks.workunit.client.0.smithi046.stdout:7/451: creat d0/d45/d71/d41/d5f/f8f x:0 0 0 2024-02-19T19:08:26.414 INFO:tasks.workunit.client.0.smithi046.stdout:7/452: write d0/d45/d71/d4b/f61 [1798064,122884] 0 2024-02-19T19:08:26.415 INFO:tasks.workunit.client.0.smithi046.stdout:8/472: mknod d3/d37/d64/ca9 0 2024-02-19T19:08:26.423 INFO:tasks.workunit.client.0.smithi046.stdout:7/453: symlink d0/d4/dd/l90 0 2024-02-19T19:08:26.424 INFO:tasks.workunit.client.0.smithi046.stdout:9/245: dread db/f24 [0,4194304] 0 2024-02-19T19:08:26.424 INFO:tasks.workunit.client.0.smithi046.stdout:9/246: fdatasync db/d20/f39 0 2024-02-19T19:08:26.425 INFO:tasks.workunit.client.0.smithi046.stdout:7/454: mkdir d0/d45/d4a/d58/d91 0 2024-02-19T19:08:26.427 INFO:tasks.workunit.client.0.smithi046.stdout:5/399: dwrite d2/dd/d2f/d34/d5d/f43 [0,4194304] 0 2024-02-19T19:08:26.428 INFO:tasks.workunit.client.0.smithi046.stdout:9/247: mknod db/d1e/d32/d38/c44 0 2024-02-19T19:08:26.432 INFO:tasks.workunit.client.0.smithi046.stdout:7/455: link d0/d4/d68/c74 d0/d4/d24/c92 0 2024-02-19T19:08:26.433 INFO:tasks.workunit.client.0.smithi046.stdout:7/456: dread - d0/d45/d4a/d58/f42 zero size 2024-02-19T19:08:26.434 INFO:tasks.workunit.client.0.smithi046.stdout:5/400: symlink d2/dd/d29/l7c 0 2024-02-19T19:08:26.435 INFO:tasks.workunit.client.0.smithi046.stdout:5/401: readlink d2/d27/d47/l67 0 2024-02-19T19:08:26.436 INFO:tasks.workunit.client.0.smithi046.stdout:9/248: rename db/d1e/l29 to db/l45 0 2024-02-19T19:08:26.438 INFO:tasks.workunit.client.0.smithi046.stdout:7/457: rename d0/d45/d71/d41/f77 to d0/d4/dd/d62/f93 0 2024-02-19T19:08:26.440 INFO:tasks.workunit.client.0.smithi046.stdout:9/249: rename c1 to db/d20/c46 0 2024-02-19T19:08:26.441 INFO:tasks.workunit.client.0.smithi046.stdout:7/458: creat d0/d4/dd/d62/f94 x:0 0 0 2024-02-19T19:08:26.443 INFO:tasks.workunit.client.0.smithi046.stdout:9/250: mkdir db/d1e/d32/d47 0 2024-02-19T19:08:26.448 INFO:tasks.workunit.client.0.smithi046.stdout:4/402: dwrite d6/d11/f35 [4194304,4194304] 0 2024-02-19T19:08:26.450 INFO:tasks.workunit.client.0.smithi046.stdout:4/403: rename d6/d15/c69 to d6/d15/d17/d1e/d25/c83 0 2024-02-19T19:08:26.457 INFO:tasks.workunit.client.0.smithi046.stdout:3/278: dwrite da/d1d/d10/f21 [0,4194304] 0 2024-02-19T19:08:26.458 INFO:tasks.workunit.client.0.smithi046.stdout:4/404: dread d6/d11/d26/f2e [0,4194304] 0 2024-02-19T19:08:26.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/279: rename da/lb to da/d30/d38/l47 0 2024-02-19T19:08:26.460 INFO:tasks.workunit.client.0.smithi046.stdout:4/405: mknod d6/d15/c84 0 2024-02-19T19:08:26.460 INFO:tasks.workunit.client.0.smithi046.stdout:4/406: creat d6/d15/d17/d4a/f85 x:0 0 0 2024-02-19T19:08:26.460 INFO:tasks.workunit.client.0.smithi046.stdout:4/407: creat d6/d15/d17/d1e/d33/d55/f86 x:0 0 0 2024-02-19T19:08:26.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/280: rename da/d30/d38/c42 to da/d1d/c48 0 2024-02-19T19:08:26.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/281: write da/f25 [650451,31380] 0 2024-02-19T19:08:26.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/282: write da/d1d/d10/f2e [41425,113070] 0 2024-02-19T19:08:26.463 INFO:tasks.workunit.client.0.smithi046.stdout:4/408: unlink d6/d15/d17/d1e/d33/d55/f7b 0 2024-02-19T19:08:26.463 INFO:tasks.workunit.client.0.smithi046.stdout:1/366: dwrite d5/f17 [0,4194304] 0 2024-02-19T19:08:26.463 INFO:tasks.workunit.client.0.smithi046.stdout:3/283: rmdir da/d1d/d3f 39 2024-02-19T19:08:26.464 INFO:tasks.workunit.client.0.smithi046.stdout:8/473: dwrite d3/dd/d13/d6b/d46/d54/d8a/f8c [0,4194304] 0 2024-02-19T19:08:26.464 INFO:tasks.workunit.client.0.smithi046.stdout:3/284: write da/d30/d38/f3e [899433,118573] 0 2024-02-19T19:08:26.464 INFO:tasks.workunit.client.0.smithi046.stdout:9/251: dwrite db/f36 [0,4194304] 0 2024-02-19T19:08:26.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/402: dwrite d2/dd/d29/f45 [4194304,4194304] 0 2024-02-19T19:08:26.464 INFO:tasks.workunit.client.0.smithi046.stdout:9/252: write db/f36 [5322158,81083] 0 2024-02-19T19:08:26.464 INFO:tasks.workunit.client.0.smithi046.stdout:9/253: truncate db/f1c 4412510 0 2024-02-19T19:08:26.465 INFO:tasks.workunit.client.0.smithi046.stdout:1/367: truncate d5/d13/d35/f36 1154210 0 2024-02-19T19:08:26.468 INFO:tasks.workunit.client.0.smithi046.stdout:3/285: symlink da/d30/d38/l49 0 2024-02-19T19:08:26.468 INFO:tasks.workunit.client.0.smithi046.stdout:3/286: creat da/d30/d38/f4a x:0 0 0 2024-02-19T19:08:26.469 INFO:tasks.workunit.client.0.smithi046.stdout:8/474: symlink d3/dd/d3f/d49/d5b/laa 0 2024-02-19T19:08:26.471 INFO:tasks.workunit.client.0.smithi046.stdout:4/409: dread d6/d15/d17/d1e/d25/f2f [0,4194304] 0 2024-02-19T19:08:26.471 INFO:tasks.workunit.client.0.smithi046.stdout:5/403: symlink d2/d27/d47/d54/d57/l7d 0 2024-02-19T19:08:26.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/254: link db/c31 db/d1e/d32/d38/c48 0 2024-02-19T19:08:26.475 INFO:tasks.workunit.client.0.smithi046.stdout:1/368: rmdir d5 39 2024-02-19T19:08:26.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/287: dread da/d1d/d10/f26 [0,4194304] 0 2024-02-19T19:08:26.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/288: write da/d30/f44 [718703,111643] 0 2024-02-19T19:08:26.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/289: chown da/d1d/d10/f2e 32557 1 2024-02-19T19:08:26.478 INFO:tasks.workunit.client.0.smithi046.stdout:8/475: creat d3/fab x:0 0 0 2024-02-19T19:08:26.481 INFO:tasks.workunit.client.0.smithi046.stdout:5/404: unlink d2/dd/d3f/f75 0 2024-02-19T19:08:26.481 INFO:tasks.workunit.client.0.smithi046.stdout:7/459: truncate d0/d3f/f5c 487945 0 2024-02-19T19:08:26.482 INFO:tasks.workunit.client.0.smithi046.stdout:7/460: fdatasync d0/f18 0 2024-02-19T19:08:26.482 INFO:tasks.workunit.client.0.smithi046.stdout:7/461: fsync d0/d45/d71/d41/f6d 0 2024-02-19T19:08:26.483 INFO:tasks.workunit.client.0.smithi046.stdout:9/255: creat db/d1e/f49 x:0 0 0 2024-02-19T19:08:26.483 INFO:tasks.workunit.client.0.smithi046.stdout:9/256: write db/d20/f2c [321400,17596] 0 2024-02-19T19:08:26.484 INFO:tasks.workunit.client.0.smithi046.stdout:7/462: symlink d0/d4/d75/l95 0 2024-02-19T19:08:26.484 INFO:tasks.workunit.client.0.smithi046.stdout:7/463: stat d0/d4/dd 0 2024-02-19T19:08:26.485 INFO:tasks.workunit.client.0.smithi046.stdout:3/290: dread da/d1d/d10/f2e [0,4194304] 0 2024-02-19T19:08:26.485 INFO:tasks.workunit.client.0.smithi046.stdout:3/291: stat da/d30 0 2024-02-19T19:08:26.486 INFO:tasks.workunit.client.0.smithi046.stdout:9/257: rename db/c3a to db/d1e/c4a 0 2024-02-19T19:08:26.486 INFO:tasks.workunit.client.0.smithi046.stdout:9/258: creat db/f4b x:0 0 0 2024-02-19T19:08:26.487 INFO:tasks.workunit.client.0.smithi046.stdout:9/259: chown db/d1e 1866 1 2024-02-19T19:08:26.487 INFO:tasks.workunit.client.0.smithi046.stdout:7/464: symlink d0/d45/d4a/d58/l96 0 2024-02-19T19:08:26.493 INFO:tasks.workunit.client.0.smithi046.stdout:3/292: mknod da/c4b 0 2024-02-19T19:08:26.493 INFO:tasks.workunit.client.0.smithi046.stdout:4/410: fsync d6/d15/d17/d1e/d33/d55/f86 0 2024-02-19T19:08:26.494 INFO:tasks.workunit.client.0.smithi046.stdout:4/411: dread d6/d11/d26/f57 [0,4194304] 0 2024-02-19T19:08:26.494 INFO:tasks.workunit.client.0.smithi046.stdout:4/412: fsync d6/d11/d26/f34 0 2024-02-19T19:08:26.497 INFO:tasks.workunit.client.0.smithi046.stdout:3/293: creat da/d1d/d10/f4c x:0 0 0 2024-02-19T19:08:26.501 INFO:tasks.workunit.client.0.smithi046.stdout:4/413: unlink d6/f31 0 2024-02-19T19:08:26.501 INFO:tasks.workunit.client.0.smithi046.stdout:4/414: getdents d6/d15/d17 0 2024-02-19T19:08:26.501 INFO:tasks.workunit.client.0.smithi046.stdout:4/415: chown d6/f7f 134 1 2024-02-19T19:08:26.503 INFO:tasks.workunit.client.0.smithi046.stdout:4/416: symlink d6/d11/d26/l87 0 2024-02-19T19:08:26.503 INFO:tasks.workunit.client.0.smithi046.stdout:4/417: truncate d6/f80 588620 0 2024-02-19T19:08:26.503 INFO:tasks.workunit.client.0.smithi046.stdout:7/465: dread d0/d45/d4a/f4e [0,4194304] 0 2024-02-19T19:08:26.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/466: unlink d0/d45/d71/c50 0 2024-02-19T19:08:26.508 INFO:tasks.workunit.client.0.smithi046.stdout:7/467: creat d0/d45/d71/d41/d5f/d85/f97 x:0 0 0 2024-02-19T19:08:26.509 INFO:tasks.workunit.client.0.smithi046.stdout:7/468: truncate d0/d45/d56/f6a 8871459 0 2024-02-19T19:08:26.509 INFO:tasks.workunit.client.0.smithi046.stdout:7/469: read d0/d4/dd/f3a [2463739,13881] 0 2024-02-19T19:08:26.516 INFO:tasks.workunit.client.0.smithi046.stdout:8/476: dwrite d3/d18/f20 [0,4194304] 0 2024-02-19T19:08:26.517 INFO:tasks.workunit.client.0.smithi046.stdout:1/369: dwrite d5/d10/d3b/f5c [0,4194304] 0 2024-02-19T19:08:26.519 INFO:tasks.workunit.client.0.smithi046.stdout:9/260: getdents db/d1e 0 2024-02-19T19:08:26.519 INFO:tasks.workunit.client.0.smithi046.stdout:9/261: dread - db/d20/f3c zero size 2024-02-19T19:08:26.520 INFO:tasks.workunit.client.0.smithi046.stdout:8/477: mkdir d3/d37/d64/da2/dac 0 2024-02-19T19:08:26.524 INFO:tasks.workunit.client.0.smithi046.stdout:9/262: creat db/d1e/f4c x:0 0 0 2024-02-19T19:08:26.524 INFO:tasks.workunit.client.0.smithi046.stdout:9/263: truncate db/d20/f39 408437 0 2024-02-19T19:08:26.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/264: creat db/d1e/d32/f4d x:0 0 0 2024-02-19T19:08:26.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/265: dread - db/d20/f3f zero size 2024-02-19T19:08:26.527 INFO:tasks.workunit.client.0.smithi046.stdout:9/266: getdents db/d1e/d32/d38 0 2024-02-19T19:08:26.530 INFO:tasks.workunit.client.0.smithi046.stdout:5/405: dwrite d2/dd/d2f/f41 [0,4194304] 0 2024-02-19T19:08:26.530 INFO:tasks.workunit.client.0.smithi046.stdout:5/406: truncate d2/dd/f5c 29292 0 2024-02-19T19:08:26.530 INFO:tasks.workunit.client.0.smithi046.stdout:5/407: fdatasync d2/dd/f36 0 2024-02-19T19:08:26.530 INFO:tasks.workunit.client.0.smithi046.stdout:7/470: dwrite d0/ff [0,4194304] 0 2024-02-19T19:08:26.530 INFO:tasks.workunit.client.0.smithi046.stdout:7/471: stat d0/cb 0 2024-02-19T19:08:26.532 INFO:tasks.workunit.client.0.smithi046.stdout:3/294: dread da/d30/d38/f3e [0,4194304] 0 2024-02-19T19:08:26.533 INFO:tasks.workunit.client.0.smithi046.stdout:4/418: dwrite d6/d15/f77 [0,4194304] 0 2024-02-19T19:08:26.533 INFO:tasks.workunit.client.0.smithi046.stdout:4/419: truncate d6/f7f 325523 0 2024-02-19T19:08:26.533 INFO:tasks.workunit.client.0.smithi046.stdout:4/420: rename d6/d15/d17/d1e/d33 to d6/d15/d17/d1e/d33/d55/d88 22 2024-02-19T19:08:26.533 INFO:tasks.workunit.client.0.smithi046.stdout:4/421: chown d6/d15/d17/d1e/d33/d55/f86 12 1 2024-02-19T19:08:26.538 INFO:tasks.workunit.client.0.smithi046.stdout:5/408: write d2/dd/d26/f50 [1615530,8397] 0 2024-02-19T19:08:26.543 INFO:tasks.workunit.client.0.smithi046.stdout:1/370: dwrite d5/d13/f70 [0,4194304] 0 2024-02-19T19:08:26.546 INFO:tasks.workunit.client.0.smithi046.stdout:8/478: dwrite d3/dd/d13/d42/d72/f85 [0,4194304] 0 2024-02-19T19:08:26.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/422: dread d6/d15/f72 [0,4194304] 0 2024-02-19T19:08:26.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/423: fsync d6/f7f 0 2024-02-19T19:08:26.547 INFO:tasks.workunit.client.0.smithi046.stdout:1/371: dread d5/fc [0,4194304] 0 2024-02-19T19:08:26.547 INFO:tasks.workunit.client.0.smithi046.stdout:1/372: creat d5/d13/d35/d37/f7e x:0 0 0 2024-02-19T19:08:26.547 INFO:tasks.workunit.client.0.smithi046.stdout:1/373: creat d5/d13/d35/d37/f7f x:0 0 0 2024-02-19T19:08:26.549 INFO:tasks.workunit.client.0.smithi046.stdout:3/295: unlink da/l13 0 2024-02-19T19:08:26.550 INFO:tasks.workunit.client.0.smithi046.stdout:5/409: mknod d2/d27/d47/c7e 0 2024-02-19T19:08:26.553 INFO:tasks.workunit.client.0.smithi046.stdout:4/424: getdents d6/d15/d17/d1e/d33 0 2024-02-19T19:08:26.553 INFO:tasks.workunit.client.0.smithi046.stdout:4/425: stat d6/d50/c61 0 2024-02-19T19:08:26.553 INFO:tasks.workunit.client.0.smithi046.stdout:4/426: chown d6/d15/d17/f78 6426 1 2024-02-19T19:08:26.556 INFO:tasks.workunit.client.0.smithi046.stdout:1/374: mkdir d5/d10/d2d/d80 0 2024-02-19T19:08:26.556 INFO:tasks.workunit.client.0.smithi046.stdout:1/375: getdents d5/d10/d3b/d4e/d76 0 2024-02-19T19:08:26.557 INFO:tasks.workunit.client.0.smithi046.stdout:3/296: truncate da/d1d/d10/f26 2983161 0 2024-02-19T19:08:26.559 INFO:tasks.workunit.client.0.smithi046.stdout:5/410: mkdir d2/d27/d47/d7f 0 2024-02-19T19:08:26.561 INFO:tasks.workunit.client.0.smithi046.stdout:8/479: link d3/dd/d13/d6b/l77 d3/d8b/lad 0 2024-02-19T19:08:26.561 INFO:tasks.workunit.client.0.smithi046.stdout:8/480: readlink d3/dd/d13/d42/la3 0 2024-02-19T19:08:26.562 INFO:tasks.workunit.client.0.smithi046.stdout:1/376: truncate d5/d21/f23 74499 0 2024-02-19T19:08:26.562 INFO:tasks.workunit.client.0.smithi046.stdout:1/377: fsync d5/d10/d3b/d4e/f6e 0 2024-02-19T19:08:26.562 INFO:tasks.workunit.client.0.smithi046.stdout:1/378: readlink d5/d13/d35/d37/d64/l67 0 2024-02-19T19:08:26.562 INFO:tasks.workunit.client.0.smithi046.stdout:3/297: rename da/d1d/c48 to da/d1d/c4d 0 2024-02-19T19:08:26.563 INFO:tasks.workunit.client.0.smithi046.stdout:5/411: unlink d2/dd/d3f/l4c 0 2024-02-19T19:08:26.565 INFO:tasks.workunit.client.0.smithi046.stdout:5/412: getdents d2/d5e 0 2024-02-19T19:08:26.565 INFO:tasks.workunit.client.0.smithi046.stdout:5/413: fsync d2/f5 0 2024-02-19T19:08:26.567 INFO:tasks.workunit.client.0.smithi046.stdout:5/414: link d2/d27/d47/d54/c59 d2/d27/c80 0 2024-02-19T19:08:26.574 INFO:tasks.workunit.client.0.smithi046.stdout:4/427: read d6/d11/d26/f34 [6137560,18474] 0 2024-02-19T19:08:26.576 INFO:tasks.workunit.client.0.smithi046.stdout:3/298: write da/d1d/d10/f21 [991570,82818] 0 2024-02-19T19:08:26.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/299: unlink da/d1d/d3f/l45 0 2024-02-19T19:08:26.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/300: symlink da/d3b/l4e 0 2024-02-19T19:08:26.579 INFO:tasks.workunit.client.0.smithi046.stdout:3/301: chown da/l2f 30089469 1 2024-02-19T19:08:26.579 INFO:tasks.workunit.client.0.smithi046.stdout:3/302: write da/d30/d38/f4a [166160,64335] 0 2024-02-19T19:08:26.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/428: dread d6/d15/d17/f78 [4194304,4194304] 0 2024-02-19T19:08:26.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/429: write d6/d11/d26/f34 [9343840,30865] 0 2024-02-19T19:08:26.582 INFO:tasks.workunit.client.0.smithi046.stdout:8/481: dwrite d3/d18/f86 [0,4194304] 0 2024-02-19T19:08:26.582 INFO:tasks.workunit.client.0.smithi046.stdout:4/430: mkdir d6/d11/d26/d89 0 2024-02-19T19:08:26.585 INFO:tasks.workunit.client.0.smithi046.stdout:8/482: mknod d3/d37/d9b/cae 0 2024-02-19T19:08:26.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/415: dwrite d2/f70 [0,4194304] 0 2024-02-19T19:08:26.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/416: stat d2/dd/f77 0 2024-02-19T19:08:26.588 INFO:tasks.workunit.client.0.smithi046.stdout:4/431: rename d6/d15/d17/d1e/d33 to d6/d11/d26/d89/d8a 0 2024-02-19T19:08:26.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/432: rename d6/d11/d26/d89/d8a/d55/f73 to d6/f8b 0 2024-02-19T19:08:26.594 INFO:tasks.workunit.client.0.smithi046.stdout:4/433: creat d6/d11/d26/d89/d8a/f8c x:0 0 0 2024-02-19T19:08:26.594 INFO:tasks.workunit.client.0.smithi046.stdout:4/434: chown d6/d11/d26/d89/d8a/l4e 61 1 2024-02-19T19:08:26.594 INFO:tasks.workunit.client.0.smithi046.stdout:4/435: readlink d6/d15/d17/d1e/l23 0 2024-02-19T19:08:26.594 INFO:tasks.workunit.client.0.smithi046.stdout:4/436: read - d6/d11/f68 zero size 2024-02-19T19:08:26.598 INFO:tasks.workunit.client.0.smithi046.stdout:4/437: read d6/d11/d26/d89/d8a/d55/f5d [1503581,99124] 0 2024-02-19T19:08:26.598 INFO:tasks.workunit.client.0.smithi046.stdout:4/438: readlink d6/d15/d17/d1e/l12 0 2024-02-19T19:08:26.600 INFO:tasks.workunit.client.0.smithi046.stdout:4/439: mkdir d6/d11/d26/d89/d8a/d8d 0 2024-02-19T19:08:26.603 INFO:tasks.workunit.client.0.smithi046.stdout:4/440: unlink d6/d15/d17/d1e/d25/f59 0 2024-02-19T19:08:26.604 INFO:tasks.workunit.client.0.smithi046.stdout:4/441: mkdir d6/d11/d26/d89/d8a/d55/d8e 0 2024-02-19T19:08:26.605 INFO:tasks.workunit.client.0.smithi046.stdout:4/442: rename d6/d11/l2d to d6/d15/d17/d1e/d25/l8f 0 2024-02-19T19:08:26.606 INFO:tasks.workunit.client.0.smithi046.stdout:4/443: truncate d6/d11/d26/f28 1808478 0 2024-02-19T19:08:26.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/444: mknod d6/d11/d26/d89/d8a/d8d/c90 0 2024-02-19T19:08:26.609 INFO:tasks.workunit.client.0.smithi046.stdout:1/379: write d5/d10/d2d/f4b [3478399,30966] 0 2024-02-19T19:08:26.616 INFO:tasks.workunit.client.0.smithi046.stdout:5/417: dwrite d2/f3c [0,4194304] 0 2024-02-19T19:08:26.617 INFO:tasks.workunit.client.0.smithi046.stdout:5/418: creat d2/f81 x:0 0 0 2024-02-19T19:08:26.617 INFO:tasks.workunit.client.0.smithi046.stdout:5/419: creat d2/dd/d29/f82 x:0 0 0 2024-02-19T19:08:26.617 INFO:tasks.workunit.client.0.smithi046.stdout:5/420: chown d2/dd/f77 209788830 1 2024-02-19T19:08:26.617 INFO:tasks.workunit.client.0.smithi046.stdout:8/483: dwrite d3/d18/f1a [0,4194304] 0 2024-02-19T19:08:26.617 INFO:tasks.workunit.client.0.smithi046.stdout:5/421: dread d2/dd/d29/f2a [0,4194304] 0 2024-02-19T19:08:26.619 INFO:tasks.workunit.client.0.smithi046.stdout:4/445: rename d6/f8b to d6/d11/d26/d89/f91 0 2024-02-19T19:08:26.622 INFO:tasks.workunit.client.0.smithi046.stdout:1/380: write d5/d21/f34 [5185168,60733] 0 2024-02-19T19:08:26.624 INFO:tasks.workunit.client.0.smithi046.stdout:8/484: symlink d3/d9d/laf 0 2024-02-19T19:08:26.625 INFO:tasks.workunit.client.0.smithi046.stdout:4/446: write d6/d15/d17/d1e/d25/f2f [492818,46373] 0 2024-02-19T19:08:26.631 INFO:tasks.workunit.client.0.smithi046.stdout:5/422: read d2/dd/d26/f48 [3585977,123982] 0 2024-02-19T19:08:26.631 INFO:tasks.workunit.client.0.smithi046.stdout:5/423: fdatasync d2/f16 0 2024-02-19T19:08:26.642 INFO:tasks.workunit.client.0.smithi046.stdout:4/447: mkdir d6/d11/d92 0 2024-02-19T19:08:26.642 INFO:tasks.workunit.client.0.smithi046.stdout:4/448: write d6/d15/d17/d1e/d25/f2f [1197355,109662] 0 2024-02-19T19:08:26.643 INFO:tasks.workunit.client.0.smithi046.stdout:5/424: symlink d2/d5e/l83 0 2024-02-19T19:08:26.645 INFO:tasks.workunit.client.0.smithi046.stdout:5/425: dread d2/dd/d2f/d34/d5d/f61 [0,4194304] 0 2024-02-19T19:08:26.658 INFO:tasks.workunit.client.0.smithi046.stdout:8/485: rmdir d3/d37/d64/d9a 39 2024-02-19T19:08:26.660 INFO:tasks.workunit.client.0.smithi046.stdout:5/426: creat d2/d5e/f84 x:0 0 0 2024-02-19T19:08:26.660 INFO:tasks.workunit.client.0.smithi046.stdout:5/427: read d2/f2d [676856,101032] 0 2024-02-19T19:08:26.663 INFO:tasks.workunit.client.0.smithi046.stdout:1/381: rename d5/d10/d2d to d5/d10/d55/d81 0 2024-02-19T19:08:26.665 INFO:tasks.workunit.client.0.smithi046.stdout:8/486: mknod d3/d18/cb0 0 2024-02-19T19:08:26.665 INFO:tasks.workunit.client.0.smithi046.stdout:8/487: write d3/dd/d3f/d49/d53/f5e [839343,67053] 0 2024-02-19T19:08:26.669 INFO:tasks.workunit.client.0.smithi046.stdout:8/488: read d3/dd/f14 [304027,108408] 0 2024-02-19T19:08:26.686 INFO:tasks.workunit.client.0.smithi046.stdout:1/382: dwrite d5/d10/d3b/d3c/d3f/f43 [0,4194304] 0 2024-02-19T19:08:26.689 INFO:tasks.workunit.client.0.smithi046.stdout:8/489: dwrite d3/d37/f2d [0,4194304] 0 2024-02-19T19:08:26.692 INFO:tasks.workunit.client.0.smithi046.stdout:1/383: mknod d5/d13/c82 0 2024-02-19T19:08:26.692 INFO:tasks.workunit.client.0.smithi046.stdout:1/384: creat d5/d13/f83 x:0 0 0 2024-02-19T19:08:26.694 INFO:tasks.workunit.client.0.smithi046.stdout:8/490: getdents d3/dd/d3f/d49/d5b/d5f 0 2024-02-19T19:08:26.698 INFO:tasks.workunit.client.0.smithi046.stdout:5/428: creat d2/f85 x:0 0 0 2024-02-19T19:08:26.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/385: rmdir d5/d13/d35/d37/d64 39 2024-02-19T19:08:26.700 INFO:tasks.workunit.client.0.smithi046.stdout:8/491: dread d3/d37/d64/d9a/f9f [0,4194304] 0 2024-02-19T19:08:26.700 INFO:tasks.workunit.client.0.smithi046.stdout:4/449: mknod d6/c93 0 2024-02-19T19:08:26.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/386: mknod d5/d10/d55/c84 0 2024-02-19T19:08:26.701 INFO:tasks.workunit.client.0.smithi046.stdout:5/429: dread d2/f2d [0,4194304] 0 2024-02-19T19:08:26.702 INFO:tasks.workunit.client.0.smithi046.stdout:5/430: stat d2/dd/l12 0 2024-02-19T19:08:26.702 INFO:tasks.workunit.client.0.smithi046.stdout:8/492: rename d3/dd/d3f/d49/d88 to d3/dd/d3f/d49/d5b/d5f/db1 0 2024-02-19T19:08:26.704 INFO:tasks.workunit.client.0.smithi046.stdout:5/431: symlink d2/dd/l86 0 2024-02-19T19:08:26.705 INFO:tasks.workunit.client.0.smithi046.stdout:1/387: rename d5/d2f/c30 to d5/d13/d35/d37/d64/c85 0 2024-02-19T19:08:26.705 INFO:tasks.workunit.client.0.smithi046.stdout:1/388: chown d5 6 1 2024-02-19T19:08:26.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/389: readlink d5/d13/d35/d37/d64/l67 0 2024-02-19T19:08:26.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/390: dread - d5/d13/f83 zero size 2024-02-19T19:08:26.706 INFO:tasks.workunit.client.0.smithi046.stdout:8/493: mkdir d3/dd/d13/d6b/d46/d6a/db2 0 2024-02-19T19:08:26.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/432: mknod d2/dd/d29/d3b/c87 0 2024-02-19T19:08:26.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/433: fsync d2/dd/f1c 0 2024-02-19T19:08:26.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/434: chown d2/d27/d47/d54/f56 14337 1 2024-02-19T19:08:26.708 INFO:tasks.workunit.client.0.smithi046.stdout:1/391: rmdir d5/d10/d55/d81 39 2024-02-19T19:08:26.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/494: creat d3/dd/d3f/d49/d5b/d5f/da0/fb3 x:0 0 0 2024-02-19T19:08:26.711 INFO:tasks.workunit.client.0.smithi046.stdout:8/495: unlink d3/dd/d13/c2c 0 2024-02-19T19:08:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/496: rename d3/dd/d13/d6b/f48 to d3/d37/d64/da2/dac/fb4 0 2024-02-19T19:08:26.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/497: fsync d3/f44 0 2024-02-19T19:08:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:8/498: chown d3/dd/d13/d6b/d46/d6a/c7c 223227 1 2024-02-19T19:08:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:8/499: read - d3/dd/d13/d66/f7b zero size 2024-02-19T19:08:26.716 INFO:tasks.workunit.client.0.smithi046.stdout:4/450: dwrite d6/d15/d17/f78 [4194304,4194304] 0 2024-02-19T19:08:26.717 INFO:tasks.workunit.client.0.smithi046.stdout:1/392: dread d5/d13/d35/f41 [0,4194304] 0 2024-02-19T19:08:26.717 INFO:tasks.workunit.client.0.smithi046.stdout:1/393: readlink d5/d10/l1d 0 2024-02-19T19:08:26.718 INFO:tasks.workunit.client.0.smithi046.stdout:5/435: dread d2/dd/d2f/d34/f74 [4194304,4194304] 0 2024-02-19T19:08:26.718 INFO:tasks.workunit.client.0.smithi046.stdout:5/436: fsync d2/f81 0 2024-02-19T19:08:26.718 INFO:tasks.workunit.client.0.smithi046.stdout:5/437: chown d2/dd/d3f 2 1 2024-02-19T19:08:26.718 INFO:tasks.workunit.client.0.smithi046.stdout:4/451: mkdir d6/d94 0 2024-02-19T19:08:26.719 INFO:tasks.workunit.client.0.smithi046.stdout:5/438: creat d2/dd/d26/d65/d5f/f88 x:0 0 0 2024-02-19T19:08:26.720 INFO:tasks.workunit.client.0.smithi046.stdout:4/452: symlink d6/d11/d40/l95 0 2024-02-19T19:08:26.722 INFO:tasks.workunit.client.0.smithi046.stdout:4/453: symlink d6/d11/d26/d89/d8a/d55/d8e/l96 0 2024-02-19T19:08:26.722 INFO:tasks.workunit.client.0.smithi046.stdout:4/454: write d6/f42 [1175014,4376] 0 2024-02-19T19:08:26.722 INFO:tasks.workunit.client.0.smithi046.stdout:4/455: stat d6/d15/d17/d1e/d25/f2f 0 2024-02-19T19:08:26.723 INFO:tasks.workunit.client.0.smithi046.stdout:4/456: write d6/d11/d26/d89/d8a/f38 [675759,43629] 0 2024-02-19T19:08:26.724 INFO:tasks.workunit.client.0.smithi046.stdout:1/394: dread d5/f27 [0,4194304] 0 2024-02-19T19:08:26.726 INFO:tasks.workunit.client.0.smithi046.stdout:1/395: creat d5/d13/d35/d37/d64/d75/f86 x:0 0 0 2024-02-19T19:08:26.728 INFO:tasks.workunit.client.0.smithi046.stdout:1/396: write d5/d2f/d5e/f62 [347504,52138] 0 2024-02-19T19:08:26.728 INFO:tasks.workunit.client.0.smithi046.stdout:1/397: dread - d5/d10/d3b/f7d zero size 2024-02-19T19:08:26.728 INFO:tasks.workunit.client.0.smithi046.stdout:1/398: rmdir d5 39 2024-02-19T19:08:26.733 INFO:tasks.workunit.client.0.smithi046.stdout:5/439: rmdir d2/dd/d29 39 2024-02-19T19:08:26.733 INFO:tasks.workunit.client.0.smithi046.stdout:5/440: fsync d2/dd/d29/f45 0 2024-02-19T19:08:26.733 INFO:tasks.workunit.client.0.smithi046.stdout:8/500: dwrite d3/d37/d64/f6c [0,4194304] 0 2024-02-19T19:08:26.733 INFO:tasks.workunit.client.0.smithi046.stdout:8/501: stat d3/d37/d64/c4f 0 2024-02-19T19:08:26.736 INFO:tasks.workunit.client.0.smithi046.stdout:1/399: mkdir d5/d13/d35/d37/d64/d87 0 2024-02-19T19:08:26.738 INFO:tasks.workunit.client.0.smithi046.stdout:5/441: mkdir d2/dd/d29/d89 0 2024-02-19T19:08:26.741 INFO:tasks.workunit.client.0.smithi046.stdout:4/457: dwrite d6/d11/d26/f81 [0,4194304] 0 2024-02-19T19:08:26.741 INFO:tasks.workunit.client.0.smithi046.stdout:2/326: sync 2024-02-19T19:08:26.741 INFO:tasks.workunit.client.0.smithi046.stdout:2/327: chown d5/d6/d13 1902304 1 2024-02-19T19:08:26.742 INFO:tasks.workunit.client.0.smithi046.stdout:5/442: creat d2/d27/d47/d7f/f8a x:0 0 0 2024-02-19T19:08:26.742 INFO:tasks.workunit.client.0.smithi046.stdout:5/443: write d2/f4a [1063414,51530] 0 2024-02-19T19:08:26.742 INFO:tasks.workunit.client.0.smithi046.stdout:5/444: chown d2/dd/d29/f45 0 1 2024-02-19T19:08:26.745 INFO:tasks.workunit.client.0.smithi046.stdout:4/458: rename d6/d15/d17/d1e/d25/f2c to d6/f97 0 2024-02-19T19:08:26.746 INFO:tasks.workunit.client.0.smithi046.stdout:4/459: mknod d6/d15/d17/d4a/c98 0 2024-02-19T19:08:26.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/502: dwrite d3/dd/d13/d6b/d46/d54/f6f [0,4194304] 0 2024-02-19T19:08:26.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/503: truncate d3/dd/d13/d6b/d46/d6a/f91 342437 0 2024-02-19T19:08:26.753 INFO:tasks.workunit.client.0.smithi046.stdout:8/504: symlink d3/d37/d64/da2/lb5 0 2024-02-19T19:08:26.755 INFO:tasks.workunit.client.0.smithi046.stdout:8/505: dread d3/f10 [0,4194304] 0 2024-02-19T19:08:26.755 INFO:tasks.workunit.client.0.smithi046.stdout:8/506: chown d3/d37 49692 1 2024-02-19T19:08:26.759 INFO:tasks.workunit.client.0.smithi046.stdout:2/328: dwrite d5/d2c/f3c [0,4194304] 0 2024-02-19T19:08:26.762 INFO:tasks.workunit.client.0.smithi046.stdout:2/329: mknod d5/d6/d13/c6b 0 2024-02-19T19:08:26.762 INFO:tasks.workunit.client.0.smithi046.stdout:2/330: chown d5/d2c/f67 173730 1 2024-02-19T19:08:26.762 INFO:tasks.workunit.client.0.smithi046.stdout:2/331: fdatasync d5/d2c/f49 0 2024-02-19T19:08:26.763 INFO:tasks.workunit.client.0.smithi046.stdout:8/507: write d3/dd/d3f/f60 [1216868,96965] 0 2024-02-19T19:08:26.763 INFO:tasks.workunit.client.0.smithi046.stdout:8/508: chown d3/d37/d64/l81 6747 1 2024-02-19T19:08:26.763 INFO:tasks.workunit.client.0.smithi046.stdout:2/332: mknod d5/df/d3d/c6c 0 2024-02-19T19:08:26.763 INFO:tasks.workunit.client.0.smithi046.stdout:2/333: dread - d5/d2c/f67 zero size 2024-02-19T19:08:26.764 INFO:tasks.workunit.client.0.smithi046.stdout:8/509: mkdir d3/d37/d64/da2/d3c/db6 0 2024-02-19T19:08:26.790 INFO:tasks.workunit.client.0.smithi046.stdout:2/334: dwrite d5/f38 [0,4194304] 0 2024-02-19T19:08:26.790 INFO:tasks.workunit.client.0.smithi046.stdout:2/335: chown d5/df/l42 10062387 1 2024-02-19T19:08:26.792 INFO:tasks.workunit.client.0.smithi046.stdout:8/510: dwrite d3/dd/d13/f1b [0,4194304] 0 2024-02-19T19:08:26.794 INFO:tasks.workunit.client.0.smithi046.stdout:8/511: mknod d3/d37/d64/cb7 0 2024-02-19T19:08:26.794 INFO:tasks.workunit.client.0.smithi046.stdout:8/512: chown d3/dd/d13/d6b/d36/l3b 365547348 1 2024-02-19T19:08:26.806 INFO:tasks.workunit.client.0.smithi046.stdout:2/336: dwrite d5/df/d3f/f5e [0,4194304] 0 2024-02-19T19:08:26.806 INFO:tasks.workunit.client.0.smithi046.stdout:2/337: readlink d5/d6/d13/l68 0 2024-02-19T19:08:26.808 INFO:tasks.workunit.client.0.smithi046.stdout:8/513: dwrite d3/dd/d13/d6b/d46/d54/f56 [0,4194304] 0 2024-02-19T19:08:26.809 INFO:tasks.workunit.client.0.smithi046.stdout:2/338: rename d5/d2c/f2e to d5/df/f6d 0 2024-02-19T19:08:26.811 INFO:tasks.workunit.client.0.smithi046.stdout:8/514: fsync d3/dd/d3f/f60 0 2024-02-19T19:08:26.811 INFO:tasks.workunit.client.0.smithi046.stdout:8/515: fdatasync d3/dd/f24 0 2024-02-19T19:08:26.817 INFO:tasks.workunit.client.0.smithi046.stdout:2/339: write d5/d2c/d56/f58 [29847,46123] 0 2024-02-19T19:08:26.817 INFO:tasks.workunit.client.0.smithi046.stdout:2/340: read - d5/d2c/d35/f69 zero size 2024-02-19T19:08:26.818 INFO:tasks.workunit.client.0.smithi046.stdout:2/341: unlink d5/df/d3f/d5c/f60 0 2024-02-19T19:08:26.819 INFO:tasks.workunit.client.0.smithi046.stdout:2/342: stat d5/d6/d13/l25 0 2024-02-19T19:08:26.826 INFO:tasks.workunit.client.0.smithi046.stdout:2/343: dread d5/df/f6d [0,4194304] 0 2024-02-19T19:08:26.826 INFO:tasks.workunit.client.0.smithi046.stdout:8/516: dwrite d3/dd/f96 [0,4194304] 0 2024-02-19T19:08:26.836 INFO:tasks.workunit.client.0.smithi046.stdout:2/344: dread d5/df/f1b [0,4194304] 0 2024-02-19T19:08:26.836 INFO:tasks.workunit.client.0.smithi046.stdout:2/345: chown d5/d6a 800 1 2024-02-19T19:08:26.846 INFO:tasks.workunit.client.0.smithi046.stdout:2/346: dwrite d5/d2c/d45/f4a [0,4194304] 0 2024-02-19T19:08:26.846 INFO:tasks.workunit.client.0.smithi046.stdout:2/347: readlink d5/d6/d13/l25 0 2024-02-19T19:08:26.847 INFO:tasks.workunit.client.0.smithi046.stdout:2/348: mkdir d5/d6/d6e 0 2024-02-19T19:08:26.849 INFO:tasks.workunit.client.0.smithi046.stdout:2/349: creat d5/df/f6f x:0 0 0 2024-02-19T19:08:26.849 INFO:tasks.workunit.client.0.smithi046.stdout:2/350: write d5/df/f1b [4998056,76412] 0 2024-02-19T19:08:26.849 INFO:tasks.workunit.client.0.smithi046.stdout:2/351: write d5/d6/f23 [413719,30356] 0 2024-02-19T19:08:26.855 INFO:tasks.workunit.client.0.smithi046.stdout:2/352: dread d5/d2c/d45/f54 [0,4194304] 0 2024-02-19T19:08:26.856 INFO:tasks.workunit.client.0.smithi046.stdout:2/353: creat d5/df/d4c/f70 x:0 0 0 2024-02-19T19:08:26.857 INFO:tasks.workunit.client.0.smithi046.stdout:2/354: getdents d5/d2c 0 2024-02-19T19:08:26.857 INFO:tasks.workunit.client.0.smithi046.stdout:2/355: creat d5/df/d3f/f71 x:0 0 0 2024-02-19T19:08:26.858 INFO:tasks.workunit.client.0.smithi046.stdout:2/356: stat d5/d2c/d56/d5a/l5b 0 2024-02-19T19:08:26.865 INFO:tasks.workunit.client.0.smithi046.stdout:2/357: dread d5/df/f28 [0,4194304] 0 2024-02-19T19:08:26.867 INFO:tasks.workunit.client.0.smithi046.stdout:2/358: rmdir d5/d2c/d35 39 2024-02-19T19:08:26.867 INFO:tasks.workunit.client.0.smithi046.stdout:2/359: stat d5/df/f1b 0 2024-02-19T19:08:26.868 INFO:tasks.workunit.client.0.smithi046.stdout:2/360: symlink d5/d2c/l72 0 2024-02-19T19:08:26.869 INFO:tasks.workunit.client.0.smithi046.stdout:2/361: link d5/d2c/d35/f52 d5/d2c/f73 0 2024-02-19T19:08:26.874 INFO:tasks.workunit.client.0.smithi046.stdout:2/362: write d5/df/f6d [2657231,118477] 0 2024-02-19T19:08:26.874 INFO:tasks.workunit.client.0.smithi046.stdout:2/363: creat d5/d2c/d56/f74 x:0 0 0 2024-02-19T19:08:26.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/364: mkdir d5/df/d4c/d75 0 2024-02-19T19:08:26.891 INFO:tasks.workunit.client.0.smithi046.stdout:2/365: dwrite d5/df/d3f/f5e [0,4194304] 0 2024-02-19T19:08:26.898 INFO:tasks.workunit.client.0.smithi046.stdout:2/366: dread d5/df/f40 [0,4194304] 0 2024-02-19T19:08:26.898 INFO:tasks.workunit.client.0.smithi046.stdout:2/367: chown d5/df/f24 427 1 2024-02-19T19:08:26.903 INFO:tasks.workunit.client.0.smithi046.stdout:2/368: dread d5/d2c/d45/f54 [0,4194304] 0 2024-02-19T19:08:26.903 INFO:tasks.workunit.client.0.smithi046.stdout:2/369: stat d5/d2c/d56/d5a/l5b 0 2024-02-19T19:08:26.904 INFO:tasks.workunit.client.0.smithi046.stdout:2/370: symlink d5/df/d4c/d75/l76 0 2024-02-19T19:08:26.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/371: unlink d5/d2c/l3a 0 2024-02-19T19:08:26.908 INFO:tasks.workunit.client.0.smithi046.stdout:0/353: sync 2024-02-19T19:08:26.908 INFO:tasks.workunit.client.0.smithi046.stdout:6/327: sync 2024-02-19T19:08:26.908 INFO:tasks.workunit.client.0.smithi046.stdout:6/328: fsync d4/d6/d1c/d60/f61 0 2024-02-19T19:08:26.922 INFO:tasks.workunit.client.0.smithi046.stdout:2/372: dwrite d5/f30 [0,4194304] 0 2024-02-19T19:08:26.938 INFO:tasks.workunit.client.0.smithi046.stdout:6/329: dwrite d4/d6/d1c/d20/f4d [0,4194304] 0 2024-02-19T19:08:26.938 INFO:tasks.workunit.client.0.smithi046.stdout:0/354: dwrite d0/d24/f4b [0,4194304] 0 2024-02-19T19:08:26.939 INFO:tasks.workunit.client.0.smithi046.stdout:0/355: chown d0/d19/f1a 598473549 1 2024-02-19T19:08:26.939 INFO:tasks.workunit.client.0.smithi046.stdout:0/356: stat d0/d6c 0 2024-02-19T19:08:26.939 INFO:tasks.workunit.client.0.smithi046.stdout:6/330: fdatasync d4/d6/dd/d10/d29/d2d/d35/f5d 0 2024-02-19T19:08:26.939 INFO:tasks.workunit.client.0.smithi046.stdout:2/373: dwrite d5/df/f1a [4194304,4194304] 0 2024-02-19T19:08:26.944 INFO:tasks.workunit.client.0.smithi046.stdout:0/357: unlink d0/f45 0 2024-02-19T19:08:26.945 INFO:tasks.workunit.client.0.smithi046.stdout:6/331: getdents d4/d6/dd/d10/d29/d2d/d35/d3c 0 2024-02-19T19:08:26.945 INFO:tasks.workunit.client.0.smithi046.stdout:6/332: dread - d4/f43 zero size 2024-02-19T19:08:26.946 INFO:tasks.workunit.client.0.smithi046.stdout:2/374: write d5/d2c/d45/f54 [662010,40281] 0 2024-02-19T19:08:26.946 INFO:tasks.workunit.client.0.smithi046.stdout:2/375: readlink d5/d6/l3b 0 2024-02-19T19:08:26.946 INFO:tasks.workunit.client.0.smithi046.stdout:6/333: dread d4/d6/dd/d10/d29/d2d/f49 [0,4194304] 0 2024-02-19T19:08:26.949 INFO:tasks.workunit.client.0.smithi046.stdout:2/376: mknod d5/df/d4c/c77 0 2024-02-19T19:08:26.950 INFO:tasks.workunit.client.0.smithi046.stdout:2/377: mknod d5/d2c/d56/c78 0 2024-02-19T19:08:26.950 INFO:tasks.workunit.client.0.smithi046.stdout:2/378: fdatasync d5/f2a 0 2024-02-19T19:08:26.951 INFO:tasks.workunit.client.0.smithi046.stdout:2/379: symlink d5/d6/l79 0 2024-02-19T19:08:26.952 INFO:tasks.workunit.client.0.smithi046.stdout:6/334: dread d4/f19 [0,4194304] 0 2024-02-19T19:08:26.952 INFO:tasks.workunit.client.0.smithi046.stdout:2/380: mkdir d5/d7a 0 2024-02-19T19:08:26.952 INFO:tasks.workunit.client.0.smithi046.stdout:6/335: read d4/d6/dd/d10/f13 [236334,107241] 0 2024-02-19T19:08:26.952 INFO:tasks.workunit.client.0.smithi046.stdout:0/358: dread d0/d19/db/f50 [0,4194304] 0 2024-02-19T19:08:26.953 INFO:tasks.workunit.client.0.smithi046.stdout:0/359: read - d0/d24/d56/f81 zero size 2024-02-19T19:08:26.958 INFO:tasks.workunit.client.0.smithi046.stdout:2/381: dread d5/df/f40 [0,4194304] 0 2024-02-19T19:08:26.960 INFO:tasks.workunit.client.0.smithi046.stdout:2/382: creat d5/df/d3d/f7b x:0 0 0 2024-02-19T19:08:26.960 INFO:tasks.workunit.client.0.smithi046.stdout:2/383: read - d5/d2c/d35/f69 zero size 2024-02-19T19:08:26.960 INFO:tasks.workunit.client.0.smithi046.stdout:2/384: read - d5/d2c/d56/f74 zero size 2024-02-19T19:08:26.960 INFO:tasks.workunit.client.0.smithi046.stdout:2/385: stat d5/d2c/f73 0 2024-02-19T19:08:26.960 INFO:tasks.workunit.client.0.smithi046.stdout:2/386: truncate d5/d2c/d45/f4a 1537104 0 2024-02-19T19:08:26.960 INFO:tasks.workunit.client.0.smithi046.stdout:2/387: chown d5/d6/f23 469296 1 2024-02-19T19:08:26.961 INFO:tasks.workunit.client.0.smithi046.stdout:2/388: mkdir d5/d6/d13/d7c 0 2024-02-19T19:08:26.962 INFO:tasks.workunit.client.0.smithi046.stdout:2/389: dread d5/d2c/d35/f55 [0,4194304] 0 2024-02-19T19:08:26.966 INFO:tasks.workunit.client.0.smithi046.stdout:0/360: dwrite d0/d24/f3b [0,4194304] 0 2024-02-19T19:08:26.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/361: creat d0/d19/d8/d37/d40/f83 x:0 0 0 2024-02-19T19:08:26.971 INFO:tasks.workunit.client.0.smithi046.stdout:0/362: mknod d0/d24/d5b/d7f/c84 0 2024-02-19T19:08:26.971 INFO:tasks.workunit.client.0.smithi046.stdout:0/363: chown d0/d19/db/d27/f41 497 1 2024-02-19T19:08:26.971 INFO:tasks.workunit.client.0.smithi046.stdout:0/364: fdatasync d0/f7c 0 2024-02-19T19:08:26.971 INFO:tasks.workunit.client.0.smithi046.stdout:0/365: fdatasync d0/d19/d8/f22 0 2024-02-19T19:08:26.971 INFO:tasks.workunit.client.0.smithi046.stdout:0/366: getdents d0/d5f/d65/d79 0 2024-02-19T19:08:26.971 INFO:tasks.workunit.client.0.smithi046.stdout:0/367: fdatasync d0/d24/d2f/d53/d6b/f6e 0 2024-02-19T19:08:26.972 INFO:tasks.workunit.client.0.smithi046.stdout:0/368: mkdir d0/d19/d8/d37/d85 0 2024-02-19T19:08:26.974 INFO:tasks.workunit.client.0.smithi046.stdout:2/390: dwrite d5/d6/d13/f16 [0,4194304] 0 2024-02-19T19:08:26.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/391: read d5/f2a [2021853,95273] 0 2024-02-19T19:08:26.985 INFO:tasks.workunit.client.0.smithi046.stdout:2/392: rmdir d5/d2c/d56 39 2024-02-19T19:08:26.986 INFO:tasks.workunit.client.0.smithi046.stdout:2/393: readlink d5/d6/d13/l68 0 2024-02-19T19:08:26.986 INFO:tasks.workunit.client.0.smithi046.stdout:2/394: fdatasync d5/f2a 0 2024-02-19T19:08:26.987 INFO:tasks.workunit.client.0.smithi046.stdout:0/369: dwrite d0/f1c [0,4194304] 0 2024-02-19T19:08:26.989 INFO:tasks.workunit.client.0.smithi046.stdout:0/370: link d0/f18 d0/d19/d8/d37/d80/f86 0 2024-02-19T19:08:26.990 INFO:tasks.workunit.client.0.smithi046.stdout:0/371: symlink d0/d24/d2f/d53/l87 0 2024-02-19T19:08:26.990 INFO:tasks.workunit.client.0.smithi046.stdout:0/372: truncate d0/d24/d56/f81 680593 0 2024-02-19T19:08:26.991 INFO:tasks.workunit.client.0.smithi046.stdout:0/373: rename d0/d76 to d0/d19/d88 0 2024-02-19T19:08:26.992 INFO:tasks.workunit.client.0.smithi046.stdout:2/395: write d5/df/f10 [485013,93007] 0 2024-02-19T19:08:26.992 INFO:tasks.workunit.client.0.smithi046.stdout:2/396: chown d5/df/d3f/f71 20451 1 2024-02-19T19:08:26.993 INFO:tasks.workunit.client.0.smithi046.stdout:0/374: dread d0/d24/d2f/d53/d6b/f6e [0,4194304] 0 2024-02-19T19:08:26.993 INFO:tasks.workunit.client.0.smithi046.stdout:2/397: creat d5/d2c/f7d x:0 0 0 2024-02-19T19:08:26.994 INFO:tasks.workunit.client.0.smithi046.stdout:0/375: link d0/d5f/f60 d0/d19/db/d27/f89 0 2024-02-19T19:08:26.995 INFO:tasks.workunit.client.0.smithi046.stdout:0/376: dread - d0/d19/db/d27/f66 zero size 2024-02-19T19:08:26.996 INFO:tasks.workunit.client.0.smithi046.stdout:0/377: rename d0/d19/d8/d37/f3e to d0/d24/d2f/f8a 0 2024-02-19T19:08:26.997 INFO:tasks.workunit.client.0.smithi046.stdout:0/378: rename d0/d24/f26 to d0/d24/f8b 0 2024-02-19T19:08:26.997 INFO:tasks.workunit.client.0.smithi046.stdout:0/379: chown d0/d5f/d74 149766 1 2024-02-19T19:08:26.997 INFO:tasks.workunit.client.0.smithi046.stdout:0/380: mkdir d0/d24/d8c 0 2024-02-19T19:08:26.999 INFO:tasks.workunit.client.0.smithi046.stdout:0/381: creat d0/d19/f8d x:0 0 0 2024-02-19T19:08:26.999 INFO:tasks.workunit.client.0.smithi046.stdout:0/382: write d0/d5f/f73 [986962,67084] 0 2024-02-19T19:08:26.999 INFO:tasks.workunit.client.0.smithi046.stdout:0/383: write d0/d19/d8/f1d [843539,22236] 0 2024-02-19T19:08:26.999 INFO:tasks.workunit.client.0.smithi046.stdout:0/384: creat d0/d19/f8e x:0 0 0 2024-02-19T19:08:26.999 INFO:tasks.workunit.client.0.smithi046.stdout:2/398: write d5/d6/f50 [1721260,87530] 0 2024-02-19T19:08:27.000 INFO:tasks.workunit.client.0.smithi046.stdout:2/399: getdents d5/d6/d13/d7c 0 2024-02-19T19:08:27.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/400: mknod d5/df/d4c/c7e 0 2024-02-19T19:08:27.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/401: write d5/d2c/d45/f4a [1852873,33044] 0 2024-02-19T19:08:27.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/402: chown d5/d6 1004142 1 2024-02-19T19:08:27.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/403: creat d5/df/d3d/f7f x:0 0 0 2024-02-19T19:08:27.007 INFO:tasks.workunit.client.0.smithi046.stdout:0/385: rmdir d0/d19 39 2024-02-19T19:08:27.008 INFO:tasks.workunit.client.0.smithi046.stdout:0/386: write d0/d5f/f60 [347454,112658] 0 2024-02-19T19:08:27.008 INFO:tasks.workunit.client.0.smithi046.stdout:0/387: fdatasync d0/d19/db/d27/f66 0 2024-02-19T19:08:27.008 INFO:tasks.workunit.client.0.smithi046.stdout:0/388: read - d0/d19/d8/d37/f7d zero size 2024-02-19T19:08:27.008 INFO:tasks.workunit.client.0.smithi046.stdout:0/389: stat d0/f1b 0 2024-02-19T19:08:27.008 INFO:tasks.workunit.client.0.smithi046.stdout:0/390: dread - d0/d19/d8/d37/d58/f63 zero size 2024-02-19T19:08:27.012 INFO:tasks.workunit.client.0.smithi046.stdout:2/404: dwrite d5/df/f24 [4194304,4194304] 0 2024-02-19T19:08:27.012 INFO:tasks.workunit.client.0.smithi046.stdout:2/405: write d5/d6/fd [64977,30742] 0 2024-02-19T19:08:27.014 INFO:tasks.workunit.client.0.smithi046.stdout:2/406: mkdir d5/d2c/d35/d80 0 2024-02-19T19:08:27.014 INFO:tasks.workunit.client.0.smithi046.stdout:2/407: dread - d5/f43 zero size 2024-02-19T19:08:27.019 INFO:tasks.workunit.client.0.smithi046.stdout:0/391: dwrite d0/d19/f8d [0,4194304] 0 2024-02-19T19:08:27.021 INFO:tasks.workunit.client.0.smithi046.stdout:0/392: creat d0/d19/d8/d37/d40/f8f x:0 0 0 2024-02-19T19:08:27.021 INFO:tasks.workunit.client.0.smithi046.stdout:0/393: readlink d0/l68 0 2024-02-19T19:08:27.022 INFO:tasks.workunit.client.0.smithi046.stdout:0/394: rename d0/d19/db/d27/l3d to d0/d19/d8/l90 0 2024-02-19T19:08:27.023 INFO:tasks.workunit.client.0.smithi046.stdout:0/395: creat d0/d19/f91 x:0 0 0 2024-02-19T19:08:27.028 INFO:tasks.workunit.client.0.smithi046.stdout:2/408: dwrite d5/d6/f23 [0,4194304] 0 2024-02-19T19:08:27.031 INFO:tasks.workunit.client.0.smithi046.stdout:2/409: rename d5/c21 to d5/df/d3f/c81 0 2024-02-19T19:08:27.039 INFO:tasks.workunit.client.0.smithi046.stdout:0/396: dwrite d0/d19/db/d27/f28 [0,4194304] 0 2024-02-19T19:08:27.039 INFO:tasks.workunit.client.0.smithi046.stdout:0/397: chown d0/d19/l29 13571772 1 2024-02-19T19:08:27.042 INFO:tasks.workunit.client.0.smithi046.stdout:2/410: dread d5/d6/fd [4194304,4194304] 0 2024-02-19T19:08:27.043 INFO:tasks.workunit.client.0.smithi046.stdout:2/411: dread d5/d2c/d35/f55 [0,4194304] 0 2024-02-19T19:08:27.043 INFO:tasks.workunit.client.0.smithi046.stdout:2/412: getdents d5/d6/d6e 0 2024-02-19T19:08:27.043 INFO:tasks.workunit.client.0.smithi046.stdout:2/413: fdatasync d5/f43 0 2024-02-19T19:08:27.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/414: truncate d5/d6/fa 229766 0 2024-02-19T19:08:27.044 INFO:tasks.workunit.client.0.smithi046.stdout:0/398: dread d0/d24/d2f/f8a [0,4194304] 0 2024-02-19T19:08:27.047 INFO:tasks.workunit.client.0.smithi046.stdout:2/415: rename d5/df/d3d to d5/df/d3f/d82 0 2024-02-19T19:08:27.053 INFO:tasks.workunit.client.0.smithi046.stdout:2/416: rename d5/f30 to d5/d6/d13/d7c/f83 0 2024-02-19T19:08:27.054 INFO:tasks.workunit.client.0.smithi046.stdout:2/417: truncate d5/df/d3f/d82/f41 2185181 0 2024-02-19T19:08:27.056 INFO:tasks.workunit.client.0.smithi046.stdout:2/418: write d5/df/d3f/d82/f41 [833438,29445] 0 2024-02-19T19:08:27.058 INFO:tasks.workunit.client.0.smithi046.stdout:2/419: unlink d5/d2c/f49 0 2024-02-19T19:08:27.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/420: getdents d5/df/d4c 0 2024-02-19T19:08:27.061 INFO:tasks.workunit.client.0.smithi046.stdout:2/421: read d5/d6/fa [63386,49777] 0 2024-02-19T19:08:27.068 INFO:tasks.workunit.client.0.smithi046.stdout:2/422: read d5/df/f40 [897076,55471] 0 2024-02-19T19:08:27.068 INFO:tasks.workunit.client.0.smithi046.stdout:3/303: sync 2024-02-19T19:08:27.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/472: sync 2024-02-19T19:08:27.068 INFO:tasks.workunit.client.0.smithi046.stdout:9/267: sync 2024-02-19T19:08:27.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/473: chown d0/d45/d71/d41/c59 210 1 2024-02-19T19:08:27.069 INFO:tasks.workunit.client.0.smithi046.stdout:2/423: rename d5/d6/l79 to d5/d6/l84 0 2024-02-19T19:08:27.069 INFO:tasks.workunit.client.0.smithi046.stdout:7/474: mkdir d0/d45/d98 0 2024-02-19T19:08:27.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/304: dread da/d1d/d10/f2b [0,4194304] 0 2024-02-19T19:08:27.071 INFO:tasks.workunit.client.0.smithi046.stdout:7/475: symlink d0/d45/d56/l99 0 2024-02-19T19:08:27.071 INFO:tasks.workunit.client.0.smithi046.stdout:7/476: readlink d0/d4/l28 0 2024-02-19T19:08:27.071 INFO:tasks.workunit.client.0.smithi046.stdout:7/477: truncate d0/d4/dd/f40 5678044 0 2024-02-19T19:08:27.072 INFO:tasks.workunit.client.0.smithi046.stdout:7/478: rmdir d0/d4/dd/d62 39 2024-02-19T19:08:27.074 INFO:tasks.workunit.client.0.smithi046.stdout:7/479: rename d0/d4/dd/l90 to d0/d45/d71/d41/d5f/l9a 0 2024-02-19T19:08:27.074 INFO:tasks.workunit.client.0.smithi046.stdout:7/480: dread - d0/d4/dd/d62/f94 zero size 2024-02-19T19:08:27.074 INFO:tasks.workunit.client.0.smithi046.stdout:7/481: stat d0/d4/d24/f7a 0 2024-02-19T19:08:27.075 INFO:tasks.workunit.client.0.smithi046.stdout:7/482: mknod d0/d4/d7b/c9b 0 2024-02-19T19:08:27.076 INFO:tasks.workunit.client.0.smithi046.stdout:7/483: symlink d0/d45/d71/d4b/l9c 0 2024-02-19T19:08:27.086 INFO:tasks.workunit.client.0.smithi046.stdout:2/424: dwrite d5/d2c/d56/f58 [0,4194304] 0 2024-02-19T19:08:27.091 INFO:tasks.workunit.client.0.smithi046.stdout:2/425: mknod d5/d2c/d45/c85 0 2024-02-19T19:08:27.091 INFO:tasks.workunit.client.0.smithi046.stdout:2/426: write d5/d2c/d56/d5a/f66 [571940,121035] 0 2024-02-19T19:08:27.091 INFO:tasks.workunit.client.0.smithi046.stdout:2/427: read - d5/df/d3f/d82/f7f zero size 2024-02-19T19:08:27.091 INFO:tasks.workunit.client.0.smithi046.stdout:2/428: creat d5/d2c/f86 x:0 0 0 2024-02-19T19:08:27.091 INFO:tasks.workunit.client.0.smithi046.stdout:2/429: dread d5/d6/fc [0,4194304] 0 2024-02-19T19:08:27.092 INFO:tasks.workunit.client.0.smithi046.stdout:2/430: truncate d5/d2c/f73 1396805 0 2024-02-19T19:08:27.093 INFO:tasks.workunit.client.0.smithi046.stdout:3/305: dwrite da/d30/d38/f3e [0,4194304] 0 2024-02-19T19:08:27.095 INFO:tasks.workunit.client.0.smithi046.stdout:7/484: dwrite d0/d3f/f6b [0,4194304] 0 2024-02-19T19:08:27.097 INFO:tasks.workunit.client.0.smithi046.stdout:3/306: mknod da/d1d/d3f/c4f 0 2024-02-19T19:08:27.099 INFO:tasks.workunit.client.0.smithi046.stdout:2/431: dread d5/df/f40 [0,4194304] 0 2024-02-19T19:08:27.100 INFO:tasks.workunit.client.0.smithi046.stdout:7/485: mkdir d0/d45/d4a/d78/d9d 0 2024-02-19T19:08:27.100 INFO:tasks.workunit.client.0.smithi046.stdout:7/486: dread - d0/d4/dd/d62/f93 zero size 2024-02-19T19:08:27.100 INFO:tasks.workunit.client.0.smithi046.stdout:7/487: chown d0/d3f/f6b 246 1 2024-02-19T19:08:27.101 INFO:tasks.workunit.client.0.smithi046.stdout:7/488: rename d0/d45/d4a/f4e to d0/d45/d71/d4b/f9e 0 2024-02-19T19:08:27.101 INFO:tasks.workunit.client.0.smithi046.stdout:7/489: stat d0/d45/d71/d41/c59 0 2024-02-19T19:08:27.101 INFO:tasks.workunit.client.0.smithi046.stdout:7/490: chown d0/d45/d71/f5b 115 1 2024-02-19T19:08:27.107 INFO:tasks.workunit.client.0.smithi046.stdout:2/432: write d5/df/f24 [939859,57753] 0 2024-02-19T19:08:27.109 INFO:tasks.workunit.client.0.smithi046.stdout:2/433: unlink d5/d6/d13/d7c/f83 0 2024-02-19T19:08:27.113 INFO:tasks.workunit.client.0.smithi046.stdout:3/307: dwrite da/f37 [0,4194304] 0 2024-02-19T19:08:27.116 INFO:tasks.workunit.client.0.smithi046.stdout:3/308: rmdir da/d30/d38/d41 0 2024-02-19T19:08:27.116 INFO:tasks.workunit.client.0.smithi046.stdout:3/309: dread - da/d1d/d10/f4c zero size 2024-02-19T19:08:27.117 INFO:tasks.workunit.client.0.smithi046.stdout:3/310: unlink da/d1d/d10/f26 0 2024-02-19T19:08:27.117 INFO:tasks.workunit.client.0.smithi046.stdout:3/311: creat da/d1d/d10/f50 x:0 0 0 2024-02-19T19:08:27.118 INFO:tasks.workunit.client.0.smithi046.stdout:3/312: chown da/f20 7032833 1 2024-02-19T19:08:27.122 INFO:tasks.workunit.client.0.smithi046.stdout:3/313: dread da/f20 [0,4194304] 0 2024-02-19T19:08:27.122 INFO:tasks.workunit.client.0.smithi046.stdout:7/491: dwrite d0/d45/d4a/d58/f42 [0,4194304] 0 2024-02-19T19:08:27.122 INFO:tasks.workunit.client.0.smithi046.stdout:2/434: dwrite d5/d2c/d45/f4a [0,4194304] 0 2024-02-19T19:08:27.123 INFO:tasks.workunit.client.0.smithi046.stdout:2/435: chown d5/d6/fd 1827792 1 2024-02-19T19:08:27.123 INFO:tasks.workunit.client.0.smithi046.stdout:2/436: read d5/df/f24 [1101073,63928] 0 2024-02-19T19:08:27.130 INFO:tasks.workunit.client.0.smithi046.stdout:3/314: getdents da/d1d/d10 0 2024-02-19T19:08:27.132 INFO:tasks.workunit.client.0.smithi046.stdout:3/315: write da/d30/f44 [305292,28049] 0 2024-02-19T19:08:27.133 INFO:tasks.workunit.client.0.smithi046.stdout:3/316: write da/d1d/d10/f50 [1035384,1800] 0 2024-02-19T19:08:27.134 INFO:tasks.workunit.client.0.smithi046.stdout:3/317: truncate da/d1d/d10/f1e 1882365 0 2024-02-19T19:08:27.135 INFO:tasks.workunit.client.0.smithi046.stdout:3/318: stat da/d1d/c4d 0 2024-02-19T19:08:27.143 INFO:tasks.workunit.client.0.smithi046.stdout:3/319: dread da/d30/d38/f3e [0,4194304] 0 2024-02-19T19:08:27.143 INFO:tasks.workunit.client.0.smithi046.stdout:3/320: chown da/d1d/d10/f4c 527441464 1 2024-02-19T19:08:27.143 INFO:tasks.workunit.client.0.smithi046.stdout:3/321: stat da/f20 0 2024-02-19T19:08:27.144 INFO:tasks.workunit.client.0.smithi046.stdout:3/322: mkdir da/d1d/d51 0 2024-02-19T19:08:27.145 INFO:tasks.workunit.client.0.smithi046.stdout:7/492: dwrite d0/d45/d71/d4b/f9e [0,4194304] 0 2024-02-19T19:08:27.145 INFO:tasks.workunit.client.0.smithi046.stdout:2/437: dwrite d5/f43 [0,4194304] 0 2024-02-19T19:08:27.145 INFO:tasks.workunit.client.0.smithi046.stdout:2/438: read d5/d6/fd [2171727,96342] 0 2024-02-19T19:08:27.146 INFO:tasks.workunit.client.0.smithi046.stdout:3/323: write da/d1d/d10/f1e [2426071,33320] 0 2024-02-19T19:08:27.149 INFO:tasks.workunit.client.0.smithi046.stdout:2/439: link d5/d6/d13/f61 d5/d2c/d35/d80/f87 0 2024-02-19T19:08:27.150 INFO:tasks.workunit.client.0.smithi046.stdout:3/324: mknod da/d30/c52 0 2024-02-19T19:08:27.151 INFO:tasks.workunit.client.0.smithi046.stdout:2/440: creat d5/d6/d13/d7c/f88 x:0 0 0 2024-02-19T19:08:27.151 INFO:tasks.workunit.client.0.smithi046.stdout:2/441: chown d5/d2c/d56 811943 1 2024-02-19T19:08:27.151 INFO:tasks.workunit.client.0.smithi046.stdout:2/442: write d5/df/f6d [4948412,60249] 0 2024-02-19T19:08:27.159 INFO:tasks.workunit.client.0.smithi046.stdout:2/443: rename d5/df to d5/d2c/d89 0 2024-02-19T19:08:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:2/444: mkdir d5/d6/d13/d8a 0 2024-02-19T19:08:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:2/445: read - d5/d2c/f5f zero size 2024-02-19T19:08:27.161 INFO:tasks.workunit.client.0.smithi046.stdout:2/446: write d5/d2c/d89/d3f/d82/f7b [528980,7274] 0 2024-02-19T19:08:27.163 INFO:tasks.workunit.client.0.smithi046.stdout:2/447: creat d5/d6/d6e/f8b x:0 0 0 2024-02-19T19:08:27.163 INFO:tasks.workunit.client.0.smithi046.stdout:2/448: chown d5/d2c/d89/f40 0 1 2024-02-19T19:08:27.164 INFO:tasks.workunit.client.0.smithi046.stdout:2/449: creat d5/d6a/f8c x:0 0 0 2024-02-19T19:08:27.170 INFO:tasks.workunit.client.0.smithi046.stdout:7/493: dwrite d0/d45/d71/d41/d5f/f8f [0,4194304] 0 2024-02-19T19:08:27.179 INFO:tasks.workunit.client.0.smithi046.stdout:2/450: dwrite d5/d2c/d35/f52 [0,4194304] 0 2024-02-19T19:08:27.179 INFO:tasks.workunit.client.0.smithi046.stdout:2/451: write d5/d6/fc [1532486,30394] 0 2024-02-19T19:08:27.180 INFO:tasks.workunit.client.0.smithi046.stdout:2/452: creat d5/d6a/f8d x:0 0 0 2024-02-19T19:08:27.180 INFO:tasks.workunit.client.0.smithi046.stdout:2/453: dread - d5/d2c/d89/d3f/d82/f7f zero size 2024-02-19T19:08:27.187 INFO:tasks.workunit.client.0.smithi046.stdout:1/400: sync 2024-02-19T19:08:27.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/454: dread d5/d2c/d89/f6d [0,4194304] 0 2024-02-19T19:08:27.188 INFO:tasks.workunit.client.0.smithi046.stdout:1/401: truncate d5/f27 1954074 0 2024-02-19T19:08:27.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/455: write d5/d2c/d89/f40 [4895954,128921] 0 2024-02-19T19:08:27.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/456: getdents d5/d2c/d45 0 2024-02-19T19:08:27.192 INFO:tasks.workunit.client.0.smithi046.stdout:7/494: dwrite d0/d45/d71/d41/d5f/f8f [0,4194304] 0 2024-02-19T19:08:27.193 INFO:tasks.workunit.client.0.smithi046.stdout:7/495: getdents d0/d4 0 2024-02-19T19:08:27.193 INFO:tasks.workunit.client.0.smithi046.stdout:7/496: write d0/d4/f3b [1314213,73994] 0 2024-02-19T19:08:27.195 INFO:tasks.workunit.client.0.smithi046.stdout:7/497: creat d0/d45/d56/f9f x:0 0 0 2024-02-19T19:08:27.196 INFO:tasks.workunit.client.0.smithi046.stdout:7/498: creat d0/d45/d4a/d78/d9d/fa0 x:0 0 0 2024-02-19T19:08:27.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:26 smithi142 ceph-mon[69118]: pgmap v118: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 640 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 53 MiB/s rd, 60 MiB/s wr, 502 op/s; 7008/44817 objects degraded (15.637%) 2024-02-19T19:08:27.215 INFO:tasks.workunit.client.0.smithi046.stdout:2/457: dwrite d5/d2c/d89/d4c/f70 [0,4194304] 0 2024-02-19T19:08:27.215 INFO:tasks.workunit.client.0.smithi046.stdout:1/402: dwrite d5/d10/d3b/f52 [0,4194304] 0 2024-02-19T19:08:27.216 INFO:tasks.workunit.client.0.smithi046.stdout:2/458: symlink d5/d2c/d35/d80/l8e 0 2024-02-19T19:08:27.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/459: dread - d5/d2c/d89/d3f/f71 zero size 2024-02-19T19:08:27.218 INFO:tasks.workunit.client.0.smithi046.stdout:1/403: getdents d5/d10/d55/d81 0 2024-02-19T19:08:27.219 INFO:tasks.workunit.client.0.smithi046.stdout:2/460: creat d5/d2c/d89/d4c/f8f x:0 0 0 2024-02-19T19:08:27.219 INFO:tasks.workunit.client.0.smithi046.stdout:2/461: truncate d5/d2c/f3c 4829045 0 2024-02-19T19:08:27.234 INFO:tasks.workunit.client.0.smithi046.stdout:1/404: dwrite d5/d10/d55/d81/f57 [0,4194304] 0 2024-02-19T19:08:27.255 INFO:tasks.workunit.client.0.smithi046.stdout:2/462: dwrite d5/d2c/d89/d3f/f71 [0,4194304] 0 2024-02-19T19:08:27.255 INFO:tasks.workunit.client.0.smithi046.stdout:2/463: fsync d5/d6/f23 0 2024-02-19T19:08:27.255 INFO:tasks.workunit.client.0.smithi046.stdout:2/464: chown d5/d6 492747735 1 2024-02-19T19:08:27.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/405: dwrite d5/f17 [0,4194304] 0 2024-02-19T19:08:27.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/406: chown d5/d10/d55/c56 410 1 2024-02-19T19:08:27.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/407: readlink d5/d10/l28 0 2024-02-19T19:08:27.276 INFO:tasks.workunit.client.0.smithi046.stdout:2/465: dwrite d5/d6/d13/d7c/f88 [0,4194304] 0 2024-02-19T19:08:27.276 INFO:tasks.workunit.client.0.smithi046.stdout:2/466: write f1 [4493,42612] 0 2024-02-19T19:08:27.277 INFO:tasks.workunit.client.0.smithi046.stdout:2/467: chown d5/d2c/d89/f24 0 1 2024-02-19T19:08:27.277 INFO:tasks.workunit.client.0.smithi046.stdout:2/468: chown d5/l17 3942 1 2024-02-19T19:08:27.277 INFO:tasks.workunit.client.0.smithi046.stdout:2/469: chown d5/d6a 125532709 1 2024-02-19T19:08:27.277 INFO:tasks.workunit.client.0.smithi046.stdout:2/470: readlink d5/d6/d13/l68 0 2024-02-19T19:08:27.289 INFO:tasks.workunit.client.0.smithi046.stdout:2/471: dwrite d5/d2c/f5f [0,4194304] 0 2024-02-19T19:08:27.289 INFO:tasks.workunit.client.0.smithi046.stdout:2/472: readlink d5/d6/d13/l20 0 2024-02-19T19:08:27.291 INFO:tasks.workunit.client.0.smithi046.stdout:2/473: getdents d5/d2c/d35 0 2024-02-19T19:08:27.292 INFO:tasks.workunit.client.0.smithi046.stdout:2/474: mkdir d5/d6/d13/d7c/d90 0 2024-02-19T19:08:27.292 INFO:tasks.workunit.client.0.smithi046.stdout:2/475: creat d5/d6/d6e/f91 x:0 0 0 2024-02-19T19:08:27.293 INFO:tasks.workunit.client.0.smithi046.stdout:2/476: mkdir d5/d2c/d89/d92 0 2024-02-19T19:08:27.294 INFO:tasks.workunit.client.0.smithi046.stdout:2/477: link d5/d2c/d89/l12 d5/d6/d13/d8a/l93 0 2024-02-19T19:08:27.308 INFO:tasks.workunit.client.0.smithi046.stdout:2/478: dwrite d5/d2c/d35/f69 [0,4194304] 0 2024-02-19T19:08:27.308 INFO:tasks.workunit.client.0.smithi046.stdout:2/479: readlink d5/d2c/d89/d4c/d75/l76 0 2024-02-19T19:08:27.311 INFO:tasks.workunit.client.0.smithi046.stdout:2/480: link d5/d2c/d89/d3f/d82/f41 d5/d6/d13/d7c/f94 0 2024-02-19T19:08:27.313 INFO:tasks.workunit.client.0.smithi046.stdout:5/445: sync 2024-02-19T19:08:27.314 INFO:tasks.workunit.client.0.smithi046.stdout:5/446: getdents d2/dd/d26 0 2024-02-19T19:08:27.315 INFO:tasks.workunit.client.0.smithi046.stdout:5/447: write d2/dd/d29/f35 [394052,50113] 0 2024-02-19T19:08:27.316 INFO:tasks.workunit.client.0.smithi046.stdout:5/448: getdents d2/dd 0 2024-02-19T19:08:27.319 INFO:tasks.workunit.client.0.smithi046.stdout:2/481: dread d5/d2c/f5f [0,4194304] 0 2024-02-19T19:08:27.320 INFO:tasks.workunit.client.0.smithi046.stdout:2/482: mknod d5/d2c/d89/d3f/d5c/c95 0 2024-02-19T19:08:27.320 INFO:tasks.workunit.client.0.smithi046.stdout:2/483: chown d5/d2c/d35/c4f 1632956537 1 2024-02-19T19:08:27.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:26 smithi046 ceph-mon[88928]: pgmap v118: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 640 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 53 MiB/s rd, 60 MiB/s wr, 502 op/s; 7008/44817 objects degraded (15.637%) 2024-02-19T19:08:27.338 INFO:tasks.workunit.client.0.smithi046.stdout:5/449: dwrite d2/fb [0,4194304] 0 2024-02-19T19:08:27.339 INFO:tasks.workunit.client.0.smithi046.stdout:2/484: dwrite d5/d6/f50 [0,4194304] 0 2024-02-19T19:08:27.339 INFO:tasks.workunit.client.0.smithi046.stdout:2/485: chown d5/d2c/d89/l12 8563 1 2024-02-19T19:08:27.339 INFO:tasks.workunit.client.0.smithi046.stdout:2/486: write d5/d6/d6e/f8b [62848,6056] 0 2024-02-19T19:08:27.339 INFO:tasks.workunit.client.0.smithi046.stdout:5/450: symlink d2/dd/d29/d72/l8b 0 2024-02-19T19:08:27.340 INFO:tasks.workunit.client.0.smithi046.stdout:2/487: creat d5/d2c/d35/d80/f96 x:0 0 0 2024-02-19T19:08:27.340 INFO:tasks.workunit.client.0.smithi046.stdout:2/488: stat d5/d2c/d89/d3f/d5c/c63 0 2024-02-19T19:08:27.341 INFO:tasks.workunit.client.0.smithi046.stdout:2/489: mknod d5/d6/d13/d8a/c97 0 2024-02-19T19:08:27.343 INFO:tasks.workunit.client.0.smithi046.stdout:2/490: mknod d5/d6/d13/d8a/c98 0 2024-02-19T19:08:27.360 INFO:tasks.workunit.client.0.smithi046.stdout:2/491: dwrite d5/d2c/d56/f74 [0,4194304] 0 2024-02-19T19:08:27.360 INFO:tasks.workunit.client.0.smithi046.stdout:2/492: chown d5 71503833 1 2024-02-19T19:08:27.360 INFO:tasks.workunit.client.0.smithi046.stdout:5/451: dwrite d2/f2d [0,4194304] 0 2024-02-19T19:08:27.362 INFO:tasks.workunit.client.0.smithi046.stdout:2/493: symlink d5/d6/l99 0 2024-02-19T19:08:27.362 INFO:tasks.workunit.client.0.smithi046.stdout:2/494: truncate d5/d2c/f67 223644 0 2024-02-19T19:08:27.366 INFO:tasks.workunit.client.0.smithi046.stdout:5/452: symlink d2/dd/d29/l8c 0 2024-02-19T19:08:27.366 INFO:tasks.workunit.client.0.smithi046.stdout:2/495: mknod d5/d2c/d89/c9a 0 2024-02-19T19:08:27.368 INFO:tasks.workunit.client.0.smithi046.stdout:5/453: link d2/dd/d29/d72/l8b d2/dd/d26/d65/d5f/l8d 0 2024-02-19T19:08:27.369 INFO:tasks.workunit.client.0.smithi046.stdout:5/454: readlink d2/dd/d3f/l6b 0 2024-02-19T19:08:27.370 INFO:tasks.workunit.client.0.smithi046.stdout:5/455: creat d2/d27/d4b/f8e x:0 0 0 2024-02-19T19:08:27.370 INFO:tasks.workunit.client.0.smithi046.stdout:2/496: dread d5/d2c/d89/d3f/d82/f41 [0,4194304] 0 2024-02-19T19:08:27.370 INFO:tasks.workunit.client.0.smithi046.stdout:2/497: write d5/d2c/f86 [924497,119656] 0 2024-02-19T19:08:27.371 INFO:tasks.workunit.client.0.smithi046.stdout:5/456: symlink d2/d27/d47/d54/d57/l8f 0 2024-02-19T19:08:27.371 INFO:tasks.workunit.client.0.smithi046.stdout:5/457: write d2/d27/d47/d7f/f8a [729295,44156] 0 2024-02-19T19:08:27.372 INFO:tasks.workunit.client.0.smithi046.stdout:2/498: mkdir d5/d2c/d45/d9b 0 2024-02-19T19:08:27.373 INFO:tasks.workunit.client.0.smithi046.stdout:5/458: creat d2/d27/f90 x:0 0 0 2024-02-19T19:08:27.374 INFO:tasks.workunit.client.0.smithi046.stdout:2/499: creat d5/d2c/d45/f9c x:0 0 0 2024-02-19T19:08:27.375 INFO:tasks.workunit.client.0.smithi046.stdout:5/459: rename d2/d27/d47/c7e to d2/dd/d2f/d34/c91 0 2024-02-19T19:08:27.375 INFO:tasks.workunit.client.0.smithi046.stdout:5/460: creat d2/dd/d26/d65/d5f/f92 x:0 0 0 2024-02-19T19:08:27.376 INFO:tasks.workunit.client.0.smithi046.stdout:2/500: rename d5/d6a/f8d to d5/d2c/d89/d3f/d5c/f9d 0 2024-02-19T19:08:27.377 INFO:tasks.workunit.client.0.smithi046.stdout:5/461: mkdir d2/dd/d29/d3b/d93 0 2024-02-19T19:08:27.385 INFO:tasks.workunit.client.0.smithi046.stdout:2/501: write d5/d2c/d89/f1a [453928,78354] 0 2024-02-19T19:08:27.386 INFO:tasks.workunit.client.0.smithi046.stdout:2/502: getdents d5/d2c/d56 0 2024-02-19T19:08:27.386 INFO:tasks.workunit.client.0.smithi046.stdout:5/462: rmdir d2/dd/d26/d65 39 2024-02-19T19:08:27.389 INFO:tasks.workunit.client.0.smithi046.stdout:2/503: link d5/d2c/d89/d3f/d82/c6c d5/d6/d13/c9e 0 2024-02-19T19:08:27.391 INFO:tasks.workunit.client.0.smithi046.stdout:5/463: link d2/d27/d47/d54/c59 d2/dd/d26/d65/d5f/c94 0 2024-02-19T19:08:27.392 INFO:tasks.workunit.client.0.smithi046.stdout:5/464: mknod d2/dd/d29/d72/c95 0 2024-02-19T19:08:27.398 INFO:tasks.workunit.client.0.smithi046.stdout:2/504: dread d5/d2c/d89/d3f/f71 [0,4194304] 0 2024-02-19T19:08:27.399 INFO:tasks.workunit.client.0.smithi046.stdout:2/505: mkdir d5/d2c/d89/d3f/d5c/d9f 0 2024-02-19T19:08:27.399 INFO:tasks.workunit.client.0.smithi046.stdout:2/506: chown d5/d6/d13/d7c/d90 6535861 1 2024-02-19T19:08:27.407 INFO:tasks.workunit.client.0.smithi046.stdout:5/465: dwrite d2/dd/f15 [0,4194304] 0 2024-02-19T19:08:27.407 INFO:tasks.workunit.client.0.smithi046.stdout:5/466: creat d2/d27/d4b/f96 x:0 0 0 2024-02-19T19:08:27.408 INFO:tasks.workunit.client.0.smithi046.stdout:5/467: rmdir d2/dd/d29/d72 39 2024-02-19T19:08:27.408 INFO:tasks.workunit.client.0.smithi046.stdout:5/468: chown d2/d27/d47/f60 31 1 2024-02-19T19:08:27.416 INFO:tasks.workunit.client.0.smithi046.stdout:2/507: dwrite d5/d6/d13/d7c/f94 [0,4194304] 0 2024-02-19T19:08:27.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/508: dwrite f1 [0,4194304] 0 2024-02-19T19:08:27.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/509: fsync d5/d2c/d89/f28 0 2024-02-19T19:08:27.434 INFO:tasks.workunit.client.0.smithi046.stdout:2/510: mkdir d5/d2c/d56/d5a/da0 0 2024-02-19T19:08:27.434 INFO:tasks.workunit.client.0.smithi046.stdout:2/511: read - d5/d2c/d35/d80/f96 zero size 2024-02-19T19:08:27.434 INFO:tasks.workunit.client.0.smithi046.stdout:2/512: read - d5/d2c/d89/d3f/d82/f7f zero size 2024-02-19T19:08:27.434 INFO:tasks.workunit.client.0.smithi046.stdout:2/513: chown d5/d2c/d56/f74 22028 1 2024-02-19T19:08:27.434 INFO:tasks.workunit.client.0.smithi046.stdout:2/514: truncate d5/d2c/d89/d3f/f71 4135822 0 2024-02-19T19:08:27.441 INFO:tasks.workunit.client.0.smithi046.stdout:2/515: dread d5/d6/d13/d7c/f88 [0,4194304] 0 2024-02-19T19:08:27.448 INFO:tasks.workunit.client.0.smithi046.stdout:2/516: dread d5/d2c/f73 [0,4194304] 0 2024-02-19T19:08:27.452 INFO:tasks.workunit.client.0.smithi046.stdout:4/460: sync 2024-02-19T19:08:27.453 INFO:tasks.workunit.client.0.smithi046.stdout:4/461: symlink d6/d11/l99 0 2024-02-19T19:08:27.454 INFO:tasks.workunit.client.0.smithi046.stdout:2/517: dread d5/f43 [0,4194304] 0 2024-02-19T19:08:27.454 INFO:tasks.workunit.client.0.smithi046.stdout:4/462: mknod d6/d11/c9a 0 2024-02-19T19:08:27.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/518: read d5/d6/d6e/f8b [40040,17638] 0 2024-02-19T19:08:27.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/519: chown d5/d6/d13 35552 1 2024-02-19T19:08:27.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/520: fsync d5/f2a 0 2024-02-19T19:08:27.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/521: fdatasync d5/d2c/d89/d4c/f70 0 2024-02-19T19:08:27.455 INFO:tasks.workunit.client.0.smithi046.stdout:4/463: symlink d6/d11/l9b 0 2024-02-19T19:08:27.456 INFO:tasks.workunit.client.0.smithi046.stdout:4/464: fsync d6/d15/d17/f78 0 2024-02-19T19:08:27.456 INFO:tasks.workunit.client.0.smithi046.stdout:2/522: write d5/d2c/f86 [589917,60037] 0 2024-02-19T19:08:27.457 INFO:tasks.workunit.client.0.smithi046.stdout:4/465: rename d6/d15/f72 to d6/d11/d92/f9c 0 2024-02-19T19:08:27.457 INFO:tasks.workunit.client.0.smithi046.stdout:4/466: chown d6/d11 0 1 2024-02-19T19:08:27.457 INFO:tasks.workunit.client.0.smithi046.stdout:4/467: creat d6/d15/d17/d1e/f9d x:0 0 0 2024-02-19T19:08:27.458 INFO:tasks.workunit.client.0.smithi046.stdout:4/468: rmdir d6/d11/d26/d89/d8a 39 2024-02-19T19:08:27.458 INFO:tasks.workunit.client.0.smithi046.stdout:4/469: stat d6/d11/d26/f81 0 2024-02-19T19:08:27.459 INFO:tasks.workunit.client.0.smithi046.stdout:4/470: creat d6/d11/d92/f9e x:0 0 0 2024-02-19T19:08:27.464 INFO:tasks.workunit.client.0.smithi046.stdout:4/471: getdents d6/d15/d17/d1e 0 2024-02-19T19:08:27.465 INFO:tasks.workunit.client.0.smithi046.stdout:2/523: write d5/d2c/d35/f69 [101051,56373] 0 2024-02-19T19:08:27.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/472: rename d6/d11/d26/f81 to d6/d11/d26/f9f 0 2024-02-19T19:08:27.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/473: fsync d6/f42 0 2024-02-19T19:08:27.477 INFO:tasks.workunit.client.0.smithi046.stdout:2/524: dread d5/d6/d13/d7c/f94 [0,4194304] 0 2024-02-19T19:08:27.477 INFO:tasks.workunit.client.0.smithi046.stdout:2/525: readlink d5/d2c/d35/l65 0 2024-02-19T19:08:27.478 INFO:tasks.workunit.client.0.smithi046.stdout:2/526: mkdir d5/d2c/d89/d3f/da1 0 2024-02-19T19:08:27.480 INFO:tasks.workunit.client.0.smithi046.stdout:2/527: rename d5/d2c/d89/f24 to d5/d2c/fa2 0 2024-02-19T19:08:27.481 INFO:tasks.workunit.client.0.smithi046.stdout:2/528: creat d5/d2c/d89/d92/fa3 x:0 0 0 2024-02-19T19:08:27.484 INFO:tasks.workunit.client.0.smithi046.stdout:4/474: dwrite d6/d11/d26/f9f [0,4194304] 0 2024-02-19T19:08:27.484 INFO:tasks.workunit.client.0.smithi046.stdout:4/475: dread - d6/d11/d26/d89/d8a/d55/f86 zero size 2024-02-19T19:08:27.487 INFO:tasks.workunit.client.0.smithi046.stdout:4/476: creat d6/d50/fa0 x:0 0 0 2024-02-19T19:08:27.488 INFO:tasks.workunit.client.0.smithi046.stdout:4/477: mknod d6/d11/ca1 0 2024-02-19T19:08:27.489 INFO:tasks.workunit.client.0.smithi046.stdout:4/478: symlink d6/d15/la2 0 2024-02-19T19:08:27.499 INFO:tasks.workunit.client.0.smithi046.stdout:4/479: dread d6/d11/d26/f34 [0,4194304] 0 2024-02-19T19:08:27.499 INFO:tasks.workunit.client.0.smithi046.stdout:2/529: dwrite f1 [0,4194304] 0 2024-02-19T19:08:27.499 INFO:tasks.workunit.client.0.smithi046.stdout:2/530: chown d5/d6/d13/d7c 177056 1 2024-02-19T19:08:27.500 INFO:tasks.workunit.client.0.smithi046.stdout:4/480: creat d6/d11/d26/d89/d8a/d55/fa3 x:0 0 0 2024-02-19T19:08:27.502 INFO:tasks.workunit.client.0.smithi046.stdout:2/531: getdents d5/d6/d13/d7c 0 2024-02-19T19:08:27.502 INFO:tasks.workunit.client.0.smithi046.stdout:2/532: write d5/d2c/d89/f40 [5740079,98419] 0 2024-02-19T19:08:27.502 INFO:tasks.workunit.client.0.smithi046.stdout:2/533: write d5/d6/f23 [4207128,80031] 0 2024-02-19T19:08:27.503 INFO:tasks.workunit.client.0.smithi046.stdout:2/534: mkdir d5/d2c/d89/d3f/d82/da4 0 2024-02-19T19:08:27.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/481: dread d6/d11/d26/f28 [0,4194304] 0 2024-02-19T19:08:27.508 INFO:tasks.workunit.client.0.smithi046.stdout:4/482: rmdir d6/d11/d26 39 2024-02-19T19:08:27.508 INFO:tasks.workunit.client.0.smithi046.stdout:4/483: readlink d6/d11/d26/l87 0 2024-02-19T19:08:27.519 INFO:tasks.workunit.client.0.smithi046.stdout:2/535: dwrite d5/d2c/d45/f9c [0,4194304] 0 2024-02-19T19:08:27.521 INFO:tasks.workunit.client.0.smithi046.stdout:2/536: mkdir d5/d2c/d56/da5 0 2024-02-19T19:08:27.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/484: dwrite d6/d11/d26/f9f [0,4194304] 0 2024-02-19T19:08:27.527 INFO:tasks.workunit.client.0.smithi046.stdout:2/537: dread d5/d6/d13/d7c/f94 [0,4194304] 0 2024-02-19T19:08:27.527 INFO:tasks.workunit.client.0.smithi046.stdout:2/538: dread - d5/d6/d6e/f91 zero size 2024-02-19T19:08:27.527 INFO:tasks.workunit.client.0.smithi046.stdout:2/539: creat d5/d6/d6e/fa6 x:0 0 0 2024-02-19T19:08:27.527 INFO:tasks.workunit.client.0.smithi046.stdout:2/540: readlink d5/d2c/d35/d80/l8e 0 2024-02-19T19:08:27.529 INFO:tasks.workunit.client.0.smithi046.stdout:4/485: mknod d6/d15/d6e/ca4 0 2024-02-19T19:08:27.529 INFO:tasks.workunit.client.0.smithi046.stdout:4/486: getdents d6/d94 0 2024-02-19T19:08:27.531 INFO:tasks.workunit.client.0.smithi046.stdout:4/487: mknod d6/d11/d26/d89/d8a/d8d/ca5 0 2024-02-19T19:08:27.531 INFO:tasks.workunit.client.0.smithi046.stdout:2/541: dread d5/d6/d13/d7c/f94 [0,4194304] 0 2024-02-19T19:08:27.533 INFO:tasks.workunit.client.0.smithi046.stdout:2/542: link d5/d2c/d89/f40 d5/d2c/d35/d80/fa7 0 2024-02-19T19:08:27.533 INFO:tasks.workunit.client.0.smithi046.stdout:4/488: read d6/d11/d26/f28 [452980,61141] 0 2024-02-19T19:08:27.533 INFO:tasks.workunit.client.0.smithi046.stdout:4/489: fsync d6/d11/f68 0 2024-02-19T19:08:27.534 INFO:tasks.workunit.client.0.smithi046.stdout:4/490: creat d6/d15/d17/d1e/d25/fa6 x:0 0 0 2024-02-19T19:08:27.536 INFO:tasks.workunit.client.0.smithi046.stdout:4/491: mkdir d6/d11/d40/da7 0 2024-02-19T19:08:27.536 INFO:tasks.workunit.client.0.smithi046.stdout:4/492: chown d6/d11/d26/d89/d8a/f8c 10273071 1 2024-02-19T19:08:27.536 INFO:tasks.workunit.client.0.smithi046.stdout:4/493: chown d6/d11/d92/f9e 5879 1 2024-02-19T19:08:27.537 INFO:tasks.workunit.client.0.smithi046.stdout:4/494: mknod d6/d11/ca8 0 2024-02-19T19:08:27.538 INFO:tasks.workunit.client.0.smithi046.stdout:4/495: creat d6/fa9 x:0 0 0 2024-02-19T19:08:27.543 INFO:tasks.workunit.client.0.smithi046.stdout:8/517: sync 2024-02-19T19:08:27.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/336: sync 2024-02-19T19:08:27.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/337: chown d4/d6/dd/d10/c1f 764080 1 2024-02-19T19:08:27.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/338: fsync d4/d6/dd/d10/f4b 0 2024-02-19T19:08:27.544 INFO:tasks.workunit.client.0.smithi046.stdout:6/339: chown d4/d6/dd/d10/d29/d2d/d35 234145 1 2024-02-19T19:08:27.545 INFO:tasks.workunit.client.0.smithi046.stdout:8/518: link d3/dd/d13/d6b/d46/d54/fa4 d3/dd/d13/d6b/d46/d54/fb8 0 2024-02-19T19:08:27.545 INFO:tasks.workunit.client.0.smithi046.stdout:8/519: fdatasync d3/dd/d13/d6b/d46/d54/f97 0 2024-02-19T19:08:27.545 INFO:tasks.workunit.client.0.smithi046.stdout:8/520: chown d3/f3a 62722 1 2024-02-19T19:08:27.546 INFO:tasks.workunit.client.0.smithi046.stdout:6/340: rename d4/d6/d22/c62 to d4/d6/d1c/d60/c6d 0 2024-02-19T19:08:27.546 INFO:tasks.workunit.client.0.smithi046.stdout:6/341: read - d4/d6/d1c/f51 zero size 2024-02-19T19:08:27.546 INFO:tasks.workunit.client.0.smithi046.stdout:6/342: dread - d4/d6/dd/d10/f4b zero size 2024-02-19T19:08:27.547 INFO:tasks.workunit.client.0.smithi046.stdout:8/521: truncate d3/dd/d3f/d49/d5b/d5f/f89 938952 0 2024-02-19T19:08:27.548 INFO:tasks.workunit.client.0.smithi046.stdout:2/543: dwrite d5/d2c/d89/d3f/d5c/f9d [0,4194304] 0 2024-02-19T19:08:27.548 INFO:tasks.workunit.client.0.smithi046.stdout:6/343: creat d4/d6/d22/f6e x:0 0 0 2024-02-19T19:08:27.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/522: mknod d3/dd/d13/d6b/d46/cb9 0 2024-02-19T19:08:27.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/523: readlink d3/dd/d13/d6b/d36/l3b 0 2024-02-19T19:08:27.551 INFO:tasks.workunit.client.0.smithi046.stdout:2/544: creat d5/d6/d13/d8a/fa8 x:0 0 0 2024-02-19T19:08:27.552 INFO:tasks.workunit.client.0.smithi046.stdout:6/344: creat d4/d6/d1c/d20/f6f x:0 0 0 2024-02-19T19:08:27.552 INFO:tasks.workunit.client.0.smithi046.stdout:8/524: mkdir d3/dd/d13/d66/dba 0 2024-02-19T19:08:27.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/525: creat d3/dd/d13/fbb x:0 0 0 2024-02-19T19:08:27.555 INFO:tasks.workunit.client.0.smithi046.stdout:8/526: unlink d3/c5 0 2024-02-19T19:08:27.556 INFO:tasks.workunit.client.0.smithi046.stdout:4/496: dwrite d6/d11/d26/d89/d8a/d55/fa3 [0,4194304] 0 2024-02-19T19:08:27.560 INFO:tasks.workunit.client.0.smithi046.stdout:2/545: write d5/d2c/d56/f58 [63803,41765] 0 2024-02-19T19:08:27.561 INFO:tasks.workunit.client.0.smithi046.stdout:4/497: creat d6/d11/d26/d89/faa x:0 0 0 2024-02-19T19:08:27.562 INFO:tasks.workunit.client.0.smithi046.stdout:2/546: mkdir d5/d2c/d56/da5/da9 0 2024-02-19T19:08:27.562 INFO:tasks.workunit.client.0.smithi046.stdout:2/547: chown d5/d6/d13/c9e 87916 1 2024-02-19T19:08:27.563 INFO:tasks.workunit.client.0.smithi046.stdout:4/498: truncate d6/d11/f35 8183968 0 2024-02-19T19:08:27.564 INFO:tasks.workunit.client.0.smithi046.stdout:4/499: dread - d6/d11/f68 zero size 2024-02-19T19:08:27.564 INFO:tasks.workunit.client.0.smithi046.stdout:4/500: chown d6/d50/l62 0 1 2024-02-19T19:08:27.564 INFO:tasks.workunit.client.0.smithi046.stdout:8/527: dread d3/d18/f33 [0,4194304] 0 2024-02-19T19:08:27.564 INFO:tasks.workunit.client.0.smithi046.stdout:8/528: chown d3/d18/c67 1 1 2024-02-19T19:08:27.564 INFO:tasks.workunit.client.0.smithi046.stdout:2/548: truncate d5/d2c/f73 1455431 0 2024-02-19T19:08:27.566 INFO:tasks.workunit.client.0.smithi046.stdout:4/501: mkdir d6/d94/dab 0 2024-02-19T19:08:27.567 INFO:tasks.workunit.client.0.smithi046.stdout:8/529: creat d3/dd/d3f/d49/d5b/fbc x:0 0 0 2024-02-19T19:08:27.568 INFO:tasks.workunit.client.0.smithi046.stdout:8/530: write d3/dd/d13/d6b/d46/d54/f97 [344805,54280] 0 2024-02-19T19:08:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:6/345: dwrite d4/f19 [0,4194304] 0 2024-02-19T19:08:27.569 INFO:tasks.workunit.client.0.smithi046.stdout:4/502: dread d6/d15/d17/d1e/d25/f4b [4194304,4194304] 0 2024-02-19T19:08:27.570 INFO:tasks.workunit.client.0.smithi046.stdout:8/531: symlink d3/dd/d13/d6b/d46/d6a/db2/lbd 0 2024-02-19T19:08:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:2/549: getdents d5/d2c 0 2024-02-19T19:08:27.571 INFO:tasks.workunit.client.0.smithi046.stdout:2/550: chown d5/d2c/d45/d9b 5185361 1 2024-02-19T19:08:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:2/551: chown d5/d6/d13/l20 968146 1 2024-02-19T19:08:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:4/503: creat d6/d15/d17/d1e/fac x:0 0 0 2024-02-19T19:08:27.573 INFO:tasks.workunit.client.0.smithi046.stdout:4/504: fsync d6/d11/d40/f79 0 2024-02-19T19:08:27.574 INFO:tasks.workunit.client.0.smithi046.stdout:8/532: creat d3/dd/d13/d66/fbe x:0 0 0 2024-02-19T19:08:27.574 INFO:tasks.workunit.client.0.smithi046.stdout:8/533: stat d3/dd/fe 0 2024-02-19T19:08:27.575 INFO:tasks.workunit.client.0.smithi046.stdout:8/534: rmdir d3/dd/d13/d6b 39 2024-02-19T19:08:27.575 INFO:tasks.workunit.client.0.smithi046.stdout:4/505: dread d6/fb [4194304,4194304] 0 2024-02-19T19:08:27.577 INFO:tasks.workunit.client.0.smithi046.stdout:8/535: symlink d3/dd/d13/d6b/d46/d54/lbf 0 2024-02-19T19:08:27.577 INFO:tasks.workunit.client.0.smithi046.stdout:8/536: fdatasync d3/f44 0 2024-02-19T19:08:27.578 INFO:tasks.workunit.client.0.smithi046.stdout:4/506: creat d6/d11/d40/fad x:0 0 0 2024-02-19T19:08:27.580 INFO:tasks.workunit.client.0.smithi046.stdout:6/346: dread d4/d6/dd/d10/f13 [0,4194304] 0 2024-02-19T19:08:27.580 INFO:tasks.workunit.client.0.smithi046.stdout:6/347: getdents d4/d6/dd/d10/d29/d2d/d35/d3c 0 2024-02-19T19:08:27.580 INFO:tasks.workunit.client.0.smithi046.stdout:6/348: dread - d4/d6/dd/f56 zero size 2024-02-19T19:08:27.580 INFO:tasks.workunit.client.0.smithi046.stdout:8/537: getdents d3/d37/d9b 0 2024-02-19T19:08:27.581 INFO:tasks.workunit.client.0.smithi046.stdout:4/507: symlink d6/d11/d26/d89/d8a/d8d/lae 0 2024-02-19T19:08:27.581 INFO:tasks.workunit.client.0.smithi046.stdout:4/508: readlink d6/d11/l99 0 2024-02-19T19:08:27.584 INFO:tasks.workunit.client.0.smithi046.stdout:6/349: symlink d4/d6/dd/d10/d29/d2d/l70 0 2024-02-19T19:08:27.586 INFO:tasks.workunit.client.0.smithi046.stdout:8/538: getdents d3/dd 0 2024-02-19T19:08:27.587 INFO:tasks.workunit.client.0.smithi046.stdout:2/552: dwrite d5/d2c/d35/d80/f96 [0,4194304] 0 2024-02-19T19:08:27.596 INFO:tasks.workunit.client.0.smithi046.stdout:8/539: fdatasync d3/dd/d13/f1f 0 2024-02-19T19:08:27.596 INFO:tasks.workunit.client.0.smithi046.stdout:8/540: read d3/d37/d64/da2/d3c/f87 [961170,70393] 0 2024-02-19T19:08:27.596 INFO:tasks.workunit.client.0.smithi046.stdout:2/553: dread d5/d2c/d89/f1b [0,4194304] 0 2024-02-19T19:08:27.596 INFO:tasks.workunit.client.0.smithi046.stdout:2/554: fsync d5/d6/d13/d7c/f94 0 2024-02-19T19:08:27.596 INFO:tasks.workunit.client.0.smithi046.stdout:2/555: chown d5/d6/d13/d7c/d90 2120579 1 2024-02-19T19:08:27.600 INFO:tasks.workunit.client.0.smithi046.stdout:2/556: unlink d5/d6/f50 0 2024-02-19T19:08:27.602 INFO:tasks.workunit.client.0.smithi046.stdout:6/350: dwrite d4/d6/dd/d10/f15 [0,4194304] 0 2024-02-19T19:08:27.602 INFO:tasks.workunit.client.0.smithi046.stdout:6/351: fdatasync d4/d6/d22/f6e 0 2024-02-19T19:08:27.602 INFO:tasks.workunit.client.0.smithi046.stdout:6/352: creat d4/d6/d22/f71 x:0 0 0 2024-02-19T19:08:27.603 INFO:tasks.workunit.client.0.smithi046.stdout:6/353: creat d4/d6/dd/d10/d29/d2d/d35/d3c/f72 x:0 0 0 2024-02-19T19:08:27.603 INFO:tasks.workunit.client.0.smithi046.stdout:6/354: chown d4/d6/dd/d10/d29/d2d/d35/c5f 61831 1 2024-02-19T19:08:27.640 INFO:tasks.workunit.client.0.smithi046.stdout:2/557: dread d5/d2c/d89/f6d [4194304,4194304] 0 2024-02-19T19:08:27.642 INFO:tasks.workunit.client.0.smithi046.stdout:2/558: creat d5/d2c/faa x:0 0 0 2024-02-19T19:08:27.644 INFO:tasks.workunit.client.0.smithi046.stdout:7/499: sync 2024-02-19T19:08:27.644 INFO:tasks.workunit.client.0.smithi046.stdout:0/399: sync 2024-02-19T19:08:27.644 INFO:tasks.workunit.client.0.smithi046.stdout:1/408: sync 2024-02-19T19:08:27.644 INFO:tasks.workunit.client.0.smithi046.stdout:9/268: sync 2024-02-19T19:08:27.644 INFO:tasks.workunit.client.0.smithi046.stdout:3/325: sync 2024-02-19T19:08:27.644 INFO:tasks.workunit.client.0.smithi046.stdout:1/409: write d5/d10/d55/d81/f47 [442113,113787] 0 2024-02-19T19:08:27.645 INFO:tasks.workunit.client.0.smithi046.stdout:3/326: creat da/d30/f53 x:0 0 0 2024-02-19T19:08:27.645 INFO:tasks.workunit.client.0.smithi046.stdout:1/410: chown d5/d13/c24 95404 1 2024-02-19T19:08:27.645 INFO:tasks.workunit.client.0.smithi046.stdout:3/327: truncate da/d1d/d10/f1e 3043897 0 2024-02-19T19:08:27.647 INFO:tasks.workunit.client.0.smithi046.stdout:7/500: dread d0/d45/d71/f4c [0,4194304] 0 2024-02-19T19:08:27.647 INFO:tasks.workunit.client.0.smithi046.stdout:9/269: mkdir db/d20/d4e 0 2024-02-19T19:08:27.648 INFO:tasks.workunit.client.0.smithi046.stdout:0/400: mkdir d0/d19/d8/d92 0 2024-02-19T19:08:27.648 INFO:tasks.workunit.client.0.smithi046.stdout:5/469: sync 2024-02-19T19:08:27.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/411: creat d5/d10/d55/d81/d80/f88 x:0 0 0 2024-02-19T19:08:27.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/412: chown d5/d13/f31 18 1 2024-02-19T19:08:27.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/413: chown d5/d10/d3b/d3c/d3f/d72/c73 13320927 1 2024-02-19T19:08:27.651 INFO:tasks.workunit.client.0.smithi046.stdout:5/470: rename d2/dd/d29/d3b/l51 to d2/d27/d4b/l97 0 2024-02-19T19:08:27.652 INFO:tasks.workunit.client.0.smithi046.stdout:1/414: link d5/d10/d55/d81/c38 d5/d10/d55/c89 0 2024-02-19T19:08:27.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/471: mknod d2/dd/d29/c98 0 2024-02-19T19:08:27.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/472: dread - d2/d5e/f84 zero size 2024-02-19T19:08:27.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/473: fsync d2/f2b 0 2024-02-19T19:08:27.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/474: dread - d2/f85 zero size 2024-02-19T19:08:27.655 INFO:tasks.workunit.client.0.smithi046.stdout:1/415: truncate d5/f12 3997570 0 2024-02-19T19:08:27.656 INFO:tasks.workunit.client.0.smithi046.stdout:5/475: unlink d2/d27/d47/f60 0 2024-02-19T19:08:27.657 INFO:tasks.workunit.client.0.smithi046.stdout:1/416: stat d5/d10/d3b/c48 0 2024-02-19T19:08:27.658 INFO:tasks.workunit.client.0.smithi046.stdout:5/476: rmdir d2/dd/d26 39 2024-02-19T19:08:27.660 INFO:tasks.workunit.client.0.smithi046.stdout:1/417: mknod d5/d10/d3b/d4e/d76/c8a 0 2024-02-19T19:08:27.660 INFO:tasks.workunit.client.0.smithi046.stdout:1/418: creat d5/d13/d35/f8b x:0 0 0 2024-02-19T19:08:27.660 INFO:tasks.workunit.client.0.smithi046.stdout:7/501: read d0/d3f/f6b [1714127,74905] 0 2024-02-19T19:08:27.660 INFO:tasks.workunit.client.0.smithi046.stdout:5/477: symlink d2/dd/d29/d3b/l99 0 2024-02-19T19:08:27.661 INFO:tasks.workunit.client.0.smithi046.stdout:9/270: write db/d1e/f27 [1296443,78830] 0 2024-02-19T19:08:27.663 INFO:tasks.workunit.client.0.smithi046.stdout:1/419: rename d5/d13/d35/d37/f66 to d5/d10/d55/d81/f8c 0 2024-02-19T19:08:27.663 INFO:tasks.workunit.client.0.smithi046.stdout:1/420: chown d5/d10/d3b/d4e 419 1 2024-02-19T19:08:27.663 INFO:tasks.workunit.client.0.smithi046.stdout:1/421: write d5/d21/f23 [149970,35721] 0 2024-02-19T19:08:27.663 INFO:tasks.workunit.client.0.smithi046.stdout:1/422: chown d5/d13/d35/d37 413555884 1 2024-02-19T19:08:27.663 INFO:tasks.workunit.client.0.smithi046.stdout:1/423: read d5/d13/f31 [4081660,43121] 0 2024-02-19T19:08:27.664 INFO:tasks.workunit.client.0.smithi046.stdout:1/424: fsync d5/f27 0 2024-02-19T19:08:27.664 INFO:tasks.workunit.client.0.smithi046.stdout:2/559: dwrite d5/d2c/d89/f6d [0,4194304] 0 2024-02-19T19:08:27.664 INFO:tasks.workunit.client.0.smithi046.stdout:2/560: fsync d5/d6/d6e/fa6 0 2024-02-19T19:08:27.664 INFO:tasks.workunit.client.0.smithi046.stdout:5/478: rmdir d2/dd/d26/d65/d5f 39 2024-02-19T19:08:27.665 INFO:tasks.workunit.client.0.smithi046.stdout:3/328: dwrite da/d1d/d10/f4c [0,4194304] 0 2024-02-19T19:08:27.666 INFO:tasks.workunit.client.0.smithi046.stdout:9/271: link db/d20/c2e db/d1e/d32/d47/c4f 0 2024-02-19T19:08:27.670 INFO:tasks.workunit.client.0.smithi046.stdout:7/502: rename d0/d45/d71/d41/d5f/l65 to d0/la1 0 2024-02-19T19:08:27.670 INFO:tasks.workunit.client.0.smithi046.stdout:7/503: chown d0/d3f/c5d 1282861041 1 2024-02-19T19:08:27.671 INFO:tasks.workunit.client.0.smithi046.stdout:5/479: truncate d2/dd/d29/f35 605895 0 2024-02-19T19:08:27.676 INFO:tasks.workunit.client.0.smithi046.stdout:3/329: mkdir da/d30/d38/d54 0 2024-02-19T19:08:27.680 INFO:tasks.workunit.client.0.smithi046.stdout:3/330: creat da/d1d/d3f/f55 x:0 0 0 2024-02-19T19:08:27.680 INFO:tasks.workunit.client.0.smithi046.stdout:3/331: dread - da/d1d/d3f/f55 zero size 2024-02-19T19:08:27.680 INFO:tasks.workunit.client.0.smithi046.stdout:3/332: creat da/d30/d38/f56 x:0 0 0 2024-02-19T19:08:27.680 INFO:tasks.workunit.client.0.smithi046.stdout:3/333: write da/d1d/d10/f1b [373363,129712] 0 2024-02-19T19:08:27.680 INFO:tasks.workunit.client.0.smithi046.stdout:3/334: truncate da/d1d/f28 2026208 0 2024-02-19T19:08:27.680 INFO:tasks.workunit.client.0.smithi046.stdout:2/561: dread d5/d2c/d45/f9c [0,4194304] 0 2024-02-19T19:08:27.680 INFO:tasks.workunit.client.0.smithi046.stdout:2/562: fdatasync f1 0 2024-02-19T19:08:27.680 INFO:tasks.workunit.client.0.smithi046.stdout:0/401: dwrite d0/f1c [0,4194304] 0 2024-02-19T19:08:27.680 INFO:tasks.workunit.client.0.smithi046.stdout:5/480: getdents d2/dd/d2f/d34/d5d 0 2024-02-19T19:08:27.681 INFO:tasks.workunit.client.0.smithi046.stdout:3/335: read da/d1d/d10/f50 [829157,102809] 0 2024-02-19T19:08:27.681 INFO:tasks.workunit.client.0.smithi046.stdout:3/336: stat da/d1d/f28 0 2024-02-19T19:08:27.682 INFO:tasks.workunit.client.0.smithi046.stdout:3/337: creat da/d30/f57 x:0 0 0 2024-02-19T19:08:27.683 INFO:tasks.workunit.client.0.smithi046.stdout:1/425: dwrite d5/d10/d55/d81/f5d [0,4194304] 0 2024-02-19T19:08:27.683 INFO:tasks.workunit.client.0.smithi046.stdout:1/426: truncate d5/f27 2582790 0 2024-02-19T19:08:27.683 INFO:tasks.workunit.client.0.smithi046.stdout:9/272: dread f0 [0,4194304] 0 2024-02-19T19:08:27.684 INFO:tasks.workunit.client.0.smithi046.stdout:2/563: mkdir d5/d6/d6e/dab 0 2024-02-19T19:08:27.686 INFO:tasks.workunit.client.0.smithi046.stdout:0/402: rename d0/d19/f2d to d0/d5f/d65/d79/f93 0 2024-02-19T19:08:27.690 INFO:tasks.workunit.client.0.smithi046.stdout:7/504: dwrite d0/d45/d4a/d58/d60/f89 [0,4194304] 0 2024-02-19T19:08:27.691 INFO:tasks.workunit.client.0.smithi046.stdout:3/338: rmdir da/d1d/d51 0 2024-02-19T19:08:27.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/505: write d0/d4/f29 [374382,23840] 0 2024-02-19T19:08:27.694 INFO:tasks.workunit.client.0.smithi046.stdout:5/481: write d2/f2b [872916,81355] 0 2024-02-19T19:08:27.694 INFO:tasks.workunit.client.0.smithi046.stdout:5/482: truncate d2/dd/f5c 246155 0 2024-02-19T19:08:27.694 INFO:tasks.workunit.client.0.smithi046.stdout:5/483: fsync d2/dd/d26/d65/f63 0 2024-02-19T19:08:27.696 INFO:tasks.workunit.client.0.smithi046.stdout:1/427: mknod d5/d2f/c8d 0 2024-02-19T19:08:27.697 INFO:tasks.workunit.client.0.smithi046.stdout:9/273: unlink db/l10 0 2024-02-19T19:08:27.700 INFO:tasks.workunit.client.0.smithi046.stdout:2/564: rename d5/d2c/d89/d4c/f8f to d5/d2c/d56/d5a/fac 0 2024-02-19T19:08:27.700 INFO:tasks.workunit.client.0.smithi046.stdout:3/339: dread da/f37 [0,4194304] 0 2024-02-19T19:08:27.701 INFO:tasks.workunit.client.0.smithi046.stdout:7/506: rename d0/c2f to d0/ca2 0 2024-02-19T19:08:27.702 INFO:tasks.workunit.client.0.smithi046.stdout:5/484: mknod d2/c9a 0 2024-02-19T19:08:27.702 INFO:tasks.workunit.client.0.smithi046.stdout:5/485: readlink d2/d27/d47/d54/d57/l7d 0 2024-02-19T19:08:27.702 INFO:tasks.workunit.client.0.smithi046.stdout:5/486: fdatasync d2/f40 0 2024-02-19T19:08:27.702 INFO:tasks.workunit.client.0.smithi046.stdout:3/340: write da/d1d/d10/f2b [817624,49481] 0 2024-02-19T19:08:27.703 INFO:tasks.workunit.client.0.smithi046.stdout:9/274: rename db/d20/c46 to db/d1e/c50 0 2024-02-19T19:08:27.703 INFO:tasks.workunit.client.0.smithi046.stdout:9/275: getdents db/d1e/d32/d38 0 2024-02-19T19:08:27.705 INFO:tasks.workunit.client.0.smithi046.stdout:3/341: unlink da/d1d/d10/c16 0 2024-02-19T19:08:27.706 INFO:tasks.workunit.client.0.smithi046.stdout:0/403: dwrite d0/d5f/f60 [0,4194304] 0 2024-02-19T19:08:27.708 INFO:tasks.workunit.client.0.smithi046.stdout:7/507: rename d0/d4/dd/d62 to d0/d45/d71/da3 0 2024-02-19T19:08:27.709 INFO:tasks.workunit.client.0.smithi046.stdout:5/487: fsync d2/dd/d2f/d34/d5d/f43 0 2024-02-19T19:08:27.710 INFO:tasks.workunit.client.0.smithi046.stdout:9/276: symlink db/d1e/d32/d38/l51 0 2024-02-19T19:08:27.710 INFO:tasks.workunit.client.0.smithi046.stdout:9/277: write db/d1e/f1f [1568731,37518] 0 2024-02-19T19:08:27.710 INFO:tasks.workunit.client.0.smithi046.stdout:9/278: chown db/f1c 1712512899 1 2024-02-19T19:08:27.711 INFO:tasks.workunit.client.0.smithi046.stdout:3/342: creat da/d1d/d10/f58 x:0 0 0 2024-02-19T19:08:27.712 INFO:tasks.workunit.client.0.smithi046.stdout:2/565: read d5/d2c/d89/d3f/d5c/f9d [3783650,86000] 0 2024-02-19T19:08:27.714 INFO:tasks.workunit.client.0.smithi046.stdout:0/404: fsync d0/d5f/d65/d79/f93 0 2024-02-19T19:08:27.714 INFO:tasks.workunit.client.0.smithi046.stdout:1/428: dwrite d5/d10/d3b/d3c/d3f/f43 [4194304,4194304] 0 2024-02-19T19:08:27.714 INFO:tasks.workunit.client.0.smithi046.stdout:1/429: fsync d5/d10/d55/d81/f57 0 2024-02-19T19:08:27.717 INFO:tasks.workunit.client.0.smithi046.stdout:5/488: rename d2/dd/d2f/d34/l6f to d2/dd/d29/d89/l9b 0 2024-02-19T19:08:27.718 INFO:tasks.workunit.client.0.smithi046.stdout:2/566: mknod d5/d2c/d45/d9b/cad 0 2024-02-19T19:08:27.725 INFO:tasks.workunit.client.0.smithi046.stdout:0/405: creat d0/d24/d8c/f94 x:0 0 0 2024-02-19T19:08:27.726 INFO:tasks.workunit.client.0.smithi046.stdout:0/406: write d0/d5f/f73 [352392,24527] 0 2024-02-19T19:08:27.726 INFO:tasks.workunit.client.0.smithi046.stdout:3/343: dwrite da/f37 [0,4194304] 0 2024-02-19T19:08:27.728 INFO:tasks.workunit.client.0.smithi046.stdout:1/430: rmdir d5/d2f 39 2024-02-19T19:08:27.730 INFO:tasks.workunit.client.0.smithi046.stdout:2/567: creat d5/d6/d6e/dab/fae x:0 0 0 2024-02-19T19:08:27.731 INFO:tasks.workunit.client.0.smithi046.stdout:0/407: unlink d0/d24/d2f/f8a 0 2024-02-19T19:08:27.733 INFO:tasks.workunit.client.0.smithi046.stdout:3/344: rename da/l2f to da/d30/d38/l59 0 2024-02-19T19:08:27.734 INFO:tasks.workunit.client.0.smithi046.stdout:2/568: mknod d5/d2c/d89/d92/caf 0 2024-02-19T19:08:27.735 INFO:tasks.workunit.client.0.smithi046.stdout:3/345: mknod da/d1d/c5a 0 2024-02-19T19:08:27.736 INFO:tasks.workunit.client.0.smithi046.stdout:3/346: read da/d1d/f28 [1337766,10834] 0 2024-02-19T19:08:27.736 INFO:tasks.workunit.client.0.smithi046.stdout:3/347: stat da/d1d/d10/f1b 0 2024-02-19T19:08:27.736 INFO:tasks.workunit.client.0.smithi046.stdout:2/569: rename d5/d6/d6e/f91 to d5/d6/d13/d7c/d90/fb0 0 2024-02-19T19:08:27.738 INFO:tasks.workunit.client.0.smithi046.stdout:2/570: creat d5/d2c/d89/fb1 x:0 0 0 2024-02-19T19:08:27.738 INFO:tasks.workunit.client.0.smithi046.stdout:2/571: readlink d5/l26 0 2024-02-19T19:08:27.738 INFO:tasks.workunit.client.0.smithi046.stdout:2/572: readlink d5/d6/d13/d8a/l93 0 2024-02-19T19:08:27.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/573: dread d5/f2a [0,4194304] 0 2024-02-19T19:08:27.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/574: creat d5/d6/d13/d8a/fb2 x:0 0 0 2024-02-19T19:08:27.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/575: fdatasync d5/d2c/d89/d3f/f5e 0 2024-02-19T19:08:27.754 INFO:tasks.workunit.client.0.smithi046.stdout:2/576: rename d5/d6/d13/l25 to d5/d2c/d89/d4c/lb3 0 2024-02-19T19:08:27.754 INFO:tasks.workunit.client.0.smithi046.stdout:2/577: fdatasync d5/d2c/d45/f9c 0 2024-02-19T19:08:27.754 INFO:tasks.workunit.client.0.smithi046.stdout:2/578: mknod d5/d2c/d89/d3f/da1/cb4 0 2024-02-19T19:08:27.773 INFO:tasks.workunit.client.0.smithi046.stdout:5/489: dwrite d2/d27/d47/d54/f56 [0,4194304] 0 2024-02-19T19:08:27.775 INFO:tasks.workunit.client.0.smithi046.stdout:5/490: mknod d2/dd/d2f/d34/c9c 0 2024-02-19T19:08:27.776 INFO:tasks.workunit.client.0.smithi046.stdout:5/491: truncate d2/f40 958527 0 2024-02-19T19:08:27.776 INFO:tasks.workunit.client.0.smithi046.stdout:5/492: chown d2/dd/l76 37953406 1 2024-02-19T19:08:27.776 INFO:tasks.workunit.client.0.smithi046.stdout:5/493: fsync d2/f70 0 2024-02-19T19:08:27.861 INFO:tasks.workunit.client.0.smithi046.stdout:3/348: dread da/d1d/d10/f1e [0,4194304] 0 2024-02-19T19:08:27.861 INFO:tasks.workunit.client.0.smithi046.stdout:3/349: chown da/d30/d38/f56 5 1 2024-02-19T19:08:27.861 INFO:tasks.workunit.client.0.smithi046.stdout:3/350: fsync da/d30/f57 0 2024-02-19T19:08:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:1/431: dwrite d5/d13/f31 [4194304,4194304] 0 2024-02-19T19:08:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:0/408: write d0/d24/f3b [3671548,6267] 0 2024-02-19T19:08:27.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/494: write d2/d27/d47/d54/f56 [1866806,100176] 0 2024-02-19T19:08:27.868 INFO:tasks.workunit.client.0.smithi046.stdout:0/409: dread d0/d24/d2f/d53/d6b/f6e [0,4194304] 0 2024-02-19T19:08:27.869 INFO:tasks.workunit.client.0.smithi046.stdout:1/432: dread d5/f27 [0,4194304] 0 2024-02-19T19:08:27.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/410: dread d0/d5f/f69 [0,4194304] 0 2024-02-19T19:08:27.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/411: dread - d0/d19/f91 zero size 2024-02-19T19:08:27.871 INFO:tasks.workunit.client.0.smithi046.stdout:1/433: mknod d5/d10/d3b/c8e 0 2024-02-19T19:08:27.877 INFO:tasks.workunit.client.0.smithi046.stdout:0/412: dread d0/f1c [0,4194304] 0 2024-02-19T19:08:27.880 INFO:tasks.workunit.client.0.smithi046.stdout:0/413: link d0/d24/f3b d0/d24/d5b/d7f/f95 0 2024-02-19T19:08:27.880 INFO:tasks.workunit.client.0.smithi046.stdout:0/414: fdatasync d0/d24/d8c/f94 0 2024-02-19T19:08:27.880 INFO:tasks.workunit.client.0.smithi046.stdout:5/495: dread d2/dd/d29/f45 [0,4194304] 0 2024-02-19T19:08:27.887 INFO:tasks.workunit.client.0.smithi046.stdout:3/351: dwrite da/f37 [0,4194304] 0 2024-02-19T19:08:27.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/352: unlink da/d3b/l4e 0 2024-02-19T19:08:27.899 INFO:tasks.workunit.client.0.smithi046.stdout:1/434: dwrite d5/d2f/d5e/f62 [0,4194304] 0 2024-02-19T19:08:27.902 INFO:tasks.workunit.client.0.smithi046.stdout:1/435: rmdir d5/d13/d35/d37 39 2024-02-19T19:08:27.906 INFO:tasks.workunit.client.0.smithi046.stdout:1/436: dread d5/fc [0,4194304] 0 2024-02-19T19:08:27.907 INFO:tasks.workunit.client.0.smithi046.stdout:1/437: link d5/d10/c1c d5/d10/d3b/d4e/c8f 0 2024-02-19T19:08:27.909 INFO:tasks.workunit.client.0.smithi046.stdout:1/438: read d5/f27 [26169,95023] 0 2024-02-19T19:08:27.912 INFO:tasks.workunit.client.0.smithi046.stdout:5/496: dwrite d2/f81 [0,4194304] 0 2024-02-19T19:08:27.914 INFO:tasks.workunit.client.0.smithi046.stdout:3/353: dwrite da/d30/f57 [0,4194304] 0 2024-02-19T19:08:27.915 INFO:tasks.workunit.client.0.smithi046.stdout:0/415: dwrite d0/f4e [0,4194304] 0 2024-02-19T19:08:27.920 INFO:tasks.workunit.client.0.smithi046.stdout:1/439: write d5/d2f/d5e/f62 [1424489,12630] 0 2024-02-19T19:08:27.920 INFO:tasks.workunit.client.0.smithi046.stdout:1/440: dread - d5/d10/d55/d81/d80/f88 zero size 2024-02-19T19:08:27.922 INFO:tasks.workunit.client.0.smithi046.stdout:1/441: link d5/d10/d55/c89 d5/d10/d55/d81/d80/c90 0 2024-02-19T19:08:27.922 INFO:tasks.workunit.client.0.smithi046.stdout:1/442: chown d5/d2f/d5e 25462365 1 2024-02-19T19:08:27.924 INFO:tasks.workunit.client.0.smithi046.stdout:1/443: mkdir d5/d10/d3b/d4e/d91 0 2024-02-19T19:08:27.936 INFO:tasks.workunit.client.0.smithi046.stdout:1/444: dread d5/d10/d3b/d3c/d3f/f43 [4194304,4194304] 0 2024-02-19T19:08:27.937 INFO:tasks.workunit.client.0.smithi046.stdout:1/445: mknod d5/c92 0 2024-02-19T19:08:27.939 INFO:tasks.workunit.client.0.smithi046.stdout:0/416: dread d0/d24/f23 [0,4194304] 0 2024-02-19T19:08:27.939 INFO:tasks.workunit.client.0.smithi046.stdout:5/497: dwrite d2/dd/d26/f50 [0,4194304] 0 2024-02-19T19:08:27.939 INFO:tasks.workunit.client.0.smithi046.stdout:5/498: chown d2/c14 417008439 1 2024-02-19T19:08:27.940 INFO:tasks.workunit.client.0.smithi046.stdout:3/354: dwrite da/f37 [4194304,4194304] 0 2024-02-19T19:08:27.940 INFO:tasks.workunit.client.0.smithi046.stdout:0/417: dread d0/d19/d8/d37/f5d [4194304,4194304] 0 2024-02-19T19:08:27.941 INFO:tasks.workunit.client.0.smithi046.stdout:1/446: mknod d5/d10/d3b/d3c/d3f/c93 0 2024-02-19T19:08:27.941 INFO:tasks.workunit.client.0.smithi046.stdout:1/447: creat d5/d13/d35/f94 x:0 0 0 2024-02-19T19:08:27.942 INFO:tasks.workunit.client.0.smithi046.stdout:5/499: symlink d2/d27/d47/d54/d57/l9d 0 2024-02-19T19:08:27.951 INFO:tasks.workunit.client.0.smithi046.stdout:1/448: dread d5/d13/d35/f71 [0,4194304] 0 2024-02-19T19:08:27.956 INFO:tasks.workunit.client.0.smithi046.stdout:1/449: write d5/d13/d35/f71 [2548675,39777] 0 2024-02-19T19:08:27.957 INFO:tasks.workunit.client.0.smithi046.stdout:1/450: creat d5/d10/f95 x:0 0 0 2024-02-19T19:08:27.958 INFO:tasks.workunit.client.0.smithi046.stdout:1/451: symlink d5/d10/d55/d81/d80/l96 0 2024-02-19T19:08:27.959 INFO:tasks.workunit.client.0.smithi046.stdout:1/452: getdents d5 0 2024-02-19T19:08:27.960 INFO:tasks.workunit.client.0.smithi046.stdout:1/453: creat d5/d2f/d5e/f97 x:0 0 0 2024-02-19T19:08:27.960 INFO:tasks.workunit.client.0.smithi046.stdout:1/454: creat d5/d21/f98 x:0 0 0 2024-02-19T19:08:27.960 INFO:tasks.workunit.client.0.smithi046.stdout:1/455: write d5/d13/d35/d37/d64/f6b [591519,65179] 0 2024-02-19T19:08:27.965 INFO:tasks.workunit.client.0.smithi046.stdout:1/456: fsync d5/d10/f95 0 2024-02-19T19:08:27.965 INFO:tasks.workunit.client.0.smithi046.stdout:0/418: dwrite d0/f52 [0,4194304] 0 2024-02-19T19:08:27.966 INFO:tasks.workunit.client.0.smithi046.stdout:1/457: unlink d5/d13/d35/c54 0 2024-02-19T19:08:27.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/419: symlink d0/d19/d8/d37/d58/l96 0 2024-02-19T19:08:27.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/420: chown d0/d19/d8/d92 375451361 1 2024-02-19T19:08:27.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/421: readlink d0/d24/d2f/l3f 0 2024-02-19T19:08:27.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/422: write d0/d19/f6 [731298,92822] 0 2024-02-19T19:08:27.968 INFO:tasks.workunit.client.0.smithi046.stdout:0/423: link d0/d19/db/d27/f41 d0/d24/d8c/f97 0 2024-02-19T19:08:27.968 INFO:tasks.workunit.client.0.smithi046.stdout:0/424: chown d0/f4e 2969 1 2024-02-19T19:08:27.968 INFO:tasks.workunit.client.0.smithi046.stdout:1/458: dread d5/fc [0,4194304] 0 2024-02-19T19:08:27.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/425: mknod d0/d24/d5b/c98 0 2024-02-19T19:08:27.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/426: stat d0/d19/f6 0 2024-02-19T19:08:27.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/427: stat d0/d24/d5b/d7f 0 2024-02-19T19:08:27.969 INFO:tasks.workunit.client.0.smithi046.stdout:1/459: symlink d5/d10/d55/d81/d80/l99 0 2024-02-19T19:08:27.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/428: creat d0/d19/d8/f99 x:0 0 0 2024-02-19T19:08:27.970 INFO:tasks.workunit.client.0.smithi046.stdout:1/460: mkdir d5/d21/d9a 0 2024-02-19T19:08:27.971 INFO:tasks.workunit.client.0.smithi046.stdout:0/429: creat d0/d19/db/d6a/f9a x:0 0 0 2024-02-19T19:08:27.971 INFO:tasks.workunit.client.0.smithi046.stdout:0/430: fsync d0/d24/f39 0 2024-02-19T19:08:27.972 INFO:tasks.workunit.client.0.smithi046.stdout:1/461: rename d5/d10/d3b/d4e/d76/c8a to d5/d10/d55/d81/d80/c9b 0 2024-02-19T19:08:27.973 INFO:tasks.workunit.client.0.smithi046.stdout:0/431: mkdir d0/d24/d5b/d7f/d9b 0 2024-02-19T19:08:27.973 INFO:tasks.workunit.client.0.smithi046.stdout:1/462: creat d5/d10/d3b/d3c/d3f/d72/f9c x:0 0 0 2024-02-19T19:08:27.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/463: chown d5/d10/d55/d81/f5d 15 1 2024-02-19T19:08:27.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/464: mknod d5/d10/d55/d81/c9d 0 2024-02-19T19:08:27.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/465: creat d5/d13/d35/f9e x:0 0 0 2024-02-19T19:08:27.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/466: chown d5/d13/d35/f8b 3 1 2024-02-19T19:08:27.981 INFO:tasks.workunit.client.0.smithi046.stdout:0/432: read d0/d19/db/d27/f89 [4066791,91484] 0 2024-02-19T19:08:28.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/433: dwrite d0/d5f/f6d [0,4194304] 0 2024-02-19T19:08:28.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/434: stat d0/d24/d2f/d53/f61 0 2024-02-19T19:08:28.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/435: creat d0/d24/f9c x:0 0 0 2024-02-19T19:08:28.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/436: stat d0/d19/f6 0 2024-02-19T19:08:28.002 INFO:tasks.workunit.client.0.smithi046.stdout:0/437: dread d0/d19/d8/d37/d80/f86 [0,4194304] 0 2024-02-19T19:08:28.004 INFO:tasks.workunit.client.0.smithi046.stdout:0/438: mknod d0/d19/d8/d37/d58/c9d 0 2024-02-19T19:08:28.004 INFO:tasks.workunit.client.0.smithi046.stdout:0/439: write d0/d24/f32 [4999462,51393] 0 2024-02-19T19:08:28.005 INFO:tasks.workunit.client.0.smithi046.stdout:0/440: mknod d0/d5f/d74/c9e 0 2024-02-19T19:08:28.005 INFO:tasks.workunit.client.0.smithi046.stdout:0/441: creat d0/d24/d2f/d53/f9f x:0 0 0 2024-02-19T19:08:28.010 INFO:tasks.workunit.client.0.smithi046.stdout:0/442: dread d0/f2 [0,4194304] 0 2024-02-19T19:08:28.024 INFO:tasks.workunit.client.0.smithi046.stdout:0/443: dwrite d0/d19/d8/f22 [0,4194304] 0 2024-02-19T19:08:28.029 INFO:tasks.workunit.client.0.smithi046.stdout:0/444: rmdir d0/d5f 39 2024-02-19T19:08:28.029 INFO:tasks.workunit.client.0.smithi046.stdout:0/445: write d0/f18 [969274,37176] 0 2024-02-19T19:08:28.029 INFO:tasks.workunit.client.0.smithi046.stdout:0/446: fdatasync d0/d19/d8/d37/d40/f8f 0 2024-02-19T19:08:28.051 INFO:tasks.workunit.client.0.smithi046.stdout:0/447: dwrite d0/d19/db/d6a/f9a [0,4194304] 0 2024-02-19T19:08:28.054 INFO:tasks.workunit.client.0.smithi046.stdout:0/448: mkdir d0/d19/d8/d37/da0 0 2024-02-19T19:08:28.054 INFO:tasks.workunit.client.0.smithi046.stdout:0/449: stat d0/d24/d2f/d53/d6b/f6e 0 2024-02-19T19:08:28.056 INFO:tasks.workunit.client.0.smithi046.stdout:0/450: rename d0/d19/db/d27 to d0/d24/d56/da1 0 2024-02-19T19:08:28.056 INFO:tasks.workunit.client.0.smithi046.stdout:0/451: write d0/f3c [428683,8273] 0 2024-02-19T19:08:28.056 INFO:tasks.workunit.client.0.smithi046.stdout:0/452: mknod d0/d24/d5b/ca2 0 2024-02-19T19:08:28.057 INFO:tasks.workunit.client.0.smithi046.stdout:0/453: mkdir d0/d24/d56/da3 0 2024-02-19T19:08:28.057 INFO:tasks.workunit.client.0.smithi046.stdout:0/454: fsync d0/d19/d8/f22 0 2024-02-19T19:08:28.058 INFO:tasks.workunit.client.0.smithi046.stdout:0/455: rename d0/d19/db/f50 to d0/d19/d8/d37/d58/fa4 0 2024-02-19T19:08:28.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/456: dread - d0/d19/d8/d37/f7d zero size 2024-02-19T19:08:28.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/457: mkdir d0/d19/d4d/da5 0 2024-02-19T19:08:28.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/458: dread d0/d24/f32 [0,4194304] 0 2024-02-19T19:08:28.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/459: fdatasync d0/d24/f8b 0 2024-02-19T19:08:28.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/460: chown d0/d19/d8/d37/d40/f83 1048786440 1 2024-02-19T19:08:28.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/461: readlink d0/d19/d8/d37/d40/l4a 0 2024-02-19T19:08:28.067 INFO:tasks.workunit.client.0.smithi046.stdout:0/462: read d0/d24/f39 [471719,67224] 0 2024-02-19T19:08:28.074 INFO:tasks.workunit.client.0.smithi046.stdout:0/463: dread d0/f4e [0,4194304] 0 2024-02-19T19:08:28.075 INFO:tasks.workunit.client.0.smithi046.stdout:0/464: chown d0/d19/l29 608863 1 2024-02-19T19:08:28.075 INFO:tasks.workunit.client.0.smithi046.stdout:0/465: mkdir d0/d19/d8/d37/d40/da6 0 2024-02-19T19:08:28.075 INFO:tasks.workunit.client.0.smithi046.stdout:0/466: write d0/d19/f35 [1008309,12219] 0 2024-02-19T19:08:28.076 INFO:tasks.workunit.client.0.smithi046.stdout:0/467: mkdir d0/d19/d4d/da5/da7 0 2024-02-19T19:08:28.077 INFO:tasks.workunit.client.0.smithi046.stdout:0/468: mkdir d0/d5f/da8 0 2024-02-19T19:08:28.078 INFO:tasks.workunit.client.0.smithi046.stdout:0/469: creat d0/d24/d5b/fa9 x:0 0 0 2024-02-19T19:08:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:0/470: symlink d0/d24/d56/da3/laa 0 2024-02-19T19:08:28.079 INFO:tasks.workunit.client.0.smithi046.stdout:0/471: creat d0/d24/d56/fab x:0 0 0 2024-02-19T19:08:28.081 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:27 smithi046 podman[112566]: 2024-02-19 19:08:27.617448163 +0000 UTC m=+2.126590111 container init a31225ea4dec5652e7294f5f748038ddd30c3c69cb8db11b07039884e06ddebf (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-19T19:08:28.081 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:27 smithi046 podman[112566]: 2024-02-19 19:08:27.622216955 +0000 UTC m=+2.131358892 container start a31225ea4dec5652e7294f5f748038ddd30c3c69cb8db11b07039884e06ddebf (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, ceph=True) 2024-02-19T19:08:28.085 INFO:tasks.workunit.client.0.smithi046.stdout:0/472: read d0/d19/d8/d37/f5d [1089631,118323] 0 2024-02-19T19:08:28.086 INFO:tasks.workunit.client.0.smithi046.stdout:0/473: mkdir d0/d24/d2f/dac 0 2024-02-19T19:08:28.091 INFO:tasks.workunit.client.0.smithi046.stdout:0/474: dread d0/d19/d8/d37/f5d [0,4194304] 0 2024-02-19T19:08:28.100 INFO:tasks.workunit.client.0.smithi046.stdout:0/475: dread d0/d19/f6 [4194304,4194304] 0 2024-02-19T19:08:28.102 INFO:tasks.workunit.client.0.smithi046.stdout:0/476: dread d0/d5f/f73 [0,4194304] 0 2024-02-19T19:08:28.107 INFO:tasks.workunit.client.0.smithi046.stdout:0/477: write d0/d19/f6 [8360227,90788] 0 2024-02-19T19:08:28.107 INFO:tasks.workunit.client.0.smithi046.stdout:0/478: chown d0/d19/db 108245 1 2024-02-19T19:08:28.111 INFO:tasks.workunit.client.0.smithi046.stdout:0/479: symlink d0/d19/d8/d37/lad 0 2024-02-19T19:08:28.113 INFO:tasks.workunit.client.0.smithi046.stdout:0/480: rename d0/d24/d56/da1/f89 to d0/d24/d2f/dac/fae 0 2024-02-19T19:08:28.113 INFO:tasks.workunit.client.0.smithi046.stdout:0/481: fdatasync d0/d24/d56/da1/f28 0 2024-02-19T19:08:28.124 INFO:tasks.workunit.client.0.smithi046.stdout:4/509: sync 2024-02-19T19:08:28.124 INFO:tasks.workunit.client.0.smithi046.stdout:8/541: sync 2024-02-19T19:08:28.124 INFO:tasks.workunit.client.0.smithi046.stdout:4/510: read d6/d15/d17/f41 [2530732,44924] 0 2024-02-19T19:08:28.125 INFO:tasks.workunit.client.0.smithi046.stdout:8/542: creat d3/d9d/fc0 x:0 0 0 2024-02-19T19:08:28.127 INFO:tasks.workunit.client.0.smithi046.stdout:4/511: link d6/d11/d26/f74 d6/d94/faf 0 2024-02-19T19:08:28.127 INFO:tasks.workunit.client.0.smithi046.stdout:4/512: stat d6/d11/d26/d89/d8a/d8d/lae 0 2024-02-19T19:08:28.128 INFO:tasks.workunit.client.0.smithi046.stdout:8/543: readlink d3/dd/d13/d6b/d46/d6a/la1 0 2024-02-19T19:08:28.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/544: dread d3/f9 [0,4194304] 0 2024-02-19T19:08:28.135 INFO:tasks.workunit.client.0.smithi046.stdout:4/513: dread d6/d15/d17/d1e/d25/f4b [0,4194304] 0 2024-02-19T19:08:28.135 INFO:tasks.workunit.client.0.smithi046.stdout:4/514: dread - d6/d11/d92/f9e zero size 2024-02-19T19:08:28.137 INFO:tasks.workunit.client.0.smithi046.stdout:4/515: unlink d6/d11/d26/l82 0 2024-02-19T19:08:28.137 INFO:tasks.workunit.client.0.smithi046.stdout:4/516: fsync d6/d15/d17/d1e/f6d 0 2024-02-19T19:08:28.137 INFO:tasks.workunit.client.0.smithi046.stdout:4/517: chown d6/d50/fa0 64139186 1 2024-02-19T19:08:28.137 INFO:tasks.workunit.client.0.smithi046.stdout:4/518: link d6/d15/d6e/c7e d6/d11/d92/cb0 0 2024-02-19T19:08:28.138 INFO:tasks.workunit.client.0.smithi046.stdout:4/519: mkdir d6/d15/d17/d4a/db1 0 2024-02-19T19:08:28.138 INFO:tasks.workunit.client.0.smithi046.stdout:4/520: fdatasync d6/d11/d26/f60 0 2024-02-19T19:08:28.140 INFO:tasks.workunit.client.0.smithi046.stdout:8/545: write d3/d18/f1a [928941,49874] 0 2024-02-19T19:08:28.143 INFO:tasks.workunit.client.0.smithi046.stdout:8/546: dread d3/dd/d3f/d49/d53/f5e [0,4194304] 0 2024-02-19T19:08:28.144 INFO:tasks.workunit.client.0.smithi046.stdout:8/547: truncate d3/f9 867958 0 2024-02-19T19:08:28.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/548: symlink d3/d37/d64/da2/dac/lc1 0 2024-02-19T19:08:28.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/549: creat d3/d9d/fc2 x:0 0 0 2024-02-19T19:08:28.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/550: readlink d3/l2b 0 2024-02-19T19:08:28.147 INFO:tasks.workunit.client.0.smithi046.stdout:8/551: link d3/dd/fe d3/d9d/fc3 0 2024-02-19T19:08:28.149 INFO:tasks.workunit.client.0.smithi046.stdout:8/552: creat d3/dd/d13/d6b/d36/fc4 x:0 0 0 2024-02-19T19:08:28.150 INFO:tasks.workunit.client.0.smithi046.stdout:8/553: dread - d3/dd/d13/d66/f7b zero size 2024-02-19T19:08:28.151 INFO:tasks.workunit.client.0.smithi046.stdout:8/554: getdents d3/d8b 0 2024-02-19T19:08:28.153 INFO:tasks.workunit.client.0.smithi046.stdout:8/555: symlink d3/d37/d64/d9a/lc5 0 2024-02-19T19:08:28.153 INFO:tasks.workunit.client.0.smithi046.stdout:8/556: chown d3/dd/d13/d6b/d46/d6a 261806937 1 2024-02-19T19:08:28.168 INFO:tasks.workunit.client.0.smithi046.stdout:8/557: dwrite d3/dd/d13/d6b/d46/d54/fa4 [0,4194304] 0 2024-02-19T19:08:28.170 INFO:tasks.workunit.client.0.smithi046.stdout:8/558: write d3/dd/d13/fbb [351111,35147] 0 2024-02-19T19:08:28.170 INFO:tasks.workunit.client.0.smithi046.stdout:8/559: write d3/f44 [4333983,106221] 0 2024-02-19T19:08:28.172 INFO:tasks.workunit.client.0.smithi046.stdout:8/560: creat d3/dd/d13/d6b/d46/d6a/db2/fc6 x:0 0 0 2024-02-19T19:08:28.172 INFO:tasks.workunit.client.0.smithi046.stdout:8/561: chown d3/dd/d13/d6b/d46/d6a/c7c 1247 1 2024-02-19T19:08:28.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/562: mkdir d3/d37/d64/da2/d3c/db6/dc7 0 2024-02-19T19:08:28.187 INFO:tasks.workunit.client.0.smithi046.stdout:8/563: dwrite d3/dd/d3f/d49/d5b/f6d [0,4194304] 0 2024-02-19T19:08:28.189 INFO:tasks.workunit.client.0.smithi046.stdout:8/564: rename d3/dd/d13/d6b/d36/l63 to d3/d37/d64/lc8 0 2024-02-19T19:08:28.191 INFO:tasks.workunit.client.0.smithi046.stdout:8/565: symlink d3/dd/d13/d6b/lc9 0 2024-02-19T19:08:28.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/566: mkdir d3/d37/dca 0 2024-02-19T19:08:28.193 INFO:tasks.workunit.client.0.smithi046.stdout:8/567: dread d3/d37/f71 [0,4194304] 0 2024-02-19T19:08:28.195 INFO:tasks.workunit.client.0.smithi046.stdout:8/568: rmdir d3/dd/d3f/d49/d5b/d5f/da0 39 2024-02-19T19:08:28.195 INFO:tasks.workunit.client.0.smithi046.stdout:8/569: chown d3/dd/d13/d6b/lc9 3828 1 2024-02-19T19:08:28.195 INFO:tasks.workunit.client.0.smithi046.stdout:8/570: stat d3/d37/d64/c92 0 2024-02-19T19:08:28.196 INFO:tasks.workunit.client.0.smithi046.stdout:8/571: link d3/dd/d3f/f60 d3/dd/d3f/fcb 0 2024-02-19T19:08:28.203 INFO:tasks.workunit.client.0.smithi046.stdout:8/572: write d3/dd/d13/d6b/d46/d54/f56 [2286404,117079] 0 2024-02-19T19:08:28.203 INFO:tasks.workunit.client.0.smithi046.stdout:8/573: creat d3/dd/d13/d6b/d46/d6a/db2/fcc x:0 0 0 2024-02-19T19:08:28.204 INFO:tasks.workunit.client.0.smithi046.stdout:8/574: mknod d3/dd/d13/d66/ccd 0 2024-02-19T19:08:28.213 INFO:tasks.workunit.client.0.smithi046.stdout:8/575: write d3/dd/d13/d6b/d46/d54/f6f [2976904,74487] 0 2024-02-19T19:08:28.213 INFO:tasks.workunit.client.0.smithi046.stdout:8/576: fdatasync d3/dd/d13/d66/f7b 0 2024-02-19T19:08:28.213 INFO:tasks.workunit.client.0.smithi046.stdout:8/577: rename d3/dd to d3/dd/d13/d42/dce 22 2024-02-19T19:08:28.214 INFO:tasks.workunit.client.0.smithi046.stdout:8/578: truncate d3/dd/d3f/d49/d53/f5e 222094 0 2024-02-19T19:08:28.214 INFO:tasks.workunit.client.0.smithi046.stdout:8/579: truncate d3/dd/d3f/d49/d5b/fbc 409834 0 2024-02-19T19:08:28.214 INFO:tasks.workunit.client.0.smithi046.stdout:8/580: creat d3/dd/d13/d6b/d46/d6a/db2/fcf x:0 0 0 2024-02-19T19:08:28.216 INFO:tasks.workunit.client.0.smithi046.stdout:8/581: rename d3/f3a to d3/d37/d64/da2/d3c/db6/fd0 0 2024-02-19T19:08:28.227 INFO:tasks.workunit.client.0.smithi046.stdout:8/582: read d3/dd/d13/d42/f57 [2088417,51214] 0 2024-02-19T19:08:28.228 INFO:tasks.workunit.client.0.smithi046.stdout:8/583: dread - d3/d9d/fc0 zero size 2024-02-19T19:08:28.238 INFO:tasks.workunit.client.0.smithi046.stdout:9/279: sync 2024-02-19T19:08:28.238 INFO:tasks.workunit.client.0.smithi046.stdout:2/579: sync 2024-02-19T19:08:28.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/508: sync 2024-02-19T19:08:28.238 INFO:tasks.workunit.client.0.smithi046.stdout:6/355: sync 2024-02-19T19:08:28.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/509: truncate d0/d4/f29 1430863 0 2024-02-19T19:08:28.239 INFO:tasks.workunit.client.0.smithi046.stdout:7/510: chown d0/d45/d71/d41/l8c 93045084 1 2024-02-19T19:08:28.240 INFO:tasks.workunit.client.0.smithi046.stdout:6/356: creat d4/f73 x:0 0 0 2024-02-19T19:08:28.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/511: rmdir d0/d4/d68 39 2024-02-19T19:08:28.245 INFO:tasks.workunit.client.0.smithi046.stdout:2/580: write d5/d2c/f5f [310747,15120] 0 2024-02-19T19:08:28.245 INFO:tasks.workunit.client.0.smithi046.stdout:2/581: write d5/d2c/d35/f69 [3564672,77362] 0 2024-02-19T19:08:28.247 INFO:tasks.workunit.client.0.smithi046.stdout:2/582: link d5/d6/d13/l1c d5/d2c/d89/d3f/da1/lb5 0 2024-02-19T19:08:28.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/583: rename d5/d2c/d56/d5a/da0 to d5/d2c/d89/d3f/d82/db6 0 2024-02-19T19:08:28.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/584: dread - d5/d6/d13/d8a/fb2 zero size 2024-02-19T19:08:28.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/585: chown d5/d6a/f8c 1 1 2024-02-19T19:08:28.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/586: write d5/f43 [4740520,74463] 0 2024-02-19T19:08:28.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/587: write d5/d2c/d56/d5a/fac [722586,14072] 0 2024-02-19T19:08:28.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/588: write d5/d6/fd [6986139,41100] 0 2024-02-19T19:08:28.249 INFO:tasks.workunit.client.0.smithi046.stdout:6/357: write d4/f5 [4003290,17092] 0 2024-02-19T19:08:28.250 INFO:tasks.workunit.client.0.smithi046.stdout:6/358: write d4/d6/d1c/f51 [375532,85458] 0 2024-02-19T19:08:28.250 INFO:tasks.workunit.client.0.smithi046.stdout:6/359: read d4/f19 [1993036,109135] 0 2024-02-19T19:08:28.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/360: symlink d4/d6/d22/l74 0 2024-02-19T19:08:28.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/361: chown d4/d6/dd/d10/d29/l42 48 1 2024-02-19T19:08:28.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/362: rmdir d4/d6/dd/d10/d29/d2d 39 2024-02-19T19:08:28.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/512: write d0/d4/d24/f51 [522605,129654] 0 2024-02-19T19:08:28.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/513: truncate d0/d45/d71/d41/d5f/d85/f97 21559 0 2024-02-19T19:08:28.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/514: fsync d0/f48 0 2024-02-19T19:08:28.262 INFO:tasks.workunit.client.0.smithi046.stdout:6/363: dread d4/d6/d1c/d20/f4d [0,4194304] 0 2024-02-19T19:08:28.262 INFO:tasks.workunit.client.0.smithi046.stdout:6/364: chown d4/d6/d1c/d20 48244296 1 2024-02-19T19:08:28.264 INFO:tasks.workunit.client.0.smithi046.stdout:7/515: write d0/d4/f3c [2140171,60416] 0 2024-02-19T19:08:28.264 INFO:tasks.workunit.client.0.smithi046.stdout:2/589: dwrite d5/d6/d6e/dab/fae [0,4194304] 0 2024-02-19T19:08:28.264 INFO:tasks.workunit.client.0.smithi046.stdout:7/516: chown d0/d45/d4a/d58/c79 1268551 1 2024-02-19T19:08:28.264 INFO:tasks.workunit.client.0.smithi046.stdout:7/517: write d0/d4/f3b [2084578,12323] 0 2024-02-19T19:08:28.265 INFO:tasks.workunit.client.0.smithi046.stdout:6/365: rename d4/d6/dd/d10/d29/d2d/f49 to d4/d6/d1c/f75 0 2024-02-19T19:08:28.269 INFO:tasks.workunit.client.0.smithi046.stdout:7/518: getdents d0 0 2024-02-19T19:08:28.269 INFO:tasks.workunit.client.0.smithi046.stdout:7/519: dread - d0/d45/d71/d4b/f72 zero size 2024-02-19T19:08:28.269 INFO:tasks.workunit.client.0.smithi046.stdout:7/520: creat d0/d45/d71/d41/d5f/fa4 x:0 0 0 2024-02-19T19:08:28.269 INFO:tasks.workunit.client.0.smithi046.stdout:7/521: chown d0/d45/d71/d41/c59 2121507 1 2024-02-19T19:08:28.269 INFO:tasks.workunit.client.0.smithi046.stdout:7/522: fdatasync d0/d45/d71/d4b/f57 0 2024-02-19T19:08:28.271 INFO:tasks.workunit.client.0.smithi046.stdout:7/523: symlink d0/d45/d98/la5 0 2024-02-19T19:08:28.271 INFO:tasks.workunit.client.0.smithi046.stdout:7/524: write d0/d45/d56/f6a [4577308,38911] 0 2024-02-19T19:08:28.271 INFO:tasks.workunit.client.0.smithi046.stdout:7/525: fsync d0/d45/d71/d41/d5f/d85/f97 0 2024-02-19T19:08:28.274 INFO:tasks.workunit.client.0.smithi046.stdout:7/526: truncate d0/f18 900506 0 2024-02-19T19:08:28.282 INFO:tasks.workunit.client.0.smithi046.stdout:7/527: creat d0/d45/fa6 x:0 0 0 2024-02-19T19:08:28.295 INFO:tasks.workunit.client.0.smithi046.stdout:7/528: read d0/d45/d4a/d58/f42 [2200273,94954] 0 2024-02-19T19:08:28.296 INFO:tasks.workunit.client.0.smithi046.stdout:2/590: dwrite d5/d2c/d89/d3f/d82/f41 [0,4194304] 0 2024-02-19T19:08:28.296 INFO:tasks.workunit.client.0.smithi046.stdout:2/591: creat d5/d2c/d45/fb7 x:0 0 0 2024-02-19T19:08:28.297 INFO:tasks.workunit.client.0.smithi046.stdout:2/592: write d5/d2c/d89/fb1 [75753,82771] 0 2024-02-19T19:08:28.297 INFO:tasks.workunit.client.0.smithi046.stdout:2/593: write d5/d2c/d89/f10 [3160239,15282] 0 2024-02-19T19:08:28.297 INFO:tasks.workunit.client.0.smithi046.stdout:2/594: write d5/d2c/f7d [673941,117968] 0 2024-02-19T19:08:28.297 INFO:tasks.workunit.client.0.smithi046.stdout:6/366: dwrite d4/d6/f5e [0,4194304] 0 2024-02-19T19:08:28.298 INFO:tasks.workunit.client.0.smithi046.stdout:7/529: getdents d0/d45/d71 0 2024-02-19T19:08:28.300 INFO:tasks.workunit.client.0.smithi046.stdout:2/595: creat d5/d2c/d89/d4c/d75/fb8 x:0 0 0 2024-02-19T19:08:28.303 INFO:tasks.workunit.client.0.smithi046.stdout:6/367: unlink d4/d6/dd/d10/d29/d2d/d35/d3c/c67 0 2024-02-19T19:08:28.306 INFO:tasks.workunit.client.0.smithi046.stdout:2/596: unlink d5/d2c/d35/l65 0 2024-02-19T19:08:28.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/530: dwrite d0/d4/d7b/f88 [0,4194304] 0 2024-02-19T19:08:28.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/531: truncate d0/d45/d4a/d78/f8e 193838 0 2024-02-19T19:08:28.316 INFO:tasks.workunit.client.0.smithi046.stdout:7/532: creat d0/d45/d4a/d58/fa7 x:0 0 0 2024-02-19T19:08:28.317 INFO:tasks.workunit.client.0.smithi046.stdout:2/597: read d5/d2c/d45/f4a [1589839,6352] 0 2024-02-19T19:08:28.319 INFO:tasks.workunit.client.0.smithi046.stdout:2/598: rename d5/d2c/d45/f54 to d5/d2c/d56/da5/da9/fb9 0 2024-02-19T19:08:28.325 INFO:tasks.workunit.client.0.smithi046.stdout:6/368: dwrite d4/d6/d1c/d60/f61 [0,4194304] 0 2024-02-19T19:08:28.330 INFO:tasks.workunit.client.0.smithi046.stdout:7/533: dread d0/d4/d24/f7a [0,4194304] 0 2024-02-19T19:08:28.335 INFO:tasks.workunit.client.0.smithi046.stdout:7/534: truncate d0/d4/f3c 2285713 0 2024-02-19T19:08:28.335 INFO:tasks.workunit.client.0.smithi046.stdout:7/535: write d0/d45/d71/d41/d5f/d85/f97 [961426,122376] 0 2024-02-19T19:08:28.346 INFO:tasks.workunit.client.0.smithi046.stdout:3/355: sync 2024-02-19T19:08:28.346 INFO:tasks.workunit.client.0.smithi046.stdout:5/500: sync 2024-02-19T19:08:28.346 INFO:tasks.workunit.client.0.smithi046.stdout:3/356: write da/d1d/d10/f1e [988762,92462] 0 2024-02-19T19:08:28.348 INFO:tasks.workunit.client.0.smithi046.stdout:5/501: rename d2/dd/f15 to d2/d27/d4b/f9e 0 2024-02-19T19:08:28.348 INFO:tasks.workunit.client.0.smithi046.stdout:5/502: dread - d2/f85 zero size 2024-02-19T19:08:28.349 INFO:tasks.workunit.client.0.smithi046.stdout:3/357: fsync da/f2c 0 2024-02-19T19:08:28.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/503: mknod d2/d27/d47/d7f/c9f 0 2024-02-19T19:08:28.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/504: stat d2/f85 0 2024-02-19T19:08:28.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/505: truncate d2/dd/d29/f35 1285091 0 2024-02-19T19:08:28.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/506: chown d2/c14 6128828 1 2024-02-19T19:08:28.352 INFO:tasks.workunit.client.0.smithi046.stdout:5/507: rename d2/f5 to d2/dd/d29/d72/fa0 0 2024-02-19T19:08:28.353 INFO:tasks.workunit.client.0.smithi046.stdout:5/508: unlink d2/dd/d2f/d34/f5b 0 2024-02-19T19:08:28.354 INFO:tasks.workunit.client.0.smithi046.stdout:5/509: dread - d2/d27/d4b/f96 zero size 2024-02-19T19:08:28.357 INFO:tasks.workunit.client.0.smithi046.stdout:6/369: dwrite d4/f19 [4194304,4194304] 0 2024-02-19T19:08:28.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/536: dwrite d0/d4/d24/f51 [0,4194304] 0 2024-02-19T19:08:28.360 INFO:tasks.workunit.client.0.smithi046.stdout:6/370: rename d4/d6/dd/d10/c50 to d4/d6/dd/d10/d29/d2d/d35/c76 0 2024-02-19T19:08:28.360 INFO:tasks.workunit.client.0.smithi046.stdout:6/371: dread - d4/f6a zero size 2024-02-19T19:08:28.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/510: rmdir d2/d27/d47/d7f 39 2024-02-19T19:08:28.365 INFO:tasks.workunit.client.0.smithi046.stdout:6/372: rename d4/d6/dd/d10/l6c to d4/l77 0 2024-02-19T19:08:28.371 INFO:tasks.workunit.client.0.smithi046.stdout:7/537: dread d0/d3f/f6b [0,4194304] 0 2024-02-19T19:08:28.371 INFO:tasks.workunit.client.0.smithi046.stdout:7/538: getdents d0/d3f 0 2024-02-19T19:08:28.372 INFO:tasks.workunit.client.0.smithi046.stdout:7/539: truncate d0/d45/d71/da3/f94 306825 0 2024-02-19T19:08:28.372 INFO:tasks.workunit.client.0.smithi046.stdout:7/540: chown d0/d45/d71/d41/d5f/fa4 231916334 1 2024-02-19T19:08:28.372 INFO:tasks.workunit.client.0.smithi046.stdout:6/373: symlink d4/d6/d1c/d60/l78 0 2024-02-19T19:08:28.379 INFO:tasks.workunit.client.0.smithi046.stdout:5/511: rmdir d2 39 2024-02-19T19:08:28.379 INFO:tasks.workunit.client.0.smithi046.stdout:5/512: dread - d2/d27/d4b/f96 zero size 2024-02-19T19:08:28.380 INFO:tasks.workunit.client.0.smithi046.stdout:7/541: getdents d0/d4/d68 0 2024-02-19T19:08:28.381 INFO:tasks.workunit.client.0.smithi046.stdout:5/513: dread d2/dd/f5c [0,4194304] 0 2024-02-19T19:08:28.382 INFO:tasks.workunit.client.0.smithi046.stdout:5/514: dread - d2/d27/f90 zero size 2024-02-19T19:08:28.382 INFO:tasks.workunit.client.0.smithi046.stdout:6/374: creat d4/d6/dd/d10/d29/d2d/d35/f79 x:0 0 0 2024-02-19T19:08:28.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/515: symlink d2/dd/d2f/d34/la1 0 2024-02-19T19:08:28.388 INFO:tasks.workunit.client.0.smithi046.stdout:7/542: dread d0/d45/d4a/d58/f42 [0,4194304] 0 2024-02-19T19:08:28.390 INFO:tasks.workunit.client.0.smithi046.stdout:7/543: unlink d0/d4/dd/l26 0 2024-02-19T19:08:28.395 INFO:tasks.workunit.client.0.smithi046.stdout:5/516: read d2/dd/d26/f50 [764852,39363] 0 2024-02-19T19:08:28.395 INFO:tasks.workunit.client.0.smithi046.stdout:5/517: readlink d2/d27/d47/d54/d57/l9d 0 2024-02-19T19:08:28.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/544: dread d0/d4/d24/f51 [0,4194304] 0 2024-02-19T19:08:28.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/545: creat d0/d45/d71/d41/fa8 x:0 0 0 2024-02-19T19:08:28.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/546: chown d0/d45/d71/d41/l53 0 1 2024-02-19T19:08:28.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/547: creat d0/d45/d4a/d58/d60/fa9 x:0 0 0 2024-02-19T19:08:28.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/548: readlink d0/d4/l2b 0 2024-02-19T19:08:28.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/549: chown d0/d4/f29 876 1 2024-02-19T19:08:28.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/375: dwrite d4/f28 [0,4194304] 0 2024-02-19T19:08:28.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/550: mknod d0/d4/d24/caa 0 2024-02-19T19:08:28.408 INFO:tasks.workunit.client.0.smithi046.stdout:6/376: mkdir d4/d6/d1c/d20/d7a 0 2024-02-19T19:08:28.410 INFO:tasks.workunit.client.0.smithi046.stdout:6/377: rename d4/d6/dd/d10/d29/d2d/d35/d3c/l5a to d4/l7b 0 2024-02-19T19:08:28.411 INFO:tasks.workunit.client.0.smithi046.stdout:7/551: dread d0/d4/d24/f7a [0,4194304] 0 2024-02-19T19:08:28.411 INFO:tasks.workunit.client.0.smithi046.stdout:6/378: symlink d4/d6/dd/d10/d29/l7c 0 2024-02-19T19:08:28.411 INFO:tasks.workunit.client.0.smithi046.stdout:6/379: truncate d4/f43 275473 0 2024-02-19T19:08:28.414 INFO:tasks.workunit.client.0.smithi046.stdout:5/518: dwrite d2/dd/f77 [0,4194304] 0 2024-02-19T19:08:28.416 INFO:tasks.workunit.client.0.smithi046.stdout:5/519: rmdir d2/dd/d26/d65 39 2024-02-19T19:08:28.418 INFO:tasks.workunit.client.0.smithi046.stdout:7/552: dread d0/d3f/f6b [0,4194304] 0 2024-02-19T19:08:28.418 INFO:tasks.workunit.client.0.smithi046.stdout:7/553: creat d0/d4/d7b/fab x:0 0 0 2024-02-19T19:08:28.418 INFO:tasks.workunit.client.0.smithi046.stdout:6/380: truncate d4/f28 2531297 0 2024-02-19T19:08:28.420 INFO:tasks.workunit.client.0.smithi046.stdout:7/554: unlink d0/d45/d71/d4b/d6f/l7c 0 2024-02-19T19:08:28.422 INFO:tasks.workunit.client.0.smithi046.stdout:7/555: rename d0/d45/c80 to d0/d45/d4a/d58/d60/cac 0 2024-02-19T19:08:28.427 INFO:tasks.workunit.client.0.smithi046.stdout:7/556: getdents d0/d4/d7b 0 2024-02-19T19:08:28.429 INFO:tasks.workunit.client.0.smithi046.stdout:7/557: creat d0/d45/d4a/d58/d91/fad x:0 0 0 2024-02-19T19:08:28.431 INFO:tasks.workunit.client.0.smithi046.stdout:7/558: rename d0/d45/d71/d41/l8c to d0/d45/lae 0 2024-02-19T19:08:28.431 INFO:tasks.workunit.client.0.smithi046.stdout:7/559: chown d0/d4/f3b 6874 1 2024-02-19T19:08:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/381: dwrite d4/d6/f1a [0,4194304] 0 2024-02-19T19:08:28.435 INFO:tasks.workunit.client.0.smithi046.stdout:7/560: rmdir d0/d45/d4a/d58 39 2024-02-19T19:08:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:7/561: mkdir d0/d45/d4a/daf 0 2024-02-19T19:08:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:7/562: write d0/d45/d71/d4b/f57 [962117,58045] 0 2024-02-19T19:08:28.438 INFO:tasks.workunit.client.0.smithi046.stdout:7/563: truncate d0/d45/fa6 207345 0 2024-02-19T19:08:28.439 INFO:tasks.workunit.client.0.smithi046.stdout:7/564: mknod d0/d45/d71/d41/cb0 0 2024-02-19T19:08:28.440 INFO:tasks.workunit.client.0.smithi046.stdout:7/565: symlink d0/d4/dd/lb1 0 2024-02-19T19:08:28.448 INFO:tasks.workunit.client.0.smithi046.stdout:6/382: write d4/f19 [7399680,62466] 0 2024-02-19T19:08:28.448 INFO:tasks.workunit.client.0.smithi046.stdout:6/383: creat d4/d6/d22/f7d x:0 0 0 2024-02-19T19:08:28.448 INFO:tasks.workunit.client.0.smithi046.stdout:6/384: write d4/d6/d1c/d20/f4d [4512245,84901] 0 2024-02-19T19:08:28.448 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:28 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[112579]: 2024-02-19T19:08:28.170+0000 7fd84b1c57c0 -1 Falling back to public interface 2024-02-19T19:08:28.464 INFO:tasks.workunit.client.0.smithi046.stdout:6/385: dwrite d4/d6/d1c/f51 [0,4194304] 0 2024-02-19T19:08:28.465 INFO:tasks.workunit.client.0.smithi046.stdout:0/482: sync 2024-02-19T19:08:28.465 INFO:tasks.workunit.client.0.smithi046.stdout:1/467: sync 2024-02-19T19:08:28.465 INFO:tasks.workunit.client.0.smithi046.stdout:4/521: sync 2024-02-19T19:08:28.465 INFO:tasks.workunit.client.0.smithi046.stdout:1/468: chown d5/d13/c82 9703 1 2024-02-19T19:08:28.465 INFO:tasks.workunit.client.0.smithi046.stdout:0/483: truncate d0/f7c 951182 0 2024-02-19T19:08:28.467 INFO:tasks.workunit.client.0.smithi046.stdout:6/386: link d4/l7b d4/d6/d1c/d64/l7e 0 2024-02-19T19:08:28.468 INFO:tasks.workunit.client.0.smithi046.stdout:4/522: creat d6/d94/fb2 x:0 0 0 2024-02-19T19:08:28.473 INFO:tasks.workunit.client.0.smithi046.stdout:4/523: mkdir d6/d15/d6e/db3 0 2024-02-19T19:08:28.474 INFO:tasks.workunit.client.0.smithi046.stdout:4/524: getdents d6/d94/dab 0 2024-02-19T19:08:28.477 INFO:tasks.workunit.client.0.smithi046.stdout:6/387: dread d4/d6/dd/d10/d29/d2d/d35/f3a [4194304,4194304] 0 2024-02-19T19:08:28.477 INFO:tasks.workunit.client.0.smithi046.stdout:1/469: rename d5/d10 to d5/d2f/d9f 0 2024-02-19T19:08:28.478 INFO:tasks.workunit.client.0.smithi046.stdout:6/388: creat d4/d6/dd/d10/d29/d2d/f7f x:0 0 0 2024-02-19T19:08:28.478 INFO:tasks.workunit.client.0.smithi046.stdout:6/389: write d4/f43 [1217814,94514] 0 2024-02-19T19:08:28.479 INFO:tasks.workunit.client.0.smithi046.stdout:6/390: chown d4/d6/d1c/d20/l2b 2609 1 2024-02-19T19:08:28.479 INFO:tasks.workunit.client.0.smithi046.stdout:1/470: creat d5/d2f/d9f/d3b/d4e/d76/fa0 x:0 0 0 2024-02-19T19:08:28.482 INFO:tasks.workunit.client.0.smithi046.stdout:6/391: creat d4/d6/d1c/d64/f80 x:0 0 0 2024-02-19T19:08:28.482 INFO:tasks.workunit.client.0.smithi046.stdout:6/392: dread - d4/d6/dd/d10/d29/d2d/d35/f79 zero size 2024-02-19T19:08:28.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/484: dwrite d0/d24/d2f/d53/f61 [0,4194304] 0 2024-02-19T19:08:28.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/485: chown d0/d19/f3a 772043 1 2024-02-19T19:08:28.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/486: dread - d0/d19/d8/d37/f7d zero size 2024-02-19T19:08:28.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/487: write d0/d24/d56/da1/f2e [129963,99333] 0 2024-02-19T19:08:28.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/488: write d0/f5c [701071,66987] 0 2024-02-19T19:08:28.487 INFO:tasks.workunit.client.0.smithi046.stdout:0/489: truncate d0/f1c 832542 0 2024-02-19T19:08:28.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/490: rename d0/d24/d56/da1/f7b to d0/d24/d56/da3/faf 0 2024-02-19T19:08:28.498 INFO:tasks.workunit.client.0.smithi046.stdout:4/525: dwrite d6/d11/d26/f74 [0,4194304] 0 2024-02-19T19:08:28.499 INFO:tasks.workunit.client.0.smithi046.stdout:4/526: mknod d6/d11/cb4 0 2024-02-19T19:08:28.499 INFO:tasks.workunit.client.0.smithi046.stdout:4/527: chown d6/d15/d17/d1e 5467414 1 2024-02-19T19:08:28.499 INFO:tasks.workunit.client.0.smithi046.stdout:4/528: write d6/f7f [1109576,34654] 0 2024-02-19T19:08:28.501 INFO:tasks.workunit.client.0.smithi046.stdout:4/529: unlink d6/c5f 0 2024-02-19T19:08:28.501 INFO:tasks.workunit.client.0.smithi046.stdout:6/393: dwrite d4/f6a [0,4194304] 0 2024-02-19T19:08:28.503 INFO:tasks.workunit.client.0.smithi046.stdout:6/394: mknod d4/d6/dd/c81 0 2024-02-19T19:08:28.509 INFO:tasks.workunit.client.0.smithi046.stdout:0/491: dwrite d0/d24/d56/da1/f2e [0,4194304] 0 2024-02-19T19:08:28.509 INFO:tasks.workunit.client.0.smithi046.stdout:0/492: dread - d0/d19/d8/d37/d40/f83 zero size 2024-02-19T19:08:28.512 INFO:tasks.workunit.client.0.smithi046.stdout:0/493: write d0/f2 [1159545,80445] 0 2024-02-19T19:08:28.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/494: rmdir d0/d19/d8/d37/d58 39 2024-02-19T19:08:28.513 INFO:tasks.workunit.client.0.smithi046.stdout:4/530: write d6/d15/f77 [169807,130799] 0 2024-02-19T19:08:28.515 INFO:tasks.workunit.client.0.smithi046.stdout:0/495: rename d0/d24/d5b/c6f to d0/d24/d2f/dac/cb0 0 2024-02-19T19:08:28.517 INFO:tasks.workunit.client.0.smithi046.stdout:4/531: creat d6/d11/d26/d89/d8a/d8d/fb5 x:0 0 0 2024-02-19T19:08:28.517 INFO:tasks.workunit.client.0.smithi046.stdout:4/532: chown d6/d11/d40/l95 15940 1 2024-02-19T19:08:28.517 INFO:tasks.workunit.client.0.smithi046.stdout:4/533: write d6/d15/d17/f41 [3537225,64233] 0 2024-02-19T19:08:28.517 INFO:tasks.workunit.client.0.smithi046.stdout:0/496: symlink d0/d5f/da8/lb1 0 2024-02-19T19:08:28.518 INFO:tasks.workunit.client.0.smithi046.stdout:4/534: symlink d6/lb6 0 2024-02-19T19:08:28.518 INFO:tasks.workunit.client.0.smithi046.stdout:4/535: dread - d6/d15/d17/d4a/f85 zero size 2024-02-19T19:08:28.518 INFO:tasks.workunit.client.0.smithi046.stdout:0/497: creat d0/d19/d4d/fb2 x:0 0 0 2024-02-19T19:08:28.519 INFO:tasks.workunit.client.0.smithi046.stdout:4/536: creat d6/d15/d6e/db3/fb7 x:0 0 0 2024-02-19T19:08:28.519 INFO:tasks.workunit.client.0.smithi046.stdout:4/537: write d6/d11/d26/d89/d8a/d55/f5d [5021271,12088] 0 2024-02-19T19:08:28.520 INFO:tasks.workunit.client.0.smithi046.stdout:6/395: dwrite d4/d6/dd/d10/f4b [0,4194304] 0 2024-02-19T19:08:28.523 INFO:tasks.workunit.client.0.smithi046.stdout:6/396: creat d4/d6/dd/d10/f82 x:0 0 0 2024-02-19T19:08:28.523 INFO:tasks.workunit.client.0.smithi046.stdout:6/397: readlink d4/d6/dd/d10/d29/l42 0 2024-02-19T19:08:28.524 INFO:tasks.workunit.client.0.smithi046.stdout:6/398: creat d4/d6/dd/f83 x:0 0 0 2024-02-19T19:08:28.535 INFO:tasks.workunit.client.0.smithi046.stdout:0/498: write d0/d24/f4b [726244,37938] 0 2024-02-19T19:08:28.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/399: dwrite d4/d6/f30 [0,4194304] 0 2024-02-19T19:08:28.544 INFO:tasks.workunit.client.0.smithi046.stdout:6/400: symlink d4/d6/dd/d10/d29/d2d/l84 0 2024-02-19T19:08:28.544 INFO:tasks.workunit.client.0.smithi046.stdout:6/401: creat d4/d6/d1c/d60/f85 x:0 0 0 2024-02-19T19:08:28.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/538: dwrite d6/d11/d26/d89/d8a/f8c [0,4194304] 0 2024-02-19T19:08:28.546 INFO:tasks.workunit.client.0.smithi046.stdout:0/499: dread d0/d24/d2f/dac/fae [0,4194304] 0 2024-02-19T19:08:28.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/539: fsync d6/d11/d92/f9c 0 2024-02-19T19:08:28.546 INFO:tasks.workunit.client.0.smithi046.stdout:6/402: dread d4/d6/d1c/f75 [0,4194304] 0 2024-02-19T19:08:28.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/540: unlink d6/d11/d26/d89/d8a/l58 0 2024-02-19T19:08:28.549 INFO:tasks.workunit.client.0.smithi046.stdout:0/500: link d0/d19/d8/d37/l42 d0/d24/d2f/d53/lb3 0 2024-02-19T19:08:28.550 INFO:tasks.workunit.client.0.smithi046.stdout:6/403: unlink d4/d6/d1c/d20/l2b 0 2024-02-19T19:08:28.550 INFO:tasks.workunit.client.0.smithi046.stdout:6/404: write d4/f28 [2882782,29763] 0 2024-02-19T19:08:28.550 INFO:tasks.workunit.client.0.smithi046.stdout:6/405: readlink d4/l16 0 2024-02-19T19:08:28.556 INFO:tasks.workunit.client.0.smithi046.stdout:0/501: write d0/d19/f1f [351001,8195] 0 2024-02-19T19:08:28.557 INFO:tasks.workunit.client.0.smithi046.stdout:4/541: rmdir d6/d15 39 2024-02-19T19:08:28.557 INFO:tasks.workunit.client.0.smithi046.stdout:4/542: chown d6/d11/d26/d89/faa 263694 1 2024-02-19T19:08:28.558 INFO:tasks.workunit.client.0.smithi046.stdout:6/406: dread d4/d6/dd/d10/d29/d2d/d35/d3c/f4a [0,4194304] 0 2024-02-19T19:08:28.558 INFO:tasks.workunit.client.0.smithi046.stdout:6/407: truncate d4/d6/d22/f71 511721 0 2024-02-19T19:08:28.558 INFO:tasks.workunit.client.0.smithi046.stdout:6/408: write d4/d6/f3b [4480314,75804] 0 2024-02-19T19:08:28.559 INFO:tasks.workunit.client.0.smithi046.stdout:4/543: creat d6/d15/d17/d1e/fb8 x:0 0 0 2024-02-19T19:08:28.559 INFO:tasks.workunit.client.0.smithi046.stdout:4/544: write d6/d15/f77 [653628,13076] 0 2024-02-19T19:08:28.559 INFO:tasks.workunit.client.0.smithi046.stdout:4/545: write d6/d11/d26/d89/f91 [610887,101823] 0 2024-02-19T19:08:28.559 INFO:tasks.workunit.client.0.smithi046.stdout:4/546: dread - d6/d50/fa0 zero size 2024-02-19T19:08:28.559 INFO:tasks.workunit.client.0.smithi046.stdout:6/409: dread d4/d6/d1c/f75 [0,4194304] 0 2024-02-19T19:08:28.585 INFO:tasks.workunit.client.0.smithi046.stdout:0/502: dwrite d0/d19/d8/f99 [0,4194304] 0 2024-02-19T19:08:28.585 INFO:tasks.workunit.client.0.smithi046.stdout:0/503: read - d0/d19/f91 zero size 2024-02-19T19:08:28.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/504: getdents d0/d5f/d74 0 2024-02-19T19:08:28.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/505: truncate d0/d24/f8b 639556 0 2024-02-19T19:08:28.595 INFO:tasks.workunit.client.0.smithi046.stdout:4/547: dwrite d6/d11/d40/f79 [0,4194304] 0 2024-02-19T19:08:28.595 INFO:tasks.workunit.client.0.smithi046.stdout:6/410: dwrite d4/f28 [0,4194304] 0 2024-02-19T19:08:28.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/411: link d4/d6/dd/d10/d29/d2d/f47 d4/d6/dd/d10/f86 0 2024-02-19T19:08:28.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/412: fsync d4/f26 0 2024-02-19T19:08:28.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/413: stat d4/d6/dd/f21 0 2024-02-19T19:08:28.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/414: dread - d4/d6/dd/d10/d29/d2d/d35/f79 zero size 2024-02-19T19:08:28.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/415: truncate d4/d6/f30 4469051 0 2024-02-19T19:08:28.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/416: write d4/d6/d1c/d60/f85 [95931,41343] 0 2024-02-19T19:08:28.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/417: stat d4/d6/dd/d10/d29/d2d/c3f 0 2024-02-19T19:08:28.600 INFO:tasks.workunit.client.0.smithi046.stdout:6/418: unlink d4/d6/dd/d10/f4b 0 2024-02-19T19:08:28.615 INFO:tasks.workunit.client.0.smithi046.stdout:4/548: dwrite d6/f1a [0,4194304] 0 2024-02-19T19:08:28.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/549: mkdir d6/d11/db9 0 2024-02-19T19:08:28.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/550: getdents d6/d15/d17 0 2024-02-19T19:08:28.621 INFO:tasks.workunit.client.0.smithi046.stdout:6/419: dwrite d4/d6/dd/d10/d29/d2d/d35/f4f [0,4194304] 0 2024-02-19T19:08:28.621 INFO:tasks.workunit.client.0.smithi046.stdout:6/420: chown d4/f39 2518317 1 2024-02-19T19:08:28.621 INFO:tasks.workunit.client.0.smithi046.stdout:6/421: chown d4/d6/f3b 329078333 1 2024-02-19T19:08:28.623 INFO:tasks.workunit.client.0.smithi046.stdout:6/422: mknod d4/d6/dd/d10/d29/c87 0 2024-02-19T19:08:28.623 INFO:tasks.workunit.client.0.smithi046.stdout:6/423: chown d4/d6/dd/d10/d29/d2d/d35/f5d 12677172 1 2024-02-19T19:08:28.634 INFO:tasks.workunit.client.0.smithi046.stdout:4/551: dwrite d6/d15/d6e/db3/fb7 [0,4194304] 0 2024-02-19T19:08:28.653 INFO:tasks.workunit.client.0.smithi046.stdout:4/552: write d6/d11/f66 [880259,33841] 0 2024-02-19T19:08:28.653 INFO:tasks.workunit.client.0.smithi046.stdout:6/424: dwrite d4/d6/d1c/d20/f4d [0,4194304] 0 2024-02-19T19:08:28.653 INFO:tasks.workunit.client.0.smithi046.stdout:6/425: chown d4/d6/d22/f71 13 1 2024-02-19T19:08:28.653 INFO:tasks.workunit.client.0.smithi046.stdout:6/426: fdatasync d4/d6/dd/d10/f86 0 2024-02-19T19:08:28.655 INFO:tasks.workunit.client.0.smithi046.stdout:4/553: creat d6/d15/fba x:0 0 0 2024-02-19T19:08:28.655 INFO:tasks.workunit.client.0.smithi046.stdout:4/554: creat d6/d11/d92/fbb x:0 0 0 2024-02-19T19:08:28.655 INFO:tasks.workunit.client.0.smithi046.stdout:4/555: truncate d6/f7f 1954349 0 2024-02-19T19:08:28.668 INFO:tasks.workunit.client.0.smithi046.stdout:4/556: dwrite d6/fb [4194304,4194304] 0 2024-02-19T19:08:28.668 INFO:tasks.workunit.client.0.smithi046.stdout:4/557: fdatasync d6/fa9 0 2024-02-19T19:08:28.670 INFO:tasks.workunit.client.0.smithi046.stdout:4/558: rename d6/d15/d17/l27 to d6/d15/d17/d1e/d25/lbc 0 2024-02-19T19:08:28.670 INFO:tasks.workunit.client.0.smithi046.stdout:4/559: creat d6/d11/d26/d89/fbd x:0 0 0 2024-02-19T19:08:28.679 INFO:tasks.workunit.client.0.smithi046.stdout:4/560: dread d6/d11/d26/f9f [0,4194304] 0 2024-02-19T19:08:28.681 INFO:tasks.workunit.client.0.smithi046.stdout:4/561: symlink d6/d15/d17/d1e/d25/lbe 0 2024-02-19T19:08:28.681 INFO:tasks.workunit.client.0.smithi046.stdout:4/562: dread - d6/d15/d17/d4a/f85 zero size 2024-02-19T19:08:28.682 INFO:tasks.workunit.client.0.smithi046.stdout:4/563: unlink d6/d11/d40/f79 0 2024-02-19T19:08:28.682 INFO:tasks.workunit.client.0.smithi046.stdout:4/564: chown d6/d15/f5c 2 1 2024-02-19T19:08:28.682 INFO:tasks.workunit.client.0.smithi046.stdout:4/565: chown d6/d11/d40/l52 15931 1 2024-02-19T19:08:28.688 INFO:tasks.workunit.client.0.smithi046.stdout:4/566: write d6/f1a [3556360,98669] 0 2024-02-19T19:08:28.701 INFO:tasks.workunit.client.0.smithi046.stdout:4/567: dwrite d6/d15/d17/d1e/d25/f4b [0,4194304] 0 2024-02-19T19:08:28.702 INFO:tasks.workunit.client.0.smithi046.stdout:4/568: rename d6/c3a to d6/d11/d26/d89/d8a/d55/cbf 0 2024-02-19T19:08:28.704 INFO:tasks.workunit.client.0.smithi046.stdout:4/569: rmdir d6/d94 39 2024-02-19T19:08:28.704 INFO:tasks.workunit.client.0.smithi046.stdout:4/570: stat d6/d15/d17/d4a/f85 0 2024-02-19T19:08:28.705 INFO:tasks.workunit.client.0.smithi046.stdout:4/571: rename d6/d15/l3d to d6/d11/d40/da7/lc0 0 2024-02-19T19:08:28.707 INFO:tasks.workunit.client.0.smithi046.stdout:4/572: mknod d6/d15/d6e/cc1 0 2024-02-19T19:08:28.708 INFO:tasks.workunit.client.0.smithi046.stdout:4/573: creat d6/d11/d26/d89/d8a/d55/d8e/fc2 x:0 0 0 2024-02-19T19:08:28.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/574: mkdir d6/d11/d26/dc3 0 2024-02-19T19:08:28.710 INFO:tasks.workunit.client.0.smithi046.stdout:4/575: creat d6/d11/d26/dc3/fc4 x:0 0 0 2024-02-19T19:08:28.711 INFO:tasks.workunit.client.0.smithi046.stdout:4/576: mkdir d6/d15/d6e/dc5 0 2024-02-19T19:08:28.711 INFO:tasks.workunit.client.0.smithi046.stdout:4/577: write d6/d11/d26/d89/fbd [809572,28925] 0 2024-02-19T19:08:28.712 INFO:tasks.workunit.client.0.smithi046.stdout:4/578: mknod d6/d15/d6e/db3/cc6 0 2024-02-19T19:08:28.720 INFO:tasks.workunit.client.0.smithi046.stdout:4/579: truncate d6/f7f 1544783 0 2024-02-19T19:08:28.729 INFO:tasks.workunit.client.0.smithi046.stdout:4/580: dread d6/d11/d26/f60 [4194304,4194304] 0 2024-02-19T19:08:28.729 INFO:tasks.workunit.client.0.smithi046.stdout:4/581: chown d6/d11/d26/d89/d8a/d8d/fb5 1 1 2024-02-19T19:08:28.729 INFO:tasks.workunit.client.0.smithi046.stdout:4/582: write d6/d15/d17/d1e/d25/f2f [5199069,114319] 0 2024-02-19T19:08:28.729 INFO:tasks.workunit.client.0.smithi046.stdout:4/583: write d6/d15/d17/d1e/d25/fa6 [156018,92338] 0 2024-02-19T19:08:28.730 INFO:tasks.workunit.client.0.smithi046.stdout:4/584: readlink d6/d15/d17/d1e/d25/lbc 0 2024-02-19T19:08:28.730 INFO:tasks.workunit.client.0.smithi046.stdout:4/585: write d6/d11/f64 [92509,78995] 0 2024-02-19T19:08:28.730 INFO:tasks.workunit.client.0.smithi046.stdout:4/586: fdatasync d6/d11/d26/f9f 0 2024-02-19T19:08:28.730 INFO:tasks.workunit.client.0.smithi046.stdout:4/587: read - d6/d15/d17/d1e/fac zero size 2024-02-19T19:08:28.731 INFO:tasks.workunit.client.0.smithi046.stdout:4/588: dread d6/d11/d26/d89/d8a/f38 [0,4194304] 0 2024-02-19T19:08:28.744 INFO:tasks.workunit.client.0.smithi046.stdout:4/589: dwrite d6/d15/d17/d4a/f85 [0,4194304] 0 2024-02-19T19:08:28.746 INFO:tasks.workunit.client.0.smithi046.stdout:4/590: rmdir d6/d11 39 2024-02-19T19:08:28.746 INFO:tasks.workunit.client.0.smithi046.stdout:4/591: chown d6/d11/d26/f2e 15 1 2024-02-19T19:08:28.747 INFO:tasks.workunit.client.0.smithi046.stdout:4/592: creat d6/d11/fc7 x:0 0 0 2024-02-19T19:08:28.747 INFO:tasks.workunit.client.0.smithi046.stdout:4/593: write d6/d11/fc7 [674152,8225] 0 2024-02-19T19:08:28.749 INFO:tasks.workunit.client.0.smithi046.stdout:4/594: symlink d6/d94/dab/lc8 0 2024-02-19T19:08:28.750 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:28 smithi046 bash[112566]: a31225ea4dec5652e7294f5f748038ddd30c3c69cb8db11b07039884e06ddebf 2024-02-19T19:08:28.750 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:28 smithi046 systemd[1]: Started Ceph osd.2 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:08:28.861 INFO:tasks.workunit.client.0.smithi046.stdout:5/520: sync 2024-02-19T19:08:28.862 INFO:tasks.workunit.client.0.smithi046.stdout:8/584: sync 2024-02-19T19:08:28.862 INFO:tasks.workunit.client.0.smithi046.stdout:9/280: sync 2024-02-19T19:08:28.862 INFO:tasks.workunit.client.0.smithi046.stdout:9/281: chown db/d1e/f49 5 1 2024-02-19T19:08:28.862 INFO:tasks.workunit.client.0.smithi046.stdout:5/521: read - d2/dd/d26/d65/d5f/f88 zero size 2024-02-19T19:08:28.862 INFO:tasks.workunit.client.0.smithi046.stdout:9/282: write db/f43 [413049,17557] 0 2024-02-19T19:08:28.862 INFO:tasks.workunit.client.0.smithi046.stdout:8/585: mknod d3/dd/d13/d42/cd1 0 2024-02-19T19:08:28.865 INFO:tasks.workunit.client.0.smithi046.stdout:5/522: rename d2/dd/d26/d65/d5f/l8d to d2/dd/d3f/la2 0 2024-02-19T19:08:28.866 INFO:tasks.workunit.client.0.smithi046.stdout:9/283: mkdir db/d1e/d52 0 2024-02-19T19:08:28.867 INFO:tasks.workunit.client.0.smithi046.stdout:8/586: getdents d3/dd/d3f/d49/d5b/d5f 0 2024-02-19T19:08:28.869 INFO:tasks.workunit.client.0.smithi046.stdout:5/523: unlink d2/d5e/f84 0 2024-02-19T19:08:28.869 INFO:tasks.workunit.client.0.smithi046.stdout:5/524: write d2/dd/d26/d65/d5f/f92 [220764,89102] 0 2024-02-19T19:08:28.870 INFO:tasks.workunit.client.0.smithi046.stdout:9/284: mkdir db/d53 0 2024-02-19T19:08:28.871 INFO:tasks.workunit.client.0.smithi046.stdout:8/587: truncate d3/f44 3039317 0 2024-02-19T19:08:28.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/285: dread db/f19 [0,4194304] 0 2024-02-19T19:08:28.872 INFO:tasks.workunit.client.0.smithi046.stdout:5/525: mknod d2/dd/d26/ca3 0 2024-02-19T19:08:28.872 INFO:tasks.workunit.client.0.smithi046.stdout:5/526: write d2/d27/f90 [123802,34544] 0 2024-02-19T19:08:28.872 INFO:tasks.workunit.client.0.smithi046.stdout:8/588: read d3/d37/f71 [789923,87498] 0 2024-02-19T19:08:28.872 INFO:tasks.workunit.client.0.smithi046.stdout:8/589: stat d3/dd/d3f/d49/c82 0 2024-02-19T19:08:28.873 INFO:tasks.workunit.client.0.smithi046.stdout:9/286: mkdir db/d1e/d32/d38/d54 0 2024-02-19T19:08:28.875 INFO:tasks.workunit.client.0.smithi046.stdout:5/527: creat d2/dd/d26/d65/fa4 x:0 0 0 2024-02-19T19:08:28.875 INFO:tasks.workunit.client.0.smithi046.stdout:5/528: chown d2/dd/d2f/d34/d5d/f61 386383077 1 2024-02-19T19:08:28.875 INFO:tasks.workunit.client.0.smithi046.stdout:5/529: read d2/dd/d26/f50 [820240,102181] 0 2024-02-19T19:08:28.876 INFO:tasks.workunit.client.0.smithi046.stdout:9/287: link db/d1e/d32/d38/c40 db/d1e/d32/d47/c55 0 2024-02-19T19:08:28.879 INFO:tasks.workunit.client.0.smithi046.stdout:5/530: rename d2/f22 to d2/dd/d26/d65/fa5 0 2024-02-19T19:08:28.879 INFO:tasks.workunit.client.0.smithi046.stdout:5/531: chown d2/dd/d29/d72 55893809 1 2024-02-19T19:08:28.879 INFO:tasks.workunit.client.0.smithi046.stdout:5/532: fsync d2/dd/d29/f82 0 2024-02-19T19:08:28.887 INFO:tasks.workunit.client.0.smithi046.stdout:9/288: dread db/f18 [4194304,4194304] 0 2024-02-19T19:08:28.887 INFO:tasks.workunit.client.0.smithi046.stdout:9/289: chown db/cd 8314554 1 2024-02-19T19:08:28.887 INFO:tasks.workunit.client.0.smithi046.stdout:9/290: read - db/d1e/d32/f4d zero size 2024-02-19T19:08:28.891 INFO:tasks.workunit.client.0.smithi046.stdout:8/590: dwrite d3/d18/f20 [4194304,4194304] 0 2024-02-19T19:08:28.894 INFO:tasks.workunit.client.0.smithi046.stdout:8/591: rename d3/f44 to d3/d37/d64/da2/fd2 0 2024-02-19T19:08:28.908 INFO:tasks.workunit.client.0.smithi046.stdout:8/592: dwrite d3/dd/d13/d6b/d46/d6a/db2/fc6 [0,4194304] 0 2024-02-19T19:08:28.908 INFO:tasks.workunit.client.0.smithi046.stdout:8/593: chown d3/d18/f86 444905499 1 2024-02-19T19:08:28.908 INFO:tasks.workunit.client.0.smithi046.stdout:8/594: fdatasync d3/dd/f14 0 2024-02-19T19:08:28.911 INFO:tasks.workunit.client.0.smithi046.stdout:8/595: rmdir d3/dd/d13/d6b/d46/d6a 39 2024-02-19T19:08:28.912 INFO:tasks.workunit.client.0.smithi046.stdout:8/596: mknod d3/d37/d64/d9a/cd3 0 2024-02-19T19:08:28.912 INFO:tasks.workunit.client.0.smithi046.stdout:8/597: write d3/dd/d3f/f60 [679541,115849] 0 2024-02-19T19:08:28.912 INFO:tasks.workunit.client.0.smithi046.stdout:8/598: fdatasync d3/dd/d13/d6b/d46/d6a/db2/fcf 0 2024-02-19T19:08:28.912 INFO:tasks.workunit.client.0.smithi046.stdout:8/599: stat d3/dd/d13/d66/fbe 0 2024-02-19T19:08:28.930 INFO:tasks.workunit.client.0.smithi046.stdout:8/600: dwrite d3/dd/d13/d6b/d46/d54/d8a/f99 [0,4194304] 0 2024-02-19T19:08:28.933 INFO:tasks.workunit.client.0.smithi046.stdout:8/601: link d3/dd/f39 d3/d18/fd4 0 2024-02-19T19:08:29.073 INFO:tasks.workunit.client.0.smithi046.stdout:2/599: sync 2024-02-19T19:08:29.073 INFO:tasks.workunit.client.0.smithi046.stdout:2/600: chown d5/d2c/d45/c85 8 1 2024-02-19T19:08:29.073 INFO:tasks.workunit.client.0.smithi046.stdout:2/601: mknod d5/d2c/d89/d4c/d75/cba 0 2024-02-19T19:08:29.073 INFO:tasks.workunit.client.0.smithi046.stdout:2/602: truncate d5/d6a/f8c 865812 0 2024-02-19T19:08:29.075 INFO:tasks.workunit.client.0.smithi046.stdout:2/603: symlink d5/d2c/d56/d5a/lbb 0 2024-02-19T19:08:29.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:28 smithi046 ceph-mon[88928]: pgmap v119: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 640 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 53 MiB/s rd, 60 MiB/s wr, 323 op/s; 7008/44817 objects degraded (15.637%) 2024-02-19T19:08:29.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:29.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:29.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:29.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:29.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:29.139 INFO:tasks.workunit.client.0.smithi046.stdout:3/358: sync 2024-02-19T19:08:29.140 INFO:tasks.workunit.client.0.smithi046.stdout:3/359: stat da/d1d/c23 0 2024-02-19T19:08:29.141 INFO:tasks.workunit.client.0.smithi046.stdout:3/360: rmdir da/d30/d38/d40 0 2024-02-19T19:08:29.142 INFO:tasks.workunit.client.0.smithi046.stdout:3/361: creat da/d30/d38/d54/f5b x:0 0 0 2024-02-19T19:08:29.149 INFO:tasks.workunit.client.0.smithi046.stdout:3/362: dread da/d30/d38/f3e [0,4194304] 0 2024-02-19T19:08:29.150 INFO:tasks.workunit.client.0.smithi046.stdout:3/363: rename da/d1d/c34 to da/d1d/d10/c5c 0 2024-02-19T19:08:29.151 INFO:tasks.workunit.client.0.smithi046.stdout:3/364: creat da/d30/d38/d54/f5d x:0 0 0 2024-02-19T19:08:29.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:28 smithi142 ceph-mon[69118]: pgmap v119: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 640 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 53 MiB/s rd, 60 MiB/s wr, 323 op/s; 7008/44817 objects degraded (15.637%) 2024-02-19T19:08:29.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:29.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:29.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:29.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:29.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:29.274 INFO:tasks.workunit.client.0.smithi046.stdout:0/506: sync 2024-02-19T19:08:29.274 INFO:tasks.workunit.client.0.smithi046.stdout:1/471: sync 2024-02-19T19:08:29.274 INFO:tasks.workunit.client.0.smithi046.stdout:7/566: sync 2024-02-19T19:08:29.274 INFO:tasks.workunit.client.0.smithi046.stdout:0/507: read - d0/d24/d56/da3/faf zero size 2024-02-19T19:08:29.275 INFO:tasks.workunit.client.0.smithi046.stdout:7/567: rename d0/d3f/c5d to d0/d4/cb2 0 2024-02-19T19:08:29.275 INFO:tasks.workunit.client.0.smithi046.stdout:7/568: read d0/d4/dd/f3a [3239360,83699] 0 2024-02-19T19:08:29.277 INFO:tasks.workunit.client.0.smithi046.stdout:1/472: rename d5/d13/d35/d37/c40 to d5/d13/d35/ca1 0 2024-02-19T19:08:29.277 INFO:tasks.workunit.client.0.smithi046.stdout:1/473: truncate d5/d2f/d5e/f97 621737 0 2024-02-19T19:08:29.280 INFO:tasks.workunit.client.0.smithi046.stdout:0/508: rename d0/d24/d56/da1/l75 to d0/d19/d8/d37/d85/lb4 0 2024-02-19T19:08:29.281 INFO:tasks.workunit.client.0.smithi046.stdout:1/474: rename d5/d13/d35/d37/d64/d75/l7a to d5/d2f/d9f/d3b/d4e/la2 0 2024-02-19T19:08:29.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/509: creat d0/d6c/fb5 x:0 0 0 2024-02-19T19:08:29.284 INFO:tasks.workunit.client.0.smithi046.stdout:0/510: rename d0/d24/f9c to d0/d19/d8/d37/d40/da6/fb6 0 2024-02-19T19:08:29.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/511: truncate d0/d19/f3a 2254320 0 2024-02-19T19:08:29.286 INFO:tasks.workunit.client.0.smithi046.stdout:0/512: creat d0/d19/d8/d37/d80/fb7 x:0 0 0 2024-02-19T19:08:29.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/513: rmdir d0/d19/d4d 39 2024-02-19T19:08:29.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/514: mkdir d0/d19/d4d/da5/da7/db8 0 2024-02-19T19:08:29.290 INFO:tasks.workunit.client.0.smithi046.stdout:7/569: dwrite d0/d4/d7b/f88 [0,4194304] 0 2024-02-19T19:08:29.290 INFO:tasks.workunit.client.0.smithi046.stdout:7/570: chown d0/d45/d4a/daf 0 1 2024-02-19T19:08:29.290 INFO:tasks.workunit.client.0.smithi046.stdout:0/515: mknod d0/d19/d4d/cb9 0 2024-02-19T19:08:29.293 INFO:tasks.workunit.client.0.smithi046.stdout:1/475: dread d5/f26 [0,4194304] 0 2024-02-19T19:08:29.293 INFO:tasks.workunit.client.0.smithi046.stdout:7/571: link d0/d45/d4a/d58/d91/fad d0/d3f/fb3 0 2024-02-19T19:08:29.294 INFO:tasks.workunit.client.0.smithi046.stdout:7/572: chown d0/d45/d71/da3/l82 4857373 1 2024-02-19T19:08:29.295 INFO:tasks.workunit.client.0.smithi046.stdout:0/516: mkdir d0/d19/d70/dba 0 2024-02-19T19:08:29.295 INFO:tasks.workunit.client.0.smithi046.stdout:0/517: write d0/f5c [525502,51181] 0 2024-02-19T19:08:29.297 INFO:tasks.workunit.client.0.smithi046.stdout:1/476: unlink d5/d2f/d9f/d55/d81/f59 0 2024-02-19T19:08:29.297 INFO:tasks.workunit.client.0.smithi046.stdout:1/477: stat d5/d2f/d9f/d3b/d4e/d76/fa0 0 2024-02-19T19:08:29.302 INFO:tasks.workunit.client.0.smithi046.stdout:7/573: rename d0/d4/dd to d0/d45/d4a/d58/d60/db4 0 2024-02-19T19:08:29.306 INFO:tasks.workunit.client.0.smithi046.stdout:7/574: rmdir d0/d45/d71/d4b/d6f 0 2024-02-19T19:08:29.306 INFO:tasks.workunit.client.0.smithi046.stdout:7/575: creat d0/d45/d56/fb5 x:0 0 0 2024-02-19T19:08:29.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/478: dread d5/d13/f31 [4194304,4194304] 0 2024-02-19T19:08:29.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/479: chown d5/d2f/d9f/c1c 0 1 2024-02-19T19:08:29.308 INFO:tasks.workunit.client.0.smithi046.stdout:7/576: rmdir d0/d4/d7b 39 2024-02-19T19:08:29.308 INFO:tasks.workunit.client.0.smithi046.stdout:7/577: stat d0/d3f/fb3 0 2024-02-19T19:08:29.309 INFO:tasks.workunit.client.0.smithi046.stdout:1/480: dread d5/f17 [4194304,4194304] 0 2024-02-19T19:08:29.309 INFO:tasks.workunit.client.0.smithi046.stdout:7/578: link d0/d45/d4a/d58/d60/db4/c1e d0/d4/d7b/cb6 0 2024-02-19T19:08:29.311 INFO:tasks.workunit.client.0.smithi046.stdout:7/579: dread d0/d45/d71/f4c [0,4194304] 0 2024-02-19T19:08:29.312 INFO:tasks.workunit.client.0.smithi046.stdout:0/518: dwrite d0/d19/f8d [0,4194304] 0 2024-02-19T19:08:29.312 INFO:tasks.workunit.client.0.smithi046.stdout:0/519: chown d0/d24/f23 557 1 2024-02-19T19:08:29.312 INFO:tasks.workunit.client.0.smithi046.stdout:0/520: write d0/d19/d8/f99 [4436523,1319] 0 2024-02-19T19:08:29.313 INFO:tasks.workunit.client.0.smithi046.stdout:1/481: rename d5/d2f/d9f/d3b/d3c/d3f/d72/c73 to d5/d2f/d9f/d3b/ca3 0 2024-02-19T19:08:29.340 INFO:tasks.workunit.client.0.smithi046.stdout:7/580: dwrite d0/d45/d71/d41/d5f/fa4 [0,4194304] 0 2024-02-19T19:08:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/521: dwrite d0/f17 [0,4194304] 0 2024-02-19T19:08:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/522: truncate d0/d19/f3a 3256771 0 2024-02-19T19:08:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/523: readlink d0/d24/d2f/l3f 0 2024-02-19T19:08:29.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/524: fdatasync d0/d24/d5b/fa9 0 2024-02-19T19:08:29.342 INFO:tasks.workunit.client.0.smithi046.stdout:1/482: dwrite d5/d2f/d9f/d3b/d3c/d3f/f43 [8388608,4194304] 0 2024-02-19T19:08:29.343 INFO:tasks.workunit.client.0.smithi046.stdout:1/483: fdatasync d5/d13/d35/d37/d64/d75/f77 0 2024-02-19T19:08:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/525: mknod d0/d19/d8/d37/d40/cbb 0 2024-02-19T19:08:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/526: read - d0/d24/d2f/d53/f9f zero size 2024-02-19T19:08:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/527: write d0/d24/d5b/fa9 [65306,71839] 0 2024-02-19T19:08:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/528: fdatasync d0/d19/d8/d37/d40/da6/fb6 0 2024-02-19T19:08:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/529: chown d0/d5f/d65 16240 1 2024-02-19T19:08:29.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/530: write d0/d19/f91 [723478,18872] 0 2024-02-19T19:08:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:1/484: mknod d5/d2f/d9f/d3b/d3c/d3f/d72/ca4 0 2024-02-19T19:08:29.347 INFO:tasks.workunit.client.0.smithi046.stdout:1/485: symlink d5/d2f/d9f/d3b/la5 0 2024-02-19T19:08:29.351 INFO:tasks.workunit.client.0.smithi046.stdout:1/486: link d5/c16 d5/d2f/d9f/d3b/d3c/d3f/ca6 0 2024-02-19T19:08:29.356 INFO:tasks.workunit.client.0.smithi046.stdout:0/531: write d0/d24/d56/da1/f2e [2343335,41232] 0 2024-02-19T19:08:29.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/581: dwrite d0/d45/d4a/d78/d9d/fa0 [0,4194304] 0 2024-02-19T19:08:29.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/582: stat d0/d4/d24/c44 0 2024-02-19T19:08:29.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/583: truncate d0/d4/d24/f51 4685985 0 2024-02-19T19:08:29.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/487: write d5/d13/d35/f41 [1493973,77627] 0 2024-02-19T19:08:29.375 INFO:tasks.workunit.client.0.smithi046.stdout:1/488: read d5/d2f/d9f/d3b/f52 [559575,129375] 0 2024-02-19T19:08:29.377 INFO:tasks.workunit.client.0.smithi046.stdout:1/489: symlink d5/d13/d35/d37/d64/d75/la7 0 2024-02-19T19:08:29.377 INFO:tasks.workunit.client.0.smithi046.stdout:1/490: fsync d5/f1f 0 2024-02-19T19:08:29.379 INFO:tasks.workunit.client.0.smithi046.stdout:7/584: dwrite d0/d3f/fb3 [0,4194304] 0 2024-02-19T19:08:29.383 INFO:tasks.workunit.client.0.smithi046.stdout:0/532: dwrite d0/f4f [0,4194304] 0 2024-02-19T19:08:29.383 INFO:tasks.workunit.client.0.smithi046.stdout:7/585: creat d0/d45/d71/da3/fb7 x:0 0 0 2024-02-19T19:08:29.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/533: getdents d0/d19/d8/d37/d40/da6 0 2024-02-19T19:08:29.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/534: write d0/d24/d2f/f46 [223615,88277] 0 2024-02-19T19:08:29.399 INFO:tasks.workunit.client.0.smithi046.stdout:1/491: dwrite d5/d13/d35/f71 [0,4194304] 0 2024-02-19T19:08:29.406 INFO:tasks.workunit.client.0.smithi046.stdout:1/492: rmdir d5/d2f/d9f/d55/d81/d80 39 2024-02-19T19:08:29.407 INFO:tasks.workunit.client.0.smithi046.stdout:1/493: rename d5/f5b to d5/d13/d35/d37/d64/d87/fa8 0 2024-02-19T19:08:29.407 INFO:tasks.workunit.client.0.smithi046.stdout:1/494: fdatasync d5/d2f/d5e/f97 0 2024-02-19T19:08:29.412 INFO:tasks.workunit.client.0.smithi046.stdout:7/586: dwrite d0/d45/d71/d41/d5f/d85/f97 [0,4194304] 0 2024-02-19T19:08:29.413 INFO:tasks.workunit.client.0.smithi046.stdout:0/535: dwrite d0/d24/f23 [4194304,4194304] 0 2024-02-19T19:08:29.415 INFO:tasks.workunit.client.0.smithi046.stdout:1/495: dread d5/d2f/d9f/d3b/f5c [0,4194304] 0 2024-02-19T19:08:29.415 INFO:tasks.workunit.client.0.smithi046.stdout:1/496: chown d5/d2f/d9f/d55/d81/d80/l99 25207216 1 2024-02-19T19:08:29.416 INFO:tasks.workunit.client.0.smithi046.stdout:1/497: chown d5/d13/f70 54224281 1 2024-02-19T19:08:29.420 INFO:tasks.workunit.client.0.smithi046.stdout:0/536: rmdir d0/d19/d8/d37/da0 0 2024-02-19T19:08:29.421 INFO:tasks.workunit.client.0.smithi046.stdout:1/498: stat d5/d2f/l7b 0 2024-02-19T19:08:29.425 INFO:tasks.workunit.client.0.smithi046.stdout:0/537: mknod d0/d19/d8/d37/d40/da6/cbc 0 2024-02-19T19:08:29.425 INFO:tasks.workunit.client.0.smithi046.stdout:0/538: write d0/d19/d8/d37/d80/fb7 [875570,48423] 0 2024-02-19T19:08:29.425 INFO:tasks.workunit.client.0.smithi046.stdout:0/539: dread - d0/d24/d56/fab zero size 2024-02-19T19:08:29.425 INFO:tasks.workunit.client.0.smithi046.stdout:0/540: stat d0/d19/d8/d37/d40/da6/fb6 0 2024-02-19T19:08:29.425 INFO:tasks.workunit.client.0.smithi046.stdout:0/541: read d0/d19/f1f [1833587,93707] 0 2024-02-19T19:08:29.425 INFO:tasks.workunit.client.0.smithi046.stdout:0/542: stat d0/d24/c64 0 2024-02-19T19:08:29.425 INFO:tasks.workunit.client.0.smithi046.stdout:0/543: truncate d0/d24/d56/f81 1421555 0 2024-02-19T19:08:29.425 INFO:tasks.workunit.client.0.smithi046.stdout:0/544: write d0/d19/d8/f22 [5061600,109429] 0 2024-02-19T19:08:29.426 INFO:tasks.workunit.client.0.smithi046.stdout:1/499: creat d5/d13/d35/d37/fa9 x:0 0 0 2024-02-19T19:08:29.427 INFO:tasks.workunit.client.0.smithi046.stdout:0/545: dread d0/f3c [0,4194304] 0 2024-02-19T19:08:29.427 INFO:tasks.workunit.client.0.smithi046.stdout:0/546: write d0/d24/d56/da3/faf [412447,64079] 0 2024-02-19T19:08:29.427 INFO:tasks.workunit.client.0.smithi046.stdout:7/587: rename d0/d45/d71/d41/d5f/d85 to d0/d45/d71/d41/db8 0 2024-02-19T19:08:29.427 INFO:tasks.workunit.client.0.smithi046.stdout:7/588: chown d0/d45/d4a/d58/d60/db4/f40 0 1 2024-02-19T19:08:29.430 INFO:tasks.workunit.client.0.smithi046.stdout:7/589: dread d0/d4/f29 [0,4194304] 0 2024-02-19T19:08:29.430 INFO:tasks.workunit.client.0.smithi046.stdout:7/590: write d0/d45/d4a/d58/d60/db4/f10 [4728564,36403] 0 2024-02-19T19:08:29.430 INFO:tasks.workunit.client.0.smithi046.stdout:7/591: fdatasync d0/d45/d71/f5b 0 2024-02-19T19:08:29.431 INFO:tasks.workunit.client.0.smithi046.stdout:1/500: rename d5/d2f/d9f/d3b/f7d to d5/d21/faa 0 2024-02-19T19:08:29.433 INFO:tasks.workunit.client.0.smithi046.stdout:7/592: mkdir d0/d4/d24/db9 0 2024-02-19T19:08:29.433 INFO:tasks.workunit.client.0.smithi046.stdout:5/533: sync 2024-02-19T19:08:29.433 INFO:tasks.workunit.client.0.smithi046.stdout:9/291: sync 2024-02-19T19:08:29.433 INFO:tasks.workunit.client.0.smithi046.stdout:4/595: sync 2024-02-19T19:08:29.434 INFO:tasks.workunit.client.0.smithi046.stdout:6/427: sync 2024-02-19T19:08:29.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/547: rename d0/d19/d8/d37/d40/da6/cbc to d0/d24/d5b/d7f/d9b/cbd 0 2024-02-19T19:08:29.436 INFO:tasks.workunit.client.0.smithi046.stdout:1/501: creat d5/d13/d35/d37/d64/fab x:0 0 0 2024-02-19T19:08:29.437 INFO:tasks.workunit.client.0.smithi046.stdout:7/593: creat d0/d3f/fba x:0 0 0 2024-02-19T19:08:29.438 INFO:tasks.workunit.client.0.smithi046.stdout:9/292: creat db/d20/f56 x:0 0 0 2024-02-19T19:08:29.439 INFO:tasks.workunit.client.0.smithi046.stdout:1/502: dread d5/d21/f23 [0,4194304] 0 2024-02-19T19:08:29.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/534: rename d2/dd/d29/f35 to d2/dd/d26/d65/d5f/fa6 0 2024-02-19T19:08:29.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/535: fsync d2/f2d 0 2024-02-19T19:08:29.441 INFO:tasks.workunit.client.0.smithi046.stdout:1/503: getdents d5/d13/d35/d37/d64/d87 0 2024-02-19T19:08:29.441 INFO:tasks.workunit.client.0.smithi046.stdout:1/504: chown d5/d2f/d9f/d3b/d3c/d3f/d72/f9c 1526 1 2024-02-19T19:08:29.441 INFO:tasks.workunit.client.0.smithi046.stdout:1/505: chown d5/d2f/d9f/d3b/f5c 199 1 2024-02-19T19:08:29.442 INFO:tasks.workunit.client.0.smithi046.stdout:9/293: rename db/d1e/d32/f4d to db/d1e/d32/d47/f57 0 2024-02-19T19:08:29.444 INFO:tasks.workunit.client.0.smithi046.stdout:9/294: symlink db/d1e/d32/d38/l58 0 2024-02-19T19:08:29.444 INFO:tasks.workunit.client.0.smithi046.stdout:9/295: stat db/f1c 0 2024-02-19T19:08:29.446 INFO:tasks.workunit.client.0.smithi046.stdout:6/428: dread d4/d6/d1c/d60/f61 [0,4194304] 0 2024-02-19T19:08:29.447 INFO:tasks.workunit.client.0.smithi046.stdout:6/429: chown d4/d6/d1c/d64/f80 0 1 2024-02-19T19:08:29.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/536: rename d2/dd/d29/d89/l9b to d2/dd/d26/la7 0 2024-02-19T19:08:29.447 INFO:tasks.workunit.client.0.smithi046.stdout:7/594: dread d0/d45/d4a/d58/d60/f89 [0,4194304] 0 2024-02-19T19:08:29.447 INFO:tasks.workunit.client.0.smithi046.stdout:4/596: dread d6/d15/d17/d1e/f7a [0,4194304] 0 2024-02-19T19:08:29.449 INFO:tasks.workunit.client.0.smithi046.stdout:5/537: symlink d2/dd/d29/la8 0 2024-02-19T19:08:29.451 INFO:tasks.workunit.client.0.smithi046.stdout:1/506: dread d5/d13/f19 [0,4194304] 0 2024-02-19T19:08:29.451 INFO:tasks.workunit.client.0.smithi046.stdout:7/595: link d0/d45/d71/c7f d0/cbb 0 2024-02-19T19:08:29.451 INFO:tasks.workunit.client.0.smithi046.stdout:7/596: creat d0/d4/d24/fbc x:0 0 0 2024-02-19T19:08:29.451 INFO:tasks.workunit.client.0.smithi046.stdout:7/597: stat d0/d4/d24/caa 0 2024-02-19T19:08:29.452 INFO:tasks.workunit.client.0.smithi046.stdout:0/548: dwrite d0/d19/f1f [0,4194304] 0 2024-02-19T19:08:29.454 INFO:tasks.workunit.client.0.smithi046.stdout:4/597: rename d6/f80 to d6/d15/d6e/dc5/fc9 0 2024-02-19T19:08:29.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/538: mkdir d2/dd/d26/da9 0 2024-02-19T19:08:29.456 INFO:tasks.workunit.client.0.smithi046.stdout:1/507: creat d5/d2f/d9f/d55/d81/d80/fac x:0 0 0 2024-02-19T19:08:29.457 INFO:tasks.workunit.client.0.smithi046.stdout:9/296: write f0 [9291168,79133] 0 2024-02-19T19:08:29.457 INFO:tasks.workunit.client.0.smithi046.stdout:7/598: unlink d0/d45/d4a/d58/d60/db4/c55 0 2024-02-19T19:08:29.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/539: mkdir d2/dd/d26/daa 0 2024-02-19T19:08:29.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/540: fsync d2/f85 0 2024-02-19T19:08:29.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/541: creat d2/dd/d26/d65/fab x:0 0 0 2024-02-19T19:08:29.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/542: chown d2/d27/d47/c6a 54 1 2024-02-19T19:08:29.461 INFO:tasks.workunit.client.0.smithi046.stdout:9/297: creat db/d1e/d52/f59 x:0 0 0 2024-02-19T19:08:29.461 INFO:tasks.workunit.client.0.smithi046.stdout:9/298: dread - db/f41 zero size 2024-02-19T19:08:29.461 INFO:tasks.workunit.client.0.smithi046.stdout:4/598: rmdir d6/d11/d92 39 2024-02-19T19:08:29.461 INFO:tasks.workunit.client.0.smithi046.stdout:4/599: chown d6/d94/dab 1 1 2024-02-19T19:08:29.463 INFO:tasks.workunit.client.0.smithi046.stdout:9/299: symlink db/d53/l5a 0 2024-02-19T19:08:29.463 INFO:tasks.workunit.client.0.smithi046.stdout:9/300: fdatasync f2 0 2024-02-19T19:08:29.464 INFO:tasks.workunit.client.0.smithi046.stdout:9/301: stat db/d1e/d32 0 2024-02-19T19:08:29.464 INFO:tasks.workunit.client.0.smithi046.stdout:9/302: getdents db/d1e/d32/d38/d54 0 2024-02-19T19:08:29.464 INFO:tasks.workunit.client.0.smithi046.stdout:9/303: chown db/f4b 4782615 1 2024-02-19T19:08:29.468 INFO:tasks.workunit.client.0.smithi046.stdout:4/600: rmdir d6/d50 39 2024-02-19T19:08:29.470 INFO:tasks.workunit.client.0.smithi046.stdout:2/604: sync 2024-02-19T19:08:29.470 INFO:tasks.workunit.client.0.smithi046.stdout:3/365: sync 2024-02-19T19:08:29.470 INFO:tasks.workunit.client.0.smithi046.stdout:3/366: creat da/d1d/d10/f5e x:0 0 0 2024-02-19T19:08:29.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/602: sync 2024-02-19T19:08:29.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/603: write d3/dd/d13/d6b/d36/f4a [1990906,16665] 0 2024-02-19T19:08:29.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/604: chown d3/d37/d9b/cae 26301 1 2024-02-19T19:08:29.474 INFO:tasks.workunit.client.0.smithi046.stdout:8/605: write d3/f10 [789619,76147] 0 2024-02-19T19:08:29.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/601: dread d6/f49 [0,4194304] 0 2024-02-19T19:08:29.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/602: chown d6/d11/l99 10 1 2024-02-19T19:08:29.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/603: write d6/f49 [2807756,84128] 0 2024-02-19T19:08:29.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/604: chown c2 262703 1 2024-02-19T19:08:29.477 INFO:tasks.workunit.client.0.smithi046.stdout:0/549: dwrite d0/f4e [0,4194304] 0 2024-02-19T19:08:29.477 INFO:tasks.workunit.client.0.smithi046.stdout:0/550: chown d0/d24/d56 123 1 2024-02-19T19:08:29.479 INFO:tasks.workunit.client.0.smithi046.stdout:8/606: creat d3/dd/d13/d66/dba/fd5 x:0 0 0 2024-02-19T19:08:29.482 INFO:tasks.workunit.client.0.smithi046.stdout:4/605: creat d6/d15/d17/fca x:0 0 0 2024-02-19T19:08:29.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/367: getdents da/d3b 0 2024-02-19T19:08:29.482 INFO:tasks.workunit.client.0.smithi046.stdout:3/368: truncate da/d1d/d10/f5e 494629 0 2024-02-19T19:08:29.483 INFO:tasks.workunit.client.0.smithi046.stdout:3/369: chown da/d30/l43 12844330 1 2024-02-19T19:08:29.483 INFO:tasks.workunit.client.0.smithi046.stdout:6/430: dwrite d4/d6/d1c/f75 [0,4194304] 0 2024-02-19T19:08:29.484 INFO:tasks.workunit.client.0.smithi046.stdout:2/605: dread d5/d2c/fa2 [0,4194304] 0 2024-02-19T19:08:29.484 INFO:tasks.workunit.client.0.smithi046.stdout:7/599: dwrite d0/d45/d71/d4b/f57 [0,4194304] 0 2024-02-19T19:08:29.485 INFO:tasks.workunit.client.0.smithi046.stdout:7/600: fdatasync d0/d4/d7b/fab 0 2024-02-19T19:08:29.485 INFO:tasks.workunit.client.0.smithi046.stdout:7/601: truncate d0/f48 1497459 0 2024-02-19T19:08:29.485 INFO:tasks.workunit.client.0.smithi046.stdout:7/602: chown d0/d4/d7b 0 1 2024-02-19T19:08:29.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/543: dwrite d2/f85 [0,4194304] 0 2024-02-19T19:08:29.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/551: rmdir d0/d24/d56/da1 39 2024-02-19T19:08:29.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/552: write d0/d5f/f69 [550492,102071] 0 2024-02-19T19:08:29.490 INFO:tasks.workunit.client.0.smithi046.stdout:1/508: dwrite d5/d2f/d9f/d55/d81/f4b [0,4194304] 0 2024-02-19T19:08:29.490 INFO:tasks.workunit.client.0.smithi046.stdout:4/606: creat d6/d15/d17/d4a/db1/fcb x:0 0 0 2024-02-19T19:08:29.492 INFO:tasks.workunit.client.0.smithi046.stdout:3/370: symlink da/d1d/l5f 0 2024-02-19T19:08:29.495 INFO:tasks.workunit.client.0.smithi046.stdout:6/431: symlink d4/d6/d1c/d20/d7a/l88 0 2024-02-19T19:08:29.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/371: dread da/d1d/d10/f1e [0,4194304] 0 2024-02-19T19:08:29.497 INFO:tasks.workunit.client.0.smithi046.stdout:2/606: truncate d5/d2c/d89/f40 3123226 0 2024-02-19T19:08:29.497 INFO:tasks.workunit.client.0.smithi046.stdout:2/607: write d5/d2c/d89/f10 [1173689,20278] 0 2024-02-19T19:08:29.499 INFO:tasks.workunit.client.0.smithi046.stdout:9/304: rmdir db/d1e 39 2024-02-19T19:08:29.499 INFO:tasks.workunit.client.0.smithi046.stdout:9/305: stat l9 0 2024-02-19T19:08:29.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/544: mknod d2/d27/d47/d7f/cac 0 2024-02-19T19:08:29.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/545: read d2/dd/d26/d65/d5f/f92 [291936,46989] 0 2024-02-19T19:08:29.504 INFO:tasks.workunit.client.0.smithi046.stdout:5/546: write d2/f4a [624273,116774] 0 2024-02-19T19:08:29.504 INFO:tasks.workunit.client.0.smithi046.stdout:0/553: unlink d0/d19/d8/d37/l42 0 2024-02-19T19:08:29.504 INFO:tasks.workunit.client.0.smithi046.stdout:0/554: dread - d0/d6c/fb5 zero size 2024-02-19T19:08:29.504 INFO:tasks.workunit.client.0.smithi046.stdout:0/555: fdatasync d0/d19/db/d6a/f9a 0 2024-02-19T19:08:29.504 INFO:tasks.workunit.client.0.smithi046.stdout:8/607: rmdir d3/dd/d13/d6b/d36 39 2024-02-19T19:08:29.508 INFO:tasks.workunit.client.0.smithi046.stdout:1/509: mknod d5/d2f/d9f/d3b/d3c/d3f/d72/cad 0 2024-02-19T19:08:29.509 INFO:tasks.workunit.client.0.smithi046.stdout:1/510: creat d5/d2f/d5e/fae x:0 0 0 2024-02-19T19:08:29.512 INFO:tasks.workunit.client.0.smithi046.stdout:4/607: unlink d6/d15/d17/d1e/f9d 0 2024-02-19T19:08:29.512 INFO:tasks.workunit.client.0.smithi046.stdout:4/608: chown d6/d15/d17/c44 195 1 2024-02-19T19:08:29.512 INFO:tasks.workunit.client.0.smithi046.stdout:1/511: write d5/d13/f19 [685360,127109] 0 2024-02-19T19:08:29.512 INFO:tasks.workunit.client.0.smithi046.stdout:1/512: write d5/d13/d35/f9e [1010797,18345] 0 2024-02-19T19:08:29.513 INFO:tasks.workunit.client.0.smithi046.stdout:3/372: creat da/d1d/f60 x:0 0 0 2024-02-19T19:08:29.513 INFO:tasks.workunit.client.0.smithi046.stdout:3/373: fdatasync da/d1d/d10/f50 0 2024-02-19T19:08:29.513 INFO:tasks.workunit.client.0.smithi046.stdout:6/432: dwrite d4/d6/dd/d10/f15 [4194304,4194304] 0 2024-02-19T19:08:29.516 INFO:tasks.workunit.client.0.smithi046.stdout:2/608: creat d5/d6/d13/d7c/fbc x:0 0 0 2024-02-19T19:08:29.516 INFO:tasks.workunit.client.0.smithi046.stdout:2/609: readlink d5/d2c/d89/l34 0 2024-02-19T19:08:29.516 INFO:tasks.workunit.client.0.smithi046.stdout:2/610: creat d5/d2c/d45/fbd x:0 0 0 2024-02-19T19:08:29.516 INFO:tasks.workunit.client.0.smithi046.stdout:5/547: creat d2/d27/d47/fad x:0 0 0 2024-02-19T19:08:29.516 INFO:tasks.workunit.client.0.smithi046.stdout:5/548: chown d2/d5e/f6d 96034939 1 2024-02-19T19:08:29.516 INFO:tasks.workunit.client.0.smithi046.stdout:5/549: chown d2/dd/d29/f82 102820 1 2024-02-19T19:08:29.516 INFO:tasks.workunit.client.0.smithi046.stdout:4/609: read d6/d15/f48 [4333944,66459] 0 2024-02-19T19:08:29.517 INFO:tasks.workunit.client.0.smithi046.stdout:9/306: dwrite db/f1b [0,4194304] 0 2024-02-19T19:08:29.519 INFO:tasks.workunit.client.0.smithi046.stdout:6/433: mknod d4/d6/d22/c89 0 2024-02-19T19:08:29.519 INFO:tasks.workunit.client.0.smithi046.stdout:6/434: stat d4/d6/dd/d10/d29/d2d/f47 0 2024-02-19T19:08:29.521 INFO:tasks.workunit.client.0.smithi046.stdout:2/611: mkdir d5/d2c/d89/d4c/d75/dbe 0 2024-02-19T19:08:29.523 INFO:tasks.workunit.client.0.smithi046.stdout:5/550: link d2/dd/f20 d2/dd/d29/d3b/d93/fae 0 2024-02-19T19:08:29.523 INFO:tasks.workunit.client.0.smithi046.stdout:5/551: write d2/dd/f77 [4516790,90067] 0 2024-02-19T19:08:29.528 INFO:tasks.workunit.client.0.smithi046.stdout:6/435: link d4/f39 d4/d6/dd/d10/f8a 0 2024-02-19T19:08:29.530 INFO:tasks.workunit.client.0.smithi046.stdout:5/552: creat d2/dd/d3f/faf x:0 0 0 2024-02-19T19:08:29.537 INFO:tasks.workunit.client.0.smithi046.stdout:9/307: write db/f18 [397888,1460] 0 2024-02-19T19:08:29.537 INFO:tasks.workunit.client.0.smithi046.stdout:9/308: write db/d20/f3f [50142,102602] 0 2024-02-19T19:08:29.537 INFO:tasks.workunit.client.0.smithi046.stdout:9/309: write db/f41 [237822,61934] 0 2024-02-19T19:08:29.537 INFO:tasks.workunit.client.0.smithi046.stdout:9/310: rmdir db/d1e 39 2024-02-19T19:08:29.538 INFO:tasks.workunit.client.0.smithi046.stdout:9/311: mkdir db/d1e/d32/d47/d5b 0 2024-02-19T19:08:29.551 INFO:tasks.workunit.client.0.smithi046.stdout:0/556: dwrite d0/d24/d2f/f46 [0,4194304] 0 2024-02-19T19:08:29.551 INFO:tasks.workunit.client.0.smithi046.stdout:0/557: write d0/d5f/d65/d79/f93 [1401304,14359] 0 2024-02-19T19:08:29.553 INFO:tasks.workunit.client.0.smithi046.stdout:6/436: dread d4/d6/dd/d10/f15 [4194304,4194304] 0 2024-02-19T19:08:29.553 INFO:tasks.workunit.client.0.smithi046.stdout:4/610: dwrite d6/d11/f68 [0,4194304] 0 2024-02-19T19:08:29.553 INFO:tasks.workunit.client.0.smithi046.stdout:6/437: write d4/d6/d22/f7d [239546,41985] 0 2024-02-19T19:08:29.553 INFO:tasks.workunit.client.0.smithi046.stdout:4/611: creat d6/d11/d40/fcc x:0 0 0 2024-02-19T19:08:29.553 INFO:tasks.workunit.client.0.smithi046.stdout:4/612: stat d6/d11/d40/l95 0 2024-02-19T19:08:29.566 INFO:tasks.workunit.client.0.smithi046.stdout:4/613: dread d6/d15/f77 [0,4194304] 0 2024-02-19T19:08:29.566 INFO:tasks.workunit.client.0.smithi046.stdout:4/614: write d6/d11/f35 [6475236,126680] 0 2024-02-19T19:08:29.567 INFO:tasks.workunit.client.0.smithi046.stdout:4/615: symlink d6/d11/d92/lcd 0 2024-02-19T19:08:29.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/438: write d4/d6/f5e [3254006,78895] 0 2024-02-19T19:08:29.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/439: truncate d4/d6/dd/f56 627122 0 2024-02-19T19:08:29.572 INFO:tasks.workunit.client.0.smithi046.stdout:2/612: dwrite d5/d2c/d89/f37 [0,4194304] 0 2024-02-19T19:08:29.573 INFO:tasks.workunit.client.0.smithi046.stdout:3/374: dwrite da/d30/d38/d54/f5d [0,4194304] 0 2024-02-19T19:08:29.573 INFO:tasks.workunit.client.0.smithi046.stdout:8/608: dwrite d3/d37/d64/da2/d3c/db6/fd0 [4194304,4194304] 0 2024-02-19T19:08:29.574 INFO:tasks.workunit.client.0.smithi046.stdout:1/513: rename d5/d2f/d9f/d3b/d3c/d3f/d72 to d5/d2f/d9f/d55/d81/d80/daf 0 2024-02-19T19:08:29.575 INFO:tasks.workunit.client.0.smithi046.stdout:6/440: mknod d4/d6/c8b 0 2024-02-19T19:08:29.579 INFO:tasks.workunit.client.0.smithi046.stdout:2/613: dread d5/d2c/d56/f74 [0,4194304] 0 2024-02-19T19:08:29.580 INFO:tasks.workunit.client.0.smithi046.stdout:3/375: getdents da 0 2024-02-19T19:08:29.584 INFO:tasks.workunit.client.0.smithi046.stdout:8/609: mknod d3/dd/d13/d6b/d46/cd6 0 2024-02-19T19:08:29.584 INFO:tasks.workunit.client.0.smithi046.stdout:8/610: truncate d3/dd/d13/d6b/d46/d54/f97 533641 0 2024-02-19T19:08:29.585 INFO:tasks.workunit.client.0.smithi046.stdout:5/553: getdents d2/dd/d29/d3b/d93 0 2024-02-19T19:08:29.587 INFO:tasks.workunit.client.0.smithi046.stdout:3/376: write da/d1d/d10/f4c [1142604,115127] 0 2024-02-19T19:08:29.588 INFO:tasks.workunit.client.0.smithi046.stdout:3/377: write da/d30/d38/f3d [42977,79644] 0 2024-02-19T19:08:29.592 INFO:tasks.workunit.client.0.smithi046.stdout:9/312: rename db/l25 to db/d20/l5c 0 2024-02-19T19:08:29.593 INFO:tasks.workunit.client.0.smithi046.stdout:6/441: mknod d4/d6/d1c/d64/c8c 0 2024-02-19T19:08:29.593 INFO:tasks.workunit.client.0.smithi046.stdout:8/611: dread d3/dd/d13/d6b/d46/d54/fa4 [0,4194304] 0 2024-02-19T19:08:29.596 INFO:tasks.workunit.client.0.smithi046.stdout:2/614: mkdir d5/d2c/d45/dbf 0 2024-02-19T19:08:29.596 INFO:tasks.workunit.client.0.smithi046.stdout:2/615: readlink d5/d2c/d56/d5a/lbb 0 2024-02-19T19:08:29.598 INFO:tasks.workunit.client.0.smithi046.stdout:5/554: link d2/f3c d2/d27/d4b/fb0 0 2024-02-19T19:08:29.603 INFO:tasks.workunit.client.0.smithi046.stdout:0/558: rename d0/d19/f8d to d0/d19/d88/fbe 0 2024-02-19T19:08:29.609 INFO:tasks.workunit.client.0.smithi046.stdout:6/442: symlink d4/d6/d1c/d20/d7a/l8d 0 2024-02-19T19:08:29.613 INFO:tasks.workunit.client.0.smithi046.stdout:3/378: rmdir da/d1d 39 2024-02-19T19:08:29.616 INFO:tasks.workunit.client.0.smithi046.stdout:6/443: mkdir d4/d6/d8e 0 2024-02-19T19:08:29.616 INFO:tasks.workunit.client.0.smithi046.stdout:6/444: creat d4/f8f x:0 0 0 2024-02-19T19:08:29.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/559: rename d0/d24/d56/fab to d0/d24/d2f/d53/d6b/fbf 0 2024-02-19T19:08:29.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/560: creat d0/d19/d8/d37/d80/fc0 x:0 0 0 2024-02-19T19:08:29.619 INFO:tasks.workunit.client.0.smithi046.stdout:2/616: read f1 [1897290,125465] 0 2024-02-19T19:08:29.620 INFO:tasks.workunit.client.0.smithi046.stdout:9/313: dwrite db/f36 [4194304,4194304] 0 2024-02-19T19:08:29.621 INFO:tasks.workunit.client.0.smithi046.stdout:6/445: unlink d4/d6/dd/d10/d29/d2d/d35/d3c/l59 0 2024-02-19T19:08:29.622 INFO:tasks.workunit.client.0.smithi046.stdout:8/612: dwrite d3/d37/d64/f7a [0,4194304] 0 2024-02-19T19:08:29.622 INFO:tasks.workunit.client.0.smithi046.stdout:3/379: rmdir da/d30/d38/d54 39 2024-02-19T19:08:29.622 INFO:tasks.workunit.client.0.smithi046.stdout:3/380: write da/d1d/f28 [2880867,84503] 0 2024-02-19T19:08:29.622 INFO:tasks.workunit.client.0.smithi046.stdout:3/381: creat da/d30/d38/f61 x:0 0 0 2024-02-19T19:08:29.624 INFO:tasks.workunit.client.0.smithi046.stdout:0/561: symlink d0/d19/d4d/lc1 0 2024-02-19T19:08:29.626 INFO:tasks.workunit.client.0.smithi046.stdout:9/314: creat db/d1e/d32/f5d x:0 0 0 2024-02-19T19:08:29.628 INFO:tasks.workunit.client.0.smithi046.stdout:6/446: link d4/d6/d1c/f75 d4/d6/d8e/f90 0 2024-02-19T19:08:29.631 INFO:tasks.workunit.client.0.smithi046.stdout:8/613: truncate d3/dd/d3f/f60 3476998 0 2024-02-19T19:08:29.634 INFO:tasks.workunit.client.0.smithi046.stdout:3/382: dread da/d30/d38/d54/f5d [0,4194304] 0 2024-02-19T19:08:29.634 INFO:tasks.workunit.client.0.smithi046.stdout:0/562: creat d0/d24/d2f/dac/fc2 x:0 0 0 2024-02-19T19:08:29.635 INFO:tasks.workunit.client.0.smithi046.stdout:2/617: getdents d5/d2c/d35 0 2024-02-19T19:08:29.637 INFO:tasks.workunit.client.0.smithi046.stdout:9/315: truncate f0 5635281 0 2024-02-19T19:08:29.639 INFO:tasks.workunit.client.0.smithi046.stdout:6/447: mknod d4/d6/d1c/d20/d7a/c91 0 2024-02-19T19:08:29.640 INFO:tasks.workunit.client.0.smithi046.stdout:6/448: write d4/d6/dd/d10/f13 [4759144,10697] 0 2024-02-19T19:08:29.643 INFO:tasks.workunit.client.0.smithi046.stdout:2/618: creat d5/d2c/d56/da5/da9/fc0 x:0 0 0 2024-02-19T19:08:29.643 INFO:tasks.workunit.client.0.smithi046.stdout:2/619: chown d5/d2c/d35 514 1 2024-02-19T19:08:29.643 INFO:tasks.workunit.client.0.smithi046.stdout:2/620: write d5/d2c/d35/d80/f87 [84646,63285] 0 2024-02-19T19:08:29.643 INFO:tasks.workunit.client.0.smithi046.stdout:2/621: readlink d5/d2c/d89/d4c/d75/l76 0 2024-02-19T19:08:29.643 INFO:tasks.workunit.client.0.smithi046.stdout:2/622: stat d5/d2c/d45/f4a 0 2024-02-19T19:08:29.648 INFO:tasks.workunit.client.0.smithi046.stdout:8/614: dwrite d3/dd/d3f/d49/d5b/d5f/f89 [0,4194304] 0 2024-02-19T19:08:29.657 INFO:tasks.workunit.client.0.smithi046.stdout:9/316: rename db/d53/l5a to db/d1e/d52/l5e 0 2024-02-19T19:08:29.662 INFO:tasks.workunit.client.0.smithi046.stdout:0/563: rmdir d0/d19 39 2024-02-19T19:08:29.665 INFO:tasks.workunit.client.0.smithi046.stdout:6/449: dwrite d4/d6/d1c/f75 [0,4194304] 0 2024-02-19T19:08:29.665 INFO:tasks.workunit.client.0.smithi046.stdout:2/623: creat d5/d2c/d89/d3f/da1/fc1 x:0 0 0 2024-02-19T19:08:29.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/564: rename d0/d5f/d74/c9e to d0/d19/d70/dba/cc3 0 2024-02-19T19:08:29.667 INFO:tasks.workunit.client.0.smithi046.stdout:8/615: dwrite d3/d18/f86 [0,4194304] 0 2024-02-19T19:08:29.669 INFO:tasks.workunit.client.0.smithi046.stdout:6/450: symlink d4/d6/dd/d10/d29/d2d/d35/d66/l92 0 2024-02-19T19:08:29.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/624: getdents d5/d6/d13/d7c/d90 0 2024-02-19T19:08:29.673 INFO:tasks.workunit.client.0.smithi046.stdout:0/565: mkdir d0/d6c/dc4 0 2024-02-19T19:08:29.675 INFO:tasks.workunit.client.0.smithi046.stdout:9/317: dwrite db/f43 [0,4194304] 0 2024-02-19T19:08:29.675 INFO:tasks.workunit.client.0.smithi046.stdout:9/318: creat db/d1e/d32/f5f x:0 0 0 2024-02-19T19:08:29.675 INFO:tasks.workunit.client.0.smithi046.stdout:8/616: link d3/dd/d13/d6b/d46/d6a/l83 d3/dd/d13/d6b/d46/d54/ld7 0 2024-02-19T19:08:29.689 INFO:tasks.workunit.client.0.smithi046.stdout:9/319: dread db/f43 [0,4194304] 0 2024-02-19T19:08:29.689 INFO:tasks.workunit.client.0.smithi046.stdout:9/320: fsync db/d20/f39 0 2024-02-19T19:08:29.693 INFO:tasks.workunit.client.0.smithi046.stdout:2/625: mknod d5/d2c/cc2 0 2024-02-19T19:08:29.693 INFO:tasks.workunit.client.0.smithi046.stdout:2/626: truncate d5/d2c/d45/fb7 551641 0 2024-02-19T19:08:29.693 INFO:tasks.workunit.client.0.smithi046.stdout:2/627: creat d5/d2c/d89/fc3 x:0 0 0 2024-02-19T19:08:29.694 INFO:tasks.workunit.client.0.smithi046.stdout:0/566: mkdir d0/d19/d8/dc5 0 2024-02-19T19:08:29.701 INFO:tasks.workunit.client.0.smithi046.stdout:6/451: dwrite d4/d6/dd/f44 [0,4194304] 0 2024-02-19T19:08:29.701 INFO:tasks.workunit.client.0.smithi046.stdout:6/452: dread - d4/d6/dd/f83 zero size 2024-02-19T19:08:29.704 INFO:tasks.workunit.client.0.smithi046.stdout:0/567: write d0/d19/f1f [1873527,52331] 0 2024-02-19T19:08:29.704 INFO:tasks.workunit.client.0.smithi046.stdout:8/617: dwrite d3/dd/d13/d66/dba/fd5 [0,4194304] 0 2024-02-19T19:08:29.704 INFO:tasks.workunit.client.0.smithi046.stdout:8/618: fdatasync d3/dd/d13/d6b/d46/d6a/db2/fcc 0 2024-02-19T19:08:29.728 INFO:tasks.workunit.client.0.smithi046.stdout:6/453: dwrite d4/f5 [4194304,4194304] 0 2024-02-19T19:08:29.730 INFO:tasks.workunit.client.0.smithi046.stdout:8/619: dwrite d3/d37/d64/f7a [0,4194304] 0 2024-02-19T19:08:29.730 INFO:tasks.workunit.client.0.smithi046.stdout:8/620: readlink d3/d37/d64/da2/d3c/l84 0 2024-02-19T19:08:29.730 INFO:tasks.workunit.client.0.smithi046.stdout:8/621: read d3/dd/d13/d6b/d46/d54/f6f [3664640,64108] 0 2024-02-19T19:08:29.736 INFO:tasks.workunit.client.0.smithi046.stdout:6/454: write d4/f6a [2017042,3458] 0 2024-02-19T19:08:29.746 INFO:tasks.workunit.client.0.smithi046.stdout:6/455: dread d4/d6/d1c/f51 [0,4194304] 0 2024-02-19T19:08:29.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/622: dwrite d3/d37/d64/f7a [0,4194304] 0 2024-02-19T19:08:29.757 INFO:tasks.workunit.client.0.smithi046.stdout:6/456: dread d4/d6/dd/d10/f13 [0,4194304] 0 2024-02-19T19:08:29.781 INFO:tasks.workunit.client.0.smithi046.stdout:9/321: mknod db/d1e/d32/d47/d5b/c60 0 2024-02-19T19:08:29.781 INFO:tasks.workunit.client.0.smithi046.stdout:9/322: write db/d1e/d32/f5f [274145,10473] 0 2024-02-19T19:08:29.795 INFO:tasks.workunit.client.0.smithi046.stdout:2/628: rename d5/l27 to d5/d2c/d89/d3f/da1/lc4 0 2024-02-19T19:08:29.796 INFO:tasks.workunit.client.0.smithi046.stdout:0/568: mkdir d0/dc6 0 2024-02-19T19:08:29.796 INFO:tasks.workunit.client.0.smithi046.stdout:0/569: read - d0/d19/d8/d37/d40/f83 zero size 2024-02-19T19:08:29.799 INFO:tasks.workunit.client.0.smithi046.stdout:9/323: dwrite db/f1c [0,4194304] 0 2024-02-19T19:08:29.801 INFO:tasks.workunit.client.0.smithi046.stdout:9/324: dread db/f41 [0,4194304] 0 2024-02-19T19:08:29.802 INFO:tasks.workunit.client.0.smithi046.stdout:8/623: mkdir d3/dd/d3f/d49/d5b/d5f/da0/dd8 0 2024-02-19T19:08:29.803 INFO:tasks.workunit.client.0.smithi046.stdout:8/624: readlink d3/d37/d64/da2/d3c/l84 0 2024-02-19T19:08:29.803 INFO:tasks.workunit.client.0.smithi046.stdout:6/457: symlink d4/l93 0 2024-02-19T19:08:29.808 INFO:tasks.workunit.client.0.smithi046.stdout:2/629: mknod d5/d7a/cc5 0 2024-02-19T19:08:29.810 INFO:tasks.workunit.client.0.smithi046.stdout:0/570: rename d0/d24/d56/da1/f66 to d0/d19/d8/dc5/fc7 0 2024-02-19T19:08:29.810 INFO:tasks.workunit.client.0.smithi046.stdout:0/571: chown d0/d24/d5b/d7f/d9b/cbd 1013357 1 2024-02-19T19:08:29.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/325: stat db/l45 0 2024-02-19T19:08:29.811 INFO:tasks.workunit.client.0.smithi046.stdout:8/625: dread d3/dd/f15 [0,4194304] 0 2024-02-19T19:08:29.811 INFO:tasks.workunit.client.0.smithi046.stdout:2/630: mkdir d5/d2c/d89/d3f/d82/db6/dc6 0 2024-02-19T19:08:29.812 INFO:tasks.workunit.client.0.smithi046.stdout:2/631: chown d5/d6/d13/l29 679 1 2024-02-19T19:08:29.813 INFO:tasks.workunit.client.0.smithi046.stdout:0/572: mknod d0/d19/d8/d37/d58/cc8 0 2024-02-19T19:08:29.813 INFO:tasks.workunit.client.0.smithi046.stdout:0/573: fdatasync d0/d24/f8b 0 2024-02-19T19:08:29.814 INFO:tasks.workunit.client.0.smithi046.stdout:9/326: unlink db/lf 0 2024-02-19T19:08:29.815 INFO:tasks.workunit.client.0.smithi046.stdout:2/632: creat d5/d6/d13/d7c/d90/fc7 x:0 0 0 2024-02-19T19:08:29.815 INFO:tasks.workunit.client.0.smithi046.stdout:2/633: fdatasync d5/d6/f23 0 2024-02-19T19:08:29.815 INFO:tasks.workunit.client.0.smithi046.stdout:2/634: creat d5/d6/d13/d7c/fc8 x:0 0 0 2024-02-19T19:08:29.822 INFO:tasks.workunit.client.0.smithi046.stdout:6/458: dwrite d4/d6/dd/d10/d29/d2d/d35/f4f [4194304,4194304] 0 2024-02-19T19:08:29.822 INFO:tasks.workunit.client.0.smithi046.stdout:6/459: chown d4 1359769 1 2024-02-19T19:08:29.828 INFO:tasks.workunit.client.0.smithi046.stdout:8/626: dread d3/d37/d64/f6c [0,4194304] 0 2024-02-19T19:08:29.839 INFO:tasks.workunit.client.0.smithi046.stdout:0/574: dwrite d0/d19/f8e [0,4194304] 0 2024-02-19T19:08:29.839 INFO:tasks.workunit.client.0.smithi046.stdout:2/635: dwrite d5/d6a/f8c [0,4194304] 0 2024-02-19T19:08:29.967 INFO:tasks.workunit.client.0.smithi046.stdout:6/460: truncate d4/d6/f4c 2834440 0 2024-02-19T19:08:29.971 INFO:tasks.workunit.client.0.smithi046.stdout:8/627: mkdir d3/d37/d64/da2/d3c/dd9 0 2024-02-19T19:08:29.976 INFO:tasks.workunit.client.0.smithi046.stdout:0/575: rename d0/f1c to d0/d24/d56/da3/fc9 0 2024-02-19T19:08:29.976 INFO:tasks.workunit.client.0.smithi046.stdout:0/576: read d0/d24/f39 [942487,18556] 0 2024-02-19T19:08:29.979 INFO:tasks.workunit.client.0.smithi046.stdout:2/636: truncate f1 1843116 0 2024-02-19T19:08:29.982 INFO:tasks.workunit.client.0.smithi046.stdout:6/461: stat d4/d6/d1c/c69 0 2024-02-19T19:08:29.982 INFO:tasks.workunit.client.0.smithi046.stdout:6/462: truncate d4/d6/dd/f83 841978 0 2024-02-19T19:08:29.982 INFO:tasks.workunit.client.0.smithi046.stdout:6/463: chown d4/d6/dd/d10/d29 5372570 1 2024-02-19T19:08:29.984 INFO:tasks.workunit.client.0.smithi046.stdout:8/628: mkdir d3/dd/d13/d42/dda 0 2024-02-19T19:08:29.985 INFO:tasks.workunit.client.0.smithi046.stdout:0/577: getdents d0/d19/d8 0 2024-02-19T19:08:29.985 INFO:tasks.workunit.client.0.smithi046.stdout:0/578: creat d0/d24/d8c/fca x:0 0 0 2024-02-19T19:08:29.985 INFO:tasks.workunit.client.0.smithi046.stdout:0/579: chown d0/d24/d56/da3/faf 388977 1 2024-02-19T19:08:29.986 INFO:tasks.workunit.client.0.smithi046.stdout:7/603: sync 2024-02-19T19:08:29.987 INFO:tasks.workunit.client.0.smithi046.stdout:2/637: link d5/d2c/d35/d80/f87 d5/d2c/d89/d3f/d82/fc9 0 2024-02-19T19:08:29.989 INFO:tasks.workunit.client.0.smithi046.stdout:6/464: mkdir d4/d6/d1c/d94 0 2024-02-19T19:08:29.990 INFO:tasks.workunit.client.0.smithi046.stdout:8/629: truncate d3/dd/d3f/d49/d53/f5e 206638 0 2024-02-19T19:08:29.991 INFO:tasks.workunit.client.0.smithi046.stdout:8/630: dread d3/dd/d13/d6b/d46/d6a/f91 [0,4194304] 0 2024-02-19T19:08:29.992 INFO:tasks.workunit.client.0.smithi046.stdout:7/604: creat d0/d4/fbd x:0 0 0 2024-02-19T19:08:29.993 INFO:tasks.workunit.client.0.smithi046.stdout:2/638: mknod d5/d2c/d89/cca 0 2024-02-19T19:08:29.994 INFO:tasks.workunit.client.0.smithi046.stdout:6/465: symlink d4/d6/dd/d10/d29/d2d/d35/d66/l95 0 2024-02-19T19:08:29.995 INFO:tasks.workunit.client.0.smithi046.stdout:8/631: mknod d3/dd/d13/d6b/d46/cdb 0 2024-02-19T19:08:29.995 INFO:tasks.workunit.client.0.smithi046.stdout:0/580: write d0/d19/d8/f34 [3184438,8773] 0 2024-02-19T19:08:29.997 INFO:tasks.workunit.client.0.smithi046.stdout:2/639: mkdir d5/d2c/d45/d9b/dcb 0 2024-02-19T19:08:29.998 INFO:tasks.workunit.client.0.smithi046.stdout:6/466: mknod d4/d6/dd/d10/c96 0 2024-02-19T19:08:29.998 INFO:tasks.workunit.client.0.smithi046.stdout:6/467: write d4/f43 [1982037,69097] 0 2024-02-19T19:08:29.998 INFO:tasks.workunit.client.0.smithi046.stdout:6/468: chown d4/d6/dd/d10/d29/d2d/f7f 15 1 2024-02-19T19:08:29.998 INFO:tasks.workunit.client.0.smithi046.stdout:6/469: dread - d4/d6/dd/d10/f82 zero size 2024-02-19T19:08:29.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/470: fdatasync d4/d6/dd/d10/f15 0 2024-02-19T19:08:29.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/471: write d4/d6/d1c/f51 [4773980,55754] 0 2024-02-19T19:08:29.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/472: read - d4/d6/dd/f57 zero size 2024-02-19T19:08:29.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/473: chown d4/d6/l1b 265792497 1 2024-02-19T19:08:29.999 INFO:tasks.workunit.client.0.smithi046.stdout:7/605: getdents d0/d45/d4a/d78/d9d 0 2024-02-19T19:08:30.000 INFO:tasks.workunit.client.0.smithi046.stdout:7/606: write d0/d4/fbd [712839,9322] 0 2024-02-19T19:08:30.000 INFO:tasks.workunit.client.0.smithi046.stdout:7/607: read d0/d45/fa6 [190850,112206] 0 2024-02-19T19:08:30.000 INFO:tasks.workunit.client.0.smithi046.stdout:7/608: write d0/d3f/fba [286476,86323] 0 2024-02-19T19:08:30.000 INFO:tasks.workunit.client.0.smithi046.stdout:7/609: dread - d0/d45/d71/d41/fa8 zero size 2024-02-19T19:08:30.000 INFO:tasks.workunit.client.0.smithi046.stdout:0/581: creat d0/d19/d4d/fcb x:0 0 0 2024-02-19T19:08:30.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/640: link d5/l26 d5/d2c/d89/lcc 0 2024-02-19T19:08:30.003 INFO:tasks.workunit.client.0.smithi046.stdout:6/474: link d4/d6/dd/d10/d29/d2d/d35/d3c/l3e d4/d6/l97 0 2024-02-19T19:08:30.004 INFO:tasks.workunit.client.0.smithi046.stdout:8/632: mkdir d3/dd/d13/d6b/ddc 0 2024-02-19T19:08:30.005 INFO:tasks.workunit.client.0.smithi046.stdout:7/610: mkdir d0/d45/d4a/d58/d60/dbe 0 2024-02-19T19:08:30.005 INFO:tasks.workunit.client.0.smithi046.stdout:7/611: read - d0/d45/d4a/d58/d60/fa9 zero size 2024-02-19T19:08:30.006 INFO:tasks.workunit.client.0.smithi046.stdout:7/612: write d0/d45/d4a/d58/f39 [683421,6231] 0 2024-02-19T19:08:30.008 INFO:tasks.workunit.client.0.smithi046.stdout:8/633: chown d3/dd/d13/d6b/c22 771 1 2024-02-19T19:08:30.008 INFO:tasks.workunit.client.0.smithi046.stdout:0/582: dread d0/d24/d5b/d7f/f95 [0,4194304] 0 2024-02-19T19:08:30.009 INFO:tasks.workunit.client.0.smithi046.stdout:6/475: getdents d4/d6/d1c 0 2024-02-19T19:08:30.011 INFO:tasks.workunit.client.0.smithi046.stdout:2/641: rmdir d5/d6/d13 39 2024-02-19T19:08:30.011 INFO:tasks.workunit.client.0.smithi046.stdout:2/642: fsync d5/d2c/d89/d3f/d5c/f9d 0 2024-02-19T19:08:30.013 INFO:tasks.workunit.client.0.smithi046.stdout:7/613: rename d0/l20 to d0/d4/d24/lbf 0 2024-02-19T19:08:30.015 INFO:tasks.workunit.client.0.smithi046.stdout:8/634: creat d3/dd/d13/d6b/ddc/fdd x:0 0 0 2024-02-19T19:08:30.015 INFO:tasks.workunit.client.0.smithi046.stdout:8/635: chown d3/dd/d13/d6b/d36 10349242 1 2024-02-19T19:08:30.016 INFO:tasks.workunit.client.0.smithi046.stdout:0/583: symlink d0/d19/db/lcc 0 2024-02-19T19:08:30.016 INFO:tasks.workunit.client.0.smithi046.stdout:0/584: creat d0/d24/d8c/fcd x:0 0 0 2024-02-19T19:08:30.016 INFO:tasks.workunit.client.0.smithi046.stdout:0/585: creat d0/d6c/fce x:0 0 0 2024-02-19T19:08:30.017 INFO:tasks.workunit.client.0.smithi046.stdout:2/643: mknod d5/d2c/d35/d80/ccd 0 2024-02-19T19:08:30.018 INFO:tasks.workunit.client.0.smithi046.stdout:7/614: creat d0/d45/d4a/d58/fc0 x:0 0 0 2024-02-19T19:08:30.021 INFO:tasks.workunit.client.0.smithi046.stdout:8/636: write d3/dd/d13/d6b/d46/d54/fb8 [2906597,120508] 0 2024-02-19T19:08:30.022 INFO:tasks.workunit.client.0.smithi046.stdout:6/476: mkdir d4/d6/d1c/d20/d98 0 2024-02-19T19:08:30.023 INFO:tasks.workunit.client.0.smithi046.stdout:2/644: creat d5/d2c/d35/fce x:0 0 0 2024-02-19T19:08:30.024 INFO:tasks.workunit.client.0.smithi046.stdout:8/637: symlink d3/d37/d64/d9a/lde 0 2024-02-19T19:08:30.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/477: dread d4/d6/dd/d10/d29/d2d/d35/d3c/f55 [0,4194304] 0 2024-02-19T19:08:30.026 INFO:tasks.workunit.client.0.smithi046.stdout:2/645: creat d5/d6/d13/fcf x:0 0 0 2024-02-19T19:08:30.026 INFO:tasks.workunit.client.0.smithi046.stdout:0/586: dread d0/d19/db/d6a/f9a [0,4194304] 0 2024-02-19T19:08:30.027 INFO:tasks.workunit.client.0.smithi046.stdout:2/646: mkdir d5/d2c/d89/d3f/d82/dd0 0 2024-02-19T19:08:30.028 INFO:tasks.workunit.client.0.smithi046.stdout:0/587: getdents d0/d5f/d65 0 2024-02-19T19:08:30.031 INFO:tasks.workunit.client.0.smithi046.stdout:6/478: mknod d4/d6/d1c/d20/c99 0 2024-02-19T19:08:30.033 INFO:tasks.workunit.client.0.smithi046.stdout:2/647: truncate d5/d2c/f73 329277 0 2024-02-19T19:08:30.033 INFO:tasks.workunit.client.0.smithi046.stdout:6/479: dread d4/d6/dd/f56 [0,4194304] 0 2024-02-19T19:08:30.036 INFO:tasks.workunit.client.0.smithi046.stdout:2/648: truncate d5/d2c/d89/f1a 6407607 0 2024-02-19T19:08:30.038 INFO:tasks.workunit.client.0.smithi046.stdout:0/588: truncate d0/d19/d8/f34 2956396 0 2024-02-19T19:08:30.039 INFO:tasks.workunit.client.0.smithi046.stdout:0/589: read d0/d19/f1a [320522,13056] 0 2024-02-19T19:08:30.039 INFO:tasks.workunit.client.0.smithi046.stdout:0/590: fsync d0/d19/d8/f99 0 2024-02-19T19:08:30.041 INFO:tasks.workunit.client.0.smithi046.stdout:8/638: dwrite d3/dd/f14 [0,4194304] 0 2024-02-19T19:08:30.041 INFO:tasks.workunit.client.0.smithi046.stdout:0/591: mknod d0/d19/db/ccf 0 2024-02-19T19:08:30.041 INFO:tasks.workunit.client.0.smithi046.stdout:0/592: chown d0/f52 3227577 1 2024-02-19T19:08:30.045 INFO:tasks.workunit.client.0.smithi046.stdout:6/480: write d4/d6/dd/f21 [8111812,8518] 0 2024-02-19T19:08:30.045 INFO:tasks.workunit.client.0.smithi046.stdout:6/481: chown d4/d6/dd/d10/d29/d2d/l34 0 1 2024-02-19T19:08:30.051 INFO:tasks.workunit.client.0.smithi046.stdout:6/482: mknod d4/d6/dd/d10/c9a 0 2024-02-19T19:08:30.051 INFO:tasks.workunit.client.0.smithi046.stdout:6/483: write d4/d6/dd/d10/d29/d2d/f47 [3723115,55871] 0 2024-02-19T19:08:30.053 INFO:tasks.workunit.client.0.smithi046.stdout:6/484: write d4/f43 [207563,99071] 0 2024-02-19T19:08:30.057 INFO:tasks.workunit.client.0.smithi046.stdout:8/639: dread d3/dd/d13/d6b/d46/f74 [0,4194304] 0 2024-02-19T19:08:30.059 INFO:tasks.workunit.client.0.smithi046.stdout:8/640: symlink d3/dd/d3f/d49/d5b/d5f/ldf 0 2024-02-19T19:08:30.062 INFO:tasks.workunit.client.0.smithi046.stdout:8/641: mkdir d3/d37/d64/de0 0 2024-02-19T19:08:30.062 INFO:tasks.workunit.client.0.smithi046.stdout:8/642: chown d3/dd/d13/d6b/lc9 172628224 1 2024-02-19T19:08:30.064 INFO:tasks.workunit.client.0.smithi046.stdout:8/643: creat d3/d37/dca/fe1 x:0 0 0 2024-02-19T19:08:30.064 INFO:tasks.workunit.client.0.smithi046.stdout:8/644: write d3/dd/d3f/d49/d5b/d5f/da0/fb3 [749140,93028] 0 2024-02-19T19:08:30.064 INFO:tasks.workunit.client.0.smithi046.stdout:8/645: fsync d3/d37/d64/f6c 0 2024-02-19T19:08:30.072 INFO:tasks.workunit.client.0.smithi046.stdout:5/555: sync 2024-02-19T19:08:30.073 INFO:tasks.workunit.client.0.smithi046.stdout:3/383: sync 2024-02-19T19:08:30.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/616: sync 2024-02-19T19:08:30.073 INFO:tasks.workunit.client.0.smithi046.stdout:3/384: chown da/d30 131 1 2024-02-19T19:08:30.073 INFO:tasks.workunit.client.0.smithi046.stdout:5/556: chown d2/dd/d29/d89 6294978 1 2024-02-19T19:08:30.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/617: write d6/d11/f35 [7632129,52640] 0 2024-02-19T19:08:30.073 INFO:tasks.workunit.client.0.smithi046.stdout:9/327: sync 2024-02-19T19:08:30.073 INFO:tasks.workunit.client.0.smithi046.stdout:1/514: sync 2024-02-19T19:08:30.075 INFO:tasks.workunit.client.0.smithi046.stdout:3/385: mknod da/c62 0 2024-02-19T19:08:30.075 INFO:tasks.workunit.client.0.smithi046.stdout:2/649: dwrite d5/d2c/d89/f1b [4194304,4194304] 0 2024-02-19T19:08:30.078 INFO:tasks.workunit.client.0.smithi046.stdout:4/618: creat d6/d15/d6e/dc5/fce x:0 0 0 2024-02-19T19:08:30.078 INFO:tasks.workunit.client.0.smithi046.stdout:6/485: dwrite d4/d6/d22/f7d [0,4194304] 0 2024-02-19T19:08:30.078 INFO:tasks.workunit.client.0.smithi046.stdout:6/486: creat d4/d6/d1c/d64/f9b x:0 0 0 2024-02-19T19:08:30.079 INFO:tasks.workunit.client.0.smithi046.stdout:6/487: dread - d4/f8f zero size 2024-02-19T19:08:30.081 INFO:tasks.workunit.client.0.smithi046.stdout:1/515: rmdir d5/d2f/d9f/d55/d81/d80/daf 39 2024-02-19T19:08:30.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:29 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 7008/44817 objects degraded (15.637%), 28 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:30.083 INFO:tasks.workunit.client.0.smithi046.stdout:3/386: mkdir da/d1d/d63 0 2024-02-19T19:08:30.083 INFO:tasks.workunit.client.0.smithi046.stdout:0/593: dwrite d0/d6c/fb5 [0,4194304] 0 2024-02-19T19:08:30.083 INFO:tasks.workunit.client.0.smithi046.stdout:0/594: write d0/d19/d4d/fb2 [259797,109718] 0 2024-02-19T19:08:30.083 INFO:tasks.workunit.client.0.smithi046.stdout:0/595: dread - d0/d19/d8/d37/f7d zero size 2024-02-19T19:08:30.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/619: symlink d6/d11/d26/lcf 0 2024-02-19T19:08:30.087 INFO:tasks.workunit.client.0.smithi046.stdout:8/646: dwrite d3/dd/d13/d6b/d46/d6a/f91 [0,4194304] 0 2024-02-19T19:08:30.087 INFO:tasks.workunit.client.0.smithi046.stdout:8/647: truncate d3/dd/d13/d6b/d36/fc4 81362 0 2024-02-19T19:08:30.087 INFO:tasks.workunit.client.0.smithi046.stdout:8/648: creat d3/d37/dca/fe2 x:0 0 0 2024-02-19T19:08:30.088 INFO:tasks.workunit.client.0.smithi046.stdout:2/650: write d5/d6/d13/f16 [3261147,82647] 0 2024-02-19T19:08:30.088 INFO:tasks.workunit.client.0.smithi046.stdout:2/651: write d5/d6/d13/d7c/fbc [903537,103152] 0 2024-02-19T19:08:30.089 INFO:tasks.workunit.client.0.smithi046.stdout:2/652: chown d5/d6/c47 12111354 1 2024-02-19T19:08:30.089 INFO:tasks.workunit.client.0.smithi046.stdout:2/653: write d5/d2c/f73 [564183,128046] 0 2024-02-19T19:08:30.090 INFO:tasks.workunit.client.0.smithi046.stdout:3/387: mkdir da/d1d/d63/d64 0 2024-02-19T19:08:30.093 INFO:tasks.workunit.client.0.smithi046.stdout:0/596: truncate d0/d19/d8/d37/f5d 3372277 0 2024-02-19T19:08:30.093 INFO:tasks.workunit.client.0.smithi046.stdout:0/597: write d0/d24/d8c/f94 [103428,31227] 0 2024-02-19T19:08:30.093 INFO:tasks.workunit.client.0.smithi046.stdout:0/598: truncate d0/d19/d4d/fb2 1413309 0 2024-02-19T19:08:30.097 INFO:tasks.workunit.client.0.smithi046.stdout:4/620: unlink d6/d11/d26/f57 0 2024-02-19T19:08:30.098 INFO:tasks.workunit.client.0.smithi046.stdout:2/654: symlink d5/d6/ld1 0 2024-02-19T19:08:30.106 INFO:tasks.workunit.client.0.smithi046.stdout:3/388: write da/d30/f57 [797419,15594] 0 2024-02-19T19:08:30.113 INFO:tasks.workunit.client.0.smithi046.stdout:8/649: dread d3/dd/d13/d6b/d46/d54/d8a/f99 [0,4194304] 0 2024-02-19T19:08:30.114 INFO:tasks.workunit.client.0.smithi046.stdout:8/650: truncate d3/dd/d13/f32 907238 0 2024-02-19T19:08:30.114 INFO:tasks.workunit.client.0.smithi046.stdout:8/651: chown d3/d37/d64/da2/d3c/f87 1645108497 1 2024-02-19T19:08:30.115 INFO:tasks.workunit.client.0.smithi046.stdout:8/652: unlink d3/f10 0 2024-02-19T19:08:30.115 INFO:tasks.workunit.client.0.smithi046.stdout:8/653: creat d3/d37/dca/fe3 x:0 0 0 2024-02-19T19:08:30.116 INFO:tasks.workunit.client.0.smithi046.stdout:5/557: dwrite d2/fb [0,4194304] 0 2024-02-19T19:08:30.116 INFO:tasks.workunit.client.0.smithi046.stdout:5/558: fdatasync d2/dd/f37 0 2024-02-19T19:08:30.117 INFO:tasks.workunit.client.0.smithi046.stdout:9/328: dwrite f2 [0,4194304] 0 2024-02-19T19:08:30.117 INFO:tasks.workunit.client.0.smithi046.stdout:9/329: creat db/d1e/d32/f61 x:0 0 0 2024-02-19T19:08:30.120 INFO:tasks.workunit.client.0.smithi046.stdout:6/488: dwrite d4/d6/f30 [0,4194304] 0 2024-02-19T19:08:30.121 INFO:tasks.workunit.client.0.smithi046.stdout:1/516: dwrite d5/d13/d35/d37/f6c [0,4194304] 0 2024-02-19T19:08:30.122 INFO:tasks.workunit.client.0.smithi046.stdout:8/654: rename d3/d37/d64/da2/d3c/db6/dc7 to d3/d37/d9b/de4 0 2024-02-19T19:08:30.122 INFO:tasks.workunit.client.0.smithi046.stdout:8/655: chown d3/d37/d64/la8 98571 1 2024-02-19T19:08:30.126 INFO:tasks.workunit.client.0.smithi046.stdout:2/655: dwrite d5/d2c/fa2 [0,4194304] 0 2024-02-19T19:08:30.133 INFO:tasks.workunit.client.0.smithi046.stdout:1/517: mkdir d5/d13/d35/d37/db0 0 2024-02-19T19:08:30.135 INFO:tasks.workunit.client.0.smithi046.stdout:2/656: dread d5/d2c/fa2 [4194304,4194304] 0 2024-02-19T19:08:30.139 INFO:tasks.workunit.client.0.smithi046.stdout:4/621: truncate d6/d11/f35 6534747 0 2024-02-19T19:08:30.140 INFO:tasks.workunit.client.0.smithi046.stdout:4/622: readlink d6/l45 0 2024-02-19T19:08:30.142 INFO:tasks.workunit.client.0.smithi046.stdout:3/389: dwrite da/d1d/d10/f50 [0,4194304] 0 2024-02-19T19:08:30.143 INFO:tasks.workunit.client.0.smithi046.stdout:8/656: dread d3/dd/d13/d42/f47 [0,4194304] 0 2024-02-19T19:08:30.145 INFO:tasks.workunit.client.0.smithi046.stdout:6/489: rename d4/d6/d1c/d20/c99 to d4/d6/d1c/d94/c9c 0 2024-02-19T19:08:30.145 INFO:tasks.workunit.client.0.smithi046.stdout:9/330: dwrite db/d1e/d32/f61 [0,4194304] 0 2024-02-19T19:08:30.148 INFO:tasks.workunit.client.0.smithi046.stdout:1/518: creat d5/d2f/d9f/d55/fb1 x:0 0 0 2024-02-19T19:08:30.148 INFO:tasks.workunit.client.0.smithi046.stdout:1/519: readlink d5/d2f/d9f/l51 0 2024-02-19T19:08:30.148 INFO:tasks.workunit.client.0.smithi046.stdout:2/657: creat d5/d2c/d45/d9b/dcb/fd2 x:0 0 0 2024-02-19T19:08:30.148 INFO:tasks.workunit.client.0.smithi046.stdout:2/658: creat d5/d2c/d35/fd3 x:0 0 0 2024-02-19T19:08:30.153 INFO:tasks.workunit.client.0.smithi046.stdout:0/599: dwrite d0/d19/d8/d37/f5d [0,4194304] 0 2024-02-19T19:08:30.153 INFO:tasks.workunit.client.0.smithi046.stdout:8/657: dread d3/d18/f33 [0,4194304] 0 2024-02-19T19:08:30.154 INFO:tasks.workunit.client.0.smithi046.stdout:5/559: dwrite d2/f28 [0,4194304] 0 2024-02-19T19:08:30.157 INFO:tasks.workunit.client.0.smithi046.stdout:4/623: dread d6/d11/d26/f9f [0,4194304] 0 2024-02-19T19:08:30.158 INFO:tasks.workunit.client.0.smithi046.stdout:2/659: symlink d5/d2c/d89/d3f/d5c/d9f/ld4 0 2024-02-19T19:08:30.159 INFO:tasks.workunit.client.0.smithi046.stdout:5/560: mknod d2/dd/d2f/d34/d5d/cb1 0 2024-02-19T19:08:30.160 INFO:tasks.workunit.client.0.smithi046.stdout:2/660: truncate d5/d2c/d35/d80/f96 906049 0 2024-02-19T19:08:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:5/561: creat d2/dd/d26/daa/fb2 x:0 0 0 2024-02-19T19:08:30.165 INFO:tasks.workunit.client.0.smithi046.stdout:2/661: mkdir d5/d2c/d89/d3f/d5c/dd5 0 2024-02-19T19:08:30.165 INFO:tasks.workunit.client.0.smithi046.stdout:4/624: dread d6/d11/d26/d89/d8a/d55/f5d [0,4194304] 0 2024-02-19T19:08:30.166 INFO:tasks.workunit.client.0.smithi046.stdout:5/562: truncate d2/dd/d26/f2e 31167 0 2024-02-19T19:08:30.166 INFO:tasks.workunit.client.0.smithi046.stdout:5/563: write d2/dd/d2f/d34/f3e [4195133,77836] 0 2024-02-19T19:08:30.167 INFO:tasks.workunit.client.0.smithi046.stdout:5/564: chown d2/dd/d26 15007 1 2024-02-19T19:08:30.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/662: rename d5/d2c/d89/d3f/d82/f41 to d5/d2c/d45/dbf/fd6 0 2024-02-19T19:08:30.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/663: stat d5/d2c/d56/da5/da9 0 2024-02-19T19:08:30.170 INFO:tasks.workunit.client.0.smithi046.stdout:5/565: creat d2/dd/d29/d3b/fb3 x:0 0 0 2024-02-19T19:08:30.171 INFO:tasks.workunit.client.0.smithi046.stdout:2/664: mkdir d5/d6/dd7 0 2024-02-19T19:08:30.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/566: mknod d2/dd/d29/d3b/cb4 0 2024-02-19T19:08:30.174 INFO:tasks.workunit.client.0.smithi046.stdout:4/625: dread d6/d15/f5c [0,4194304] 0 2024-02-19T19:08:30.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/665: link d5/d2c/d56/da5/da9/fc0 d5/d2c/d89/d3f/d82/dd0/fd8 0 2024-02-19T19:08:30.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/666: dread - d5/d2c/faa zero size 2024-02-19T19:08:30.175 INFO:tasks.workunit.client.0.smithi046.stdout:6/490: dwrite d4/f26 [0,4194304] 0 2024-02-19T19:08:30.175 INFO:tasks.workunit.client.0.smithi046.stdout:6/491: fdatasync d4/d6/dd/d10/d29/d2d/f7f 0 2024-02-19T19:08:30.175 INFO:tasks.workunit.client.0.smithi046.stdout:0/600: dwrite d0/d19/d8/d37/f5d [0,4194304] 0 2024-02-19T19:08:30.176 INFO:tasks.workunit.client.0.smithi046.stdout:0/601: fsync d0/d19/d8/dc5/fc7 0 2024-02-19T19:08:30.176 INFO:tasks.workunit.client.0.smithi046.stdout:5/567: unlink d2/dd/c71 0 2024-02-19T19:08:30.176 INFO:tasks.workunit.client.0.smithi046.stdout:8/658: dwrite d3/d37/d64/f6c [0,4194304] 0 2024-02-19T19:08:30.177 INFO:tasks.workunit.client.0.smithi046.stdout:4/626: truncate d6/d15/d17/f3f 359160 0 2024-02-19T19:08:30.178 INFO:tasks.workunit.client.0.smithi046.stdout:2/667: symlink d5/d6/d6e/ld9 0 2024-02-19T19:08:30.179 INFO:tasks.workunit.client.0.smithi046.stdout:6/492: dread d4/f43 [0,4194304] 0 2024-02-19T19:08:30.179 INFO:tasks.workunit.client.0.smithi046.stdout:6/493: chown d4/d6/d1c/l65 0 1 2024-02-19T19:08:30.180 INFO:tasks.workunit.client.0.smithi046.stdout:6/494: stat d4/f73 0 2024-02-19T19:08:30.180 INFO:tasks.workunit.client.0.smithi046.stdout:6/495: chown d4/d6/d1c/c69 1 1 2024-02-19T19:08:30.180 INFO:tasks.workunit.client.0.smithi046.stdout:0/602: symlink d0/d5f/ld0 0 2024-02-19T19:08:30.181 INFO:tasks.workunit.client.0.smithi046.stdout:2/668: dread d5/d2c/f73 [0,4194304] 0 2024-02-19T19:08:30.181 INFO:tasks.workunit.client.0.smithi046.stdout:2/669: chown d5/d2c/d35/c4f 1983856566 1 2024-02-19T19:08:30.181 INFO:tasks.workunit.client.0.smithi046.stdout:2/670: write d5/d2c/f5f [4578244,67302] 0 2024-02-19T19:08:30.181 INFO:tasks.workunit.client.0.smithi046.stdout:8/659: truncate d3/d37/d64/da2/d3c/f3e 861804 0 2024-02-19T19:08:30.183 INFO:tasks.workunit.client.0.smithi046.stdout:6/496: rename d4/d6/d1c/d60/l78 to d4/d6/d22/l9d 0 2024-02-19T19:08:30.183 INFO:tasks.workunit.client.0.smithi046.stdout:6/497: write d4/f8f [732291,64825] 0 2024-02-19T19:08:30.184 INFO:tasks.workunit.client.0.smithi046.stdout:0/603: creat d0/d19/d8/fd1 x:0 0 0 2024-02-19T19:08:30.184 INFO:tasks.workunit.client.0.smithi046.stdout:0/604: stat d0/d19/db/lcc 0 2024-02-19T19:08:30.185 INFO:tasks.workunit.client.0.smithi046.stdout:6/498: dread d4/d6/d1c/d60/f85 [0,4194304] 0 2024-02-19T19:08:30.185 INFO:tasks.workunit.client.0.smithi046.stdout:6/499: fsync d4/d6/dd/d10/f86 0 2024-02-19T19:08:30.185 INFO:tasks.workunit.client.0.smithi046.stdout:2/671: mkdir d5/d2c/d89/d3f/d5c/d9f/dda 0 2024-02-19T19:08:30.185 INFO:tasks.workunit.client.0.smithi046.stdout:2/672: write d5/d2c/d89/fc3 [319201,112992] 0 2024-02-19T19:08:30.186 INFO:tasks.workunit.client.0.smithi046.stdout:8/660: truncate d3/d37/f2e 3002027 0 2024-02-19T19:08:30.186 INFO:tasks.workunit.client.0.smithi046.stdout:8/661: creat d3/dd/d3f/d49/d5b/fe5 x:0 0 0 2024-02-19T19:08:30.186 INFO:tasks.workunit.client.0.smithi046.stdout:8/662: write d3/d37/dca/fe3 [252416,13154] 0 2024-02-19T19:08:30.186 INFO:tasks.workunit.client.0.smithi046.stdout:8/663: fdatasync d3/dd/d13/d42/d72/f85 0 2024-02-19T19:08:30.187 INFO:tasks.workunit.client.0.smithi046.stdout:0/605: mkdir d0/dd2 0 2024-02-19T19:08:30.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/673: mknod d5/d6/d13/d7c/d90/cdb 0 2024-02-19T19:08:30.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/674: fdatasync d5/d2c/d89/d3f/d5c/f9d 0 2024-02-19T19:08:30.190 INFO:tasks.workunit.client.0.smithi046.stdout:8/664: symlink d3/d37/d64/da2/d3c/le6 0 2024-02-19T19:08:30.198 INFO:tasks.workunit.client.0.smithi046.stdout:2/675: read d5/f2a [7360695,112533] 0 2024-02-19T19:08:30.199 INFO:tasks.workunit.client.0.smithi046.stdout:2/676: readlink d5/d6/d13/l1c 0 2024-02-19T19:08:30.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:29 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 7008/44817 objects degraded (15.637%), 28 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:30.204 INFO:tasks.workunit.client.0.smithi046.stdout:6/500: dwrite d4/d6/d1c/d20/f6f [0,4194304] 0 2024-02-19T19:08:30.205 INFO:tasks.workunit.client.0.smithi046.stdout:6/501: symlink d4/d6/d8e/l9e 0 2024-02-19T19:08:30.206 INFO:tasks.workunit.client.0.smithi046.stdout:0/606: getdents d0/d19/d8 0 2024-02-19T19:08:30.208 INFO:tasks.workunit.client.0.smithi046.stdout:6/502: truncate d4/d6/dd/d10/d29/d2d/d35/f4f 5660668 0 2024-02-19T19:08:30.208 INFO:tasks.workunit.client.0.smithi046.stdout:6/503: creat d4/d6/d1c/d64/f9f x:0 0 0 2024-02-19T19:08:30.210 INFO:tasks.workunit.client.0.smithi046.stdout:0/607: unlink d0/d24/f23 0 2024-02-19T19:08:30.210 INFO:tasks.workunit.client.0.smithi046.stdout:8/665: dwrite d3/d37/d64/f7a [4194304,4194304] 0 2024-02-19T19:08:30.210 INFO:tasks.workunit.client.0.smithi046.stdout:8/666: fdatasync d3/dd/d13/d6b/d46/d54/f97 0 2024-02-19T19:08:30.210 INFO:tasks.workunit.client.0.smithi046.stdout:2/677: write d5/d6/d13/d7c/f94 [1106891,45317] 0 2024-02-19T19:08:30.211 INFO:tasks.workunit.client.0.smithi046.stdout:4/627: dwrite d6/d15/d17/f3f [0,4194304] 0 2024-02-19T19:08:30.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/504: creat d4/d6/d1c/d20/d7a/fa0 x:0 0 0 2024-02-19T19:08:30.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/505: fdatasync d4/d6/dd/d10/d29/d2d/d35/f3a 0 2024-02-19T19:08:30.213 INFO:tasks.workunit.client.0.smithi046.stdout:6/506: creat d4/d6/d1c/d64/fa1 x:0 0 0 2024-02-19T19:08:30.213 INFO:tasks.workunit.client.0.smithi046.stdout:6/507: readlink d4/d6/dd/d10/d29/l42 0 2024-02-19T19:08:30.213 INFO:tasks.workunit.client.0.smithi046.stdout:6/508: readlink d4/d6/d1c/d20/l32 0 2024-02-19T19:08:30.213 INFO:tasks.workunit.client.0.smithi046.stdout:0/608: truncate d0/d19/f6 1590538 0 2024-02-19T19:08:30.217 INFO:tasks.workunit.client.0.smithi046.stdout:8/667: mknod d3/dd/d13/d42/ce7 0 2024-02-19T19:08:30.219 INFO:tasks.workunit.client.0.smithi046.stdout:2/678: dread d5/d2c/d89/d4c/f70 [0,4194304] 0 2024-02-19T19:08:30.219 INFO:tasks.workunit.client.0.smithi046.stdout:2/679: truncate d5/d2c/d89/d3f/d5c/f9d 4591366 0 2024-02-19T19:08:30.225 INFO:tasks.workunit.client.0.smithi046.stdout:4/628: unlink d6/d15/d17/d4a/c98 0 2024-02-19T19:08:30.227 INFO:tasks.workunit.client.0.smithi046.stdout:6/509: unlink d4/d6/dd/d10/d29/d2d/d35/l63 0 2024-02-19T19:08:30.229 INFO:tasks.workunit.client.0.smithi046.stdout:8/668: unlink d3/d37/d64/da2/fd2 0 2024-02-19T19:08:30.230 INFO:tasks.workunit.client.0.smithi046.stdout:4/629: symlink d6/d15/d17/ld0 0 2024-02-19T19:08:30.230 INFO:tasks.workunit.client.0.smithi046.stdout:4/630: creat d6/d11/d26/dc3/fd1 x:0 0 0 2024-02-19T19:08:30.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/609: unlink d0/d24/d2f/d53/f61 0 2024-02-19T19:08:30.234 INFO:tasks.workunit.client.0.smithi046.stdout:8/669: truncate d3/d18/f1e 3877455 0 2024-02-19T19:08:30.234 INFO:tasks.workunit.client.0.smithi046.stdout:2/680: dwrite d5/d2c/d89/f1b [8388608,4194304] 0 2024-02-19T19:08:30.234 INFO:tasks.workunit.client.0.smithi046.stdout:2/681: creat d5/d2c/d35/d80/fdc x:0 0 0 2024-02-19T19:08:30.234 INFO:tasks.workunit.client.0.smithi046.stdout:2/682: truncate d5/d2c/d45/fbd 90349 0 2024-02-19T19:08:30.236 INFO:tasks.workunit.client.0.smithi046.stdout:4/631: mkdir d6/d11/d40/da7/dd2 0 2024-02-19T19:08:30.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/683: dread d5/d2c/d89/d3f/d82/fc9 [0,4194304] 0 2024-02-19T19:08:30.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/684: read - d5/d6/d13/d7c/d90/fc7 zero size 2024-02-19T19:08:30.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/610: rename d0/d19/d8/d37/d58/cc8 to d0/cd3 0 2024-02-19T19:08:30.241 INFO:tasks.workunit.client.0.smithi046.stdout:8/670: rename d3/dd to d3/dd/d13/de8 22 2024-02-19T19:08:30.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/611: mknod d0/d5f/d65/cd4 0 2024-02-19T19:08:30.244 INFO:tasks.workunit.client.0.smithi046.stdout:0/612: readlink d0/d24/d56/da1/l54 0 2024-02-19T19:08:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:6/510: dwrite d4/d6/dd/d10/d29/d2d/f7f [0,4194304] 0 2024-02-19T19:08:30.249 INFO:tasks.workunit.client.0.smithi046.stdout:4/632: read d6/d11/f68 [2297169,39034] 0 2024-02-19T19:08:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:0/613: dread d0/d24/d56/da3/fc9 [0,4194304] 0 2024-02-19T19:08:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:0/614: getdents d0/dd2 0 2024-02-19T19:08:30.250 INFO:tasks.workunit.client.0.smithi046.stdout:0/615: write d0/d24/d8c/fca [586264,117276] 0 2024-02-19T19:08:30.251 INFO:tasks.workunit.client.0.smithi046.stdout:0/616: fdatasync d0/d24/d2f/d53/d6b/fbf 0 2024-02-19T19:08:30.251 INFO:tasks.workunit.client.0.smithi046.stdout:0/617: write d0/d24/d2f/d53/d6b/f6e [1234644,120366] 0 2024-02-19T19:08:30.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/511: mkdir d4/d6/dd/d10/d29/da2 0 2024-02-19T19:08:30.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/512: chown d4/d6/dd/d10/d29/d2d/d35/d66/l92 17 1 2024-02-19T19:08:30.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/513: write d4/d6/dd/d10/f86 [2678664,30035] 0 2024-02-19T19:08:30.252 INFO:tasks.workunit.client.0.smithi046.stdout:0/618: unlink d0/d19/db/lcc 0 2024-02-19T19:08:30.254 INFO:tasks.workunit.client.0.smithi046.stdout:2/685: dwrite d5/d6/d13/d7c/fc8 [0,4194304] 0 2024-02-19T19:08:30.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/619: symlink d0/d19/d8/d37/ld5 0 2024-02-19T19:08:30.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/620: creat d0/d24/d56/fd6 x:0 0 0 2024-02-19T19:08:30.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/621: dread - d0/d6c/fce zero size 2024-02-19T19:08:30.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/622: read d0/d19/f1f [3363613,59435] 0 2024-02-19T19:08:30.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/623: write d0/d5f/f7e [664589,67054] 0 2024-02-19T19:08:30.260 INFO:tasks.workunit.client.0.smithi046.stdout:0/624: mknod d0/d24/d2f/cd7 0 2024-02-19T19:08:30.262 INFO:tasks.workunit.client.0.smithi046.stdout:2/686: dread d5/d2c/d89/f28 [0,4194304] 0 2024-02-19T19:08:30.262 INFO:tasks.workunit.client.0.smithi046.stdout:2/687: write d5/d2c/d89/f40 [2971710,124046] 0 2024-02-19T19:08:30.264 INFO:tasks.workunit.client.0.smithi046.stdout:2/688: dread d5/d2c/d35/f52 [0,4194304] 0 2024-02-19T19:08:30.267 INFO:tasks.workunit.client.0.smithi046.stdout:6/514: dread d4/d6/d22/f7d [0,4194304] 0 2024-02-19T19:08:30.267 INFO:tasks.workunit.client.0.smithi046.stdout:2/689: rmdir d5/d2c/d35 39 2024-02-19T19:08:30.267 INFO:tasks.workunit.client.0.smithi046.stdout:2/690: readlink d5/d2c/l46 0 2024-02-19T19:08:30.268 INFO:tasks.workunit.client.0.smithi046.stdout:6/515: dread d4/f39 [0,4194304] 0 2024-02-19T19:08:30.269 INFO:tasks.workunit.client.0.smithi046.stdout:2/691: creat d5/d2c/d89/d3f/d82/db6/dc6/fdd x:0 0 0 2024-02-19T19:08:30.269 INFO:tasks.workunit.client.0.smithi046.stdout:2/692: creat d5/d2c/d89/d4c/fde x:0 0 0 2024-02-19T19:08:30.270 INFO:tasks.workunit.client.0.smithi046.stdout:8/671: dwrite d3/dd/d13/d6b/d46/d6a/db2/fcf [0,4194304] 0 2024-02-19T19:08:30.271 INFO:tasks.workunit.client.0.smithi046.stdout:6/516: link d4/f26 d4/d6/fa3 0 2024-02-19T19:08:30.272 INFO:tasks.workunit.client.0.smithi046.stdout:6/517: creat d4/d6/d1c/d20/d7a/fa4 x:0 0 0 2024-02-19T19:08:30.272 INFO:tasks.workunit.client.0.smithi046.stdout:0/625: dread d0/d24/f2a [0,4194304] 0 2024-02-19T19:08:30.276 INFO:tasks.workunit.client.0.smithi046.stdout:0/626: getdents d0/d19/d8/d37/d40 0 2024-02-19T19:08:30.276 INFO:tasks.workunit.client.0.smithi046.stdout:0/627: chown d0/d19/d8/f22 0 1 2024-02-19T19:08:30.276 INFO:tasks.workunit.client.0.smithi046.stdout:0/628: chown d0/d19/d8/d37 12870868 1 2024-02-19T19:08:30.278 INFO:tasks.workunit.client.0.smithi046.stdout:0/629: rename d0/d19/d8/f22 to d0/d19/d4d/da5/fd8 0 2024-02-19T19:08:30.280 INFO:tasks.workunit.client.0.smithi046.stdout:2/693: dread d5/f2a [12582912,4194304] 0 2024-02-19T19:08:30.280 INFO:tasks.workunit.client.0.smithi046.stdout:2/694: creat d5/d2c/d89/d92/fdf x:0 0 0 2024-02-19T19:08:30.282 INFO:tasks.workunit.client.0.smithi046.stdout:2/695: mkdir d5/d2c/d45/d9b/dcb/de0 0 2024-02-19T19:08:30.283 INFO:tasks.workunit.client.0.smithi046.stdout:8/672: dread d3/dd/d13/d6b/d46/d54/d8a/f8c [0,4194304] 0 2024-02-19T19:08:30.285 INFO:tasks.workunit.client.0.smithi046.stdout:2/696: rename d5/d6a/f8c to d5/d2c/d56/fe1 0 2024-02-19T19:08:30.289 INFO:tasks.workunit.client.0.smithi046.stdout:4/633: dwrite d6/d11/d26/d89/faa [0,4194304] 0 2024-02-19T19:08:30.289 INFO:tasks.workunit.client.0.smithi046.stdout:4/634: chown d6/d11/d26/f60 220543 1 2024-02-19T19:08:30.289 INFO:tasks.workunit.client.0.smithi046.stdout:4/635: write d6/d15/d17/d1e/fb8 [426814,19347] 0 2024-02-19T19:08:30.291 INFO:tasks.workunit.client.0.smithi046.stdout:6/518: dwrite d4/d6/dd/d10/d29/d2d/f47 [4194304,4194304] 0 2024-02-19T19:08:30.294 INFO:tasks.workunit.client.0.smithi046.stdout:6/519: dread d4/f8f [0,4194304] 0 2024-02-19T19:08:30.296 INFO:tasks.workunit.client.0.smithi046.stdout:4/636: rename d6/d15/d6e to d6/dd3 0 2024-02-19T19:08:30.296 INFO:tasks.workunit.client.0.smithi046.stdout:4/637: dread - d6/d11/d26/d89/d8a/d55/d8e/fc2 zero size 2024-02-19T19:08:30.297 INFO:tasks.workunit.client.0.smithi046.stdout:8/673: dread d3/dd/d13/d6b/d46/d54/f61 [0,4194304] 0 2024-02-19T19:08:30.297 INFO:tasks.workunit.client.0.smithi046.stdout:6/520: rmdir d4/d6/d1c/d94 39 2024-02-19T19:08:30.299 INFO:tasks.workunit.client.0.smithi046.stdout:4/638: mkdir d6/d11/d40/da7/dd2/dd4 0 2024-02-19T19:08:30.301 INFO:tasks.workunit.client.0.smithi046.stdout:6/521: mkdir d4/d6/dd/d10/d29/d2d/d35/da5 0 2024-02-19T19:08:30.308 INFO:tasks.workunit.client.0.smithi046.stdout:0/630: dwrite d0/d24/d8c/fca [0,4194304] 0 2024-02-19T19:08:30.308 INFO:tasks.workunit.client.0.smithi046.stdout:0/631: write d0/d19/d8/dc5/fc7 [47826,113204] 0 2024-02-19T19:08:30.308 INFO:tasks.workunit.client.0.smithi046.stdout:0/632: truncate d0/d19/d4d/fcb 260824 0 2024-02-19T19:08:30.308 INFO:tasks.workunit.client.0.smithi046.stdout:0/633: chown d0/d19/d8/d37/d80 302213 1 2024-02-19T19:08:30.308 INFO:tasks.workunit.client.0.smithi046.stdout:2/697: dwrite d5/d2c/d89/d3f/da1/fc1 [0,4194304] 0 2024-02-19T19:08:30.311 INFO:tasks.workunit.client.0.smithi046.stdout:0/634: rename d0/d5f/d65/d79 to d0/d19/d8/d37/dd9 0 2024-02-19T19:08:30.312 INFO:tasks.workunit.client.0.smithi046.stdout:2/698: mknod d5/d6/d6e/ce2 0 2024-02-19T19:08:30.313 INFO:tasks.workunit.client.0.smithi046.stdout:2/699: rmdir d5/d2c/d56/da5 39 2024-02-19T19:08:30.314 INFO:tasks.workunit.client.0.smithi046.stdout:2/700: creat d5/d2c/d89/d3f/d5c/fe3 x:0 0 0 2024-02-19T19:08:30.315 INFO:tasks.workunit.client.0.smithi046.stdout:2/701: creat d5/d6/fe4 x:0 0 0 2024-02-19T19:08:30.315 INFO:tasks.workunit.client.0.smithi046.stdout:2/702: write d5/d6/fe4 [718,98311] 0 2024-02-19T19:08:30.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/635: dread d0/d24/d5b/fa9 [0,4194304] 0 2024-02-19T19:08:30.316 INFO:tasks.workunit.client.0.smithi046.stdout:2/703: dread d5/d2c/d35/f55 [0,4194304] 0 2024-02-19T19:08:30.316 INFO:tasks.workunit.client.0.smithi046.stdout:2/704: truncate d5/d2c/d89/d3f/d82/fc9 963271 0 2024-02-19T19:08:30.317 INFO:tasks.workunit.client.0.smithi046.stdout:2/705: rename d5/d2c/c33 to d5/d2c/d89/d3f/d82/db6/ce5 0 2024-02-19T19:08:30.317 INFO:tasks.workunit.client.0.smithi046.stdout:2/706: write d5/d2c/d89/fb1 [777247,61817] 0 2024-02-19T19:08:30.318 INFO:tasks.workunit.client.0.smithi046.stdout:2/707: creat d5/d2c/d89/d3f/d82/db6/fe6 x:0 0 0 2024-02-19T19:08:30.320 INFO:tasks.workunit.client.0.smithi046.stdout:0/636: dread d0/d19/f35 [0,4194304] 0 2024-02-19T19:08:30.320 INFO:tasks.workunit.client.0.smithi046.stdout:0/637: readlink d0/l68 0 2024-02-19T19:08:30.320 INFO:tasks.workunit.client.0.smithi046.stdout:0/638: mknod d0/d19/d8/d37/d85/cda 0 2024-02-19T19:08:30.321 INFO:tasks.workunit.client.0.smithi046.stdout:0/639: truncate d0/d19/d88/fbe 3698059 0 2024-02-19T19:08:30.323 INFO:tasks.workunit.client.0.smithi046.stdout:0/640: creat d0/d19/d4d/da5/da7/fdb x:0 0 0 2024-02-19T19:08:30.324 INFO:tasks.workunit.client.0.smithi046.stdout:0/641: mkdir d0/d5f/ddc 0 2024-02-19T19:08:30.324 INFO:tasks.workunit.client.0.smithi046.stdout:0/642: creat d0/d19/d4d/da5/da7/fdd x:0 0 0 2024-02-19T19:08:30.326 INFO:tasks.workunit.client.0.smithi046.stdout:8/674: dwrite d3/dd/f14 [4194304,4194304] 0 2024-02-19T19:08:30.326 INFO:tasks.workunit.client.0.smithi046.stdout:8/675: write d3/dd/d13/fbb [1430766,48488] 0 2024-02-19T19:08:30.326 INFO:tasks.workunit.client.0.smithi046.stdout:4/639: dwrite d6/d15/d17/d1e/f6d [0,4194304] 0 2024-02-19T19:08:30.329 INFO:tasks.workunit.client.0.smithi046.stdout:4/640: write d6/d15/d17/d1e/d25/fa6 [58146,123174] 0 2024-02-19T19:08:30.329 INFO:tasks.workunit.client.0.smithi046.stdout:4/641: chown d6/d11/d26/d89/d8a/d55/cbf 231 1 2024-02-19T19:08:30.332 INFO:tasks.workunit.client.0.smithi046.stdout:0/643: write d0/d19/f8e [4109600,1702] 0 2024-02-19T19:08:30.332 INFO:tasks.workunit.client.0.smithi046.stdout:0/644: creat d0/d24/d2f/d53/d6b/fde x:0 0 0 2024-02-19T19:08:30.332 INFO:tasks.workunit.client.0.smithi046.stdout:0/645: write d0/d19/d8/f34 [827191,57204] 0 2024-02-19T19:08:30.332 INFO:tasks.workunit.client.0.smithi046.stdout:0/646: chown d0/d24/d2f/d53/d6b/fde 4047 1 2024-02-19T19:08:30.332 INFO:tasks.workunit.client.0.smithi046.stdout:0/647: stat d0/d24/d56/da1/f41 0 2024-02-19T19:08:30.332 INFO:tasks.workunit.client.0.smithi046.stdout:0/648: stat d0/d24/d56/da3/fc9 0 2024-02-19T19:08:30.332 INFO:tasks.workunit.client.0.smithi046.stdout:7/615: sync 2024-02-19T19:08:30.335 INFO:tasks.workunit.client.0.smithi046.stdout:4/642: rename d6/d11/d26/d89/fbd to d6/d15/d17/d1e/d25/fd5 0 2024-02-19T19:08:30.337 INFO:tasks.workunit.client.0.smithi046.stdout:2/708: write d5/d2c/d56/fe1 [1861061,73253] 0 2024-02-19T19:08:30.338 INFO:tasks.workunit.client.0.smithi046.stdout:2/709: chown d5/d6/d6e 2664 1 2024-02-19T19:08:30.338 INFO:tasks.workunit.client.0.smithi046.stdout:7/616: symlink d0/d45/d4a/d58/d91/lc1 0 2024-02-19T19:08:30.338 INFO:tasks.workunit.client.0.smithi046.stdout:7/617: chown d0/d45/d4a 12 1 2024-02-19T19:08:30.345 INFO:tasks.workunit.client.0.smithi046.stdout:7/618: rename d0/la1 to d0/d45/d56/lc2 0 2024-02-19T19:08:30.347 INFO:tasks.workunit.client.0.smithi046.stdout:8/676: dwrite d3/d18/fd4 [0,4194304] 0 2024-02-19T19:08:30.347 INFO:tasks.workunit.client.0.smithi046.stdout:8/677: fdatasync d3/d9d/fc3 0 2024-02-19T19:08:30.351 INFO:tasks.workunit.client.0.smithi046.stdout:7/619: link d0/d45/d71/da3/f93 d0/d45/d4a/d78/d9d/fc3 0 2024-02-19T19:08:30.351 INFO:tasks.workunit.client.0.smithi046.stdout:7/620: fdatasync d0/d4/f29 0 2024-02-19T19:08:30.352 INFO:tasks.workunit.client.0.smithi046.stdout:7/621: creat d0/d4/d24/fc4 x:0 0 0 2024-02-19T19:08:30.352 INFO:tasks.workunit.client.0.smithi046.stdout:8/678: mkdir d3/d37/d9b/de9 0 2024-02-19T19:08:30.352 INFO:tasks.workunit.client.0.smithi046.stdout:8/679: chown d3/dd/d3f/d49 0 1 2024-02-19T19:08:30.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/649: dwrite d0/d19/d8/fd1 [0,4194304] 0 2024-02-19T19:08:30.357 INFO:tasks.workunit.client.0.smithi046.stdout:2/710: dwrite d5/d2c/d89/d3f/da1/fc1 [4194304,4194304] 0 2024-02-19T19:08:30.360 INFO:tasks.workunit.client.0.smithi046.stdout:8/680: symlink d3/d37/d64/d9a/lea 0 2024-02-19T19:08:30.360 INFO:tasks.workunit.client.0.smithi046.stdout:8/681: chown d3/dd/f15 225064919 1 2024-02-19T19:08:30.360 INFO:tasks.workunit.client.0.smithi046.stdout:4/643: rename d6/d11/d26 to d6/d11/dd6 0 2024-02-19T19:08:30.363 INFO:tasks.workunit.client.0.smithi046.stdout:0/650: rename d0/d24/d2f/d53/d6b/fde to d0/d19/db/d6a/fdf 0 2024-02-19T19:08:30.363 INFO:tasks.workunit.client.0.smithi046.stdout:0/651: read - d0/d6c/fce zero size 2024-02-19T19:08:30.363 INFO:tasks.workunit.client.0.smithi046.stdout:0/652: stat d0/d24/d56/da3/laa 0 2024-02-19T19:08:30.366 INFO:tasks.workunit.client.0.smithi046.stdout:2/711: mkdir d5/d2c/d45/de7 0 2024-02-19T19:08:30.366 INFO:tasks.workunit.client.0.smithi046.stdout:7/622: getdents d0/d45/d4a/d78 0 2024-02-19T19:08:30.368 INFO:tasks.workunit.client.0.smithi046.stdout:8/682: creat d3/dd/d3f/feb x:0 0 0 2024-02-19T19:08:30.369 INFO:tasks.workunit.client.0.smithi046.stdout:7/623: read d0/f18 [389206,58330] 0 2024-02-19T19:08:30.369 INFO:tasks.workunit.client.0.smithi046.stdout:4/644: rename d6/d15/c84 to d6/d11/dd6/cd7 0 2024-02-19T19:08:30.370 INFO:tasks.workunit.client.0.smithi046.stdout:4/645: chown d6/d11/d40/da7/dd2/dd4 2224 1 2024-02-19T19:08:30.370 INFO:tasks.workunit.client.0.smithi046.stdout:4/646: creat d6/d15/d17/d1e/fd8 x:0 0 0 2024-02-19T19:08:30.370 INFO:tasks.workunit.client.0.smithi046.stdout:0/653: mknod d0/d19/ce0 0 2024-02-19T19:08:30.371 INFO:tasks.workunit.client.0.smithi046.stdout:2/712: symlink d5/d2c/d45/de7/le8 0 2024-02-19T19:08:30.371 INFO:tasks.workunit.client.0.smithi046.stdout:8/683: mknod d3/d37/d64/da2/d3c/cec 0 2024-02-19T19:08:30.374 INFO:tasks.workunit.client.0.smithi046.stdout:0/654: symlink d0/d19/d8/le1 0 2024-02-19T19:08:30.375 INFO:tasks.workunit.client.0.smithi046.stdout:8/684: creat d3/dd/d3f/d49/d5b/d5f/da0/dd8/fed x:0 0 0 2024-02-19T19:08:30.377 INFO:tasks.workunit.client.0.smithi046.stdout:4/647: dread d6/d15/d17/d4a/f85 [0,4194304] 0 2024-02-19T19:08:30.378 INFO:tasks.workunit.client.0.smithi046.stdout:0/655: rename d0/d24/d56/da1/f41 to d0/d19/d8/d37/d58/fe2 0 2024-02-19T19:08:30.380 INFO:tasks.workunit.client.0.smithi046.stdout:8/685: getdents d3/dd/d13/d42 0 2024-02-19T19:08:30.380 INFO:tasks.workunit.client.0.smithi046.stdout:8/686: chown d3/d9d/fc2 13204545 1 2024-02-19T19:08:30.382 INFO:tasks.workunit.client.0.smithi046.stdout:4/648: mknod d6/d11/d40/da7/dd2/dd4/cd9 0 2024-02-19T19:08:30.383 INFO:tasks.workunit.client.0.smithi046.stdout:4/649: truncate d6/d11/dd6/d89/d8a/d8d/fb5 783702 0 2024-02-19T19:08:30.383 INFO:tasks.workunit.client.0.smithi046.stdout:2/713: dread d5/d2c/d89/d3f/d5c/f9d [0,4194304] 0 2024-02-19T19:08:30.384 INFO:tasks.workunit.client.0.smithi046.stdout:2/714: dread d5/d2c/d45/fb7 [0,4194304] 0 2024-02-19T19:08:30.384 INFO:tasks.workunit.client.0.smithi046.stdout:2/715: stat d5/d2c/d45/d9b/dcb/de0 0 2024-02-19T19:08:30.385 INFO:tasks.workunit.client.0.smithi046.stdout:2/716: creat d5/fe9 x:0 0 0 2024-02-19T19:08:30.385 INFO:tasks.workunit.client.0.smithi046.stdout:4/650: rmdir d6/dd3/dc5 39 2024-02-19T19:08:30.388 INFO:tasks.workunit.client.0.smithi046.stdout:0/656: rmdir d0/d24/d2f 39 2024-02-19T19:08:30.390 INFO:tasks.workunit.client.0.smithi046.stdout:2/717: symlink d5/d6a/lea 0 2024-02-19T19:08:30.392 INFO:tasks.workunit.client.0.smithi046.stdout:4/651: creat d6/d11/dd6/d89/d8a/d55/d8e/fda x:0 0 0 2024-02-19T19:08:30.392 INFO:tasks.workunit.client.0.smithi046.stdout:0/657: stat d0/d24/d5b/d7f/d9b/cbd 0 2024-02-19T19:08:30.393 INFO:tasks.workunit.client.0.smithi046.stdout:0/658: chown d0/d24/d56/da1/f28 1 1 2024-02-19T19:08:30.394 INFO:tasks.workunit.client.0.smithi046.stdout:2/718: symlink d5/d2c/d56/da5/leb 0 2024-02-19T19:08:30.395 INFO:tasks.workunit.client.0.smithi046.stdout:4/652: mkdir d6/d11/d40/ddb 0 2024-02-19T19:08:30.396 INFO:tasks.workunit.client.0.smithi046.stdout:2/719: link d5/d2c/d45/d9b/cad d5/d6/d13/d8a/cec 0 2024-02-19T19:08:30.397 INFO:tasks.workunit.client.0.smithi046.stdout:4/653: symlink d6/ldc 0 2024-02-19T19:08:30.397 INFO:tasks.workunit.client.0.smithi046.stdout:4/654: fsync d6/fa9 0 2024-02-19T19:08:30.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/659: mknod d0/d24/d2f/d53/ce3 0 2024-02-19T19:08:30.399 INFO:tasks.workunit.client.0.smithi046.stdout:4/655: mknod d6/d11/cdd 0 2024-02-19T19:08:30.399 INFO:tasks.workunit.client.0.smithi046.stdout:0/660: symlink d0/d19/d4d/le4 0 2024-02-19T19:08:30.400 INFO:tasks.workunit.client.0.smithi046.stdout:0/661: readlink d0/d19/l59 0 2024-02-19T19:08:30.402 INFO:tasks.workunit.client.0.smithi046.stdout:2/720: rmdir d5/d2c/d89 39 2024-02-19T19:08:30.402 INFO:tasks.workunit.client.0.smithi046.stdout:4/656: mkdir d6/d50/dde 0 2024-02-19T19:08:30.403 INFO:tasks.workunit.client.0.smithi046.stdout:4/657: mknod d6/d11/dd6/d89/d8a/d55/cdf 0 2024-02-19T19:08:30.409 INFO:tasks.workunit.client.0.smithi046.stdout:4/658: creat d6/d11/dd6/fe0 x:0 0 0 2024-02-19T19:08:30.409 INFO:tasks.workunit.client.0.smithi046.stdout:4/659: link d6/d11/dd6/f60 d6/d50/fe1 0 2024-02-19T19:08:30.409 INFO:tasks.workunit.client.0.smithi046.stdout:0/662: dread d0/d24/d2f/f46 [0,4194304] 0 2024-02-19T19:08:30.410 INFO:tasks.workunit.client.0.smithi046.stdout:0/663: read - d0/d19/d8/d37/d40/f83 zero size 2024-02-19T19:08:30.410 INFO:tasks.workunit.client.0.smithi046.stdout:0/664: truncate d0/d19/d8/d37/d80/f86 246278 0 2024-02-19T19:08:30.410 INFO:tasks.workunit.client.0.smithi046.stdout:2/721: write d5/d6/d13/d7c/f88 [2259243,5617] 0 2024-02-19T19:08:30.410 INFO:tasks.workunit.client.0.smithi046.stdout:0/665: unlink d0/d24/d2f/l3f 0 2024-02-19T19:08:30.410 INFO:tasks.workunit.client.0.smithi046.stdout:0/666: write d0/d24/d56/da3/fc9 [1163751,30193] 0 2024-02-19T19:08:30.410 INFO:tasks.workunit.client.0.smithi046.stdout:2/722: creat d5/d6/dd7/fed x:0 0 0 2024-02-19T19:08:30.411 INFO:tasks.workunit.client.0.smithi046.stdout:0/667: mknod d0/d19/d88/ce5 0 2024-02-19T19:08:30.412 INFO:tasks.workunit.client.0.smithi046.stdout:0/668: unlink d0/d19/d8/f34 0 2024-02-19T19:08:30.416 INFO:tasks.workunit.client.0.smithi046.stdout:0/669: creat d0/d19/d70/dba/fe6 x:0 0 0 2024-02-19T19:08:30.416 INFO:tasks.workunit.client.0.smithi046.stdout:7/624: dwrite d0/d4/d24/fc4 [0,4194304] 0 2024-02-19T19:08:30.416 INFO:tasks.workunit.client.0.smithi046.stdout:8/687: dwrite d3/dd/f58 [4194304,4194304] 0 2024-02-19T19:08:30.419 INFO:tasks.workunit.client.0.smithi046.stdout:7/625: creat d0/d4/d24/db9/fc5 x:0 0 0 2024-02-19T19:08:30.420 INFO:tasks.workunit.client.0.smithi046.stdout:8/688: unlink d3/d37/d64/d9a/lde 0 2024-02-19T19:08:30.420 INFO:tasks.workunit.client.0.smithi046.stdout:8/689: dread - d3/d9d/fc2 zero size 2024-02-19T19:08:30.422 INFO:tasks.workunit.client.0.smithi046.stdout:4/660: dread d6/d11/dd6/d89/d8a/d55/fa3 [0,4194304] 0 2024-02-19T19:08:30.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/690: mkdir d3/d37/d64/da2/dac/dee 0 2024-02-19T19:08:30.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/691: fsync d3/f7 0 2024-02-19T19:08:30.425 INFO:tasks.workunit.client.0.smithi046.stdout:7/626: getdents d0/d45/d71/d41 0 2024-02-19T19:08:30.427 INFO:tasks.workunit.client.0.smithi046.stdout:4/661: symlink d6/le2 0 2024-02-19T19:08:30.429 INFO:tasks.workunit.client.0.smithi046.stdout:2/723: dwrite d5/fe9 [0,4194304] 0 2024-02-19T19:08:30.430 INFO:tasks.workunit.client.0.smithi046.stdout:8/692: rename d3/dd/d13/d6b/d46/d54/ld7 to d3/d37/d9b/de4/lef 0 2024-02-19T19:08:30.432 INFO:tasks.workunit.client.0.smithi046.stdout:7/627: getdents d0 0 2024-02-19T19:08:30.433 INFO:tasks.workunit.client.0.smithi046.stdout:7/628: fdatasync d0/d45/d71/d41/d5f/f76 0 2024-02-19T19:08:30.433 INFO:tasks.workunit.client.0.smithi046.stdout:7/629: dread - d0/d45/d56/fb5 zero size 2024-02-19T19:08:30.435 INFO:tasks.workunit.client.0.smithi046.stdout:4/662: mkdir d6/d94/dab/de3 0 2024-02-19T19:08:30.435 INFO:tasks.workunit.client.0.smithi046.stdout:4/663: stat d6/d11/dd6/d89/d8a/f8c 0 2024-02-19T19:08:30.438 INFO:tasks.workunit.client.0.smithi046.stdout:0/670: dwrite d0/d19/d8/f99 [0,4194304] 0 2024-02-19T19:08:30.446 INFO:tasks.workunit.client.0.smithi046.stdout:2/724: truncate d5/d2c/d89/fb1 245455 0 2024-02-19T19:08:30.446 INFO:tasks.workunit.client.0.smithi046.stdout:2/725: chown d5/d2c/d89/d3f/d5c/d9f 133215 1 2024-02-19T19:08:30.449 INFO:tasks.workunit.client.0.smithi046.stdout:8/693: creat d3/dd/d13/d6b/d46/d6a/db2/ff0 x:0 0 0 2024-02-19T19:08:30.451 INFO:tasks.workunit.client.0.smithi046.stdout:4/664: rename d6/d15/d17/d1e/l3e to d6/d11/dd6/d89/le4 0 2024-02-19T19:08:30.451 INFO:tasks.workunit.client.0.smithi046.stdout:4/665: creat d6/d11/d40/fe5 x:0 0 0 2024-02-19T19:08:30.452 INFO:tasks.workunit.client.0.smithi046.stdout:0/671: mkdir d0/d19/db/de7 0 2024-02-19T19:08:30.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/726: mkdir d5/d2c/d89/d3f/d5c/dee 0 2024-02-19T19:08:30.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/727: write d5/d6/d13/fcf [585188,4214] 0 2024-02-19T19:08:30.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/728: fdatasync d5/d2c/d89/d4c/fde 0 2024-02-19T19:08:30.460 INFO:tasks.workunit.client.0.smithi046.stdout:0/672: symlink d0/d19/d88/le8 0 2024-02-19T19:08:30.460 INFO:tasks.workunit.client.0.smithi046.stdout:0/673: fdatasync d0/d19/d88/fbe 0 2024-02-19T19:08:30.460 INFO:tasks.workunit.client.0.smithi046.stdout:0/674: write d0/d24/d56/da3/fc9 [2207650,26912] 0 2024-02-19T19:08:30.460 INFO:tasks.workunit.client.0.smithi046.stdout:0/675: chown d0/d19/l59 22913 1 2024-02-19T19:08:30.461 INFO:tasks.workunit.client.0.smithi046.stdout:2/729: creat d5/d2c/d89/d4c/fef x:0 0 0 2024-02-19T19:08:30.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/676: mkdir d0/d19/d8/dc5/de9 0 2024-02-19T19:08:30.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/677: fdatasync d0/d19/f35 0 2024-02-19T19:08:30.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/678: truncate d0/d24/d56/da3/fc9 2458637 0 2024-02-19T19:08:30.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/679: read - d0/d24/d8c/fcd zero size 2024-02-19T19:08:30.465 INFO:tasks.workunit.client.0.smithi046.stdout:8/694: dwrite d3/f9 [0,4194304] 0 2024-02-19T19:08:30.470 INFO:tasks.workunit.client.0.smithi046.stdout:0/680: rename d0/d24/d56/fd6 to d0/d24/d8c/fea 0 2024-02-19T19:08:30.473 INFO:tasks.workunit.client.0.smithi046.stdout:0/681: mknod d0/d24/d5b/d7f/ceb 0 2024-02-19T19:08:30.473 INFO:tasks.workunit.client.0.smithi046.stdout:0/682: fdatasync d0/d24/d2f/dac/fc2 0 2024-02-19T19:08:30.474 INFO:tasks.workunit.client.0.smithi046.stdout:0/683: rmdir d0/d19/d4d/da5 39 2024-02-19T19:08:30.478 INFO:tasks.workunit.client.0.smithi046.stdout:3/390: sync 2024-02-19T19:08:30.478 INFO:tasks.workunit.client.0.smithi046.stdout:3/391: chown da/d30/c52 3512888 1 2024-02-19T19:08:30.483 INFO:tasks.workunit.client.0.smithi046.stdout:2/730: dwrite d5/d2c/d45/fbd [0,4194304] 0 2024-02-19T19:08:30.483 INFO:tasks.workunit.client.0.smithi046.stdout:2/731: fdatasync d5/d2c/d89/d3f/d82/db6/dc6/fdd 0 2024-02-19T19:08:30.483 INFO:tasks.workunit.client.0.smithi046.stdout:2/732: chown d5/d2c/d89/d3f/d5c/dee 41426965 1 2024-02-19T19:08:30.487 INFO:tasks.workunit.client.0.smithi046.stdout:2/733: mkdir d5/d7a/df0 0 2024-02-19T19:08:30.489 INFO:tasks.workunit.client.0.smithi046.stdout:2/734: mkdir d5/d2c/d89/d3f/d5c/d9f/dda/df1 0 2024-02-19T19:08:30.491 INFO:tasks.workunit.client.0.smithi046.stdout:2/735: mknod d5/d6/dd7/cf2 0 2024-02-19T19:08:30.493 INFO:tasks.workunit.client.0.smithi046.stdout:2/736: creat d5/d2c/d89/d92/ff3 x:0 0 0 2024-02-19T19:08:30.493 INFO:tasks.workunit.client.0.smithi046.stdout:0/684: dwrite d0/d19/d8/fd1 [0,4194304] 0 2024-02-19T19:08:30.495 INFO:tasks.workunit.client.0.smithi046.stdout:2/737: mkdir d5/d2c/d89/d3f/d82/df4 0 2024-02-19T19:08:30.498 INFO:tasks.workunit.client.0.smithi046.stdout:2/738: unlink d5/d2c/d89/c22 0 2024-02-19T19:08:30.507 INFO:tasks.workunit.client.0.smithi046.stdout:2/739: dread d5/d6/fd [0,4194304] 0 2024-02-19T19:08:30.507 INFO:tasks.workunit.client.0.smithi046.stdout:2/740: stat d5/d6/d6e/dab/fae 0 2024-02-19T19:08:30.559 INFO:tasks.workunit.client.0.smithi046.stdout:9/331: sync 2024-02-19T19:08:30.560 INFO:tasks.workunit.client.0.smithi046.stdout:1/520: sync 2024-02-19T19:08:30.560 INFO:tasks.workunit.client.0.smithi046.stdout:9/332: fsync db/d1e/d32/d47/f57 0 2024-02-19T19:08:30.560 INFO:tasks.workunit.client.0.smithi046.stdout:1/521: getdents d5/d2f/d9f/d3b/d4e/d91 0 2024-02-19T19:08:30.560 INFO:tasks.workunit.client.0.smithi046.stdout:1/522: truncate d5/d13/d35/f8b 1017795 0 2024-02-19T19:08:30.560 INFO:tasks.workunit.client.0.smithi046.stdout:9/333: rmdir db/d1e/d32/d38 39 2024-02-19T19:08:30.563 INFO:tasks.workunit.client.0.smithi046.stdout:1/523: rename d5/d2f/d9f/d3b/c8e to d5/d2f/d9f/d55/d81/cb2 0 2024-02-19T19:08:30.563 INFO:tasks.workunit.client.0.smithi046.stdout:1/524: dread - d5/d13/d35/d37/d64/fab zero size 2024-02-19T19:08:30.565 INFO:tasks.workunit.client.0.smithi046.stdout:9/334: rename db/d1e/c35 to db/d1e/d52/c62 0 2024-02-19T19:08:30.567 INFO:tasks.workunit.client.0.smithi046.stdout:9/335: link l9 db/d1e/d32/d38/l63 0 2024-02-19T19:08:30.575 INFO:tasks.workunit.client.0.smithi046.stdout:1/525: dwrite d5/d2f/d9f/d55/d81/f4b [4194304,4194304] 0 2024-02-19T19:08:30.577 INFO:tasks.workunit.client.0.smithi046.stdout:1/526: creat d5/fb3 x:0 0 0 2024-02-19T19:08:30.581 INFO:tasks.workunit.client.0.smithi046.stdout:1/527: getdents d5/d2f 0 2024-02-19T19:08:30.584 INFO:tasks.workunit.client.0.smithi046.stdout:1/528: rmdir d5/d2f/d9f/d55 39 2024-02-19T19:08:30.598 INFO:tasks.workunit.client.0.smithi046.stdout:1/529: dwrite d5/f17 [4194304,4194304] 0 2024-02-19T19:08:30.598 INFO:tasks.workunit.client.0.smithi046.stdout:1/530: truncate d5/d2f/d9f/d55/d81/d80/f88 98310 0 2024-02-19T19:08:30.598 INFO:tasks.workunit.client.0.smithi046.stdout:1/531: chown d5/d2f/d9f/d3b/d3c/d3f/c93 837 1 2024-02-19T19:08:30.601 INFO:tasks.workunit.client.0.smithi046.stdout:1/532: dread d5/fc [0,4194304] 0 2024-02-19T19:08:30.615 INFO:tasks.workunit.client.0.smithi046.stdout:1/533: dwrite d5/d13/f83 [0,4194304] 0 2024-02-19T19:08:30.615 INFO:tasks.workunit.client.0.smithi046.stdout:1/534: stat d5/d2f/d9f/d3b/la5 0 2024-02-19T19:08:30.636 INFO:tasks.workunit.client.0.smithi046.stdout:1/535: dwrite d5/d13/d35/d37/fa9 [0,4194304] 0 2024-02-19T19:08:30.657 INFO:tasks.workunit.client.0.smithi046.stdout:1/536: dwrite d5/d13/d35/d37/fa9 [0,4194304] 0 2024-02-19T19:08:31.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:30 smithi046 ceph-mon[88928]: pgmap v120: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 1.1 GiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 111 MiB/s rd, 133 MiB/s wr, 454 op/s; 6973/44469 objects degraded (15.681%) 2024-02-19T19:08:31.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:30 smithi142 ceph-mon[69118]: pgmap v120: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 1.1 GiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 111 MiB/s rd, 133 MiB/s wr, 454 op/s; 6973/44469 objects degraded (15.681%) 2024-02-19T19:08:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.262+0000 7fd3628ff700 1 -- 172.21.15.46:0/1764352572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd35c068540 msgr2=0x7fd35c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.262+0000 7fd3628ff700 1 --2- 172.21.15.46:0/1764352572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd35c068540 0x7fd35c0689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd350009910 tx=0x7fd350009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.262+0000 7fd3628ff700 1 -- 172.21.15.46:0/1764352572 shutdown_connections 2024-02-19T19:08:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.262+0000 7fd3628ff700 1 --2- 172.21.15.46:0/1764352572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd35c068540 0x7fd35c0689b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.262+0000 7fd3628ff700 1 --2- 172.21.15.46:0/1764352572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c1085b0 0x7fd35c108980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.262+0000 7fd3628ff700 1 -- 172.21.15.46:0/1764352572 >> 172.21.15.46:0/1764352572 conn(0x7fd35c075130 msgr2=0x7fd35c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.262+0000 7fd3628ff700 1 -- 172.21.15.46:0/1764352572 shutdown_connections 2024-02-19T19:08:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.262+0000 7fd3628ff700 1 -- 172.21.15.46:0/1764352572 wait complete. 2024-02-19T19:08:31.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.263+0000 7fd3628ff700 1 Processor -- start 2024-02-19T19:08:31.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.263+0000 7fd3628ff700 1 -- start start 2024-02-19T19:08:31.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.263+0000 7fd3628ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c068540 0x7fd35c1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.263+0000 7fd3628ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd35c1085b0 0x7fd35c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.263+0000 7fd3628ff700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c198cd0 con 0x7fd35c1085b0 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.263+0000 7fd3628ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c19ca60 con 0x7fd35c068540 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.263+0000 7fd35bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c068540 0x7fd35c1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.263+0000 7fd35bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c068540 0x7fd35c1980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:36202/0 (socket says 172.21.15.46:36202) 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.263+0000 7fd35bfff700 1 -- 172.21.15.46:0/1599995108 learned_addr learned my addr 172.21.15.46:0/1599995108 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd35b7fe700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd35c1085b0 0x7fd35c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd35bfff700 1 -- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd35c1085b0 msgr2=0x7fd35c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd35bfff700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd35c1085b0 0x7fd35c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd35bfff700 1 -- 172.21.15.46:0/1599995108 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500095f0 con 0x7fd35c068540 2024-02-19T19:08:31.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd35b7fe700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd35c1085b0 0x7fd35c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:08:31.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd35bfff700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c068540 0x7fd35c1980b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00e8f0 tx=0x7fd34c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:31.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd3597fa700 1 -- 172.21.15.46:0/1599995108 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd34c009790 con 0x7fd35c068540 2024-02-19T19:08:31.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd3628ff700 1 -- 172.21.15.46:0/1599995108 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35c19cd40 con 0x7fd35c068540 2024-02-19T19:08:31.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd3628ff700 1 -- 172.21.15.46:0/1599995108 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c19d290 con 0x7fd35c068540 2024-02-19T19:08:31.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd3597fa700 1 -- 172.21.15.46:0/1599995108 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd34c0044e0 con 0x7fd35c068540 2024-02-19T19:08:31.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.264+0000 7fd3597fa700 1 -- 172.21.15.46:0/1599995108 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd34c003e00 con 0x7fd35c068540 2024-02-19T19:08:31.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.265+0000 7fd3628ff700 1 -- 172.21.15.46:0/1599995108 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd348005320 con 0x7fd35c068540 2024-02-19T19:08:31.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.266+0000 7fd3597fa700 1 -- 172.21.15.46:0/1599995108 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd34c00cba0 con 0x7fd35c068540 2024-02-19T19:08:31.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.267+0000 7fd3597fa700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd34406d8a0 0x7fd34406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:31.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.267+0000 7fd35b7fe700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd34406d8a0 0x7fd34406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:31.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.267+0000 7fd3597fa700 1 -- 172.21.15.46:0/1599995108 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fd34c014070 con 0x7fd35c068540 2024-02-19T19:08:31.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.267+0000 7fd35b7fe700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd34406d8a0 0x7fd34406fd50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd350009fd0 tx=0x7fd350005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:31.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.271+0000 7fd3597fa700 1 -- 172.21.15.46:0/1599995108 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd34c057060 con 0x7fd35c068540 2024-02-19T19:08:31.341 INFO:tasks.workunit.client.0.smithi046.stdout:1/537: mknod d5/d2f/d9f/d3b/d4e/d91/cb4 0 2024-02-19T19:08:31.351 INFO:tasks.workunit.client.0.smithi046.stdout:1/538: unlink d5/d2f/d9f/c2c 0 2024-02-19T19:08:31.360 INFO:tasks.workunit.client.0.smithi046.stdout:1/539: dread d5/d13/f70 [0,4194304] 0 2024-02-19T19:08:31.360 INFO:tasks.workunit.client.0.smithi046.stdout:1/540: write d5/d13/d35/f94 [191943,72867] 0 2024-02-19T19:08:31.360 INFO:tasks.workunit.client.0.smithi046.stdout:1/541: write d5/d2f/d9f/d3b/d4e/f6e [223426,28592] 0 2024-02-19T19:08:31.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/542: mkdir d5/d2f/d9f/d55/d81/d80/daf/db5 0 2024-02-19T19:08:31.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/543: chown d5/d13/d35/f94 447475991 1 2024-02-19T19:08:31.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/544: dread - d5/fb3 zero size 2024-02-19T19:08:31.382 INFO:tasks.workunit.client.0.smithi046.stdout:8/695: sync 2024-02-19T19:08:31.382 INFO:tasks.workunit.client.0.smithi046.stdout:9/336: sync 2024-02-19T19:08:31.382 INFO:tasks.workunit.client.0.smithi046.stdout:8/696: readlink d3/dd/d13/d6b/d46/d6a/l83 0 2024-02-19T19:08:31.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/392: sync 2024-02-19T19:08:31.382 INFO:tasks.workunit.client.0.smithi046.stdout:4/666: sync 2024-02-19T19:08:31.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/393: dread - da/d30/d38/f61 zero size 2024-02-19T19:08:31.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/394: readlink da/d30/d38/l59 0 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:4/667: chown d6/d11/dd6/d89 582871 1 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:4/668: fsync d6/d11/dd6/d89/d8a/d55/f86 0 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:6/522: sync 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:6/523: chown d4/d6/dd/d10/d29/l7c 4435 1 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:4/669: write d6/d11/dd6/d89/f91 [745921,127451] 0 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:4/670: stat d6/d94 0 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:5/568: sync 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:4/671: read d6/d11/dd6/d89/d8a/d55/f5d [2744353,13957] 0 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:5/569: creat d2/dd/d26/daa/fb5 x:0 0 0 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:7/630: sync 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:5/570: read - d2/dd/d3f/faf zero size 2024-02-19T19:08:31.383 INFO:tasks.workunit.client.0.smithi046.stdout:0/685: sync 2024-02-19T19:08:31.384 INFO:tasks.workunit.client.0.smithi046.stdout:2/741: sync 2024-02-19T19:08:31.385 INFO:tasks.workunit.client.0.smithi046.stdout:9/337: getdents db/d53 0 2024-02-19T19:08:31.385 INFO:tasks.workunit.client.0.smithi046.stdout:8/697: mkdir d3/d37/df1 0 2024-02-19T19:08:31.385 INFO:tasks.workunit.client.0.smithi046.stdout:9/338: chown db/d1e/f22 54 1 2024-02-19T19:08:31.385 INFO:tasks.workunit.client.0.smithi046.stdout:3/395: mknod da/d1d/d63/d64/c65 0 2024-02-19T19:08:31.386 INFO:tasks.workunit.client.0.smithi046.stdout:8/698: dread d3/dd/d3f/d49/d5b/fbc [0,4194304] 0 2024-02-19T19:08:31.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/672: creat d6/d15/d17/d4a/fe6 x:0 0 0 2024-02-19T19:08:31.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/673: fdatasync d6/d15/d17/fca 0 2024-02-19T19:08:31.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/674: chown d6/d15/d17/d1e/d25/fd5 1 1 2024-02-19T19:08:31.390 INFO:tasks.workunit.client.0.smithi046.stdout:7/631: dread d0/d45/d4a/d58/d60/f89 [0,4194304] 0 2024-02-19T19:08:31.391 INFO:tasks.workunit.client.0.smithi046.stdout:0/686: creat d0/d6c/dc4/fec x:0 0 0 2024-02-19T19:08:31.392 INFO:tasks.workunit.client.0.smithi046.stdout:2/742: mknod d5/d7a/df0/cf5 0 2024-02-19T19:08:31.395 INFO:tasks.workunit.client.0.smithi046.stdout:3/396: unlink da/d30/d38/f61 0 2024-02-19T19:08:31.397 INFO:tasks.workunit.client.0.smithi046.stdout:7/632: getdents d0/d45/d4a/d58/d60/db4 0 2024-02-19T19:08:31.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/687: creat d0/d5f/d74/fed x:0 0 0 2024-02-19T19:08:31.398 INFO:tasks.workunit.client.0.smithi046.stdout:7/633: dread d0/d3f/fba [0,4194304] 0 2024-02-19T19:08:31.399 INFO:tasks.workunit.client.0.smithi046.stdout:6/524: dread d4/d6/f1a [0,4194304] 0 2024-02-19T19:08:31.399 INFO:tasks.workunit.client.0.smithi046.stdout:3/397: dread da/d30/d38/f3d [0,4194304] 0 2024-02-19T19:08:31.403 INFO:tasks.workunit.client.0.smithi046.stdout:8/699: read d3/d37/f2d [2444218,54984] 0 2024-02-19T19:08:31.408 INFO:tasks.workunit.client.0.smithi046.stdout:5/571: dwrite d2/dd/d29/d3b/d93/fae [4194304,4194304] 0 2024-02-19T19:08:31.458 INFO:tasks.workunit.client.0.smithi046.stdout:0/688: mknod d0/d24/d8c/cee 0 2024-02-19T19:08:31.458 INFO:tasks.workunit.client.0.smithi046.stdout:0/689: chown d0/d24/f32 21 1 2024-02-19T19:08:31.462 INFO:tasks.workunit.client.0.smithi046.stdout:7/634: rename d0/d4/d75 to d0/d45/d4a/d58/dc6 0 2024-02-19T19:08:31.462 INFO:tasks.workunit.client.0.smithi046.stdout:7/635: write d0/d45/d4a/d58/f39 [1355974,120428] 0 2024-02-19T19:08:31.462 INFO:tasks.workunit.client.0.smithi046.stdout:7/636: creat d0/d4/d24/fc7 x:0 0 0 2024-02-19T19:08:31.463 INFO:tasks.workunit.client.0.smithi046.stdout:3/398: mkdir da/d30/d38/d66 0 2024-02-19T19:08:31.467 INFO:tasks.workunit.client.0.smithi046.stdout:5/572: link d2/dd/d29/d3b/cb4 d2/d5e/cb6 0 2024-02-19T19:08:31.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/690: creat d0/d19/d8/d37/fef x:0 0 0 2024-02-19T19:08:31.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/691: write d0/d19/d8/d37/d40/f83 [20345,99226] 0 2024-02-19T19:08:31.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/692: stat d0/d5f 0 2024-02-19T19:08:31.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/700: rename d3/d18/l94 to d3/dd/d13/d6b/d46/d54/lf2 0 2024-02-19T19:08:31.474 INFO:tasks.workunit.client.0.smithi046.stdout:7/637: creat d0/fc8 x:0 0 0 2024-02-19T19:08:31.475 INFO:tasks.workunit.client.0.smithi046.stdout:5/573: mknod d2/dd/d26/da9/cb7 0 2024-02-19T19:08:31.475 INFO:tasks.workunit.client.0.smithi046.stdout:5/574: fsync d2/dd/d26/f3d 0 2024-02-19T19:08:31.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/339: dwrite db/f18 [4194304,4194304] 0 2024-02-19T19:08:31.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/340: readlink db/d20/l5c 0 2024-02-19T19:08:31.476 INFO:tasks.workunit.client.0.smithi046.stdout:0/693: mkdir d0/d19/db/df0 0 2024-02-19T19:08:31.476 INFO:tasks.workunit.client.0.smithi046.stdout:0/694: write d0/d19/d8/d37/dd9/f93 [1969845,22617] 0 2024-02-19T19:08:31.478 INFO:tasks.workunit.client.0.smithi046.stdout:8/701: truncate d3/d37/d64/d9a/f9f 737010 0 2024-02-19T19:08:31.480 INFO:tasks.workunit.client.0.smithi046.stdout:7/638: rename d0/d45/d71/d41/d5f/l9a to d0/d45/d71/da3/lc9 0 2024-02-19T19:08:31.482 INFO:tasks.workunit.client.0.smithi046.stdout:9/341: unlink db/d1e/d32/d47/c4f 0 2024-02-19T19:08:31.482 INFO:tasks.workunit.client.0.smithi046.stdout:9/342: chown db/d1e/c50 832001796 1 2024-02-19T19:08:31.483 INFO:tasks.workunit.client.0.smithi046.stdout:0/695: truncate d0/d19/f8e 1319764 0 2024-02-19T19:08:31.485 INFO:tasks.workunit.client.0.smithi046.stdout:7/639: mknod d0/d45/d4a/d78/d9d/cca 0 2024-02-19T19:08:31.486 INFO:tasks.workunit.client.0.smithi046.stdout:6/525: dwrite d4/d6/dd/d10/d29/d2d/d35/f79 [0,4194304] 0 2024-02-19T19:08:31.486 INFO:tasks.workunit.client.0.smithi046.stdout:9/343: symlink db/d1e/l64 0 2024-02-19T19:08:31.486 INFO:tasks.workunit.client.0.smithi046.stdout:4/675: dwrite d6/d94/faf [4194304,4194304] 0 2024-02-19T19:08:31.487 INFO:tasks.workunit.client.0.smithi046.stdout:7/640: creat d0/d45/d4a/d58/d60/fcb x:0 0 0 2024-02-19T19:08:31.487 INFO:tasks.workunit.client.0.smithi046.stdout:7/641: dread - d0/d4/d7b/fab zero size 2024-02-19T19:08:31.490 INFO:tasks.workunit.client.0.smithi046.stdout:5/575: read d2/dd/d29/d3b/d93/fae [6751880,60082] 0 2024-02-19T19:08:31.490 INFO:tasks.workunit.client.0.smithi046.stdout:3/399: dwrite da/d1d/f60 [0,4194304] 0 2024-02-19T19:08:31.494 INFO:tasks.workunit.client.0.smithi046.stdout:0/696: fdatasync d0/d19/d8/d37/d40/f83 0 2024-02-19T19:08:31.496 INFO:tasks.workunit.client.0.smithi046.stdout:6/526: mknod d4/d6/d22/ca6 0 2024-02-19T19:08:31.496 INFO:tasks.workunit.client.0.smithi046.stdout:6/527: creat d4/d6/dd/d10/fa7 x:0 0 0 2024-02-19T19:08:31.496 INFO:tasks.workunit.client.0.smithi046.stdout:8/702: dwrite d3/d37/d64/da2/d3c/f3e [0,4194304] 0 2024-02-19T19:08:31.498 INFO:tasks.workunit.client.0.smithi046.stdout:9/344: creat db/d53/f65 x:0 0 0 2024-02-19T19:08:31.498 INFO:tasks.workunit.client.0.smithi046.stdout:9/345: write db/d20/f39 [557058,27349] 0 2024-02-19T19:08:31.501 INFO:tasks.workunit.client.0.smithi046.stdout:7/642: symlink d0/d45/d71/d41/lcc 0 2024-02-19T19:08:31.501 INFO:tasks.workunit.client.0.smithi046.stdout:7/643: write d0/d4/d7b/fab [783614,106983] 0 2024-02-19T19:08:31.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/576: mkdir d2/d27/d47/d54/db8 0 2024-02-19T19:08:31.507 INFO:tasks.workunit.client.0.smithi046.stdout:0/697: dread d0/d19/d8/d37/d58/fa4 [0,4194304] 0 2024-02-19T19:08:31.507 INFO:tasks.workunit.client.0.smithi046.stdout:3/400: creat da/d30/d38/d66/f67 x:0 0 0 2024-02-19T19:08:31.510 INFO:tasks.workunit.client.0.smithi046.stdout:4/676: dwrite d6/d94/faf [0,4194304] 0 2024-02-19T19:08:31.513 INFO:tasks.workunit.client.0.smithi046.stdout:7/644: dread d0/d45/d71/d41/db8/f97 [0,4194304] 0 2024-02-19T19:08:31.513 INFO:tasks.workunit.client.0.smithi046.stdout:7/645: readlink d0/d45/d4a/d58/l31 0 2024-02-19T19:08:31.513 INFO:tasks.workunit.client.0.smithi046.stdout:6/528: dwrite d4/d6/d1c/d64/f9b [0,4194304] 0 2024-02-19T19:08:31.513 INFO:tasks.workunit.client.0.smithi046.stdout:7/646: fdatasync d0/f48 0 2024-02-19T19:08:31.513 INFO:tasks.workunit.client.0.smithi046.stdout:7/647: chown d0/d45/fa6 6 1 2024-02-19T19:08:31.516 INFO:tasks.workunit.client.0.smithi046.stdout:8/703: mkdir d3/d8b/df3 0 2024-02-19T19:08:31.516 INFO:tasks.workunit.client.0.smithi046.stdout:8/704: readlink d3/dd/d13/d6b/d46/d6a/db2/lbd 0 2024-02-19T19:08:31.519 INFO:tasks.workunit.client.0.smithi046.stdout:9/346: truncate db/f1c 3043321 0 2024-02-19T19:08:31.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/577: creat d2/dd/d29/fb9 x:0 0 0 2024-02-19T19:08:31.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/578: write d2/f40 [1750395,13924] 0 2024-02-19T19:08:31.524 INFO:tasks.workunit.client.0.smithi046.stdout:7/648: dread d0/d45/d71/d41/d5f/fa4 [0,4194304] 0 2024-02-19T19:08:31.525 INFO:tasks.workunit.client.0.smithi046.stdout:0/698: mkdir d0/d19/d8/d37/dd9/df1 0 2024-02-19T19:08:31.525 INFO:tasks.workunit.client.0.smithi046.stdout:3/401: creat da/d1d/f68 x:0 0 0 2024-02-19T19:08:31.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/347: fsync db/d20/f39 0 2024-02-19T19:08:31.526 INFO:tasks.workunit.client.0.smithi046.stdout:0/699: read d0/d24/d5b/fa9 [52282,39542] 0 2024-02-19T19:08:31.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/348: creat db/d53/f66 x:0 0 0 2024-02-19T19:08:31.527 INFO:tasks.workunit.client.0.smithi046.stdout:4/677: mkdir d6/d11/d40/ddb/de7 0 2024-02-19T19:08:31.527 INFO:tasks.workunit.client.0.smithi046.stdout:4/678: truncate d6/f7f 1683452 0 2024-02-19T19:08:31.532 INFO:tasks.workunit.client.0.smithi046.stdout:6/529: creat d4/d6/dd/d10/d29/da2/fa8 x:0 0 0 2024-02-19T19:08:31.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/705: dwrite d3/dd/d13/d42/f57 [4194304,4194304] 0 2024-02-19T19:08:31.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/706: fdatasync d3/dd/d13/d42/f47 0 2024-02-19T19:08:31.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/707: stat d3/dd/d13/d6b/d36 0 2024-02-19T19:08:31.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/708: chown d3/fab 24655 1 2024-02-19T19:08:31.535 INFO:tasks.workunit.client.0.smithi046.stdout:5/579: write d2/d27/d4b/fb0 [972920,63222] 0 2024-02-19T19:08:31.535 INFO:tasks.workunit.client.0.smithi046.stdout:5/580: chown d2/dd/l86 0 1 2024-02-19T19:08:31.540 INFO:tasks.workunit.client.0.smithi046.stdout:0/700: stat d0/d19/db/d6a/c82 0 2024-02-19T19:08:31.540 INFO:tasks.workunit.client.0.smithi046.stdout:9/349: link db/d1e/d32/d38/l3e db/d53/l67 0 2024-02-19T19:08:31.540 INFO:tasks.workunit.client.0.smithi046.stdout:9/350: fsync f2 0 2024-02-19T19:08:31.541 INFO:tasks.workunit.client.0.smithi046.stdout:6/530: creat d4/d6/dd/d10/d29/fa9 x:0 0 0 2024-02-19T19:08:31.541 INFO:tasks.workunit.client.0.smithi046.stdout:6/531: write d4/f6a [2313234,30876] 0 2024-02-19T19:08:31.542 INFO:tasks.workunit.client.0.smithi046.stdout:8/709: mknod d3/cf4 0 2024-02-19T19:08:31.543 INFO:tasks.workunit.client.0.smithi046.stdout:4/679: dwrite d6/d11/dd6/f2e [4194304,4194304] 0 2024-02-19T19:08:31.545 INFO:tasks.workunit.client.0.smithi046.stdout:3/402: fsync da/d1d/f68 0 2024-02-19T19:08:31.549 INFO:tasks.workunit.client.0.smithi046.stdout:9/351: creat db/d1e/d32/d47/d5b/f68 x:0 0 0 2024-02-19T19:08:31.554 INFO:tasks.workunit.client.0.smithi046.stdout:6/532: creat d4/d6/faa x:0 0 0 2024-02-19T19:08:31.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/710: getdents d3/dd/d13/d6b/d46/d6a 0 2024-02-19T19:08:31.554 INFO:tasks.workunit.client.0.smithi046.stdout:5/581: write d2/dd/d29/d72/fa0 [3080017,76764] 0 2024-02-19T19:08:31.554 INFO:tasks.workunit.client.0.smithi046.stdout:7/649: dwrite d0/d45/d71/da3/f94 [0,4194304] 0 2024-02-19T19:08:31.556 INFO:tasks.workunit.client.0.smithi046.stdout:8/711: rename d3/dd/d13/d6b/d36 to d3/d37/d64/da2/df5 0 2024-02-19T19:08:31.565 INFO:tasks.workunit.client.0.smithi046.stdout:0/701: dwrite d0/d24/f8b [0,4194304] 0 2024-02-19T19:08:31.565 INFO:tasks.workunit.client.0.smithi046.stdout:5/582: dread d2/dd/f20 [4194304,4194304] 0 2024-02-19T19:08:31.568 INFO:tasks.workunit.client.0.smithi046.stdout:4/680: dwrite d6/d11/fc7 [0,4194304] 0 2024-02-19T19:08:31.570 INFO:tasks.workunit.client.0.smithi046.stdout:0/702: link d0/d24/f2a d0/d19/d4d/ff2 0 2024-02-19T19:08:31.576 INFO:tasks.workunit.client.0.smithi046.stdout:3/403: dwrite da/d30/f44 [0,4194304] 0 2024-02-19T19:08:31.578 INFO:tasks.workunit.client.0.smithi046.stdout:0/703: unlink d0/d24/d2f/cd7 0 2024-02-19T19:08:31.583 INFO:tasks.workunit.client.0.smithi046.stdout:0/704: unlink d0/d19/l29 0 2024-02-19T19:08:31.583 INFO:tasks.workunit.client.0.smithi046.stdout:0/705: chown d0/d19/d88/le8 1 1 2024-02-19T19:08:31.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/352: dwrite db/d53/f66 [0,4194304] 0 2024-02-19T19:08:31.584 INFO:tasks.workunit.client.0.smithi046.stdout:0/706: write d0/d19/d8/d37/d80/fb7 [708592,2834] 0 2024-02-19T19:08:31.584 INFO:tasks.workunit.client.0.smithi046.stdout:9/353: symlink db/d20/d4e/l69 0 2024-02-19T19:08:31.585 INFO:tasks.workunit.client.0.smithi046.stdout:9/354: chown db/d1e/d32 136354 1 2024-02-19T19:08:31.586 INFO:tasks.workunit.client.0.smithi046.stdout:0/707: creat d0/d5f/da8/ff3 x:0 0 0 2024-02-19T19:08:31.587 INFO:tasks.workunit.client.0.smithi046.stdout:9/355: creat db/d20/d4e/f6a x:0 0 0 2024-02-19T19:08:31.587 INFO:tasks.workunit.client.0.smithi046.stdout:9/356: dread - db/d1e/f49 zero size 2024-02-19T19:08:31.587 INFO:tasks.workunit.client.0.smithi046.stdout:5/583: write d2/dd/d2f/f41 [3864157,41827] 0 2024-02-19T19:08:31.588 INFO:tasks.workunit.client.0.smithi046.stdout:0/708: mknod d0/d19/d70/cf4 0 2024-02-19T19:08:31.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/709: symlink d0/dd2/lf5 0 2024-02-19T19:08:31.589 INFO:tasks.workunit.client.0.smithi046.stdout:8/712: dwrite d3/dd/d3f/d49/d5b/d5f/da0/dd8/fed [0,4194304] 0 2024-02-19T19:08:31.589 INFO:tasks.workunit.client.0.smithi046.stdout:7/650: dwrite d0/fc8 [0,4194304] 0 2024-02-19T19:08:31.589 INFO:tasks.workunit.client.0.smithi046.stdout:7/651: rename d0/d45/d4a/d58/d91 to d0/d45/d4a/d58/d91/dcd 22 2024-02-19T19:08:31.590 INFO:tasks.workunit.client.0.smithi046.stdout:4/681: dwrite d6/d11/dd6/dc3/fc4 [0,4194304] 0 2024-02-19T19:08:31.591 INFO:tasks.workunit.client.0.smithi046.stdout:7/652: write d0/d4/f3b [1395791,110237] 0 2024-02-19T19:08:31.594 INFO:tasks.workunit.client.0.smithi046.stdout:0/710: mkdir d0/d19/db/de7/df6 0 2024-02-19T19:08:31.595 INFO:tasks.workunit.client.0.smithi046.stdout:8/713: mknod d3/dd/d13/d6b/d46/d54/cf6 0 2024-02-19T19:08:31.599 INFO:tasks.workunit.client.0.smithi046.stdout:4/682: symlink d6/d11/dd6/d89/le8 0 2024-02-19T19:08:31.599 INFO:tasks.workunit.client.0.smithi046.stdout:3/404: dwrite da/d1d/f28 [0,4194304] 0 2024-02-19T19:08:31.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/653: creat d0/d45/d98/fce x:0 0 0 2024-02-19T19:08:31.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/654: write d0/d45/d4a/d58/d60/db4/f40 [225668,93848] 0 2024-02-19T19:08:31.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/655: fsync d0/d4/fbd 0 2024-02-19T19:08:31.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/656: readlink d0/d45/d71/d41/l53 0 2024-02-19T19:08:31.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/657: fsync d0/d45/d4a/d58/d91/fad 0 2024-02-19T19:08:31.600 INFO:tasks.workunit.client.0.smithi046.stdout:8/714: symlink d3/d37/d9b/lf7 0 2024-02-19T19:08:31.605 INFO:tasks.workunit.client.0.smithi046.stdout:7/658: symlink d0/d4/lcf 0 2024-02-19T19:08:31.606 INFO:tasks.workunit.client.0.smithi046.stdout:3/405: rmdir da/d1d 39 2024-02-19T19:08:31.608 INFO:tasks.workunit.client.0.smithi046.stdout:0/711: write d0/d19/d8/d37/f5d [610218,130340] 0 2024-02-19T19:08:31.608 INFO:tasks.workunit.client.0.smithi046.stdout:4/683: read d6/d15/d17/f3f [405607,23920] 0 2024-02-19T19:08:31.610 INFO:tasks.workunit.client.0.smithi046.stdout:9/357: dread db/f18 [0,4194304] 0 2024-02-19T19:08:31.610 INFO:tasks.workunit.client.0.smithi046.stdout:5/584: write d2/f2d [740561,38489] 0 2024-02-19T19:08:31.614 INFO:tasks.workunit.client.0.smithi046.stdout:3/406: dread da/d1d/d10/f1e [0,4194304] 0 2024-02-19T19:08:31.620 INFO:tasks.workunit.client.0.smithi046.stdout:7/659: rmdir d0 39 2024-02-19T19:08:31.620 INFO:tasks.workunit.client.0.smithi046.stdout:7/660: readlink d0/d45/d4a/d58/d60/db4/l25 0 2024-02-19T19:08:31.622 INFO:tasks.workunit.client.0.smithi046.stdout:7/661: mkdir d0/d45/d71/da3/dd0 0 2024-02-19T19:08:31.622 INFO:tasks.workunit.client.0.smithi046.stdout:7/662: chown d0/d4/f7 3196 1 2024-02-19T19:08:31.624 INFO:tasks.workunit.client.0.smithi046.stdout:7/663: mkdir d0/d45/d71/d41/db8/dd1 0 2024-02-19T19:08:31.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.606+0000 7fd3628ff700 1 -- 172.21.15.46:0/1599995108 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd348000bf0 con 0x7fd34406d8a0 2024-02-19T19:08:31.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.609+0000 7fd3597fa700 1 -- 172.21.15.46:0/1599995108 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd348000bf0 con 0x7fd34406d8a0 2024-02-19T19:08:31.634 INFO:tasks.workunit.client.0.smithi046.stdout:9/358: write db/f1c [475065,45693] 0 2024-02-19T19:08:31.634 INFO:tasks.workunit.client.0.smithi046.stdout:4/684: dwrite d6/d15/d17/d1e/d25/fd5 [0,4194304] 0 2024-02-19T19:08:31.635 INFO:tasks.workunit.client.0.smithi046.stdout:4/685: creat d6/d15/d17/fe9 x:0 0 0 2024-02-19T19:08:31.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.613+0000 7fd3628ff700 1 -- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd34406d8a0 msgr2=0x7fd34406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:31.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.613+0000 7fd3628ff700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd34406d8a0 0x7fd34406fd50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd350009fd0 tx=0x7fd350005a90 comp rx=0 tx=0).stop 2024-02-19T19:08:31.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.614+0000 7fd3628ff700 1 -- 172.21.15.46:0/1599995108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c068540 msgr2=0x7fd35c1980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:31.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.614+0000 7fd3628ff700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c068540 0x7fd35c1980b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00e8f0 tx=0x7fd34c00ecb0 comp rx=0 tx=0).stop 2024-02-19T19:08:31.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.614+0000 7fd3628ff700 1 -- 172.21.15.46:0/1599995108 shutdown_connections 2024-02-19T19:08:31.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.614+0000 7fd3628ff700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd34406d8a0 0x7fd34406fd50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:31.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.614+0000 7fd3628ff700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd35c068540 0x7fd35c1980b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:31.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.614+0000 7fd3628ff700 1 --2- 172.21.15.46:0/1599995108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd35c1085b0 0x7fd35c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:31.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.614+0000 7fd3628ff700 1 -- 172.21.15.46:0/1599995108 >> 172.21.15.46:0/1599995108 conn(0x7fd35c075130 msgr2=0x7fd35c106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:31.637 INFO:tasks.workunit.client.0.smithi046.stdout:9/359: dread db/f19 [0,4194304] 0 2024-02-19T19:08:31.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.615+0000 7fd3628ff700 1 -- 172.21.15.46:0/1599995108 shutdown_connections 2024-02-19T19:08:31.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.616+0000 7fd3628ff700 1 -- 172.21.15.46:0/1599995108 wait complete. 2024-02-19T19:08:31.647 INFO:tasks.workunit.client.0.smithi046.stdout:4/686: read d6/d11/dd6/f34 [2404376,109097] 0 2024-02-19T19:08:31.648 INFO:tasks.workunit.client.0.smithi046.stdout:4/687: readlink d6/d11/dd6/d89/d8a/l53 0 2024-02-19T19:08:31.648 INFO:tasks.workunit.client.0.smithi046.stdout:4/688: chown d6/d11/db9 53 1 2024-02-19T19:08:31.650 INFO:tasks.workunit.client.0.smithi046.stdout:3/407: dwrite da/d1d/d10/f50 [4194304,4194304] 0 2024-02-19T19:08:31.655 INFO:tasks.workunit.client.0.smithi046.stdout:0/712: dwrite d0/f7c [0,4194304] 0 2024-02-19T19:08:31.655 INFO:tasks.workunit.client.0.smithi046.stdout:5/585: dwrite d2/dd/d29/d3b/fb3 [0,4194304] 0 2024-02-19T19:08:31.655 INFO:tasks.workunit.client.0.smithi046.stdout:5/586: stat d2/f85 0 2024-02-19T19:08:31.657 INFO:tasks.workunit.client.0.smithi046.stdout:0/713: dread d0/d19/f1a [0,4194304] 0 2024-02-19T19:08:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:3/408: dread da/d30/f57 [0,4194304] 0 2024-02-19T19:08:31.662 INFO:tasks.workunit.client.0.smithi046.stdout:7/664: dwrite d0/f48 [0,4194304] 0 2024-02-19T19:08:31.668 INFO:tasks.workunit.client.0.smithi046.stdout:3/409: dread da/d1d/d10/f2b [0,4194304] 0 2024-02-19T19:08:31.669 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:08:31.669 INFO:tasks.workunit.client.0.smithi046.stdout:0/714: dread d0/d19/d8/f99 [0,4194304] 0 2024-02-19T19:08:31.711 INFO:tasks.workunit.client.0.smithi046.stdout:4/689: creat d6/dd3/db3/fea x:0 0 0 2024-02-19T19:08:31.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/665: link d0/d45/d4a/d58/d60/db4/f40 d0/d45/d4a/fd2 0 2024-02-19T19:08:31.745 INFO:tasks.workunit.client.0.smithi046.stdout:9/360: getdents db 0 2024-02-19T19:08:31.748 INFO:tasks.workunit.client.0.smithi046.stdout:0/715: symlink d0/d6c/dc4/lf7 0 2024-02-19T19:08:31.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/690: mkdir d6/d11/dd6/d89/d8a/deb 0 2024-02-19T19:08:31.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/691: stat d6/d15/d17/d1e/c54 0 2024-02-19T19:08:31.753 INFO:tasks.workunit.client.0.smithi046.stdout:5/587: truncate d2/dd/d26/f2e 245060 0 2024-02-19T19:08:31.755 INFO:tasks.workunit.client.0.smithi046.stdout:9/361: rename db/d1e/d32/d38 to db/d20/d6b 0 2024-02-19T19:08:31.756 INFO:tasks.workunit.client.0.smithi046.stdout:3/410: getdents da/d30/d38/d66 0 2024-02-19T19:08:31.758 INFO:tasks.workunit.client.0.smithi046.stdout:4/692: symlink d6/d15/d17/d1e/lec 0 2024-02-19T19:08:31.760 INFO:tasks.workunit.client.0.smithi046.stdout:5/588: mkdir d2/dd/d26/d65/d5f/dba 0 2024-02-19T19:08:31.760 INFO:tasks.workunit.client.0.smithi046.stdout:7/666: dwrite d0/d45/d4a/d58/f42 [0,4194304] 0 2024-02-19T19:08:31.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/362: getdents db/d1e 0 2024-02-19T19:08:31.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/363: write db/d20/f3c [271866,38422] 0 2024-02-19T19:08:31.766 INFO:tasks.workunit.client.0.smithi046.stdout:4/693: symlink d6/d50/led 0 2024-02-19T19:08:31.768 INFO:tasks.workunit.client.0.smithi046.stdout:5/589: mknod d2/dd/d2f/d34/cbb 0 2024-02-19T19:08:31.770 INFO:tasks.workunit.client.0.smithi046.stdout:7/667: truncate d0/d45/d71/d41/db8/f8a 3750476 0 2024-02-19T19:08:31.771 INFO:tasks.workunit.client.0.smithi046.stdout:7/668: truncate d0/d4/d24/db9/fc5 643719 0 2024-02-19T19:08:31.771 INFO:tasks.workunit.client.0.smithi046.stdout:7/669: chown d0/d45/d4a/fd2 322 1 2024-02-19T19:08:31.771 INFO:tasks.workunit.client.0.smithi046.stdout:7/670: write d0/d45/d56/f6a [3199935,87057] 0 2024-02-19T19:08:31.772 INFO:tasks.workunit.client.0.smithi046.stdout:9/364: mknod db/c6c 0 2024-02-19T19:08:31.773 INFO:tasks.workunit.client.0.smithi046.stdout:4/694: symlink d6/dd3/db3/lee 0 2024-02-19T19:08:31.773 INFO:tasks.workunit.client.0.smithi046.stdout:4/695: chown d6/d15/d17/d1e/d25/c83 3336922 1 2024-02-19T19:08:31.773 INFO:tasks.workunit.client.0.smithi046.stdout:4/696: dread - d6/d11/d92/f9e zero size 2024-02-19T19:08:31.774 INFO:tasks.workunit.client.0.smithi046.stdout:5/590: link d2/dd/d2f/d34/la1 d2/dd/d2f/lbc 0 2024-02-19T19:08:31.775 INFO:tasks.workunit.client.0.smithi046.stdout:9/365: unlink db/c6c 0 2024-02-19T19:08:31.775 INFO:tasks.workunit.client.0.smithi046.stdout:9/366: chown db/d1e/f27 3 1 2024-02-19T19:08:31.776 INFO:tasks.workunit.client.0.smithi046.stdout:0/716: rename d0/d5f/d74 to d0/d19/db/de7/df6/df8 0 2024-02-19T19:08:31.777 INFO:tasks.workunit.client.0.smithi046.stdout:5/591: link d2/d27/d4b/f8e d2/d27/d47/d54/d57/fbd 0 2024-02-19T19:08:31.778 INFO:tasks.workunit.client.0.smithi046.stdout:9/367: creat db/d1e/f6d x:0 0 0 2024-02-19T19:08:31.778 INFO:tasks.workunit.client.0.smithi046.stdout:9/368: write db/d1e/f49 [245927,46782] 0 2024-02-19T19:08:31.778 INFO:tasks.workunit.client.0.smithi046.stdout:3/411: rename da/d30/f53 to da/d30/d38/d66/f69 0 2024-02-19T19:08:31.779 INFO:tasks.workunit.client.0.smithi046.stdout:0/717: creat d0/d19/d8/d37/dd9/df1/ff9 x:0 0 0 2024-02-19T19:08:31.780 INFO:tasks.workunit.client.0.smithi046.stdout:5/592: creat d2/d27/d47/d7f/fbe x:0 0 0 2024-02-19T19:08:31.780 INFO:tasks.workunit.client.0.smithi046.stdout:9/369: creat db/d20/d6b/f6e x:0 0 0 2024-02-19T19:08:31.781 INFO:tasks.workunit.client.0.smithi046.stdout:4/697: dread d6/d15/f48 [0,4194304] 0 2024-02-19T19:08:31.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/671: rename d0/d3f to d0/d45/d4a/d58/dc6/d83/dd3 0 2024-02-19T19:08:31.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/672: dread - d0/d45/d71/da3/fb7 zero size 2024-02-19T19:08:31.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/673: chown d0/l86 650 1 2024-02-19T19:08:31.783 INFO:tasks.workunit.client.0.smithi046.stdout:3/412: creat da/d3b/f6a x:0 0 0 2024-02-19T19:08:31.783 INFO:tasks.workunit.client.0.smithi046.stdout:3/413: fdatasync da/d1d/d10/f58 0 2024-02-19T19:08:31.783 INFO:tasks.workunit.client.0.smithi046.stdout:3/414: readlink da/d30/d38/l59 0 2024-02-19T19:08:31.783 INFO:tasks.workunit.client.0.smithi046.stdout:0/718: mknod d0/d24/d8c/cfa 0 2024-02-19T19:08:31.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/593: mkdir d2/dd/d26/da9/dbf 0 2024-02-19T19:08:31.785 INFO:tasks.workunit.client.0.smithi046.stdout:9/370: unlink db/d1e/f6d 0 2024-02-19T19:08:31.786 INFO:tasks.workunit.client.0.smithi046.stdout:4/698: unlink d6/fa9 0 2024-02-19T19:08:31.786 INFO:tasks.workunit.client.0.smithi046.stdout:4/699: readlink d6/l67 0 2024-02-19T19:08:31.786 INFO:tasks.workunit.client.0.smithi046.stdout:4/700: dread - d6/d11/dd6/dc3/fd1 zero size 2024-02-19T19:08:31.787 INFO:tasks.workunit.client.0.smithi046.stdout:7/674: rmdir d0/d45/d4a/d58 39 2024-02-19T19:08:31.789 INFO:tasks.workunit.client.0.smithi046.stdout:3/415: rmdir da/d1d/d10 39 2024-02-19T19:08:31.789 INFO:tasks.workunit.client.0.smithi046.stdout:0/719: creat d0/d19/d8/dc5/ffb x:0 0 0 2024-02-19T19:08:31.789 INFO:tasks.workunit.client.0.smithi046.stdout:0/720: dread - d0/d6c/fce zero size 2024-02-19T19:08:31.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/594: mkdir d2/dd/d26/da9/dc0 0 2024-02-19T19:08:31.790 INFO:tasks.workunit.client.0.smithi046.stdout:4/701: stat d6/d15/d17/c51 0 2024-02-19T19:08:31.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/595: write d2/dd/d2f/d34/d5d/f43 [8939216,3502] 0 2024-02-19T19:08:31.792 INFO:tasks.workunit.client.0.smithi046.stdout:3/416: symlink da/d1d/l6b 0 2024-02-19T19:08:31.792 INFO:tasks.workunit.client.0.smithi046.stdout:3/417: truncate da/d3b/f6a 184199 0 2024-02-19T19:08:31.793 INFO:tasks.workunit.client.0.smithi046.stdout:0/721: unlink d0/d19/d4d/lc1 0 2024-02-19T19:08:31.794 INFO:tasks.workunit.client.0.smithi046.stdout:4/702: read d6/d15/d17/d1e/f7a [4773928,37583] 0 2024-02-19T19:08:31.799 INFO:tasks.workunit.client.0.smithi046.stdout:4/703: symlink d6/d11/d40/da7/dd2/lef 0 2024-02-19T19:08:31.799 INFO:tasks.workunit.client.0.smithi046.stdout:4/704: truncate d6/d15/d17/d1e/d25/fa6 270486 0 2024-02-19T19:08:31.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/722: rmdir d0/d24/d56 39 2024-02-19T19:08:31.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/723: fdatasync d0/f7c 0 2024-02-19T19:08:31.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/724: fdatasync d0/d19/d4d/fcb 0 2024-02-19T19:08:31.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/725: write d0/d24/d8c/fcd [416698,88603] 0 2024-02-19T19:08:31.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/726: write d0/d19/d4d/da5/da7/fdb [1027457,66072] 0 2024-02-19T19:08:31.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/727: write d0/d19/d8/d37/d40/f8f [707417,2895] 0 2024-02-19T19:08:31.801 INFO:tasks.workunit.client.0.smithi046.stdout:0/728: rename d0/d5f/d65 to d0/d24/d5b/d7f/dfc 0 2024-02-19T19:08:31.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/729: creat d0/d19/d8/d92/ffd x:0 0 0 2024-02-19T19:08:31.805 INFO:tasks.workunit.client.0.smithi046.stdout:0/730: creat d0/d19/d8/d37/ffe x:0 0 0 2024-02-19T19:08:31.807 INFO:tasks.workunit.client.0.smithi046.stdout:0/731: creat d0/d5f/ddc/fff x:0 0 0 2024-02-19T19:08:31.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.787+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/3658978505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fbc104130 msgr2=0x7f0fbc104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:31.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.787+0000 7f0fc2dc1700 1 --2- 172.21.15.46:0/3658978505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fbc104130 0x7f0fbc104500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009910 tx=0x7f0fac009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:31.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.787+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/3658978505 shutdown_connections 2024-02-19T19:08:31.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.787+0000 7f0fc2dc1700 1 --2- 172.21.15.46:0/3658978505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fbc0ffbd0 0x7f0fbc100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:31.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.787+0000 7f0fc2dc1700 1 --2- 172.21.15.46:0/3658978505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fbc104130 0x7f0fbc104500 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:31.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.787+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/3658978505 >> 172.21.15.46:0/3658978505 conn(0x7f0fbc075130 msgr2=0x7f0fbc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:31.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.787+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/3658978505 shutdown_connections 2024-02-19T19:08:31.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.788+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/3658978505 wait complete. 2024-02-19T19:08:31.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.789+0000 7f0fc2dc1700 1 Processor -- start 2024-02-19T19:08:31.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.789+0000 7f0fc2dc1700 1 -- start start 2024-02-19T19:08:31.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.789+0000 7f0fc2dc1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fbc0ffbd0 0x7f0fbc194a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:31.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.789+0000 7f0fc2dc1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fbc104130 0x7f0fbc194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:31.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.789+0000 7f0fc2dc1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc195500 con 0x7f0fbc104130 2024-02-19T19:08:31.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.789+0000 7f0fc2dc1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc195670 con 0x7f0fbc0ffbd0 2024-02-19T19:08:31.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.789+0000 7f0fbbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fbc104130 0x7f0fbc194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:31.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.789+0000 7f0fbbfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fbc104130 0x7f0fbc194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40192/0 (socket says 172.21.15.46:40192) 2024-02-19T19:08:31.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.789+0000 7f0fbbfff700 1 -- 172.21.15.46:0/1806347633 learned_addr learned my addr 172.21.15.46:0/1806347633 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:08:31.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.789+0000 7f0fc0b5d700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fbc0ffbd0 0x7f0fbc194a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:31.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.790+0000 7f0fbbfff700 1 -- 172.21.15.46:0/1806347633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fbc0ffbd0 msgr2=0x7f0fbc194a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:31.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.790+0000 7f0fbbfff700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fbc0ffbd0 0x7f0fbc194a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:31.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.790+0000 7f0fbbfff700 1 -- 172.21.15.46:0/1806347633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0095f0 con 0x7f0fbc104130 2024-02-19T19:08:31.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.790+0000 7f0fc0b5d700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fbc0ffbd0 0x7f0fbc194a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:08:31.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.790+0000 7f0fbbfff700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fbc104130 0x7f0fbc194fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000d8d0 tx=0x7f0fb000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.790+0000 7f0fb9ffb700 1 -- 172.21.15.46:0/1806347633 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fb0009940 con 0x7f0fbc104130 2024-02-19T19:08:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.791+0000 7f0fb9ffb700 1 -- 172.21.15.46:0/1806347633 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fb0010460 con 0x7f0fbc104130 2024-02-19T19:08:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.791+0000 7f0fb9ffb700 1 -- 172.21.15.46:0/1806347633 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fb000f5f0 con 0x7f0fbc104130 2024-02-19T19:08:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.791+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/1806347633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc1a20f0 con 0x7f0fbc104130 2024-02-19T19:08:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.791+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/1806347633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc1a2450 con 0x7f0fbc104130 2024-02-19T19:08:31.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.794+0000 7f0fb9ffb700 1 -- 172.21.15.46:0/1806347633 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0fb00105d0 con 0x7f0fbc104130 2024-02-19T19:08:31.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.794+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/1806347633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc1076a0 con 0x7f0fbc104130 2024-02-19T19:08:31.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.794+0000 7f0fb9ffb700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0fa406d8f0 0x7f0fa406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:31.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.795+0000 7f0fb9ffb700 1 -- 172.21.15.46:0/1806347633 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f0fb008d460 con 0x7f0fbc104130 2024-02-19T19:08:31.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.795+0000 7f0fc0b5d700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0fa406d8f0 0x7f0fa406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:31.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.795+0000 7f0fc0b5d700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0fa406d8f0 0x7f0fa406fda0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0fac006010 tx=0x7f0fac01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:31.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:31.802+0000 7f0fb9ffb700 1 -- 172.21.15.46:0/1806347633 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0fb005a760 con 0x7f0fbc104130 2024-02-19T19:08:31.824 INFO:tasks.workunit.client.0.smithi046.stdout:7/675: dwrite d0/d45/d4a/d58/f42 [0,4194304] 0 2024-02-19T19:08:31.835 INFO:tasks.workunit.client.0.smithi046.stdout:3/418: dwrite da/d1d/d3f/f55 [0,4194304] 0 2024-02-19T19:08:31.835 INFO:tasks.workunit.client.0.smithi046.stdout:5/596: dwrite d2/f70 [0,4194304] 0 2024-02-19T19:08:31.835 INFO:tasks.workunit.client.0.smithi046.stdout:4/705: dwrite d6/fb [0,4194304] 0 2024-02-19T19:08:31.836 INFO:tasks.workunit.client.0.smithi046.stdout:0/732: dwrite d0/d19/d4d/da5/da7/fdd [0,4194304] 0 2024-02-19T19:08:31.837 INFO:tasks.workunit.client.0.smithi046.stdout:3/419: mknod da/d1d/d10/c6c 0 2024-02-19T19:08:31.838 INFO:tasks.workunit.client.0.smithi046.stdout:5/597: creat d2/dd/d26/da9/fc1 x:0 0 0 2024-02-19T19:08:31.838 INFO:tasks.workunit.client.0.smithi046.stdout:5/598: write d2/dd/d3f/f7b [783439,45127] 0 2024-02-19T19:08:31.838 INFO:tasks.workunit.client.0.smithi046.stdout:5/599: write d2/dd/f36 [2117268,112009] 0 2024-02-19T19:08:31.839 INFO:tasks.workunit.client.0.smithi046.stdout:3/420: dread da/d1d/d10/f2b [0,4194304] 0 2024-02-19T19:08:31.839 INFO:tasks.workunit.client.0.smithi046.stdout:3/421: chown da/d1d/f28 219 1 2024-02-19T19:08:31.842 INFO:tasks.workunit.client.0.smithi046.stdout:7/676: dwrite d0/d4/f29 [0,4194304] 0 2024-02-19T19:08:31.843 INFO:tasks.workunit.client.0.smithi046.stdout:7/677: chown d0/d45/d71/da3/dd0 11979 1 2024-02-19T19:08:31.848 INFO:tasks.workunit.client.0.smithi046.stdout:0/733: mknod d0/d19/db/de7/df6/c100 0 2024-02-19T19:08:31.848 INFO:tasks.workunit.client.0.smithi046.stdout:0/734: chown d0/f18 6680178 1 2024-02-19T19:08:31.848 INFO:tasks.workunit.client.0.smithi046.stdout:0/735: write d0/d19/d8/d37/d58/fe2 [5236962,109601] 0 2024-02-19T19:08:31.850 INFO:tasks.workunit.client.0.smithi046.stdout:3/422: mknod da/d1d/d10/c6d 0 2024-02-19T19:08:31.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/678: unlink d0/d45/d4a/d78/d9d/fc3 0 2024-02-19T19:08:31.854 INFO:tasks.workunit.client.0.smithi046.stdout:7/679: mknod d0/d4/d7b/cd4 0 2024-02-19T19:08:31.854 INFO:tasks.workunit.client.0.smithi046.stdout:4/706: dread d6/dd3/db3/fb7 [0,4194304] 0 2024-02-19T19:08:31.854 INFO:tasks.workunit.client.0.smithi046.stdout:0/736: read d0/d19/d8/d37/d58/fe2 [479376,98841] 0 2024-02-19T19:08:31.855 INFO:tasks.workunit.client.0.smithi046.stdout:7/680: symlink d0/d45/d4a/d58/dc6/d83/dd3/ld5 0 2024-02-19T19:08:31.863 INFO:tasks.workunit.client.0.smithi046.stdout:5/600: dwrite d2/dd/d29/fb9 [0,4194304] 0 2024-02-19T19:08:31.866 INFO:tasks.workunit.client.0.smithi046.stdout:7/681: dread d0/d45/d4a/d58/d91/fad [0,4194304] 0 2024-02-19T19:08:31.868 INFO:tasks.workunit.client.0.smithi046.stdout:7/682: link d0/d45/d56/lc2 d0/d45/d98/ld6 0 2024-02-19T19:08:31.868 INFO:tasks.workunit.client.0.smithi046.stdout:7/683: write d0/d45/d71/f4c [1665079,100514] 0 2024-02-19T19:08:31.870 INFO:tasks.workunit.client.0.smithi046.stdout:7/684: creat d0/d45/d4a/d58/d60/dbe/fd7 x:0 0 0 2024-02-19T19:08:31.870 INFO:tasks.workunit.client.0.smithi046.stdout:7/685: rmdir d0 39 2024-02-19T19:08:31.871 INFO:tasks.workunit.client.0.smithi046.stdout:3/423: dwrite da/d3b/f6a [0,4194304] 0 2024-02-19T19:08:31.871 INFO:tasks.workunit.client.0.smithi046.stdout:0/737: dwrite d0/d24/d5b/d7f/dfc/f71 [0,4194304] 0 2024-02-19T19:08:31.871 INFO:tasks.workunit.client.0.smithi046.stdout:0/738: dread - d0/d19/d8/d37/d80/fc0 zero size 2024-02-19T19:08:31.871 INFO:tasks.workunit.client.0.smithi046.stdout:0/739: readlink d0/d19/d8/d37/d85/lb4 0 2024-02-19T19:08:31.872 INFO:tasks.workunit.client.0.smithi046.stdout:7/686: write d0/d4/d24/f51 [4455629,85101] 0 2024-02-19T19:08:31.876 INFO:tasks.workunit.client.0.smithi046.stdout:0/740: mkdir d0/d5f/d101 0 2024-02-19T19:08:31.876 INFO:tasks.workunit.client.0.smithi046.stdout:0/741: write d0/d19/d8/d37/d40/f8f [874962,28051] 0 2024-02-19T19:08:31.876 INFO:tasks.workunit.client.0.smithi046.stdout:0/742: chown d0/d6c/fb5 0 1 2024-02-19T19:08:31.877 INFO:tasks.workunit.client.0.smithi046.stdout:7/687: mknod d0/d45/d71/da3/dd0/cd8 0 2024-02-19T19:08:31.877 INFO:tasks.workunit.client.0.smithi046.stdout:7/688: chown d0/fc8 1944953 1 2024-02-19T19:08:31.877 INFO:tasks.workunit.client.0.smithi046.stdout:7/689: chown d0/d45/l46 28097453 1 2024-02-19T19:08:31.878 INFO:tasks.workunit.client.0.smithi046.stdout:5/601: dwrite d2/d27/d47/d7f/f8a [0,4194304] 0 2024-02-19T19:08:31.878 INFO:tasks.workunit.client.0.smithi046.stdout:5/602: readlink d2/d27/d4b/l97 0 2024-02-19T19:08:31.878 INFO:tasks.workunit.client.0.smithi046.stdout:0/743: link d0/d24/d56/da1/f28 d0/d19/d4d/da5/f102 0 2024-02-19T19:08:31.880 INFO:tasks.workunit.client.0.smithi046.stdout:7/690: creat d0/d45/d4a/d58/dc6/d83/fd9 x:0 0 0 2024-02-19T19:08:31.883 INFO:tasks.workunit.client.0.smithi046.stdout:5/603: mkdir d2/d27/d4b/dc2 0 2024-02-19T19:08:31.885 INFO:tasks.workunit.client.0.smithi046.stdout:7/691: creat d0/d4/d24/db9/fda x:0 0 0 2024-02-19T19:08:31.886 INFO:tasks.workunit.client.0.smithi046.stdout:7/692: creat d0/fdb x:0 0 0 2024-02-19T19:08:31.887 INFO:tasks.workunit.client.0.smithi046.stdout:0/744: write d0/d24/d8c/fca [1335518,92154] 0 2024-02-19T19:08:31.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/424: dwrite da/d30/f44 [4194304,4194304] 0 2024-02-19T19:08:31.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/425: truncate da/d30/d38/f56 327978 0 2024-02-19T19:08:31.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/426: chown c7 9464539 1 2024-02-19T19:08:31.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/427: truncate da/d30/d38/d66/f67 494088 0 2024-02-19T19:08:31.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/428: fdatasync da/d30/d38/d54/f5d 0 2024-02-19T19:08:31.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/429: chown da/c29 2 1 2024-02-19T19:08:31.890 INFO:tasks.workunit.client.0.smithi046.stdout:0/745: symlink d0/d24/d5b/d7f/d9b/l103 0 2024-02-19T19:08:31.893 INFO:tasks.workunit.client.0.smithi046.stdout:3/430: creat da/d1d/d10/f6e x:0 0 0 2024-02-19T19:08:31.894 INFO:tasks.workunit.client.0.smithi046.stdout:7/693: dread d0/d45/d4a/d58/d60/db4/f40 [0,4194304] 0 2024-02-19T19:08:31.894 INFO:tasks.workunit.client.0.smithi046.stdout:7/694: write d0/d45/d71/d4b/f61 [4844835,95633] 0 2024-02-19T19:08:31.894 INFO:tasks.workunit.client.0.smithi046.stdout:7/695: fdatasync d0/d45/d71/d4b/f57 0 2024-02-19T19:08:31.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/746: symlink d0/d19/d8/d37/d85/l104 0 2024-02-19T19:08:31.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/747: fdatasync d0/d5f/f7e 0 2024-02-19T19:08:31.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/748: chown d0/d24/d2f 103091 1 2024-02-19T19:08:31.896 INFO:tasks.workunit.client.0.smithi046.stdout:3/431: rename da/d3b/f6a to da/d30/d38/f6f 0 2024-02-19T19:08:31.897 INFO:tasks.workunit.client.0.smithi046.stdout:7/696: mkdir d0/d45/d4a/d58/d60/ddc 0 2024-02-19T19:08:31.900 INFO:tasks.workunit.client.0.smithi046.stdout:7/697: link d0/d45/d4a/d58/d91/lc1 d0/d45/d4a/d78/ldd 0 2024-02-19T19:08:31.903 INFO:tasks.workunit.client.0.smithi046.stdout:5/604: dwrite d2/d27/d4b/f8e [0,4194304] 0 2024-02-19T19:08:31.911 INFO:tasks.workunit.client.0.smithi046.stdout:0/749: dwrite d0/f7c [0,4194304] 0 2024-02-19T19:08:31.912 INFO:tasks.workunit.client.0.smithi046.stdout:0/750: fdatasync d0/d5f/da8/ff3 0 2024-02-19T19:08:31.912 INFO:tasks.workunit.client.0.smithi046.stdout:0/751: truncate d0/d6c/dc4/fec 715324 0 2024-02-19T19:08:31.912 INFO:tasks.workunit.client.0.smithi046.stdout:7/698: dread d0/d45/d4a/d58/dc6/d83/dd3/fb3 [0,4194304] 0 2024-02-19T19:08:31.914 INFO:tasks.workunit.client.0.smithi046.stdout:7/699: rename d0/d45/d71/d41/l53 to d0/d45/d71/lde 0 2024-02-19T19:08:31.916 INFO:tasks.workunit.client.0.smithi046.stdout:7/700: symlink d0/d45/d71/d4b/d8d/ldf 0 2024-02-19T19:08:31.918 INFO:tasks.workunit.client.0.smithi046.stdout:0/752: dread d0/d19/d4d/da5/f102 [0,4194304] 0 2024-02-19T19:08:31.918 INFO:tasks.workunit.client.0.smithi046.stdout:3/432: rmdir da/d3b 0 2024-02-19T19:08:31.919 INFO:tasks.workunit.client.0.smithi046.stdout:7/701: creat d0/d45/d4a/d78/fe0 x:0 0 0 2024-02-19T19:08:31.923 INFO:tasks.workunit.client.0.smithi046.stdout:3/433: mknod da/d30/d38/c70 0 2024-02-19T19:08:31.924 INFO:tasks.workunit.client.0.smithi046.stdout:5/605: dwrite d2/dd/d2f/d34/d5d/f61 [0,4194304] 0 2024-02-19T19:08:31.928 INFO:tasks.workunit.client.0.smithi046.stdout:5/606: link d2/d27/d4b/f8e d2/d27/d4b/dc2/fc3 0 2024-02-19T19:08:31.931 INFO:tasks.workunit.client.0.smithi046.stdout:3/434: dread da/d1d/f28 [0,4194304] 0 2024-02-19T19:08:31.932 INFO:tasks.workunit.client.0.smithi046.stdout:5/607: creat d2/d27/d47/d54/fc4 x:0 0 0 2024-02-19T19:08:31.933 INFO:tasks.workunit.client.0.smithi046.stdout:3/435: getdents da/d1d/d63/d64 0 2024-02-19T19:08:31.934 INFO:tasks.workunit.client.0.smithi046.stdout:5/608: creat d2/d27/d47/d54/db8/fc5 x:0 0 0 2024-02-19T19:08:31.934 INFO:tasks.workunit.client.0.smithi046.stdout:5/609: readlink d2/dd/l86 0 2024-02-19T19:08:31.934 INFO:tasks.workunit.client.0.smithi046.stdout:5/610: getdents d2/dd/d29/d3b/d93 0 2024-02-19T19:08:31.935 INFO:tasks.workunit.client.0.smithi046.stdout:3/436: symlink da/d1d/d63/d64/l71 0 2024-02-19T19:08:31.936 INFO:tasks.workunit.client.0.smithi046.stdout:7/702: dwrite d0/d45/d56/fb5 [0,4194304] 0 2024-02-19T19:08:31.936 INFO:tasks.workunit.client.0.smithi046.stdout:7/703: write d0/d45/d56/f9f [160504,81109] 0 2024-02-19T19:08:31.936 INFO:tasks.workunit.client.0.smithi046.stdout:7/704: readlink d0/d45/d98/ld6 0 2024-02-19T19:08:31.937 INFO:tasks.workunit.client.0.smithi046.stdout:5/611: rmdir d2/d27/d47/d54/d57 39 2024-02-19T19:08:31.937 INFO:tasks.workunit.client.0.smithi046.stdout:5/612: write d2/dd/f44 [1502740,89125] 0 2024-02-19T19:08:31.937 INFO:tasks.workunit.client.0.smithi046.stdout:5/613: chown d2/dd/f77 207773 1 2024-02-19T19:08:31.940 INFO:tasks.workunit.client.0.smithi046.stdout:3/437: mknod da/d1d/d63/d64/c72 0 2024-02-19T19:08:31.942 INFO:tasks.workunit.client.0.smithi046.stdout:3/438: symlink da/d30/l73 0 2024-02-19T19:08:31.944 INFO:tasks.workunit.client.0.smithi046.stdout:3/439: mkdir da/d1d/d63/d64/d74 0 2024-02-19T19:08:31.944 INFO:tasks.workunit.client.0.smithi046.stdout:3/440: creat da/d1d/d63/d64/d74/f75 x:0 0 0 2024-02-19T19:08:31.946 INFO:tasks.workunit.client.0.smithi046.stdout:3/441: rename da/f25 to da/d1d/d3f/f76 0 2024-02-19T19:08:31.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/442: symlink da/d1d/d63/d64/d74/l77 0 2024-02-19T19:08:31.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/443: write da/d1d/d10/f4c [5003023,30544] 0 2024-02-19T19:08:31.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/444: readlink da/d1d/d63/d64/d74/l77 0 2024-02-19T19:08:31.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/445: write da/f20 [654281,46713] 0 2024-02-19T19:08:31.961 INFO:tasks.workunit.client.0.smithi046.stdout:3/446: dwrite da/d1d/d10/f1e [0,4194304] 0 2024-02-19T19:08:31.962 INFO:tasks.workunit.client.0.smithi046.stdout:3/447: write da/f20 [1154803,51737] 0 2024-02-19T19:08:31.962 INFO:tasks.workunit.client.0.smithi046.stdout:3/448: fdatasync da/d1d/d10/f2e 0 2024-02-19T19:08:32.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.107+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/1806347633 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fbc195830 con 0x7f0fa406d8f0 2024-02-19T19:08:32.129 INFO:tasks.workunit.client.0.smithi046.stdout:1/545: sync 2024-02-19T19:08:32.129 INFO:tasks.workunit.client.0.smithi046.stdout:1/546: fsync d5/d13/f19 0 2024-02-19T19:08:32.129 INFO:tasks.workunit.client.0.smithi046.stdout:1/547: fsync d5/d2f/d9f/d3b/f52 0 2024-02-19T19:08:32.129 INFO:tasks.workunit.client.0.smithi046.stdout:1/548: stat d5/d13/d35/f41 0 2024-02-19T19:08:32.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.108+0000 7f0fb9ffb700 1 -- 172.21.15.46:0/1806347633 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0fbc195830 con 0x7f0fa406d8f0 2024-02-19T19:08:32.130 INFO:tasks.workunit.client.0.smithi046.stdout:1/549: dread d5/d2f/d9f/d55/d81/d80/f88 [0,4194304] 0 2024-02-19T19:08:32.131 INFO:tasks.workunit.client.0.smithi046.stdout:1/550: mknod d5/d2f/d9f/d3b/d3c/d3f/cb6 0 2024-02-19T19:08:32.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/1806347633 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0fa406d8f0 msgr2=0x7f0fa406fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:32.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0fa406d8f0 0x7f0fa406fda0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0fac006010 tx=0x7f0fac01a040 comp rx=0 tx=0).stop 2024-02-19T19:08:32.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/1806347633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fbc104130 msgr2=0x7f0fbc194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:32.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fbc104130 0x7f0fbc194fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000d8d0 tx=0x7f0fb000dc90 comp rx=0 tx=0).stop 2024-02-19T19:08:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/1806347633 shutdown_connections 2024-02-19T19:08:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0fa406d8f0 0x7f0fa406fda0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fbc0ffbd0 0x7f0fbc194a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 --2- 172.21.15.46:0/1806347633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fbc104130 0x7f0fbc194fc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/1806347633 >> 172.21.15.46:0/1806347633 conn(0x7f0fbc075130 msgr2=0x7f0fbc0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/1806347633 shutdown_connections 2024-02-19T19:08:32.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.113+0000 7f0fc2dc1700 1 -- 172.21.15.46:0/1806347633 wait complete. 2024-02-19T19:08:32.150 INFO:tasks.workunit.client.0.smithi046.stdout:1/551: dwrite d5/d21/faa [0,4194304] 0 2024-02-19T19:08:32.152 INFO:tasks.workunit.client.0.smithi046.stdout:1/552: symlink d5/d13/d35/d37/d64/d87/lb7 0 2024-02-19T19:08:32.160 INFO:tasks.workunit.client.0.smithi046.stdout:1/553: write d5/d13/d35/d37/fa9 [2545763,32358] 0 2024-02-19T19:08:32.161 INFO:tasks.workunit.client.0.smithi046.stdout:1/554: write d5/d13/d35/d37/d64/d75/f77 [725500,90285] 0 2024-02-19T19:08:32.161 INFO:tasks.workunit.client.0.smithi046.stdout:1/555: stat d5/d2f/d5e/f97 0 2024-02-19T19:08:32.161 INFO:tasks.workunit.client.0.smithi046.stdout:1/556: fsync d5/d13/d35/f9e 0 2024-02-19T19:08:32.177 INFO:tasks.workunit.client.0.smithi046.stdout:1/557: dwrite d5/d13/d35/d37/d64/fab [0,4194304] 0 2024-02-19T19:08:32.179 INFO:tasks.workunit.client.0.smithi046.stdout:1/558: rename d5/d2f/d9f/d55/d81/d80/daf/ca4 to d5/d2f/cb8 0 2024-02-19T19:08:32.181 INFO:tasks.workunit.client.0.smithi046.stdout:1/559: creat d5/d13/d35/d37/d64/d87/fb9 x:0 0 0 2024-02-19T19:08:32.181 INFO:tasks.workunit.client.0.smithi046.stdout:1/560: chown d5/d2f/d9f/d3b/d3c 12 1 2024-02-19T19:08:32.181 INFO:tasks.workunit.client.0.smithi046.stdout:1/561: creat d5/fba x:0 0 0 2024-02-19T19:08:32.193 INFO:tasks.workunit.client.0.smithi046.stdout:1/562: dwrite d5/d13/d35/d37/d64/d75/f86 [0,4194304] 0 2024-02-19T19:08:32.193 INFO:tasks.workunit.client.0.smithi046.stdout:1/563: chown d5/d13/d35/f41 1928102 1 2024-02-19T19:08:32.195 INFO:tasks.workunit.client.0.smithi046.stdout:1/564: unlink d5/d13/d35/d37/d64/d75/la7 0 2024-02-19T19:08:32.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/565: symlink d5/d13/d35/d37/db0/lbb 0 2024-02-19T19:08:32.197 INFO:tasks.workunit.client.0.smithi046.stdout:1/566: link d5/d2f/d9f/f2e d5/d13/d35/d37/d64/d75/fbc 0 2024-02-19T19:08:32.202 INFO:tasks.workunit.client.0.smithi046.stdout:1/567: fsync d5/d2f/d9f/f2e 0 2024-02-19T19:08:32.203 INFO:tasks.workunit.client.0.smithi046.stdout:1/568: creat d5/d2f/d9f/d55/d81/d80/daf/db5/fbd x:0 0 0 2024-02-19T19:08:32.221 INFO:tasks.workunit.client.0.smithi046.stdout:1/569: dwrite d5/d13/d35/d37/d64/fab [0,4194304] 0 2024-02-19T19:08:32.228 INFO:tasks.workunit.client.0.smithi046.stdout:1/570: dread d5/d13/d35/f41 [0,4194304] 0 2024-02-19T19:08:32.229 INFO:tasks.workunit.client.0.smithi046.stdout:1/571: getdents d5/d2f/d9f/d3b/d4e 0 2024-02-19T19:08:32.229 INFO:tasks.workunit.client.0.smithi046.stdout:1/572: truncate d5/d13/f70 4304509 0 2024-02-19T19:08:32.230 INFO:tasks.workunit.client.0.smithi046.stdout:1/573: dread d5/d13/d35/d37/d64/f6b [0,4194304] 0 2024-02-19T19:08:32.246 INFO:tasks.workunit.client.0.smithi046.stdout:1/574: dwrite d5/d2f/d9f/d55/d81/f57 [0,4194304] 0 2024-02-19T19:08:32.247 INFO:tasks.workunit.client.0.smithi046.stdout:1/575: mkdir d5/d2f/d9f/d55/d81/d80/daf/db5/dbe 0 2024-02-19T19:08:32.255 INFO:tasks.workunit.client.0.smithi046.stdout:1/576: read d5/d2f/d9f/f2e [3009857,118344] 0 2024-02-19T19:08:32.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/577: mknod d5/d2f/d9f/d3b/d4e/d91/cbf 0 2024-02-19T19:08:32.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/578: fsync d5/d2f/d9f/d3b/f5c 0 2024-02-19T19:08:32.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/579: mknod d5/d2f/d9f/d3b/d4e/d91/cc0 0 2024-02-19T19:08:32.258 INFO:tasks.workunit.client.0.smithi046.stdout:1/580: rename d5/c39 to d5/d2f/d9f/d55/d81/d80/daf/cc1 0 2024-02-19T19:08:32.276 INFO:tasks.workunit.client.0.smithi046.stdout:1/581: dwrite d5/d13/d35/f71 [0,4194304] 0 2024-02-19T19:08:32.277 INFO:tasks.workunit.client.0.smithi046.stdout:1/582: link d5/d13/d35/f71 d5/d21/fc2 0 2024-02-19T19:08:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.256+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1684106413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ccc101d30 msgr2=0x7f4ccc10a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.256+0000 7f4cd3f01700 1 --2- 172.21.15.46:0/1684106413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ccc101d30 0x7f4ccc10a230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009910 tx=0x7f4cbc009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.256+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1684106413 shutdown_connections 2024-02-19T19:08:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.256+0000 7f4cd3f01700 1 --2- 172.21.15.46:0/1684106413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ccc101d30 0x7f4ccc10a230 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.256+0000 7f4cd3f01700 1 --2- 172.21.15.46:0/1684106413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ccc101420 0x7f4ccc1017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.256+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1684106413 >> 172.21.15.46:0/1684106413 conn(0x7f4ccc0fac60 msgr2=0x7f4ccc0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:32.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.256+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1684106413 shutdown_connections 2024-02-19T19:08:32.278 INFO:tasks.workunit.client.0.smithi046.stdout:1/583: mknod d5/d2f/d9f/d3b/d4e/d76/cc3 0 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.257+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1684106413 wait complete. 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.258+0000 7f4cd3f01700 1 Processor -- start 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.258+0000 7f4cd3f01700 1 -- start start 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.258+0000 7f4cd3f01700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ccc101420 0x7f4ccc0ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.258+0000 7f4cd3f01700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ccc101d30 0x7f4ccc0ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.258+0000 7f4cd3f01700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc100e50 con 0x7f4ccc101d30 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.258+0000 7f4cd3f01700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc100fc0 con 0x7f4ccc101420 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.258+0000 7f4cd1c9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ccc101420 0x7f4ccc0ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.258+0000 7f4cd1c9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ccc101420 0x7f4ccc0ff0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:36248/0 (socket says 172.21.15.46:36248) 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.258+0000 7f4cd1c9d700 1 -- 172.21.15.46:0/1108851990 learned_addr learned my addr 172.21.15.46:0/1108851990 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:08:32.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.258+0000 7f4cd149c700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ccc101d30 0x7f4ccc0ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:32.281 INFO:tasks.workunit.client.0.smithi046.stdout:1/584: dread d5/d13/d35/d37/d64/f6b [0,4194304] 0 2024-02-19T19:08:32.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.259+0000 7f4cd1c9d700 1 -- 172.21.15.46:0/1108851990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ccc101d30 msgr2=0x7f4ccc0ff5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:32.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.259+0000 7f4cd1c9d700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ccc101d30 0x7f4ccc0ff5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.259+0000 7f4cd1c9d700 1 -- 172.21.15.46:0/1108851990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc0095f0 con 0x7f4ccc101420 2024-02-19T19:08:32.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.259+0000 7f4cd1c9d700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ccc101420 0x7f4ccc0ff0a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800e920 tx=0x7f4cc800ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:32.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.259+0000 7f4cc2ffd700 1 -- 172.21.15.46:0/1108851990 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc800c9d0 con 0x7f4ccc101420 2024-02-19T19:08:32.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.259+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1108851990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc0ffc40 con 0x7f4ccc101420 2024-02-19T19:08:32.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.259+0000 7f4cc2ffd700 1 -- 172.21.15.46:0/1108851990 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4cc8010430 con 0x7f4ccc101420 2024-02-19T19:08:32.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.260+0000 7f4cc2ffd700 1 -- 172.21.15.46:0/1108851990 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc8018630 con 0x7f4ccc101420 2024-02-19T19:08:32.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.260+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1108851990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc1a69a0 con 0x7f4ccc101420 2024-02-19T19:08:32.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.261+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1108851990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc1078a0 con 0x7f4ccc101420 2024-02-19T19:08:32.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.262+0000 7f4cc2ffd700 1 -- 172.21.15.46:0/1108851990 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4cc800cb30 con 0x7f4ccc101420 2024-02-19T19:08:32.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.263+0000 7f4cc2ffd700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4cb806d8a0 0x7f4cb806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:32.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.263+0000 7f4cc2ffd700 1 -- 172.21.15.46:0/1108851990 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f4cc8014070 con 0x7f4ccc101420 2024-02-19T19:08:32.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.263+0000 7f4cd149c700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4cb806d8a0 0x7f4cb806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:32.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.263+0000 7f4cd149c700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4cb806d8a0 0x7f4cb806fd50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc100890 tx=0x7f4cbc005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:32.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.268+0000 7f4cc2ffd700 1 -- 172.21.15.46:0/1108851990 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4cc8052d20 con 0x7f4ccc101420 2024-02-19T19:08:32.294 INFO:tasks.workunit.client.0.smithi046.stdout:1/585: dwrite d5/d13/f31 [0,4194304] 0 2024-02-19T19:08:32.295 INFO:tasks.workunit.client.0.smithi046.stdout:1/586: mkdir d5/d2f/d9f/dc4 0 2024-02-19T19:08:32.300 INFO:tasks.workunit.client.0.smithi046.stdout:1/587: rename d5/d2f/d9f/d55/d81/d80/daf/cc1 to d5/d2f/d9f/d55/d81/d80/daf/db5/cc5 0 2024-02-19T19:08:32.307 INFO:tasks.workunit.client.0.smithi046.stdout:6/533: sync 2024-02-19T19:08:32.307 INFO:tasks.workunit.client.0.smithi046.stdout:8/715: sync 2024-02-19T19:08:32.307 INFO:tasks.workunit.client.0.smithi046.stdout:6/534: readlink d4/l93 0 2024-02-19T19:08:32.307 INFO:tasks.workunit.client.0.smithi046.stdout:6/535: write d4/d6/d1c/d64/fa1 [272867,35991] 0 2024-02-19T19:08:32.308 INFO:tasks.workunit.client.0.smithi046.stdout:2/743: sync 2024-02-19T19:08:32.308 INFO:tasks.workunit.client.0.smithi046.stdout:8/716: mkdir d3/d37/d64/da2/dac/dee/df8 0 2024-02-19T19:08:32.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/588: dread d5/d2f/d9f/d3b/f5c [0,4194304] 0 2024-02-19T19:08:32.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/589: truncate d5/d2f/d9f/d55/d81/d80/daf/db5/fbd 519266 0 2024-02-19T19:08:32.309 INFO:tasks.workunit.client.0.smithi046.stdout:2/744: mkdir d5/d2c/d89/d3f/d5c/d9f/dda/df6 0 2024-02-19T19:08:32.310 INFO:tasks.workunit.client.0.smithi046.stdout:8/717: symlink d3/dd/d13/d6b/d46/lf9 0 2024-02-19T19:08:32.311 INFO:tasks.workunit.client.0.smithi046.stdout:6/536: symlink d4/d6/d1c/d20/lab 0 2024-02-19T19:08:32.311 INFO:tasks.workunit.client.0.smithi046.stdout:6/537: dread - d4/d6/dd/d10/fa7 zero size 2024-02-19T19:08:32.313 INFO:tasks.workunit.client.0.smithi046.stdout:1/590: symlink d5/d13/d35/d37/d64/lc6 0 2024-02-19T19:08:32.323 INFO:tasks.workunit.client.0.smithi046.stdout:2/745: write d5/d2c/d89/d4c/f70 [350001,90951] 0 2024-02-19T19:08:32.323 INFO:tasks.workunit.client.0.smithi046.stdout:2/746: write d5/d2c/d45/d9b/dcb/fd2 [787190,42606] 0 2024-02-19T19:08:32.328 INFO:tasks.workunit.client.0.smithi046.stdout:6/538: dread d4/d6/f1a [0,4194304] 0 2024-02-19T19:08:32.329 INFO:tasks.workunit.client.0.smithi046.stdout:6/539: symlink d4/d6/d1c/d64/lac 0 2024-02-19T19:08:32.331 INFO:tasks.workunit.client.0.smithi046.stdout:6/540: mknod d4/cad 0 2024-02-19T19:08:32.331 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:32 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[112579]: 2024-02-19T19:08:32.032+0000 7fd84b1c57c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-19T19:08:32.332 INFO:tasks.workunit.client.0.smithi046.stdout:6/541: creat d4/d6/d1c/fae x:0 0 0 2024-02-19T19:08:32.333 INFO:tasks.workunit.client.0.smithi046.stdout:6/542: write d4/f39 [986892,73259] 0 2024-02-19T19:08:32.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/718: dwrite d3/d37/d64/da2/d3c/db6/fd0 [0,4194304] 0 2024-02-19T19:08:32.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/719: fdatasync d3/dd/f96 0 2024-02-19T19:08:32.335 INFO:tasks.workunit.client.0.smithi046.stdout:6/543: rename d4/d6/l46 to d4/d6/laf 0 2024-02-19T19:08:32.336 INFO:tasks.workunit.client.0.smithi046.stdout:8/720: rename d3/d37/d9b/cae to d3/dd/d3f/d49/d5b/d5f/cfa 0 2024-02-19T19:08:32.343 INFO:tasks.workunit.client.0.smithi046.stdout:6/544: write d4/d6/d1c/d60/f61 [1381402,66166] 0 2024-02-19T19:08:32.347 INFO:tasks.workunit.client.0.smithi046.stdout:2/747: dwrite d5/d6/d13/d8a/fa8 [0,4194304] 0 2024-02-19T19:08:32.349 INFO:tasks.workunit.client.0.smithi046.stdout:2/748: mknod d5/d2c/d89/d3f/d5c/d9f/dda/df6/cf7 0 2024-02-19T19:08:32.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/721: dwrite d3/dd/d13/d6b/d46/f74 [0,4194304] 0 2024-02-19T19:08:32.363 INFO:tasks.workunit.client.0.smithi046.stdout:2/749: dread d5/d2c/d89/d3f/f5e [0,4194304] 0 2024-02-19T19:08:32.365 INFO:tasks.workunit.client.0.smithi046.stdout:2/750: symlink d5/d6/d13/d7c/d90/lf8 0 2024-02-19T19:08:32.373 INFO:tasks.workunit.client.0.smithi046.stdout:8/722: dwrite d3/dd/d13/d6b/d46/d54/f56 [0,4194304] 0 2024-02-19T19:08:32.375 INFO:tasks.workunit.client.0.smithi046.stdout:8/723: creat d3/d8b/df3/ffb x:0 0 0 2024-02-19T19:08:32.376 INFO:tasks.workunit.client.0.smithi046.stdout:8/724: unlink d3/d37/la7 0 2024-02-19T19:08:32.376 INFO:tasks.workunit.client.0.smithi046.stdout:8/725: read d3/f7 [767021,25290] 0 2024-02-19T19:08:32.383 INFO:tasks.workunit.client.0.smithi046.stdout:2/751: dwrite d5/d2c/d89/d3f/d82/fc9 [0,4194304] 0 2024-02-19T19:08:32.385 INFO:tasks.workunit.client.0.smithi046.stdout:2/752: mknod d5/d2c/d89/d3f/d82/dd0/cf9 0 2024-02-19T19:08:32.386 INFO:tasks.workunit.client.0.smithi046.stdout:2/753: symlink d5/d2c/d89/d3f/d82/df4/lfa 0 2024-02-19T19:08:32.386 INFO:tasks.workunit.client.0.smithi046.stdout:2/754: read d5/d2c/f86 [921942,23494] 0 2024-02-19T19:08:32.387 INFO:tasks.workunit.client.0.smithi046.stdout:2/755: creat d5/d2c/d89/d3f/d5c/dee/ffb x:0 0 0 2024-02-19T19:08:32.396 INFO:tasks.workunit.client.0.smithi046.stdout:2/756: dread d5/d2c/f5f [0,4194304] 0 2024-02-19T19:08:32.396 INFO:tasks.workunit.client.0.smithi046.stdout:2/757: dread - d5/d2c/d89/d92/fa3 zero size 2024-02-19T19:08:32.396 INFO:tasks.workunit.client.0.smithi046.stdout:8/726: dwrite d3/d18/f86 [0,4194304] 0 2024-02-19T19:08:32.397 INFO:tasks.workunit.client.0.smithi046.stdout:2/758: rename d5/d2c/d89/d3f/d5c/d9f/dda/df6 to d5/d2c/d45/d9b/dcb/dfc 0 2024-02-19T19:08:32.398 INFO:tasks.workunit.client.0.smithi046.stdout:8/727: creat d3/d37/d64/da2/d3c/db6/ffc x:0 0 0 2024-02-19T19:08:32.399 INFO:tasks.workunit.client.0.smithi046.stdout:2/759: symlink d5/d2c/d89/d3f/lfd 0 2024-02-19T19:08:32.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/760: read d5/d2c/d45/d9b/dcb/fd2 [785631,7535] 0 2024-02-19T19:08:32.402 INFO:tasks.workunit.client.0.smithi046.stdout:2/761: truncate d5/d2c/d89/d3f/d5c/f9d 4335974 0 2024-02-19T19:08:32.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/762: truncate d5/d2c/d89/d4c/f70 3792173 0 2024-02-19T19:08:32.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/763: dread - d5/d2c/d89/d92/ff3 zero size 2024-02-19T19:08:32.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/764: truncate d5/d2c/d89/d3f/d5c/dee/ffb 930325 0 2024-02-19T19:08:32.407 INFO:tasks.workunit.client.0.smithi046.stdout:2/765: dread d5/d2c/d56/d5a/fac [0,4194304] 0 2024-02-19T19:08:32.408 INFO:tasks.workunit.client.0.smithi046.stdout:2/766: mknod d5/d2c/d45/d9b/dcb/dfc/cfe 0 2024-02-19T19:08:32.410 INFO:tasks.workunit.client.0.smithi046.stdout:2/767: dread d5/d2c/d89/fc3 [0,4194304] 0 2024-02-19T19:08:32.413 INFO:tasks.workunit.client.0.smithi046.stdout:2/768: symlink d5/d2c/d45/d9b/dcb/de0/lff 0 2024-02-19T19:08:32.413 INFO:tasks.workunit.client.0.smithi046.stdout:2/769: stat d5/f43 0 2024-02-19T19:08:32.413 INFO:tasks.workunit.client.0.smithi046.stdout:2/770: chown d5/d2c/d89/d3f/da1/fc1 1710217 1 2024-02-19T19:08:32.414 INFO:tasks.workunit.client.0.smithi046.stdout:2/771: symlink d5/d2c/d89/d3f/d5c/dee/l100 0 2024-02-19T19:08:32.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/728: dwrite d3/dd/d13/d6b/d46/d6a/db2/ff0 [0,4194304] 0 2024-02-19T19:08:32.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/729: write d3/dd/d3f/fcb [495650,14421] 0 2024-02-19T19:08:32.438 INFO:tasks.workunit.client.0.smithi046.stdout:2/772: dwrite d5/d2c/d89/f6d [0,4194304] 0 2024-02-19T19:08:32.438 INFO:tasks.workunit.client.0.smithi046.stdout:8/730: dwrite d3/dd/d13/d42/f57 [0,4194304] 0 2024-02-19T19:08:32.452 INFO:tasks.workunit.client.0.smithi046.stdout:8/731: dread d3/d18/fd4 [0,4194304] 0 2024-02-19T19:08:32.456 INFO:tasks.workunit.client.0.smithi046.stdout:2/773: dwrite d5/d2c/d89/f37 [0,4194304] 0 2024-02-19T19:08:32.464 INFO:tasks.workunit.client.0.smithi046.stdout:8/732: dwrite d3/dd/d13/d6b/d46/d6a/f91 [4194304,4194304] 0 2024-02-19T19:08:32.465 INFO:tasks.workunit.client.0.smithi046.stdout:8/733: creat d3/d37/d64/da2/d3c/db6/ffd x:0 0 0 2024-02-19T19:08:32.465 INFO:tasks.workunit.client.0.smithi046.stdout:8/734: fdatasync d3/dd/d13/d66/fbe 0 2024-02-19T19:08:32.467 INFO:tasks.workunit.client.0.smithi046.stdout:8/735: mkdir d3/dd/d13/dfe 0 2024-02-19T19:08:32.468 INFO:tasks.workunit.client.0.smithi046.stdout:8/736: getdents d3/d37/d64/da2/df5 0 2024-02-19T19:08:32.468 INFO:tasks.workunit.client.0.smithi046.stdout:8/737: write d3/dd/d13/d66/fbe [650143,115264] 0 2024-02-19T19:08:32.469 INFO:tasks.workunit.client.0.smithi046.stdout:8/738: creat d3/dd/d3f/d49/fff x:0 0 0 2024-02-19T19:08:32.474 INFO:tasks.workunit.client.0.smithi046.stdout:2/774: dwrite d5/d6/d6e/dab/fae [0,4194304] 0 2024-02-19T19:08:32.476 INFO:tasks.workunit.client.0.smithi046.stdout:2/775: symlink d5/d2c/d89/d3f/d5c/d9f/dda/df1/l101 0 2024-02-19T19:08:32.481 INFO:tasks.workunit.client.0.smithi046.stdout:8/739: dread d3/d37/d64/da2/dac/fb4 [0,4194304] 0 2024-02-19T19:08:32.481 INFO:tasks.workunit.client.0.smithi046.stdout:8/740: dread - d3/d9d/fc0 zero size 2024-02-19T19:08:32.484 INFO:tasks.workunit.client.0.smithi046.stdout:8/741: rename d3/dd/d13/d6b/d46/d6a/db2/fcc to d3/dd/d13/f100 0 2024-02-19T19:08:32.484 INFO:tasks.workunit.client.0.smithi046.stdout:8/742: write d3/d37/d64/da2/d3c/f3e [4221822,117786] 0 2024-02-19T19:08:32.485 INFO:tasks.workunit.client.0.smithi046.stdout:8/743: mknod d3/dd/d3f/d49/d5b/d5f/da0/dd8/c101 0 2024-02-19T19:08:32.488 INFO:tasks.workunit.client.0.smithi046.stdout:8/744: fsync d3/dd/d3f/d49/fff 0 2024-02-19T19:08:32.490 INFO:tasks.workunit.client.0.smithi046.stdout:8/745: symlink d3/dd/d13/d6b/ddc/l102 0 2024-02-19T19:08:32.490 INFO:tasks.workunit.client.0.smithi046.stdout:2/776: dwrite d5/d2c/d35/f55 [0,4194304] 0 2024-02-19T19:08:32.492 INFO:tasks.workunit.client.0.smithi046.stdout:2/777: link d5/d2c/d45/f4a d5/d2c/d45/de7/f102 0 2024-02-19T19:08:32.497 INFO:tasks.workunit.client.0.smithi046.stdout:8/746: dread d3/dd/d13/d6b/d46/d54/f56 [0,4194304] 0 2024-02-19T19:08:32.499 INFO:tasks.workunit.client.0.smithi046.stdout:8/747: link d3/d37/d64/f7a d3/dd/d3f/f103 0 2024-02-19T19:08:32.500 INFO:tasks.workunit.client.0.smithi046.stdout:8/748: creat d3/dd/d13/d42/d72/f104 x:0 0 0 2024-02-19T19:08:32.501 INFO:tasks.workunit.client.0.smithi046.stdout:8/749: creat d3/dd/d3f/d49/d5b/d5f/da0/f105 x:0 0 0 2024-02-19T19:08:32.502 INFO:tasks.workunit.client.0.smithi046.stdout:2/778: write d5/d2c/d35/d80/f87 [2185869,66119] 0 2024-02-19T19:08:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:2/779: write d5/d2c/d89/d3f/d5c/dee/ffb [35970,112212] 0 2024-02-19T19:08:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/750: rename d3/dd/d13/l27 to d3/d37/d64/da2/dac/dee/df8/l106 0 2024-02-19T19:08:32.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/751: creat d3/d18/f107 x:0 0 0 2024-02-19T19:08:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:9/371: sync 2024-02-19T19:08:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/707: sync 2024-02-19T19:08:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/708: chown d6/d15/d17/ld0 984078 1 2024-02-19T19:08:32.504 INFO:tasks.workunit.client.0.smithi046.stdout:9/372: dread - db/d1e/d32/d47/f57 zero size 2024-02-19T19:08:32.505 INFO:tasks.workunit.client.0.smithi046.stdout:8/752: unlink d3/d37/d64/da2/d3c/f3e 0 2024-02-19T19:08:32.506 INFO:tasks.workunit.client.0.smithi046.stdout:2/780: fdatasync d5/d6/d13/f61 0 2024-02-19T19:08:32.506 INFO:tasks.workunit.client.0.smithi046.stdout:4/709: unlink d6/d11/dd6/f34 0 2024-02-19T19:08:32.509 INFO:tasks.workunit.client.0.smithi046.stdout:8/753: rename d3/dd/d13/d6b/d46/d54/fb8 to d3/d37/d64/da2/dac/dee/df8/f108 0 2024-02-19T19:08:32.509 INFO:tasks.workunit.client.0.smithi046.stdout:8/754: creat d3/dd/d3f/d49/d5b/d5f/da0/dd8/f109 x:0 0 0 2024-02-19T19:08:32.509 INFO:tasks.workunit.client.0.smithi046.stdout:8/755: truncate d3/d9d/fc2 203372 0 2024-02-19T19:08:32.509 INFO:tasks.workunit.client.0.smithi046.stdout:4/710: getdents d6/d94 0 2024-02-19T19:08:32.511 INFO:tasks.workunit.client.0.smithi046.stdout:4/711: mknod d6/d11/dd6/d89/d8a/d8d/cf0 0 2024-02-19T19:08:32.515 INFO:tasks.workunit.client.0.smithi046.stdout:4/712: dread d6/f7f [0,4194304] 0 2024-02-19T19:08:32.515 INFO:tasks.workunit.client.0.smithi046.stdout:4/713: write d6/d11/f68 [603958,22617] 0 2024-02-19T19:08:32.515 INFO:tasks.workunit.client.0.smithi046.stdout:4/714: truncate d6/d11/d92/f9e 741887 0 2024-02-19T19:08:32.516 INFO:tasks.workunit.client.0.smithi046.stdout:4/715: write d6/d15/d17/d1e/fb8 [363041,115748] 0 2024-02-19T19:08:32.517 INFO:tasks.workunit.client.0.smithi046.stdout:4/716: creat d6/d15/d17/d1e/ff1 x:0 0 0 2024-02-19T19:08:32.521 INFO:tasks.workunit.client.0.smithi046.stdout:4/717: dread d6/d11/dd6/d89/f91 [0,4194304] 0 2024-02-19T19:08:32.523 INFO:tasks.workunit.client.0.smithi046.stdout:4/718: creat d6/dd3/ff2 x:0 0 0 2024-02-19T19:08:32.523 INFO:tasks.workunit.client.0.smithi046.stdout:4/719: chown d6/d15/d17/d4a/f85 7 1 2024-02-19T19:08:32.523 INFO:tasks.workunit.client.0.smithi046.stdout:4/720: chown d6/dd3 328 1 2024-02-19T19:08:32.523 INFO:tasks.workunit.client.0.smithi046.stdout:4/721: chown d6/dd3 211 1 2024-02-19T19:08:32.529 INFO:tasks.workunit.client.0.smithi046.stdout:9/373: dwrite db/f24 [0,4194304] 0 2024-02-19T19:08:32.530 INFO:tasks.workunit.client.0.smithi046.stdout:8/756: dwrite d3/dd/d13/d66/fbe [0,4194304] 0 2024-02-19T19:08:32.531 INFO:tasks.workunit.client.0.smithi046.stdout:4/722: dread d6/d15/d17/d1e/d25/f2f [0,4194304] 0 2024-02-19T19:08:32.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/757: creat d3/dd/d13/f10a x:0 0 0 2024-02-19T19:08:32.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/758: getdents d3/d37/d64/da2 0 2024-02-19T19:08:32.534 INFO:tasks.workunit.client.0.smithi046.stdout:8/759: symlink d3/d37/dca/l10b 0 2024-02-19T19:08:32.534 INFO:tasks.workunit.client.0.smithi046.stdout:8/760: creat d3/dd/d13/d66/dba/f10c x:0 0 0 2024-02-19T19:08:32.534 INFO:tasks.workunit.client.0.smithi046.stdout:8/761: chown d3/dd/d3f/d49/d5b/d5f/l7f 0 1 2024-02-19T19:08:32.535 INFO:tasks.workunit.client.0.smithi046.stdout:8/762: fdatasync d3/dd/d13/d6b/d46/d54/d8a/f8c 0 2024-02-19T19:08:32.543 INFO:tasks.workunit.client.0.smithi046.stdout:4/723: dread d6/d11/dd6/f60 [4194304,4194304] 0 2024-02-19T19:08:32.544 INFO:tasks.workunit.client.0.smithi046.stdout:4/724: write d6/d15/d17/d1e/fd8 [878433,87457] 0 2024-02-19T19:08:32.544 INFO:tasks.workunit.client.0.smithi046.stdout:4/725: creat d6/ff3 x:0 0 0 2024-02-19T19:08:32.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/726: rename d6/d11/d40/ddb to d6/d94/df4 0 2024-02-19T19:08:32.549 INFO:tasks.workunit.client.0.smithi046.stdout:4/727: symlink d6/d11/d40/da7/lf5 0 2024-02-19T19:08:32.550 INFO:tasks.workunit.client.0.smithi046.stdout:4/728: symlink d6/d15/d17/d4a/lf6 0 2024-02-19T19:08:32.550 INFO:tasks.workunit.client.0.smithi046.stdout:4/729: dread - d6/d11/dd6/d89/d8a/d55/f86 zero size 2024-02-19T19:08:32.550 INFO:tasks.workunit.client.0.smithi046.stdout:4/730: chown d6/d15/l71 479910 1 2024-02-19T19:08:32.550 INFO:tasks.workunit.client.0.smithi046.stdout:4/731: chown d6/d11/d40/da7/lc0 16156 1 2024-02-19T19:08:32.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/732: rename d6/c6f to d6/d15/d17/cf7 0 2024-02-19T19:08:32.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/733: write d6/d15/d17/f41 [1699176,120641] 0 2024-02-19T19:08:32.555 INFO:tasks.workunit.client.0.smithi046.stdout:8/763: dwrite d3/dd/d13/d6b/d46/f74 [0,4194304] 0 2024-02-19T19:08:32.556 INFO:tasks.workunit.client.0.smithi046.stdout:9/374: dwrite db/d20/f56 [0,4194304] 0 2024-02-19T19:08:32.561 INFO:tasks.workunit.client.0.smithi046.stdout:9/375: mkdir db/d20/d6f 0 2024-02-19T19:08:32.561 INFO:tasks.workunit.client.0.smithi046.stdout:9/376: fdatasync db/d1e/d32/d47/f57 0 2024-02-19T19:08:32.571 INFO:tasks.workunit.client.0.smithi046.stdout:9/377: dread db/d1e/f27 [0,4194304] 0 2024-02-19T19:08:32.574 INFO:tasks.workunit.client.0.smithi046.stdout:4/734: getdents d6/d11/d40 0 2024-02-19T19:08:32.574 INFO:tasks.workunit.client.0.smithi046.stdout:4/735: chown d6/d15/d17/d1e/d25/fa6 333937571 1 2024-02-19T19:08:32.575 INFO:tasks.workunit.client.0.smithi046.stdout:8/764: dwrite d3/d37/f2d [0,4194304] 0 2024-02-19T19:08:32.576 INFO:tasks.workunit.client.0.smithi046.stdout:8/765: creat d3/dd/d3f/d49/f10d x:0 0 0 2024-02-19T19:08:32.588 INFO:tasks.workunit.client.0.smithi046.stdout:8/766: write d3/d37/f2d [2502847,119801] 0 2024-02-19T19:08:32.591 INFO:tasks.workunit.client.0.smithi046.stdout:8/767: unlink d3/dd/d13/f10a 0 2024-02-19T19:08:32.594 INFO:tasks.workunit.client.0.smithi046.stdout:9/378: dwrite db/d53/f65 [0,4194304] 0 2024-02-19T19:08:32.596 INFO:tasks.workunit.client.0.smithi046.stdout:4/736: dwrite d6/d15/d17/d1e/f6d [0,4194304] 0 2024-02-19T19:08:32.602 INFO:tasks.workunit.client.0.smithi046.stdout:8/768: read d3/dd/d3f/d49/d5b/d5f/da0/dd8/fed [1434714,19407] 0 2024-02-19T19:08:32.608 INFO:tasks.workunit.client.0.smithi046.stdout:4/737: link d6/d15/d17/d1e/d25/l8f d6/d11/d40/da7/dd2/lf8 0 2024-02-19T19:08:32.609 INFO:tasks.workunit.client.0.smithi046.stdout:4/738: fdatasync d6/d11/dd6/d89/d8a/f8c 0 2024-02-19T19:08:32.611 INFO:tasks.workunit.client.0.smithi046.stdout:4/739: rename d6/d11/dd6/d89/d8a/d8d/cf0 to d6/d50/dde/cf9 0 2024-02-19T19:08:32.612 INFO:tasks.workunit.client.0.smithi046.stdout:9/379: dwrite db/d20/f2c [0,4194304] 0 2024-02-19T19:08:32.612 INFO:tasks.workunit.client.0.smithi046.stdout:9/380: fsync db/d1e/d32/f61 0 2024-02-19T19:08:32.614 INFO:tasks.workunit.client.0.smithi046.stdout:4/740: rename d6/dd3/dc5/fce to d6/dd3/dc5/ffa 0 2024-02-19T19:08:32.617 INFO:tasks.workunit.client.0.smithi046.stdout:9/381: creat db/d20/d6b/d54/f70 x:0 0 0 2024-02-19T19:08:32.617 INFO:tasks.workunit.client.0.smithi046.stdout:9/382: fdatasync db/d1e/d32/f5d 0 2024-02-19T19:08:32.618 INFO:tasks.workunit.client.0.smithi046.stdout:9/383: mkdir db/d20/d71 0 2024-02-19T19:08:32.619 INFO:tasks.workunit.client.0.smithi046.stdout:9/384: truncate f2 4522883 0 2024-02-19T19:08:32.619 INFO:tasks.workunit.client.0.smithi046.stdout:9/385: fdatasync db/f43 0 2024-02-19T19:08:32.619 INFO:tasks.workunit.client.0.smithi046.stdout:8/769: dwrite d3/d37/d64/da2/df5/fc4 [0,4194304] 0 2024-02-19T19:08:32.620 INFO:tasks.workunit.client.0.smithi046.stdout:4/741: dread d6/d15/d17/d1e/f7a [0,4194304] 0 2024-02-19T19:08:32.626 INFO:tasks.workunit.client.0.smithi046.stdout:8/770: creat d3/dd/d13/d6b/d46/d6a/f10e x:0 0 0 2024-02-19T19:08:32.628 INFO:tasks.workunit.client.0.smithi046.stdout:8/771: getdents d3/dd/d13/d6b/ddc 0 2024-02-19T19:08:32.628 INFO:tasks.workunit.client.0.smithi046.stdout:8/772: fdatasync d3/d37/d64/da2/dac/dee/df8/f108 0 2024-02-19T19:08:32.628 INFO:tasks.workunit.client.0.smithi046.stdout:8/773: chown d3/d37/d64/d9a/lc5 219764 1 2024-02-19T19:08:32.628 INFO:tasks.workunit.client.0.smithi046.stdout:8/774: chown d3/d18/c67 156237 1 2024-02-19T19:08:32.635 INFO:tasks.workunit.client.0.smithi046.stdout:9/386: dwrite db/d1e/f4c [0,4194304] 0 2024-02-19T19:08:32.635 INFO:tasks.workunit.client.0.smithi046.stdout:9/387: fdatasync db/d1e/f1f 0 2024-02-19T19:08:32.642 INFO:tasks.workunit.client.0.smithi046.stdout:9/388: symlink db/d1e/d32/d47/l72 0 2024-02-19T19:08:32.648 INFO:tasks.workunit.client.0.smithi046.stdout:8/775: dwrite d3/d37/d64/da2/d3c/db6/ffc [0,4194304] 0 2024-02-19T19:08:32.652 INFO:tasks.workunit.client.0.smithi046.stdout:8/776: rename d3/dd/d13/d6b/d46/d6a/db2/fc6 to d3/dd/d13/d6b/d46/d54/d8a/f10f 0 2024-02-19T19:08:32.654 INFO:tasks.workunit.client.0.smithi046.stdout:8/777: symlink d3/dd/d3f/d49/d5b/d5f/db1/l110 0 2024-02-19T19:08:32.654 INFO:tasks.workunit.client.0.smithi046.stdout:8/778: chown d3/d37/d9b/de9 386650359 1 2024-02-19T19:08:32.656 INFO:tasks.workunit.client.0.smithi046.stdout:8/779: mkdir d3/d37/d111 0 2024-02-19T19:08:32.661 INFO:tasks.workunit.client.0.smithi046.stdout:9/389: dwrite db/f24 [0,4194304] 0 2024-02-19T19:08:32.662 INFO:tasks.workunit.client.0.smithi046.stdout:9/390: symlink db/d20/d6b/l73 0 2024-02-19T19:08:32.663 INFO:tasks.workunit.client.0.smithi046.stdout:9/391: dread - db/d1e/d52/f59 zero size 2024-02-19T19:08:32.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.652+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1108851990 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ccc061190 con 0x7f4cb806d8a0 2024-02-19T19:08:32.676 INFO:tasks.workunit.client.0.smithi046.stdout:8/780: dwrite d3/fab [0,4194304] 0 2024-02-19T19:08:32.676 INFO:tasks.workunit.client.0.smithi046.stdout:9/392: dread f0 [0,4194304] 0 2024-02-19T19:08:32.679 INFO:tasks.workunit.client.0.smithi046.stdout:8/781: rename d3/d37/d64/l81 to d3/d37/d64/de0/l112 0 2024-02-19T19:08:32.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/393: rmdir db/d1e/d32 39 2024-02-19T19:08:32.683 INFO:tasks.workunit.client.0.smithi046.stdout:8/782: rename d3/d37/d64/da2/dac/dee to d3/d8b/d113 0 2024-02-19T19:08:32.683 INFO:tasks.workunit.client.0.smithi046.stdout:8/783: write d3/d37/f2e [657501,6829] 0 2024-02-19T19:08:32.688 INFO:tasks.workunit.client.0.smithi046.stdout:5/614: sync 2024-02-19T19:08:32.689 INFO:tasks.workunit.client.0.smithi046.stdout:0/753: sync 2024-02-19T19:08:32.689 INFO:tasks.workunit.client.0.smithi046.stdout:3/449: sync 2024-02-19T19:08:32.689 INFO:tasks.workunit.client.0.smithi046.stdout:7/705: sync 2024-02-19T19:08:32.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.669+0000 7f4cc2ffd700 1 -- 172.21.15.46:0/1108851990 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f4ccc061190 con 0x7f4cb806d8a0 2024-02-19T19:08:32.690 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:08:32.690 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (4m) 50s ago 15m 26.2M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:08:32.690 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (15m) 50s ago 15m 8312k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:08:32.690 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (13m) 113s ago 13m 7960k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (2m) 50s ago 15m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (116s) 113s ago 13m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (4m) 50s ago 14m 87.3M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (9m) 50s ago 9m 113M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (9m) 50s ago 9m 16.6M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (9m) 113s ago 9m 16.6M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (9m) 113s ago 9m 25.4M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (6m) 50s ago 16m 504M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (5m) 113s ago 13m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (3m) 50s ago 16m 47.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (2m) 113s ago 13m 34.1M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:08:32.691 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (5m) 50s ago 15m 17.0M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:08:32.692 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (5m) 113s ago 13m 16.8M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:08:32.692 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (93s) 50s ago 12m 158M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:08:32.692 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (58s) 50s ago 12m 12.8M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 974e56511c36 2024-02-19T19:08:32.692 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 starting - - - 1217M 2024-02-19T19:08:32.692 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (11m) 113s ago 11m 49.8M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:08:32.692 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (11m) 113s ago 11m 47.8M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:08:32.692 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (10m) 113s ago 10m 48.8M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:08:32.692 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 50s ago 14m 63.5M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:08:32.693 INFO:tasks.workunit.client.0.smithi046.stdout:9/394: dread db/f43 [0,4194304] 0 2024-02-19T19:08:32.693 INFO:tasks.workunit.client.0.smithi046.stdout:9/395: write db/f36 [8522495,114475] 0 2024-02-19T19:08:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.672+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1108851990 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4cb806d8a0 msgr2=0x7f4cb806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.672+0000 7f4cd3f01700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4cb806d8a0 0x7f4cb806fd50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc100890 tx=0x7f4cbc005fb0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.673+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1108851990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ccc101420 msgr2=0x7f4ccc0ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.673+0000 7f4cd3f01700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ccc101420 0x7f4ccc0ff0a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800e920 tx=0x7f4cc800ec30 comp rx=0 tx=0).stop 2024-02-19T19:08:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.673+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1108851990 shutdown_connections 2024-02-19T19:08:32.695 INFO:tasks.workunit.client.0.smithi046.stdout:9/396: rmdir db/d20/d6b 39 2024-02-19T19:08:32.695 INFO:tasks.workunit.client.0.smithi046.stdout:9/397: readlink db/l3d 0 2024-02-19T19:08:32.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.673+0000 7f4cd3f01700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f4cb806d8a0 0x7f4cb806fd50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.673+0000 7f4cd3f01700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ccc101420 0x7f4ccc0ff0a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.673+0000 7f4cd3f01700 1 --2- 172.21.15.46:0/1108851990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ccc101d30 0x7f4ccc0ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.673+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1108851990 >> 172.21.15.46:0/1108851990 conn(0x7f4ccc0fac60 msgr2=0x7f4ccc1049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.673+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1108851990 shutdown_connections 2024-02-19T19:08:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.673+0000 7f4cd3f01700 1 -- 172.21.15.46:0/1108851990 wait complete. 2024-02-19T19:08:32.696 INFO:tasks.workunit.client.0.smithi046.stdout:9/398: dread db/d20/f3c [0,4194304] 0 2024-02-19T19:08:32.698 INFO:tasks.workunit.client.0.smithi046.stdout:9/399: creat db/d20/d6b/d54/f74 x:0 0 0 2024-02-19T19:08:32.700 INFO:tasks.workunit.client.0.smithi046.stdout:7/706: write d0/d4/f29 [3670344,108996] 0 2024-02-19T19:08:32.702 INFO:tasks.workunit.client.0.smithi046.stdout:7/707: symlink d0/d45/d71/da3/le1 0 2024-02-19T19:08:32.702 INFO:tasks.workunit.client.0.smithi046.stdout:7/708: readlink d0/d45/d98/ld6 0 2024-02-19T19:08:32.702 INFO:tasks.workunit.client.0.smithi046.stdout:7/709: write d0/ff [5113332,82884] 0 2024-02-19T19:08:32.702 INFO:tasks.workunit.client.0.smithi046.stdout:7/710: read - d0/d45/d4a/d58/dc6/d83/fd9 zero size 2024-02-19T19:08:32.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/754: dread d0/d19/d4d/da5/da7/fdd [0,4194304] 0 2024-02-19T19:08:32.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/755: chown d0/d19/d8/d37/f5d 1 1 2024-02-19T19:08:32.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/756: write d0/d19/db/d6a/fdf [540985,57440] 0 2024-02-19T19:08:32.705 INFO:tasks.workunit.client.0.smithi046.stdout:0/757: creat d0/d19/db/f105 x:0 0 0 2024-02-19T19:08:32.706 INFO:tasks.workunit.client.0.smithi046.stdout:3/450: dread da/d30/d38/d54/f5d [0,4194304] 0 2024-02-19T19:08:32.706 INFO:tasks.workunit.client.0.smithi046.stdout:3/451: fsync da/f2c 0 2024-02-19T19:08:32.706 INFO:tasks.workunit.client.0.smithi046.stdout:3/452: chown da/f20 3120 1 2024-02-19T19:08:32.707 INFO:tasks.workunit.client.0.smithi046.stdout:0/758: creat d0/d24/d56/da3/f106 x:0 0 0 2024-02-19T19:08:32.707 INFO:tasks.workunit.client.0.smithi046.stdout:3/453: symlink da/d1d/d10/l78 0 2024-02-19T19:08:32.708 INFO:tasks.workunit.client.0.smithi046.stdout:0/759: mkdir d0/d19/d4d/da5/da7/db8/d107 0 2024-02-19T19:08:32.709 INFO:tasks.workunit.client.0.smithi046.stdout:3/454: symlink da/l79 0 2024-02-19T19:08:32.709 INFO:tasks.workunit.client.0.smithi046.stdout:3/455: creat da/d30/d38/f7a x:0 0 0 2024-02-19T19:08:32.710 INFO:tasks.workunit.client.0.smithi046.stdout:0/760: rmdir d0/d19/d8/d37/d85 39 2024-02-19T19:08:32.710 INFO:tasks.workunit.client.0.smithi046.stdout:0/761: write d0/f5c [1806577,73667] 0 2024-02-19T19:08:32.710 INFO:tasks.workunit.client.0.smithi046.stdout:0/762: creat d0/d6c/f108 x:0 0 0 2024-02-19T19:08:32.714 INFO:tasks.workunit.client.0.smithi046.stdout:0/763: rename d0/cd3 to d0/d19/c109 0 2024-02-19T19:08:32.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/764: rename d0/d24/d5b/c98 to d0/d5f/da8/c10a 0 2024-02-19T19:08:32.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/765: fdatasync d0/d6c/dc4/fec 0 2024-02-19T19:08:32.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/766: read - d0/d6c/fce zero size 2024-02-19T19:08:32.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/767: chown d0/d6c/dc4/lf7 218 1 2024-02-19T19:08:32.718 INFO:tasks.workunit.client.0.smithi046.stdout:0/768: write d0/d19/f91 [160415,38490] 0 2024-02-19T19:08:32.718 INFO:tasks.workunit.client.0.smithi046.stdout:0/769: readlink d0/d19/d8/d37/d85/l104 0 2024-02-19T19:08:32.718 INFO:tasks.workunit.client.0.smithi046.stdout:0/770: stat d0/d5f/da8 0 2024-02-19T19:08:32.718 INFO:tasks.workunit.client.0.smithi046.stdout:8/784: dwrite d3/dd/d3f/d49/d5b/d5f/da0/fb3 [0,4194304] 0 2024-02-19T19:08:32.718 INFO:tasks.workunit.client.0.smithi046.stdout:8/785: chown d3/cf4 0 1 2024-02-19T19:08:32.719 INFO:tasks.workunit.client.0.smithi046.stdout:5/615: dwrite d2/d27/f90 [0,4194304] 0 2024-02-19T19:08:32.719 INFO:tasks.workunit.client.0.smithi046.stdout:7/711: fsync d0/d45/d4a/d58/dc6/d83/dd3/f5c 0 2024-02-19T19:08:32.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/771: dread d0/d24/f39 [0,4194304] 0 2024-02-19T19:08:32.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/772: chown d0/d24/d56/da1/f28 468 1 2024-02-19T19:08:32.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/773: fdatasync d0/d19/f6 0 2024-02-19T19:08:32.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/774: chown d0/d19/l7a 981854 1 2024-02-19T19:08:32.720 INFO:tasks.workunit.client.0.smithi046.stdout:9/400: dwrite db/d53/f65 [0,4194304] 0 2024-02-19T19:08:32.721 INFO:tasks.workunit.client.0.smithi046.stdout:9/401: creat db/d1e/d32/d47/d5b/f75 x:0 0 0 2024-02-19T19:08:32.721 INFO:tasks.workunit.client.0.smithi046.stdout:9/402: chown db/d20/d6f 353194 1 2024-02-19T19:08:32.721 INFO:tasks.workunit.client.0.smithi046.stdout:9/403: write db/f1c [3592957,106403] 0 2024-02-19T19:08:32.721 INFO:tasks.workunit.client.0.smithi046.stdout:9/404: chown db/d53 1 1 2024-02-19T19:08:32.724 INFO:tasks.workunit.client.0.smithi046.stdout:7/712: mkdir d0/de2 0 2024-02-19T19:08:32.724 INFO:tasks.workunit.client.0.smithi046.stdout:7/713: chown d0/d4/l15 14814419 1 2024-02-19T19:08:32.727 INFO:tasks.workunit.client.0.smithi046.stdout:0/775: rename d0/d19/d8/d37/d80 to d0/d19/d88/d10b 0 2024-02-19T19:08:32.729 INFO:tasks.workunit.client.0.smithi046.stdout:9/405: mknod db/d1e/d32/c76 0 2024-02-19T19:08:32.731 INFO:tasks.workunit.client.0.smithi046.stdout:5/616: dread d2/dd/d29/d3b/fb3 [0,4194304] 0 2024-02-19T19:08:32.733 INFO:tasks.workunit.client.0.smithi046.stdout:0/776: rename d0/d19/d4d/da5/da7/fdb to d0/d19/db/df0/f10c 0 2024-02-19T19:08:32.745 INFO:tasks.workunit.client.0.smithi046.stdout:9/406: dread db/d53/f65 [0,4194304] 0 2024-02-19T19:08:32.746 INFO:tasks.workunit.client.0.smithi046.stdout:8/786: dwrite d3/dd/d13/d42/f57 [0,4194304] 0 2024-02-19T19:08:32.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/787: creat d3/dd/d13/d6b/d46/d54/f114 x:0 0 0 2024-02-19T19:08:32.749 INFO:tasks.workunit.client.0.smithi046.stdout:8/788: creat d3/dd/f115 x:0 0 0 2024-02-19T19:08:32.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/789: dread - d3/dd/d13/d66/dba/f10c zero size 2024-02-19T19:08:32.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/407: dread db/d20/f39 [0,4194304] 0 2024-02-19T19:08:32.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/408: chown f2 35 1 2024-02-19T19:08:32.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/409: fdatasync db/d1e/d52/f59 0 2024-02-19T19:08:32.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/410: dread - db/d1e/d32/d47/d5b/f75 zero size 2024-02-19T19:08:32.751 INFO:tasks.workunit.client.0.smithi046.stdout:7/714: dwrite d0/d45/d56/fb5 [4194304,4194304] 0 2024-02-19T19:08:32.751 INFO:tasks.workunit.client.0.smithi046.stdout:5/617: dwrite d2/dd/f37 [0,4194304] 0 2024-02-19T19:08:32.753 INFO:tasks.workunit.client.0.smithi046.stdout:7/715: mknod d0/d45/d4a/d58/dc6/d83/dd3/ce3 0 2024-02-19T19:08:32.754 INFO:tasks.workunit.client.0.smithi046.stdout:5/618: getdents d2/d27/d47 0 2024-02-19T19:08:32.756 INFO:tasks.workunit.client.0.smithi046.stdout:7/716: creat d0/d45/d71/d4b/fe4 x:0 0 0 2024-02-19T19:08:32.756 INFO:tasks.workunit.client.0.smithi046.stdout:9/411: dread db/d53/f65 [0,4194304] 0 2024-02-19T19:08:32.756 INFO:tasks.workunit.client.0.smithi046.stdout:5/619: symlink d2/dd/d29/d3b/lc6 0 2024-02-19T19:08:32.756 INFO:tasks.workunit.client.0.smithi046.stdout:5/620: fdatasync d2/d5e/f6d 0 2024-02-19T19:08:32.758 INFO:tasks.workunit.client.0.smithi046.stdout:0/777: dwrite d0/d24/f2a [0,4194304] 0 2024-02-19T19:08:32.764 INFO:tasks.workunit.client.0.smithi046.stdout:7/717: read d0/d45/d71/d4b/f57 [2988456,9266] 0 2024-02-19T19:08:32.764 INFO:tasks.workunit.client.0.smithi046.stdout:7/718: chown d0/d45/d4a/d58/dc6/d83/dd3/l54 112 1 2024-02-19T19:08:32.764 INFO:tasks.workunit.client.0.smithi046.stdout:7/719: chown d0/d45/d56/fb5 179291693 1 2024-02-19T19:08:32.766 INFO:tasks.workunit.client.0.smithi046.stdout:8/790: dread d3/dd/d13/f1b [0,4194304] 0 2024-02-19T19:08:32.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/720: mknod d0/d45/d71/da3/ce5 0 2024-02-19T19:08:32.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/721: chown d0/d45/d71/d4b/d8d/ldf 11000 1 2024-02-19T19:08:32.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/722: rmdir d0/d45/d4a/d58 39 2024-02-19T19:08:32.769 INFO:tasks.workunit.client.0.smithi046.stdout:8/791: dread d3/dd/d13/fbb [0,4194304] 0 2024-02-19T19:08:32.769 INFO:tasks.workunit.client.0.smithi046.stdout:8/792: chown d3/d9d/fc2 50917525 1 2024-02-19T19:08:32.770 INFO:tasks.workunit.client.0.smithi046.stdout:0/778: dread d0/d19/d8/d37/d58/fa4 [0,4194304] 0 2024-02-19T19:08:32.770 INFO:tasks.workunit.client.0.smithi046.stdout:8/793: unlink d3/dd/d13/d42/d72/f104 0 2024-02-19T19:08:32.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/794: chown d3/dd/d13/d6b/d46/d6a/db2/lbd 1 1 2024-02-19T19:08:32.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/795: rmdir d3/d37/d64/da2/dac 39 2024-02-19T19:08:32.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/796: write d3/dd/d3f/d49/d5b/f6d [4292839,127613] 0 2024-02-19T19:08:32.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/797: chown d3/d18/cb0 79385588 1 2024-02-19T19:08:32.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/798: symlink d3/d8b/l116 0 2024-02-19T19:08:32.774 INFO:tasks.workunit.client.0.smithi046.stdout:8/799: rename d3/d18/f1a to d3/d37/d111/f117 0 2024-02-19T19:08:32.774 INFO:tasks.workunit.client.0.smithi046.stdout:0/779: dread d0/d19/f91 [0,4194304] 0 2024-02-19T19:08:32.775 INFO:tasks.workunit.client.0.smithi046.stdout:0/780: read d0/d24/d56/da3/faf [363206,12371] 0 2024-02-19T19:08:32.775 INFO:tasks.workunit.client.0.smithi046.stdout:8/800: dread d3/dd/d3f/d49/d53/f5e [0,4194304] 0 2024-02-19T19:08:32.777 INFO:tasks.workunit.client.0.smithi046.stdout:0/781: symlink d0/d19/db/d6a/l10d 0 2024-02-19T19:08:32.779 INFO:tasks.workunit.client.0.smithi046.stdout:8/801: symlink d3/dd/d13/d6b/l118 0 2024-02-19T19:08:32.782 INFO:tasks.workunit.client.0.smithi046.stdout:5/621: dwrite d2/dd/d2f/d34/d5d/f43 [0,4194304] 0 2024-02-19T19:08:32.783 INFO:tasks.workunit.client.0.smithi046.stdout:5/622: symlink d2/dd/d26/da9/dc0/lc7 0 2024-02-19T19:08:32.783 INFO:tasks.workunit.client.0.smithi046.stdout:5/623: chown d2/dd/d2f/lbc 5480738 1 2024-02-19T19:08:32.784 INFO:tasks.workunit.client.0.smithi046.stdout:7/723: dwrite d0/d45/d71/d4b/f72 [0,4194304] 0 2024-02-19T19:08:32.785 INFO:tasks.workunit.client.0.smithi046.stdout:5/624: truncate d2/dd/f5c 168640 0 2024-02-19T19:08:32.787 INFO:tasks.workunit.client.0.smithi046.stdout:7/724: dread d0/d4/f3b [0,4194304] 0 2024-02-19T19:08:32.787 INFO:tasks.workunit.client.0.smithi046.stdout:5/625: symlink d2/dd/lc8 0 2024-02-19T19:08:32.788 INFO:tasks.workunit.client.0.smithi046.stdout:5/626: chown d2/dd/d29/f2a 7952606 1 2024-02-19T19:08:32.788 INFO:tasks.workunit.client.0.smithi046.stdout:5/627: write d2/dd/d26/daa/fb2 [10,64899] 0 2024-02-19T19:08:32.788 INFO:tasks.workunit.client.0.smithi046.stdout:7/725: mknod d0/d4/d68/ce6 0 2024-02-19T19:08:32.789 INFO:tasks.workunit.client.0.smithi046.stdout:5/628: rmdir d2/dd/d29 39 2024-02-19T19:08:32.791 INFO:tasks.workunit.client.0.smithi046.stdout:7/726: rename d0/d45/d4a/d58/dc6/d83/dd3/fba to d0/fe7 0 2024-02-19T19:08:32.792 INFO:tasks.workunit.client.0.smithi046.stdout:7/727: fsync d0/d45/d4a/d58/f39 0 2024-02-19T19:08:32.792 INFO:tasks.workunit.client.0.smithi046.stdout:7/728: fsync d0/d4/d24/fc4 0 2024-02-19T19:08:32.792 INFO:tasks.workunit.client.0.smithi046.stdout:7/729: fsync d0/d45/d71/f5b 0 2024-02-19T19:08:32.792 INFO:tasks.workunit.client.0.smithi046.stdout:7/730: fsync d0/d45/d4a/d78/d9d/fa0 0 2024-02-19T19:08:32.793 INFO:tasks.workunit.client.0.smithi046.stdout:7/731: getdents d0/d45/d4a/d58/d91 0 2024-02-19T19:08:32.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/732: mkdir d0/d45/d71/d41/db8/dd1/de8 0 2024-02-19T19:08:32.800 INFO:tasks.workunit.client.0.smithi046.stdout:5/629: write d2/dd/d29/d3b/fb3 [1530352,32432] 0 2024-02-19T19:08:32.801 INFO:tasks.workunit.client.0.smithi046.stdout:5/630: symlink d2/dd/d26/lc9 0 2024-02-19T19:08:32.801 INFO:tasks.workunit.client.0.smithi046.stdout:5/631: write d2/dd/d3f/faf [468465,59756] 0 2024-02-19T19:08:32.803 INFO:tasks.workunit.client.0.smithi046.stdout:5/632: mkdir d2/dd/d29/d89/dca 0 2024-02-19T19:08:32.807 INFO:tasks.workunit.client.0.smithi046.stdout:7/733: write d0/f48 [1887162,24922] 0 2024-02-19T19:08:32.808 INFO:tasks.workunit.client.0.smithi046.stdout:0/782: dwrite d0/f3c [0,4194304] 0 2024-02-19T19:08:32.808 INFO:tasks.workunit.client.0.smithi046.stdout:0/783: dread - d0/d24/d56/da3/f106 zero size 2024-02-19T19:08:32.808 INFO:tasks.workunit.client.0.smithi046.stdout:8/802: dwrite d3/d37/d64/da2/d3c/db6/fd0 [4194304,4194304] 0 2024-02-19T19:08:32.818 INFO:tasks.workunit.client.0.smithi046.stdout:7/734: rename d0/d45/d71/d41/lcc to d0/d4/le9 0 2024-02-19T19:08:32.819 INFO:tasks.workunit.client.0.smithi046.stdout:0/784: truncate d0/d5f/f73 884019 0 2024-02-19T19:08:32.819 INFO:tasks.workunit.client.0.smithi046.stdout:0/785: chown d0/d19/d4d/da5/da7/db8/d107 1 1 2024-02-19T19:08:32.819 INFO:tasks.workunit.client.0.smithi046.stdout:0/786: readlink d0/d19/d8/l21 0 2024-02-19T19:08:32.820 INFO:tasks.workunit.client.0.smithi046.stdout:8/803: truncate d3/d37/f71 84921 0 2024-02-19T19:08:32.820 INFO:tasks.workunit.client.0.smithi046.stdout:8/804: chown d3/d37/d64/d9a/cd3 0 1 2024-02-19T19:08:32.822 INFO:tasks.workunit.client.0.smithi046.stdout:7/735: dread d0/d4/fbd [0,4194304] 0 2024-02-19T19:08:32.822 INFO:tasks.workunit.client.0.smithi046.stdout:7/736: chown d0/d45/d71/da3/fb7 8062984 1 2024-02-19T19:08:32.824 INFO:tasks.workunit.client.0.smithi046.stdout:7/737: unlink d0/d45/d56/l99 0 2024-02-19T19:08:32.825 INFO:tasks.workunit.client.0.smithi046.stdout:7/738: truncate d0/d45/d71/d41/d5f/f76 792407 0 2024-02-19T19:08:32.825 INFO:tasks.workunit.client.0.smithi046.stdout:7/739: fsync d0/d4/f3c 0 2024-02-19T19:08:32.827 INFO:tasks.workunit.client.0.smithi046.stdout:5/633: dwrite d2/f40 [0,4194304] 0 2024-02-19T19:08:32.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:32 smithi046 ceph-mon[88928]: from='client.44199 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:32.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:32 smithi046 ceph-mon[88928]: pgmap v121: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 1.3 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 131 MiB/s rd, 154 MiB/s wr, 410 op/s; 6919/44139 objects degraded (15.675%) 2024-02-19T19:08:32.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:32 smithi046 ceph-mon[88928]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:32.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:32 smithi046 ceph-mon[88928]: from='osd.2 [v2:172.21.15.46:6818/3010717446,v1:172.21.15.46:6819/3010717446]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T19:08:32.832 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:32 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[112579]: 2024-02-19T19:08:32.521+0000 7fd84b1c57c0 -1 osd.2 73 log_to_monitors true 2024-02-19T19:08:32.835 INFO:tasks.workunit.client.0.smithi046.stdout:8/805: dread d3/dd/d3f/d49/d5b/d5f/da0/fb3 [0,4194304] 0 2024-02-19T19:08:32.837 INFO:tasks.workunit.client.0.smithi046.stdout:8/806: getdents d3/d37/d64/da2/d3c/db6 0 2024-02-19T19:08:32.837 INFO:tasks.workunit.client.0.smithi046.stdout:8/807: read - d3/d37/d64/da2/d3c/fa5 zero size 2024-02-19T19:08:32.852 INFO:tasks.workunit.client.0.smithi046.stdout:8/808: dread d3/dd/d13/d6b/d46/d6a/f91 [4194304,4194304] 0 2024-02-19T19:08:32.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/740: dwrite d0/d45/d71/d4b/f57 [0,4194304] 0 2024-02-19T19:08:32.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/741: fdatasync d0/d45/d4a/d78/f8e 0 2024-02-19T19:08:32.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/742: chown d0/d45/d71/d41/fa8 711449 1 2024-02-19T19:08:32.852 INFO:tasks.workunit.client.0.smithi046.stdout:8/809: mknod d3/dd/d3f/c119 0 2024-02-19T19:08:32.855 INFO:tasks.workunit.client.0.smithi046.stdout:7/743: link d0/d45/d71/d4b/l9c d0/d45/d71/lea 0 2024-02-19T19:08:32.855 INFO:tasks.workunit.client.0.smithi046.stdout:7/744: rename d0/d45/d4a/d58/f39 to d0/d45/d4a/d78/feb 0 2024-02-19T19:08:32.856 INFO:tasks.workunit.client.0.smithi046.stdout:7/745: mknod d0/d45/d4a/d58/dc6/d83/dd3/cec 0 2024-02-19T19:08:32.857 INFO:tasks.workunit.client.0.smithi046.stdout:7/746: fdatasync d0/d45/d71/da3/fb7 0 2024-02-19T19:08:32.858 INFO:tasks.workunit.client.0.smithi046.stdout:7/747: creat d0/d45/d4a/d58/d60/db4/fed x:0 0 0 2024-02-19T19:08:32.858 INFO:tasks.workunit.client.0.smithi046.stdout:7/748: write d0/d45/d71/da3/fb7 [621849,3962] 0 2024-02-19T19:08:32.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.849+0000 7fe5f7288700 1 -- 172.21.15.46:0/3057354557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5f00ff3c0 msgr2=0x7fe5f00ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:32.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.849+0000 7fe5f7288700 1 --2- 172.21.15.46:0/3057354557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5f00ff3c0 0x7fe5f00ff790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009910 tx=0x7fe5ec009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:32.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.849+0000 7fe5f7288700 1 -- 172.21.15.46:0/3057354557 shutdown_connections 2024-02-19T19:08:32.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.849+0000 7fe5f7288700 1 --2- 172.21.15.46:0/3057354557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f00ffd60 0x7fe5f0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.849+0000 7fe5f7288700 1 --2- 172.21.15.46:0/3057354557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5f00ff3c0 0x7fe5f00ff790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.849+0000 7fe5f7288700 1 -- 172.21.15.46:0/3057354557 >> 172.21.15.46:0/3057354557 conn(0x7fe5f00fac60 msgr2=0x7fe5f00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:32.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.849+0000 7fe5f7288700 1 -- 172.21.15.46:0/3057354557 shutdown_connections 2024-02-19T19:08:32.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.849+0000 7fe5f7288700 1 -- 172.21.15.46:0/3057354557 wait complete. 2024-02-19T19:08:32.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.850+0000 7fe5f7288700 1 Processor -- start 2024-02-19T19:08:32.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.850+0000 7fe5f7288700 1 -- start start 2024-02-19T19:08:32.872 INFO:tasks.workunit.client.0.smithi046.stdout:8/810: dwrite d3/dd/f115 [0,4194304] 0 2024-02-19T19:08:32.872 INFO:tasks.workunit.client.0.smithi046.stdout:8/811: creat d3/dd/d13/d6b/d46/d6a/f11a x:0 0 0 2024-02-19T19:08:32.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.850+0000 7fe5f7288700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f00ff3c0 0x7fe5f0198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:32.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.850+0000 7fe5f7288700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5f00ffd60 0x7fe5f0198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:32.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.850+0000 7fe5f7288700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0198d60 con 0x7fe5f00ffd60 2024-02-19T19:08:32.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.850+0000 7fe5f7288700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f019caf0 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.850+0000 7fe5f4823700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5f00ffd60 0x7fe5f0198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:32.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.850+0000 7fe5f5024700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f00ff3c0 0x7fe5f0198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:32.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.850+0000 7fe5f5024700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f00ff3c0 0x7fe5f0198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:36276/0 (socket says 172.21.15.46:36276) 2024-02-19T19:08:32.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.850+0000 7fe5f5024700 1 -- 172.21.15.46:0/1133793145 learned_addr learned my addr 172.21.15.46:0/1133793145 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:08:32.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.851+0000 7fe5f5024700 1 -- 172.21.15.46:0/1133793145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5f00ffd60 msgr2=0x7fe5f0198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:32.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.851+0000 7fe5f5024700 1 --2- 172.21.15.46:0/1133793145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5f00ffd60 0x7fe5f0198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:32.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.851+0000 7fe5f5024700 1 -- 172.21.15.46:0/1133793145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec0095f0 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.851+0000 7fe5f5024700 1 --2- 172.21.15.46:0/1133793145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f00ff3c0 0x7fe5f0198140 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec006010 tx=0x7fe5ec00bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:32.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.851+0000 7fe5e67fc700 1 -- 172.21.15.46:0/1133793145 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec01d070 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.851+0000 7fe5f7288700 1 -- 172.21.15.46:0/1133793145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f019cd70 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.851+0000 7fe5f7288700 1 -- 172.21.15.46:0/1133793145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f019d260 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.851+0000 7fe5e67fc700 1 -- 172.21.15.46:0/1133793145 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5ec005dc0 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.851+0000 7fe5e67fc700 1 -- 172.21.15.46:0/1133793145 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec017400 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.853+0000 7fe5f7288700 1 -- 172.21.15.46:0/1133793145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f01076d0 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/749: dwrite d0/d4/f7 [0,4194304] 0 2024-02-19T19:08:32.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/812: getdents d3/d37/dca 0 2024-02-19T19:08:32.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/813: read d3/dd/d3f/fcb [558671,87939] 0 2024-02-19T19:08:32.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/750: write d0/d45/d71/d41/d5f/f76 [75763,76441] 0 2024-02-19T19:08:32.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/814: readlink d3/d37/d64/de0/l112 0 2024-02-19T19:08:32.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/751: fsync d0/d45/d71/d4b/f57 0 2024-02-19T19:08:32.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/815: dread - d3/d37/d64/da2/d3c/fa5 zero size 2024-02-19T19:08:32.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/752: readlink d0/d4/l15 0 2024-02-19T19:08:32.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.854+0000 7fe5e67fc700 1 -- 172.21.15.46:0/1133793145 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe5ec003a60 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.854+0000 7fe5e67fc700 1 --2- 172.21.15.46:0/1133793145 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe5dc06d8a0 0x7fe5dc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:32.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.855+0000 7fe5f4823700 1 --2- 172.21.15.46:0/1133793145 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe5dc06d8a0 0x7fe5dc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:32.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.855+0000 7fe5e67fc700 1 -- 172.21.15.46:0/1133793145 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fe5ec08ea80 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.877 INFO:tasks.workunit.client.0.smithi046.stdout:8/816: rmdir d3/d37/df1 0 2024-02-19T19:08:32.878 INFO:tasks.workunit.client.0.smithi046.stdout:8/817: dread - d3/d37/dca/fe1 zero size 2024-02-19T19:08:32.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.855+0000 7fe5f4823700 1 --2- 172.21.15.46:0/1133793145 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe5dc06d8a0 0x7fe5dc06fd50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0199760 tx=0x7fe5e00073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:32.878 INFO:tasks.workunit.client.0.smithi046.stdout:8/818: mkdir d3/d37/d64/da2/d3c/dd9/d11b 0 2024-02-19T19:08:32.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:32.860+0000 7fe5e67fc700 1 -- 172.21.15.46:0/1133793145 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe5ec058130 con 0x7fe5f00ff3c0 2024-02-19T19:08:32.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/819: dwrite d3/dd/d3f/f7e [0,4194304] 0 2024-02-19T19:08:32.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/820: write d3/d37/f2e [1700335,76884] 0 2024-02-19T19:08:32.894 INFO:tasks.workunit.client.0.smithi046.stdout:8/821: mknod d3/dd/d13/d66/c11c 0 2024-02-19T19:08:32.895 INFO:tasks.workunit.client.0.smithi046.stdout:8/822: symlink d3/dd/d13/d6b/d46/d6a/l11d 0 2024-02-19T19:08:32.896 INFO:tasks.workunit.client.0.smithi046.stdout:7/753: dwrite d0/d45/d4a/d78/f8e [0,4194304] 0 2024-02-19T19:08:32.896 INFO:tasks.workunit.client.0.smithi046.stdout:7/754: chown d0/d45/d71/d41/db8/f8a 92 1 2024-02-19T19:08:32.897 INFO:tasks.workunit.client.0.smithi046.stdout:8/823: link d3/d37/d64/la8 d3/d37/d64/da2/d3c/dd9/d11b/l11e 0 2024-02-19T19:08:32.897 INFO:tasks.workunit.client.0.smithi046.stdout:8/824: dread - d3/d37/dca/fe2 zero size 2024-02-19T19:08:32.897 INFO:tasks.workunit.client.0.smithi046.stdout:8/825: stat d3/dd/d3f/d49/fff 0 2024-02-19T19:08:32.897 INFO:tasks.workunit.client.0.smithi046.stdout:8/826: fdatasync d3/dd/d3f/d49/d5b/f6d 0 2024-02-19T19:08:32.897 INFO:tasks.workunit.client.0.smithi046.stdout:8/827: fsync d3/dd/f15 0 2024-02-19T19:08:32.898 INFO:tasks.workunit.client.0.smithi046.stdout:7/755: mknod d0/d45/d4a/d58/d60/cee 0 2024-02-19T19:08:32.899 INFO:tasks.workunit.client.0.smithi046.stdout:7/756: write d0/d4/f29 [151894,100369] 0 2024-02-19T19:08:32.899 INFO:tasks.workunit.client.0.smithi046.stdout:8/828: truncate d3/dd/d3f/f103 2465987 0 2024-02-19T19:08:32.900 INFO:tasks.workunit.client.0.smithi046.stdout:8/829: creat d3/d37/d64/da2/dac/f11f x:0 0 0 2024-02-19T19:08:32.900 INFO:tasks.workunit.client.0.smithi046.stdout:8/830: creat d3/dd/d3f/d49/f120 x:0 0 0 2024-02-19T19:08:32.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/831: mknod d3/d37/d111/c121 0 2024-02-19T19:08:32.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/832: fsync d3/d9d/fc2 0 2024-02-19T19:08:32.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/833: write d3/dd/f15 [2118444,24411] 0 2024-02-19T19:08:32.911 INFO:tasks.workunit.client.0.smithi046.stdout:8/834: write d3/dd/d3f/d49/d5b/fbc [350051,10407] 0 2024-02-19T19:08:32.919 INFO:tasks.workunit.client.0.smithi046.stdout:7/757: dwrite d0/d45/d4a/d58/d60/db4/f3a [0,4194304] 0 2024-02-19T19:08:32.920 INFO:tasks.workunit.client.0.smithi046.stdout:7/758: creat d0/d45/d71/d4b/d8d/fef x:0 0 0 2024-02-19T19:08:32.922 INFO:tasks.workunit.client.0.smithi046.stdout:7/759: symlink d0/d45/d71/d41/db8/dd1/lf0 0 2024-02-19T19:08:32.923 INFO:tasks.workunit.client.0.smithi046.stdout:7/760: creat d0/d45/d4a/d58/dc6/ff1 x:0 0 0 2024-02-19T19:08:32.924 INFO:tasks.workunit.client.0.smithi046.stdout:7/761: mknod d0/d45/d71/d41/db8/cf2 0 2024-02-19T19:08:32.924 INFO:tasks.workunit.client.0.smithi046.stdout:7/762: write d0/d45/d4a/d78/fe0 [555676,60770] 0 2024-02-19T19:08:32.925 INFO:tasks.workunit.client.0.smithi046.stdout:8/835: write d3/d37/d64/f6c [4184438,14480] 0 2024-02-19T19:08:32.925 INFO:tasks.workunit.client.0.smithi046.stdout:8/836: write d3/dd/d3f/f60 [2189114,111437] 0 2024-02-19T19:08:32.925 INFO:tasks.workunit.client.0.smithi046.stdout:7/763: mknod d0/d45/d71/d41/d5f/cf3 0 2024-02-19T19:08:32.927 INFO:tasks.workunit.client.0.smithi046.stdout:8/837: mkdir d3/d37/d9b/de9/d122 0 2024-02-19T19:08:32.927 INFO:tasks.workunit.client.0.smithi046.stdout:8/838: write d3/d37/d64/da2/d3c/f43 [392950,93195] 0 2024-02-19T19:08:32.948 INFO:tasks.workunit.client.0.smithi046.stdout:8/839: dwrite d3/dd/f96 [0,4194304] 0 2024-02-19T19:08:32.950 INFO:tasks.workunit.client.0.smithi046.stdout:8/840: link d3/d37/d64/de0/l112 d3/d37/d9b/de9/d122/l123 0 2024-02-19T19:08:32.951 INFO:tasks.workunit.client.0.smithi046.stdout:8/841: dread d3/d37/dca/fe3 [0,4194304] 0 2024-02-19T19:08:32.951 INFO:tasks.workunit.client.0.smithi046.stdout:8/842: truncate d3/dd/d13/f100 426693 0 2024-02-19T19:08:32.951 INFO:tasks.workunit.client.0.smithi046.stdout:8/843: chown d3/d37/d64/cb7 155 1 2024-02-19T19:08:33.096 INFO:tasks.workunit.client.0.smithi046.stdout:6/545: sync 2024-02-19T19:08:33.096 INFO:tasks.workunit.client.0.smithi046.stdout:1/591: sync 2024-02-19T19:08:33.096 INFO:tasks.workunit.client.0.smithi046.stdout:2/781: sync 2024-02-19T19:08:33.097 INFO:tasks.workunit.client.0.smithi046.stdout:1/592: unlink d5/d13/d35/f9e 0 2024-02-19T19:08:33.098 INFO:tasks.workunit.client.0.smithi046.stdout:2/782: creat d5/d6/d13/d8a/f103 x:0 0 0 2024-02-19T19:08:33.100 INFO:tasks.workunit.client.0.smithi046.stdout:6/546: rmdir d4/d6/dd 39 2024-02-19T19:08:33.100 INFO:tasks.workunit.client.0.smithi046.stdout:2/783: symlink d5/d2c/d89/d3f/d82/dd0/l104 0 2024-02-19T19:08:33.102 INFO:tasks.workunit.client.0.smithi046.stdout:2/784: getdents d5/d2c/d89/d3f/d82 0 2024-02-19T19:08:33.110 INFO:tasks.workunit.client.0.smithi046.stdout:6/547: write d4/d6/fa3 [383882,23868] 0 2024-02-19T19:08:33.113 INFO:tasks.workunit.client.0.smithi046.stdout:1/593: dwrite d5/d13/f29 [0,4194304] 0 2024-02-19T19:08:33.114 INFO:tasks.workunit.client.0.smithi046.stdout:1/594: creat d5/d13/d35/d37/d64/d87/fc7 x:0 0 0 2024-02-19T19:08:33.117 INFO:tasks.workunit.client.0.smithi046.stdout:1/595: creat d5/d2f/d9f/d55/d81/d80/daf/db5/dbe/fc8 x:0 0 0 2024-02-19T19:08:33.117 INFO:tasks.workunit.client.0.smithi046.stdout:2/785: dwrite d5/d6/fc [0,4194304] 0 2024-02-19T19:08:33.117 INFO:tasks.workunit.client.0.smithi046.stdout:2/786: chown d5/d2c/d89/d3f/d5c/d9f/dda/df1/l101 43870091 1 2024-02-19T19:08:33.120 INFO:tasks.workunit.client.0.smithi046.stdout:2/787: rename d5/d2c/d45/d9b/dcb to d5/d2c/d45/de7/d105 0 2024-02-19T19:08:33.122 INFO:tasks.workunit.client.0.smithi046.stdout:6/548: write d4/d6/dd/d10/d29/f36 [2146269,50757] 0 2024-02-19T19:08:33.123 INFO:tasks.workunit.client.0.smithi046.stdout:6/549: mkdir d4/d6/d22/db0 0 2024-02-19T19:08:33.124 INFO:tasks.workunit.client.0.smithi046.stdout:1/596: dread d5/d13/f83 [0,4194304] 0 2024-02-19T19:08:33.124 INFO:tasks.workunit.client.0.smithi046.stdout:1/597: chown d5/d2f/d9f/d3b/d3c/d3f/f43 326 1 2024-02-19T19:08:33.130 INFO:tasks.workunit.client.0.smithi046.stdout:2/788: dread d5/fe9 [0,4194304] 0 2024-02-19T19:08:33.130 INFO:tasks.workunit.client.0.smithi046.stdout:2/789: chown d5/d2c/f7d 6342813 1 2024-02-19T19:08:33.132 INFO:tasks.workunit.client.0.smithi046.stdout:2/790: creat d5/d2c/d45/de7/f106 x:0 0 0 2024-02-19T19:08:33.134 INFO:tasks.workunit.client.0.smithi046.stdout:2/791: link d5/d2c/f5f d5/d2c/d89/d92/f107 0 2024-02-19T19:08:33.134 INFO:tasks.workunit.client.0.smithi046.stdout:2/792: dread - d5/d2c/d56/da5/da9/fc0 zero size 2024-02-19T19:08:33.136 INFO:tasks.workunit.client.0.smithi046.stdout:6/550: dread d4/f6a [0,4194304] 0 2024-02-19T19:08:33.136 INFO:tasks.workunit.client.0.smithi046.stdout:6/551: stat d4/d6/d1c/d20/d7a/fa4 0 2024-02-19T19:08:33.136 INFO:tasks.workunit.client.0.smithi046.stdout:6/552: creat d4/d6/d22/fb1 x:0 0 0 2024-02-19T19:08:33.136 INFO:tasks.workunit.client.0.smithi046.stdout:6/553: readlink d4/d6/dd/d10/d29/d2d/d35/d66/l92 0 2024-02-19T19:08:33.137 INFO:tasks.workunit.client.0.smithi046.stdout:6/554: read d4/d6/dd/d10/d29/f36 [4126208,54822] 0 2024-02-19T19:08:33.137 INFO:tasks.workunit.client.0.smithi046.stdout:6/555: stat d4/d6/d22/db0 0 2024-02-19T19:08:33.138 INFO:tasks.workunit.client.0.smithi046.stdout:6/556: symlink d4/d6/dd/d10/d29/da2/lb2 0 2024-02-19T19:08:33.139 INFO:tasks.workunit.client.0.smithi046.stdout:6/557: truncate d4/d6/dd/d10/d29/d2d/d35/f79 1941525 0 2024-02-19T19:08:33.141 INFO:tasks.workunit.client.0.smithi046.stdout:6/558: creat d4/d6/dd/d10/d29/d2d/d35/fb3 x:0 0 0 2024-02-19T19:08:33.141 INFO:tasks.workunit.client.0.smithi046.stdout:6/559: chown d4/d6/dd/d10/d29/d2d/d35 2 1 2024-02-19T19:08:33.141 INFO:tasks.workunit.client.0.smithi046.stdout:1/598: dwrite d5/d2f/d9f/d55/d81/d80/daf/db5/fbd [0,4194304] 0 2024-02-19T19:08:33.142 INFO:tasks.workunit.client.0.smithi046.stdout:6/560: creat d4/d6/dd/d10/d29/d2d/fb4 x:0 0 0 2024-02-19T19:08:33.144 INFO:tasks.workunit.client.0.smithi046.stdout:2/793: dread f1 [0,4194304] 0 2024-02-19T19:08:33.150 INFO:tasks.workunit.client.0.smithi046.stdout:6/561: write d4/d6/f1a [3526835,126951] 0 2024-02-19T19:08:33.151 INFO:tasks.workunit.client.0.smithi046.stdout:1/599: truncate d5/d13/d35/f36 970578 0 2024-02-19T19:08:33.161 INFO:tasks.workunit.client.0.smithi046.stdout:1/600: dread d5/d2f/d9f/d3b/d3c/d3f/f43 [0,4194304] 0 2024-02-19T19:08:33.163 INFO:tasks.workunit.client.0.smithi046.stdout:6/562: write d4/d6/d8e/f90 [782733,60289] 0 2024-02-19T19:08:33.163 INFO:tasks.workunit.client.0.smithi046.stdout:1/601: mkdir d5/d2f/d9f/dc9 0 2024-02-19T19:08:33.163 INFO:tasks.workunit.client.0.smithi046.stdout:1/602: truncate d5/d13/f31 4745126 0 2024-02-19T19:08:33.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/603: symlink d5/d21/lca 0 2024-02-19T19:08:33.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/604: truncate d5/d13/d35/d37/d64/d75/f86 4476669 0 2024-02-19T19:08:33.165 INFO:tasks.workunit.client.0.smithi046.stdout:1/605: symlink d5/d13/d35/d37/db0/lcb 0 2024-02-19T19:08:33.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/794: dwrite d5/d6/fa [0,4194304] 0 2024-02-19T19:08:33.171 INFO:tasks.workunit.client.0.smithi046.stdout:2/795: unlink d5/d2c/d89/d4c/c4e 0 2024-02-19T19:08:33.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/606: write d5/d13/f83 [2245612,121261] 0 2024-02-19T19:08:33.173 INFO:tasks.workunit.client.0.smithi046.stdout:2/796: mkdir d5/d2c/d89/d3f/d5c/d9f/dda/d108 0 2024-02-19T19:08:33.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/563: dread d4/d6/d1c/d20/f4d [0,4194304] 0 2024-02-19T19:08:33.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/564: write d4/d6/dd/f56 [1044904,93664] 0 2024-02-19T19:08:33.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/565: fdatasync d4/d6/dd/d10/d29/d2d/d35/f79 0 2024-02-19T19:08:33.175 INFO:tasks.workunit.client.0.smithi046.stdout:1/607: symlink d5/d2f/d9f/d55/d81/d80/daf/lcc 0 2024-02-19T19:08:33.176 INFO:tasks.workunit.client.0.smithi046.stdout:2/797: mknod d5/d2c/d89/d3f/d5c/dd5/c109 0 2024-02-19T19:08:33.176 INFO:tasks.workunit.client.0.smithi046.stdout:2/798: write d5/d2c/d35/f52 [916036,56514] 0 2024-02-19T19:08:33.176 INFO:tasks.workunit.client.0.smithi046.stdout:2/799: creat d5/d2c/d89/d4c/f10a x:0 0 0 2024-02-19T19:08:33.177 INFO:tasks.workunit.client.0.smithi046.stdout:6/566: rename d4/d6/d1c/c69 to d4/d6/d22/db0/cb5 0 2024-02-19T19:08:33.179 INFO:tasks.workunit.client.0.smithi046.stdout:1/608: link d5/d13/f29 d5/d13/d35/d37/d64/d87/fcd 0 2024-02-19T19:08:33.180 INFO:tasks.workunit.client.0.smithi046.stdout:2/800: mkdir d5/d6/d6e/dab/d10b 0 2024-02-19T19:08:33.183 INFO:tasks.workunit.client.0.smithi046.stdout:1/609: mkdir d5/d13/d35/d37/d64/dce 0 2024-02-19T19:08:33.184 INFO:tasks.workunit.client.0.smithi046.stdout:2/801: creat d5/d2c/d89/d4c/d75/dbe/f10c x:0 0 0 2024-02-19T19:08:33.187 INFO:tasks.workunit.client.0.smithi046.stdout:6/567: rmdir d4/d6/d1c/d20 39 2024-02-19T19:08:33.189 INFO:tasks.workunit.client.0.smithi046.stdout:1/610: mkdir d5/d13/d35/d37/d64/d75/dcf 0 2024-02-19T19:08:33.190 INFO:tasks.workunit.client.0.smithi046.stdout:6/568: mkdir d4/d6/d22/db0/db6 0 2024-02-19T19:08:33.190 INFO:tasks.workunit.client.0.smithi046.stdout:6/569: write d4/d6/d1c/fae [76155,82635] 0 2024-02-19T19:08:33.192 INFO:tasks.workunit.client.0.smithi046.stdout:6/570: mkdir d4/d6/dd/d10/d29/da2/db7 0 2024-02-19T19:08:33.192 INFO:tasks.workunit.client.0.smithi046.stdout:6/571: write d4/d6/dd/d10/f13 [1951047,24466] 0 2024-02-19T19:08:33.192 INFO:tasks.workunit.client.0.smithi046.stdout:6/572: stat d4/d6/dd/f21 0 2024-02-19T19:08:33.194 INFO:tasks.workunit.client.0.smithi046.stdout:1/611: rename d5/d2f/d9f/d55/d81 to d5/d21/d9a/dd0 0 2024-02-19T19:08:33.194 INFO:tasks.workunit.client.0.smithi046.stdout:2/802: dread d5/d2c/f3c [0,4194304] 0 2024-02-19T19:08:33.194 INFO:tasks.workunit.client.0.smithi046.stdout:2/803: dread - d5/d6/d13/d8a/fb2 zero size 2024-02-19T19:08:33.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/804: rename d5/d6/l3b to d5/d2c/d45/d9b/l10d 0 2024-02-19T19:08:33.197 INFO:tasks.workunit.client.0.smithi046.stdout:2/805: rename d5/d6/d13/c9e to d5/d2c/d89/c10e 0 2024-02-19T19:08:33.198 INFO:tasks.workunit.client.0.smithi046.stdout:2/806: mkdir d5/d2c/d89/d3f/d5c/d9f/d10f 0 2024-02-19T19:08:33.198 INFO:tasks.workunit.client.0.smithi046.stdout:2/807: readlink d5/d6/l84 0 2024-02-19T19:08:33.200 INFO:tasks.workunit.client.0.smithi046.stdout:2/808: mknod d5/d2c/d45/de7/c110 0 2024-02-19T19:08:33.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:32 smithi142 ceph-mon[69118]: from='client.44199 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:33.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:32 smithi142 ceph-mon[69118]: pgmap v121: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 1.3 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 131 MiB/s rd, 154 MiB/s wr, 410 op/s; 6919/44139 objects degraded (15.675%) 2024-02-19T19:08:33.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:32 smithi142 ceph-mon[69118]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:33.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:32 smithi142 ceph-mon[69118]: from='osd.2 [v2:172.21.15.46:6818/3010717446,v1:172.21.15.46:6819/3010717446]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T19:08:33.202 INFO:tasks.workunit.client.0.smithi046.stdout:1/612: dread d5/d21/faa [0,4194304] 0 2024-02-19T19:08:33.202 INFO:tasks.workunit.client.0.smithi046.stdout:1/613: chown d5/d21/d9a/dd0/d80/daf/c74 6817546 1 2024-02-19T19:08:33.203 INFO:tasks.workunit.client.0.smithi046.stdout:6/573: fdatasync d4/d6/d8e/f90 0 2024-02-19T19:08:33.203 INFO:tasks.workunit.client.0.smithi046.stdout:6/574: read - d4/d6/dd/f57 zero size 2024-02-19T19:08:33.204 INFO:tasks.workunit.client.0.smithi046.stdout:6/575: creat d4/fb8 x:0 0 0 2024-02-19T19:08:33.204 INFO:tasks.workunit.client.0.smithi046.stdout:6/576: chown d4/d6/d1c/l68 36 1 2024-02-19T19:08:33.207 INFO:tasks.workunit.client.0.smithi046.stdout:1/614: dread d5/d13/f19 [0,4194304] 0 2024-02-19T19:08:33.209 INFO:tasks.workunit.client.0.smithi046.stdout:1/615: creat d5/d21/d9a/dd0/fd1 x:0 0 0 2024-02-19T19:08:33.209 INFO:tasks.workunit.client.0.smithi046.stdout:1/616: write d5/d21/d9a/dd0/f5d [4470882,95880] 0 2024-02-19T19:08:33.211 INFO:tasks.workunit.client.0.smithi046.stdout:2/809: dread d5/d6/d13/d7c/fc8 [0,4194304] 0 2024-02-19T19:08:33.211 INFO:tasks.workunit.client.0.smithi046.stdout:2/810: write d5/d2c/d89/f6f [998076,38457] 0 2024-02-19T19:08:33.211 INFO:tasks.workunit.client.0.smithi046.stdout:2/811: truncate d5/d2c/d35/f52 1731603 0 2024-02-19T19:08:33.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/577: dread d4/d6/dd/d10/d29/d2d/f47 [4194304,4194304] 0 2024-02-19T19:08:33.221 INFO:tasks.workunit.client.0.smithi046.stdout:6/578: write d4/d6/d1c/d20/f4d [111279,54761] 0 2024-02-19T19:08:33.222 INFO:tasks.workunit.client.0.smithi046.stdout:6/579: getdents d4/d6/d1c/d20 0 2024-02-19T19:08:33.223 INFO:tasks.workunit.client.0.smithi046.stdout:1/617: write d5/d21/d9a/dd0/d80/daf/db5/fbd [3811742,121761] 0 2024-02-19T19:08:33.225 INFO:tasks.workunit.client.0.smithi046.stdout:6/580: creat d4/d6/dd/d10/d29/da2/db7/fb9 x:0 0 0 2024-02-19T19:08:33.225 INFO:tasks.workunit.client.0.smithi046.stdout:1/618: mkdir d5/d21/d9a/dd0/d80/daf/db5/dd2 0 2024-02-19T19:08:33.225 INFO:tasks.workunit.client.0.smithi046.stdout:2/812: dread d5/d6/d13/f61 [0,4194304] 0 2024-02-19T19:08:33.225 INFO:tasks.workunit.client.0.smithi046.stdout:2/813: chown d5/d2c/d35/d80 0 1 2024-02-19T19:08:33.227 INFO:tasks.workunit.client.0.smithi046.stdout:4/742: sync 2024-02-19T19:08:33.227 INFO:tasks.workunit.client.0.smithi046.stdout:3/456: sync 2024-02-19T19:08:33.227 INFO:tasks.workunit.client.0.smithi046.stdout:3/457: fsync da/d30/d38/f56 0 2024-02-19T19:08:33.227 INFO:tasks.workunit.client.0.smithi046.stdout:3/458: chown da/d1d/d10 345 1 2024-02-19T19:08:33.228 INFO:tasks.workunit.client.0.smithi046.stdout:4/743: chown d6/d11/ca8 121420 1 2024-02-19T19:08:33.228 INFO:tasks.workunit.client.0.smithi046.stdout:4/744: write d6/d11/dd6/d89/f91 [1913072,44613] 0 2024-02-19T19:08:33.228 INFO:tasks.workunit.client.0.smithi046.stdout:2/814: dread d5/d2c/d89/d3f/d5c/dee/ffb [0,4194304] 0 2024-02-19T19:08:33.231 INFO:tasks.workunit.client.0.smithi046.stdout:6/581: write d4/f28 [1379452,11212] 0 2024-02-19T19:08:33.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/459: rename da/d1d/d10/f50 to da/d1d/d63/d64/f7b 0 2024-02-19T19:08:33.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/460: fsync da/d1d/d10/f6e 0 2024-02-19T19:08:33.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/461: fsync da/d30/d38/f6f 0 2024-02-19T19:08:33.232 INFO:tasks.workunit.client.0.smithi046.stdout:3/462: fsync da/d30/f44 0 2024-02-19T19:08:33.232 INFO:tasks.workunit.client.0.smithi046.stdout:3/463: chown da/d1d/d10/f58 3 1 2024-02-19T19:08:33.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/464: getdents da/d30 0 2024-02-19T19:08:33.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/465: write da/d30/d38/d54/f5d [4208524,83577] 0 2024-02-19T19:08:33.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/466: read - da/d30/d38/d54/f5b zero size 2024-02-19T19:08:33.235 INFO:tasks.workunit.client.0.smithi046.stdout:2/815: rename d5/d6/d13/d8a/fb2 to d5/d7a/f111 0 2024-02-19T19:08:33.240 INFO:tasks.workunit.client.0.smithi046.stdout:3/467: symlink da/l7c 0 2024-02-19T19:08:33.240 INFO:tasks.workunit.client.0.smithi046.stdout:3/468: dread - da/d1d/d10/f58 zero size 2024-02-19T19:08:33.242 INFO:tasks.workunit.client.0.smithi046.stdout:2/816: truncate d5/d6/f23 2458292 0 2024-02-19T19:08:33.242 INFO:tasks.workunit.client.0.smithi046.stdout:2/817: creat d5/d6a/f112 x:0 0 0 2024-02-19T19:08:33.242 INFO:tasks.workunit.client.0.smithi046.stdout:2/818: readlink d5/d2c/d89/d3f/d5c/d9f/ld4 0 2024-02-19T19:08:33.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/619: dwrite d5/d13/d35/f41 [0,4194304] 0 2024-02-19T19:08:33.252 INFO:tasks.workunit.client.0.smithi046.stdout:1/620: mkdir d5/d21/d9a/dd0/d80/daf/db5/dbe/dd3 0 2024-02-19T19:08:33.254 INFO:tasks.workunit.client.0.smithi046.stdout:1/621: creat d5/d2f/d9f/d3b/d4e/fd4 x:0 0 0 2024-02-19T19:08:33.254 INFO:tasks.workunit.client.0.smithi046.stdout:1/622: read d5/d13/f19 [843150,128331] 0 2024-02-19T19:08:33.254 INFO:tasks.workunit.client.0.smithi046.stdout:1/623: readlink d5/d13/d35/d37/l58 0 2024-02-19T19:08:33.255 INFO:tasks.workunit.client.0.smithi046.stdout:6/582: rmdir d4 39 2024-02-19T19:08:33.255 INFO:tasks.workunit.client.0.smithi046.stdout:6/583: read d4/f39 [692288,48800] 0 2024-02-19T19:08:33.255 INFO:tasks.workunit.client.0.smithi046.stdout:6/584: write d4/d6/d8e/f90 [3887646,115077] 0 2024-02-19T19:08:33.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/624: mkdir d5/d21/d9a/dd5 0 2024-02-19T19:08:33.256 INFO:tasks.workunit.client.0.smithi046.stdout:6/585: read d4/f8f [521634,48866] 0 2024-02-19T19:08:33.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/625: write d5/d21/d9a/dd0/fd1 [604863,29827] 0 2024-02-19T19:08:33.258 INFO:tasks.workunit.client.0.smithi046.stdout:1/626: creat d5/d2f/d9f/d3b/d3c/d3f/fd6 x:0 0 0 2024-02-19T19:08:33.258 INFO:tasks.workunit.client.0.smithi046.stdout:1/627: truncate d5/d13/d35/d37/d64/fab 4219752 0 2024-02-19T19:08:33.259 INFO:tasks.workunit.client.0.smithi046.stdout:1/628: mknod d5/d13/d35/cd7 0 2024-02-19T19:08:33.259 INFO:tasks.workunit.client.0.smithi046.stdout:1/629: write d5/d13/d35/d37/fa9 [5084347,79458] 0 2024-02-19T19:08:33.261 INFO:tasks.workunit.client.0.smithi046.stdout:1/630: unlink d5/d21/d9a/dd0/f57 0 2024-02-19T19:08:33.263 INFO:tasks.workunit.client.0.smithi046.stdout:1/631: creat d5/d2f/d9f/d3b/fd8 x:0 0 0 2024-02-19T19:08:33.264 INFO:tasks.workunit.client.0.smithi046.stdout:1/632: truncate d5/d21/faa 3574219 0 2024-02-19T19:08:33.265 INFO:tasks.workunit.client.0.smithi046.stdout:3/469: dwrite da/d1d/d10/f5e [0,4194304] 0 2024-02-19T19:08:33.265 INFO:tasks.workunit.client.0.smithi046.stdout:2/819: dwrite d5/d2c/f3c [0,4194304] 0 2024-02-19T19:08:33.269 INFO:tasks.workunit.client.0.smithi046.stdout:3/470: link da/d30/d38/f4a da/d30/d38/f7d 0 2024-02-19T19:08:33.271 INFO:tasks.workunit.client.0.smithi046.stdout:3/471: mknod da/d30/c7e 0 2024-02-19T19:08:33.271 INFO:tasks.workunit.client.0.smithi046.stdout:3/472: write da/d30/d38/d66/f69 [386274,94346] 0 2024-02-19T19:08:33.272 INFO:tasks.workunit.client.0.smithi046.stdout:3/473: mknod da/d1d/d3f/c7f 0 2024-02-19T19:08:33.273 INFO:tasks.workunit.client.0.smithi046.stdout:3/474: write da/d30/f57 [2885359,118218] 0 2024-02-19T19:08:33.275 INFO:tasks.workunit.client.0.smithi046.stdout:3/475: rename da/c18 to da/d1d/d63/d64/d74/c80 0 2024-02-19T19:08:33.276 INFO:tasks.workunit.client.0.smithi046.stdout:6/586: dwrite d4/d6/dd/f57 [0,4194304] 0 2024-02-19T19:08:33.279 INFO:tasks.workunit.client.0.smithi046.stdout:2/820: write d5/d6/f23 [477302,15815] 0 2024-02-19T19:08:33.279 INFO:tasks.workunit.client.0.smithi046.stdout:2/821: write d5/d2c/d89/d4c/d75/fb8 [83411,123993] 0 2024-02-19T19:08:33.283 INFO:tasks.workunit.client.0.smithi046.stdout:6/587: truncate d4/d6/dd/d10/d29/f48 3767963 0 2024-02-19T19:08:33.283 INFO:tasks.workunit.client.0.smithi046.stdout:6/588: readlink d4/l52 0 2024-02-19T19:08:33.286 INFO:tasks.workunit.client.0.smithi046.stdout:2/822: unlink d5/d2c/d89/d3f/d5c/dee/l100 0 2024-02-19T19:08:33.286 INFO:tasks.workunit.client.0.smithi046.stdout:2/823: write d5/d2c/d35/d80/f96 [1578461,89302] 0 2024-02-19T19:08:33.289 INFO:tasks.workunit.client.0.smithi046.stdout:3/476: write da/d30/d38/f6f [1606765,127282] 0 2024-02-19T19:08:33.290 INFO:tasks.workunit.client.0.smithi046.stdout:3/477: symlink da/d30/d38/d66/l81 0 2024-02-19T19:08:33.290 INFO:tasks.workunit.client.0.smithi046.stdout:3/478: chown da/d30/d38/c70 71 1 2024-02-19T19:08:33.294 INFO:tasks.workunit.client.0.smithi046.stdout:6/589: read d4/d6/dd/d10/d29/d2d/f47 [5335416,51002] 0 2024-02-19T19:08:33.295 INFO:tasks.workunit.client.0.smithi046.stdout:9/412: sync 2024-02-19T19:08:33.295 INFO:tasks.workunit.client.0.smithi046.stdout:9/413: write db/d20/d6b/d54/f70 [109810,41826] 0 2024-02-19T19:08:33.295 INFO:tasks.workunit.client.0.smithi046.stdout:6/590: creat d4/d6/dd/d10/d29/d2d/d35/fba x:0 0 0 2024-02-19T19:08:33.297 INFO:tasks.workunit.client.0.smithi046.stdout:6/591: symlink d4/d6/d1c/d20/d7a/lbb 0 2024-02-19T19:08:33.298 INFO:tasks.workunit.client.0.smithi046.stdout:6/592: symlink d4/d6/d22/lbc 0 2024-02-19T19:08:33.299 INFO:tasks.workunit.client.0.smithi046.stdout:6/593: stat d4/d6/d1c/f51 0 2024-02-19T19:08:33.299 INFO:tasks.workunit.client.0.smithi046.stdout:6/594: stat d4/d6/d22/db0 0 2024-02-19T19:08:33.300 INFO:tasks.workunit.client.0.smithi046.stdout:2/824: dread d5/d2c/d45/f9c [0,4194304] 0 2024-02-19T19:08:33.303 INFO:tasks.workunit.client.0.smithi046.stdout:6/595: unlink d4/d6/d1c/d64/l7e 0 2024-02-19T19:08:33.304 INFO:tasks.workunit.client.0.smithi046.stdout:2/825: rename d5/d2c/d56/c62 to d5/d6/c113 0 2024-02-19T19:08:33.307 INFO:tasks.workunit.client.0.smithi046.stdout:9/414: write db/d1e/d32/f61 [958125,21651] 0 2024-02-19T19:08:33.308 INFO:tasks.workunit.client.0.smithi046.stdout:2/826: dread d5/d2c/d56/d5a/fac [0,4194304] 0 2024-02-19T19:08:33.308 INFO:tasks.workunit.client.0.smithi046.stdout:9/415: chown f2 1923 1 2024-02-19T19:08:33.308 INFO:tasks.workunit.client.0.smithi046.stdout:9/416: truncate db/d1e/d32/d47/d5b/f68 795687 0 2024-02-19T19:08:33.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/479: dwrite da/d1d/d10/f5e [0,4194304] 0 2024-02-19T19:08:33.310 INFO:tasks.workunit.client.0.smithi046.stdout:2/827: truncate d5/fe9 2979475 0 2024-02-19T19:08:33.310 INFO:tasks.workunit.client.0.smithi046.stdout:2/828: write d5/d2c/d89/d3f/d5c/fe3 [527105,126094] 0 2024-02-19T19:08:33.313 INFO:tasks.workunit.client.0.smithi046.stdout:3/480: mkdir da/d1d/d82 0 2024-02-19T19:08:33.313 INFO:tasks.workunit.client.0.smithi046.stdout:3/481: fsync da/d1d/f60 0 2024-02-19T19:08:33.313 INFO:tasks.workunit.client.0.smithi046.stdout:2/829: mkdir d5/d7a/df0/d114 0 2024-02-19T19:08:33.314 INFO:tasks.workunit.client.0.smithi046.stdout:9/417: read db/d53/f65 [2347240,69976] 0 2024-02-19T19:08:33.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/482: rmdir da/d30/d38/d54 39 2024-02-19T19:08:33.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/483: chown da/d1d/d63/d64/d74/f75 11492 1 2024-02-19T19:08:33.316 INFO:tasks.workunit.client.0.smithi046.stdout:2/830: creat d5/d2c/d56/da5/f115 x:0 0 0 2024-02-19T19:08:33.318 INFO:tasks.workunit.client.0.smithi046.stdout:3/484: dread da/d1d/d10/f1b [0,4194304] 0 2024-02-19T19:08:33.319 INFO:tasks.workunit.client.0.smithi046.stdout:9/418: unlink db/d20/f3c 0 2024-02-19T19:08:33.319 INFO:tasks.workunit.client.0.smithi046.stdout:9/419: truncate db/d20/d4e/f6a 107798 0 2024-02-19T19:08:33.320 INFO:tasks.workunit.client.0.smithi046.stdout:9/420: write db/d1e/f22 [1491721,117362] 0 2024-02-19T19:08:33.320 INFO:tasks.workunit.client.0.smithi046.stdout:9/421: write db/d1e/d32/d47/d5b/f68 [1707510,15945] 0 2024-02-19T19:08:33.323 INFO:tasks.workunit.client.0.smithi046.stdout:9/422: mknod db/d1e/d32/c77 0 2024-02-19T19:08:33.324 INFO:tasks.workunit.client.0.smithi046.stdout:3/485: getdents da/d30/d38 0 2024-02-19T19:08:33.326 INFO:tasks.workunit.client.0.smithi046.stdout:9/423: unlink db/d1e/l64 0 2024-02-19T19:08:33.327 INFO:tasks.workunit.client.0.smithi046.stdout:3/486: mkdir da/d1d/d63/d64/d74/d83 0 2024-02-19T19:08:33.328 INFO:tasks.workunit.client.0.smithi046.stdout:9/424: symlink db/d20/d6b/d54/l78 0 2024-02-19T19:08:33.328 INFO:tasks.workunit.client.0.smithi046.stdout:3/487: dread da/d30/d38/d66/f67 [0,4194304] 0 2024-02-19T19:08:33.329 INFO:tasks.workunit.client.0.smithi046.stdout:9/425: symlink db/d20/d6b/d54/l79 0 2024-02-19T19:08:33.329 INFO:tasks.workunit.client.0.smithi046.stdout:9/426: creat db/d20/d4e/f7a x:0 0 0 2024-02-19T19:08:33.330 INFO:tasks.workunit.client.0.smithi046.stdout:2/831: dread d5/d2c/d45/fbd [0,4194304] 0 2024-02-19T19:08:33.330 INFO:tasks.workunit.client.0.smithi046.stdout:6/596: dwrite d4/d6/dd/d10/f15 [4194304,4194304] 0 2024-02-19T19:08:33.330 INFO:tasks.workunit.client.0.smithi046.stdout:6/597: write d4/d6/d1c/f75 [2924322,25280] 0 2024-02-19T19:08:33.332 INFO:tasks.workunit.client.0.smithi046.stdout:9/427: rename db/f41 to db/f7b 0 2024-02-19T19:08:33.332 INFO:tasks.workunit.client.0.smithi046.stdout:9/428: dread - db/d20/d6b/f6e zero size 2024-02-19T19:08:33.333 INFO:tasks.workunit.client.0.smithi046.stdout:9/429: mkdir db/d1e/d32/d7c 0 2024-02-19T19:08:33.335 INFO:tasks.workunit.client.0.smithi046.stdout:9/430: symlink db/d1e/d32/d47/d5b/l7d 0 2024-02-19T19:08:33.337 INFO:tasks.workunit.client.0.smithi046.stdout:9/431: unlink db/d20/d6b/l3e 0 2024-02-19T19:08:33.340 INFO:tasks.workunit.client.0.smithi046.stdout:9/432: symlink db/d1e/d32/d47/l7e 0 2024-02-19T19:08:33.344 INFO:tasks.workunit.client.0.smithi046.stdout:2/832: write d5/d6/d13/d8a/fa8 [3048879,109277] 0 2024-02-19T19:08:33.346 INFO:tasks.workunit.client.0.smithi046.stdout:2/833: creat d5/d2c/d89/d3f/d5c/d9f/f116 x:0 0 0 2024-02-19T19:08:33.346 INFO:tasks.workunit.client.0.smithi046.stdout:2/834: chown d5/d2c/d35/fd3 221971256 1 2024-02-19T19:08:33.347 INFO:tasks.workunit.client.0.smithi046.stdout:2/835: symlink d5/d2c/d89/d3f/da1/l117 0 2024-02-19T19:08:33.348 INFO:tasks.workunit.client.0.smithi046.stdout:2/836: creat d5/d2c/d89/d3f/d5c/d9f/dda/f118 x:0 0 0 2024-02-19T19:08:33.350 INFO:tasks.workunit.client.0.smithi046.stdout:2/837: symlink d5/d2c/d35/d80/l119 0 2024-02-19T19:08:33.352 INFO:tasks.workunit.client.0.smithi046.stdout:2/838: rename d5/d2c/d89/d4c/d75/l76 to d5/d2c/d89/d3f/d5c/dee/l11a 0 2024-02-19T19:08:33.354 INFO:tasks.workunit.client.0.smithi046.stdout:2/839: unlink d5/d2c/d89/f6d 0 2024-02-19T19:08:33.354 INFO:tasks.workunit.client.0.smithi046.stdout:2/840: write d5/d2c/d89/d4c/fef [620599,78074] 0 2024-02-19T19:08:33.355 INFO:tasks.workunit.client.0.smithi046.stdout:2/841: mknod d5/d2c/d89/d3f/d5c/d9f/c11b 0 2024-02-19T19:08:33.358 INFO:tasks.workunit.client.0.smithi046.stdout:3/488: dwrite da/d30/f57 [4194304,4194304] 0 2024-02-19T19:08:33.358 INFO:tasks.workunit.client.0.smithi046.stdout:2/842: rename d5/d2c/d56/d5a/l5b to d5/d6/d13/d7c/d90/l11c 0 2024-02-19T19:08:33.358 INFO:tasks.workunit.client.0.smithi046.stdout:6/598: dwrite d4/d6/fa3 [4194304,4194304] 0 2024-02-19T19:08:33.360 INFO:tasks.workunit.client.0.smithi046.stdout:3/489: symlink da/d30/l84 0 2024-02-19T19:08:33.361 INFO:tasks.workunit.client.0.smithi046.stdout:3/490: dread da/d1d/d10/f4c [4194304,4194304] 0 2024-02-19T19:08:33.363 INFO:tasks.workunit.client.0.smithi046.stdout:6/599: symlink d4/d6/d1c/d64/lbd 0 2024-02-19T19:08:33.363 INFO:tasks.workunit.client.0.smithi046.stdout:6/600: stat d4/d6/dd/d10/d29/d2d/l70 0 2024-02-19T19:08:33.363 INFO:tasks.workunit.client.0.smithi046.stdout:6/601: write d4/f6a [416002,58773] 0 2024-02-19T19:08:33.364 INFO:tasks.workunit.client.0.smithi046.stdout:6/602: fdatasync d4/d6/d1c/d20/d7a/fa0 0 2024-02-19T19:08:33.364 INFO:tasks.workunit.client.0.smithi046.stdout:6/603: write d4/d6/f5e [4132573,102180] 0 2024-02-19T19:08:33.364 INFO:tasks.workunit.client.0.smithi046.stdout:2/843: dread d5/d6/d13/fcf [0,4194304] 0 2024-02-19T19:08:33.364 INFO:tasks.workunit.client.0.smithi046.stdout:2/844: readlink d5/d2c/d56/d5a/lbb 0 2024-02-19T19:08:33.368 INFO:tasks.workunit.client.0.smithi046.stdout:3/491: rename da/d30/d38/f6f to da/d1d/d63/f85 0 2024-02-19T19:08:33.369 INFO:tasks.workunit.client.0.smithi046.stdout:6/604: mknod d4/d6/dd/d10/d29/da2/cbe 0 2024-02-19T19:08:33.372 INFO:tasks.workunit.client.0.smithi046.stdout:2/845: mknod d5/d2c/d45/dbf/c11d 0 2024-02-19T19:08:33.372 INFO:tasks.workunit.client.0.smithi046.stdout:2/846: dread - d5/d2c/d89/d3f/d82/db6/fe6 zero size 2024-02-19T19:08:33.373 INFO:tasks.workunit.client.0.smithi046.stdout:9/433: dwrite db/d20/d6b/d54/f70 [0,4194304] 0 2024-02-19T19:08:33.373 INFO:tasks.workunit.client.0.smithi046.stdout:9/434: fsync db/d53/f65 0 2024-02-19T19:08:33.374 INFO:tasks.workunit.client.0.smithi046.stdout:6/605: symlink d4/d6/d1c/d64/lbf 0 2024-02-19T19:08:33.377 INFO:tasks.workunit.client.0.smithi046.stdout:9/435: unlink db/d1e/d32/d47/d5b/l7d 0 2024-02-19T19:08:33.386 INFO:tasks.workunit.client.0.smithi046.stdout:2/847: dread d5/d6/fa [0,4194304] 0 2024-02-19T19:08:33.389 INFO:tasks.workunit.client.0.smithi046.stdout:2/848: rmdir d5/d2c/d89/d3f/d82/df4 39 2024-02-19T19:08:33.389 INFO:tasks.workunit.client.0.smithi046.stdout:2/849: stat d5/d2c/d89/d3f/f5e 0 2024-02-19T19:08:33.393 INFO:tasks.workunit.client.0.smithi046.stdout:2/850: dread d5/d2c/d89/fc3 [0,4194304] 0 2024-02-19T19:08:33.394 INFO:tasks.workunit.client.0.smithi046.stdout:2/851: creat d5/d2c/f11e x:0 0 0 2024-02-19T19:08:33.394 INFO:tasks.workunit.client.0.smithi046.stdout:2/852: truncate d5/d2c/d89/fc3 971412 0 2024-02-19T19:08:33.395 INFO:tasks.workunit.client.0.smithi046.stdout:2/853: readlink d5/d2c/d56/d5a/lbb 0 2024-02-19T19:08:33.395 INFO:tasks.workunit.client.0.smithi046.stdout:6/606: dwrite d4/f5 [4194304,4194304] 0 2024-02-19T19:08:33.395 INFO:tasks.workunit.client.0.smithi046.stdout:6/607: getdents d4/d6/d1c/d20/d98 0 2024-02-19T19:08:33.395 INFO:tasks.workunit.client.0.smithi046.stdout:6/608: fsync d4/d6/dd/d10/f8a 0 2024-02-19T19:08:33.395 INFO:tasks.workunit.client.0.smithi046.stdout:6/609: getdents d4/d6/dd/d10/d29/d2d/d35/da5 0 2024-02-19T19:08:33.402 INFO:tasks.workunit.client.0.smithi046.stdout:9/436: dwrite db/f18 [4194304,4194304] 0 2024-02-19T19:08:33.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/437: mkdir db/d1e/d32/d47/d5b/d7f 0 2024-02-19T19:08:33.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/438: fsync db/f1b 0 2024-02-19T19:08:33.404 INFO:tasks.workunit.client.0.smithi046.stdout:9/439: truncate db/d20/f2c 951050 0 2024-02-19T19:08:33.408 INFO:tasks.workunit.client.0.smithi046.stdout:2/854: dread d5/d2c/d56/fe1 [0,4194304] 0 2024-02-19T19:08:33.408 INFO:tasks.workunit.client.0.smithi046.stdout:2/855: write d5/d2c/d45/f4a [917493,110239] 0 2024-02-19T19:08:33.409 INFO:tasks.workunit.client.0.smithi046.stdout:2/856: truncate d5/fe9 1515010 0 2024-02-19T19:08:33.410 INFO:tasks.workunit.client.0.smithi046.stdout:2/857: mknod d5/d6/d6e/dab/c11f 0 2024-02-19T19:08:33.411 INFO:tasks.workunit.client.0.smithi046.stdout:2/858: link d5/d6/d13/c6b d5/d2c/d45/de7/d105/de0/c120 0 2024-02-19T19:08:33.412 INFO:tasks.workunit.client.0.smithi046.stdout:2/859: unlink d5/d2c/d89/d4c/l5d 0 2024-02-19T19:08:33.413 INFO:tasks.workunit.client.0.smithi046.stdout:2/860: write d5/d2c/d89/d3f/d5c/f9d [1467396,13650] 0 2024-02-19T19:08:33.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.392+0000 7fe5f7288700 1 -- 172.21.15.46:0/1133793145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe5f01995a0 con 0x7fe5f00ff3c0 2024-02-19T19:08:33.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.393+0000 7fe5e67fc700 1 -- 172.21.15.46:0/1133793145 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fe5ec05b7f0 con 0x7fe5f00ff3c0 2024-02-19T19:08:33.414 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:08:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:08:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:08:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:08:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:08:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:08:33.414 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:08:33.415 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:08:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 -- 172.21.15.46:0/1133793145 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe5dc06d8a0 msgr2=0x7fe5dc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 --2- 172.21.15.46:0/1133793145 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe5dc06d8a0 0x7fe5dc06fd50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0199760 tx=0x7fe5e00073d0 comp rx=0 tx=0).stop 2024-02-19T19:08:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 -- 172.21.15.46:0/1133793145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f00ff3c0 msgr2=0x7fe5f0198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 --2- 172.21.15.46:0/1133793145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f00ff3c0 0x7fe5f0198140 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec006010 tx=0x7fe5ec00bd70 comp rx=0 tx=0).stop 2024-02-19T19:08:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 -- 172.21.15.46:0/1133793145 shutdown_connections 2024-02-19T19:08:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 --2- 172.21.15.46:0/1133793145 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe5dc06d8a0 0x7fe5dc06fd50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 --2- 172.21.15.46:0/1133793145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f00ff3c0 0x7fe5f0198140 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 --2- 172.21.15.46:0/1133793145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5f00ffd60 0x7fe5f0198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:33.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 -- 172.21.15.46:0/1133793145 >> 172.21.15.46:0/1133793145 conn(0x7fe5f00fac60 msgr2=0x7fe5f00fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:33.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 -- 172.21.15.46:0/1133793145 shutdown_connections 2024-02-19T19:08:33.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.397+0000 7fe5f7288700 1 -- 172.21.15.46:0/1133793145 wait complete. 2024-02-19T19:08:33.419 INFO:tasks.workunit.client.0.smithi046.stdout:2/861: dread d5/d6/fd [4194304,4194304] 0 2024-02-19T19:08:33.420 INFO:tasks.workunit.client.0.smithi046.stdout:2/862: mkdir d5/d2c/d89/d3f/d5c/dd5/d121 0 2024-02-19T19:08:33.422 INFO:tasks.workunit.client.0.smithi046.stdout:2/863: rename d5/d6/d13/l1c to d5/d2c/d89/d4c/l122 0 2024-02-19T19:08:33.436 INFO:tasks.workunit.client.0.smithi046.stdout:2/864: dwrite d5/d2c/d89/d3f/d5c/dee/ffb [0,4194304] 0 2024-02-19T19:08:33.438 INFO:tasks.workunit.client.0.smithi046.stdout:2/865: symlink d5/d6a/l123 0 2024-02-19T19:08:33.439 INFO:tasks.workunit.client.0.smithi046.stdout:2/866: mkdir d5/d2c/d56/d124 0 2024-02-19T19:08:33.440 INFO:tasks.workunit.client.0.smithi046.stdout:5/634: sync 2024-02-19T19:08:33.440 INFO:tasks.workunit.client.0.smithi046.stdout:0/787: sync 2024-02-19T19:08:33.440 INFO:tasks.workunit.client.0.smithi046.stdout:8/844: sync 2024-02-19T19:08:33.440 INFO:tasks.workunit.client.0.smithi046.stdout:8/845: stat d3/dd/f15 0 2024-02-19T19:08:33.440 INFO:tasks.workunit.client.0.smithi046.stdout:0/788: truncate d0/d24/f32 2986112 0 2024-02-19T19:08:33.440 INFO:tasks.workunit.client.0.smithi046.stdout:0/789: fdatasync d0/f4f 0 2024-02-19T19:08:33.440 INFO:tasks.workunit.client.0.smithi046.stdout:7/764: sync 2024-02-19T19:08:33.443 INFO:tasks.workunit.client.0.smithi046.stdout:8/846: mkdir d3/d8b/d124 0 2024-02-19T19:08:33.443 INFO:tasks.workunit.client.0.smithi046.stdout:0/790: mkdir d0/d24/d2f/d53/d6b/d10e 0 2024-02-19T19:08:33.444 INFO:tasks.workunit.client.0.smithi046.stdout:7/765: mknod d0/d45/d4a/d58/d60/cf4 0 2024-02-19T19:08:33.447 INFO:tasks.workunit.client.0.smithi046.stdout:7/766: creat d0/d45/d98/ff5 x:0 0 0 2024-02-19T19:08:33.454 INFO:tasks.workunit.client.0.smithi046.stdout:0/791: dread d0/f52 [0,4194304] 0 2024-02-19T19:08:33.458 INFO:tasks.workunit.client.0.smithi046.stdout:0/792: symlink d0/d19/d8/dc5/de9/l10f 0 2024-02-19T19:08:33.461 INFO:tasks.workunit.client.0.smithi046.stdout:7/767: dread d0/d45/d4a/d78/f8e [0,4194304] 0 2024-02-19T19:08:33.467 INFO:tasks.workunit.client.0.smithi046.stdout:7/768: dread d0/d4/f29 [0,4194304] 0 2024-02-19T19:08:33.467 INFO:tasks.workunit.client.0.smithi046.stdout:7/769: write d0/d45/d4a/d58/dc6/d83/fd9 [576785,101922] 0 2024-02-19T19:08:33.490 INFO:tasks.workunit.client.0.smithi046.stdout:5/635: dwrite d2/d27/d4b/f8e [0,4194304] 0 2024-02-19T19:08:33.490 INFO:tasks.workunit.client.0.smithi046.stdout:5/636: dread - d2/d27/d47/d7f/fbe zero size 2024-02-19T19:08:33.490 INFO:tasks.workunit.client.0.smithi046.stdout:5/637: chown d2/dd/d29/d72/fa0 2 1 2024-02-19T19:08:33.491 INFO:tasks.workunit.client.0.smithi046.stdout:2/867: dwrite d5/d6/d13/d8a/fa8 [0,4194304] 0 2024-02-19T19:08:33.491 INFO:tasks.workunit.client.0.smithi046.stdout:2/868: write d5/d2c/f73 [2143125,45847] 0 2024-02-19T19:08:33.492 INFO:tasks.workunit.client.0.smithi046.stdout:8/847: dwrite d3/d37/d64/da2/dac/f11f [0,4194304] 0 2024-02-19T19:08:33.492 INFO:tasks.workunit.client.0.smithi046.stdout:0/793: dwrite d0/d19/d8/d37/d40/da6/fb6 [0,4194304] 0 2024-02-19T19:08:33.492 INFO:tasks.workunit.client.0.smithi046.stdout:0/794: chown d0/d19/db/ccf 2178159 1 2024-02-19T19:08:33.493 INFO:tasks.workunit.client.0.smithi046.stdout:7/770: dwrite d0/d45/d4a/d58/dc6/d83/dd3/fb3 [4194304,4194304] 0 2024-02-19T19:08:33.493 INFO:tasks.workunit.client.0.smithi046.stdout:7/771: write d0/d4/f3c [804140,40628] 0 2024-02-19T19:08:33.494 INFO:tasks.workunit.client.0.smithi046.stdout:5/638: truncate d2/dd/d26/f3d 5349300 0 2024-02-19T19:08:33.495 INFO:tasks.workunit.client.0.smithi046.stdout:2/869: creat d5/d2c/d56/f125 x:0 0 0 2024-02-19T19:08:33.495 INFO:tasks.workunit.client.0.smithi046.stdout:2/870: write d5/d2c/d89/d3f/d82/db6/dc6/fdd [50605,70703] 0 2024-02-19T19:08:33.495 INFO:tasks.workunit.client.0.smithi046.stdout:2/871: chown d5/d2c/f5f 516274242 1 2024-02-19T19:08:33.496 INFO:tasks.workunit.client.0.smithi046.stdout:8/848: creat d3/dd/d3f/d49/d5b/f125 x:0 0 0 2024-02-19T19:08:33.496 INFO:tasks.workunit.client.0.smithi046.stdout:8/849: stat d3/d9d/fc2 0 2024-02-19T19:08:33.499 INFO:tasks.workunit.client.0.smithi046.stdout:2/872: mknod d5/d6/d13/d7c/d90/c126 0 2024-02-19T19:08:33.500 INFO:tasks.workunit.client.0.smithi046.stdout:8/850: link d3/dd/d3f/d49/d5b/d5f/da0/fb3 d3/dd/d3f/d49/f126 0 2024-02-19T19:08:33.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/851: link d3/dd/d13/d6b/d46/d6a/db2/ff0 d3/d37/d64/da2/d3c/f127 0 2024-02-19T19:08:33.504 INFO:tasks.workunit.client.0.smithi046.stdout:2/873: write d5/d6/fa [433131,92396] 0 2024-02-19T19:08:33.507 INFO:tasks.workunit.client.0.smithi046.stdout:2/874: mkdir d5/d2c/d89/d3f/d82/df4/d127 0 2024-02-19T19:08:33.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/772: read d0/d45/d4a/d58/d91/fad [1170761,91535] 0 2024-02-19T19:08:33.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/773: truncate d0/d4/fbd 763821 0 2024-02-19T19:08:33.508 INFO:tasks.workunit.client.0.smithi046.stdout:2/875: creat d5/d6/d6e/dab/d10b/f128 x:0 0 0 2024-02-19T19:08:33.508 INFO:tasks.workunit.client.0.smithi046.stdout:2/876: readlink d5/d6a/lea 0 2024-02-19T19:08:33.508 INFO:tasks.workunit.client.0.smithi046.stdout:5/639: write d2/f2b [1202951,127390] 0 2024-02-19T19:08:33.508 INFO:tasks.workunit.client.0.smithi046.stdout:5/640: read d2/f16 [1043299,51381] 0 2024-02-19T19:08:33.511 INFO:tasks.workunit.client.0.smithi046.stdout:7/774: rmdir d0/d45/d71/d41/db8/dd1/de8 0 2024-02-19T19:08:33.511 INFO:tasks.workunit.client.0.smithi046.stdout:8/852: dread d3/dd/f15 [0,4194304] 0 2024-02-19T19:08:33.511 INFO:tasks.workunit.client.0.smithi046.stdout:0/795: dwrite d0/f1b [0,4194304] 0 2024-02-19T19:08:33.512 INFO:tasks.workunit.client.0.smithi046.stdout:2/877: mknod d5/d6/d6e/dab/d10b/c129 0 2024-02-19T19:08:33.512 INFO:tasks.workunit.client.0.smithi046.stdout:2/878: chown d5/d6/d13/fcf 91119220 1 2024-02-19T19:08:33.513 INFO:tasks.workunit.client.0.smithi046.stdout:5/641: unlink d2/dd/d26/f50 0 2024-02-19T19:08:33.514 INFO:tasks.workunit.client.0.smithi046.stdout:5/642: creat d2/d27/d47/d7f/fcb x:0 0 0 2024-02-19T19:08:33.514 INFO:tasks.workunit.client.0.smithi046.stdout:5/643: fdatasync d2/dd/d29/d72/fa0 0 2024-02-19T19:08:33.515 INFO:tasks.workunit.client.0.smithi046.stdout:7/775: link d0/d4/le9 d0/d45/d4a/d58/d60/dbe/lf6 0 2024-02-19T19:08:33.515 INFO:tasks.workunit.client.0.smithi046.stdout:8/853: getdents d3/d8b/d113/df8 0 2024-02-19T19:08:33.516 INFO:tasks.workunit.client.0.smithi046.stdout:0/796: mknod d0/d19/d70/c110 0 2024-02-19T19:08:33.521 INFO:tasks.workunit.client.0.smithi046.stdout:2/879: unlink d5/d2c/d89/d3f/da1/lb5 0 2024-02-19T19:08:33.524 INFO:tasks.workunit.client.0.smithi046.stdout:5/644: creat d2/d27/d47/d54/d57/fcc x:0 0 0 2024-02-19T19:08:33.526 INFO:tasks.workunit.client.0.smithi046.stdout:7/776: creat d0/d45/d4a/d58/d60/ff7 x:0 0 0 2024-02-19T19:08:33.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/797: rename d0/d24/f8b to d0/d19/d8/d37/d58/f111 0 2024-02-19T19:08:33.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/798: chown d0/d19/db/d6a/fdf 14998446 1 2024-02-19T19:08:33.528 INFO:tasks.workunit.client.0.smithi046.stdout:2/880: mknod d5/d2c/d89/c12a 0 2024-02-19T19:08:33.530 INFO:tasks.workunit.client.0.smithi046.stdout:5/645: link d2/d27/d4b/f96 d2/dd/d29/fcd 0 2024-02-19T19:08:33.531 INFO:tasks.workunit.client.0.smithi046.stdout:0/799: creat d0/d19/db/de7/f112 x:0 0 0 2024-02-19T19:08:33.531 INFO:tasks.workunit.client.0.smithi046.stdout:0/800: write d0/f18 [669890,125499] 0 2024-02-19T19:08:33.532 INFO:tasks.workunit.client.0.smithi046.stdout:2/881: creat d5/d2c/d89/d3f/d5c/d9f/d10f/f12b x:0 0 0 2024-02-19T19:08:33.535 INFO:tasks.workunit.client.0.smithi046.stdout:5/646: getdents d2/dd/d26/d65 0 2024-02-19T19:08:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:8/854: dwrite d3/d37/dca/fe3 [0,4194304] 0 2024-02-19T19:08:33.537 INFO:tasks.workunit.client.0.smithi046.stdout:5/647: unlink d2/d5e/f6d 0 2024-02-19T19:08:33.537 INFO:tasks.workunit.client.0.smithi046.stdout:5/648: stat d2/dd/d26/da9/dbf 0 2024-02-19T19:08:33.542 INFO:tasks.workunit.client.0.smithi046.stdout:8/855: creat d3/d37/d64/d9a/f128 x:0 0 0 2024-02-19T19:08:33.544 INFO:tasks.workunit.client.0.smithi046.stdout:7/777: read d0/d4/d24/f51 [2577060,119811] 0 2024-02-19T19:08:33.546 INFO:tasks.workunit.client.0.smithi046.stdout:7/778: creat d0/d45/d71/d41/db8/ff8 x:0 0 0 2024-02-19T19:08:33.548 INFO:tasks.workunit.client.0.smithi046.stdout:7/779: rename d0/d45/d4a/d58/dc6/d83/dd3 to d0/d45/d4a/d58/d60/dbe/df9 0 2024-02-19T19:08:33.548 INFO:tasks.workunit.client.0.smithi046.stdout:7/780: readlink d0/d45/d4a/d78/ldd 0 2024-02-19T19:08:33.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/745: sync 2024-02-19T19:08:33.551 INFO:tasks.workunit.client.0.smithi046.stdout:1/633: sync 2024-02-19T19:08:33.551 INFO:tasks.workunit.client.0.smithi046.stdout:7/781: symlink d0/d45/d71/d4b/lfa 0 2024-02-19T19:08:33.553 INFO:tasks.workunit.client.0.smithi046.stdout:4/746: mknod d6/d11/dd6/d89/d8a/d55/cfb 0 2024-02-19T19:08:33.553 INFO:tasks.workunit.client.0.smithi046.stdout:0/801: dwrite d0/d24/f32 [0,4194304] 0 2024-02-19T19:08:33.555 INFO:tasks.workunit.client.0.smithi046.stdout:2/882: dwrite d5/d6/d6e/f8b [0,4194304] 0 2024-02-19T19:08:33.557 INFO:tasks.workunit.client.0.smithi046.stdout:4/747: link d6/f1a d6/d11/dd6/dc3/ffc 0 2024-02-19T19:08:33.557 INFO:tasks.workunit.client.0.smithi046.stdout:4/748: truncate d6/dd3/db3/fea 906183 0 2024-02-19T19:08:33.561 INFO:tasks.workunit.client.0.smithi046.stdout:0/802: getdents d0/d24/d2f/d53 0 2024-02-19T19:08:33.561 INFO:tasks.workunit.client.0.smithi046.stdout:0/803: chown d0/d19/d4d/cb9 36 1 2024-02-19T19:08:33.562 INFO:tasks.workunit.client.0.smithi046.stdout:8/856: dwrite d3/dd/d13/d6b/d46/d54/fa4 [0,4194304] 0 2024-02-19T19:08:33.563 INFO:tasks.workunit.client.0.smithi046.stdout:2/883: rename d5/d2c/d35/d80/l119 to d5/d2c/d89/d3f/d5c/dee/l12c 0 2024-02-19T19:08:33.586 INFO:tasks.workunit.client.0.smithi046.stdout:4/749: dwrite d6/d15/d17/d1e/ff1 [0,4194304] 0 2024-02-19T19:08:33.587 INFO:tasks.workunit.client.0.smithi046.stdout:4/750: symlink d6/d50/dde/lfd 0 2024-02-19T19:08:33.588 INFO:tasks.workunit.client.0.smithi046.stdout:4/751: chown d6/d15/d17/f78 375064 1 2024-02-19T19:08:33.588 INFO:tasks.workunit.client.0.smithi046.stdout:4/752: read - d6/d11/dd6/d89/d8a/d55/f86 zero size 2024-02-19T19:08:33.589 INFO:tasks.workunit.client.0.smithi046.stdout:4/753: link d6/d11/dd6/d89/d8a/d55/d8e/fda d6/d15/ffe 0 2024-02-19T19:08:33.589 INFO:tasks.workunit.client.0.smithi046.stdout:4/754: truncate d6/d15/d17/d4a/fe6 88767 0 2024-02-19T19:08:33.589 INFO:tasks.workunit.client.0.smithi046.stdout:4/755: dread - d6/d15/d17/d4a/db1/fcb zero size 2024-02-19T19:08:33.590 INFO:tasks.workunit.client.0.smithi046.stdout:4/756: truncate d6/d11/dd6/f60 1243969 0 2024-02-19T19:08:33.595 INFO:tasks.workunit.client.0.smithi046.stdout:7/782: dwrite d0/d4/d24/f2e [0,4194304] 0 2024-02-19T19:08:33.595 INFO:tasks.workunit.client.0.smithi046.stdout:2/884: dwrite d5/d2c/d89/d3f/d5c/d9f/f116 [0,4194304] 0 2024-02-19T19:08:33.599 INFO:tasks.workunit.client.0.smithi046.stdout:0/804: dwrite d0/d19/d8/d37/d40/da6/fb6 [4194304,4194304] 0 2024-02-19T19:08:33.602 INFO:tasks.workunit.client.0.smithi046.stdout:0/805: rmdir d0/d19/d8/dc5/de9 39 2024-02-19T19:08:33.602 INFO:tasks.workunit.client.0.smithi046.stdout:0/806: chown d0/d24/d5b/d7f/d9b/l103 84 1 2024-02-19T19:08:33.602 INFO:tasks.workunit.client.0.smithi046.stdout:0/807: fdatasync d0/d19/f8e 0 2024-02-19T19:08:33.605 INFO:tasks.workunit.client.0.smithi046.stdout:4/757: dread d6/f97 [0,4194304] 0 2024-02-19T19:08:33.605 INFO:tasks.workunit.client.0.smithi046.stdout:1/634: dwrite d5/f27 [0,4194304] 0 2024-02-19T19:08:33.605 INFO:tasks.workunit.client.0.smithi046.stdout:8/857: dwrite d3/dd/d13/d42/f47 [4194304,4194304] 0 2024-02-19T19:08:33.605 INFO:tasks.workunit.client.0.smithi046.stdout:8/858: creat d3/dd/d13/d66/dba/f129 x:0 0 0 2024-02-19T19:08:33.605 INFO:tasks.workunit.client.0.smithi046.stdout:8/859: read - d3/dd/d3f/d49/f120 zero size 2024-02-19T19:08:33.605 INFO:tasks.workunit.client.0.smithi046.stdout:4/758: mknod d6/d11/d40/da7/cff 0 2024-02-19T19:08:33.608 INFO:tasks.workunit.client.0.smithi046.stdout:1/635: creat d5/d2f/fd9 x:0 0 0 2024-02-19T19:08:33.608 INFO:tasks.workunit.client.0.smithi046.stdout:1/636: fsync d5/f1f 0 2024-02-19T19:08:33.608 INFO:tasks.workunit.client.0.smithi046.stdout:1/637: fsync d5/d2f/d5e/f97 0 2024-02-19T19:08:33.612 INFO:tasks.workunit.client.0.smithi046.stdout:4/759: truncate d6/d11/dd6/f28 148694 0 2024-02-19T19:08:33.614 INFO:tasks.workunit.client.0.smithi046.stdout:8/860: rename d3/dd/d13/c8e to d3/d37/d9b/c12a 0 2024-02-19T19:08:33.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/760: stat d6/d11/cb4 0 2024-02-19T19:08:33.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/761: write d6/d11/dd6/dc3/fd1 [463631,9728] 0 2024-02-19T19:08:33.618 INFO:tasks.workunit.client.0.smithi046.stdout:8/861: mknod d3/dd/d3f/c12b 0 2024-02-19T19:08:33.619 INFO:tasks.workunit.client.0.smithi046.stdout:4/762: creat d6/d94/dab/f100 x:0 0 0 2024-02-19T19:08:33.621 INFO:tasks.workunit.client.0.smithi046.stdout:4/763: symlink d6/d15/d17/d4a/db1/l101 0 2024-02-19T19:08:33.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.601+0000 7f9396ff2700 1 -- 172.21.15.46:0/4140721101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939010c1f0 msgr2=0x7f939010c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:33.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.601+0000 7f9396ff2700 1 --2- 172.21.15.46:0/4140721101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939010c1f0 0x7f939010c5c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f938800c210 tx=0x7f938800c520 comp rx=0 tx=0).stop 2024-02-19T19:08:33.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.601+0000 7f9396ff2700 1 -- 172.21.15.46:0/4140721101 shutdown_connections 2024-02-19T19:08:33.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.601+0000 7f9396ff2700 1 --2- 172.21.15.46:0/4140721101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9390107d50 0x7f93901081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:33.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.601+0000 7f9396ff2700 1 --2- 172.21.15.46:0/4140721101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939010c1f0 0x7f939010c5c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:33.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.601+0000 7f9396ff2700 1 -- 172.21.15.46:0/4140721101 >> 172.21.15.46:0/4140721101 conn(0x7f939006c630 msgr2=0x7f939006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:33.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.602+0000 7f9396ff2700 1 -- 172.21.15.46:0/4140721101 shutdown_connections 2024-02-19T19:08:33.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.602+0000 7f9396ff2700 1 -- 172.21.15.46:0/4140721101 wait complete. 2024-02-19T19:08:33.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.603+0000 7f9396ff2700 1 Processor -- start 2024-02-19T19:08:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.603+0000 7f9396ff2700 1 -- start start 2024-02-19T19:08:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.603+0000 7f9396ff2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9390107d50 0x7f9390108f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.603+0000 7f9396ff2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939010c1f0 0x7f9390109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.603+0000 7f9396ff2700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939010acc0 con 0x7f939010c1f0 2024-02-19T19:08:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.603+0000 7f9396ff2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939010ae30 con 0x7f9390107d50 2024-02-19T19:08:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.603+0000 7f9394d8e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9390107d50 0x7f9390108f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.604+0000 7f9394d8e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9390107d50 0x7f9390108f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:36306/0 (socket says 172.21.15.46:36306) 2024-02-19T19:08:33.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.604+0000 7f9394d8e700 1 -- 172.21.15.46:0/803291503 learned_addr learned my addr 172.21.15.46:0/803291503 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:08:33.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.604+0000 7f9394d8e700 1 -- 172.21.15.46:0/803291503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939010c1f0 msgr2=0x7f9390109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:33.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.604+0000 7f9394d8e700 1 --2- 172.21.15.46:0/803291503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939010c1f0 0x7f9390109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:33.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.604+0000 7f9394d8e700 1 -- 172.21.15.46:0/803291503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938800ae10 con 0x7f9390107d50 2024-02-19T19:08:33.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.604+0000 7f9394d8e700 1 --2- 172.21.15.46:0/803291503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9390107d50 0x7f9390108f10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9388016040 tx=0x7f9388008320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:33.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.604+0000 7f938dffb700 1 -- 172.21.15.46:0/803291503 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f938800f070 con 0x7f9390107d50 2024-02-19T19:08:33.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.605+0000 7f9396ff2700 1 -- 172.21.15.46:0/803291503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93901099f0 con 0x7f9390107d50 2024-02-19T19:08:33.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.605+0000 7f938dffb700 1 -- 172.21.15.46:0/803291503 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93880086d0 con 0x7f9390107d50 2024-02-19T19:08:33.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.605+0000 7f938dffb700 1 -- 172.21.15.46:0/803291503 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93880076d0 con 0x7f9390107d50 2024-02-19T19:08:33.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.605+0000 7f9396ff2700 1 -- 172.21.15.46:0/803291503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9390109d70 con 0x7f9390107d50 2024-02-19T19:08:33.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.606+0000 7f9396ff2700 1 -- 172.21.15.46:0/803291503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9390111560 con 0x7f9390107d50 2024-02-19T19:08:33.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.607+0000 7f938dffb700 1 -- 172.21.15.46:0/803291503 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f938800cd50 con 0x7f9390107d50 2024-02-19T19:08:33.628 INFO:tasks.workunit.client.0.smithi046.stdout:7/783: dwrite d0/d45/d71/d41/d5f/f76 [0,4194304] 0 2024-02-19T19:08:33.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.607+0000 7f938dffb700 1 --2- 172.21.15.46:0/803291503 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f937c06d8f0 0x7f937c06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:33.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.608+0000 7f938dffb700 1 -- 172.21.15.46:0/803291503 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f938808e270 con 0x7f9390107d50 2024-02-19T19:08:33.629 INFO:tasks.workunit.client.0.smithi046.stdout:0/808: dwrite d0/d19/db/de7/f112 [0,4194304] 0 2024-02-19T19:08:33.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.608+0000 7f938ffff700 1 --2- 172.21.15.46:0/803291503 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f937c06d8f0 0x7f937c06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:33.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.609+0000 7f938ffff700 1 --2- 172.21.15.46:0/803291503 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f937c06d8f0 0x7f937c06fda0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9380005950 tx=0x7f93800058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:33.630 INFO:tasks.workunit.client.0.smithi046.stdout:7/784: mknod d0/d45/d4a/d58/d60/dbe/cfb 0 2024-02-19T19:08:33.631 INFO:tasks.workunit.client.0.smithi046.stdout:8/862: dread d3/dd/d13/d42/f47 [4194304,4194304] 0 2024-02-19T19:08:33.634 INFO:tasks.workunit.client.0.smithi046.stdout:2/885: dwrite d5/d2c/d89/d3f/d5c/dee/ffb [0,4194304] 0 2024-02-19T19:08:33.634 INFO:tasks.workunit.client.0.smithi046.stdout:2/886: write d5/d2c/d56/fe1 [4390549,115479] 0 2024-02-19T19:08:33.634 INFO:tasks.workunit.client.0.smithi046.stdout:1/638: dwrite d5/d2f/d9f/d55/f63 [0,4194304] 0 2024-02-19T19:08:33.634 INFO:tasks.workunit.client.0.smithi046.stdout:1/639: fdatasync d5/d13/d35/d37/d64/d75/f86 0 2024-02-19T19:08:33.635 INFO:tasks.workunit.client.0.smithi046.stdout:7/785: mknod d0/d45/d4a/d58/d60/cfc 0 2024-02-19T19:08:33.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:33.614+0000 7f938dffb700 1 -- 172.21.15.46:0/803291503 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f93880579d0 con 0x7f9390107d50 2024-02-19T19:08:33.645 INFO:tasks.workunit.client.0.smithi046.stdout:8/863: read d3/dd/d13/d66/fbe [2178520,130690] 0 2024-02-19T19:08:33.649 INFO:tasks.workunit.client.0.smithi046.stdout:4/764: rename d6/d15/d17/d4a to d6/d11/d92/d102 0 2024-02-19T19:08:33.649 INFO:tasks.workunit.client.0.smithi046.stdout:1/640: read d5/d21/d9a/dd0/f4b [3200050,114113] 0 2024-02-19T19:08:33.649 INFO:tasks.workunit.client.0.smithi046.stdout:8/864: dread d3/d37/d64/da2/d3c/f43 [0,4194304] 0 2024-02-19T19:08:33.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/641: symlink d5/d13/d35/d37/d64/dce/lda 0 2024-02-19T19:08:33.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/642: readlink d5/d21/d9a/dd0/d80/l99 0 2024-02-19T19:08:33.650 INFO:tasks.workunit.client.0.smithi046.stdout:8/865: mkdir d3/dd/d3f/d49/d5b/d5f/d12c 0 2024-02-19T19:08:33.651 INFO:tasks.workunit.client.0.smithi046.stdout:1/643: truncate d5/d2f/d5e/f97 347070 0 2024-02-19T19:08:33.653 INFO:tasks.workunit.client.0.smithi046.stdout:1/644: creat d5/d13/d35/d37/d64/d75/dcf/fdb x:0 0 0 2024-02-19T19:08:33.653 INFO:tasks.workunit.client.0.smithi046.stdout:1/645: dread - d5/d13/d35/d37/f7f zero size 2024-02-19T19:08:33.654 INFO:tasks.workunit.client.0.smithi046.stdout:0/809: dwrite d0/d24/f3b [0,4194304] 0 2024-02-19T19:08:33.654 INFO:tasks.workunit.client.0.smithi046.stdout:0/810: chown d0/d19/d8/d37/ld5 3837 1 2024-02-19T19:08:33.654 INFO:tasks.workunit.client.0.smithi046.stdout:0/811: write d0/f17 [1098569,58018] 0 2024-02-19T19:08:33.657 INFO:tasks.workunit.client.0.smithi046.stdout:7/786: read d0/d45/d71/d41/d5f/fa4 [1012181,59147] 0 2024-02-19T19:08:33.659 INFO:tasks.workunit.client.0.smithi046.stdout:7/787: dread d0/d4/fbd [0,4194304] 0 2024-02-19T19:08:33.659 INFO:tasks.workunit.client.0.smithi046.stdout:1/646: creat d5/d13/d35/d37/db0/fdc x:0 0 0 2024-02-19T19:08:33.664 INFO:tasks.workunit.client.0.smithi046.stdout:8/866: dread d3/d37/d64/da2/d3c/db6/ffc [0,4194304] 0 2024-02-19T19:08:33.675 INFO:tasks.workunit.client.0.smithi046.stdout:7/788: unlink d0/d45/d71/da3/fb7 0 2024-02-19T19:08:33.678 INFO:tasks.workunit.client.0.smithi046.stdout:1/647: rename d5/d13/f70 to d5/d13/d35/fdd 0 2024-02-19T19:08:33.679 INFO:tasks.workunit.client.0.smithi046.stdout:1/648: rename d5/d13/d35/d37/db0/lbb to d5/d21/d9a/dd5/lde 0 2024-02-19T19:08:33.680 INFO:tasks.workunit.client.0.smithi046.stdout:1/649: creat d5/d21/d9a/fdf x:0 0 0 2024-02-19T19:08:33.688 INFO:tasks.workunit.client.0.smithi046.stdout:0/812: dwrite d0/d24/f39 [0,4194304] 0 2024-02-19T19:08:33.689 INFO:tasks.workunit.client.0.smithi046.stdout:8/867: dwrite d3/d37/f71 [0,4194304] 0 2024-02-19T19:08:33.689 INFO:tasks.workunit.client.0.smithi046.stdout:8/868: chown d3/d37/d64/ca9 35 1 2024-02-19T19:08:33.692 INFO:tasks.workunit.client.0.smithi046.stdout:0/813: rename d0/d19/l7a to d0/d19/d8/l113 0 2024-02-19T19:08:33.695 INFO:tasks.workunit.client.0.smithi046.stdout:0/814: rmdir d0/d19/d4d/da5/da7/db8 39 2024-02-19T19:08:33.697 INFO:tasks.workunit.client.0.smithi046.stdout:1/650: read d5/d13/d35/f71 [1133459,92888] 0 2024-02-19T19:08:33.701 INFO:tasks.workunit.client.0.smithi046.stdout:0/815: unlink d0/d19/d88/ce5 0 2024-02-19T19:08:33.702 INFO:tasks.workunit.client.0.smithi046.stdout:1/651: getdents d5/d2f 0 2024-02-19T19:08:33.705 INFO:tasks.workunit.client.0.smithi046.stdout:1/652: link d5/f1f d5/fe0 0 2024-02-19T19:08:33.706 INFO:tasks.workunit.client.0.smithi046.stdout:6/610: sync 2024-02-19T19:08:33.706 INFO:tasks.workunit.client.0.smithi046.stdout:3/492: sync 2024-02-19T19:08:33.708 INFO:tasks.workunit.client.0.smithi046.stdout:6/611: mkdir d4/d6/dd/d10/d29/d2d/dc0 0 2024-02-19T19:08:33.709 INFO:tasks.workunit.client.0.smithi046.stdout:6/612: rename d4/d6/laf to d4/lc1 0 2024-02-19T19:08:33.711 INFO:tasks.workunit.client.0.smithi046.stdout:6/613: mknod d4/d6/d1c/d64/cc2 0 2024-02-19T19:08:33.714 INFO:tasks.workunit.client.0.smithi046.stdout:6/614: creat d4/d6/dd/d10/d29/d2d/fc3 x:0 0 0 2024-02-19T19:08:33.716 INFO:tasks.workunit.client.0.smithi046.stdout:8/869: dwrite d3/dd/d3f/f103 [0,4194304] 0 2024-02-19T19:08:33.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/816: read d0/d24/f39 [2410843,29457] 0 2024-02-19T19:08:33.718 INFO:tasks.workunit.client.0.smithi046.stdout:8/870: creat d3/d8b/d124/f12d x:0 0 0 2024-02-19T19:08:33.718 INFO:tasks.workunit.client.0.smithi046.stdout:8/871: creat d3/d37/d64/d9a/f12e x:0 0 0 2024-02-19T19:08:33.718 INFO:tasks.workunit.client.0.smithi046.stdout:8/872: chown d3/dd/d13/d66/dba 16 1 2024-02-19T19:08:33.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/493: write da/d1d/f60 [3970820,70286] 0 2024-02-19T19:08:33.719 INFO:tasks.workunit.client.0.smithi046.stdout:0/817: mkdir d0/d24/d5b/d7f/dfc/d114 0 2024-02-19T19:08:33.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/653: write d5/d13/d35/d37/f6c [3867385,77365] 0 2024-02-19T19:08:33.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/654: write d5/d13/d35/f41 [4231450,27638] 0 2024-02-19T19:08:33.721 INFO:tasks.workunit.client.0.smithi046.stdout:8/873: symlink d3/dd/d13/d6b/d46/d54/l12f 0 2024-02-19T19:08:33.721 INFO:tasks.workunit.client.0.smithi046.stdout:8/874: stat d3/dd/la6 0 2024-02-19T19:08:33.721 INFO:tasks.workunit.client.0.smithi046.stdout:8/875: truncate d3/f7 1748302 0 2024-02-19T19:08:33.725 INFO:tasks.workunit.client.0.smithi046.stdout:0/818: mkdir d0/d5f/da8/d115 0 2024-02-19T19:08:33.725 INFO:tasks.workunit.client.0.smithi046.stdout:0/819: dread - d0/d6c/fce zero size 2024-02-19T19:08:33.725 INFO:tasks.workunit.client.0.smithi046.stdout:1/655: creat d5/d2f/fe1 x:0 0 0 2024-02-19T19:08:33.725 INFO:tasks.workunit.client.0.smithi046.stdout:1/656: write d5/fb3 [998610,60164] 0 2024-02-19T19:08:33.726 INFO:tasks.workunit.client.0.smithi046.stdout:1/657: link d5/d21/d9a/dd0/d80/c9b d5/d13/d35/d37/db0/ce2 0 2024-02-19T19:08:33.739 INFO:tasks.workunit.client.0.smithi046.stdout:0/820: write d0/d19/d4d/da5/da7/fdd [1588861,32117] 0 2024-02-19T19:08:33.739 INFO:tasks.workunit.client.0.smithi046.stdout:0/821: readlink d0/d24/d2f/l5e 0 2024-02-19T19:08:33.743 INFO:tasks.workunit.client.0.smithi046.stdout:0/822: rename d0/d5f/f69 to d0/d24/d5b/d7f/f116 0 2024-02-19T19:08:33.743 INFO:tasks.workunit.client.0.smithi046.stdout:0/823: chown d0/d6c/dc4/lf7 100506 1 2024-02-19T19:08:33.743 INFO:tasks.workunit.client.0.smithi046.stdout:0/824: read - d0/d19/d70/dba/fe6 zero size 2024-02-19T19:08:33.745 INFO:tasks.workunit.client.0.smithi046.stdout:0/825: getdents d0/d19/db/de7/df6 0 2024-02-19T19:08:33.747 INFO:tasks.workunit.client.0.smithi046.stdout:6/615: dwrite d4/d6/dd/d10/d29/f36 [0,4194304] 0 2024-02-19T19:08:33.747 INFO:tasks.workunit.client.0.smithi046.stdout:6/616: fsync d4/d6/d1c/d64/fa1 0 2024-02-19T19:08:33.747 INFO:tasks.workunit.client.0.smithi046.stdout:0/826: unlink d0/f7c 0 2024-02-19T19:08:33.750 INFO:tasks.workunit.client.0.smithi046.stdout:6/617: mkdir d4/d6/d1c/d20/d98/dc4 0 2024-02-19T19:08:33.750 INFO:tasks.workunit.client.0.smithi046.stdout:6/618: chown d4/d6/d1c/f51 2177660 1 2024-02-19T19:08:33.750 INFO:tasks.workunit.client.0.smithi046.stdout:1/658: dwrite d5/fc [0,4194304] 0 2024-02-19T19:08:33.750 INFO:tasks.workunit.client.0.smithi046.stdout:1/659: truncate d5/f17 9029931 0 2024-02-19T19:08:33.750 INFO:tasks.workunit.client.0.smithi046.stdout:1/660: dread - d5/d13/d35/d37/db0/fdc zero size 2024-02-19T19:08:33.750 INFO:tasks.workunit.client.0.smithi046.stdout:1/661: dread - d5/d2f/d9f/d3b/d4e/fd4 zero size 2024-02-19T19:08:33.754 INFO:tasks.workunit.client.0.smithi046.stdout:0/827: creat d0/d19/d8/d37/d85/f117 x:0 0 0 2024-02-19T19:08:33.754 INFO:tasks.workunit.client.0.smithi046.stdout:8/876: dwrite d3/dd/d13/f1f [0,4194304] 0 2024-02-19T19:08:33.755 INFO:tasks.workunit.client.0.smithi046.stdout:0/828: dread d0/d24/d8c/f94 [0,4194304] 0 2024-02-19T19:08:33.757 INFO:tasks.workunit.client.0.smithi046.stdout:1/662: creat d5/d13/d35/d37/fe3 x:0 0 0 2024-02-19T19:08:33.757 INFO:tasks.workunit.client.0.smithi046.stdout:1/663: dread - d5/d2f/d9f/d55/fb1 zero size 2024-02-19T19:08:33.759 INFO:tasks.workunit.client.0.smithi046.stdout:8/877: creat d3/dd/d13/f130 x:0 0 0 2024-02-19T19:08:33.759 INFO:tasks.workunit.client.0.smithi046.stdout:8/878: truncate d3/d8b/d124/f12d 940757 0 2024-02-19T19:08:33.760 INFO:tasks.workunit.client.0.smithi046.stdout:8/879: fdatasync d3/d37/d64/da2/d3c/db6/ffc 0 2024-02-19T19:08:33.761 INFO:tasks.workunit.client.0.smithi046.stdout:0/829: truncate d0/d6c/fb5 4043433 0 2024-02-19T19:08:33.761 INFO:tasks.workunit.client.0.smithi046.stdout:0/830: fsync d0/d24/d56/da3/fc9 0 2024-02-19T19:08:33.761 INFO:tasks.workunit.client.0.smithi046.stdout:0/831: write d0/d19/d88/d10b/fb7 [1406785,123588] 0 2024-02-19T19:08:33.761 INFO:tasks.workunit.client.0.smithi046.stdout:0/832: dread - d0/d6c/f108 zero size 2024-02-19T19:08:33.762 INFO:tasks.workunit.client.0.smithi046.stdout:8/880: creat d3/dd/d3f/d49/d5b/d5f/db1/f131 x:0 0 0 2024-02-19T19:08:33.762 INFO:tasks.workunit.client.0.smithi046.stdout:8/881: readlink d3/d37/d64/da2/df5/l5a 0 2024-02-19T19:08:33.765 INFO:tasks.workunit.client.0.smithi046.stdout:8/882: link d3/l34 d3/d18/l132 0 2024-02-19T19:08:33.767 INFO:tasks.workunit.client.0.smithi046.stdout:8/883: getdents d3/d37/d64 0 2024-02-19T19:08:33.771 INFO:tasks.workunit.client.0.smithi046.stdout:6/619: dwrite d4/d6/d1c/d64/f9f [0,4194304] 0 2024-02-19T19:08:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:0/833: dread d0/d19/d8/d37/d58/f111 [0,4194304] 0 2024-02-19T19:08:33.780 INFO:tasks.workunit.client.0.smithi046.stdout:0/834: mkdir d0/d19/d8/d92/d118 0 2024-02-19T19:08:33.787 INFO:tasks.workunit.client.0.smithi046.stdout:0/835: write d0/f1b [3918593,72039] 0 2024-02-19T19:08:33.790 INFO:tasks.workunit.client.0.smithi046.stdout:0/836: mkdir d0/d19/d8/d37/d40/d119 0 2024-02-19T19:08:33.792 INFO:tasks.workunit.client.0.smithi046.stdout:0/837: dread d0/d5f/f7e [0,4194304] 0 2024-02-19T19:08:33.792 INFO:tasks.workunit.client.0.smithi046.stdout:1/664: dwrite d5/d13/d35/d37/f7f [0,4194304] 0 2024-02-19T19:08:33.796 INFO:tasks.workunit.client.0.smithi046.stdout:6/620: dwrite d4/d6/dd/d10/d29/d2d/d35/f3a [4194304,4194304] 0 2024-02-19T19:08:33.796 INFO:tasks.workunit.client.0.smithi046.stdout:6/621: readlink d4/d6/d22/l2f 0 2024-02-19T19:08:33.797 INFO:tasks.workunit.client.0.smithi046.stdout:1/665: rmdir d5/d2f/d9f/d3b/d4e 39 2024-02-19T19:08:33.802 INFO:tasks.workunit.client.0.smithi046.stdout:6/622: mkdir d4/d6/d1c/d20/dc5 0 2024-02-19T19:08:33.803 INFO:tasks.workunit.client.0.smithi046.stdout:1/666: symlink d5/d13/d35/d37/d64/le4 0 2024-02-19T19:08:33.813 INFO:tasks.workunit.client.0.smithi046.stdout:1/667: write d5/d2f/d9f/d3b/d4e/f6e [1213296,124054] 0 2024-02-19T19:08:33.815 INFO:tasks.workunit.client.0.smithi046.stdout:1/668: rename d5/fba to d5/d13/fe5 0 2024-02-19T19:08:33.816 INFO:tasks.workunit.client.0.smithi046.stdout:6/623: dread d4/d6/dd/d10/f13 [0,4194304] 0 2024-02-19T19:08:33.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/669: creat d5/d2f/d9f/dc9/fe6 x:0 0 0 2024-02-19T19:08:33.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/670: write d5/fc [4972795,102128] 0 2024-02-19T19:08:33.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/671: write d5/d2f/d9f/f95 [144154,63098] 0 2024-02-19T19:08:33.818 INFO:tasks.workunit.client.0.smithi046.stdout:6/624: creat d4/d6/d1c/d60/fc6 x:0 0 0 2024-02-19T19:08:33.819 INFO:tasks.workunit.client.0.smithi046.stdout:1/672: mkdir d5/d2f/de7 0 2024-02-19T19:08:33.819 INFO:tasks.workunit.client.0.smithi046.stdout:1/673: chown d5/d13/d35/c53 1024560549 1 2024-02-19T19:08:33.821 INFO:tasks.workunit.client.0.smithi046.stdout:6/625: creat d4/d6/dd/d10/d29/d2d/d35/da5/fc7 x:0 0 0 2024-02-19T19:08:33.822 INFO:tasks.workunit.client.0.smithi046.stdout:1/674: symlink d5/d21/d9a/dd0/d80/daf/db5/dd2/le8 0 2024-02-19T19:08:33.822 INFO:tasks.workunit.client.0.smithi046.stdout:1/675: chown d5/f17 147158850 1 2024-02-19T19:08:33.824 INFO:tasks.workunit.client.0.smithi046.stdout:6/626: symlink d4/d6/d1c/d94/lc8 0 2024-02-19T19:08:33.825 INFO:tasks.workunit.client.0.smithi046.stdout:6/627: symlink d4/d6/d1c/d94/lc9 0 2024-02-19T19:08:33.825 INFO:tasks.workunit.client.0.smithi046.stdout:6/628: dread - d4/d6/dd/d10/d29/d2d/d35/fb3 zero size 2024-02-19T19:08:33.827 INFO:tasks.workunit.client.0.smithi046.stdout:6/629: creat d4/d6/d22/db0/fca x:0 0 0 2024-02-19T19:08:33.839 INFO:tasks.workunit.client.0.smithi046.stdout:6/630: read d4/d6/f3b [3523581,61055] 0 2024-02-19T19:08:33.839 INFO:tasks.workunit.client.0.smithi046.stdout:6/631: stat d4/d6/d1c/d64/lac 0 2024-02-19T19:08:33.841 INFO:tasks.workunit.client.0.smithi046.stdout:6/632: symlink d4/d6/dd/d10/d29/d2d/d35/d66/lcb 0 2024-02-19T19:08:33.841 INFO:tasks.workunit.client.0.smithi046.stdout:6/633: dread - d4/d6/dd/d10/d29/d2d/fb4 zero size 2024-02-19T19:08:33.841 INFO:tasks.workunit.client.0.smithi046.stdout:6/634: rmdir d4/d6/d1c/d20 39 2024-02-19T19:08:33.842 INFO:tasks.workunit.client.0.smithi046.stdout:6/635: stat d4/d6/dd/d10/fa7 0 2024-02-19T19:08:33.842 INFO:tasks.workunit.client.0.smithi046.stdout:6/636: stat d4/d6/dd/d10/d29/d2d/f7f 0 2024-02-19T19:08:33.843 INFO:tasks.workunit.client.0.smithi046.stdout:6/637: creat d4/d6/d1c/d20/fcc x:0 0 0 2024-02-19T19:08:33.844 INFO:tasks.workunit.client.0.smithi046.stdout:1/676: dwrite d5/d2f/d9f/dc9/fe6 [0,4194304] 0 2024-02-19T19:08:33.844 INFO:tasks.workunit.client.0.smithi046.stdout:6/638: symlink d4/d6/dd/d10/d29/d2d/d35/d3c/lcd 0 2024-02-19T19:08:33.845 INFO:tasks.workunit.client.0.smithi046.stdout:6/639: truncate d4/d6/dd/d10/d29/d2d/d35/fba 709781 0 2024-02-19T19:08:33.845 INFO:tasks.workunit.client.0.smithi046.stdout:6/640: readlink d4/d6/d1c/d64/lac 0 2024-02-19T19:08:33.846 INFO:tasks.workunit.client.0.smithi046.stdout:6/641: rmdir d4/d6/dd/d10/d29 39 2024-02-19T19:08:33.846 INFO:tasks.workunit.client.0.smithi046.stdout:6/642: write d4/d6/d8e/f90 [4277878,67574] 0 2024-02-19T19:08:33.848 INFO:tasks.workunit.client.0.smithi046.stdout:9/440: sync 2024-02-19T19:08:33.848 INFO:tasks.workunit.client.0.smithi046.stdout:9/441: write db/d1e/f22 [1119061,31757] 0 2024-02-19T19:08:33.849 INFO:tasks.workunit.client.0.smithi046.stdout:6/643: mkdir d4/d6/d1c/d20/d98/dc4/dce 0 2024-02-19T19:08:33.850 INFO:tasks.workunit.client.0.smithi046.stdout:9/442: write db/d1e/f22 [321560,99380] 0 2024-02-19T19:08:33.851 INFO:tasks.workunit.client.0.smithi046.stdout:9/443: chown db/d20/l21 169849562 1 2024-02-19T19:08:33.851 INFO:tasks.workunit.client.0.smithi046.stdout:9/444: fsync db/f7b 0 2024-02-19T19:08:33.859 INFO:tasks.workunit.client.0.smithi046.stdout:6/644: dread d4/d6/d1c/d60/f61 [0,4194304] 0 2024-02-19T19:08:33.863 INFO:tasks.workunit.client.0.smithi046.stdout:1/677: dwrite d5/d21/d9a/dd0/d80/daf/f9c [0,4194304] 0 2024-02-19T19:08:33.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/645: dread d4/d6/d1c/d60/f85 [0,4194304] 0 2024-02-19T19:08:33.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/646: write d4/d6/dd/d10/d29/d2d/d35/fb3 [640726,122866] 0 2024-02-19T19:08:33.865 INFO:tasks.workunit.client.0.smithi046.stdout:9/445: write db/f43 [1697915,49833] 0 2024-02-19T19:08:33.867 INFO:tasks.workunit.client.0.smithi046.stdout:9/446: creat db/d20/d6f/f80 x:0 0 0 2024-02-19T19:08:33.874 INFO:tasks.workunit.client.0.smithi046.stdout:6/647: dread d4/f28 [0,4194304] 0 2024-02-19T19:08:33.874 INFO:tasks.workunit.client.0.smithi046.stdout:9/447: mknod db/d20/d6f/c81 0 2024-02-19T19:08:33.874 INFO:tasks.workunit.client.0.smithi046.stdout:1/678: dread d5/d13/d35/fdd [0,4194304] 0 2024-02-19T19:08:33.874 INFO:tasks.workunit.client.0.smithi046.stdout:9/448: mkdir db/d82 0 2024-02-19T19:08:33.875 INFO:tasks.workunit.client.0.smithi046.stdout:9/449: mknod db/d20/c83 0 2024-02-19T19:08:33.877 INFO:tasks.workunit.client.0.smithi046.stdout:9/450: symlink db/d53/l84 0 2024-02-19T19:08:33.880 INFO:tasks.workunit.client.0.smithi046.stdout:9/451: rename db/d20/d6b/c40 to db/d1e/d32/d47/d5b/c85 0 2024-02-19T19:08:33.880 INFO:tasks.workunit.client.0.smithi046.stdout:9/452: creat db/d20/d6f/f86 x:0 0 0 2024-02-19T19:08:33.883 INFO:tasks.workunit.client.0.smithi046.stdout:9/453: getdents db/d1e/d32 0 2024-02-19T19:08:33.883 INFO:tasks.workunit.client.0.smithi046.stdout:9/454: fdatasync db/d20/d6b/d54/f74 0 2024-02-19T19:08:33.883 INFO:tasks.workunit.client.0.smithi046.stdout:9/455: read db/f43 [2524253,18751] 0 2024-02-19T19:08:33.886 INFO:tasks.workunit.client.0.smithi046.stdout:9/456: unlink db/d1e/d32/d47/f57 0 2024-02-19T19:08:33.886 INFO:tasks.workunit.client.0.smithi046.stdout:9/457: chown db/d20/d71 14941 1 2024-02-19T19:08:33.886 INFO:tasks.workunit.client.0.smithi046.stdout:1/679: dread d5/fc [0,4194304] 0 2024-02-19T19:08:33.886 INFO:tasks.workunit.client.0.smithi046.stdout:1/680: dread - d5/d2f/d9f/d3b/d4e/fd4 zero size 2024-02-19T19:08:33.886 INFO:tasks.workunit.client.0.smithi046.stdout:1/681: chown d5/d2f/d9f/d3b/d4e/d76 48349929 1 2024-02-19T19:08:33.886 INFO:tasks.workunit.client.0.smithi046.stdout:1/682: chown d5/d2f/d9f/d3b/f52 104 1 2024-02-19T19:08:33.886 INFO:tasks.workunit.client.0.smithi046.stdout:1/683: write d5/d2f/d9f/f2e [679878,66559] 0 2024-02-19T19:08:33.888 INFO:tasks.workunit.client.0.smithi046.stdout:1/684: mkdir d5/d2f/d9f/d3b/de9 0 2024-02-19T19:08:33.889 INFO:tasks.workunit.client.0.smithi046.stdout:1/685: symlink d5/d2f/d9f/d3b/d3c/lea 0 2024-02-19T19:08:33.890 INFO:tasks.workunit.client.0.smithi046.stdout:1/686: rmdir d5/d21/d9a/dd0/d80/daf/db5/dd2 39 2024-02-19T19:08:33.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/648: dwrite d4/d6/d1c/d64/fa1 [0,4194304] 0 2024-02-19T19:08:33.898 INFO:tasks.workunit.client.0.smithi046.stdout:6/649: mknod d4/d6/d1c/d20/d98/dc4/ccf 0 2024-02-19T19:08:33.900 INFO:tasks.workunit.client.0.smithi046.stdout:6/650: getdents d4/d6/d1c/d20 0 2024-02-19T19:08:33.903 INFO:tasks.workunit.client.0.smithi046.stdout:6/651: link d4/d6/d1c/l24 d4/d6/d1c/d20/dc5/ld0 0 2024-02-19T19:08:33.903 INFO:tasks.workunit.client.0.smithi046.stdout:6/652: chown d4/d6/dd/d10/d29/d2d/d35/f4f 0 1 2024-02-19T19:08:33.903 INFO:tasks.workunit.client.0.smithi046.stdout:6/653: write d4/d6/dd/d10/d29/da2/fa8 [515467,20085] 0 2024-02-19T19:08:33.908 INFO:tasks.workunit.client.0.smithi046.stdout:9/458: dwrite db/d20/d4e/f6a [0,4194304] 0 2024-02-19T19:08:33.909 INFO:tasks.workunit.client.0.smithi046.stdout:9/459: stat db/d1e/d32 0 2024-02-19T19:08:33.914 INFO:tasks.workunit.client.0.smithi046.stdout:9/460: getdents db/d53 0 2024-02-19T19:08:33.917 INFO:tasks.workunit.client.0.smithi046.stdout:9/461: creat db/f87 x:0 0 0 2024-02-19T19:08:33.917 INFO:tasks.workunit.client.0.smithi046.stdout:9/462: creat db/d1e/f88 x:0 0 0 2024-02-19T19:08:33.917 INFO:tasks.workunit.client.0.smithi046.stdout:9/463: creat db/d1e/d32/d47/d5b/f89 x:0 0 0 2024-02-19T19:08:33.920 INFO:tasks.workunit.client.0.smithi046.stdout:6/654: dwrite d4/d6/dd/d10/f8a [0,4194304] 0 2024-02-19T19:08:33.921 INFO:tasks.workunit.client.0.smithi046.stdout:6/655: stat d4/d6/dd/d10/d29/d2d/d35/f4f 0 2024-02-19T19:08:33.924 INFO:tasks.workunit.client.0.smithi046.stdout:1/687: dwrite d5/d21/d9a/dd0/f4b [0,4194304] 0 2024-02-19T19:08:33.927 INFO:tasks.workunit.client.0.smithi046.stdout:1/688: write d5/d13/d35/d37/d64/f6b [554353,44239] 0 2024-02-19T19:08:33.928 INFO:tasks.workunit.client.0.smithi046.stdout:1/689: creat d5/d13/d35/d37/d64/feb x:0 0 0 2024-02-19T19:08:33.930 INFO:tasks.workunit.client.0.smithi046.stdout:1/690: symlink d5/d2f/d9f/d55/lec 0 2024-02-19T19:08:33.938 INFO:tasks.workunit.client.0.smithi046.stdout:9/464: dwrite db/d1e/d52/f59 [0,4194304] 0 2024-02-19T19:08:33.938 INFO:tasks.workunit.client.0.smithi046.stdout:9/465: fsync db/d1e/d32/f5d 0 2024-02-19T19:08:33.946 INFO:tasks.workunit.client.0.smithi046.stdout:9/466: read db/d20/f56 [1360739,45221] 0 2024-02-19T19:08:33.946 INFO:tasks.workunit.client.0.smithi046.stdout:9/467: write db/d1e/d32/f61 [1422311,77050] 0 2024-02-19T19:08:33.947 INFO:tasks.workunit.client.0.smithi046.stdout:9/468: mkdir db/d20/d8a 0 2024-02-19T19:08:33.948 INFO:tasks.workunit.client.0.smithi046.stdout:9/469: creat db/d1e/d32/d47/d5b/d7f/f8b x:0 0 0 2024-02-19T19:08:33.949 INFO:tasks.workunit.client.0.smithi046.stdout:5/649: sync 2024-02-19T19:08:33.950 INFO:tasks.workunit.client.0.smithi046.stdout:2/887: sync 2024-02-19T19:08:33.950 INFO:tasks.workunit.client.0.smithi046.stdout:4/765: sync 2024-02-19T19:08:33.950 INFO:tasks.workunit.client.0.smithi046.stdout:2/888: chown d5/d2c/d45/fbd 56808199 1 2024-02-19T19:08:33.950 INFO:tasks.workunit.client.0.smithi046.stdout:4/766: read - d6/d11/d40/fad zero size 2024-02-19T19:08:33.952 INFO:tasks.workunit.client.0.smithi046.stdout:9/470: rename db/l15 to db/d1e/d32/d47/d5b/l8c 0 2024-02-19T19:08:33.954 INFO:tasks.workunit.client.0.smithi046.stdout:9/471: creat db/d20/d6b/f8d x:0 0 0 2024-02-19T19:08:33.956 INFO:tasks.workunit.client.0.smithi046.stdout:9/472: link db/d1e/d32/c77 db/d82/c8e 0 2024-02-19T19:08:33.971 INFO:tasks.workunit.client.0.smithi046.stdout:4/767: dwrite d6/d15/fba [0,4194304] 0 2024-02-19T19:08:33.971 INFO:tasks.workunit.client.0.smithi046.stdout:2/889: dwrite d5/d2c/d56/f58 [0,4194304] 0 2024-02-19T19:08:33.971 INFO:tasks.workunit.client.0.smithi046.stdout:2/890: write d5/d2c/d89/d92/ff3 [590086,18720] 0 2024-02-19T19:08:33.972 INFO:tasks.workunit.client.0.smithi046.stdout:5/650: dwrite d2/dd/d26/d65/f63 [0,4194304] 0 2024-02-19T19:08:33.972 INFO:tasks.workunit.client.0.smithi046.stdout:5/651: chown d2/dd/d26/da9/dc0 109 1 2024-02-19T19:08:33.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/473: dwrite db/d1e/f49 [0,4194304] 0 2024-02-19T19:08:33.973 INFO:tasks.workunit.client.0.smithi046.stdout:4/768: symlink d6/d11/dd6/d89/l103 0 2024-02-19T19:08:33.974 INFO:tasks.workunit.client.0.smithi046.stdout:2/891: symlink d5/l12d 0 2024-02-19T19:08:33.976 INFO:tasks.workunit.client.0.smithi046.stdout:5/652: mkdir d2/dd/d26/da9/dbf/dce 0 2024-02-19T19:08:33.979 INFO:tasks.workunit.client.0.smithi046.stdout:9/474: link db/d20/l30 db/d20/d8a/l8f 0 2024-02-19T19:08:33.981 INFO:tasks.workunit.client.0.smithi046.stdout:2/892: mknod d5/d2c/d45/de7/d105/dfc/c12e 0 2024-02-19T19:08:33.982 INFO:tasks.workunit.client.0.smithi046.stdout:5/653: symlink d2/dd/d29/d89/lcf 0 2024-02-19T19:08:33.983 INFO:tasks.workunit.client.0.smithi046.stdout:9/475: truncate db/f24 3803571 0 2024-02-19T19:08:33.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/893: getdents d5/d2c/d89/d3f/d5c 0 2024-02-19T19:08:33.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/894: fdatasync d5/d6/d13/d7c/d90/fb0 0 2024-02-19T19:08:33.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/895: fsync d5/d2c/d45/f4a 0 2024-02-19T19:08:33.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/896: creat d5/d2c/d89/d3f/d5c/dee/f12f x:0 0 0 2024-02-19T19:08:33.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/897: stat d5/d2c/d45/f4a 0 2024-02-19T19:08:33.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/898: dread - d5/d2c/d56/da5/f115 zero size 2024-02-19T19:08:33.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/899: dread - d5/d6/d13/d7c/d90/fb0 zero size 2024-02-19T19:08:33.985 INFO:tasks.workunit.client.0.smithi046.stdout:2/900: fsync d5/d2c/d35/fce 0 2024-02-19T19:08:33.985 INFO:tasks.workunit.client.0.smithi046.stdout:2/901: fsync f1 0 2024-02-19T19:08:33.985 INFO:tasks.workunit.client.0.smithi046.stdout:2/902: fdatasync d5/d6/d6e/dab/d10b/f128 0 2024-02-19T19:08:33.985 INFO:tasks.workunit.client.0.smithi046.stdout:4/769: read d6/d11/dd6/d89/d8a/f8c [677777,97072] 0 2024-02-19T19:08:33.985 INFO:tasks.workunit.client.0.smithi046.stdout:5/654: truncate d2/dd/f1a 1284441 0 2024-02-19T19:08:33.985 INFO:tasks.workunit.client.0.smithi046.stdout:5/655: chown d2/dd/f5c 146 1 2024-02-19T19:08:33.986 INFO:tasks.workunit.client.0.smithi046.stdout:9/476: symlink db/d20/d8a/l90 0 2024-02-19T19:08:33.986 INFO:tasks.workunit.client.0.smithi046.stdout:9/477: creat db/d1e/d32/d47/d5b/f91 x:0 0 0 2024-02-19T19:08:33.986 INFO:tasks.workunit.client.0.smithi046.stdout:9/478: write db/d1e/d52/f59 [4853557,86205] 0 2024-02-19T19:08:33.988 INFO:tasks.workunit.client.0.smithi046.stdout:2/903: link d5/d2c/d45/c4d d5/d2c/d89/d4c/d75/c130 0 2024-02-19T19:08:33.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/656: link d2/dd/d29/fcd d2/fd0 0 2024-02-19T19:08:33.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/657: chown d2/dd/lc8 970034 1 2024-02-19T19:08:33.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/658: dread - d2/dd/d26/d65/fab zero size 2024-02-19T19:08:33.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/659: stat d2/d27/d4b/dc2/fc3 0 2024-02-19T19:08:33.993 INFO:tasks.workunit.client.0.smithi046.stdout:4/770: dread d6/d15/d17/f41 [0,4194304] 0 2024-02-19T19:08:33.994 INFO:tasks.workunit.client.0.smithi046.stdout:2/904: mknod d5/d2c/d89/d3f/d5c/d9f/dda/d108/c131 0 2024-02-19T19:08:33.994 INFO:tasks.workunit.client.0.smithi046.stdout:9/479: rmdir db/d20/d6b 39 2024-02-19T19:08:33.997 INFO:tasks.workunit.client.0.smithi046.stdout:4/771: creat d6/d94/df4/f104 x:0 0 0 2024-02-19T19:08:33.997 INFO:tasks.workunit.client.0.smithi046.stdout:4/772: read - d6/d11/dd6/d89/d8a/d55/d8e/fc2 zero size 2024-02-19T19:08:33.997 INFO:tasks.workunit.client.0.smithi046.stdout:9/480: symlink db/d1e/d52/l92 0 2024-02-19T19:08:33.999 INFO:tasks.workunit.client.0.smithi046.stdout:4/773: creat d6/d11/d40/da7/f105 x:0 0 0 2024-02-19T19:08:34.000 INFO:tasks.workunit.client.0.smithi046.stdout:9/481: symlink db/d1e/d32/d47/d5b/d7f/l93 0 2024-02-19T19:08:34.006 INFO:tasks.workunit.client.0.smithi046.stdout:5/660: write d2/dd/f36 [778604,106722] 0 2024-02-19T19:08:34.010 INFO:tasks.workunit.client.0.smithi046.stdout:4/774: dread d6/d11/dd6/d89/d8a/d55/fa3 [0,4194304] 0 2024-02-19T19:08:34.011 INFO:tasks.workunit.client.0.smithi046.stdout:4/775: mkdir d6/d11/d92/d102/d106 0 2024-02-19T19:08:34.011 INFO:tasks.workunit.client.0.smithi046.stdout:4/776: fsync d6/d11/f35 0 2024-02-19T19:08:34.012 INFO:tasks.workunit.client.0.smithi046.stdout:4/777: mknod d6/d11/db9/c107 0 2024-02-19T19:08:34.012 INFO:tasks.workunit.client.0.smithi046.stdout:4/778: fsync d6/dd3/db3/fb7 0 2024-02-19T19:08:34.012 INFO:tasks.workunit.client.0.smithi046.stdout:4/779: write d6/d11/dd6/dc3/fc4 [4903994,50184] 0 2024-02-19T19:08:34.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/780: write d6/d15/d17/d1e/f7a [3258798,23860] 0 2024-02-19T19:08:34.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/905: dwrite d5/d2c/d56/d5a/f66 [0,4194304] 0 2024-02-19T19:08:34.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/906: stat d5/d7a/df0 0 2024-02-19T19:08:34.022 INFO:tasks.workunit.client.0.smithi046.stdout:9/482: dread db/f24 [0,4194304] 0 2024-02-19T19:08:34.026 INFO:tasks.workunit.client.0.smithi046.stdout:5/661: write d2/dd/d29/fb9 [1188441,84207] 0 2024-02-19T19:08:34.026 INFO:tasks.workunit.client.0.smithi046.stdout:5/662: fdatasync d2/dd/d26/daa/fb2 0 2024-02-19T19:08:34.026 INFO:tasks.workunit.client.0.smithi046.stdout:5/663: read d2/f2d [257224,102255] 0 2024-02-19T19:08:34.026 INFO:tasks.workunit.client.0.smithi046.stdout:5/664: chown d2/dd/d26/daa/fb5 566 1 2024-02-19T19:08:34.027 INFO:tasks.workunit.client.0.smithi046.stdout:5/665: write d2/dd/f77 [4231459,25942] 0 2024-02-19T19:08:34.037 INFO:tasks.workunit.client.0.smithi046.stdout:4/781: dwrite d6/d50/fa0 [0,4194304] 0 2024-02-19T19:08:34.038 INFO:tasks.workunit.client.0.smithi046.stdout:9/483: read db/d20/d4e/f6a [560982,16834] 0 2024-02-19T19:08:34.040 INFO:tasks.workunit.client.0.smithi046.stdout:4/782: symlink d6/d11/d40/da7/l108 0 2024-02-19T19:08:34.042 INFO:tasks.workunit.client.0.smithi046.stdout:9/484: read db/d1e/d32/d47/d5b/f68 [900952,48454] 0 2024-02-19T19:08:34.042 INFO:tasks.workunit.client.0.smithi046.stdout:9/485: dread - db/d20/d6b/f6e zero size 2024-02-19T19:08:34.043 INFO:tasks.workunit.client.0.smithi046.stdout:4/783: symlink d6/d11/l109 0 2024-02-19T19:08:34.043 INFO:tasks.workunit.client.0.smithi046.stdout:2/907: write d5/d2c/d89/d3f/d5c/d9f/f116 [3216493,93943] 0 2024-02-19T19:08:34.043 INFO:tasks.workunit.client.0.smithi046.stdout:4/784: mkdir d6/d11/d92/d102/d10a 0 2024-02-19T19:08:34.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/908: mkdir d5/d7a/df0/d132 0 2024-02-19T19:08:34.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/909: readlink d5/d2c/d89/d3f/da1/lc4 0 2024-02-19T19:08:34.044 INFO:tasks.workunit.client.0.smithi046.stdout:4/785: rmdir d6/dd3/dc5 39 2024-02-19T19:08:34.045 INFO:tasks.workunit.client.0.smithi046.stdout:4/786: fsync d6/d15/d17/f41 0 2024-02-19T19:08:34.046 INFO:tasks.workunit.client.0.smithi046.stdout:5/666: dwrite d2/dd/f20 [8388608,4194304] 0 2024-02-19T19:08:34.046 INFO:tasks.workunit.client.0.smithi046.stdout:5/667: chown d2/dd/d2f 55900360 1 2024-02-19T19:08:34.046 INFO:tasks.workunit.client.0.smithi046.stdout:5/668: chown d2/dd/f36 285166 1 2024-02-19T19:08:34.046 INFO:tasks.workunit.client.0.smithi046.stdout:2/910: rename d5/d2c/d89/d92/caf to d5/d6/d6e/dab/d10b/c133 0 2024-02-19T19:08:34.047 INFO:tasks.workunit.client.0.smithi046.stdout:4/787: creat d6/d11/dd6/d89/d8a/d55/f10b x:0 0 0 2024-02-19T19:08:34.047 INFO:tasks.workunit.client.0.smithi046.stdout:4/788: readlink d6/d50/l62 0 2024-02-19T19:08:34.048 INFO:tasks.workunit.client.0.smithi046.stdout:2/911: symlink d5/d6/d13/d8a/l134 0 2024-02-19T19:08:34.049 INFO:tasks.workunit.client.0.smithi046.stdout:2/912: dread d5/d2c/f67 [0,4194304] 0 2024-02-19T19:08:34.049 INFO:tasks.workunit.client.0.smithi046.stdout:5/669: rename d2/dd/d3f/c5a to d2/dd/d26/d65/d5f/cd1 0 2024-02-19T19:08:34.050 INFO:tasks.workunit.client.0.smithi046.stdout:4/789: truncate d6/d15/d17/d1e/d25/fd5 4189562 0 2024-02-19T19:08:34.051 INFO:tasks.workunit.client.0.smithi046.stdout:5/670: creat d2/dd/d29/d89/fd2 x:0 0 0 2024-02-19T19:08:34.052 INFO:tasks.workunit.client.0.smithi046.stdout:5/671: creat d2/dd/d26/d65/fd3 x:0 0 0 2024-02-19T19:08:34.058 INFO:tasks.workunit.client.0.smithi046.stdout:2/913: write d5/d2c/d89/f37 [3680321,130138] 0 2024-02-19T19:08:34.058 INFO:tasks.workunit.client.0.smithi046.stdout:9/486: dwrite f0 [4194304,4194304] 0 2024-02-19T19:08:34.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/914: write d5/d6/d13/fcf [415327,39986] 0 2024-02-19T19:08:34.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/915: fsync d5/d2c/d56/da5/f115 0 2024-02-19T19:08:34.064 INFO:tasks.workunit.client.0.smithi046.stdout:9/487: mkdir db/d1e/d32/d47/d5b/d94 0 2024-02-19T19:08:34.066 INFO:tasks.workunit.client.0.smithi046.stdout:2/916: rename d5/d2c/d89/d3f/d82/df4/lfa to d5/d2c/d89/d3f/d82/dd0/l135 0 2024-02-19T19:08:34.066 INFO:tasks.workunit.client.0.smithi046.stdout:9/488: truncate db/f7b 68458 0 2024-02-19T19:08:34.067 INFO:tasks.workunit.client.0.smithi046.stdout:2/917: mknod d5/d2c/d89/d3f/d5c/dd5/d121/c136 0 2024-02-19T19:08:34.068 INFO:tasks.workunit.client.0.smithi046.stdout:9/489: symlink db/d1e/d52/l95 0 2024-02-19T19:08:34.068 INFO:tasks.workunit.client.0.smithi046.stdout:9/490: write db/f18 [3276718,92672] 0 2024-02-19T19:08:34.070 INFO:tasks.workunit.client.0.smithi046.stdout:2/918: rename d5/d6/d6e/dab/d10b/c129 to d5/d2c/d45/de7/d105/de0/c137 0 2024-02-19T19:08:34.073 INFO:tasks.workunit.client.0.smithi046.stdout:9/491: mkdir db/d20/d8a/d96 0 2024-02-19T19:08:34.074 INFO:tasks.workunit.client.0.smithi046.stdout:9/492: creat db/d20/d6b/d54/f97 x:0 0 0 2024-02-19T19:08:34.079 INFO:tasks.workunit.client.0.smithi046.stdout:4/790: dwrite d6/d15/d17/d1e/d25/fd5 [4194304,4194304] 0 2024-02-19T19:08:34.081 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 19:08:33 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[112579]: 2024-02-19T19:08:33.678+0000 7fd838615700 -1 osd.2 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:08:34.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:33 smithi046 ceph-mon[88928]: from='client.44207 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:34.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:33 smithi046 ceph-mon[88928]: from='osd.2 [v2:172.21.15.46:6818/3010717446,v1:172.21.15.46:6819/3010717446]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T19:08:34.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:33 smithi046 ceph-mon[88928]: osdmap e76: 6 total, 5 up, 6 in 2024-02-19T19:08:34.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:33 smithi046 ceph-mon[88928]: from='osd.2 [v2:172.21.15.46:6818/3010717446,v1:172.21.15.46:6819/3010717446]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T19:08:34.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:33 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1133793145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:34.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:33 smithi046 ceph-mon[88928]: from='osd.2 [v2:172.21.15.46:6818/3010717446,v1:172.21.15.46:6819/3010717446]' entity='osd.2' 2024-02-19T19:08:34.082 INFO:tasks.workunit.client.0.smithi046.stdout:4/791: creat d6/d94/df4/de7/f10c x:0 0 0 2024-02-19T19:08:34.082 INFO:tasks.workunit.client.0.smithi046.stdout:4/792: chown d6/dd3/ca4 72 1 2024-02-19T19:08:34.082 INFO:tasks.workunit.client.0.smithi046.stdout:4/793: fsync d6/d15/d17/f78 0 2024-02-19T19:08:34.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/794: mkdir d6/d11/d40/da7/dd2/d10d 0 2024-02-19T19:08:34.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.064+0000 7f9396ff2700 1 -- 172.21.15.46:0/803291503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f939010a540 con 0x7f9390107d50 2024-02-19T19:08:34.088 INFO:tasks.workunit.client.0.smithi046.stdout:4/795: creat d6/d11/db9/f10e x:0 0 0 2024-02-19T19:08:34.088 INFO:tasks.workunit.client.0.smithi046.stdout:4/796: fsync d6/d94/dab/f100 0 2024-02-19T19:08:34.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.064+0000 7f938dffb700 1 -- 172.21.15.46:0/803291503 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1890 (secure 0 0 0) 0x7f939010a540 con 0x7f9390107d50 2024-02-19T19:08:34.088 INFO:teuthology.orchestra.run.smithi046.stdout:e19 2024-02-19T19:08:34.088 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 19 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T19:08:21.613462+0000 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:08:34.089 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:08:34.090 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:34.092 INFO:tasks.workunit.client.0.smithi046.stdout:4/797: creat d6/d11/dd6/d89/d8a/f10f x:0 0 0 2024-02-19T19:08:34.092 INFO:tasks.workunit.client.0.smithi046.stdout:4/798: mknod d6/d11/d92/d102/db1/c110 0 2024-02-19T19:08:34.092 INFO:tasks.workunit.client.0.smithi046.stdout:4/799: truncate d6/d11/d40/fe5 248653 0 2024-02-19T19:08:34.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 -- 172.21.15.46:0/803291503 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f937c06d8f0 msgr2=0x7f937c06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:34.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 --2- 172.21.15.46:0/803291503 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f937c06d8f0 0x7f937c06fda0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9380005950 tx=0x7f93800058e0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 -- 172.21.15.46:0/803291503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9390107d50 msgr2=0x7f9390108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 --2- 172.21.15.46:0/803291503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9390107d50 0x7f9390108f10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9388016040 tx=0x7f9388008320 comp rx=0 tx=0).stop 2024-02-19T19:08:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 -- 172.21.15.46:0/803291503 shutdown_connections 2024-02-19T19:08:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 --2- 172.21.15.46:0/803291503 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f937c06d8f0 0x7f937c06fda0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 --2- 172.21.15.46:0/803291503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9390107d50 0x7f9390108f10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 --2- 172.21.15.46:0/803291503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939010c1f0 0x7f9390109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 -- 172.21.15.46:0/803291503 >> 172.21.15.46:0/803291503 conn(0x7f939006c630 msgr2=0x7f9390070580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 -- 172.21.15.46:0/803291503 shutdown_connections 2024-02-19T19:08:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.068+0000 7f9396ff2700 1 -- 172.21.15.46:0/803291503 wait complete. 2024-02-19T19:08:34.093 INFO:tasks.workunit.client.0.smithi046.stdout:2/919: dwrite d5/d2c/d89/d3f/f5e [0,4194304] 0 2024-02-19T19:08:34.094 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-02-19T19:08:34.096 INFO:tasks.workunit.client.0.smithi046.stdout:4/800: write d6/d11/fc7 [1688771,92741] 0 2024-02-19T19:08:34.096 INFO:tasks.workunit.client.0.smithi046.stdout:4/801: chown d6/d15/d17/d1e/fd8 509171514 1 2024-02-19T19:08:34.098 INFO:tasks.workunit.client.0.smithi046.stdout:2/920: write d5/d2c/d56/d5a/f66 [202554,101683] 0 2024-02-19T19:08:34.100 INFO:tasks.workunit.client.0.smithi046.stdout:2/921: unlink d5/d2c/d89/d4c/f10a 0 2024-02-19T19:08:34.102 INFO:tasks.workunit.client.0.smithi046.stdout:2/922: rename d5/d6/d13/d8a/fa8 to d5/d6/d13/d7c/d90/f138 0 2024-02-19T19:08:34.104 INFO:tasks.workunit.client.0.smithi046.stdout:2/923: dread d5/d2c/d89/fb1 [0,4194304] 0 2024-02-19T19:08:34.105 INFO:tasks.workunit.client.0.smithi046.stdout:2/924: readlink d5/d2c/d56/d5a/lbb 0 2024-02-19T19:08:34.105 INFO:tasks.workunit.client.0.smithi046.stdout:2/925: stat d5/d2c/d89/d3f/d5c/dee 0 2024-02-19T19:08:34.106 INFO:tasks.workunit.client.0.smithi046.stdout:2/926: mkdir d5/d2c/d35/d80/d139 0 2024-02-19T19:08:34.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/927: mknod d5/d6/d6e/dab/c13a 0 2024-02-19T19:08:34.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/928: chown d5/d2c/d89/d3f/d82 7912376 1 2024-02-19T19:08:34.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/929: creat d5/d2c/d56/f13b x:0 0 0 2024-02-19T19:08:34.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/930: write d5/d2c/d35/d80/f87 [952350,37486] 0 2024-02-19T19:08:34.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/931: truncate d5/d2c/d56/da5/f115 1000659 0 2024-02-19T19:08:34.109 INFO:tasks.workunit.client.0.smithi046.stdout:2/932: dread - d5/d2c/d35/fd3 zero size 2024-02-19T19:08:34.109 INFO:tasks.workunit.client.0.smithi046.stdout:2/933: truncate d5/d2c/d35/fd3 395248 0 2024-02-19T19:08:34.110 INFO:tasks.workunit.client.0.smithi046.stdout:2/934: link d5/d6/d13/d8a/cec d5/d2c/d89/d4c/d75/dbe/c13c 0 2024-02-19T19:08:34.110 INFO:tasks.workunit.client.0.smithi046.stdout:2/935: write d5/d2c/d35/f69 [4964638,75356] 0 2024-02-19T19:08:34.110 INFO:tasks.workunit.client.0.smithi046.stdout:2/936: read - d5/d6/d13/d7c/d90/fc7 zero size 2024-02-19T19:08:34.110 INFO:tasks.workunit.client.0.smithi046.stdout:2/937: stat d5/d2c/d45/de7/le8 0 2024-02-19T19:08:34.111 INFO:tasks.workunit.client.0.smithi046.stdout:2/938: creat d5/d2c/d89/d3f/d82/df4/d127/f13d x:0 0 0 2024-02-19T19:08:34.120 INFO:tasks.workunit.client.0.smithi046.stdout:4/802: dwrite d6/d15/fba [0,4194304] 0 2024-02-19T19:08:34.120 INFO:tasks.workunit.client.0.smithi046.stdout:4/803: readlink d6/d11/l109 0 2024-02-19T19:08:34.123 INFO:tasks.workunit.client.0.smithi046.stdout:2/939: write d5/d6/d13/d7c/d90/f138 [676220,37903] 0 2024-02-19T19:08:34.124 INFO:tasks.workunit.client.0.smithi046.stdout:2/940: read - d5/d2c/d89/d3f/d82/df4/d127/f13d zero size 2024-02-19T19:08:34.144 INFO:tasks.workunit.client.0.smithi046.stdout:4/804: dwrite d6/d11/d92/fbb [0,4194304] 0 2024-02-19T19:08:34.144 INFO:tasks.workunit.client.0.smithi046.stdout:2/941: dwrite d5/d2c/d89/d4c/d75/fb8 [0,4194304] 0 2024-02-19T19:08:34.146 INFO:tasks.workunit.client.0.smithi046.stdout:4/805: symlink d6/d11/d40/da7/l111 0 2024-02-19T19:08:34.146 INFO:tasks.workunit.client.0.smithi046.stdout:4/806: stat d6/dd3/db3/fea 0 2024-02-19T19:08:34.146 INFO:tasks.workunit.client.0.smithi046.stdout:4/807: chown d6/d15/d17/d1e/d25 7313 1 2024-02-19T19:08:34.148 INFO:tasks.workunit.client.0.smithi046.stdout:2/942: unlink d5/d2c/d89/d3f/d82/db6/fe6 0 2024-02-19T19:08:34.149 INFO:tasks.workunit.client.0.smithi046.stdout:2/943: mknod d5/d7a/df0/c13e 0 2024-02-19T19:08:34.149 INFO:tasks.workunit.client.0.smithi046.stdout:2/944: rmdir d5/d2c/d45/d9b 39 2024-02-19T19:08:34.150 INFO:tasks.workunit.client.0.smithi046.stdout:2/945: symlink d5/d2c/d89/d3f/d5c/d9f/dda/df1/l13f 0 2024-02-19T19:08:34.151 INFO:tasks.workunit.client.0.smithi046.stdout:2/946: chown d5/d2c/d89/d4c/d75/c130 297228 1 2024-02-19T19:08:34.151 INFO:tasks.workunit.client.0.smithi046.stdout:2/947: chown d5/d6a 10601618 1 2024-02-19T19:08:34.151 INFO:tasks.workunit.client.0.smithi046.stdout:2/948: creat d5/d2c/d89/d92/f140 x:0 0 0 2024-02-19T19:08:34.156 INFO:tasks.workunit.client.0.smithi046.stdout:2/949: dread d5/d2c/d89/d3f/d5c/d9f/f116 [0,4194304] 0 2024-02-19T19:08:34.157 INFO:tasks.workunit.client.0.smithi046.stdout:4/808: write d6/f97 [1348619,47263] 0 2024-02-19T19:08:34.157 INFO:tasks.workunit.client.0.smithi046.stdout:4/809: fdatasync d6/d11/dd6/d89/d8a/f10f 0 2024-02-19T19:08:34.157 INFO:tasks.workunit.client.0.smithi046.stdout:2/950: mknod d5/d6/d6e/dab/c141 0 2024-02-19T19:08:34.158 INFO:tasks.workunit.client.0.smithi046.stdout:4/810: creat d6/d11/dd6/d89/d8a/deb/f112 x:0 0 0 2024-02-19T19:08:34.158 INFO:tasks.workunit.client.0.smithi046.stdout:4/811: write d6/d15/d17/d1e/d25/f2f [5701481,72915] 0 2024-02-19T19:08:34.158 INFO:tasks.workunit.client.0.smithi046.stdout:2/951: rmdir d5/d2c/d89/d3f/d5c/d9f/dda/df1 39 2024-02-19T19:08:34.159 INFO:tasks.workunit.client.0.smithi046.stdout:4/812: rename d6/d11/d40/da7/dd2/dd4/cd9 to d6/d11/dd6/d89/d8a/deb/c113 0 2024-02-19T19:08:34.160 INFO:tasks.workunit.client.0.smithi046.stdout:4/813: chown d6/d11/dd6 2 1 2024-02-19T19:08:34.160 INFO:tasks.workunit.client.0.smithi046.stdout:2/952: truncate d5/d6/d6e/dab/fae 1253833 0 2024-02-19T19:08:34.161 INFO:tasks.workunit.client.0.smithi046.stdout:7/789: sync 2024-02-19T19:08:34.161 INFO:tasks.workunit.client.0.smithi046.stdout:4/814: truncate d6/d15/d17/d1e/d25/f4b 4843131 0 2024-02-19T19:08:34.162 INFO:tasks.workunit.client.0.smithi046.stdout:4/815: write d6/f42 [874103,71307] 0 2024-02-19T19:08:34.172 INFO:tasks.workunit.client.0.smithi046.stdout:7/790: read d0/d45/d4a/d58/f42 [3156127,127457] 0 2024-02-19T19:08:34.182 INFO:tasks.workunit.client.0.smithi046.stdout:7/791: dread d0/d45/d4a/d58/d60/dbe/df9/f6b [0,4194304] 0 2024-02-19T19:08:34.182 INFO:tasks.workunit.client.0.smithi046.stdout:7/792: truncate d0/d45/d4a/d58/dc6/ff1 694084 0 2024-02-19T19:08:34.186 INFO:tasks.workunit.client.0.smithi046.stdout:2/953: dread d5/d2c/d89/d3f/d82/fc9 [0,4194304] 0 2024-02-19T19:08:34.186 INFO:tasks.workunit.client.0.smithi046.stdout:2/954: creat d5/d2c/d56/da5/f142 x:0 0 0 2024-02-19T19:08:34.187 INFO:tasks.workunit.client.0.smithi046.stdout:2/955: creat d5/f143 x:0 0 0 2024-02-19T19:08:34.188 INFO:tasks.workunit.client.0.smithi046.stdout:7/793: dread d0/d45/d4a/d58/d91/fad [0,4194304] 0 2024-02-19T19:08:34.188 INFO:tasks.workunit.client.0.smithi046.stdout:7/794: dread - d0/d4/d24/fbc zero size 2024-02-19T19:08:34.188 INFO:tasks.workunit.client.0.smithi046.stdout:7/795: creat d0/d4/d24/db9/ffd x:0 0 0 2024-02-19T19:08:34.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/956: link d5/d2c/f5f d5/d6/d6e/f144 0 2024-02-19T19:08:34.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:33 smithi142 ceph-mon[69118]: from='client.44207 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:34.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:33 smithi142 ceph-mon[69118]: from='osd.2 [v2:172.21.15.46:6818/3010717446,v1:172.21.15.46:6819/3010717446]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T19:08:34.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:33 smithi142 ceph-mon[69118]: osdmap e76: 6 total, 5 up, 6 in 2024-02-19T19:08:34.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:33 smithi142 ceph-mon[69118]: from='osd.2 [v2:172.21.15.46:6818/3010717446,v1:172.21.15.46:6819/3010717446]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-02-19T19:08:34.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:33 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1133793145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:34.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:33 smithi142 ceph-mon[69118]: from='osd.2 [v2:172.21.15.46:6818/3010717446,v1:172.21.15.46:6819/3010717446]' entity='osd.2' 2024-02-19T19:08:34.209 INFO:tasks.workunit.client.0.smithi046.stdout:2/957: dread d5/d2c/d35/f69 [0,4194304] 0 2024-02-19T19:08:34.210 INFO:tasks.workunit.client.0.smithi046.stdout:7/796: dwrite d0/d45/d71/d4b/f72 [4194304,4194304] 0 2024-02-19T19:08:34.210 INFO:tasks.workunit.client.0.smithi046.stdout:7/797: write d0/d45/d4a/d58/d60/ff7 [310922,4313] 0 2024-02-19T19:08:34.212 INFO:tasks.workunit.client.0.smithi046.stdout:2/958: creat d5/d6/d13/d7c/d90/f145 x:0 0 0 2024-02-19T19:08:34.213 INFO:tasks.workunit.client.0.smithi046.stdout:2/959: dread - d5/d2c/d35/d80/fdc zero size 2024-02-19T19:08:34.213 INFO:tasks.workunit.client.0.smithi046.stdout:2/960: chown d5/d6/d6e 22 1 2024-02-19T19:08:34.214 INFO:tasks.workunit.client.0.smithi046.stdout:2/961: symlink d5/d6/d6e/l146 0 2024-02-19T19:08:34.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/962: rename d5/d6/d13/d7c/d90/fc7 to d5/d7a/df0/f147 0 2024-02-19T19:08:34.218 INFO:tasks.workunit.client.0.smithi046.stdout:2/963: mknod d5/d2c/d89/d3f/d82/da4/c148 0 2024-02-19T19:08:34.218 INFO:tasks.workunit.client.0.smithi046.stdout:2/964: stat d5/d2c/c32 0 2024-02-19T19:08:34.218 INFO:tasks.workunit.client.0.smithi046.stdout:2/965: fdatasync d5/d6/d6e/dab/d10b/f128 0 2024-02-19T19:08:34.220 INFO:tasks.workunit.client.0.smithi046.stdout:2/966: creat d5/d2c/d89/d3f/d82/dd0/f149 x:0 0 0 2024-02-19T19:08:34.220 INFO:tasks.workunit.client.0.smithi046.stdout:2/967: chown d5/d6/l99 448 1 2024-02-19T19:08:34.221 INFO:tasks.workunit.client.0.smithi046.stdout:2/968: mknod d5/d2c/d56/d5a/c14a 0 2024-02-19T19:08:34.222 INFO:tasks.workunit.client.0.smithi046.stdout:2/969: rmdir d5/d2c/d56/da5 39 2024-02-19T19:08:34.224 INFO:tasks.workunit.client.0.smithi046.stdout:2/970: mknod d5/d2c/d56/da5/da9/c14b 0 2024-02-19T19:08:34.224 INFO:tasks.workunit.client.0.smithi046.stdout:2/971: truncate d5/d2c/d35/d80/fdc 1027733 0 2024-02-19T19:08:34.224 INFO:tasks.workunit.client.0.smithi046.stdout:2/972: truncate d5/d2c/d45/f9c 2535664 0 2024-02-19T19:08:34.225 INFO:tasks.workunit.client.0.smithi046.stdout:2/973: mkdir d5/d2c/d45/de7/d105/dfc/d14c 0 2024-02-19T19:08:34.227 INFO:tasks.workunit.client.0.smithi046.stdout:7/798: dwrite d0/d45/d71/f4c [0,4194304] 0 2024-02-19T19:08:34.227 INFO:tasks.workunit.client.0.smithi046.stdout:2/974: dread d5/d2c/d56/d5a/fac [0,4194304] 0 2024-02-19T19:08:34.234 INFO:tasks.workunit.client.0.smithi046.stdout:7/799: dread d0/d45/d71/f5b [0,4194304] 0 2024-02-19T19:08:34.245 INFO:tasks.workunit.client.0.smithi046.stdout:2/975: dwrite d5/d2c/d89/d3f/d82/f7b [0,4194304] 0 2024-02-19T19:08:34.245 INFO:tasks.workunit.client.0.smithi046.stdout:2/976: stat d5/d2c/d89/fb1 0 2024-02-19T19:08:34.245 INFO:tasks.workunit.client.0.smithi046.stdout:2/977: truncate d5/d6/d13/d7c/d90/f145 272037 0 2024-02-19T19:08:34.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.238+0000 7f3643a77700 1 -- 172.21.15.46:0/2644892223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f363c0ffbd0 msgr2=0x7f363c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:34.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.238+0000 7f3643a77700 1 --2- 172.21.15.46:0/2644892223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f363c0ffbd0 0x7f363c100040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f362c009910 tx=0x7f362c009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:34.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.238+0000 7f3643a77700 1 -- 172.21.15.46:0/2644892223 shutdown_connections 2024-02-19T19:08:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.238+0000 7f3643a77700 1 --2- 172.21.15.46:0/2644892223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f363c0ffbd0 0x7f363c100040 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.238+0000 7f3643a77700 1 --2- 172.21.15.46:0/2644892223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c104130 0x7f363c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.238+0000 7f3643a77700 1 -- 172.21.15.46:0/2644892223 >> 172.21.15.46:0/2644892223 conn(0x7f363c075130 msgr2=0x7f363c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.238+0000 7f3643a77700 1 -- 172.21.15.46:0/2644892223 shutdown_connections 2024-02-19T19:08:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.238+0000 7f3643a77700 1 -- 172.21.15.46:0/2644892223 wait complete. 2024-02-19T19:08:34.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.239+0000 7f3643a77700 1 Processor -- start 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.239+0000 7f3643a77700 1 -- start start 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.239+0000 7f3643a77700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f363c0ffbd0 0x7f363c196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.239+0000 7f3643a77700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c104130 0x7f363c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.239+0000 7f3643a77700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c197800 con 0x7f363c0ffbd0 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.239+0000 7f3643a77700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c197940 con 0x7f363c104130 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.239+0000 7f3641813700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f363c0ffbd0 0x7f363c196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3641813700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f363c0ffbd0 0x7f363c196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40292/0 (socket says 172.21.15.46:40292) 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3641813700 1 -- 172.21.15.46:0/4288466518 learned_addr learned my addr 172.21.15.46:0/4288466518 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3641012700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c104130 0x7f363c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3641813700 1 -- 172.21.15.46:0/4288466518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c104130 msgr2=0x7f363c1971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3641813700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c104130 0x7f363c1971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3641813700 1 -- 172.21.15.46:0/4288466518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c0095f0 con 0x7f363c0ffbd0 2024-02-19T19:08:34.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3641813700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f363c0ffbd0 0x7f363c196ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f363800e920 tx=0x7f363800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:34.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3632ffd700 1 -- 172.21.15.46:0/4288466518 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f363800c9d0 con 0x7f363c0ffbd0 2024-02-19T19:08:34.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3632ffd700 1 -- 172.21.15.46:0/4288466518 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3638010430 con 0x7f363c0ffbd0 2024-02-19T19:08:34.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3643a77700 1 -- 172.21.15.46:0/4288466518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c19fd10 con 0x7f363c0ffbd0 2024-02-19T19:08:34.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.240+0000 7f3643a77700 1 -- 172.21.15.46:0/4288466518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c1a01d0 con 0x7f363c0ffbd0 2024-02-19T19:08:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.241+0000 7f3632ffd700 1 -- 172.21.15.46:0/4288466518 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3638018630 con 0x7f363c0ffbd0 2024-02-19T19:08:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.242+0000 7f3643a77700 1 -- 172.21.15.46:0/4288466518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3620005320 con 0x7f363c0ffbd0 2024-02-19T19:08:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.242+0000 7f3632ffd700 1 -- 172.21.15.46:0/4288466518 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f36380188a0 con 0x7f363c0ffbd0 2024-02-19T19:08:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.242+0000 7f3632ffd700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f362806d8a0 0x7f362806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:34.264 INFO:tasks.workunit.client.0.smithi046.stdout:2/978: dwrite d5/d2c/d89/d3f/da1/fc1 [4194304,4194304] 0 2024-02-19T19:08:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.243+0000 7f3632ffd700 1 -- 172.21.15.46:0/4288466518 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f3638014070 con 0x7f363c0ffbd0 2024-02-19T19:08:34.265 INFO:tasks.workunit.client.0.smithi046.stdout:2/979: chown d5/d2c/d35/d80/ccd 18349 1 2024-02-19T19:08:34.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.243+0000 7f3641012700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f362806d8a0 0x7f362806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:34.265 INFO:tasks.workunit.client.0.smithi046.stdout:2/980: write d5/d2c/d45/fb7 [1289166,2033] 0 2024-02-19T19:08:34.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.243+0000 7f3641012700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f362806d8a0 0x7f362806fd50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f363c068df0 tx=0x7f362c009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:34.266 INFO:tasks.workunit.client.0.smithi046.stdout:2/981: mkdir d5/d2c/d89/d3f/d82/df4/d127/d14d 0 2024-02-19T19:08:34.266 INFO:tasks.workunit.client.0.smithi046.stdout:2/982: stat d5/d6/d6e 0 2024-02-19T19:08:34.266 INFO:tasks.workunit.client.0.smithi046.stdout:2/983: truncate d5/d6/dd7/fed 93633 0 2024-02-19T19:08:34.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.248+0000 7f3632ffd700 1 -- 172.21.15.46:0/4288466518 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3638052d20 con 0x7f363c0ffbd0 2024-02-19T19:08:34.307 INFO:tasks.workunit.client.0.smithi046.stdout:8/884: sync 2024-02-19T19:08:34.307 INFO:tasks.workunit.client.0.smithi046.stdout:0/838: sync 2024-02-19T19:08:34.307 INFO:tasks.workunit.client.0.smithi046.stdout:3/494: sync 2024-02-19T19:08:34.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/495: link da/d1d/c19 da/d30/d38/c86 0 2024-02-19T19:08:34.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/496: stat da/d30/d38/d66/f69 0 2024-02-19T19:08:34.310 INFO:tasks.workunit.client.0.smithi046.stdout:8/885: mknod d3/dd/d13/d6b/d46/d6a/c133 0 2024-02-19T19:08:34.312 INFO:tasks.workunit.client.0.smithi046.stdout:3/497: rename da/d30/c52 to da/d1d/d63/c87 0 2024-02-19T19:08:34.312 INFO:tasks.workunit.client.0.smithi046.stdout:3/498: write da/d30/d38/d66/f69 [1485777,7442] 0 2024-02-19T19:08:34.312 INFO:tasks.workunit.client.0.smithi046.stdout:8/886: mkdir d3/dd/d13/d6b/d46/d6a/db2/d134 0 2024-02-19T19:08:34.315 INFO:tasks.workunit.client.0.smithi046.stdout:8/887: mkdir d3/d37/d64/da2/d135 0 2024-02-19T19:08:34.321 INFO:tasks.workunit.client.0.smithi046.stdout:3/499: dread da/f37 [0,4194304] 0 2024-02-19T19:08:34.321 INFO:tasks.workunit.client.0.smithi046.stdout:3/500: write da/d1d/d10/f6e [255311,34172] 0 2024-02-19T19:08:34.323 INFO:tasks.workunit.client.0.smithi046.stdout:3/501: link da/d1d/c19 da/d1d/d63/d64/c88 0 2024-02-19T19:08:34.324 INFO:tasks.workunit.client.0.smithi046.stdout:0/839: dwrite d0/d24/d5b/fa9 [0,4194304] 0 2024-02-19T19:08:34.324 INFO:tasks.workunit.client.0.smithi046.stdout:3/502: mknod da/d1d/d82/c89 0 2024-02-19T19:08:34.324 INFO:tasks.workunit.client.0.smithi046.stdout:3/503: read da/f20 [1065027,73509] 0 2024-02-19T19:08:34.326 INFO:tasks.workunit.client.0.smithi046.stdout:0/840: truncate d0/f1b 1082468 0 2024-02-19T19:08:34.326 INFO:tasks.workunit.client.0.smithi046.stdout:0/841: creat d0/d19/d70/dba/f11a x:0 0 0 2024-02-19T19:08:34.326 INFO:tasks.workunit.client.0.smithi046.stdout:0/842: chown d0/d19/d4d/da5 750 1 2024-02-19T19:08:34.327 INFO:tasks.workunit.client.0.smithi046.stdout:3/504: unlink da/d1d/c4d 0 2024-02-19T19:08:34.329 INFO:tasks.workunit.client.0.smithi046.stdout:0/843: mknod d0/d19/d8/d37/d40/da6/c11b 0 2024-02-19T19:08:34.329 INFO:tasks.workunit.client.0.smithi046.stdout:0/844: fsync d0/d19/d8/d37/f7d 0 2024-02-19T19:08:34.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/888: dwrite d3/d18/fd4 [0,4194304] 0 2024-02-19T19:08:34.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/889: fdatasync d3/dd/f39 0 2024-02-19T19:08:34.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/890: read - d3/dd/d13/d6b/d46/d6a/f10e zero size 2024-02-19T19:08:34.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/891: chown d3/dd/d3f/d49 112635 1 2024-02-19T19:08:34.336 INFO:tasks.workunit.client.0.smithi046.stdout:8/892: rename d3/dd/d13/d6b/d46/d6a/db2/fcf to d3/d9d/f136 0 2024-02-19T19:08:34.343 INFO:tasks.workunit.client.0.smithi046.stdout:0/845: dwrite d0/d24/f2a [0,4194304] 0 2024-02-19T19:08:34.343 INFO:tasks.workunit.client.0.smithi046.stdout:0/846: fdatasync d0/d24/d56/da3/fc9 0 2024-02-19T19:08:34.343 INFO:tasks.workunit.client.0.smithi046.stdout:0/847: stat d0/d19/db/df0/f10c 0 2024-02-19T19:08:34.343 INFO:tasks.workunit.client.0.smithi046.stdout:0/848: readlink d0/d19/d88/le8 0 2024-02-19T19:08:34.343 INFO:tasks.workunit.client.0.smithi046.stdout:0/849: chown d0/d24/d2f/d53/d6b/d10e 13 1 2024-02-19T19:08:34.345 INFO:tasks.workunit.client.0.smithi046.stdout:8/893: write d3/dd/d3f/d49/d5b/d5f/f89 [2385284,71127] 0 2024-02-19T19:08:34.345 INFO:tasks.workunit.client.0.smithi046.stdout:8/894: stat d3/d18/c75 0 2024-02-19T19:08:34.351 INFO:tasks.workunit.client.0.smithi046.stdout:0/850: read d0/f52 [1711872,83335] 0 2024-02-19T19:08:34.351 INFO:tasks.workunit.client.0.smithi046.stdout:0/851: write d0/d5f/ddc/fff [177183,86901] 0 2024-02-19T19:08:34.353 INFO:tasks.workunit.client.0.smithi046.stdout:0/852: creat d0/d24/d5b/d7f/d9b/f11c x:0 0 0 2024-02-19T19:08:34.361 INFO:tasks.workunit.client.0.smithi046.stdout:8/895: dwrite d3/dd/d13/d66/f7b [0,4194304] 0 2024-02-19T19:08:34.364 INFO:tasks.workunit.client.0.smithi046.stdout:8/896: unlink d3/dd/d13/d6b/d46/cb9 0 2024-02-19T19:08:34.364 INFO:tasks.workunit.client.0.smithi046.stdout:8/897: fsync d3/d37/d111/f117 0 2024-02-19T19:08:34.365 INFO:tasks.workunit.client.0.smithi046.stdout:8/898: unlink d3/d37/d64/da2/d3c/le6 0 2024-02-19T19:08:34.365 INFO:tasks.workunit.client.0.smithi046.stdout:8/899: write d3/dd/f15 [1528057,92941] 0 2024-02-19T19:08:34.366 INFO:tasks.workunit.client.0.smithi046.stdout:8/900: rename d3/d9d/fc2 to d3/dd/d3f/d49/f137 0 2024-02-19T19:08:34.366 INFO:tasks.workunit.client.0.smithi046.stdout:8/901: chown d3/dd/d3f/c12b 11 1 2024-02-19T19:08:34.367 INFO:tasks.workunit.client.0.smithi046.stdout:8/902: link d3/d37/c76 d3/dd/d13/d6b/d46/d6a/c138 0 2024-02-19T19:08:34.367 INFO:tasks.workunit.client.0.smithi046.stdout:8/903: chown d3/dd/d3f/c12b 234758 1 2024-02-19T19:08:34.368 INFO:tasks.workunit.client.0.smithi046.stdout:8/904: chown d3/dd/d13 2 1 2024-02-19T19:08:34.368 INFO:tasks.workunit.client.0.smithi046.stdout:0/853: dwrite d0/d24/d8c/fea [0,4194304] 0 2024-02-19T19:08:34.368 INFO:tasks.workunit.client.0.smithi046.stdout:0/854: creat d0/d19/d70/dba/f11d x:0 0 0 2024-02-19T19:08:34.369 INFO:tasks.workunit.client.0.smithi046.stdout:8/905: rmdir d3/d8b/d113/df8 39 2024-02-19T19:08:34.369 INFO:tasks.workunit.client.0.smithi046.stdout:8/906: fdatasync d3/d37/d111/f117 0 2024-02-19T19:08:34.370 INFO:tasks.workunit.client.0.smithi046.stdout:0/855: mkdir d0/d19/d11e 0 2024-02-19T19:08:34.371 INFO:tasks.workunit.client.0.smithi046.stdout:0/856: symlink d0/d19/db/df0/l11f 0 2024-02-19T19:08:34.372 INFO:tasks.workunit.client.0.smithi046.stdout:0/857: mkdir d0/dd2/d120 0 2024-02-19T19:08:34.376 INFO:tasks.workunit.client.0.smithi046.stdout:8/907: dread d3/dd/d13/d6b/d46/d6a/f91 [4194304,4194304] 0 2024-02-19T19:08:34.378 INFO:tasks.workunit.client.0.smithi046.stdout:8/908: link d3/d37/d64/l6e d3/dd/d3f/l139 0 2024-02-19T19:08:34.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/909: write d3/fab [3661232,130313] 0 2024-02-19T19:08:34.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/910: fsync d3/dd/d3f/d49/d5b/f125 0 2024-02-19T19:08:34.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/911: chown d3/d37/d111/c121 0 1 2024-02-19T19:08:34.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/912: read d3/dd/d3f/fcb [1966363,40474] 0 2024-02-19T19:08:34.388 INFO:tasks.workunit.client.0.smithi046.stdout:8/913: mkdir d3/dd/d13/d6b/d46/d6a/d13a 0 2024-02-19T19:08:34.389 INFO:tasks.workunit.client.0.smithi046.stdout:8/914: truncate d3/dd/f14 5153739 0 2024-02-19T19:08:34.389 INFO:tasks.workunit.client.0.smithi046.stdout:8/915: fsync d3/dd/d13/d6b/d46/d6a/f91 0 2024-02-19T19:08:34.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/916: dread d3/dd/d13/d6b/d46/d6a/f91 [0,4194304] 0 2024-02-19T19:08:34.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/917: truncate d3/dd/d13/d6b/d46/d6a/f11a 643032 0 2024-02-19T19:08:34.398 INFO:tasks.workunit.client.0.smithi046.stdout:8/918: rename d3/dd/d3f/l139 to d3/dd/d3f/d49/d5b/d5f/d12c/l13b 0 2024-02-19T19:08:34.399 INFO:tasks.workunit.client.0.smithi046.stdout:8/919: chown d3/dd/d13/d6b/l3d 177 1 2024-02-19T19:08:34.400 INFO:tasks.workunit.client.0.smithi046.stdout:8/920: mkdir d3/d37/d64/da2/d3c/dd9/d13c 0 2024-02-19T19:08:34.407 INFO:tasks.workunit.client.0.smithi046.stdout:8/921: dread d3/dd/d3f/fcb [0,4194304] 0 2024-02-19T19:08:34.408 INFO:tasks.workunit.client.0.smithi046.stdout:8/922: link d3/d37/c26 d3/d37/dca/c13d 0 2024-02-19T19:08:34.409 INFO:tasks.workunit.client.0.smithi046.stdout:8/923: rmdir d3/d8b 39 2024-02-19T19:08:34.416 INFO:tasks.workunit.client.0.smithi046.stdout:8/924: dread d3/d9d/f136 [0,4194304] 0 2024-02-19T19:08:34.416 INFO:tasks.workunit.client.0.smithi046.stdout:8/925: chown d3/dd/d3f/d49/d5b/d5f/c9e 0 1 2024-02-19T19:08:34.416 INFO:tasks.workunit.client.0.smithi046.stdout:8/926: stat d3/dd/d13/d42/l7d 0 2024-02-19T19:08:34.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/927: creat d3/d8b/f13e x:0 0 0 2024-02-19T19:08:34.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/928: dread d3/dd/d13/d42/f57 [4194304,4194304] 0 2024-02-19T19:08:34.424 INFO:tasks.workunit.client.0.smithi046.stdout:8/929: mkdir d3/dd/d13/d6b/d46/d13f 0 2024-02-19T19:08:34.426 INFO:tasks.workunit.client.0.smithi046.stdout:8/930: rename d3/dd/f24 to d3/d37/d9b/f140 0 2024-02-19T19:08:34.435 INFO:tasks.workunit.client.0.smithi046.stdout:8/931: read d3/d37/d64/da2/d3c/f43 [1124700,38018] 0 2024-02-19T19:08:34.435 INFO:tasks.workunit.client.0.smithi046.stdout:8/932: dread - d3/d37/dca/fe2 zero size 2024-02-19T19:08:34.435 INFO:tasks.workunit.client.0.smithi046.stdout:8/933: write d3/d37/d64/da2/d3c/db6/ffd [823591,56047] 0 2024-02-19T19:08:34.435 INFO:tasks.workunit.client.0.smithi046.stdout:8/934: fsync d3/d37/f71 0 2024-02-19T19:08:34.435 INFO:tasks.workunit.client.0.smithi046.stdout:8/935: creat d3/d8b/d124/f141 x:0 0 0 2024-02-19T19:08:34.435 INFO:tasks.workunit.client.0.smithi046.stdout:8/936: chown d3/dd/d13/d6b/d46/d6a/db2/lbd 1629 1 2024-02-19T19:08:34.435 INFO:tasks.workunit.client.0.smithi046.stdout:8/937: write d3/f9 [4394507,93151] 0 2024-02-19T19:08:34.436 INFO:tasks.workunit.client.0.smithi046.stdout:8/938: symlink d3/dd/d13/d6b/d46/d6a/l142 0 2024-02-19T19:08:34.437 INFO:tasks.workunit.client.0.smithi046.stdout:8/939: creat d3/dd/d3f/d49/d5b/d5f/f143 x:0 0 0 2024-02-19T19:08:34.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/940: write d3/d9d/f136 [1779999,23489] 0 2024-02-19T19:08:34.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/941: chown d3/d37/d64/da2/d3c/dd9 233563 1 2024-02-19T19:08:34.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/942: chown d3/dd/d13/d66/ccd 0 1 2024-02-19T19:08:34.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/943: write d3/d37/d9b/f140 [5410240,111872] 0 2024-02-19T19:08:34.443 INFO:tasks.workunit.client.0.smithi046.stdout:8/944: creat d3/d37/dca/f144 x:0 0 0 2024-02-19T19:08:34.444 INFO:tasks.workunit.client.0.smithi046.stdout:8/945: stat d3/d37/d9b/de9/d122/l123 0 2024-02-19T19:08:34.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/946: dwrite d3/dd/d13/d6b/d46/f74 [0,4194304] 0 2024-02-19T19:08:34.478 INFO:tasks.workunit.client.0.smithi046.stdout:8/947: write d3/dd/d13/d6b/d46/d54/d8a/f8c [3705820,106192] 0 2024-02-19T19:08:34.478 INFO:tasks.workunit.client.0.smithi046.stdout:8/948: truncate d3/dd/d13/d6b/f28 2641057 0 2024-02-19T19:08:34.491 INFO:tasks.workunit.client.0.smithi046.stdout:8/949: dwrite d3/dd/d3f/d49/d5b/d5f/da0/dd8/fed [0,4194304] 0 2024-02-19T19:08:34.492 INFO:tasks.workunit.client.0.smithi046.stdout:8/950: truncate d3/dd/d13/d6b/d46/d54/d8a/f99 823253 0 2024-02-19T19:08:34.493 INFO:tasks.workunit.client.0.smithi046.stdout:8/951: truncate d3/dd/d13/d6b/d46/d6a/db2/ff0 2469616 0 2024-02-19T19:08:34.494 INFO:tasks.workunit.client.0.smithi046.stdout:8/952: mkdir d3/d37/d9b/de9/d145 0 2024-02-19T19:08:34.495 INFO:tasks.workunit.client.0.smithi046.stdout:8/953: creat d3/dd/d13/d42/dda/f146 x:0 0 0 2024-02-19T19:08:34.497 INFO:tasks.workunit.client.0.smithi046.stdout:8/954: rename d3/dd/d3f/c119 to d3/dd/d13/d6b/d46/d13f/c147 0 2024-02-19T19:08:34.498 INFO:tasks.workunit.client.0.smithi046.stdout:8/955: write d3/d9d/fc0 [13519,29198] 0 2024-02-19T19:08:34.505 INFO:tasks.workunit.client.0.smithi046.stdout:8/956: write d3/d37/d64/da2/d3c/f87 [3557535,39822] 0 2024-02-19T19:08:34.506 INFO:tasks.workunit.client.0.smithi046.stdout:8/957: truncate d3/d37/d64/f7a 435312 0 2024-02-19T19:08:34.520 INFO:tasks.workunit.client.0.smithi046.stdout:1/691: sync 2024-02-19T19:08:34.520 INFO:tasks.workunit.client.0.smithi046.stdout:6/656: sync 2024-02-19T19:08:34.522 INFO:tasks.workunit.client.0.smithi046.stdout:1/692: mkdir d5/d21/d9a/dd0/d80/daf/db5/dbe/dd3/ded 0 2024-02-19T19:08:34.522 INFO:tasks.workunit.client.0.smithi046.stdout:6/657: getdents d4/d6/dd/d10/d29/d2d/d35/d3c 0 2024-02-19T19:08:34.524 INFO:tasks.workunit.client.0.smithi046.stdout:6/658: symlink d4/d6/d1c/d20/ld1 0 2024-02-19T19:08:34.525 INFO:tasks.workunit.client.0.smithi046.stdout:6/659: mknod d4/d6/cd2 0 2024-02-19T19:08:34.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/958: dwrite d3/dd/d3f/d49/d5b/d5f/da0/fb3 [0,4194304] 0 2024-02-19T19:08:34.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/959: write d3/d9d/f136 [1806824,57005] 0 2024-02-19T19:08:34.535 INFO:tasks.workunit.client.0.smithi046.stdout:8/960: mknod d3/dd/d3f/d49/d5b/d5f/d12c/c148 0 2024-02-19T19:08:34.536 INFO:tasks.workunit.client.0.smithi046.stdout:6/660: dread d4/d6/d1c/f51 [0,4194304] 0 2024-02-19T19:08:34.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/961: symlink d3/dd/d3f/l149 0 2024-02-19T19:08:34.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/962: chown d3/l34 129363 1 2024-02-19T19:08:34.537 INFO:tasks.workunit.client.0.smithi046.stdout:1/693: dwrite d5/d2f/d9f/d3b/d4e/d76/fa0 [0,4194304] 0 2024-02-19T19:08:34.537 INFO:tasks.workunit.client.0.smithi046.stdout:1/694: stat d5/d2f/d9f/f95 0 2024-02-19T19:08:34.537 INFO:tasks.workunit.client.0.smithi046.stdout:1/695: fsync d5/f17 0 2024-02-19T19:08:34.537 INFO:tasks.workunit.client.0.smithi046.stdout:1/696: read - d5/d21/d9a/fdf zero size 2024-02-19T19:08:34.539 INFO:tasks.workunit.client.0.smithi046.stdout:8/963: truncate d3/d8b/d124/f12d 226458 0 2024-02-19T19:08:34.540 INFO:tasks.workunit.client.0.smithi046.stdout:1/697: symlink d5/d2f/d9f/d55/lee 0 2024-02-19T19:08:34.556 INFO:tasks.workunit.client.0.smithi046.stdout:6/661: dwrite d4/d6/dd/d10/d29/d2d/f47 [0,4194304] 0 2024-02-19T19:08:34.556 INFO:tasks.workunit.client.0.smithi046.stdout:6/662: chown d4/l93 63445 1 2024-02-19T19:08:34.556 INFO:tasks.workunit.client.0.smithi046.stdout:6/663: truncate d4/f73 236556 0 2024-02-19T19:08:34.558 INFO:tasks.workunit.client.0.smithi046.stdout:6/664: creat d4/d6/dd/d10/d29/da2/fd3 x:0 0 0 2024-02-19T19:08:34.560 INFO:tasks.workunit.client.0.smithi046.stdout:6/665: getdents d4/d6/dd/d10/d29/d2d/d35 0 2024-02-19T19:08:34.560 INFO:tasks.workunit.client.0.smithi046.stdout:6/666: chown d4/d6/d1c/d64/lbd 9219127 1 2024-02-19T19:08:34.564 INFO:tasks.workunit.client.0.smithi046.stdout:1/698: dwrite d5/d13/d35/d37/f7f [4194304,4194304] 0 2024-02-19T19:08:34.566 INFO:tasks.workunit.client.0.smithi046.stdout:1/699: getdents d5/d13/d35/d37/d64/dce 0 2024-02-19T19:08:34.566 INFO:tasks.workunit.client.0.smithi046.stdout:1/700: write d5/d13/d35/d37/d64/d87/fcd [4991637,18328] 0 2024-02-19T19:08:34.568 INFO:tasks.workunit.client.0.smithi046.stdout:6/667: read d4/d6/dd/d10/d29/f36 [3197528,51285] 0 2024-02-19T19:08:34.569 INFO:tasks.workunit.client.0.smithi046.stdout:6/668: symlink d4/d6/dd/d10/d29/da2/ld4 0 2024-02-19T19:08:34.570 INFO:tasks.workunit.client.0.smithi046.stdout:1/701: dread d5/d13/f19 [0,4194304] 0 2024-02-19T19:08:34.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/669: creat d4/d6/d1c/d20/d7a/fd5 x:0 0 0 2024-02-19T19:08:34.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/702: link d5/d13/d35/d37/d64/d87/lb7 d5/d21/d9a/dd0/d80/daf/lef 0 2024-02-19T19:08:34.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/703: chown d5/d13/d35/d37/fa9 216641365 1 2024-02-19T19:08:34.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/704: write d5/d21/d9a/dd0/d80/daf/db5/dbe/fc8 [80624,116009] 0 2024-02-19T19:08:34.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/705: creat d5/d13/d35/d37/d64/d75/dcf/ff0 x:0 0 0 2024-02-19T19:08:34.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/706: creat d5/d2f/d9f/d3b/d3c/d3f/ff1 x:0 0 0 2024-02-19T19:08:34.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/707: fsync d5/d13/d35/d37/fa9 0 2024-02-19T19:08:34.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/708: dread - d5/d2f/d9f/d3b/fd8 zero size 2024-02-19T19:08:34.576 INFO:tasks.workunit.client.0.smithi046.stdout:1/709: mknod d5/d2f/d9f/d3b/d4e/d91/cf2 0 2024-02-19T19:08:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.568+0000 7f3643a77700 1 -- 172.21.15.46:0/4288466518 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3620000bf0 con 0x7f362806d8a0 2024-02-19T19:08:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.570+0000 7f3632ffd700 1 -- 172.21.15.46:0/4288466518 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3620000bf0 con 0x7f362806d8a0 2024-02-19T19:08:34.591 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:08:34.591 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:08:34.591 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:08:34.591 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:08:34.591 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:08:34.591 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:08:34.591 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-02-19T19:08:34.591 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:08:34.592 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:08:34.592 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "8/23 daemons upgraded", 2024-02-19T19:08:34.592 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:08:34.592 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:08:34.592 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:08:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 -- 172.21.15.46:0/4288466518 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f362806d8a0 msgr2=0x7f362806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f362806d8a0 0x7f362806fd50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f363c068df0 tx=0x7f362c009f70 comp rx=0 tx=0).stop 2024-02-19T19:08:34.594 INFO:tasks.workunit.client.0.smithi046.stdout:6/670: dwrite d4/d6/dd/d10/d29/d2d/f47 [4194304,4194304] 0 2024-02-19T19:08:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 -- 172.21.15.46:0/4288466518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f363c0ffbd0 msgr2=0x7f363c196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f363c0ffbd0 0x7f363c196ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f363800e920 tx=0x7f363800ec30 comp rx=0 tx=0).stop 2024-02-19T19:08:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 -- 172.21.15.46:0/4288466518 shutdown_connections 2024-02-19T19:08:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f362806d8a0 0x7f362806fd50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f363c0ffbd0 0x7f363c196ca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 --2- 172.21.15.46:0/4288466518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f363c104130 0x7f363c1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 -- 172.21.15.46:0/4288466518 >> 172.21.15.46:0/4288466518 conn(0x7f363c075130 msgr2=0x7f363c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:34.595 INFO:tasks.workunit.client.0.smithi046.stdout:1/710: dwrite d5/fc [4194304,4194304] 0 2024-02-19T19:08:34.595 INFO:tasks.workunit.client.0.smithi046.stdout:1/711: write d5/d2f/d9f/f2e [941498,128682] 0 2024-02-19T19:08:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 -- 172.21.15.46:0/4288466518 shutdown_connections 2024-02-19T19:08:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.573+0000 7f3643a77700 1 -- 172.21.15.46:0/4288466518 wait complete. 2024-02-19T19:08:34.596 INFO:tasks.workunit.client.0.smithi046.stdout:6/671: mkdir d4/d6/d1c/d20/d98/dc4/dce/dd6 0 2024-02-19T19:08:34.597 INFO:tasks.workunit.client.0.smithi046.stdout:1/712: mkdir d5/d21/d9a/df3 0 2024-02-19T19:08:34.597 INFO:tasks.workunit.client.0.smithi046.stdout:1/713: read d5/d2f/d9f/d3b/f52 [1120398,130327] 0 2024-02-19T19:08:34.597 INFO:tasks.workunit.client.0.smithi046.stdout:1/714: write d5/d2f/fd9 [728473,105298] 0 2024-02-19T19:08:34.597 INFO:tasks.workunit.client.0.smithi046.stdout:1/715: dread - d5/d13/d35/d37/f79 zero size 2024-02-19T19:08:34.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/672: unlink d4/d6/d1c/d20/d98/dc4/ccf 0 2024-02-19T19:08:34.600 INFO:tasks.workunit.client.0.smithi046.stdout:1/716: creat d5/d2f/d9f/d3b/d4e/ff4 x:0 0 0 2024-02-19T19:08:34.600 INFO:tasks.workunit.client.0.smithi046.stdout:1/717: chown d5/d13/d35/c53 1 1 2024-02-19T19:08:34.608 INFO:tasks.workunit.client.0.smithi046.stdout:1/718: creat d5/d13/ff5 x:0 0 0 2024-02-19T19:08:34.608 INFO:tasks.workunit.client.0.smithi046.stdout:1/719: readlink d5/d13/d35/d37/d64/le4 0 2024-02-19T19:08:34.611 INFO:tasks.workunit.client.0.smithi046.stdout:6/673: dwrite d4/d6/d1c/d20/f6f [0,4194304] 0 2024-02-19T19:08:34.612 INFO:tasks.workunit.client.0.smithi046.stdout:6/674: mkdir d4/d6/d1c/dd7 0 2024-02-19T19:08:34.617 INFO:tasks.workunit.client.0.smithi046.stdout:1/720: dread d5/d2f/d9f/d3b/f52 [0,4194304] 0 2024-02-19T19:08:34.629 INFO:tasks.workunit.client.0.smithi046.stdout:6/675: dwrite d4/d6/dd/d10/d29/d2d/f47 [4194304,4194304] 0 2024-02-19T19:08:34.629 INFO:tasks.workunit.client.0.smithi046.stdout:6/676: write d4/d6/f4c [319446,119769] 0 2024-02-19T19:08:34.639 INFO:tasks.workunit.client.0.smithi046.stdout:1/721: dwrite d5/d13/d35/d37/f6c [0,4194304] 0 2024-02-19T19:08:34.641 INFO:tasks.workunit.client.0.smithi046.stdout:1/722: symlink d5/d2f/d9f/d3b/lf6 0 2024-02-19T19:08:34.641 INFO:tasks.workunit.client.0.smithi046.stdout:1/723: rename d5/d21/d9a/dd0/d80/daf/db5 to d5/d21/d9a/dd0/d80/daf/db5/dbe/dd3/df7 22 2024-02-19T19:08:34.657 INFO:tasks.workunit.client.0.smithi046.stdout:1/724: dwrite d5/d13/fe5 [0,4194304] 0 2024-02-19T19:08:34.657 INFO:tasks.workunit.client.0.smithi046.stdout:1/725: creat d5/d2f/d9f/dc9/ff8 x:0 0 0 2024-02-19T19:08:34.658 INFO:tasks.workunit.client.0.smithi046.stdout:1/726: write d5/d2f/d5e/f97 [214895,186] 0 2024-02-19T19:08:34.658 INFO:tasks.workunit.client.0.smithi046.stdout:1/727: write d5/d21/f23 [795892,97420] 0 2024-02-19T19:08:34.658 INFO:tasks.workunit.client.0.smithi046.stdout:1/728: fsync d5/d21/f69 0 2024-02-19T19:08:34.660 INFO:tasks.workunit.client.0.smithi046.stdout:1/729: symlink d5/d21/d9a/dd0/lf9 0 2024-02-19T19:08:34.661 INFO:tasks.workunit.client.0.smithi046.stdout:1/730: mknod d5/d13/d35/d37/d64/d75/dcf/cfa 0 2024-02-19T19:08:34.661 INFO:tasks.workunit.client.0.smithi046.stdout:1/731: stat d5/d13/d35/d37/d64/le4 0 2024-02-19T19:08:34.670 INFO:tasks.workunit.client.0.smithi046.stdout:1/732: getdents d5/d13/d35/d37/d64/d75/dcf 0 2024-02-19T19:08:34.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/733: rmdir d5/d21/d9a/dd0/d80/daf/db5/dbe/dd3/ded 0 2024-02-19T19:08:34.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/734: creat d5/d13/d35/d37/d64/ffb x:0 0 0 2024-02-19T19:08:34.693 INFO:tasks.workunit.client.0.smithi046.stdout:1/735: dwrite d5/d2f/d5e/f97 [0,4194304] 0 2024-02-19T19:08:34.695 INFO:tasks.workunit.client.0.smithi046.stdout:1/736: mkdir d5/d13/d35/d37/d64/dce/dfc 0 2024-02-19T19:08:34.695 INFO:tasks.workunit.client.0.smithi046.stdout:1/737: dread - d5/d2f/d9f/d3b/d3c/d3f/ff1 zero size 2024-02-19T19:08:34.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/738: dread d5/d2f/d9f/f2e [0,4194304] 0 2024-02-19T19:08:34.723 INFO:tasks.workunit.client.0.smithi046.stdout:1/739: write d5/d13/d35/f41 [3546126,60670] 0 2024-02-19T19:08:34.723 INFO:tasks.workunit.client.0.smithi046.stdout:1/740: stat d5/d2f/d9f/d3b/d4e/d91/cbf 0 2024-02-19T19:08:34.725 INFO:tasks.workunit.client.0.smithi046.stdout:1/741: rename d5/d13/d35/f8b to d5/d21/ffd 0 2024-02-19T19:08:34.727 INFO:tasks.workunit.client.0.smithi046.stdout:1/742: rename d5/d2f/c8d to d5/d21/d9a/cfe 0 2024-02-19T19:08:34.727 INFO:tasks.workunit.client.0.smithi046.stdout:1/743: fdatasync d5/d21/d9a/dd0/f47 0 2024-02-19T19:08:34.749 INFO:tasks.workunit.client.0.smithi046.stdout:5/672: sync 2024-02-19T19:08:34.749 INFO:tasks.workunit.client.0.smithi046.stdout:9/493: sync 2024-02-19T19:08:34.749 INFO:tasks.workunit.client.0.smithi046.stdout:9/494: fsync db/f87 0 2024-02-19T19:08:34.750 INFO:tasks.workunit.client.0.smithi046.stdout:9/495: mknod db/d1e/d32/d47/d5b/c98 0 2024-02-19T19:08:34.760 INFO:tasks.workunit.client.0.smithi046.stdout:9/496: dread db/f24 [0,4194304] 0 2024-02-19T19:08:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.743+0000 7f975cc68700 1 -- 172.21.15.46:0/3220786032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97580ffd60 msgr2=0x7f9758103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.743+0000 7f975cc68700 1 --2- 172.21.15.46:0/3220786032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97580ffd60 0x7f9758103d30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f974c009910 tx=0x7f974c009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.743+0000 7f975cc68700 1 -- 172.21.15.46:0/3220786032 shutdown_connections 2024-02-19T19:08:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.743+0000 7f975cc68700 1 --2- 172.21.15.46:0/3220786032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97580ffd60 0x7f9758103d30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.743+0000 7f975cc68700 1 --2- 172.21.15.46:0/3220786032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97580ff3c0 0x7f97580ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.743+0000 7f975cc68700 1 -- 172.21.15.46:0/3220786032 >> 172.21.15.46:0/3220786032 conn(0x7f97580fac60 msgr2=0x7f97580fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:34.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.743+0000 7f975cc68700 1 -- 172.21.15.46:0/3220786032 shutdown_connections 2024-02-19T19:08:34.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.743+0000 7f975cc68700 1 -- 172.21.15.46:0/3220786032 wait complete. 2024-02-19T19:08:34.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.744+0000 7f975cc68700 1 Processor -- start 2024-02-19T19:08:34.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.744+0000 7f975cc68700 1 -- start start 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.744+0000 7f975cc68700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97580ff3c0 0x7f9758193d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.744+0000 7f975cc68700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97580ffd60 0x7f9758194250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.744+0000 7f975cc68700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9758194930 con 0x7f97580ff3c0 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.744+0000 7f975cc68700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97581986c0 con 0x7f97580ffd60 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.744+0000 7f975659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97580ff3c0 0x7f9758193d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.744+0000 7f975659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97580ff3c0 0x7f9758193d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40314/0 (socket says 172.21.15.46:40314) 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.744+0000 7f975659c700 1 -- 172.21.15.46:0/2879641241 learned_addr learned my addr 172.21.15.46:0/2879641241 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.744+0000 7f9755d9b700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97580ffd60 0x7f9758194250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.745+0000 7f975659c700 1 -- 172.21.15.46:0/2879641241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97580ffd60 msgr2=0x7f9758194250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.745+0000 7f975659c700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97580ffd60 0x7f9758194250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.745+0000 7f975659c700 1 -- 172.21.15.46:0/2879641241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c0095f0 con 0x7f97580ff3c0 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.745+0000 7f975659c700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97580ff3c0 0x7f9758193d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f974800e920 tx=0x7f974800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.745+0000 7f97477fe700 1 -- 172.21.15.46:0/2879641241 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f974800c9d0 con 0x7f97580ff3c0 2024-02-19T19:08:34.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.745+0000 7f975cc68700 1 -- 172.21.15.46:0/2879641241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97581989a0 con 0x7f97580ff3c0 2024-02-19T19:08:34.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.745+0000 7f97477fe700 1 -- 172.21.15.46:0/2879641241 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9748010430 con 0x7f97580ff3c0 2024-02-19T19:08:34.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.745+0000 7f97477fe700 1 -- 172.21.15.46:0/2879641241 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9748018630 con 0x7f97580ff3c0 2024-02-19T19:08:34.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.745+0000 7f975cc68700 1 -- 172.21.15.46:0/2879641241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9758198ec0 con 0x7f97580ff3c0 2024-02-19T19:08:34.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.747+0000 7f975cc68700 1 -- 172.21.15.46:0/2879641241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9758107730 con 0x7f97580ff3c0 2024-02-19T19:08:34.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.748+0000 7f97477fe700 1 -- 172.21.15.46:0/2879641241 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f97480105a0 con 0x7f97580ff3c0 2024-02-19T19:08:34.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.748+0000 7f97477fe700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f974006fab0 0x7f9740071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:34.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.748+0000 7f97477fe700 1 -- 172.21.15.46:0/2879641241 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f9748014070 con 0x7f97580ff3c0 2024-02-19T19:08:34.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.748+0000 7f9755d9b700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f974006fab0 0x7f9740071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:34.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.749+0000 7f9755d9b700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f974006fab0 0x7f9740071f60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f974c009fd0 tx=0x7f974c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:34.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:34.756+0000 7f97477fe700 1 -- 172.21.15.46:0/2879641241 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9748052d20 con 0x7f97580ff3c0 2024-02-19T19:08:35.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:34 smithi046 ceph-mon[88928]: pgmap v123: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 1.6 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 182 MiB/s rd, 213 MiB/s wr, 425 op/s; 6811/43461 objects degraded (15.672%) 2024-02-19T19:08:35.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:34 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/803291503' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:08:35.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:34 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 6919/44139 objects degraded (15.675%), 28 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:35.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:34 smithi046 ceph-mon[88928]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:35.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:34 smithi046 ceph-mon[88928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:08:35.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:34 smithi046 ceph-mon[88928]: osd.2 [v2:172.21.15.46:6818/3010717446,v1:172.21.15.46:6819/3010717446] boot 2024-02-19T19:08:35.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:34 smithi046 ceph-mon[88928]: osdmap e77: 6 total, 6 up, 6 in 2024-02-19T19:08:35.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:34 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:08:35.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.112+0000 7f975cc68700 1 -- 172.21.15.46:0/2879641241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9758067980 con 0x7f97580ff3c0 2024-02-19T19:08:35.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.112+0000 7f97477fe700 1 -- 172.21.15.46:0/2879641241 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1748 (secure 0 0 0) 0x7f9748056f80 con 0x7f97580ff3c0 2024-02-19T19:08:35.133 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN Degraded data redundancy: 6811/43461 objects degraded (15.672%), 28 pgs degraded 2024-02-19T19:08:35.133 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 6811/43461 objects degraded (15.672%), 28 pgs degraded 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1 is active+undersized+degraded, acting [1,5] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.7 is active+undersized+degraded, acting [1,4] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.13 is active+undersized+degraded, acting [1,4] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1f is active+undersized+degraded, acting [1,4] 2024-02-19T19:08:35.134 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.0 is active+undersized+degraded, acting [1,4] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.1 is active+undersized+degraded, acting [0,4] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.4 is active+undersized+degraded, acting [1,0] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.5 is active+undersized+degraded, acting [5,3] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.7 is active+undersized+degraded, acting [1,4] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.8 is active+undersized+degraded, acting [1,5] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.9 is active+undersized+degraded, acting [1,5] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.d is active+undersized+degraded, acting [3,4] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.13 is active+undersized+degraded, acting [3,5] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.17 is active+undersized+degraded, acting [0,5] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.18 is active+undersized+degraded, acting [0,1] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.1a is active+undersized+degraded, acting [4,1] 2024-02-19T19:08:35.135 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.1d is active+undersized+degraded, acting [5,1] 2024-02-19T19:08:35.136 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.1e is active+undersized+degraded, acting [3,1] 2024-02-19T19:08:35.136 INFO:teuthology.orchestra.run.smithi046.stdout: pg 3.1f is active+undersized+degraded, acting [0,3] 2024-02-19T19:08:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.114+0000 7f975cc68700 1 -- 172.21.15.46:0/2879641241 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f974006fab0 msgr2=0x7f9740071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.114+0000 7f975cc68700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f974006fab0 0x7f9740071f60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f974c009fd0 tx=0x7f974c005a90 comp rx=0 tx=0).stop 2024-02-19T19:08:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.114+0000 7f975cc68700 1 -- 172.21.15.46:0/2879641241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97580ff3c0 msgr2=0x7f9758193d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.114+0000 7f975cc68700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97580ff3c0 0x7f9758193d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f974800e920 tx=0x7f974800ec30 comp rx=0 tx=0).stop 2024-02-19T19:08:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.114+0000 7f975cc68700 1 -- 172.21.15.46:0/2879641241 shutdown_connections 2024-02-19T19:08:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.114+0000 7f975cc68700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f974006fab0 0x7f9740071f60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.114+0000 7f975cc68700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97580ff3c0 0x7f9758193d10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.114+0000 7f975cc68700 1 --2- 172.21.15.46:0/2879641241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97580ffd60 0x7f9758194250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.114+0000 7f975cc68700 1 -- 172.21.15.46:0/2879641241 >> 172.21.15.46:0/2879641241 conn(0x7f97580fac60 msgr2=0x7f97580fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.115+0000 7f975cc68700 1 -- 172.21.15.46:0/2879641241 shutdown_connections 2024-02-19T19:08:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:08:35.115+0000 7f975cc68700 1 -- 172.21.15.46:0/2879641241 wait complete. 2024-02-19T19:08:35.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:34 smithi142 ceph-mon[69118]: pgmap v123: 65 pgs: 1 active+undersized, 28 active+undersized+degraded, 36 active+clean; 1.6 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 182 MiB/s rd, 213 MiB/s wr, 425 op/s; 6811/43461 objects degraded (15.672%) 2024-02-19T19:08:35.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:34 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/803291503' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:08:35.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:34 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 6919/44139 objects degraded (15.675%), 28 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:35.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:34 smithi142 ceph-mon[69118]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:35.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:34 smithi142 ceph-mon[69118]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:08:35.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:34 smithi142 ceph-mon[69118]: osd.2 [v2:172.21.15.46:6818/3010717446,v1:172.21.15.46:6819/3010717446] boot 2024-02-19T19:08:35.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:34 smithi142 ceph-mon[69118]: osdmap e77: 6 total, 6 up, 6 in 2024-02-19T19:08:35.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:34 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:08:36.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:35 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2879641241' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:08:36.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:35 smithi046 ceph-mon[88928]: osdmap e78: 6 total, 6 up, 6 in 2024-02-19T19:08:36.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:35 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2879641241' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:08:36.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:35 smithi142 ceph-mon[69118]: osdmap e78: 6 total, 6 up, 6 in 2024-02-19T19:08:36.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:36 smithi046 ceph-mon[88928]: pgmap v126: 65 pgs: 7 peering, 1 active+undersized, 21 active+undersized+degraded, 36 active+clean; 1.7 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 172 MiB/s rd, 197 MiB/s wr, 409 op/s; 5420/43164 objects degraded (12.557%) 2024-02-19T19:08:36.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:36 smithi046 ceph-mon[88928]: osdmap e79: 6 total, 6 up, 6 in 2024-02-19T19:08:37.102 INFO:tasks.workunit.client.0.smithi046.stdout:5/673: write d2/dd/d2f/d34/f74 [1799575,35242] 0 2024-02-19T19:08:37.103 INFO:tasks.workunit.client.0.smithi046.stdout:5/674: mknod d2/dd/d26/daa/cd4 0 2024-02-19T19:08:37.103 INFO:tasks.workunit.client.0.smithi046.stdout:5/675: fsync d2/dd/d29/d89/fd2 0 2024-02-19T19:08:37.106 INFO:tasks.workunit.client.0.smithi046.stdout:5/676: link d2/dd/d26/d65/d5f/f92 d2/dd/d26/da9/dc0/fd5 0 2024-02-19T19:08:37.129 INFO:tasks.workunit.client.0.smithi046.stdout:5/677: dwrite d2/dd/f44 [0,4194304] 0 2024-02-19T19:08:37.131 INFO:tasks.workunit.client.0.smithi046.stdout:5/678: dread d2/dd/f5c [0,4194304] 0 2024-02-19T19:08:37.132 INFO:tasks.workunit.client.0.smithi046.stdout:5/679: creat d2/dd/d26/d65/fd6 x:0 0 0 2024-02-19T19:08:37.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/680: mkdir d2/dd/d26/da9/dbf/dd7 0 2024-02-19T19:08:37.134 INFO:tasks.workunit.client.0.smithi046.stdout:9/497: write db/f36 [2569795,31427] 0 2024-02-19T19:08:37.134 INFO:tasks.workunit.client.0.smithi046.stdout:9/498: truncate db/f4b 115899 0 2024-02-19T19:08:37.134 INFO:tasks.workunit.client.0.smithi046.stdout:9/499: write db/f87 [167368,81778] 0 2024-02-19T19:08:37.134 INFO:tasks.workunit.client.0.smithi046.stdout:9/500: write db/f4b [1014304,130662] 0 2024-02-19T19:08:37.144 INFO:tasks.workunit.client.0.smithi046.stdout:5/681: dread d2/dd/d29/f2a [0,4194304] 0 2024-02-19T19:08:37.144 INFO:tasks.workunit.client.0.smithi046.stdout:5/682: write d2/dd/d29/fb9 [4423436,60381] 0 2024-02-19T19:08:37.144 INFO:tasks.workunit.client.0.smithi046.stdout:5/683: read d2/dd/d26/d65/fa5 [2808163,112718] 0 2024-02-19T19:08:37.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/684: write d2/dd/d26/d65/fd6 [555162,114255] 0 2024-02-19T19:08:37.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/685: write d2/dd/d29/f45 [242146,61303] 0 2024-02-19T19:08:37.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/686: read d2/fb [2202063,36377] 0 2024-02-19T19:08:37.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/687: write d2/dd/d2f/d34/f74 [2246504,63614] 0 2024-02-19T19:08:37.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/688: dread - d2/d27/d47/d7f/fcb zero size 2024-02-19T19:08:37.147 INFO:tasks.workunit.client.0.smithi046.stdout:9/501: dread db/f36 [0,4194304] 0 2024-02-19T19:08:37.160 INFO:tasks.workunit.client.0.smithi046.stdout:5/689: dwrite d2/d27/d4b/f96 [0,4194304] 0 2024-02-19T19:08:37.160 INFO:tasks.workunit.client.0.smithi046.stdout:5/690: dread - d2/d27/d47/d54/db8/fc5 zero size 2024-02-19T19:08:37.160 INFO:tasks.workunit.client.0.smithi046.stdout:5/691: readlink d2/d27/d47/d54/d57/l9d 0 2024-02-19T19:08:37.175 INFO:tasks.workunit.client.0.smithi046.stdout:9/502: fsync db/f4b 0 2024-02-19T19:08:37.185 INFO:tasks.workunit.client.0.smithi046.stdout:9/503: mkdir db/d1e/d99 0 2024-02-19T19:08:37.190 INFO:tasks.workunit.client.0.smithi046.stdout:9/504: dread db/d1e/f1f [0,4194304] 0 2024-02-19T19:08:37.190 INFO:tasks.workunit.client.0.smithi046.stdout:9/505: write db/d20/d6b/f8d [979298,29663] 0 2024-02-19T19:08:37.190 INFO:tasks.workunit.client.0.smithi046.stdout:4/816: sync 2024-02-19T19:08:37.191 INFO:tasks.workunit.client.0.smithi046.stdout:9/506: mknod db/d20/c9a 0 2024-02-19T19:08:37.192 INFO:tasks.workunit.client.0.smithi046.stdout:5/692: dwrite d2/dd/d2f/d34/d5d/f61 [0,4194304] 0 2024-02-19T19:08:37.193 INFO:tasks.workunit.client.0.smithi046.stdout:4/817: symlink d6/d11/dd6/d89/l114 0 2024-02-19T19:08:37.195 INFO:tasks.workunit.client.0.smithi046.stdout:9/507: creat db/d20/d8a/d96/f9b x:0 0 0 2024-02-19T19:08:37.197 INFO:tasks.workunit.client.0.smithi046.stdout:7/800: sync 2024-02-19T19:08:37.197 INFO:tasks.workunit.client.0.smithi046.stdout:7/801: creat d0/d45/d4a/d58/d60/dbe/ffe x:0 0 0 2024-02-19T19:08:37.197 INFO:tasks.workunit.client.0.smithi046.stdout:7/802: write d0/f48 [1279284,77743] 0 2024-02-19T19:08:37.197 INFO:tasks.workunit.client.0.smithi046.stdout:7/803: write d0/d45/d71/d4b/d8d/fef [349636,50944] 0 2024-02-19T19:08:37.200 INFO:tasks.workunit.client.0.smithi046.stdout:5/693: unlink d2/dd/ce 0 2024-02-19T19:08:37.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/818: creat d6/d11/d40/da7/f115 x:0 0 0 2024-02-19T19:08:37.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:36 smithi142 ceph-mon[69118]: pgmap v126: 65 pgs: 7 peering, 1 active+undersized, 21 active+undersized+degraded, 36 active+clean; 1.7 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 172 MiB/s rd, 197 MiB/s wr, 409 op/s; 5420/43164 objects degraded (12.557%) 2024-02-19T19:08:37.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:36 smithi142 ceph-mon[69118]: osdmap e79: 6 total, 6 up, 6 in 2024-02-19T19:08:37.202 INFO:tasks.workunit.client.0.smithi046.stdout:9/508: creat db/d1e/d32/d47/d5b/d94/f9c x:0 0 0 2024-02-19T19:08:37.204 INFO:tasks.workunit.client.0.smithi046.stdout:7/804: mkdir d0/d45/d4a/d58/d60/dbe/dff 0 2024-02-19T19:08:37.207 INFO:tasks.workunit.client.0.smithi046.stdout:4/819: link c2 d6/d11/dd6/dc3/c116 0 2024-02-19T19:08:37.210 INFO:tasks.workunit.client.0.smithi046.stdout:9/509: truncate db/d1e/d32/f61 931603 0 2024-02-19T19:08:37.212 INFO:tasks.workunit.client.0.smithi046.stdout:2/984: sync 2024-02-19T19:08:37.212 INFO:tasks.workunit.client.0.smithi046.stdout:2/985: stat d5/d7a 0 2024-02-19T19:08:37.212 INFO:tasks.workunit.client.0.smithi046.stdout:0/858: sync 2024-02-19T19:08:37.212 INFO:tasks.workunit.client.0.smithi046.stdout:0/859: fdatasync d0/f4e 0 2024-02-19T19:08:37.212 INFO:tasks.workunit.client.0.smithi046.stdout:8/964: sync 2024-02-19T19:08:37.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/677: sync 2024-02-19T19:08:37.212 INFO:tasks.workunit.client.0.smithi046.stdout:3/505: sync 2024-02-19T19:08:37.213 INFO:tasks.workunit.client.0.smithi046.stdout:1/744: sync 2024-02-19T19:08:37.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/805: creat d0/d45/f100 x:0 0 0 2024-02-19T19:08:37.213 INFO:tasks.workunit.client.0.smithi046.stdout:1/745: fsync d5/d2f/d9f/d55/f63 0 2024-02-19T19:08:37.213 INFO:tasks.workunit.client.0.smithi046.stdout:1/746: creat d5/d21/d9a/fff x:0 0 0 2024-02-19T19:08:37.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/806: creat d0/d45/d98/f101 x:0 0 0 2024-02-19T19:08:37.213 INFO:tasks.workunit.client.0.smithi046.stdout:2/986: dread d5/d2c/d89/d3f/d82/db6/dc6/fdd [0,4194304] 0 2024-02-19T19:08:37.215 INFO:tasks.workunit.client.0.smithi046.stdout:4/820: link d6/d11/dd6/d89/d8a/l5e d6/d11/d40/da7/dd2/dd4/l117 0 2024-02-19T19:08:37.216 INFO:tasks.workunit.client.0.smithi046.stdout:0/860: mknod d0/d19/d4d/da5/da7/db8/d107/c121 0 2024-02-19T19:08:37.220 INFO:tasks.workunit.client.0.smithi046.stdout:8/965: mkdir d3/dd/d13/d6b/d46/d6a/db2/d14a 0 2024-02-19T19:08:37.220 INFO:tasks.workunit.client.0.smithi046.stdout:8/966: write d3/dd/d3f/d49/d5b/fbc [765923,75491] 0 2024-02-19T19:08:37.222 INFO:tasks.workunit.client.0.smithi046.stdout:3/506: mkdir da/d8a 0 2024-02-19T19:08:37.224 INFO:tasks.workunit.client.0.smithi046.stdout:3/507: dread da/d30/d38/f7d [0,4194304] 0 2024-02-19T19:08:37.225 INFO:tasks.workunit.client.0.smithi046.stdout:1/747: truncate d5/d2f/d9f/dc9/fe6 2102879 0 2024-02-19T19:08:37.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/510: dread db/d1e/f49 [0,4194304] 0 2024-02-19T19:08:37.233 INFO:tasks.workunit.client.0.smithi046.stdout:0/861: getdents d0/d19/d8/d37/dd9 0 2024-02-19T19:08:37.233 INFO:tasks.workunit.client.0.smithi046.stdout:8/967: creat d3/d37/d9b/de4/f14b x:0 0 0 2024-02-19T19:08:37.233 INFO:tasks.workunit.client.0.smithi046.stdout:2/987: creat d5/d2c/d45/dbf/f14e x:0 0 0 2024-02-19T19:08:37.233 INFO:tasks.workunit.client.0.smithi046.stdout:2/988: truncate d5/d6/dd7/fed 996558 0 2024-02-19T19:08:37.233 INFO:tasks.workunit.client.0.smithi046.stdout:3/508: mknod da/d30/d38/d54/c8b 0 2024-02-19T19:08:37.233 INFO:tasks.workunit.client.0.smithi046.stdout:0/862: mkdir d0/d19/d88/d122 0 2024-02-19T19:08:37.233 INFO:tasks.workunit.client.0.smithi046.stdout:0/863: chown d0 32699649 1 2024-02-19T19:08:37.236 INFO:tasks.workunit.client.0.smithi046.stdout:2/989: unlink d5/d2c/d89/d3f/d82/db6/ce5 0 2024-02-19T19:08:37.236 INFO:tasks.workunit.client.0.smithi046.stdout:2/990: creat d5/d6/d6e/dab/f14f x:0 0 0 2024-02-19T19:08:37.238 INFO:tasks.workunit.client.0.smithi046.stdout:3/509: truncate da/d1d/d10/f4c 4020603 0 2024-02-19T19:08:37.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/864: unlink d0/d24/f3b 0 2024-02-19T19:08:37.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/865: rename d0 to d0/d24/d5b/d7f/d123 22 2024-02-19T19:08:37.239 INFO:tasks.workunit.client.0.smithi046.stdout:1/748: dread d5/d13/d35/d37/d64/f6b [0,4194304] 0 2024-02-19T19:08:37.242 INFO:tasks.workunit.client.0.smithi046.stdout:2/991: rmdir d5/d7a 39 2024-02-19T19:08:37.244 INFO:tasks.workunit.client.0.smithi046.stdout:2/992: unlink d5/d2c/f3c 0 2024-02-19T19:08:37.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/749: dread d5/d21/d9a/dd0/fd1 [0,4194304] 0 2024-02-19T19:08:37.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/750: write d5/d13/d35/d37/fa9 [2276229,60285] 0 2024-02-19T19:08:37.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/751: read - d5/d13/d35/d37/db0/fdc zero size 2024-02-19T19:08:37.244 INFO:tasks.workunit.client.0.smithi046.stdout:0/866: rmdir d0/d24/d56 39 2024-02-19T19:08:37.246 INFO:tasks.workunit.client.0.smithi046.stdout:2/993: mknod d5/d2c/d89/c150 0 2024-02-19T19:08:37.247 INFO:tasks.workunit.client.0.smithi046.stdout:6/678: dwrite d4/d6/dd/d10/d29/d2d/d35/f5d [0,4194304] 0 2024-02-19T19:08:37.247 INFO:tasks.workunit.client.0.smithi046.stdout:7/807: dwrite d0/d45/f100 [0,4194304] 0 2024-02-19T19:08:37.254 INFO:tasks.workunit.client.0.smithi046.stdout:1/752: mkdir d5/d21/d9a/dd0/d80/daf/db5/dbe/dd3/d100 0 2024-02-19T19:08:37.254 INFO:tasks.workunit.client.0.smithi046.stdout:0/867: dread d0/d19/d4d/da5/f102 [0,4194304] 0 2024-02-19T19:08:37.254 INFO:tasks.workunit.client.0.smithi046.stdout:0/868: write d0/d6c/f108 [664614,80074] 0 2024-02-19T19:08:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/869: write d0/d19/d8/d37/dd9/df1/ff9 [597726,22167] 0 2024-02-19T19:08:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/870: write d0/d19/f1f [4519678,66442] 0 2024-02-19T19:08:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:2/994: truncate d5/d2c/f7d 154414 0 2024-02-19T19:08:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:2/995: truncate d5/d2c/d89/fb1 664981 0 2024-02-19T19:08:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:6/679: write d4/d6/d1c/f51 [1985533,92590] 0 2024-02-19T19:08:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:6/680: chown d4/d6/dd/d10/f86 323881148 1 2024-02-19T19:08:37.256 INFO:tasks.workunit.client.0.smithi046.stdout:6/681: dread - d4/d6/d22/f6e zero size 2024-02-19T19:08:37.261 INFO:tasks.workunit.client.0.smithi046.stdout:5/694: dwrite d2/dd/d26/f2e [0,4194304] 0 2024-02-19T19:08:37.261 INFO:tasks.workunit.client.0.smithi046.stdout:7/808: creat d0/d45/d4a/d78/d9d/f102 x:0 0 0 2024-02-19T19:08:37.265 INFO:tasks.workunit.client.0.smithi046.stdout:9/511: dwrite db/d1e/d52/f59 [4194304,4194304] 0 2024-02-19T19:08:37.266 INFO:tasks.workunit.client.0.smithi046.stdout:0/871: unlink d0/d19/c109 0 2024-02-19T19:08:37.267 INFO:tasks.workunit.client.0.smithi046.stdout:3/510: dwrite da/d30/d38/f4a [0,4194304] 0 2024-02-19T19:08:37.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/996: rename d5/d2c/d89/d3f/d5c/d9f/ld4 to d5/d2c/d89/d3f/d82/dd0/l151 0 2024-02-19T19:08:37.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/997: write d5/d2c/d56/d5a/f66 [5058296,20272] 0 2024-02-19T19:08:37.275 INFO:tasks.workunit.client.0.smithi046.stdout:8/968: write d3/dd/d13/f32 [1338946,5279] 0 2024-02-19T19:08:37.277 INFO:tasks.workunit.client.0.smithi046.stdout:5/695: mknod d2/dd/d29/d72/cd8 0 2024-02-19T19:08:37.277 INFO:tasks.workunit.client.0.smithi046.stdout:5/696: read d2/dd/f36 [1755357,80338] 0 2024-02-19T19:08:37.279 INFO:tasks.workunit.client.0.smithi046.stdout:7/809: creat d0/d45/d71/da3/dd0/f103 x:0 0 0 2024-02-19T19:08:37.279 INFO:tasks.workunit.client.0.smithi046.stdout:6/682: dwrite d4/d6/d1c/d64/fa1 [0,4194304] 0 2024-02-19T19:08:37.280 INFO:tasks.workunit.client.0.smithi046.stdout:1/753: dwrite d5/d21/d9a/dd0/d80/daf/db5/fbd [0,4194304] 0 2024-02-19T19:08:37.280 INFO:tasks.workunit.client.0.smithi046.stdout:1/754: fdatasync d5/d13/d35/f94 0 2024-02-19T19:08:37.280 INFO:tasks.workunit.client.0.smithi046.stdout:1/755: getdents d5/d2f/de7 0 2024-02-19T19:08:37.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/872: unlink d0/d24/d5b/fa9 0 2024-02-19T19:08:37.287 INFO:tasks.workunit.client.0.smithi046.stdout:3/511: link da/d1d/c19 da/c8c 0 2024-02-19T19:08:37.288 INFO:tasks.workunit.client.0.smithi046.stdout:9/512: rename db/d1e/f26 to db/d20/f9d 0 2024-02-19T19:08:37.292 INFO:tasks.workunit.client.0.smithi046.stdout:6/683: unlink d4/d6/dd/d10/d29/da2/cbe 0 2024-02-19T19:08:37.293 INFO:tasks.workunit.client.0.smithi046.stdout:0/873: dread d0/f3c [0,4194304] 0 2024-02-19T19:08:37.293 INFO:tasks.workunit.client.0.smithi046.stdout:1/756: mknod d5/d13/d35/d37/d64/dce/c101 0 2024-02-19T19:08:37.293 INFO:tasks.workunit.client.0.smithi046.stdout:1/757: stat d5/d13/d35/d37/d64/f6b 0 2024-02-19T19:08:37.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/512: mkdir da/d1d/d3f/d8d 0 2024-02-19T19:08:37.302 INFO:tasks.workunit.client.0.smithi046.stdout:7/810: rename d0/d4/d7b/fab to d0/d45/d4a/d58/d60/db4/f104 0 2024-02-19T19:08:37.303 INFO:tasks.workunit.client.0.smithi046.stdout:9/513: symlink db/d1e/d32/d47/d5b/d7f/l9e 0 2024-02-19T19:08:37.303 INFO:tasks.workunit.client.0.smithi046.stdout:9/514: fsync db/f19 0 2024-02-19T19:08:37.305 INFO:tasks.workunit.client.0.smithi046.stdout:8/969: getdents d3/d8b 0 2024-02-19T19:08:37.306 INFO:tasks.workunit.client.0.smithi046.stdout:5/697: getdents d2/dd 0 2024-02-19T19:08:37.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/758: mknod d5/d2f/d9f/d3b/d3c/c102 0 2024-02-19T19:08:37.309 INFO:tasks.workunit.client.0.smithi046.stdout:3/513: mkdir da/d1d/d8e 0 2024-02-19T19:08:37.309 INFO:tasks.workunit.client.0.smithi046.stdout:3/514: fdatasync da/d1d/d10/f2b 0 2024-02-19T19:08:37.311 INFO:tasks.workunit.client.0.smithi046.stdout:0/874: rename d0/d19/d88/d10b/fc0 to d0/d5f/da8/f124 0 2024-02-19T19:08:37.312 INFO:tasks.workunit.client.0.smithi046.stdout:9/515: rmdir db/d1e/d32/d47 39 2024-02-19T19:08:37.312 INFO:tasks.workunit.client.0.smithi046.stdout:9/516: write db/d1e/f1f [2175566,86003] 0 2024-02-19T19:08:37.312 INFO:tasks.workunit.client.0.smithi046.stdout:9/517: write db/f18 [3198910,82323] 0 2024-02-19T19:08:37.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/970: mkdir d3/d37/d64/da2/d3c/dd9/d13c/d14c 0 2024-02-19T19:08:37.315 INFO:tasks.workunit.client.0.smithi046.stdout:5/698: creat d2/dd/d26/da9/dbf/fd9 x:0 0 0 2024-02-19T19:08:37.316 INFO:tasks.workunit.client.0.smithi046.stdout:1/759: getdents d5/d21/d9a/dd0/d80/daf 0 2024-02-19T19:08:37.317 INFO:tasks.workunit.client.0.smithi046.stdout:3/515: creat da/d30/d38/f8f x:0 0 0 2024-02-19T19:08:37.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/518: rmdir db/d1e/d52 39 2024-02-19T19:08:37.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/519: read - db/d20/d6f/f80 zero size 2024-02-19T19:08:37.319 INFO:tasks.workunit.client.0.smithi046.stdout:8/971: rename d3/d37/d64/lc8 to d3/d37/d64/da2/d3c/l14d 0 2024-02-19T19:08:37.319 INFO:tasks.workunit.client.0.smithi046.stdout:8/972: fsync d3/d37/d64/da2/d3c/f87 0 2024-02-19T19:08:37.320 INFO:tasks.workunit.client.0.smithi046.stdout:0/875: dread d0/f52 [0,4194304] 0 2024-02-19T19:08:37.320 INFO:tasks.workunit.client.0.smithi046.stdout:0/876: write d0/d19/d8/d37/d40/f8f [1653990,48693] 0 2024-02-19T19:08:37.320 INFO:tasks.workunit.client.0.smithi046.stdout:5/699: creat d2/dd/d3f/fda x:0 0 0 2024-02-19T19:08:37.321 INFO:tasks.workunit.client.0.smithi046.stdout:3/516: truncate da/d30/f44 837069 0 2024-02-19T19:08:37.321 INFO:tasks.workunit.client.0.smithi046.stdout:3/517: dread - da/d1d/d10/f58 zero size 2024-02-19T19:08:37.322 INFO:tasks.workunit.client.0.smithi046.stdout:0/877: creat d0/dc6/f125 x:0 0 0 2024-02-19T19:08:37.323 INFO:tasks.workunit.client.0.smithi046.stdout:3/518: mkdir da/d1d/d82/d90 0 2024-02-19T19:08:37.324 INFO:tasks.workunit.client.0.smithi046.stdout:3/519: creat da/d1d/d8e/f91 x:0 0 0 2024-02-19T19:08:37.326 INFO:tasks.workunit.client.0.smithi046.stdout:3/520: mkdir da/d1d/d63/d92 0 2024-02-19T19:08:37.329 INFO:tasks.workunit.client.0.smithi046.stdout:8/973: dread d3/d37/d64/da2/dac/f11f [0,4194304] 0 2024-02-19T19:08:37.330 INFO:tasks.workunit.client.0.smithi046.stdout:3/521: dread da/d30/d38/f56 [0,4194304] 0 2024-02-19T19:08:37.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/974: rename d3/dd/d13/d6b/d46/d54/lbf to d3/d8b/df3/l14e 0 2024-02-19T19:08:37.335 INFO:tasks.workunit.client.0.smithi046.stdout:8/975: creat d3/dd/d13/dfe/f14f x:0 0 0 2024-02-19T19:08:37.335 INFO:tasks.workunit.client.0.smithi046.stdout:8/976: fdatasync d3/dd/d3f/d49/d5b/fbc 0 2024-02-19T19:08:37.335 INFO:tasks.workunit.client.0.smithi046.stdout:8/977: creat d3/d8b/df3/f150 x:0 0 0 2024-02-19T19:08:37.337 INFO:tasks.workunit.client.0.smithi046.stdout:0/878: dread d0/d6c/fb5 [0,4194304] 0 2024-02-19T19:08:37.337 INFO:tasks.workunit.client.0.smithi046.stdout:9/520: fdatasync db/d1e/f1f 0 2024-02-19T19:08:37.338 INFO:tasks.workunit.client.0.smithi046.stdout:0/879: write d0/d24/d8c/f94 [832822,18327] 0 2024-02-19T19:08:37.339 INFO:tasks.workunit.client.0.smithi046.stdout:8/978: unlink d3/d37/d64/da2/d3c/cec 0 2024-02-19T19:08:37.341 INFO:tasks.workunit.client.0.smithi046.stdout:9/521: rename db/cd to db/d1e/d32/d7c/c9f 0 2024-02-19T19:08:37.342 INFO:tasks.workunit.client.0.smithi046.stdout:0/880: creat d0/d5f/f126 x:0 0 0 2024-02-19T19:08:37.343 INFO:tasks.workunit.client.0.smithi046.stdout:0/881: dread - d0/d24/d5b/d7f/d9b/f11c zero size 2024-02-19T19:08:37.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/882: mknod d0/d19/c127 0 2024-02-19T19:08:37.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/883: dread - d0/d19/d8/dc5/ffb zero size 2024-02-19T19:08:37.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/884: chown d0/d6c/fb5 6 1 2024-02-19T19:08:37.347 INFO:tasks.workunit.client.0.smithi046.stdout:0/885: mkdir d0/d24/d2f/dac/d128 0 2024-02-19T19:08:37.347 INFO:tasks.workunit.client.0.smithi046.stdout:0/886: stat d0/d19/d70/c110 0 2024-02-19T19:08:37.348 INFO:tasks.workunit.client.0.smithi046.stdout:0/887: fsync d0/d24/d5b/d7f/f116 0 2024-02-19T19:08:37.354 INFO:tasks.workunit.client.0.smithi046.stdout:1/760: dwrite d5/d21/d9a/dd0/fd1 [0,4194304] 0 2024-02-19T19:08:37.355 INFO:tasks.workunit.client.0.smithi046.stdout:1/761: symlink d5/d2f/d9f/d3b/de9/l103 0 2024-02-19T19:08:37.356 INFO:tasks.workunit.client.0.smithi046.stdout:1/762: chown d5/d2f/d9f/dc9/ff8 409108 1 2024-02-19T19:08:37.356 INFO:tasks.workunit.client.0.smithi046.stdout:1/763: chown d5/d13/f31 148 1 2024-02-19T19:08:37.357 INFO:tasks.workunit.client.0.smithi046.stdout:1/764: creat d5/d13/d35/d37/d64/d75/f104 x:0 0 0 2024-02-19T19:08:37.357 INFO:tasks.workunit.client.0.smithi046.stdout:1/765: write d5/d2f/fd9 [1109713,122974] 0 2024-02-19T19:08:37.357 INFO:tasks.workunit.client.0.smithi046.stdout:1/766: chown d5/d13/d35/f41 80411 1 2024-02-19T19:08:37.357 INFO:tasks.workunit.client.0.smithi046.stdout:1/767: mknod d5/d2f/d9f/d3b/d4e/d76/c105 0 2024-02-19T19:08:37.359 INFO:tasks.workunit.client.0.smithi046.stdout:1/768: rename d5/d13/d35/f71 to d5/d13/d35/d37/d64/d75/f106 0 2024-02-19T19:08:37.360 INFO:tasks.workunit.client.0.smithi046.stdout:1/769: creat d5/d2f/d9f/d3b/d4e/d91/f107 x:0 0 0 2024-02-19T19:08:37.360 INFO:tasks.workunit.client.0.smithi046.stdout:1/770: chown d5/d2f/d9f/d3b/d3c 0 1 2024-02-19T19:08:37.480 INFO:tasks.workunit.client.0.smithi046.stdout:6/684: read d4/d6/d1c/d64/f9b [244018,71190] 0 2024-02-19T19:08:37.482 INFO:tasks.workunit.client.0.smithi046.stdout:6/685: creat d4/d6/dd/d10/d29/d2d/d35/d3c/fd8 x:0 0 0 2024-02-19T19:08:37.484 INFO:tasks.workunit.client.0.smithi046.stdout:0/888: write d0/d19/d8/d37/dd9/f93 [720987,56661] 0 2024-02-19T19:08:37.484 INFO:tasks.workunit.client.0.smithi046.stdout:6/686: symlink d4/d6/d1c/d94/ld9 0 2024-02-19T19:08:37.486 INFO:tasks.workunit.client.0.smithi046.stdout:5/700: dwrite d2/d27/f90 [0,4194304] 0 2024-02-19T19:08:37.486 INFO:tasks.workunit.client.0.smithi046.stdout:6/687: dread d4/f73 [0,4194304] 0 2024-02-19T19:08:37.486 INFO:tasks.workunit.client.0.smithi046.stdout:6/688: chown d4/d6/fe 0 1 2024-02-19T19:08:37.489 INFO:tasks.workunit.client.0.smithi046.stdout:7/811: dwrite d0/d45/d4a/d58/d60/db4/f10 [0,4194304] 0 2024-02-19T19:08:37.489 INFO:tasks.workunit.client.0.smithi046.stdout:7/812: truncate d0/d45/d71/d41/f6d 992717 0 2024-02-19T19:08:37.489 INFO:tasks.workunit.client.0.smithi046.stdout:7/813: dread - d0/d45/d4a/d58/d60/dbe/fd7 zero size 2024-02-19T19:08:37.491 INFO:tasks.workunit.client.0.smithi046.stdout:7/814: creat d0/d45/d4a/d58/d60/dbe/df9/f105 x:0 0 0 2024-02-19T19:08:37.491 INFO:tasks.workunit.client.0.smithi046.stdout:7/815: write d0/d45/d4a/fd2 [4593321,55200] 0 2024-02-19T19:08:37.494 INFO:tasks.workunit.client.0.smithi046.stdout:7/816: symlink d0/l106 0 2024-02-19T19:08:37.498 INFO:tasks.workunit.client.0.smithi046.stdout:6/689: dread d4/d6/f1a [0,4194304] 0 2024-02-19T19:08:37.498 INFO:tasks.workunit.client.0.smithi046.stdout:3/522: dwrite da/d30/d38/f8f [0,4194304] 0 2024-02-19T19:08:37.499 INFO:tasks.workunit.client.0.smithi046.stdout:9/522: dwrite db/d1e/d32/f61 [0,4194304] 0 2024-02-19T19:08:37.502 INFO:tasks.workunit.client.0.smithi046.stdout:6/690: dread d4/d6/dd/d10/d29/d2d/d35/d3c/f55 [0,4194304] 0 2024-02-19T19:08:37.502 INFO:tasks.workunit.client.0.smithi046.stdout:3/523: mkdir da/d30/d38/d93 0 2024-02-19T19:08:37.507 INFO:tasks.workunit.client.0.smithi046.stdout:9/523: mknod db/d1e/d32/d47/ca0 0 2024-02-19T19:08:37.507 INFO:tasks.workunit.client.0.smithi046.stdout:9/524: creat db/d20/d8a/d96/fa1 x:0 0 0 2024-02-19T19:08:37.507 INFO:tasks.workunit.client.0.smithi046.stdout:9/525: write db/d1e/d32/f5f [1034593,91262] 0 2024-02-19T19:08:37.507 INFO:tasks.workunit.client.0.smithi046.stdout:9/526: fdatasync db/d1e/f1f 0 2024-02-19T19:08:37.510 INFO:tasks.workunit.client.0.smithi046.stdout:6/691: dread d4/d6/f1a [0,4194304] 0 2024-02-19T19:08:37.510 INFO:tasks.workunit.client.0.smithi046.stdout:6/692: dread - d4/d6/dd/d10/f82 zero size 2024-02-19T19:08:37.512 INFO:tasks.workunit.client.0.smithi046.stdout:6/693: mknod d4/cda 0 2024-02-19T19:08:37.512 INFO:tasks.workunit.client.0.smithi046.stdout:6/694: write d4/d6/dd/f83 [1646184,63992] 0 2024-02-19T19:08:37.519 INFO:tasks.workunit.client.0.smithi046.stdout:3/524: dread da/d30/d38/d54/f5d [0,4194304] 0 2024-02-19T19:08:37.519 INFO:tasks.workunit.client.0.smithi046.stdout:3/525: write da/d1d/d10/f1b [269106,3253] 0 2024-02-19T19:08:37.521 INFO:tasks.workunit.client.0.smithi046.stdout:0/889: dwrite d0/d24/d2f/dac/fc2 [0,4194304] 0 2024-02-19T19:08:37.521 INFO:tasks.workunit.client.0.smithi046.stdout:0/890: readlink d0/d19/db/l47 0 2024-02-19T19:08:37.521 INFO:tasks.workunit.client.0.smithi046.stdout:0/891: chown d0/d24/d2f/dac/fae 0 1 2024-02-19T19:08:37.523 INFO:tasks.workunit.client.0.smithi046.stdout:3/526: symlink da/l94 0 2024-02-19T19:08:37.523 INFO:tasks.workunit.client.0.smithi046.stdout:3/527: write da/d1d/d10/f1b [605640,106026] 0 2024-02-19T19:08:37.524 INFO:tasks.workunit.client.0.smithi046.stdout:7/817: dwrite d0/d45/d71/d4b/f57 [0,4194304] 0 2024-02-19T19:08:37.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/527: dwrite f0 [4194304,4194304] 0 2024-02-19T19:08:37.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/528: write db/d20/d6f/f80 [537909,15879] 0 2024-02-19T19:08:37.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/529: stat db/d53/l84 0 2024-02-19T19:08:37.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/530: stat db/d20/d6b/d54 0 2024-02-19T19:08:37.530 INFO:tasks.workunit.client.0.smithi046.stdout:3/528: unlink da/d30/d38/f3e 0 2024-02-19T19:08:37.542 INFO:tasks.workunit.client.0.smithi046.stdout:7/818: dwrite d0/d45/d4a/d78/feb [0,4194304] 0 2024-02-19T19:08:37.545 INFO:tasks.workunit.client.0.smithi046.stdout:3/529: dread da/d1d/d10/f1b [0,4194304] 0 2024-02-19T19:08:37.547 INFO:tasks.workunit.client.0.smithi046.stdout:3/530: read da/d30/d38/d66/f69 [812313,120922] 0 2024-02-19T19:08:37.550 INFO:tasks.workunit.client.0.smithi046.stdout:7/819: write d0/d45/d71/da3/f93 [320952,63530] 0 2024-02-19T19:08:37.550 INFO:tasks.workunit.client.0.smithi046.stdout:7/820: write d0/d45/d71/d41/db8/f97 [4224907,14646] 0 2024-02-19T19:08:37.550 INFO:tasks.workunit.client.0.smithi046.stdout:7/821: write d0/d4/d24/f51 [3877903,21696] 0 2024-02-19T19:08:37.550 INFO:tasks.workunit.client.0.smithi046.stdout:7/822: chown d0/d45/d71/d4b/d8d 57486430 1 2024-02-19T19:08:37.552 INFO:tasks.workunit.client.0.smithi046.stdout:7/823: mkdir d0/d45/d4a/d58/d60/ddc/d107 0 2024-02-19T19:08:37.552 INFO:tasks.workunit.client.0.smithi046.stdout:7/824: truncate d0/d45/d4a/d58/d60/fa9 969188 0 2024-02-19T19:08:37.553 INFO:tasks.workunit.client.0.smithi046.stdout:7/825: creat d0/d45/d4a/f108 x:0 0 0 2024-02-19T19:08:37.557 INFO:tasks.workunit.client.0.smithi046.stdout:0/892: dwrite d0/d19/d4d/fb2 [0,4194304] 0 2024-02-19T19:08:37.557 INFO:tasks.workunit.client.0.smithi046.stdout:0/893: fdatasync d0/d6c/fce 0 2024-02-19T19:08:37.557 INFO:tasks.workunit.client.0.smithi046.stdout:0/894: dread - d0/d19/d70/dba/f11d zero size 2024-02-19T19:08:37.557 INFO:tasks.workunit.client.0.smithi046.stdout:0/895: chown d0/f17 4132354 1 2024-02-19T19:08:37.560 INFO:tasks.workunit.client.0.smithi046.stdout:3/531: read da/d30/d38/f7d [3756339,114494] 0 2024-02-19T19:08:37.562 INFO:tasks.workunit.client.0.smithi046.stdout:1/771: dwrite d5/d21/d9a/dd0/fd1 [4194304,4194304] 0 2024-02-19T19:08:37.562 INFO:tasks.workunit.client.0.smithi046.stdout:1/772: write d5/fe0 [881883,25466] 0 2024-02-19T19:08:37.566 INFO:tasks.workunit.client.0.smithi046.stdout:1/773: rename d5/d21/d9a/dd0/d80/daf/f9c to d5/d2f/d9f/d3b/d4e/f108 0 2024-02-19T19:08:37.569 INFO:tasks.workunit.client.0.smithi046.stdout:1/774: unlink d5/d13/d35/cd7 0 2024-02-19T19:08:37.569 INFO:tasks.workunit.client.0.smithi046.stdout:1/775: creat d5/d2f/d9f/d3b/f109 x:0 0 0 2024-02-19T19:08:37.572 INFO:tasks.workunit.client.0.smithi046.stdout:9/531: truncate db/d1e/d32/f61 1649106 0 2024-02-19T19:08:37.572 INFO:tasks.workunit.client.0.smithi046.stdout:9/532: creat db/d1e/d32/d47/d5b/d94/fa2 x:0 0 0 2024-02-19T19:08:37.572 INFO:tasks.workunit.client.0.smithi046.stdout:9/533: write db/d20/d6f/f80 [977544,113262] 0 2024-02-19T19:08:37.572 INFO:tasks.workunit.client.0.smithi046.stdout:9/534: chown db/d20/d6f 128 1 2024-02-19T19:08:37.572 INFO:tasks.workunit.client.0.smithi046.stdout:9/535: readlink db/d1e/d32/d47/l72 0 2024-02-19T19:08:37.581 INFO:tasks.workunit.client.0.smithi046.stdout:1/776: dread d5/f27 [0,4194304] 0 2024-02-19T19:08:37.583 INFO:tasks.workunit.client.0.smithi046.stdout:1/777: mknod d5/d2f/d9f/dc4/c10a 0 2024-02-19T19:08:37.585 INFO:tasks.workunit.client.0.smithi046.stdout:1/778: rename d5/d13/d35/d37/d64/d75/f104 to d5/d2f/d9f/d3b/f10b 0 2024-02-19T19:08:37.585 INFO:tasks.workunit.client.0.smithi046.stdout:1/779: fsync d5/d13/d35/d37/d64/d75/fbc 0 2024-02-19T19:08:37.585 INFO:tasks.workunit.client.0.smithi046.stdout:1/780: write d5/d2f/d9f/d3b/d3c/d3f/fd6 [359770,87080] 0 2024-02-19T19:08:37.587 INFO:tasks.workunit.client.0.smithi046.stdout:1/781: dread d5/d13/d35/d37/d64/f6b [0,4194304] 0 2024-02-19T19:08:37.587 INFO:tasks.workunit.client.0.smithi046.stdout:1/782: getdents d5/d2f/d9f/d3b/de9 0 2024-02-19T19:08:37.587 INFO:tasks.workunit.client.0.smithi046.stdout:1/783: chown d5/d2f/d9f/d55/c56 3813681 1 2024-02-19T19:08:37.589 INFO:tasks.workunit.client.0.smithi046.stdout:1/784: unlink d5/d2f/d9f/d3b/d3c/c5a 0 2024-02-19T19:08:37.590 INFO:tasks.workunit.client.0.smithi046.stdout:1/785: mkdir d5/d2f/d10c 0 2024-02-19T19:08:37.591 INFO:tasks.workunit.client.0.smithi046.stdout:7/826: dwrite d0/d45/f100 [0,4194304] 0 2024-02-19T19:08:37.591 INFO:tasks.workunit.client.0.smithi046.stdout:7/827: dread - d0/d45/d98/fce zero size 2024-02-19T19:08:37.595 INFO:tasks.workunit.client.0.smithi046.stdout:7/828: getdents d0/d45/d4a/d58/dc6/d83 0 2024-02-19T19:08:37.597 INFO:tasks.workunit.client.0.smithi046.stdout:3/532: dwrite da/d30/f57 [4194304,4194304] 0 2024-02-19T19:08:37.597 INFO:tasks.workunit.client.0.smithi046.stdout:3/533: dread - da/d1d/f68 zero size 2024-02-19T19:08:37.599 INFO:tasks.workunit.client.0.smithi046.stdout:3/534: mknod da/d1d/c95 0 2024-02-19T19:08:37.599 INFO:tasks.workunit.client.0.smithi046.stdout:0/896: dwrite d0/d19/f1a [0,4194304] 0 2024-02-19T19:08:37.600 INFO:tasks.workunit.client.0.smithi046.stdout:3/535: creat da/d1d/f96 x:0 0 0 2024-02-19T19:08:37.600 INFO:tasks.workunit.client.0.smithi046.stdout:3/536: fdatasync da/d1d/d3f/f55 0 2024-02-19T19:08:37.601 INFO:tasks.workunit.client.0.smithi046.stdout:3/537: creat da/d1d/d8e/f97 x:0 0 0 2024-02-19T19:08:37.601 INFO:tasks.workunit.client.0.smithi046.stdout:3/538: write da/d1d/d8e/f97 [960148,106314] 0 2024-02-19T19:08:37.602 INFO:tasks.workunit.client.0.smithi046.stdout:9/536: dwrite db/d20/d6b/d54/f74 [0,4194304] 0 2024-02-19T19:08:37.603 INFO:tasks.workunit.client.0.smithi046.stdout:0/897: truncate d0/f1b 3455 0 2024-02-19T19:08:37.607 INFO:tasks.workunit.client.0.smithi046.stdout:9/537: rename db/f18 to db/d1e/d32/d47/d5b/d7f/fa3 0 2024-02-19T19:08:37.608 INFO:tasks.workunit.client.0.smithi046.stdout:0/898: symlink d0/d19/d4d/da5/da7/l129 0 2024-02-19T19:08:37.608 INFO:tasks.workunit.client.0.smithi046.stdout:0/899: fdatasync d0/d19/d4d/ff2 0 2024-02-19T19:08:37.609 INFO:tasks.workunit.client.0.smithi046.stdout:7/829: dread d0/d45/d4a/d58/f42 [0,4194304] 0 2024-02-19T19:08:37.610 INFO:tasks.workunit.client.0.smithi046.stdout:0/900: mknod d0/d19/d8/d92/d118/c12a 0 2024-02-19T19:08:37.614 INFO:tasks.workunit.client.0.smithi046.stdout:7/830: link d0/d45/d4a/d58/d60/db4/l27 d0/d45/l109 0 2024-02-19T19:08:37.614 INFO:tasks.workunit.client.0.smithi046.stdout:7/831: creat d0/d45/d98/f10a x:0 0 0 2024-02-19T19:08:37.616 INFO:tasks.workunit.client.0.smithi046.stdout:0/901: truncate d0/d24/d2f/dac/fc2 2130491 0 2024-02-19T19:08:37.620 INFO:tasks.workunit.client.0.smithi046.stdout:0/902: mknod d0/d19/d8/d37/d40/da6/c12b 0 2024-02-19T19:08:37.624 INFO:tasks.workunit.client.0.smithi046.stdout:1/786: dwrite d5/d2f/d9f/d3b/f5c [0,4194304] 0 2024-02-19T19:08:37.624 INFO:tasks.workunit.client.0.smithi046.stdout:3/539: dwrite da/d30/d38/f3d [0,4194304] 0 2024-02-19T19:08:37.625 INFO:tasks.workunit.client.0.smithi046.stdout:0/903: creat d0/d24/d5b/d7f/f12c x:0 0 0 2024-02-19T19:08:37.625 INFO:tasks.workunit.client.0.smithi046.stdout:9/538: write f0 [2373455,17085] 0 2024-02-19T19:08:37.625 INFO:tasks.workunit.client.0.smithi046.stdout:9/539: write db/d20/d6f/f86 [516754,116416] 0 2024-02-19T19:08:37.625 INFO:tasks.workunit.client.0.smithi046.stdout:9/540: readlink db/l14 0 2024-02-19T19:08:37.630 INFO:tasks.workunit.client.0.smithi046.stdout:1/787: read - d5/d2f/d9f/d3b/d3c/d3f/ff1 zero size 2024-02-19T19:08:37.633 INFO:tasks.workunit.client.0.smithi046.stdout:3/540: creat da/d1d/d63/d92/f98 x:0 0 0 2024-02-19T19:08:37.635 INFO:tasks.workunit.client.0.smithi046.stdout:9/541: link db/d1e/l2b db/d1e/d32/d47/d5b/d7f/la4 0 2024-02-19T19:08:37.635 INFO:tasks.workunit.client.0.smithi046.stdout:9/542: creat db/d20/d6b/d54/fa5 x:0 0 0 2024-02-19T19:08:37.639 INFO:tasks.workunit.client.0.smithi046.stdout:9/543: unlink db/c12 0 2024-02-19T19:08:37.641 INFO:tasks.workunit.client.0.smithi046.stdout:3/541: write da/d30/d38/f3d [1797119,124882] 0 2024-02-19T19:08:37.642 INFO:tasks.workunit.client.0.smithi046.stdout:9/544: mkdir db/d1e/d32/d47/d5b/d7f/da6 0 2024-02-19T19:08:37.645 INFO:tasks.workunit.client.0.smithi046.stdout:3/542: dread da/f20 [0,4194304] 0 2024-02-19T19:08:37.645 INFO:tasks.workunit.client.0.smithi046.stdout:3/543: readlink da/d30/d38/l49 0 2024-02-19T19:08:37.648 INFO:tasks.workunit.client.0.smithi046.stdout:7/832: dwrite d0/d45/d4a/d58/d60/dbe/df9/f6b [0,4194304] 0 2024-02-19T19:08:37.649 INFO:tasks.workunit.client.0.smithi046.stdout:7/833: rmdir d0/d45/d4a/d58 39 2024-02-19T19:08:37.651 INFO:tasks.workunit.client.0.smithi046.stdout:7/834: write d0/d45/d56/f9f [20943,6271] 0 2024-02-19T19:08:37.651 INFO:tasks.workunit.client.0.smithi046.stdout:7/835: write d0/d45/d98/ff5 [330577,124885] 0 2024-02-19T19:08:37.671 INFO:tasks.workunit.client.0.smithi046.stdout:1/788: dwrite d5/d13/d35/d37/f7f [0,4194304] 0 2024-02-19T19:08:37.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/544: dwrite da/d30/f57 [8388608,4194304] 0 2024-02-19T19:08:37.691 INFO:tasks.workunit.client.0.smithi046.stdout:9/545: dwrite f0 [0,4194304] 0 2024-02-19T19:08:37.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/789: dwrite d5/d21/d9a/fff [0,4194304] 0 2024-02-19T19:08:37.694 INFO:tasks.workunit.client.0.smithi046.stdout:9/546: mknod db/d1e/d32/d47/d5b/d7f/da6/ca7 0 2024-02-19T19:08:37.697 INFO:tasks.workunit.client.0.smithi046.stdout:1/790: rmdir d5/d2f/d9f/d55 39 2024-02-19T19:08:37.700 INFO:tasks.workunit.client.0.smithi046.stdout:9/547: rmdir db/d20/d6b/d54 39 2024-02-19T19:08:37.700 INFO:tasks.workunit.client.0.smithi046.stdout:9/548: dread - db/d1e/f88 zero size 2024-02-19T19:08:37.712 INFO:tasks.workunit.client.0.smithi046.stdout:9/549: dread db/d20/d4e/f6a [0,4194304] 0 2024-02-19T19:08:37.722 INFO:tasks.workunit.client.0.smithi046.stdout:9/550: truncate db/d1e/d52/f59 6149424 0 2024-02-19T19:08:37.724 INFO:tasks.workunit.client.0.smithi046.stdout:9/551: link db/d1e/c37 db/d1e/d32/d47/d5b/d7f/da6/ca8 0 2024-02-19T19:08:37.726 INFO:tasks.workunit.client.0.smithi046.stdout:9/552: creat db/d20/d71/fa9 x:0 0 0 2024-02-19T19:08:37.726 INFO:tasks.workunit.client.0.smithi046.stdout:9/553: fdatasync db/d1e/d32/f5d 0 2024-02-19T19:08:37.746 INFO:tasks.workunit.client.0.smithi046.stdout:9/554: dwrite f0 [4194304,4194304] 0 2024-02-19T19:08:37.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/555: dwrite db/d1e/f27 [0,4194304] 0 2024-02-19T19:08:37.786 INFO:tasks.workunit.client.0.smithi046.stdout:9/556: dwrite db/d1e/f49 [0,4194304] 0 2024-02-19T19:08:37.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/557: creat db/d53/faa x:0 0 0 2024-02-19T19:08:37.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/558: chown db/d1e 6839 1 2024-02-19T19:08:37.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/559: fdatasync db/d53/f65 0 2024-02-19T19:08:37.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/560: stat db/l16 0 2024-02-19T19:08:37.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/561: read - db/d20/d6b/d54/f97 zero size 2024-02-19T19:08:37.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/562: rmdir db/d20/d71 39 2024-02-19T19:08:37.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/563: fsync db/d1e/f22 0 2024-02-19T19:08:37.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/564: chown db/d20/d4e/f6a 397980 1 2024-02-19T19:08:37.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/565: dread - db/d1e/d32/d47/d5b/d94/f9c zero size 2024-02-19T19:08:37.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/566: chown db/d1e/f4c 0 1 2024-02-19T19:08:37.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/567: fsync f0 0 2024-02-19T19:08:37.789 INFO:tasks.workunit.client.0.smithi046.stdout:9/568: rename db/d20/f9d to db/d20/d6b/d54/fab 0 2024-02-19T19:08:37.790 INFO:tasks.workunit.client.0.smithi046.stdout:9/569: mkdir db/d20/dac 0 2024-02-19T19:08:37.791 INFO:tasks.workunit.client.0.smithi046.stdout:9/570: mknod db/d20/d4e/cad 0 2024-02-19T19:08:37.792 INFO:tasks.workunit.client.0.smithi046.stdout:9/571: creat db/d1e/d99/fae x:0 0 0 2024-02-19T19:08:37.792 INFO:tasks.workunit.client.0.smithi046.stdout:9/572: creat db/d20/dac/faf x:0 0 0 2024-02-19T19:08:37.830 INFO:tasks.workunit.client.0.smithi046.stdout:9/573: dwrite db/d1e/f1f [0,4194304] 0 2024-02-19T19:08:37.830 INFO:tasks.workunit.client.0.smithi046.stdout:9/574: write db/f43 [789994,109372] 0 2024-02-19T19:08:39.037 INFO:tasks.workunit.client.0.smithi046.stdout:4/821: sync 2024-02-19T19:08:39.047 INFO:tasks.workunit.client.0.smithi046.stdout:4/822: dread d6/d15/fba [0,4194304] 0 2024-02-19T19:08:39.048 INFO:tasks.workunit.client.0.smithi046.stdout:4/823: rmdir d6/d50 39 2024-02-19T19:08:39.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/824: truncate d6/d11/dd6/d89/d8a/d8d/fb5 28970 0 2024-02-19T19:08:39.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/825: creat d6/dd3/db3/f118 x:0 0 0 2024-02-19T19:08:39.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/826: dread - d6/dd3/db3/f118 zero size 2024-02-19T19:08:39.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/827: creat d6/d11/dd6/d89/d8a/f119 x:0 0 0 2024-02-19T19:08:39.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:38 smithi046 ceph-mon[88928]: pgmap v128: 65 pgs: 7 peering, 1 active+undersized, 21 active+undersized+degraded, 36 active+clean; 1.7 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 147 MiB/s rd, 173 MiB/s wr, 361 op/s; 5420/43164 objects degraded (12.557%) 2024-02-19T19:08:39.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:38 smithi046 ceph-mon[88928]: osdmap e80: 6 total, 6 up, 6 in 2024-02-19T19:08:39.114 INFO:tasks.workunit.client.0.smithi046.stdout:4/828: dwrite d6/d11/d40/fad [0,4194304] 0 2024-02-19T19:08:39.117 INFO:tasks.workunit.client.0.smithi046.stdout:4/829: link d6/d11/f66 d6/dd3/db3/f11a 0 2024-02-19T19:08:39.120 INFO:tasks.workunit.client.0.smithi046.stdout:4/830: rmdir d6/d11/dd6/d89 39 2024-02-19T19:08:39.136 INFO:tasks.workunit.client.0.smithi046.stdout:4/831: dwrite d6/d11/dd6/f28 [0,4194304] 0 2024-02-19T19:08:39.136 INFO:tasks.workunit.client.0.smithi046.stdout:4/832: read d6/d11/d92/f9c [2225856,30564] 0 2024-02-19T19:08:39.139 INFO:tasks.workunit.client.0.smithi046.stdout:4/833: creat d6/d11/d92/d102/d10a/f11b x:0 0 0 2024-02-19T19:08:39.139 INFO:tasks.workunit.client.0.smithi046.stdout:4/834: creat d6/d94/dab/f11c x:0 0 0 2024-02-19T19:08:39.140 INFO:tasks.workunit.client.0.smithi046.stdout:4/835: symlink d6/d11/dd6/d89/d8a/d8d/l11d 0 2024-02-19T19:08:39.141 INFO:tasks.workunit.client.0.smithi046.stdout:4/836: rename d6/d11/dd6/d89/d8a/d55/cdf to d6/d11/db9/c11e 0 2024-02-19T19:08:39.162 INFO:tasks.workunit.client.0.smithi046.stdout:4/837: dwrite d6/d11/dd6/d89/d8a/d8d/fb5 [0,4194304] 0 2024-02-19T19:08:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:4/838: mkdir d6/d11/d40/da7/d11f 0 2024-02-19T19:08:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:4/839: dread - d6/d11/d40/da7/f105 zero size 2024-02-19T19:08:39.171 INFO:tasks.workunit.client.0.smithi046.stdout:4/840: dread d6/d11/d92/d102/f85 [0,4194304] 0 2024-02-19T19:08:39.180 INFO:tasks.workunit.client.0.smithi046.stdout:4/841: dread d6/d11/dd6/d89/faa [0,4194304] 0 2024-02-19T19:08:39.181 INFO:tasks.workunit.client.0.smithi046.stdout:4/842: mknod d6/d11/d92/d102/db1/c120 0 2024-02-19T19:08:39.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/843: dread d6/d15/fba [0,4194304] 0 2024-02-19T19:08:39.187 INFO:tasks.workunit.client.0.smithi046.stdout:4/844: write d6/d11/dd6/d89/d8a/d55/d8e/fda [789520,105846] 0 2024-02-19T19:08:39.187 INFO:tasks.workunit.client.0.smithi046.stdout:4/845: write d6/d11/dd6/d89/d8a/d55/d8e/fda [1769217,120489] 0 2024-02-19T19:08:39.188 INFO:tasks.workunit.client.0.smithi046.stdout:4/846: mkdir d6/d11/d40/da7/dd2/d10d/d121 0 2024-02-19T19:08:39.189 INFO:tasks.workunit.client.0.smithi046.stdout:4/847: mknod d6/d11/d92/d102/c122 0 2024-02-19T19:08:39.189 INFO:tasks.workunit.client.0.smithi046.stdout:4/848: truncate d6/d11/dd6/d89/d8a/d55/f5d 5798483 0 2024-02-19T19:08:39.189 INFO:tasks.workunit.client.0.smithi046.stdout:4/849: write d6/d11/db9/f10e [712603,120493] 0 2024-02-19T19:08:39.189 INFO:tasks.workunit.client.0.smithi046.stdout:4/850: write d6/d11/dd6/d89/d8a/d55/f5d [1343295,16327] 0 2024-02-19T19:08:39.201 INFO:tasks.workunit.client.0.smithi046.stdout:2/998: sync 2024-02-19T19:08:39.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:38 smithi142 ceph-mon[69118]: pgmap v128: 65 pgs: 7 peering, 1 active+undersized, 21 active+undersized+degraded, 36 active+clean; 1.7 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 147 MiB/s rd, 173 MiB/s wr, 361 op/s; 5420/43164 objects degraded (12.557%) 2024-02-19T19:08:39.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:38 smithi142 ceph-mon[69118]: osdmap e80: 6 total, 6 up, 6 in 2024-02-19T19:08:39.203 INFO:tasks.workunit.client.0.smithi046.stdout:2/999: creat d5/d2c/d89/d3f/d82/df4/d127/d14d/f152 x:0 0 0 2024-02-19T19:08:39.267 INFO:tasks.workunit.client.0.smithi046.stdout:8/979: sync 2024-02-19T19:08:39.267 INFO:tasks.workunit.client.0.smithi046.stdout:5/701: sync 2024-02-19T19:08:39.268 INFO:tasks.workunit.client.0.smithi046.stdout:8/980: truncate d3/f7 1682029 0 2024-02-19T19:08:39.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/702: dread d2/dd/d26/d65/fa5 [0,4194304] 0 2024-02-19T19:08:39.279 INFO:tasks.workunit.client.0.smithi046.stdout:5/703: creat d2/d27/fdb x:0 0 0 2024-02-19T19:08:39.431 INFO:tasks.workunit.client.0.smithi046.stdout:6/695: sync 2024-02-19T19:08:39.431 INFO:tasks.workunit.client.0.smithi046.stdout:6/696: write d4/d6/dd/d10/d29/d2d/d35/d3c/f72 [166279,56894] 0 2024-02-19T19:08:39.432 INFO:tasks.workunit.client.0.smithi046.stdout:6/697: creat d4/d6/d1c/d20/fdb x:0 0 0 2024-02-19T19:08:39.433 INFO:tasks.workunit.client.0.smithi046.stdout:6/698: symlink d4/d6/d1c/d94/ldc 0 2024-02-19T19:08:39.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/699: rename d4/d6/dd/d10/c31 to d4/d6/cdd 0 2024-02-19T19:08:39.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/700: write d4/d6/dd/d10/d29/d2d/d35/da5/fc7 [464269,62391] 0 2024-02-19T19:08:39.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/701: write d4/d6/dd/d10/f13 [1653654,58948] 0 2024-02-19T19:08:39.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/702: truncate d4/d6/dd/d10/d29/d2d/d35/fb3 50304 0 2024-02-19T19:08:39.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/703: creat d4/d6/dd/d10/d29/d2d/d35/da5/fde x:0 0 0 2024-02-19T19:08:39.459 INFO:tasks.workunit.client.0.smithi046.stdout:6/704: dwrite d4/d6/dd/d10/f13 [4194304,4194304] 0 2024-02-19T19:08:39.473 INFO:tasks.workunit.client.0.smithi046.stdout:7/836: sync 2024-02-19T19:08:39.473 INFO:tasks.workunit.client.0.smithi046.stdout:0/904: sync 2024-02-19T19:08:39.473 INFO:tasks.workunit.client.0.smithi046.stdout:0/905: write d0/f2 [1048265,75639] 0 2024-02-19T19:08:39.474 INFO:tasks.workunit.client.0.smithi046.stdout:7/837: getdents d0/d45/d71/da3 0 2024-02-19T19:08:39.479 INFO:tasks.workunit.client.0.smithi046.stdout:0/906: dread d0/d19/d8/d37/f5d [0,4194304] 0 2024-02-19T19:08:39.479 INFO:tasks.workunit.client.0.smithi046.stdout:6/705: dwrite d4/d6/dd/d10/d29/d2d/d35/f3a [4194304,4194304] 0 2024-02-19T19:08:39.481 INFO:tasks.workunit.client.0.smithi046.stdout:0/907: unlink d0/d24/d5b/d7f/d9b/cbd 0 2024-02-19T19:08:39.484 INFO:tasks.workunit.client.0.smithi046.stdout:6/706: creat d4/d6/dd/d10/d29/d2d/d35/d66/fdf x:0 0 0 2024-02-19T19:08:39.484 INFO:tasks.workunit.client.0.smithi046.stdout:6/707: readlink d4/d6/d22/l9d 0 2024-02-19T19:08:39.484 INFO:tasks.workunit.client.0.smithi046.stdout:6/708: chown d4/d6/d22/f7d 2435 1 2024-02-19T19:08:39.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/908: creat d0/d24/d5b/d7f/dfc/d114/f12d x:0 0 0 2024-02-19T19:08:39.487 INFO:tasks.workunit.client.0.smithi046.stdout:9/575: sync 2024-02-19T19:08:39.488 INFO:tasks.workunit.client.0.smithi046.stdout:5/704: sync 2024-02-19T19:08:39.488 INFO:tasks.workunit.client.0.smithi046.stdout:4/851: sync 2024-02-19T19:08:39.488 INFO:tasks.workunit.client.0.smithi046.stdout:8/981: sync 2024-02-19T19:08:39.488 INFO:tasks.workunit.client.0.smithi046.stdout:1/791: sync 2024-02-19T19:08:39.488 INFO:tasks.workunit.client.0.smithi046.stdout:1/792: dread - d5/d13/d35/d37/fe3 zero size 2024-02-19T19:08:39.488 INFO:tasks.workunit.client.0.smithi046.stdout:3/545: sync 2024-02-19T19:08:39.492 INFO:tasks.workunit.client.0.smithi046.stdout:6/709: dread d4/d6/dd/f56 [0,4194304] 0 2024-02-19T19:08:39.492 INFO:tasks.workunit.client.0.smithi046.stdout:5/705: mkdir d2/dd/d26/da9/dbf/dd7/ddc 0 2024-02-19T19:08:39.492 INFO:tasks.workunit.client.0.smithi046.stdout:8/982: mknod d3/d18/c151 0 2024-02-19T19:08:39.493 INFO:tasks.workunit.client.0.smithi046.stdout:9/576: mknod db/d20/d8a/d96/cb0 0 2024-02-19T19:08:39.494 INFO:tasks.workunit.client.0.smithi046.stdout:6/710: dread d4/d6/d1c/d60/f85 [0,4194304] 0 2024-02-19T19:08:39.494 INFO:tasks.workunit.client.0.smithi046.stdout:6/711: chown d4/d6/dd/d10/d29/d2d/d35/c41 55841178 1 2024-02-19T19:08:39.494 INFO:tasks.workunit.client.0.smithi046.stdout:4/852: dread d6/d11/dd6/d89/d8a/d55/d8e/fda [0,4194304] 0 2024-02-19T19:08:39.494 INFO:tasks.workunit.client.0.smithi046.stdout:4/853: creat d6/dd3/db3/f123 x:0 0 0 2024-02-19T19:08:39.494 INFO:tasks.workunit.client.0.smithi046.stdout:9/577: mknod db/d1e/d32/d47/d5b/d7f/cb1 0 2024-02-19T19:08:39.495 INFO:tasks.workunit.client.0.smithi046.stdout:8/983: unlink d3/dd/d13/c2f 0 2024-02-19T19:08:39.495 INFO:tasks.workunit.client.0.smithi046.stdout:8/984: readlink d3/dd/d13/d6b/ddc/l102 0 2024-02-19T19:08:39.495 INFO:tasks.workunit.client.0.smithi046.stdout:8/985: chown d3/dd/d13/d6b/c22 75232790 1 2024-02-19T19:08:39.496 INFO:tasks.workunit.client.0.smithi046.stdout:9/578: stat db/d20/d8a/l8f 0 2024-02-19T19:08:39.497 INFO:tasks.workunit.client.0.smithi046.stdout:4/854: link d6/d11/dd6/d89/d8a/deb/f112 d6/d15/d17/f124 0 2024-02-19T19:08:39.499 INFO:tasks.workunit.client.0.smithi046.stdout:9/579: creat db/d1e/d32/d7c/fb2 x:0 0 0 2024-02-19T19:08:39.499 INFO:tasks.workunit.client.0.smithi046.stdout:3/546: dread da/d1d/f60 [0,4194304] 0 2024-02-19T19:08:39.499 INFO:tasks.workunit.client.0.smithi046.stdout:3/547: write da/d1d/d10/f2b [421001,76930] 0 2024-02-19T19:08:39.502 INFO:tasks.workunit.client.0.smithi046.stdout:9/580: rename db/d1e/d32/f5d to db/d20/fb3 0 2024-02-19T19:08:39.504 INFO:tasks.workunit.client.0.smithi046.stdout:3/548: rmdir da/d1d/d63/d64/d74/d83 0 2024-02-19T19:08:39.507 INFO:tasks.workunit.client.0.smithi046.stdout:3/549: creat da/d30/f99 x:0 0 0 2024-02-19T19:08:39.510 INFO:tasks.workunit.client.0.smithi046.stdout:3/550: mknod da/d8a/c9a 0 2024-02-19T19:08:39.510 INFO:tasks.workunit.client.0.smithi046.stdout:3/551: fsync da/d30/f57 0 2024-02-19T19:08:39.510 INFO:tasks.workunit.client.0.smithi046.stdout:3/552: write da/d30/f44 [1840514,102035] 0 2024-02-19T19:08:39.510 INFO:tasks.workunit.client.0.smithi046.stdout:9/581: write db/d1e/f4c [219095,76074] 0 2024-02-19T19:08:39.511 INFO:tasks.workunit.client.0.smithi046.stdout:0/909: dwrite d0/f18 [0,4194304] 0 2024-02-19T19:08:39.512 INFO:tasks.workunit.client.0.smithi046.stdout:0/910: fdatasync d0/d24/f39 0 2024-02-19T19:08:39.512 INFO:tasks.workunit.client.0.smithi046.stdout:0/911: creat d0/d5f/f12e x:0 0 0 2024-02-19T19:08:39.512 INFO:tasks.workunit.client.0.smithi046.stdout:0/912: chown d0/d19/d8/d37/f7d 1178 1 2024-02-19T19:08:39.512 INFO:tasks.workunit.client.0.smithi046.stdout:3/553: link da/d1d/l33 da/d30/d38/d66/l9b 0 2024-02-19T19:08:39.516 INFO:tasks.workunit.client.0.smithi046.stdout:0/913: mknod d0/d19/db/de7/df6/df8/c12f 0 2024-02-19T19:08:39.517 INFO:tasks.workunit.client.0.smithi046.stdout:1/793: dwrite d5/d2f/d9f/f2e [4194304,4194304] 0 2024-02-19T19:08:39.518 INFO:tasks.workunit.client.0.smithi046.stdout:0/914: creat d0/d19/d4d/f130 x:0 0 0 2024-02-19T19:08:39.521 INFO:tasks.workunit.client.0.smithi046.stdout:1/794: symlink d5/d13/d35/d37/db0/l10d 0 2024-02-19T19:08:39.521 INFO:tasks.workunit.client.0.smithi046.stdout:1/795: chown d5/d21/d9a/dd0/d80/daf/db5/dbe/dd3/d100 21073 1 2024-02-19T19:08:39.522 INFO:tasks.workunit.client.0.smithi046.stdout:3/554: getdents da/d1d/d8e 0 2024-02-19T19:08:39.522 INFO:tasks.workunit.client.0.smithi046.stdout:3/555: chown da/d1d/d3f/c4f 90189 1 2024-02-19T19:08:39.523 INFO:tasks.workunit.client.0.smithi046.stdout:1/796: mkdir d5/d2f/de7/d10e 0 2024-02-19T19:08:39.523 INFO:tasks.workunit.client.0.smithi046.stdout:1/797: truncate d5/d13/d35/d37/d64/d87/fcd 5225805 0 2024-02-19T19:08:39.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/556: truncate da/d1d/d10/f1e 136326 0 2024-02-19T19:08:39.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/557: chown da/d1d/d63/d64/f7b 91117082 1 2024-02-19T19:08:39.524 INFO:tasks.workunit.client.0.smithi046.stdout:1/798: mkdir d5/d21/d9a/dd0/d80/daf/db5/d10f 0 2024-02-19T19:08:39.527 INFO:tasks.workunit.client.0.smithi046.stdout:3/558: unlink da/d1d/d10/l78 0 2024-02-19T19:08:39.527 INFO:tasks.workunit.client.0.smithi046.stdout:3/559: creat da/d1d/d10/f9c x:0 0 0 2024-02-19T19:08:39.530 INFO:tasks.workunit.client.0.smithi046.stdout:3/560: unlink da/d1d/l5f 0 2024-02-19T19:08:39.530 INFO:tasks.workunit.client.0.smithi046.stdout:3/561: read da/d30/d38/d66/f69 [877432,29737] 0 2024-02-19T19:08:39.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/986: dwrite d3/d18/f20 [4194304,4194304] 0 2024-02-19T19:08:39.533 INFO:tasks.workunit.client.0.smithi046.stdout:5/706: dwrite d2/fb [0,4194304] 0 2024-02-19T19:08:39.533 INFO:tasks.workunit.client.0.smithi046.stdout:9/582: dwrite db/d1e/d32/d47/d5b/f91 [0,4194304] 0 2024-02-19T19:08:39.533 INFO:tasks.workunit.client.0.smithi046.stdout:9/583: truncate db/d20/f39 1497544 0 2024-02-19T19:08:39.535 INFO:tasks.workunit.client.0.smithi046.stdout:8/987: link d3/d37/d64/da2/d3c/c73 d3/d37/d64/da2/c152 0 2024-02-19T19:08:39.545 INFO:tasks.workunit.client.0.smithi046.stdout:5/707: write d2/dd/d2f/d34/f3e [3187404,19866] 0 2024-02-19T19:08:39.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/988: dread d3/d9d/fc3 [0,4194304] 0 2024-02-19T19:08:39.549 INFO:tasks.workunit.client.0.smithi046.stdout:3/562: dwrite da/d30/f44 [0,4194304] 0 2024-02-19T19:08:39.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/708: truncate d2/fb 1806479 0 2024-02-19T19:08:39.558 INFO:tasks.workunit.client.0.smithi046.stdout:5/709: symlink d2/d27/d47/d54/ldd 0 2024-02-19T19:08:39.558 INFO:tasks.workunit.client.0.smithi046.stdout:3/563: dread da/d30/d38/f7d [0,4194304] 0 2024-02-19T19:08:39.560 INFO:tasks.workunit.client.0.smithi046.stdout:3/564: rename da/c62 to da/c9d 0 2024-02-19T19:08:39.560 INFO:tasks.workunit.client.0.smithi046.stdout:3/565: stat da/d1d/d10/f2b 0 2024-02-19T19:08:39.563 INFO:tasks.workunit.client.0.smithi046.stdout:8/989: write d3/dd/d13/d42/f57 [2890186,126521] 0 2024-02-19T19:08:39.563 INFO:tasks.workunit.client.0.smithi046.stdout:8/990: stat d3/d8b/d113/df8 0 2024-02-19T19:08:39.564 INFO:tasks.workunit.client.0.smithi046.stdout:8/991: symlink d3/d18/l153 0 2024-02-19T19:08:39.573 INFO:tasks.workunit.client.0.smithi046.stdout:3/566: dwrite da/d30/d38/d66/f67 [0,4194304] 0 2024-02-19T19:08:39.576 INFO:tasks.workunit.client.0.smithi046.stdout:3/567: rename da/d1d/c3c to da/d30/d38/c9e 0 2024-02-19T19:08:39.580 INFO:tasks.workunit.client.0.smithi046.stdout:8/992: dwrite d3/d37/dca/f144 [0,4194304] 0 2024-02-19T19:08:39.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/993: dwrite d3/dd/d13/d6b/d46/d54/d8a/f10f [0,4194304] 0 2024-02-19T19:08:39.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/994: stat d3/d37/d64/da2/d135 0 2024-02-19T19:08:39.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/995: write d3/dd/d13/dfe/f14f [900969,50245] 0 2024-02-19T19:08:39.600 INFO:tasks.workunit.client.0.smithi046.stdout:3/568: dwrite da/f2c [0,4194304] 0 2024-02-19T19:08:39.600 INFO:tasks.workunit.client.0.smithi046.stdout:8/996: getdents d3/dd/d3f/d49/d5b/d5f/da0 0 2024-02-19T19:08:39.601 INFO:tasks.workunit.client.0.smithi046.stdout:8/997: truncate d3/dd/d13/f1b 2521596 0 2024-02-19T19:08:39.602 INFO:tasks.workunit.client.0.smithi046.stdout:8/998: unlink d3/d37/d64/da2/c152 0 2024-02-19T19:08:39.602 INFO:tasks.workunit.client.0.smithi046.stdout:8/999: chown d3/d8b/d124/f141 54663158 1 2024-02-19T19:08:39.612 INFO:tasks.workunit.client.0.smithi046.stdout:3/569: dwrite da/d1d/d63/d64/f7b [4194304,4194304] 0 2024-02-19T19:08:39.613 INFO:tasks.workunit.client.0.smithi046.stdout:3/570: getdents da/d1d/d63 0 2024-02-19T19:08:39.615 INFO:tasks.workunit.client.0.smithi046.stdout:3/571: mkdir da/d8a/d9f 0 2024-02-19T19:08:39.615 INFO:tasks.workunit.client.0.smithi046.stdout:3/572: fsync da/d30/d38/d66/f69 0 2024-02-19T19:08:39.615 INFO:tasks.workunit.client.0.smithi046.stdout:3/573: fsync da/d1d/f60 0 2024-02-19T19:08:39.623 INFO:tasks.workunit.client.0.smithi046.stdout:3/574: write da/d1d/d63/d64/f7b [278016,52715] 0 2024-02-19T19:08:39.628 INFO:tasks.workunit.client.0.smithi046.stdout:3/575: creat da/d30/d38/d93/fa0 x:0 0 0 2024-02-19T19:08:39.642 INFO:tasks.workunit.client.0.smithi046.stdout:3/576: dwrite da/d30/d38/f56 [0,4194304] 0 2024-02-19T19:08:39.644 INFO:tasks.workunit.client.0.smithi046.stdout:3/577: mknod da/d1d/d8e/ca1 0 2024-02-19T19:08:39.644 INFO:tasks.workunit.client.0.smithi046.stdout:3/578: getdents da/d1d/d63 0 2024-02-19T19:08:39.645 INFO:tasks.workunit.client.0.smithi046.stdout:3/579: link da/d1d/d3f/f76 da/d30/d38/d54/fa2 0 2024-02-19T19:08:39.646 INFO:tasks.workunit.client.0.smithi046.stdout:3/580: creat da/d1d/d82/fa3 x:0 0 0 2024-02-19T19:08:39.647 INFO:tasks.workunit.client.0.smithi046.stdout:3/581: mknod da/ca4 0 2024-02-19T19:08:39.649 INFO:tasks.workunit.client.0.smithi046.stdout:3/582: creat da/d30/d38/d66/fa5 x:0 0 0 2024-02-19T19:08:39.649 INFO:tasks.workunit.client.0.smithi046.stdout:3/583: stat da/d1d/d82/c89 0 2024-02-19T19:08:39.651 INFO:tasks.workunit.client.0.smithi046.stdout:3/584: creat da/fa6 x:0 0 0 2024-02-19T19:08:39.651 INFO:tasks.workunit.client.0.smithi046.stdout:3/585: write da/d30/d38/f4a [4792511,114881] 0 2024-02-19T19:08:39.654 INFO:tasks.workunit.client.0.smithi046.stdout:3/586: dread da/f20 [0,4194304] 0 2024-02-19T19:08:39.669 INFO:tasks.workunit.client.0.smithi046.stdout:3/587: dwrite da/d30/d38/d93/fa0 [0,4194304] 0 2024-02-19T19:08:39.669 INFO:tasks.workunit.client.0.smithi046.stdout:3/588: write da/d30/d38/f7d [2023754,82778] 0 2024-02-19T19:08:39.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/838: sync 2024-02-19T19:08:39.762 INFO:tasks.workunit.client.0.smithi046.stdout:7/839: dread d0/d45/d71/d4b/f9e [0,4194304] 0 2024-02-19T19:08:39.762 INFO:tasks.workunit.client.0.smithi046.stdout:7/840: dread - d0/d4/d24/db9/ffd zero size 2024-02-19T19:08:39.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/841: mknod d0/d45/d98/c10b 0 2024-02-19T19:08:39.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/842: fsync d0/d4/fbd 0 2024-02-19T19:08:39.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/843: chown d0/d45/d71/d4b/f9e 60138 1 2024-02-19T19:08:39.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/844: dread - d0/fdb zero size 2024-02-19T19:08:39.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/845: readlink d0/d45/d4a/d58/l96 0 2024-02-19T19:08:39.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/846: stat d0/d4/d24/caa 0 2024-02-19T19:08:39.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/847: mknod d0/d45/d71/d41/d5f/c10c 0 2024-02-19T19:08:39.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/848: truncate d0/d45/d71/f5b 3851130 0 2024-02-19T19:08:39.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/849: chown d0/d45/d4a/d58/dc6/ff1 9093580 1 2024-02-19T19:08:39.795 INFO:tasks.workunit.client.0.smithi046.stdout:7/850: fsync d0/d45/d4a/d78/f8e 0 2024-02-19T19:08:39.798 INFO:tasks.workunit.client.0.smithi046.stdout:7/851: dread d0/f18 [0,4194304] 0 2024-02-19T19:08:39.798 INFO:tasks.workunit.client.0.smithi046.stdout:7/852: write d0/d45/d71/d4b/d8d/fef [524521,43597] 0 2024-02-19T19:08:39.799 INFO:tasks.workunit.client.0.smithi046.stdout:7/853: write d0/fdb [50247,97278] 0 2024-02-19T19:08:39.799 INFO:tasks.workunit.client.0.smithi046.stdout:7/854: fdatasync d0/d4/d24/f7a 0 2024-02-19T19:08:39.821 INFO:tasks.workunit.client.0.smithi046.stdout:7/855: read d0/d45/d71/d41/f6d [496404,112736] 0 2024-02-19T19:08:39.822 INFO:tasks.workunit.client.0.smithi046.stdout:7/856: mknod d0/d45/d4a/d58/dc6/c10d 0 2024-02-19T19:08:39.823 INFO:tasks.workunit.client.0.smithi046.stdout:7/857: mknod d0/d45/d71/c10e 0 2024-02-19T19:08:39.824 INFO:tasks.workunit.client.0.smithi046.stdout:7/858: creat d0/d45/d71/d41/db8/dd1/f10f x:0 0 0 2024-02-19T19:08:39.825 INFO:tasks.workunit.client.0.smithi046.stdout:7/859: rename d0/d45/l109 to d0/d45/d71/d41/d5f/l110 0 2024-02-19T19:08:39.826 INFO:tasks.workunit.client.0.smithi046.stdout:7/860: write d0/d45/d4a/d58/d60/db4/f104 [371926,104452] 0 2024-02-19T19:08:39.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:39 smithi046 ceph-mon[88928]: osdmap e81: 6 total, 6 up, 6 in 2024-02-19T19:08:39.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:39 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 5420/43164 objects degraded (12.557%), 21 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:39.841 INFO:tasks.workunit.client.0.smithi046.stdout:7/861: dwrite d0/d45/d56/f9f [0,4194304] 0 2024-02-19T19:08:39.844 INFO:tasks.workunit.client.0.smithi046.stdout:7/862: creat d0/d4/d7b/f111 x:0 0 0 2024-02-19T19:08:39.844 INFO:tasks.workunit.client.0.smithi046.stdout:7/863: write d0/d45/d71/d4b/f72 [8883105,53246] 0 2024-02-19T19:08:39.845 INFO:tasks.workunit.client.0.smithi046.stdout:7/864: rmdir d0/d45/d4a/d58/d60/ddc 39 2024-02-19T19:08:39.846 INFO:tasks.workunit.client.0.smithi046.stdout:7/865: mknod d0/d4/d24/c112 0 2024-02-19T19:08:39.847 INFO:tasks.workunit.client.0.smithi046.stdout:7/866: truncate d0/d45/d4a/d58/d60/fa9 1198085 0 2024-02-19T19:08:39.847 INFO:tasks.workunit.client.0.smithi046.stdout:7/867: getdents d0/d45/d71/d41 0 2024-02-19T19:08:39.850 INFO:tasks.workunit.client.0.smithi046.stdout:7/868: write d0/d45/d4a/d58/d60/dbe/df9/f5c [4847442,17819] 0 2024-02-19T19:08:39.862 INFO:tasks.workunit.client.0.smithi046.stdout:6/712: sync 2024-02-19T19:08:39.862 INFO:tasks.workunit.client.0.smithi046.stdout:4/855: sync 2024-02-19T19:08:39.862 INFO:tasks.workunit.client.0.smithi046.stdout:4/856: chown d6/d15/d17/c44 212 1 2024-02-19T19:08:39.863 INFO:tasks.workunit.client.0.smithi046.stdout:6/713: creat d4/d6/dd/d10/d29/da2/db7/fe0 x:0 0 0 2024-02-19T19:08:39.863 INFO:tasks.workunit.client.0.smithi046.stdout:6/714: creat d4/d6/dd/d10/d29/da2/fe1 x:0 0 0 2024-02-19T19:08:39.864 INFO:tasks.workunit.client.0.smithi046.stdout:4/857: creat d6/dd3/dc5/f125 x:0 0 0 2024-02-19T19:08:39.865 INFO:tasks.workunit.client.0.smithi046.stdout:4/858: chown d6/d11/d40/fe5 125 1 2024-02-19T19:08:39.865 INFO:tasks.workunit.client.0.smithi046.stdout:4/859: write d6/d11/fc7 [434002,91579] 0 2024-02-19T19:08:39.867 INFO:tasks.workunit.client.0.smithi046.stdout:6/715: symlink d4/d6/le2 0 2024-02-19T19:08:39.867 INFO:tasks.workunit.client.0.smithi046.stdout:4/860: mkdir d6/d15/d17/d1e/d126 0 2024-02-19T19:08:39.867 INFO:tasks.workunit.client.0.smithi046.stdout:6/716: write d4/d6/dd/d10/d29/da2/fa8 [697015,78368] 0 2024-02-19T19:08:39.868 INFO:tasks.workunit.client.0.smithi046.stdout:6/717: symlink d4/d6/dd/d10/d29/da2/db7/le3 0 2024-02-19T19:08:39.874 INFO:tasks.workunit.client.0.smithi046.stdout:6/718: rmdir d4/d6/dd/d10/d29/da2 39 2024-02-19T19:08:39.875 INFO:tasks.workunit.client.0.smithi046.stdout:6/719: symlink d4/d6/d22/le4 0 2024-02-19T19:08:39.875 INFO:tasks.workunit.client.0.smithi046.stdout:6/720: chown d4/d6/dd/d10/d29/d2d/f7f 415552841 1 2024-02-19T19:08:39.875 INFO:tasks.workunit.client.0.smithi046.stdout:6/721: symlink d4/d6/dd/d10/d29/d2d/d35/d3c/le5 0 2024-02-19T19:08:39.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/722: truncate d4/d6/d1c/f51 1037575 0 2024-02-19T19:08:39.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/723: fsync d4/d6/dd/d10/d29/d2d/d35/f3a 0 2024-02-19T19:08:39.878 INFO:tasks.workunit.client.0.smithi046.stdout:6/724: symlink d4/d6/dd/d10/d29/d2d/le6 0 2024-02-19T19:08:39.879 INFO:tasks.workunit.client.0.smithi046.stdout:6/725: creat d4/d6/dd/d10/d29/d2d/dc0/fe7 x:0 0 0 2024-02-19T19:08:39.879 INFO:tasks.workunit.client.0.smithi046.stdout:6/726: rmdir d4/d6/dd 39 2024-02-19T19:08:39.880 INFO:tasks.workunit.client.0.smithi046.stdout:6/727: mkdir d4/d6/d1c/d20/de8 0 2024-02-19T19:08:39.881 INFO:tasks.workunit.client.0.smithi046.stdout:4/861: dwrite d6/d11/d92/d102/db1/fcb [0,4194304] 0 2024-02-19T19:08:39.889 INFO:tasks.workunit.client.0.smithi046.stdout:6/728: write d4/d6/dd/d10/d29/d2d/f7f [3972567,58321] 0 2024-02-19T19:08:39.891 INFO:tasks.workunit.client.0.smithi046.stdout:4/862: dread d6/d11/dd6/f74 [4194304,4194304] 0 2024-02-19T19:08:39.893 INFO:tasks.workunit.client.0.smithi046.stdout:4/863: unlink d6/d11/dd6/d89/d8a/d55/cfb 0 2024-02-19T19:08:39.894 INFO:tasks.workunit.client.0.smithi046.stdout:4/864: symlink d6/d11/dd6/d89/d8a/l127 0 2024-02-19T19:08:39.894 INFO:tasks.workunit.client.0.smithi046.stdout:4/865: truncate d6/d11/d40/da7/f105 262322 0 2024-02-19T19:08:39.896 INFO:tasks.workunit.client.0.smithi046.stdout:4/866: symlink d6/d11/d92/d102/db1/l128 0 2024-02-19T19:08:39.896 INFO:tasks.workunit.client.0.smithi046.stdout:4/867: write d6/d11/dd6/dc3/ffc [1836246,51666] 0 2024-02-19T19:08:39.896 INFO:tasks.workunit.client.0.smithi046.stdout:4/868: readlink d6/le2 0 2024-02-19T19:08:39.896 INFO:tasks.workunit.client.0.smithi046.stdout:4/869: write d6/d11/db9/f10e [1446537,40082] 0 2024-02-19T19:08:39.898 INFO:tasks.workunit.client.0.smithi046.stdout:4/870: rename d6/d11/d92/d102/lf6 to d6/d11/dd6/l129 0 2024-02-19T19:08:39.899 INFO:tasks.workunit.client.0.smithi046.stdout:4/871: creat d6/d11/d40/da7/dd2/d10d/d121/f12a x:0 0 0 2024-02-19T19:08:39.899 INFO:tasks.workunit.client.0.smithi046.stdout:4/872: stat d6/d11/d40/fe5 0 2024-02-19T19:08:39.899 INFO:tasks.workunit.client.0.smithi046.stdout:4/873: readlink d6/d11/dd6/d89/le4 0 2024-02-19T19:08:39.900 INFO:tasks.workunit.client.0.smithi046.stdout:4/874: truncate d6/d15/d17/f3f 1159265 0 2024-02-19T19:08:39.901 INFO:tasks.workunit.client.0.smithi046.stdout:4/875: mknod d6/d11/d40/da7/dd2/d10d/d121/c12b 0 2024-02-19T19:08:39.902 INFO:tasks.workunit.client.0.smithi046.stdout:4/876: creat d6/d11/d40/da7/dd2/f12c x:0 0 0 2024-02-19T19:08:39.902 INFO:tasks.workunit.client.0.smithi046.stdout:4/877: readlink d6/l67 0 2024-02-19T19:08:39.902 INFO:tasks.workunit.client.0.smithi046.stdout:4/878: write d6/d11/dd6/d89/d8a/d55/f86 [45909,102448] 0 2024-02-19T19:08:39.903 INFO:tasks.workunit.client.0.smithi046.stdout:4/879: getdents d6/d11/dd6/d89/d8a/d8d 0 2024-02-19T19:08:39.908 INFO:tasks.workunit.client.0.smithi046.stdout:6/729: dwrite d4/d6/d1c/d64/fa1 [4194304,4194304] 0 2024-02-19T19:08:39.908 INFO:tasks.workunit.client.0.smithi046.stdout:6/730: read d4/d6/dd/d10/f13 [929075,98044] 0 2024-02-19T19:08:39.910 INFO:tasks.workunit.client.0.smithi046.stdout:6/731: link d4/d6/dd/d10/d29/l5b d4/d6/dd/d10/d29/da2/db7/le9 0 2024-02-19T19:08:39.910 INFO:tasks.workunit.client.0.smithi046.stdout:6/732: chown d4/d6/dd/d10/f15 1120 1 2024-02-19T19:08:39.916 INFO:tasks.workunit.client.0.smithi046.stdout:4/880: dread d6/d15/d17/d1e/ff1 [0,4194304] 0 2024-02-19T19:08:39.917 INFO:tasks.workunit.client.0.smithi046.stdout:4/881: rename d6/l45 to d6/d15/d17/d1e/d25/l12d 0 2024-02-19T19:08:39.925 INFO:tasks.workunit.client.0.smithi046.stdout:6/733: dwrite d4/f43 [0,4194304] 0 2024-02-19T19:08:39.928 INFO:tasks.workunit.client.0.smithi046.stdout:6/734: rmdir d4/d6/d1c/d20/d98/dc4/dce/dd6 0 2024-02-19T19:08:39.928 INFO:tasks.workunit.client.0.smithi046.stdout:6/735: truncate d4/d6/d1c/d64/f80 325497 0 2024-02-19T19:08:39.930 INFO:tasks.workunit.client.0.smithi046.stdout:6/736: rmdir d4/d6/d1c/d60 39 2024-02-19T19:08:39.939 INFO:tasks.workunit.client.0.smithi046.stdout:6/737: dread d4/f43 [0,4194304] 0 2024-02-19T19:08:39.939 INFO:tasks.workunit.client.0.smithi046.stdout:6/738: chown d4/d6/d22/db0/cb5 2655753 1 2024-02-19T19:08:39.939 INFO:tasks.workunit.client.0.smithi046.stdout:6/739: dread - d4/d6/d1c/d20/fcc zero size 2024-02-19T19:08:39.947 INFO:tasks.workunit.client.0.smithi046.stdout:6/740: dread d4/d6/dd/d10/f15 [0,4194304] 0 2024-02-19T19:08:39.949 INFO:tasks.workunit.client.0.smithi046.stdout:6/741: rename d4/d6/dd/d10/d29/d2d/d35/f5d to d4/d6/d1c/d20/dc5/fea 0 2024-02-19T19:08:39.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/742: rename d4/d6/dd/d10/d29/d2d/d35/da5/fc7 to d4/d6/d22/db0/db6/feb 0 2024-02-19T19:08:39.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/743: chown d4/l77 94620 1 2024-02-19T19:08:39.952 INFO:tasks.workunit.client.0.smithi046.stdout:6/744: rename d4/d6/f5e to d4/d6/d8e/fec 0 2024-02-19T19:08:39.968 INFO:tasks.workunit.client.0.smithi046.stdout:6/745: dwrite d4/d6/f4c [0,4194304] 0 2024-02-19T19:08:39.982 INFO:tasks.workunit.client.0.smithi046.stdout:6/746: dread d4/f28 [0,4194304] 0 2024-02-19T19:08:39.997 INFO:tasks.workunit.client.0.smithi046.stdout:6/747: dwrite d4/d6/dd/d10/d29/d2d/d35/d3c/f55 [0,4194304] 0 2024-02-19T19:08:40.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:39 smithi142 ceph-mon[69118]: osdmap e81: 6 total, 6 up, 6 in 2024-02-19T19:08:40.216 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:39 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 5420/43164 objects degraded (12.557%), 21 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:40.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:40 smithi046 ceph-mon[88928]: pgmap v131: 65 pgs: 7 peering, 1 active+undersized+remapped, 8 active+recovery_wait+undersized+degraded+remapped, 4 active+undersized+degraded, 45 active+clean; 1.8 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 64 MiB/s rd, 74 MiB/s wr, 254 op/s; 4185/41163 objects degraded (10.167%); 13 MiB/s, 88 objects/s recovering 2024-02-19T19:08:40.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:40 smithi046 ceph-mon[88928]: osdmap e82: 6 total, 6 up, 6 in 2024-02-19T19:08:40.849 INFO:tasks.workunit.client.0.smithi046.stdout:9/584: sync 2024-02-19T19:08:40.849 INFO:tasks.workunit.client.0.smithi046.stdout:3/589: sync 2024-02-19T19:08:40.849 INFO:tasks.workunit.client.0.smithi046.stdout:0/915: sync 2024-02-19T19:08:40.849 INFO:tasks.workunit.client.0.smithi046.stdout:3/590: creat da/d1d/d82/fa7 x:0 0 0 2024-02-19T19:08:40.849 INFO:tasks.workunit.client.0.smithi046.stdout:5/710: sync 2024-02-19T19:08:40.850 INFO:tasks.workunit.client.0.smithi046.stdout:1/799: sync 2024-02-19T19:08:40.850 INFO:tasks.workunit.client.0.smithi046.stdout:1/800: truncate d5/d13/d35/d37/db0/fdc 847681 0 2024-02-19T19:08:40.852 INFO:tasks.workunit.client.0.smithi046.stdout:9/585: creat db/d1e/d52/fb4 x:0 0 0 2024-02-19T19:08:40.854 INFO:tasks.workunit.client.0.smithi046.stdout:3/591: symlink da/d30/la8 0 2024-02-19T19:08:40.854 INFO:tasks.workunit.client.0.smithi046.stdout:3/592: dread - da/d1d/d8e/f91 zero size 2024-02-19T19:08:40.856 INFO:tasks.workunit.client.0.smithi046.stdout:1/801: creat d5/d21/d9a/df3/f110 x:0 0 0 2024-02-19T19:08:40.857 INFO:tasks.workunit.client.0.smithi046.stdout:9/586: truncate db/d1e/f1f 410304 0 2024-02-19T19:08:40.857 INFO:tasks.workunit.client.0.smithi046.stdout:0/916: dread d0/d19/d8/d37/d40/da6/fb6 [4194304,4194304] 0 2024-02-19T19:08:40.859 INFO:tasks.workunit.client.0.smithi046.stdout:3/593: unlink da/f37 0 2024-02-19T19:08:40.860 INFO:tasks.workunit.client.0.smithi046.stdout:1/802: truncate d5/f26 2917113 0 2024-02-19T19:08:40.862 INFO:tasks.workunit.client.0.smithi046.stdout:9/587: rename db/d1e/d32/d47/d5b/c98 to db/d20/d6b/d54/cb5 0 2024-02-19T19:08:40.863 INFO:tasks.workunit.client.0.smithi046.stdout:5/711: write d2/d27/d47/d54/d57/fbd [3837172,64668] 0 2024-02-19T19:08:40.864 INFO:tasks.workunit.client.0.smithi046.stdout:3/594: dread da/d30/d38/d66/f69 [0,4194304] 0 2024-02-19T19:08:40.864 INFO:tasks.workunit.client.0.smithi046.stdout:3/595: write da/d30/d38/d54/f5b [105096,43702] 0 2024-02-19T19:08:40.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/803: link d5/d21/d9a/dd0/f4b d5/d21/d9a/dd0/d80/daf/db5/dd2/f111 0 2024-02-19T19:08:40.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/588: rename f2 to db/d1e/d32/d47/d5b/d7f/da6/fb6 0 2024-02-19T19:08:40.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/589: chown db/f1c 40692305 1 2024-02-19T19:08:40.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/590: write db/d1e/d32/d47/d5b/f75 [437129,63721] 0 2024-02-19T19:08:40.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/712: creat d2/dd/d29/d3b/d93/fde x:0 0 0 2024-02-19T19:08:40.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/713: dread - d2/dd/d29/d89/fd2 zero size 2024-02-19T19:08:40.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/714: chown d2/dd/d29/d3b/d93 3217 1 2024-02-19T19:08:40.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/715: write d2/d27/d4b/f96 [4434295,26487] 0 2024-02-19T19:08:40.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/716: read - d2/d27/d47/d7f/fbe zero size 2024-02-19T19:08:40.877 INFO:tasks.workunit.client.0.smithi046.stdout:0/917: getdents d0/d24/d56/da3 0 2024-02-19T19:08:40.877 INFO:tasks.workunit.client.0.smithi046.stdout:0/918: fsync d0/d19/d8/d37/fef 0 2024-02-19T19:08:40.880 INFO:tasks.workunit.client.0.smithi046.stdout:3/596: creat da/d1d/d8e/fa9 x:0 0 0 2024-02-19T19:08:40.880 INFO:tasks.workunit.client.0.smithi046.stdout:3/597: chown da/d30/d38/d54 1370028378 1 2024-02-19T19:08:40.881 INFO:tasks.workunit.client.0.smithi046.stdout:1/804: stat d5/d2f/d9f/d3b/d4e/d76 0 2024-02-19T19:08:40.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/591: mkdir db/d20/d6b/d54/db7 0 2024-02-19T19:08:40.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/592: chown db/d20/c83 162 1 2024-02-19T19:08:40.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/593: truncate db/d20/f3f 1006942 0 2024-02-19T19:08:40.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/594: chown db/d1e/d52/c62 7423046 1 2024-02-19T19:08:40.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/595: chown db/d1e/d32/d47/d5b/d7f 350 1 2024-02-19T19:08:40.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/596: write db/d1e/d99/fae [497382,97129] 0 2024-02-19T19:08:40.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/597: dread - db/d1e/d52/fb4 zero size 2024-02-19T19:08:40.887 INFO:tasks.workunit.client.0.smithi046.stdout:0/919: rename d0/d24/d2f/f46 to d0/d19/db/de7/f131 0 2024-02-19T19:08:40.888 INFO:tasks.workunit.client.0.smithi046.stdout:0/920: chown d0/d19/d8/d37/d40/d119 26 1 2024-02-19T19:08:40.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/598: symlink da/d1d/laa 0 2024-02-19T19:08:40.892 INFO:tasks.workunit.client.0.smithi046.stdout:1/805: mknod d5/d2f/d5e/c112 0 2024-02-19T19:08:40.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/921: creat d0/d19/db/de7/df6/f132 x:0 0 0 2024-02-19T19:08:40.896 INFO:tasks.workunit.client.0.smithi046.stdout:0/922: mknod d0/d24/c133 0 2024-02-19T19:08:40.900 INFO:tasks.workunit.client.0.smithi046.stdout:5/717: dwrite d2/dd/d26/d65/fd6 [0,4194304] 0 2024-02-19T19:08:40.900 INFO:tasks.workunit.client.0.smithi046.stdout:5/718: stat d2/d27/f4f 0 2024-02-19T19:08:40.907 INFO:tasks.workunit.client.0.smithi046.stdout:1/806: dread d5/d21/d9a/dd0/d80/daf/db5/dd2/f111 [0,4194304] 0 2024-02-19T19:08:40.908 INFO:tasks.workunit.client.0.smithi046.stdout:0/923: dread d0/d24/d56/da3/fc9 [0,4194304] 0 2024-02-19T19:08:40.908 INFO:tasks.workunit.client.0.smithi046.stdout:1/807: write d5/d2f/d9f/dc9/fe6 [2279917,63137] 0 2024-02-19T19:08:40.908 INFO:tasks.workunit.client.0.smithi046.stdout:0/924: write d0/d19/d8/d37/d85/f117 [928274,29071] 0 2024-02-19T19:08:40.908 INFO:tasks.workunit.client.0.smithi046.stdout:5/719: link d2/f4a d2/d27/d47/d54/fdf 0 2024-02-19T19:08:40.908 INFO:tasks.workunit.client.0.smithi046.stdout:0/925: dread - d0/d19/d8/d37/f7d zero size 2024-02-19T19:08:40.908 INFO:tasks.workunit.client.0.smithi046.stdout:0/926: write d0/d24/d2f/dac/fae [306466,129252] 0 2024-02-19T19:08:40.909 INFO:tasks.workunit.client.0.smithi046.stdout:1/808: symlink d5/d13/d35/d37/l113 0 2024-02-19T19:08:40.911 INFO:tasks.workunit.client.0.smithi046.stdout:9/598: dwrite db/d1e/f1f [0,4194304] 0 2024-02-19T19:08:40.911 INFO:tasks.workunit.client.0.smithi046.stdout:5/720: symlink d2/dd/d2f/d34/le0 0 2024-02-19T19:08:40.911 INFO:tasks.workunit.client.0.smithi046.stdout:5/721: chown d2/dd/d29/d89/lcf 3374681 1 2024-02-19T19:08:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:5/722: write d2/dd/f5c [393674,51430] 0 2024-02-19T19:08:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:9/599: write db/d1e/d52/fb4 [344572,104249] 0 2024-02-19T19:08:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:5/723: read - d2/d27/f53 zero size 2024-02-19T19:08:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:9/600: creat db/d1e/d99/fb8 x:0 0 0 2024-02-19T19:08:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:9/601: creat db/d20/dac/fb9 x:0 0 0 2024-02-19T19:08:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:9/602: chown db/d1e/d99/fae 703 1 2024-02-19T19:08:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:9/603: fdatasync db/d20/d6f/f86 0 2024-02-19T19:08:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:9/604: fdatasync db/d20/f39 0 2024-02-19T19:08:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:0/927: rmdir d0/d19/db/d6a 39 2024-02-19T19:08:40.919 INFO:tasks.workunit.client.0.smithi046.stdout:0/928: mkdir d0/dd2/d120/d134 0 2024-02-19T19:08:40.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/929: rmdir d0/d19/d8/dc5 39 2024-02-19T19:08:40.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/930: chown d0/d19/d4d/da5/da7 4 1 2024-02-19T19:08:40.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/931: chown d0/d19/d4d/le4 696277082 1 2024-02-19T19:08:40.926 INFO:tasks.workunit.client.0.smithi046.stdout:0/932: unlink d0/d24/d2f/d53/d6b/fbf 0 2024-02-19T19:08:40.942 INFO:tasks.workunit.client.0.smithi046.stdout:3/599: write da/d1d/d3f/f76 [3411690,87203] 0 2024-02-19T19:08:40.942 INFO:tasks.workunit.client.0.smithi046.stdout:1/809: dwrite d5/d13/d35/d37/d64/d75/dcf/fdb [0,4194304] 0 2024-02-19T19:08:40.942 INFO:tasks.workunit.client.0.smithi046.stdout:5/724: dwrite d2/dd/f1c [4194304,4194304] 0 2024-02-19T19:08:40.942 INFO:tasks.workunit.client.0.smithi046.stdout:5/725: dread - d2/d27/fdb zero size 2024-02-19T19:08:40.943 INFO:tasks.workunit.client.0.smithi046.stdout:9/605: dwrite db/d20/d6b/d54/fa5 [0,4194304] 0 2024-02-19T19:08:40.944 INFO:tasks.workunit.client.0.smithi046.stdout:3/600: creat da/d1d/d3f/fab x:0 0 0 2024-02-19T19:08:40.948 INFO:tasks.workunit.client.0.smithi046.stdout:3/601: mknod da/d1d/d63/d64/cac 0 2024-02-19T19:08:40.957 INFO:tasks.workunit.client.0.smithi046.stdout:5/726: fdatasync d2/dd/f5c 0 2024-02-19T19:08:40.957 INFO:tasks.workunit.client.0.smithi046.stdout:5/727: stat d2/dd/d29/d89/fd2 0 2024-02-19T19:08:40.958 INFO:tasks.workunit.client.0.smithi046.stdout:0/933: dwrite d0/d5f/f73 [0,4194304] 0 2024-02-19T19:08:40.959 INFO:tasks.workunit.client.0.smithi046.stdout:5/728: creat d2/d5e/fe1 x:0 0 0 2024-02-19T19:08:40.959 INFO:tasks.workunit.client.0.smithi046.stdout:5/729: write d2/dd/d2f/d34/d5d/f61 [4612525,52339] 0 2024-02-19T19:08:40.960 INFO:tasks.workunit.client.0.smithi046.stdout:1/810: dread d5/d21/d9a/dd0/fd1 [4194304,4194304] 0 2024-02-19T19:08:40.961 INFO:tasks.workunit.client.0.smithi046.stdout:9/606: dread db/d20/d6b/d54/f70 [0,4194304] 0 2024-02-19T19:08:40.961 INFO:tasks.workunit.client.0.smithi046.stdout:9/607: fdatasync db/d20/f39 0 2024-02-19T19:08:40.961 INFO:tasks.workunit.client.0.smithi046.stdout:0/934: unlink d0/d19/d8/l4c 0 2024-02-19T19:08:40.961 INFO:tasks.workunit.client.0.smithi046.stdout:9/608: write db/d20/dac/fb9 [147455,128994] 0 2024-02-19T19:08:40.961 INFO:tasks.workunit.client.0.smithi046.stdout:5/730: write d2/dd/d3f/f7b [27564,25029] 0 2024-02-19T19:08:40.962 INFO:tasks.workunit.client.0.smithi046.stdout:9/609: creat db/d20/d6f/fba x:0 0 0 2024-02-19T19:08:40.962 INFO:tasks.workunit.client.0.smithi046.stdout:5/731: truncate d2/f70 4605146 0 2024-02-19T19:08:40.962 INFO:tasks.workunit.client.0.smithi046.stdout:5/732: chown d2/dd/d2f/d34/la1 0 1 2024-02-19T19:08:40.962 INFO:tasks.workunit.client.0.smithi046.stdout:5/733: getdents d2/dd 0 2024-02-19T19:08:40.962 INFO:tasks.workunit.client.0.smithi046.stdout:5/734: creat d2/d27/d47/d7f/fe2 x:0 0 0 2024-02-19T19:08:40.963 INFO:tasks.workunit.client.0.smithi046.stdout:1/811: link d5/d2f/d9f/d3b/d4e/d91/cc0 d5/d21/d9a/dd0/c114 0 2024-02-19T19:08:40.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/935: link d0/f4f d0/d19/db/f135 0 2024-02-19T19:08:40.967 INFO:tasks.workunit.client.0.smithi046.stdout:5/735: creat d2/dd/d2f/d34/fe3 x:0 0 0 2024-02-19T19:08:40.969 INFO:tasks.workunit.client.0.smithi046.stdout:5/736: mknod d2/dd/d26/d65/d5f/ce4 0 2024-02-19T19:08:40.969 INFO:tasks.workunit.client.0.smithi046.stdout:5/737: fsync d2/d27/d47/fad 0 2024-02-19T19:08:40.969 INFO:tasks.workunit.client.0.smithi046.stdout:5/738: chown d2/d27/d47/d54/fdf 1007521 1 2024-02-19T19:08:40.970 INFO:tasks.workunit.client.0.smithi046.stdout:5/739: symlink d2/d27/d47/d7f/le5 0 2024-02-19T19:08:40.971 INFO:tasks.workunit.client.0.smithi046.stdout:5/740: symlink d2/dd/d29/d3b/le6 0 2024-02-19T19:08:40.973 INFO:tasks.workunit.client.0.smithi046.stdout:5/741: symlink d2/dd/d26/da9/dbf/le7 0 2024-02-19T19:08:40.998 INFO:tasks.workunit.client.0.smithi046.stdout:9/610: dwrite db/d20/d6f/fba [0,4194304] 0 2024-02-19T19:08:40.998 INFO:tasks.workunit.client.0.smithi046.stdout:0/936: dwrite d0/d24/d5b/d7f/dfc/d114/f12d [0,4194304] 0 2024-02-19T19:08:40.998 INFO:tasks.workunit.client.0.smithi046.stdout:9/611: chown db/l14 0 1 2024-02-19T19:08:40.998 INFO:tasks.workunit.client.0.smithi046.stdout:0/937: write d0/d19/f91 [892439,66188] 0 2024-02-19T19:08:40.998 INFO:tasks.workunit.client.0.smithi046.stdout:5/742: dwrite d2/dd/d26/d65/fa4 [0,4194304] 0 2024-02-19T19:08:40.998 INFO:tasks.workunit.client.0.smithi046.stdout:5/743: write d2/d27/d47/d7f/fe2 [421555,69644] 0 2024-02-19T19:08:41.004 INFO:tasks.workunit.client.0.smithi046.stdout:5/744: rename d2/dd/d2f/d34/fe3 to d2/dd/d26/d65/d5f/fe8 0 2024-02-19T19:08:41.006 INFO:tasks.workunit.client.0.smithi046.stdout:0/938: write d0/f17 [1900415,115788] 0 2024-02-19T19:08:41.006 INFO:tasks.workunit.client.0.smithi046.stdout:0/939: dread - d0/d19/d8/d37/ffe zero size 2024-02-19T19:08:41.006 INFO:tasks.workunit.client.0.smithi046.stdout:0/940: dread - d0/d24/d2f/d53/f9f zero size 2024-02-19T19:08:41.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/745: write d2/fd0 [1906962,36841] 0 2024-02-19T19:08:41.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/746: write d2/dd/d29/d3b/d93/fae [2026826,122952] 0 2024-02-19T19:08:41.018 INFO:tasks.workunit.client.0.smithi046.stdout:5/747: rename d2/dd/d29/d3b/d93/fde to d2/dd/d26/d65/d5f/dba/fe9 0 2024-02-19T19:08:41.018 INFO:tasks.workunit.client.0.smithi046.stdout:5/748: read - d2/d27/fdb zero size 2024-02-19T19:08:41.018 INFO:tasks.workunit.client.0.smithi046.stdout:5/749: chown d2/f28 0 1 2024-02-19T19:08:41.023 INFO:tasks.workunit.client.0.smithi046.stdout:9/612: dwrite db/d1e/d32/f5f [0,4194304] 0 2024-02-19T19:08:41.028 INFO:tasks.workunit.client.0.smithi046.stdout:0/941: dwrite d0/d24/d8c/fcd [0,4194304] 0 2024-02-19T19:08:41.032 INFO:tasks.workunit.client.0.smithi046.stdout:0/942: symlink d0/d24/d2f/l136 0 2024-02-19T19:08:41.033 INFO:tasks.workunit.client.0.smithi046.stdout:0/943: write d0/d19/d4d/f130 [588630,114851] 0 2024-02-19T19:08:41.035 INFO:tasks.workunit.client.0.smithi046.stdout:0/944: creat d0/d24/d2f/d53/d6b/f137 x:0 0 0 2024-02-19T19:08:41.035 INFO:tasks.workunit.client.0.smithi046.stdout:0/945: read - d0/d24/d56/da3/f106 zero size 2024-02-19T19:08:41.035 INFO:tasks.workunit.client.0.smithi046.stdout:0/946: chown d0/d19/d8/l2c 53413 1 2024-02-19T19:08:41.035 INFO:tasks.workunit.client.0.smithi046.stdout:9/613: dread db/d20/d4e/f6a [0,4194304] 0 2024-02-19T19:08:41.036 INFO:tasks.workunit.client.0.smithi046.stdout:9/614: mknod db/d53/cbb 0 2024-02-19T19:08:41.036 INFO:tasks.workunit.client.0.smithi046.stdout:9/615: write db/d1e/d32/d47/d5b/f75 [683780,74373] 0 2024-02-19T19:08:41.038 INFO:tasks.workunit.client.0.smithi046.stdout:5/750: dwrite d2/dd/d2f/f41 [4194304,4194304] 0 2024-02-19T19:08:41.038 INFO:tasks.workunit.client.0.smithi046.stdout:5/751: readlink d2/dd/d29/la8 0 2024-02-19T19:08:41.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/947: dwrite d0/d19/d8/d37/f5d [0,4194304] 0 2024-02-19T19:08:41.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/948: creat d0/d19/d8/d37/dd9/df1/f138 x:0 0 0 2024-02-19T19:08:41.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/949: chown d0/d24/d5b/d7f/dfc/l67 5211 1 2024-02-19T19:08:41.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/950: truncate d0/d24/d56/da3/faf 722750 0 2024-02-19T19:08:41.067 INFO:tasks.workunit.client.0.smithi046.stdout:5/752: dwrite d2/dd/d26/daa/fb2 [0,4194304] 0 2024-02-19T19:08:41.071 INFO:tasks.workunit.client.0.smithi046.stdout:9/616: dwrite db/d20/f56 [0,4194304] 0 2024-02-19T19:08:41.072 INFO:tasks.workunit.client.0.smithi046.stdout:5/753: link d2/d27/d47/d7f/f8a d2/dd/d29/d89/dca/fea 0 2024-02-19T19:08:41.073 INFO:tasks.workunit.client.0.smithi046.stdout:9/617: mknod db/d20/cbc 0 2024-02-19T19:08:41.073 INFO:tasks.workunit.client.0.smithi046.stdout:9/618: dread - db/d1e/d32/d47/d5b/d7f/f8b zero size 2024-02-19T19:08:41.073 INFO:tasks.workunit.client.0.smithi046.stdout:9/619: readlink db/d1e/d32/d47/l7e 0 2024-02-19T19:08:41.074 INFO:tasks.workunit.client.0.smithi046.stdout:5/754: mknod d2/dd/d2f/d34/ceb 0 2024-02-19T19:08:41.074 INFO:tasks.workunit.client.0.smithi046.stdout:5/755: readlink d2/dd/l86 0 2024-02-19T19:08:41.077 INFO:tasks.workunit.client.0.smithi046.stdout:9/620: mknod db/d1e/d32/d47/d5b/d7f/cbd 0 2024-02-19T19:08:41.085 INFO:tasks.workunit.client.0.smithi046.stdout:9/621: dread db/d20/d6b/d54/fa5 [0,4194304] 0 2024-02-19T19:08:41.085 INFO:tasks.workunit.client.0.smithi046.stdout:9/622: write db/d20/dac/fb9 [302151,84851] 0 2024-02-19T19:08:41.091 INFO:tasks.workunit.client.0.smithi046.stdout:5/756: dwrite d2/dd/d26/da9/fc1 [0,4194304] 0 2024-02-19T19:08:41.101 INFO:tasks.workunit.client.0.smithi046.stdout:5/757: dread d2/dd/f20 [8388608,4194304] 0 2024-02-19T19:08:41.102 INFO:tasks.workunit.client.0.smithi046.stdout:5/758: truncate d2/dd/d26/f48 5842125 0 2024-02-19T19:08:41.111 INFO:tasks.workunit.client.0.smithi046.stdout:5/759: write d2/dd/d26/d65/fd6 [3537144,10801] 0 2024-02-19T19:08:41.127 INFO:tasks.workunit.client.0.smithi046.stdout:5/760: dwrite d2/dd/d29/d89/dca/fea [0,4194304] 0 2024-02-19T19:08:41.127 INFO:tasks.workunit.client.0.smithi046.stdout:5/761: creat d2/dd/d3f/fec x:0 0 0 2024-02-19T19:08:41.129 INFO:tasks.workunit.client.0.smithi046.stdout:5/762: truncate d2/f40 1042094 0 2024-02-19T19:08:41.146 INFO:tasks.workunit.client.0.smithi046.stdout:5/763: dwrite d2/dd/d26/d65/d5f/fa6 [0,4194304] 0 2024-02-19T19:08:41.149 INFO:tasks.workunit.client.0.smithi046.stdout:5/764: link d2/fb d2/d27/d4b/dc2/fed 0 2024-02-19T19:08:41.164 INFO:tasks.workunit.client.0.smithi046.stdout:5/765: dwrite d2/dd/f77 [0,4194304] 0 2024-02-19T19:08:41.164 INFO:tasks.workunit.client.0.smithi046.stdout:5/766: chown d2/dd/d2f/lbc 1 1 2024-02-19T19:08:41.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/767: dread d2/dd/d26/f2e [0,4194304] 0 2024-02-19T19:08:41.174 INFO:tasks.workunit.client.0.smithi046.stdout:5/768: rename d2/dd/d29/d3b/fb3 to d2/d27/d47/fee 0 2024-02-19T19:08:41.174 INFO:tasks.workunit.client.0.smithi046.stdout:5/769: symlink d2/dd/d29/d3b/lef 0 2024-02-19T19:08:41.175 INFO:tasks.workunit.client.0.smithi046.stdout:5/770: creat d2/dd/d26/d65/d5f/dba/ff0 x:0 0 0 2024-02-19T19:08:41.184 INFO:tasks.workunit.client.0.smithi046.stdout:5/771: read d2/dd/d29/f45 [6701408,69649] 0 2024-02-19T19:08:41.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:40 smithi142 ceph-mon[69118]: pgmap v131: 65 pgs: 7 peering, 1 active+undersized+remapped, 8 active+recovery_wait+undersized+degraded+remapped, 4 active+undersized+degraded, 45 active+clean; 1.8 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 64 MiB/s rd, 74 MiB/s wr, 254 op/s; 4185/41163 objects degraded (10.167%); 13 MiB/s, 88 objects/s recovering 2024-02-19T19:08:41.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:40 smithi142 ceph-mon[69118]: osdmap e82: 6 total, 6 up, 6 in 2024-02-19T19:08:41.852 INFO:tasks.workunit.client.0.smithi046.stdout:9/623: write db/d20/d6b/d54/fab [1209018,102927] 0 2024-02-19T19:08:41.852 INFO:tasks.workunit.client.0.smithi046.stdout:9/624: write db/d1e/d32/d47/d5b/d94/f9c [717868,106906] 0 2024-02-19T19:08:41.852 INFO:tasks.workunit.client.0.smithi046.stdout:3/602: dwrite da/d1d/d3f/f55 [0,4194304] 0 2024-02-19T19:08:41.852 INFO:tasks.workunit.client.0.smithi046.stdout:3/603: truncate da/d30/f99 535827 0 2024-02-19T19:08:41.852 INFO:tasks.workunit.client.0.smithi046.stdout:1/812: dwrite d5/d2f/d9f/d3b/d4e/d76/fa0 [0,4194304] 0 2024-02-19T19:08:41.853 INFO:tasks.workunit.client.0.smithi046.stdout:3/604: symlink da/d1d/d63/lad 0 2024-02-19T19:08:41.854 INFO:tasks.workunit.client.0.smithi046.stdout:3/605: fsync da/d1d/d10/f21 0 2024-02-19T19:08:41.859 INFO:tasks.workunit.client.0.smithi046.stdout:9/625: dread db/d1e/d32/f61 [0,4194304] 0 2024-02-19T19:08:41.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/813: link d5/d13/d35/d37/d64/f6b d5/d13/d35/d37/d64/d87/f115 0 2024-02-19T19:08:41.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/814: chown d5/d21/d9a/fdf 1 1 2024-02-19T19:08:41.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/815: dread - d5/d21/d9a/df3/f110 zero size 2024-02-19T19:08:41.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/816: dread - d5/d21/f98 zero size 2024-02-19T19:08:41.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/817: chown d5/d13/d35/d37/db0/ce2 88389745 1 2024-02-19T19:08:41.868 INFO:tasks.workunit.client.0.smithi046.stdout:3/606: link da/d1d/d10/c6d da/cae 0 2024-02-19T19:08:41.870 INFO:tasks.workunit.client.0.smithi046.stdout:9/626: dread db/d20/d6f/fba [0,4194304] 0 2024-02-19T19:08:41.872 INFO:tasks.workunit.client.0.smithi046.stdout:9/627: mkdir db/d1e/d52/dbe 0 2024-02-19T19:08:41.872 INFO:tasks.workunit.client.0.smithi046.stdout:9/628: dread - db/d1e/d99/fb8 zero size 2024-02-19T19:08:41.874 INFO:tasks.workunit.client.0.smithi046.stdout:9/629: getdents db/d1e/d32/d47 0 2024-02-19T19:08:41.877 INFO:tasks.workunit.client.0.smithi046.stdout:1/818: dread d5/d2f/d9f/d55/f63 [0,4194304] 0 2024-02-19T19:08:41.882 INFO:tasks.workunit.client.0.smithi046.stdout:3/607: write da/d30/f44 [620859,13784] 0 2024-02-19T19:08:41.884 INFO:tasks.workunit.client.0.smithi046.stdout:3/608: read da/d1d/d10/f6e [78266,9367] 0 2024-02-19T19:08:41.886 INFO:tasks.workunit.client.0.smithi046.stdout:3/609: getdents da/d30/d38/d93 0 2024-02-19T19:08:41.887 INFO:tasks.workunit.client.0.smithi046.stdout:3/610: mknod da/caf 0 2024-02-19T19:08:41.898 INFO:tasks.workunit.client.0.smithi046.stdout:1/819: dwrite d5/d2f/d9f/d3b/f109 [0,4194304] 0 2024-02-19T19:08:41.898 INFO:tasks.workunit.client.0.smithi046.stdout:3/611: dread da/d30/d38/d66/f67 [0,4194304] 0 2024-02-19T19:08:41.898 INFO:tasks.workunit.client.0.smithi046.stdout:3/612: creat da/d1d/fb0 x:0 0 0 2024-02-19T19:08:41.899 INFO:tasks.workunit.client.0.smithi046.stdout:1/820: mknod d5/d21/d9a/dd0/c116 0 2024-02-19T19:08:41.901 INFO:tasks.workunit.client.0.smithi046.stdout:3/613: creat da/d30/d38/d93/fb1 x:0 0 0 2024-02-19T19:08:41.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/821: chown d5/d2f/d9f/d3b/la5 41 1 2024-02-19T19:08:41.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/822: stat d5/d21/d9a/dd0/d80/daf/db5/dbe 0 2024-02-19T19:08:41.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/823: chown d5/d21/d9a/dd0/d80/daf/c78 769 1 2024-02-19T19:08:41.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/824: truncate d5/d13/d35/d37/fa9 5694231 0 2024-02-19T19:08:41.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/825: symlink d5/d2f/d9f/l117 0 2024-02-19T19:08:41.904 INFO:tasks.workunit.client.0.smithi046.stdout:1/826: link d5/d2f/d9f/d3b/de9/l103 d5/d2f/d9f/d3b/d3c/l118 0 2024-02-19T19:08:41.918 INFO:tasks.workunit.client.0.smithi046.stdout:1/827: write d5/d13/d35/d37/f6c [499601,105985] 0 2024-02-19T19:08:41.927 INFO:tasks.workunit.client.0.smithi046.stdout:3/614: dwrite da/f2c [0,4194304] 0 2024-02-19T19:08:41.927 INFO:tasks.workunit.client.0.smithi046.stdout:1/828: dread d5/d2f/d9f/d3b/d4e/f108 [0,4194304] 0 2024-02-19T19:08:41.927 INFO:tasks.workunit.client.0.smithi046.stdout:3/615: write da/d1d/f60 [4090213,105091] 0 2024-02-19T19:08:41.927 INFO:tasks.workunit.client.0.smithi046.stdout:3/616: write da/d1d/d3f/f76 [4085358,45718] 0 2024-02-19T19:08:41.927 INFO:tasks.workunit.client.0.smithi046.stdout:3/617: getdents da/d8a/d9f 0 2024-02-19T19:08:41.928 INFO:tasks.workunit.client.0.smithi046.stdout:1/829: unlink d5/d2f/d9f/d3b/d4e/d76/c105 0 2024-02-19T19:08:41.929 INFO:tasks.workunit.client.0.smithi046.stdout:3/618: rmdir da/d30/d38/d54 39 2024-02-19T19:08:41.931 INFO:tasks.workunit.client.0.smithi046.stdout:1/830: mknod d5/d21/d9a/dd0/d80/daf/db5/dd2/c119 0 2024-02-19T19:08:41.931 INFO:tasks.workunit.client.0.smithi046.stdout:1/831: truncate d5/d13/ff5 483024 0 2024-02-19T19:08:41.934 INFO:tasks.workunit.client.0.smithi046.stdout:1/832: link d5/d13/d35/d37/d64/d75/f106 d5/d13/d35/d37/d64/d87/f11a 0 2024-02-19T19:08:41.948 INFO:tasks.workunit.client.0.smithi046.stdout:3/619: dwrite da/d1d/d10/f58 [0,4194304] 0 2024-02-19T19:08:41.953 INFO:tasks.workunit.client.0.smithi046.stdout:1/833: dwrite d5/d2f/d9f/f95 [0,4194304] 0 2024-02-19T19:08:41.957 INFO:tasks.workunit.client.0.smithi046.stdout:1/834: symlink d5/d2f/d9f/dc4/l11b 0 2024-02-19T19:08:41.958 INFO:tasks.workunit.client.0.smithi046.stdout:1/835: write d5/d21/fc2 [2290284,99822] 0 2024-02-19T19:08:41.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/836: link d5/d13/d35/d37/d64/d87/fc7 d5/d21/f11c 0 2024-02-19T19:08:41.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/837: write d5/d21/d9a/dd0/d80/fac [513016,5986] 0 2024-02-19T19:08:41.965 INFO:tasks.workunit.client.0.smithi046.stdout:1/838: mkdir d5/d2f/d9f/d3b/d3c/d3f/d11d 0 2024-02-19T19:08:41.966 INFO:tasks.workunit.client.0.smithi046.stdout:3/620: dwrite da/d1d/d63/f85 [0,4194304] 0 2024-02-19T19:08:41.974 INFO:tasks.workunit.client.0.smithi046.stdout:4/882: sync 2024-02-19T19:08:41.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/883: readlink d6/dd3/l7c 0 2024-02-19T19:08:41.975 INFO:tasks.workunit.client.0.smithi046.stdout:6/748: sync 2024-02-19T19:08:41.975 INFO:tasks.workunit.client.0.smithi046.stdout:6/749: chown d4/d6/d1c/d20/l32 11 1 2024-02-19T19:08:41.975 INFO:tasks.workunit.client.0.smithi046.stdout:6/750: truncate d4/d6/dd/d10/d29/d2d/fb4 721120 0 2024-02-19T19:08:41.975 INFO:tasks.workunit.client.0.smithi046.stdout:6/751: creat d4/d6/d22/db0/fed x:0 0 0 2024-02-19T19:08:41.975 INFO:tasks.workunit.client.0.smithi046.stdout:7/869: sync 2024-02-19T19:08:41.976 INFO:tasks.workunit.client.0.smithi046.stdout:4/884: mknod d6/d11/db9/c12e 0 2024-02-19T19:08:41.978 INFO:tasks.workunit.client.0.smithi046.stdout:6/752: stat d4/l7b 0 2024-02-19T19:08:41.980 INFO:tasks.workunit.client.0.smithi046.stdout:7/870: mkdir d0/d4/d24/db9/d113 0 2024-02-19T19:08:41.982 INFO:tasks.workunit.client.0.smithi046.stdout:4/885: link d6/l6b d6/d11/d92/l12f 0 2024-02-19T19:08:41.982 INFO:tasks.workunit.client.0.smithi046.stdout:4/886: mknod d6/d15/d17/c130 0 2024-02-19T19:08:41.985 INFO:tasks.workunit.client.0.smithi046.stdout:4/887: unlink d6/l6b 0 2024-02-19T19:08:41.986 INFO:tasks.workunit.client.0.smithi046.stdout:1/839: write d5/d13/d35/d37/d64/d87/fcd [489111,100821] 0 2024-02-19T19:08:41.988 INFO:tasks.workunit.client.0.smithi046.stdout:4/888: creat d6/d11/dd6/d89/d8a/d55/f131 x:0 0 0 2024-02-19T19:08:41.988 INFO:tasks.workunit.client.0.smithi046.stdout:4/889: write d6/d11/dd6/d89/d8a/f119 [977616,20308] 0 2024-02-19T19:08:41.989 INFO:tasks.workunit.client.0.smithi046.stdout:1/840: mkdir d5/d13/d35/d37/d64/d75/dcf/d11e 0 2024-02-19T19:08:41.989 INFO:tasks.workunit.client.0.smithi046.stdout:1/841: truncate d5/d2f/fd9 1362102 0 2024-02-19T19:08:41.989 INFO:tasks.workunit.client.0.smithi046.stdout:4/890: stat d6/d15/d17/f3f 0 2024-02-19T19:08:41.991 INFO:tasks.workunit.client.0.smithi046.stdout:1/842: rmdir d5/d2f/d9f/d55 39 2024-02-19T19:08:41.993 INFO:tasks.workunit.client.0.smithi046.stdout:1/843: getdents d5/d2f/d9f/d55 0 2024-02-19T19:08:41.993 INFO:tasks.workunit.client.0.smithi046.stdout:1/844: write d5/d13/d35/d37/d64/d87/fcd [5562642,4416] 0 2024-02-19T19:08:41.994 INFO:tasks.workunit.client.0.smithi046.stdout:6/753: read d4/d6/dd/d10/d29/d2d/f47 [3869871,60944] 0 2024-02-19T19:08:41.994 INFO:tasks.workunit.client.0.smithi046.stdout:1/845: creat d5/d2f/de7/f11f x:0 0 0 2024-02-19T19:08:41.994 INFO:tasks.workunit.client.0.smithi046.stdout:6/754: rmdir d4/d6/d22/db0/db6 39 2024-02-19T19:08:41.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/846: rmdir d5/d2f 39 2024-02-19T19:08:41.996 INFO:tasks.workunit.client.0.smithi046.stdout:1/847: mknod d5/d13/d35/d37/c120 0 2024-02-19T19:08:41.998 INFO:tasks.workunit.client.0.smithi046.stdout:1/848: mkdir d5/d13/d35/d37/d121 0 2024-02-19T19:08:41.999 INFO:tasks.workunit.client.0.smithi046.stdout:7/871: dwrite d0/d45/d71/da3/f93 [0,4194304] 0 2024-02-19T19:08:41.999 INFO:tasks.workunit.client.0.smithi046.stdout:7/872: chown d0/d45/d4a/d78/d9d 74597 1 2024-02-19T19:08:42.005 INFO:tasks.workunit.client.0.smithi046.stdout:4/891: dread d6/d11/dd6/f74 [4194304,4194304] 0 2024-02-19T19:08:42.007 INFO:tasks.workunit.client.0.smithi046.stdout:4/892: symlink d6/dd3/l132 0 2024-02-19T19:08:42.022 INFO:tasks.workunit.client.0.smithi046.stdout:4/893: write d6/d15/d17/d1e/d25/fd5 [5092918,62793] 0 2024-02-19T19:08:42.022 INFO:tasks.workunit.client.0.smithi046.stdout:6/755: dwrite d4/d6/dd/d10/d29/d2d/d35/d3c/f55 [0,4194304] 0 2024-02-19T19:08:42.022 INFO:tasks.workunit.client.0.smithi046.stdout:6/756: creat d4/d6/d1c/d20/d7a/fee x:0 0 0 2024-02-19T19:08:42.022 INFO:tasks.workunit.client.0.smithi046.stdout:6/757: read - d4/d6/dd/d10/f82 zero size 2024-02-19T19:08:42.023 INFO:tasks.workunit.client.0.smithi046.stdout:6/758: readlink d4/d6/d1c/d20/l32 0 2024-02-19T19:08:42.023 INFO:tasks.workunit.client.0.smithi046.stdout:1/849: rename d5/d13/d35 to d5/d2f/d9f/d3b/d4e/d91/d122 0 2024-02-19T19:08:42.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/759: mkdir d4/d6/d1c/d60/def 0 2024-02-19T19:08:42.028 INFO:tasks.workunit.client.0.smithi046.stdout:6/760: dread d4/d6/dd/d10/d29/da2/fa8 [0,4194304] 0 2024-02-19T19:08:42.031 INFO:tasks.workunit.client.0.smithi046.stdout:6/761: mkdir d4/d6/dd/d10/d29/d2d/d35/da5/df0 0 2024-02-19T19:08:42.034 INFO:tasks.workunit.client.0.smithi046.stdout:7/873: dwrite d0/d45/d4a/d58/fa7 [0,4194304] 0 2024-02-19T19:08:42.034 INFO:tasks.workunit.client.0.smithi046.stdout:7/874: fsync d0/d45/d71/d41/d5f/f8f 0 2024-02-19T19:08:42.034 INFO:tasks.workunit.client.0.smithi046.stdout:7/875: chown d0/d4/d24/db9/ffd 67 1 2024-02-19T19:08:42.036 INFO:tasks.workunit.client.0.smithi046.stdout:1/850: read d5/d21/d9a/dd0/f5d [2934972,22700] 0 2024-02-19T19:08:42.036 INFO:tasks.workunit.client.0.smithi046.stdout:1/851: dread - d5/d2f/d5e/fae zero size 2024-02-19T19:08:42.037 INFO:tasks.workunit.client.0.smithi046.stdout:7/876: symlink d0/d4/d24/l114 0 2024-02-19T19:08:42.038 INFO:tasks.workunit.client.0.smithi046.stdout:1/852: mknod d5/d21/d9a/dd0/d80/daf/db5/dbe/c123 0 2024-02-19T19:08:42.039 INFO:tasks.workunit.client.0.smithi046.stdout:7/877: mknod d0/d45/d71/d4b/c115 0 2024-02-19T19:08:42.043 INFO:tasks.workunit.client.0.smithi046.stdout:1/853: creat d5/d2f/d9f/d3b/d3c/f124 x:0 0 0 2024-02-19T19:08:42.047 INFO:tasks.workunit.client.0.smithi046.stdout:1/854: link d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d75/dcf/ff0 d5/d2f/d9f/d3b/d4e/d91/d122/d37/db0/f125 0 2024-02-19T19:08:42.050 INFO:tasks.workunit.client.0.smithi046.stdout:7/878: rename d0/d45/d4a/d58/d60 to d0/d45/d98/d116 0 2024-02-19T19:08:42.050 INFO:tasks.workunit.client.0.smithi046.stdout:7/879: readlink d0/l106 0 2024-02-19T19:08:42.051 INFO:tasks.workunit.client.0.smithi046.stdout:7/880: mknod d0/d45/d56/c117 0 2024-02-19T19:08:42.053 INFO:tasks.workunit.client.0.smithi046.stdout:1/855: dread d5/d2f/d9f/dc9/fe6 [0,4194304] 0 2024-02-19T19:08:42.053 INFO:tasks.workunit.client.0.smithi046.stdout:7/881: mkdir d0/d4/d24/db9/d113/d118 0 2024-02-19T19:08:42.053 INFO:tasks.workunit.client.0.smithi046.stdout:1/856: chown d5/d2f/d9f/d55/fb1 467 1 2024-02-19T19:08:42.055 INFO:tasks.workunit.client.0.smithi046.stdout:7/882: read d0/d45/d98/d116/fa9 [1184321,75727] 0 2024-02-19T19:08:42.056 INFO:tasks.workunit.client.0.smithi046.stdout:1/857: creat d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d75/dcf/d11e/f126 x:0 0 0 2024-02-19T19:08:42.057 INFO:tasks.workunit.client.0.smithi046.stdout:7/883: mknod d0/de2/c119 0 2024-02-19T19:08:42.057 INFO:tasks.workunit.client.0.smithi046.stdout:6/762: dwrite d4/d6/f3b [4194304,4194304] 0 2024-02-19T19:08:42.057 INFO:tasks.workunit.client.0.smithi046.stdout:6/763: chown d4/d6/d1c/d94/lc8 16 1 2024-02-19T19:08:42.057 INFO:tasks.workunit.client.0.smithi046.stdout:7/884: write d0/d4/f3c [377516,18279] 0 2024-02-19T19:08:42.057 INFO:tasks.workunit.client.0.smithi046.stdout:7/885: dread - d0/d4/d24/db9/fda zero size 2024-02-19T19:08:42.058 INFO:tasks.workunit.client.0.smithi046.stdout:6/764: rmdir d4/d6/d22/db0/db6 39 2024-02-19T19:08:42.059 INFO:tasks.workunit.client.0.smithi046.stdout:7/886: creat d0/d45/d4a/d58/f11a x:0 0 0 2024-02-19T19:08:42.067 INFO:tasks.workunit.client.0.smithi046.stdout:7/887: write d0/d45/d98/d116/fa9 [30760,64566] 0 2024-02-19T19:08:42.068 INFO:tasks.workunit.client.0.smithi046.stdout:1/858: dread d5/d2f/d9f/d55/f63 [0,4194304] 0 2024-02-19T19:08:42.068 INFO:tasks.workunit.client.0.smithi046.stdout:1/859: fsync d5/d2f/d9f/d3b/d3c/d3f/fd6 0 2024-02-19T19:08:42.068 INFO:tasks.workunit.client.0.smithi046.stdout:1/860: fdatasync d5/d2f/d9f/dc9/fe6 0 2024-02-19T19:08:42.068 INFO:tasks.workunit.client.0.smithi046.stdout:1/861: fdatasync d5/d2f/d9f/d3b/d4e/d91/d122/d37/db0/fdc 0 2024-02-19T19:08:42.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/888: unlink d0/d45/d98/c10b 0 2024-02-19T19:08:42.070 INFO:tasks.workunit.client.0.smithi046.stdout:7/889: truncate d0/d45/d71/d4b/f72 3286456 0 2024-02-19T19:08:42.079 INFO:tasks.workunit.client.0.smithi046.stdout:7/890: dread d0/ff [0,4194304] 0 2024-02-19T19:08:42.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:41 smithi046 ceph-mon[88928]: osdmap e83: 6 total, 6 up, 6 in 2024-02-19T19:08:42.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:41 smithi046 ceph-mon[88928]: osdmap e84: 6 total, 6 up, 6 in 2024-02-19T19:08:42.095 INFO:tasks.workunit.client.0.smithi046.stdout:1/862: dwrite d5/f26 [0,4194304] 0 2024-02-19T19:08:42.097 INFO:tasks.workunit.client.0.smithi046.stdout:1/863: rename d5/d2f/d5e/fae to d5/d2f/d9f/d3b/d4e/f127 0 2024-02-19T19:08:42.097 INFO:tasks.workunit.client.0.smithi046.stdout:1/864: creat d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d75/dcf/d11e/f128 x:0 0 0 2024-02-19T19:08:42.098 INFO:tasks.workunit.client.0.smithi046.stdout:1/865: mkdir d5/d21/d9a/dd0/d129 0 2024-02-19T19:08:42.098 INFO:tasks.workunit.client.0.smithi046.stdout:1/866: creat d5/d2f/d9f/d3b/d3c/d3f/f12a x:0 0 0 2024-02-19T19:08:42.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/867: creat d5/d21/d9a/dd0/d80/daf/f12b x:0 0 0 2024-02-19T19:08:42.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/868: chown d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d75/fbc 1348 1 2024-02-19T19:08:42.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/869: stat d5/d13/c24 0 2024-02-19T19:08:42.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/870: read - d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d87/fb9 zero size 2024-02-19T19:08:42.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/871: chown d5/d2f/d9f/d3b/d4e/l4a 48407056 1 2024-02-19T19:08:42.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/872: truncate d5/d2f/d9f/d3b/d3c/d3f/f43 4447638 0 2024-02-19T19:08:42.101 INFO:tasks.workunit.client.0.smithi046.stdout:1/873: creat d5/d21/d9a/dd0/d80/daf/db5/d10f/f12c x:0 0 0 2024-02-19T19:08:42.102 INFO:tasks.workunit.client.0.smithi046.stdout:1/874: mknod d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/dce/dfc/c12d 0 2024-02-19T19:08:42.103 INFO:tasks.workunit.client.0.smithi046.stdout:1/875: mknod d5/d21/d9a/dd0/d129/c12e 0 2024-02-19T19:08:42.103 INFO:tasks.workunit.client.0.smithi046.stdout:1/876: fsync d5/d21/fc2 0 2024-02-19T19:08:42.105 INFO:tasks.workunit.client.0.smithi046.stdout:1/877: rename d5/d2f/d9f/d3b/lf6 to d5/d2f/d9f/d3b/d4e/d91/d122/d37/l12f 0 2024-02-19T19:08:42.106 INFO:tasks.workunit.client.0.smithi046.stdout:1/878: link d5/d13/l60 d5/d21/d9a/df3/l130 0 2024-02-19T19:08:42.106 INFO:tasks.workunit.client.0.smithi046.stdout:1/879: fsync d5/d2f/d9f/d3b/d4e/fd4 0 2024-02-19T19:08:42.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/880: dwrite d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d87/fcd [0,4194304] 0 2024-02-19T19:08:42.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/881: readlink d5/d2f/d9f/d3b/d4e/d91/d122/d37/l58 0 2024-02-19T19:08:42.133 INFO:tasks.workunit.client.0.smithi046.stdout:1/882: dread d5/d21/f34 [4194304,4194304] 0 2024-02-19T19:08:42.133 INFO:tasks.workunit.client.0.smithi046.stdout:1/883: creat d5/d2f/d9f/dc9/f131 x:0 0 0 2024-02-19T19:08:42.136 INFO:tasks.workunit.client.0.smithi046.stdout:1/884: unlink d5/d21/d9a/dd0/d80/daf/db5/dbe/c123 0 2024-02-19T19:08:42.138 INFO:tasks.workunit.client.0.smithi046.stdout:1/885: getdents d5/d2f/d9f/d3b/d3c 0 2024-02-19T19:08:42.139 INFO:tasks.workunit.client.0.smithi046.stdout:1/886: symlink d5/d21/d9a/dd0/d80/daf/db5/dd2/l132 0 2024-02-19T19:08:42.141 INFO:tasks.workunit.client.0.smithi046.stdout:1/887: dread d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d75/f77 [0,4194304] 0 2024-02-19T19:08:42.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:41 smithi142 ceph-mon[69118]: osdmap e83: 6 total, 6 up, 6 in 2024-02-19T19:08:42.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:41 smithi142 ceph-mon[69118]: osdmap e84: 6 total, 6 up, 6 in 2024-02-19T19:08:42.213 INFO:tasks.workunit.client.0.smithi046.stdout:1/888: dwrite d5/d21/faa [0,4194304] 0 2024-02-19T19:08:42.213 INFO:tasks.workunit.client.0.smithi046.stdout:1/889: readlink d5/d21/d9a/dd0/lf9 0 2024-02-19T19:08:42.214 INFO:tasks.workunit.client.0.smithi046.stdout:1/890: link d5/f17 d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/dce/dfc/f133 0 2024-02-19T19:08:42.215 INFO:tasks.workunit.client.0.smithi046.stdout:1/891: creat d5/d2f/d9f/d3b/d4e/d91/d122/d37/d121/f134 x:0 0 0 2024-02-19T19:08:42.215 INFO:tasks.workunit.client.0.smithi046.stdout:1/892: chown d5/d2f/d9f/dc9 731 1 2024-02-19T19:08:42.216 INFO:tasks.workunit.client.0.smithi046.stdout:1/893: creat d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d87/f135 x:0 0 0 2024-02-19T19:08:42.216 INFO:tasks.workunit.client.0.smithi046.stdout:1/894: readlink d5/d2f/d9f/d3b/d3c/l118 0 2024-02-19T19:08:42.217 INFO:tasks.workunit.client.0.smithi046.stdout:1/895: rmdir d5 39 2024-02-19T19:08:42.848 INFO:tasks.workunit.client.0.smithi046.stdout:7/891: dread d0/d45/d98/d116/db4/f104 [0,4194304] 0 2024-02-19T19:08:42.849 INFO:tasks.workunit.client.0.smithi046.stdout:4/894: dwrite d6/dd3/db3/f118 [0,4194304] 0 2024-02-19T19:08:42.851 INFO:tasks.workunit.client.0.smithi046.stdout:6/765: dwrite d4/d6/dd/d10/f8a [0,4194304] 0 2024-02-19T19:08:42.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/892: link d0/d45/d4a/d58/l31 d0/d45/l11b 0 2024-02-19T19:08:42.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/893: write d0/d45/d71/d41/d5f/fa4 [4178942,50666] 0 2024-02-19T19:08:42.855 INFO:tasks.workunit.client.0.smithi046.stdout:4/895: symlink d6/d11/dd6/l133 0 2024-02-19T19:08:42.860 INFO:tasks.workunit.client.0.smithi046.stdout:4/896: creat d6/d15/d17/f134 x:0 0 0 2024-02-19T19:08:42.861 INFO:tasks.workunit.client.0.smithi046.stdout:4/897: getdents d6/dd3 0 2024-02-19T19:08:42.865 INFO:tasks.workunit.client.0.smithi046.stdout:4/898: rename d6/d15/d17/d1e/c54 to d6/d11/dd6/d89/d8a/d55/d8e/c135 0 2024-02-19T19:08:42.865 INFO:tasks.workunit.client.0.smithi046.stdout:4/899: stat d6/d11/dd6/d89/d8a 0 2024-02-19T19:08:42.867 INFO:tasks.workunit.client.0.smithi046.stdout:4/900: readlink d6/d11/d92/lcd 0 2024-02-19T19:08:42.875 INFO:tasks.workunit.client.0.smithi046.stdout:0/951: sync 2024-02-19T19:08:42.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/766: dwrite d4/d6/d1c/d64/fa1 [0,4194304] 0 2024-02-19T19:08:42.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/767: chown d4/d6/d1c/d64/lac 82 1 2024-02-19T19:08:42.878 INFO:tasks.workunit.client.0.smithi046.stdout:0/952: unlink d0/d19/d8/d37/d85/cda 0 2024-02-19T19:08:42.878 INFO:tasks.workunit.client.0.smithi046.stdout:0/953: write d0/d24/f39 [17451,50175] 0 2024-02-19T19:08:42.879 INFO:tasks.workunit.client.0.smithi046.stdout:6/768: mkdir d4/d6/dd/d10/d29/d2d/dc0/df1 0 2024-02-19T19:08:42.882 INFO:tasks.workunit.client.0.smithi046.stdout:0/954: creat d0/d19/d88/f139 x:0 0 0 2024-02-19T19:08:42.882 INFO:tasks.workunit.client.0.smithi046.stdout:4/901: dread d6/dd3/db3/fb7 [0,4194304] 0 2024-02-19T19:08:42.884 INFO:tasks.workunit.client.0.smithi046.stdout:6/769: truncate d4/d6/dd/d10/d29/d2d/f47 462554 0 2024-02-19T19:08:42.886 INFO:tasks.workunit.client.0.smithi046.stdout:4/902: creat d6/d11/dd6/d89/d8a/f136 x:0 0 0 2024-02-19T19:08:42.886 INFO:tasks.workunit.client.0.smithi046.stdout:4/903: write d6/d11/d40/fe5 [402676,92960] 0 2024-02-19T19:08:42.887 INFO:tasks.workunit.client.0.smithi046.stdout:6/770: rmdir d4/d6/dd 39 2024-02-19T19:08:42.887 INFO:tasks.workunit.client.0.smithi046.stdout:6/771: write d4/d6/d1c/d20/f4d [241350,118920] 0 2024-02-19T19:08:42.888 INFO:tasks.workunit.client.0.smithi046.stdout:4/904: mknod d6/d11/dd6/d89/d8a/c137 0 2024-02-19T19:08:42.890 INFO:tasks.workunit.client.0.smithi046.stdout:6/772: link d4/d6/dd/d10/d29/d2d/d35/f3a d4/d6/dd/d10/d29/d2d/d35/da5/df0/ff2 0 2024-02-19T19:08:42.890 INFO:tasks.workunit.client.0.smithi046.stdout:6/773: fdatasync d4/d6/dd/f44 0 2024-02-19T19:08:42.890 INFO:tasks.workunit.client.0.smithi046.stdout:6/774: fdatasync d4/d6/dd/d10/d29/da2/fe1 0 2024-02-19T19:08:42.890 INFO:tasks.workunit.client.0.smithi046.stdout:6/775: stat d4/d6/d1c/d64/lac 0 2024-02-19T19:08:42.891 INFO:tasks.workunit.client.0.smithi046.stdout:0/955: dread d0/f18 [0,4194304] 0 2024-02-19T19:08:42.891 INFO:tasks.workunit.client.0.smithi046.stdout:0/956: read d0/d19/d88/d10b/f86 [920074,32505] 0 2024-02-19T19:08:42.893 INFO:tasks.workunit.client.0.smithi046.stdout:4/905: mknod d6/d94/dab/c138 0 2024-02-19T19:08:42.896 INFO:tasks.workunit.client.0.smithi046.stdout:4/906: dread d6/dd3/db3/fea [0,4194304] 0 2024-02-19T19:08:42.896 INFO:tasks.workunit.client.0.smithi046.stdout:4/907: chown d6/d11/dd6/d89/d8a/d8d 319582 1 2024-02-19T19:08:42.899 INFO:tasks.workunit.client.0.smithi046.stdout:4/908: unlink d6/d11/dd6/dc3/fc4 0 2024-02-19T19:08:42.901 INFO:tasks.workunit.client.0.smithi046.stdout:4/909: truncate d6/d15/d17/d1e/f7a 1452846 0 2024-02-19T19:08:42.901 INFO:tasks.workunit.client.0.smithi046.stdout:4/910: creat d6/d11/d40/da7/dd2/f139 x:0 0 0 2024-02-19T19:08:42.902 INFO:tasks.workunit.client.0.smithi046.stdout:4/911: chown d6/d11/d40/da7/l111 0 1 2024-02-19T19:08:42.904 INFO:tasks.workunit.client.0.smithi046.stdout:4/912: mknod d6/d11/d40/c13a 0 2024-02-19T19:08:42.906 INFO:tasks.workunit.client.0.smithi046.stdout:4/913: mkdir d6/d11/dd6/d89/d8a/d55/d13b 0 2024-02-19T19:08:42.907 INFO:tasks.workunit.client.0.smithi046.stdout:4/914: write d6/f42 [875944,120258] 0 2024-02-19T19:08:42.907 INFO:tasks.workunit.client.0.smithi046.stdout:4/915: stat d6/d15/d17/f78 0 2024-02-19T19:08:42.909 INFO:tasks.workunit.client.0.smithi046.stdout:4/916: creat d6/d11/d40/da7/dd2/d10d/f13c x:0 0 0 2024-02-19T19:08:42.909 INFO:tasks.workunit.client.0.smithi046.stdout:4/917: write d6/d15/d17/fe9 [362867,55836] 0 2024-02-19T19:08:42.909 INFO:tasks.workunit.client.0.smithi046.stdout:4/918: chown d6/d11/dd6/d89/d8a/f10f 508583 1 2024-02-19T19:08:42.911 INFO:tasks.workunit.client.0.smithi046.stdout:4/919: symlink d6/d11/d40/da7/d11f/l13d 0 2024-02-19T19:08:42.912 INFO:tasks.workunit.client.0.smithi046.stdout:6/776: dwrite d4/d6/d1c/d64/f9b [0,4194304] 0 2024-02-19T19:08:42.912 INFO:tasks.workunit.client.0.smithi046.stdout:6/777: read - d4/d6/d1c/d20/fdb zero size 2024-02-19T19:08:42.912 INFO:tasks.workunit.client.0.smithi046.stdout:6/778: truncate d4/d6/dd/d10/f8a 4650277 0 2024-02-19T19:08:42.912 INFO:tasks.workunit.client.0.smithi046.stdout:6/779: fsync d4/d6/d1c/f51 0 2024-02-19T19:08:42.914 INFO:tasks.workunit.client.0.smithi046.stdout:4/920: rename d6/d11/f64 to d6/d15/f13e 0 2024-02-19T19:08:42.914 INFO:tasks.workunit.client.0.smithi046.stdout:4/921: chown d6/d11/d40/fad 182 1 2024-02-19T19:08:42.914 INFO:tasks.workunit.client.0.smithi046.stdout:4/922: write d6/d11/dd6/d89/faa [4764058,18694] 0 2024-02-19T19:08:42.917 INFO:tasks.workunit.client.0.smithi046.stdout:6/780: truncate d4/d6/dd/d10/d29/f36 141038 0 2024-02-19T19:08:42.919 INFO:tasks.workunit.client.0.smithi046.stdout:4/923: mknod d6/d94/dab/c13f 0 2024-02-19T19:08:42.922 INFO:tasks.workunit.client.0.smithi046.stdout:6/781: mknod d4/d6/dd/d10/d29/d2d/d35/da5/df0/cf3 0 2024-02-19T19:08:42.926 INFO:tasks.workunit.client.0.smithi046.stdout:6/782: link d4/d6/dd/d10/d29/da2/fa8 d4/d6/d1c/d20/ff4 0 2024-02-19T19:08:42.929 INFO:tasks.workunit.client.0.smithi046.stdout:4/924: unlink d6/d11/d92/d102/c70 0 2024-02-19T19:08:42.931 INFO:tasks.workunit.client.0.smithi046.stdout:6/783: rename d4/d6/dd/d10/d29/d2d/d35/fba to d4/d6/d1c/ff5 0 2024-02-19T19:08:42.932 INFO:tasks.workunit.client.0.smithi046.stdout:6/784: chown d4/d6/d1c/d60 7 1 2024-02-19T19:08:42.934 INFO:tasks.workunit.client.0.smithi046.stdout:6/785: unlink d4/f43 0 2024-02-19T19:08:42.936 INFO:tasks.workunit.client.0.smithi046.stdout:6/786: symlink d4/d6/d1c/d94/lf6 0 2024-02-19T19:08:42.946 INFO:tasks.workunit.client.0.smithi046.stdout:6/787: dread d4/f6a [0,4194304] 0 2024-02-19T19:08:42.946 INFO:tasks.workunit.client.0.smithi046.stdout:6/788: chown d4/d6/d1c/d20/dc5/fea 102501 1 2024-02-19T19:08:42.947 INFO:tasks.workunit.client.0.smithi046.stdout:6/789: write d4/d6/dd/d10/d29/d2d/dc0/fe7 [527155,48437] 0 2024-02-19T19:08:42.947 INFO:tasks.workunit.client.0.smithi046.stdout:6/790: read d4/d6/dd/d10/d29/d2d/f7f [3246194,51767] 0 2024-02-19T19:08:42.954 INFO:tasks.workunit.client.0.smithi046.stdout:4/925: dwrite d6/d11/d92/f9c [0,4194304] 0 2024-02-19T19:08:42.958 INFO:tasks.workunit.client.0.smithi046.stdout:4/926: link d6/d11/dd6/d89/d8a/d55/f5d d6/d11/d40/da7/dd2/f140 0 2024-02-19T19:08:42.963 INFO:tasks.workunit.client.0.smithi046.stdout:6/791: getdents d4/d6/dd/d10/d29/d2d/d35/da5/df0 0 2024-02-19T19:08:42.963 INFO:tasks.workunit.client.0.smithi046.stdout:6/792: readlink d4/d6/le2 0 2024-02-19T19:08:42.971 INFO:tasks.workunit.client.0.smithi046.stdout:4/927: mkdir d6/d11/d40/da7/dd2/dd4/d141 0 2024-02-19T19:08:42.971 INFO:tasks.workunit.client.0.smithi046.stdout:4/928: write d6/d11/dd6/d89/d8a/d55/f10b [500286,73882] 0 2024-02-19T19:08:42.974 INFO:tasks.workunit.client.0.smithi046.stdout:6/793: symlink d4/d6/d1c/d20/dc5/lf7 0 2024-02-19T19:08:42.976 INFO:tasks.workunit.client.0.smithi046.stdout:6/794: rename d4/d6/d1c/d20/de8 to d4/d6/dd/d10/d29/d2d/d35/d3c/df8 0 2024-02-19T19:08:42.978 INFO:tasks.workunit.client.0.smithi046.stdout:6/795: mkdir d4/d6/dd/d10/d29/d2d/dc0/df9 0 2024-02-19T19:08:42.979 INFO:tasks.workunit.client.0.smithi046.stdout:9/630: sync 2024-02-19T19:08:42.979 INFO:tasks.workunit.client.0.smithi046.stdout:3/621: sync 2024-02-19T19:08:42.979 INFO:tasks.workunit.client.0.smithi046.stdout:1/896: sync 2024-02-19T19:08:42.979 INFO:tasks.workunit.client.0.smithi046.stdout:5/772: sync 2024-02-19T19:08:42.979 INFO:tasks.workunit.client.0.smithi046.stdout:5/773: getdents d2/dd/d26/da9/dbf/dd7/ddc 0 2024-02-19T19:08:42.979 INFO:tasks.workunit.client.0.smithi046.stdout:5/774: chown d2/dd/d29/d89/dca 50662 1 2024-02-19T19:08:42.979 INFO:tasks.workunit.client.0.smithi046.stdout:5/775: creat d2/d5e/ff1 x:0 0 0 2024-02-19T19:08:42.980 INFO:tasks.workunit.client.0.smithi046.stdout:9/631: mkdir db/d20/d6b/dbf 0 2024-02-19T19:08:42.980 INFO:tasks.workunit.client.0.smithi046.stdout:9/632: chown db/d82/c8e 1036 1 2024-02-19T19:08:42.980 INFO:tasks.workunit.client.0.smithi046.stdout:9/633: creat db/d1e/d32/d7c/fc0 x:0 0 0 2024-02-19T19:08:42.982 INFO:tasks.workunit.client.0.smithi046.stdout:5/776: creat d2/dd/d29/d89/dca/ff2 x:0 0 0 2024-02-19T19:08:42.986 INFO:tasks.workunit.client.0.smithi046.stdout:9/634: getdents db/d1e/d52 0 2024-02-19T19:08:42.987 INFO:tasks.workunit.client.0.smithi046.stdout:6/796: dread d4/d6/dd/d10/d29/d2d/d35/f4f [0,4194304] 0 2024-02-19T19:08:42.993 INFO:tasks.workunit.client.0.smithi046.stdout:3/622: dread da/d30/d38/f56 [0,4194304] 0 2024-02-19T19:08:43.002 INFO:tasks.workunit.client.0.smithi046.stdout:3/623: write da/d1d/d63/d64/f7b [7815840,53413] 0 2024-02-19T19:08:43.002 INFO:tasks.workunit.client.0.smithi046.stdout:3/624: fsync da/d1d/d10/f9c 0 2024-02-19T19:08:43.003 INFO:tasks.workunit.client.0.smithi046.stdout:5/777: dwrite d2/dd/d26/da9/fc1 [0,4194304] 0 2024-02-19T19:08:43.003 INFO:tasks.workunit.client.0.smithi046.stdout:5/778: write d2/dd/d26/d65/fd3 [989718,5676] 0 2024-02-19T19:08:43.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/625: mkdir da/d30/d38/d54/db2 0 2024-02-19T19:08:43.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/779: mkdir d2/dd/d26/da9/dbf/dd7/df3 0 2024-02-19T19:08:43.006 INFO:tasks.workunit.client.0.smithi046.stdout:5/780: read - d2/dd/d26/daa/fb5 zero size 2024-02-19T19:08:43.006 INFO:tasks.workunit.client.0.smithi046.stdout:5/781: stat d2/d27/d47/d54/d57/l9d 0 2024-02-19T19:08:43.006 INFO:tasks.workunit.client.0.smithi046.stdout:5/782: truncate d2/d27/d47/d54/d57/fcc 843784 0 2024-02-19T19:08:43.006 INFO:tasks.workunit.client.0.smithi046.stdout:3/626: creat da/d1d/d3f/d8d/fb3 x:0 0 0 2024-02-19T19:08:43.006 INFO:tasks.workunit.client.0.smithi046.stdout:3/627: truncate da/d1d/f96 125769 0 2024-02-19T19:08:43.007 INFO:tasks.workunit.client.0.smithi046.stdout:5/783: rename d2/f4a to d2/dd/d26/ff4 0 2024-02-19T19:08:43.007 INFO:tasks.workunit.client.0.smithi046.stdout:5/784: fsync d2/dd/d3f/fda 0 2024-02-19T19:08:43.007 INFO:tasks.workunit.client.0.smithi046.stdout:5/785: creat d2/dd/d29/d89/ff5 x:0 0 0 2024-02-19T19:08:43.007 INFO:tasks.workunit.client.0.smithi046.stdout:5/786: readlink d2/dd/d26/da9/dbf/le7 0 2024-02-19T19:08:43.008 INFO:tasks.workunit.client.0.smithi046.stdout:3/628: mknod da/d1d/d10/cb4 0 2024-02-19T19:08:43.008 INFO:tasks.workunit.client.0.smithi046.stdout:3/629: creat da/d1d/d8e/fb5 x:0 0 0 2024-02-19T19:08:43.010 INFO:tasks.workunit.client.0.smithi046.stdout:3/630: mknod da/d1d/d63/d64/d74/cb6 0 2024-02-19T19:08:43.010 INFO:tasks.workunit.client.0.smithi046.stdout:3/631: chown da/d30/d38/d66/f69 2 1 2024-02-19T19:08:43.010 INFO:tasks.workunit.client.0.smithi046.stdout:3/632: truncate da/d1d/d63/d92/f98 999447 0 2024-02-19T19:08:43.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/929: dwrite d6/d15/d17/d1e/f7a [0,4194304] 0 2024-02-19T19:08:43.020 INFO:tasks.workunit.client.0.smithi046.stdout:4/930: rename d6/d11/c9a to d6/d11/d40/da7/dd2/d10d/c142 0 2024-02-19T19:08:43.021 INFO:tasks.workunit.client.0.smithi046.stdout:4/931: mkdir d6/d11/dd6/d89/d8a/d8d/d143 0 2024-02-19T19:08:43.021 INFO:tasks.workunit.client.0.smithi046.stdout:4/932: write d6/d11/dd6/d89/d8a/d55/f86 [290547,69729] 0 2024-02-19T19:08:43.021 INFO:tasks.workunit.client.0.smithi046.stdout:4/933: truncate d6/d50/fe1 168067 0 2024-02-19T19:08:43.024 INFO:tasks.workunit.client.0.smithi046.stdout:3/633: write da/d1d/d10/f1e [1071592,115782] 0 2024-02-19T19:08:43.024 INFO:tasks.workunit.client.0.smithi046.stdout:3/634: chown da/d1d/d63/d64 243375 1 2024-02-19T19:08:43.024 INFO:tasks.workunit.client.0.smithi046.stdout:4/934: rmdir d6/d94/df4/de7 39 2024-02-19T19:08:43.024 INFO:tasks.workunit.client.0.smithi046.stdout:4/935: creat d6/d11/dd6/d89/d8a/f144 x:0 0 0 2024-02-19T19:08:43.024 INFO:tasks.workunit.client.0.smithi046.stdout:4/936: dread - d6/d94/df4/f104 zero size 2024-02-19T19:08:43.024 INFO:tasks.workunit.client.0.smithi046.stdout:3/635: truncate da/d30/d38/d93/fa0 623298 0 2024-02-19T19:08:43.026 INFO:tasks.workunit.client.0.smithi046.stdout:4/937: mknod d6/d11/d92/d102/c145 0 2024-02-19T19:08:43.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/636: rename da/d30/d38/c86 to da/d1d/d63/d64/d74/cb7 0 2024-02-19T19:08:43.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/637: mknod da/d1d/d63/cb8 0 2024-02-19T19:08:43.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/938: symlink d6/d11/l146 0 2024-02-19T19:08:43.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/939: write d6/dd3/db3/f123 [850724,21244] 0 2024-02-19T19:08:43.030 INFO:tasks.workunit.client.0.smithi046.stdout:4/940: link d6/d11/dd6/d89/d8a/deb/f112 d6/d15/d17/f147 0 2024-02-19T19:08:43.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/941: symlink d6/d11/dd6/l148 0 2024-02-19T19:08:43.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/942: fdatasync d6/d11/dd6/f60 0 2024-02-19T19:08:43.032 INFO:tasks.workunit.client.0.smithi046.stdout:5/787: dwrite d2/dd/d29/fb9 [4194304,4194304] 0 2024-02-19T19:08:43.032 INFO:tasks.workunit.client.0.smithi046.stdout:5/788: chown d2/d27/d47/d54/d57/fbd 85 1 2024-02-19T19:08:43.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/943: mknod d6/d11/dd6/d89/d8a/c149 0 2024-02-19T19:08:43.033 INFO:tasks.workunit.client.0.smithi046.stdout:5/789: mkdir d2/dd/d26/da9/dbf/dd7/df3/df6 0 2024-02-19T19:08:43.033 INFO:tasks.workunit.client.0.smithi046.stdout:5/790: creat d2/dd/d29/d3b/ff7 x:0 0 0 2024-02-19T19:08:43.033 INFO:tasks.workunit.client.0.smithi046.stdout:5/791: dread - d2/d5e/ff1 zero size 2024-02-19T19:08:43.051 INFO:tasks.workunit.client.0.smithi046.stdout:3/638: dwrite da/d1d/d63/d64/f7b [0,4194304] 0 2024-02-19T19:08:43.053 INFO:tasks.workunit.client.0.smithi046.stdout:3/639: creat da/d8a/fb9 x:0 0 0 2024-02-19T19:08:43.055 INFO:tasks.workunit.client.0.smithi046.stdout:4/944: dwrite d6/f1a [0,4194304] 0 2024-02-19T19:08:43.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/945: dwrite d6/d11/dd6/d89/d8a/d55/d8e/fda [0,4194304] 0 2024-02-19T19:08:43.075 INFO:tasks.workunit.client.0.smithi046.stdout:3/640: dwrite da/d1d/d8e/fb5 [0,4194304] 0 2024-02-19T19:08:43.075 INFO:tasks.workunit.client.0.smithi046.stdout:4/946: stat d6/d11/dd6/l129 0 2024-02-19T19:08:43.075 INFO:tasks.workunit.client.0.smithi046.stdout:4/947: readlink d6/d11/dd6/l148 0 2024-02-19T19:08:43.077 INFO:tasks.workunit.client.0.smithi046.stdout:4/948: mknod d6/d94/df4/de7/c14a 0 2024-02-19T19:08:43.079 INFO:tasks.workunit.client.0.smithi046.stdout:4/949: creat d6/d15/d17/d1e/d25/f14b x:0 0 0 2024-02-19T19:08:43.079 INFO:tasks.workunit.client.0.smithi046.stdout:4/950: fsync d6/d11/dd6/d89/d8a/f144 0 2024-02-19T19:08:43.079 INFO:tasks.workunit.client.0.smithi046.stdout:4/951: chown d6/d15/d17 265845 1 2024-02-19T19:08:43.081 INFO:tasks.workunit.client.0.smithi046.stdout:3/641: rmdir da/d8a 39 2024-02-19T19:08:43.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:42 smithi046 ceph-mon[88928]: pgmap v134: 65 pgs: 1 active+undersized+remapped, 14 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+degraded, 49 active+clean; 1.9 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 82 MiB/s rd, 108 MiB/s wr, 437 op/s; 5007/40293 objects degraded (12.426%); 13 MiB/s, 89 objects/s recovering 2024-02-19T19:08:43.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:43.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:43.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:42 smithi046 ceph-mon[88928]: osdmap e85: 6 total, 6 up, 6 in 2024-02-19T19:08:43.082 INFO:tasks.workunit.client.0.smithi046.stdout:3/642: mknod da/d30/cba 0 2024-02-19T19:08:43.083 INFO:tasks.workunit.client.0.smithi046.stdout:3/643: getdents da/d1d/d3f/d8d 0 2024-02-19T19:08:43.094 INFO:tasks.workunit.client.0.smithi046.stdout:3/644: write da/f2c [463127,23772] 0 2024-02-19T19:08:43.095 INFO:tasks.workunit.client.0.smithi046.stdout:3/645: rmdir da/d30/d38/d54 39 2024-02-19T19:08:43.095 INFO:tasks.workunit.client.0.smithi046.stdout:3/646: creat da/d1d/d63/d92/fbb x:0 0 0 2024-02-19T19:08:43.095 INFO:tasks.workunit.client.0.smithi046.stdout:4/952: dwrite d6/d11/dd6/dc3/fd1 [0,4194304] 0 2024-02-19T19:08:43.096 INFO:tasks.workunit.client.0.smithi046.stdout:4/953: stat d6/d11/d40/da7/cff 0 2024-02-19T19:08:43.097 INFO:tasks.workunit.client.0.smithi046.stdout:3/647: rename da/d1d/l6b to da/d1d/d63/d64/d74/lbc 0 2024-02-19T19:08:43.097 INFO:tasks.workunit.client.0.smithi046.stdout:3/648: getdents da/d30/d38/d54/db2 0 2024-02-19T19:08:43.097 INFO:tasks.workunit.client.0.smithi046.stdout:3/649: chown da/d1d/d63/d64 4561 1 2024-02-19T19:08:43.098 INFO:tasks.workunit.client.0.smithi046.stdout:4/954: truncate d6/d11/dd6/d89/d8a/d55/fa3 294369 0 2024-02-19T19:08:43.116 INFO:tasks.workunit.client.0.smithi046.stdout:3/650: dwrite da/d1d/d10/f5e [0,4194304] 0 2024-02-19T19:08:43.121 INFO:tasks.workunit.client.0.smithi046.stdout:4/955: dwrite d6/d11/dd6/d89/d8a/d55/d8e/fda [4194304,4194304] 0 2024-02-19T19:08:43.129 INFO:tasks.workunit.client.0.smithi046.stdout:4/956: dread d6/d11/dd6/f2e [4194304,4194304] 0 2024-02-19T19:08:43.129 INFO:tasks.workunit.client.0.smithi046.stdout:4/957: fsync d6/d11/dd6/f74 0 2024-02-19T19:08:43.129 INFO:tasks.workunit.client.0.smithi046.stdout:4/958: symlink d6/d50/dde/l14c 0 2024-02-19T19:08:43.130 INFO:tasks.workunit.client.0.smithi046.stdout:3/651: dwrite da/d30/d38/f3d [0,4194304] 0 2024-02-19T19:08:43.132 INFO:tasks.workunit.client.0.smithi046.stdout:4/959: unlink d6/d11/dd6/d89/d8a/d8d/fb5 0 2024-02-19T19:08:43.132 INFO:tasks.workunit.client.0.smithi046.stdout:4/960: read d6/d15/d17/d1e/d25/fd5 [4875857,39855] 0 2024-02-19T19:08:43.134 INFO:tasks.workunit.client.0.smithi046.stdout:3/652: getdents da/d1d/d63/d64 0 2024-02-19T19:08:43.135 INFO:tasks.workunit.client.0.smithi046.stdout:4/961: mkdir d6/d94/dab/de3/d14d 0 2024-02-19T19:08:43.135 INFO:tasks.workunit.client.0.smithi046.stdout:4/962: write d6/d15/d17/f41 [767682,65560] 0 2024-02-19T19:08:43.136 INFO:tasks.workunit.client.0.smithi046.stdout:3/653: creat da/d8a/fbd x:0 0 0 2024-02-19T19:08:43.136 INFO:tasks.workunit.client.0.smithi046.stdout:4/963: symlink d6/d50/dde/l14e 0 2024-02-19T19:08:43.138 INFO:tasks.workunit.client.0.smithi046.stdout:3/654: mkdir da/dbe 0 2024-02-19T19:08:43.138 INFO:tasks.workunit.client.0.smithi046.stdout:3/655: dread - da/d1d/d8e/fa9 zero size 2024-02-19T19:08:43.138 INFO:tasks.workunit.client.0.smithi046.stdout:3/656: fdatasync da/d1d/d8e/f91 0 2024-02-19T19:08:43.138 INFO:tasks.workunit.client.0.smithi046.stdout:3/657: write da/d1d/d8e/fa9 [405125,5967] 0 2024-02-19T19:08:43.138 INFO:tasks.workunit.client.0.smithi046.stdout:4/964: link d6/d11/dd6/d89/d8a/d55/f86 d6/d11/dd6/d89/d8a/d55/d13b/f14f 0 2024-02-19T19:08:43.140 INFO:tasks.workunit.client.0.smithi046.stdout:3/658: unlink da/c4b 0 2024-02-19T19:08:43.140 INFO:tasks.workunit.client.0.smithi046.stdout:3/659: symlink da/d1d/d3f/d8d/lbf 0 2024-02-19T19:08:43.141 INFO:tasks.workunit.client.0.smithi046.stdout:3/660: mknod da/d1d/d8e/cc0 0 2024-02-19T19:08:43.141 INFO:tasks.workunit.client.0.smithi046.stdout:3/661: read - da/d1d/d8e/f91 zero size 2024-02-19T19:08:43.141 INFO:tasks.workunit.client.0.smithi046.stdout:3/662: fsync da/d1d/d8e/f97 0 2024-02-19T19:08:43.142 INFO:tasks.workunit.client.0.smithi046.stdout:3/663: fsync da/d1d/fb0 0 2024-02-19T19:08:43.142 INFO:tasks.workunit.client.0.smithi046.stdout:3/664: creat da/d1d/d82/d90/fc1 x:0 0 0 2024-02-19T19:08:43.143 INFO:tasks.workunit.client.0.smithi046.stdout:3/665: getdents da/d1d/d82 0 2024-02-19T19:08:43.145 INFO:tasks.workunit.client.0.smithi046.stdout:3/666: link da/d1d/laa da/dbe/lc2 0 2024-02-19T19:08:43.147 INFO:tasks.workunit.client.0.smithi046.stdout:4/965: write d6/d15/d17/f78 [8072995,57377] 0 2024-02-19T19:08:43.148 INFO:tasks.workunit.client.0.smithi046.stdout:4/966: creat d6/d15/d17/d1e/d126/f150 x:0 0 0 2024-02-19T19:08:43.149 INFO:tasks.workunit.client.0.smithi046.stdout:4/967: truncate d6/d15/d17/f3f 1919555 0 2024-02-19T19:08:43.150 INFO:tasks.workunit.client.0.smithi046.stdout:4/968: getdents d6/d11 0 2024-02-19T19:08:43.150 INFO:tasks.workunit.client.0.smithi046.stdout:4/969: truncate d6/d11/d40/da7/dd2/f12c 814730 0 2024-02-19T19:08:43.152 INFO:tasks.workunit.client.0.smithi046.stdout:4/970: rename d6/d15/d17/d1e/f6d to d6/d15/d17/d1e/f151 0 2024-02-19T19:08:43.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/667: write da/d30/d38/f3d [2321065,53459] 0 2024-02-19T19:08:43.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/668: write da/fa6 [978160,103893] 0 2024-02-19T19:08:43.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/669: truncate da/d1d/d63/d92/fbb 64391 0 2024-02-19T19:08:43.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/670: creat da/fc3 x:0 0 0 2024-02-19T19:08:43.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/671: read - da/d1d/d3f/d8d/fb3 zero size 2024-02-19T19:08:43.165 INFO:tasks.workunit.client.0.smithi046.stdout:4/971: dwrite d6/d94/df4/f104 [0,4194304] 0 2024-02-19T19:08:43.173 INFO:tasks.workunit.client.0.smithi046.stdout:4/972: dread d6/d11/d40/da7/dd2/f140 [0,4194304] 0 2024-02-19T19:08:43.173 INFO:tasks.workunit.client.0.smithi046.stdout:4/973: mkdir d6/d11/d40/da7/dd2/d152 0 2024-02-19T19:08:43.174 INFO:tasks.workunit.client.0.smithi046.stdout:4/974: unlink d6/d15/d17/d1e/fd8 0 2024-02-19T19:08:43.180 INFO:tasks.workunit.client.0.smithi046.stdout:4/975: dread d6/f49 [0,4194304] 0 2024-02-19T19:08:43.181 INFO:tasks.workunit.client.0.smithi046.stdout:4/976: getdents d6/d11/d40/da7/dd2/d10d 0 2024-02-19T19:08:43.182 INFO:tasks.workunit.client.0.smithi046.stdout:4/977: rmdir d6/d15/d17/d1e/d126 39 2024-02-19T19:08:43.182 INFO:tasks.workunit.client.0.smithi046.stdout:4/978: fsync d6/d11/d40/fe5 0 2024-02-19T19:08:43.184 INFO:tasks.workunit.client.0.smithi046.stdout:4/979: rename d6/d11/dd6/l129 to d6/d94/df4/l153 0 2024-02-19T19:08:43.184 INFO:tasks.workunit.client.0.smithi046.stdout:4/980: chown d6/d11/f66 2033322748 1 2024-02-19T19:08:43.184 INFO:tasks.workunit.client.0.smithi046.stdout:4/981: write d6/d15/f77 [1785441,87663] 0 2024-02-19T19:08:43.185 INFO:tasks.workunit.client.0.smithi046.stdout:4/982: creat d6/d94/df4/de7/f154 x:0 0 0 2024-02-19T19:08:43.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/983: mknod d6/d15/d17/d1e/d25/c155 0 2024-02-19T19:08:43.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/984: write d6/d15/d17/fe9 [574227,16249] 0 2024-02-19T19:08:43.187 INFO:tasks.workunit.client.0.smithi046.stdout:4/985: mkdir d6/d94/d156 0 2024-02-19T19:08:43.187 INFO:tasks.workunit.client.0.smithi046.stdout:4/986: creat d6/d11/d40/da7/f157 x:0 0 0 2024-02-19T19:08:43.187 INFO:tasks.workunit.client.0.smithi046.stdout:4/987: write d6/d11/dd6/d89/f91 [2615282,119440] 0 2024-02-19T19:08:43.190 INFO:tasks.workunit.client.0.smithi046.stdout:4/988: unlink d6/d11/d92/cb0 0 2024-02-19T19:08:43.190 INFO:tasks.workunit.client.0.smithi046.stdout:4/989: fsync d6/f97 0 2024-02-19T19:08:43.190 INFO:tasks.workunit.client.0.smithi046.stdout:4/990: write d6/d11/dd6/d89/d8a/d55/f5d [1336328,110274] 0 2024-02-19T19:08:43.190 INFO:tasks.workunit.client.0.smithi046.stdout:4/991: chown d6/d94/dab/c13f 10153250 1 2024-02-19T19:08:43.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:42 smithi142 ceph-mon[69118]: pgmap v134: 65 pgs: 1 active+undersized+remapped, 14 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+degraded, 49 active+clean; 1.9 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 82 MiB/s rd, 108 MiB/s wr, 437 op/s; 5007/40293 objects degraded (12.426%); 13 MiB/s, 89 objects/s recovering 2024-02-19T19:08:43.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:43.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:43.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:42 smithi142 ceph-mon[69118]: osdmap e85: 6 total, 6 up, 6 in 2024-02-19T19:08:43.544 INFO:tasks.workunit.client.0.smithi046.stdout:0/957: sync 2024-02-19T19:08:43.546 INFO:tasks.workunit.client.0.smithi046.stdout:0/958: rename d0/d6c/dc4 to d0/d24/d56/d13a 0 2024-02-19T19:08:43.547 INFO:tasks.workunit.client.0.smithi046.stdout:0/959: rename d0/d19/d4d/fb2 to d0/d19/db/f13b 0 2024-02-19T19:08:43.548 INFO:tasks.workunit.client.0.smithi046.stdout:0/960: symlink d0/d19/db/df0/l13c 0 2024-02-19T19:08:43.549 INFO:tasks.workunit.client.0.smithi046.stdout:0/961: mknod d0/d24/d8c/c13d 0 2024-02-19T19:08:43.549 INFO:tasks.workunit.client.0.smithi046.stdout:0/962: read - d0/d19/d88/f139 zero size 2024-02-19T19:08:43.554 INFO:tasks.workunit.client.0.smithi046.stdout:0/963: write d0/d6c/fb5 [1409627,59182] 0 2024-02-19T19:08:43.559 INFO:tasks.workunit.client.0.smithi046.stdout:0/964: rename d0/d24/d2f/d53/d6b to d0/d19/d8/d92/d13e 0 2024-02-19T19:08:43.568 INFO:tasks.workunit.client.0.smithi046.stdout:0/965: write d0/d19/f3a [1657242,89444] 0 2024-02-19T19:08:43.570 INFO:tasks.workunit.client.0.smithi046.stdout:0/966: unlink d0/d19/d8/d37/dd9/df1/ff9 0 2024-02-19T19:08:43.570 INFO:tasks.workunit.client.0.smithi046.stdout:0/967: symlink d0/d19/db/d6a/l13f 0 2024-02-19T19:08:43.571 INFO:tasks.workunit.client.0.smithi046.stdout:0/968: creat d0/dd2/f140 x:0 0 0 2024-02-19T19:08:43.572 INFO:tasks.workunit.client.0.smithi046.stdout:0/969: getdents d0/d5f 0 2024-02-19T19:08:43.585 INFO:tasks.workunit.client.0.smithi046.stdout:0/970: dwrite d0/d19/d8/d37/d58/fa4 [0,4194304] 0 2024-02-19T19:08:43.585 INFO:tasks.workunit.client.0.smithi046.stdout:0/971: readlink d0/d19/db/d6a/l10d 0 2024-02-19T19:08:43.592 INFO:tasks.workunit.client.0.smithi046.stdout:0/972: dread d0/d24/d5b/d7f/dfc/d114/f12d [0,4194304] 0 2024-02-19T19:08:43.592 INFO:tasks.workunit.client.0.smithi046.stdout:0/973: stat d0/d19/d8/d37/d58/f63 0 2024-02-19T19:08:43.592 INFO:tasks.workunit.client.0.smithi046.stdout:0/974: fdatasync d0/d19/d88/d10b/f86 0 2024-02-19T19:08:43.592 INFO:tasks.workunit.client.0.smithi046.stdout:0/975: fdatasync d0/d19/d8/d37/d40/da6/fb6 0 2024-02-19T19:08:43.593 INFO:tasks.workunit.client.0.smithi046.stdout:0/976: read d0/f18 [1222115,9285] 0 2024-02-19T19:08:43.594 INFO:tasks.workunit.client.0.smithi046.stdout:0/977: link d0/d24/f39 d0/d19/d8/d37/d40/f141 0 2024-02-19T19:08:43.594 INFO:tasks.workunit.client.0.smithi046.stdout:0/978: chown d0/f1b 66555992 1 2024-02-19T19:08:43.608 INFO:tasks.workunit.client.0.smithi046.stdout:0/979: dwrite d0/d19/d8/d37/d85/f117 [0,4194304] 0 2024-02-19T19:08:43.617 INFO:tasks.workunit.client.0.smithi046.stdout:0/980: write d0/d19/db/de7/f112 [2558880,116585] 0 2024-02-19T19:08:43.618 INFO:tasks.workunit.client.0.smithi046.stdout:0/981: chown d0/d19/d8/dc5 7 1 2024-02-19T19:08:43.618 INFO:tasks.workunit.client.0.smithi046.stdout:0/982: read d0/d24/f4b [211580,91618] 0 2024-02-19T19:08:43.618 INFO:tasks.workunit.client.0.smithi046.stdout:0/983: fdatasync d0/d19/d8/dc5/fc7 0 2024-02-19T19:08:43.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/984: mkdir d0/d19/d4d/da5/da7/d142 0 2024-02-19T19:08:43.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/985: write d0/d19/d8/d37/d58/fe2 [1863221,115143] 0 2024-02-19T19:08:43.646 INFO:tasks.workunit.client.0.smithi046.stdout:0/986: dwrite d0/d24/f39 [0,4194304] 0 2024-02-19T19:08:43.647 INFO:tasks.workunit.client.0.smithi046.stdout:0/987: truncate d0/d24/d2f/d53/f9f 270617 0 2024-02-19T19:08:43.649 INFO:tasks.workunit.client.0.smithi046.stdout:0/988: truncate d0/d24/d56/da1/f28 1015450 0 2024-02-19T19:08:43.664 INFO:tasks.workunit.client.0.smithi046.stdout:6/797: sync 2024-02-19T19:08:43.664 INFO:tasks.workunit.client.0.smithi046.stdout:4/992: sync 2024-02-19T19:08:43.664 INFO:tasks.workunit.client.0.smithi046.stdout:5/792: sync 2024-02-19T19:08:43.664 INFO:tasks.workunit.client.0.smithi046.stdout:9/635: sync 2024-02-19T19:08:43.664 INFO:tasks.workunit.client.0.smithi046.stdout:6/798: readlink d4/d6/d1c/d20/l32 0 2024-02-19T19:08:43.665 INFO:tasks.workunit.client.0.smithi046.stdout:3/672: sync 2024-02-19T19:08:43.665 INFO:tasks.workunit.client.0.smithi046.stdout:5/793: truncate d2/dd/f5c 377949 0 2024-02-19T19:08:43.665 INFO:tasks.workunit.client.0.smithi046.stdout:5/794: write d2/dd/d3f/f7b [959554,129167] 0 2024-02-19T19:08:43.665 INFO:tasks.workunit.client.0.smithi046.stdout:5/795: chown d2/dd/d26/d65/d5f/cd1 1412212 1 2024-02-19T19:08:43.666 INFO:tasks.workunit.client.0.smithi046.stdout:6/799: getdents d4/d6/dd 0 2024-02-19T19:08:43.667 INFO:tasks.workunit.client.0.smithi046.stdout:6/800: chown d4/d6/fa3 114 1 2024-02-19T19:08:43.667 INFO:tasks.workunit.client.0.smithi046.stdout:6/801: fsync d4/d6/dd/d10/d29/d2d/d35/f79 0 2024-02-19T19:08:43.667 INFO:tasks.workunit.client.0.smithi046.stdout:6/802: truncate d4/d6/dd/d10/d29/fa9 886519 0 2024-02-19T19:08:43.668 INFO:tasks.workunit.client.0.smithi046.stdout:9/636: link db/d1e/d52/c62 db/d1e/d32/d47/d5b/d94/cc1 0 2024-02-19T19:08:43.668 INFO:tasks.workunit.client.0.smithi046.stdout:9/637: stat db/f4b 0 2024-02-19T19:08:43.668 INFO:tasks.workunit.client.0.smithi046.stdout:9/638: dread - db/d1e/d99/fb8 zero size 2024-02-19T19:08:43.668 INFO:tasks.workunit.client.0.smithi046.stdout:9/639: chown db/d20/d6f/fba 123 1 2024-02-19T19:08:43.668 INFO:tasks.workunit.client.0.smithi046.stdout:9/640: write db/d1e/d32/f61 [2265170,14194] 0 2024-02-19T19:08:43.669 INFO:tasks.workunit.client.0.smithi046.stdout:3/673: symlink da/dbe/lc4 0 2024-02-19T19:08:43.669 INFO:tasks.workunit.client.0.smithi046.stdout:3/674: readlink da/d1d/d63/d64/l71 0 2024-02-19T19:08:43.672 INFO:tasks.workunit.client.0.smithi046.stdout:5/796: rename d2/d27/d4b/dc2/fc3 to d2/dd/d29/d3b/ff8 0 2024-02-19T19:08:43.673 INFO:tasks.workunit.client.0.smithi046.stdout:5/797: fdatasync d2/dd/d3f/fec 0 2024-02-19T19:08:43.673 INFO:tasks.workunit.client.0.smithi046.stdout:5/798: fsync d2/dd/d26/d65/d5f/f88 0 2024-02-19T19:08:43.673 INFO:tasks.workunit.client.0.smithi046.stdout:5/799: truncate d2/d5e/fe1 90157 0 2024-02-19T19:08:43.678 INFO:tasks.workunit.client.0.smithi046.stdout:4/993: getdents d6/d11/d40/da7 0 2024-02-19T19:08:43.678 INFO:tasks.workunit.client.0.smithi046.stdout:5/800: truncate d2/dd/f1c 4513393 0 2024-02-19T19:08:43.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/803: dread d4/d6/dd/d10/d29/d2d/d35/d3c/f55 [0,4194304] 0 2024-02-19T19:08:43.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/804: readlink d4/d6/dd/d10/d29/d2d/d35/d66/l92 0 2024-02-19T19:08:43.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/805: write d4/d6/d1c/d20/d7a/fa0 [630189,72045] 0 2024-02-19T19:08:43.679 INFO:tasks.workunit.client.0.smithi046.stdout:6/806: stat d4/d6/dd 0 2024-02-19T19:08:43.682 INFO:tasks.workunit.client.0.smithi046.stdout:4/994: creat d6/d15/d17/d1e/d126/f158 x:0 0 0 2024-02-19T19:08:43.682 INFO:tasks.workunit.client.0.smithi046.stdout:4/995: chown d6/d11/dd6/d89/d8a/f119 162 1 2024-02-19T19:08:43.683 INFO:tasks.workunit.client.0.smithi046.stdout:5/801: symlink d2/dd/d3f/lf9 0 2024-02-19T19:08:43.685 INFO:tasks.workunit.client.0.smithi046.stdout:6/807: creat d4/d6/d1c/d60/def/ffa x:0 0 0 2024-02-19T19:08:43.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/641: dwrite db/d20/f2c [0,4194304] 0 2024-02-19T19:08:43.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/642: fdatasync db/d1e/d32/d47/d5b/f89 0 2024-02-19T19:08:43.700 INFO:tasks.workunit.client.0.smithi046.stdout:6/808: write d4/d6/f4c [1766304,118507] 0 2024-02-19T19:08:43.700 INFO:tasks.workunit.client.0.smithi046.stdout:6/809: write d4/d6/f30 [4602767,116235] 0 2024-02-19T19:08:43.701 INFO:tasks.workunit.client.0.smithi046.stdout:6/810: link d4/d6/dd/d10/d29/d2d/f7f d4/d6/d1c/d64/ffb 0 2024-02-19T19:08:43.702 INFO:tasks.workunit.client.0.smithi046.stdout:6/811: mknod d4/d6/dd/d10/d29/cfc 0 2024-02-19T19:08:43.703 INFO:tasks.workunit.client.0.smithi046.stdout:6/812: truncate d4/d6/dd/d10/d29/da2/fd3 45445 0 2024-02-19T19:08:43.703 INFO:tasks.workunit.client.0.smithi046.stdout:6/813: stat d4/d6/d22/le4 0 2024-02-19T19:08:43.703 INFO:tasks.workunit.client.0.smithi046.stdout:4/996: dwrite d6/d11/d40/fad [0,4194304] 0 2024-02-19T19:08:43.703 INFO:tasks.workunit.client.0.smithi046.stdout:4/997: dread - d6/d11/d40/da7/dd2/d10d/f13c zero size 2024-02-19T19:08:43.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/802: dwrite d2/d27/d47/d54/db8/fc5 [0,4194304] 0 2024-02-19T19:08:43.707 INFO:tasks.workunit.client.0.smithi046.stdout:4/998: write d6/d11/dd6/d89/f91 [475763,99836] 0 2024-02-19T19:08:43.707 INFO:tasks.workunit.client.0.smithi046.stdout:4/999: read d6/d11/f68 [453258,59894] 0 2024-02-19T19:08:43.707 INFO:tasks.workunit.client.0.smithi046.stdout:5/803: symlink d2/dd/d26/da9/dbf/dce/lfa 0 2024-02-19T19:08:43.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/804: mkdir d2/d27/d4b/dfb 0 2024-02-19T19:08:43.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/805: dread - d2/dd/d3f/fda zero size 2024-02-19T19:08:43.709 INFO:tasks.workunit.client.0.smithi046.stdout:9/643: dwrite db/d1e/d32/d7c/fb2 [0,4194304] 0 2024-02-19T19:08:43.710 INFO:tasks.workunit.client.0.smithi046.stdout:5/806: mknod d2/dd/d29/d89/dca/cfc 0 2024-02-19T19:08:43.713 INFO:tasks.workunit.client.0.smithi046.stdout:5/807: getdents d2/d27/d47/d54/db8 0 2024-02-19T19:08:43.713 INFO:tasks.workunit.client.0.smithi046.stdout:5/808: chown d2/dd/f36 977793186 1 2024-02-19T19:08:43.724 INFO:tasks.workunit.client.0.smithi046.stdout:5/809: dread d2/f16 [0,4194304] 0 2024-02-19T19:08:43.725 INFO:tasks.workunit.client.0.smithi046.stdout:5/810: symlink d2/d27/d4b/lfd 0 2024-02-19T19:08:43.727 INFO:tasks.workunit.client.0.smithi046.stdout:5/811: mkdir d2/dd/d2f/d34/dfe 0 2024-02-19T19:08:43.729 INFO:tasks.workunit.client.0.smithi046.stdout:6/814: dwrite d4/d6/dd/d10/d29/d2d/d35/da5/df0/ff2 [0,4194304] 0 2024-02-19T19:08:43.731 INFO:tasks.workunit.client.0.smithi046.stdout:9/644: dwrite db/d1e/d32/d47/d5b/d7f/fa3 [4194304,4194304] 0 2024-02-19T19:08:43.731 INFO:tasks.workunit.client.0.smithi046.stdout:9/645: fsync db/d20/d6b/f8d 0 2024-02-19T19:08:43.731 INFO:tasks.workunit.client.0.smithi046.stdout:6/815: mkdir d4/d6/dd/d10/d29/d2d/d35/da5/dfd 0 2024-02-19T19:08:43.732 INFO:tasks.workunit.client.0.smithi046.stdout:6/816: rmdir d4/d6/dd/d10/d29/da2/db7 39 2024-02-19T19:08:43.734 INFO:tasks.workunit.client.0.smithi046.stdout:6/817: rename d4/d6/d1c/d94/ld9 to d4/d6/dd/d10/d29/d2d/d35/da5/df0/lfe 0 2024-02-19T19:08:43.735 INFO:tasks.workunit.client.0.smithi046.stdout:6/818: truncate d4/d6/d8e/fec 2162596 0 2024-02-19T19:08:43.737 INFO:tasks.workunit.client.0.smithi046.stdout:6/819: symlink d4/d6/d1c/d20/d98/lff 0 2024-02-19T19:08:43.737 INFO:tasks.workunit.client.0.smithi046.stdout:6/820: creat d4/d6/d1c/d20/f100 x:0 0 0 2024-02-19T19:08:43.739 INFO:tasks.workunit.client.0.smithi046.stdout:6/821: mkdir d4/d6/dd/d10/d29/da2/db7/d101 0 2024-02-19T19:08:43.741 INFO:tasks.workunit.client.0.smithi046.stdout:6/822: rmdir d4/d6 39 2024-02-19T19:08:43.743 INFO:tasks.workunit.client.0.smithi046.stdout:6/823: rename d4/d6/dd/d10/d29/d2d/fc3 to d4/d6/d22/db0/db6/f102 0 2024-02-19T19:08:43.744 INFO:tasks.workunit.client.0.smithi046.stdout:6/824: readlink d4/d6/d1c/d20/dc5/lf7 0 2024-02-19T19:08:43.745 INFO:tasks.workunit.client.0.smithi046.stdout:6/825: unlink d4/d6/d1c/d94/lf6 0 2024-02-19T19:08:43.752 INFO:tasks.workunit.client.0.smithi046.stdout:5/812: dwrite d2/dd/f77 [0,4194304] 0 2024-02-19T19:08:43.757 INFO:tasks.workunit.client.0.smithi046.stdout:9/646: dwrite db/f87 [0,4194304] 0 2024-02-19T19:08:43.762 INFO:tasks.workunit.client.0.smithi046.stdout:9/647: rename db/d1e/d32/d47/d5b/f75 to db/d20/d6b/d54/db7/fc2 0 2024-02-19T19:08:43.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/648: mknod db/d53/cc3 0 2024-02-19T19:08:43.764 INFO:tasks.workunit.client.0.smithi046.stdout:9/649: mkdir db/d1e/d99/dc4 0 2024-02-19T19:08:43.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/650: creat db/d1e/d32/fc5 x:0 0 0 2024-02-19T19:08:43.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/651: write db/d20/d6b/d54/fab [1177421,73842] 0 2024-02-19T19:08:43.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/652: readlink db/d20/d4e/l69 0 2024-02-19T19:08:43.768 INFO:tasks.workunit.client.0.smithi046.stdout:9/653: rename db/d1e/d32/d47/d5b/d7f to db/d20/d6b/d54/db7/dc6 0 2024-02-19T19:08:43.768 INFO:tasks.workunit.client.0.smithi046.stdout:9/654: write db/d20/d6b/f6e [928853,108171] 0 2024-02-19T19:08:43.769 INFO:tasks.workunit.client.0.smithi046.stdout:9/655: mknod db/d20/d8a/cc7 0 2024-02-19T19:08:43.769 INFO:tasks.workunit.client.0.smithi046.stdout:9/656: fdatasync db/d1e/f27 0 2024-02-19T19:08:43.770 INFO:tasks.workunit.client.0.smithi046.stdout:9/657: rmdir db/d20/dac 39 2024-02-19T19:08:43.773 INFO:tasks.workunit.client.0.smithi046.stdout:6/826: dwrite d4/fb8 [0,4194304] 0 2024-02-19T19:08:43.774 INFO:tasks.workunit.client.0.smithi046.stdout:5/813: dwrite d2/dd/d29/f45 [0,4194304] 0 2024-02-19T19:08:43.775 INFO:tasks.workunit.client.0.smithi046.stdout:6/827: symlink d4/d6/dd/d10/d29/d2d/d35/l103 0 2024-02-19T19:08:43.777 INFO:tasks.workunit.client.0.smithi046.stdout:5/814: mkdir d2/d27/d4b/dfb/dff 0 2024-02-19T19:08:43.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/828: creat d4/d6/dd/d10/d29/d2d/f104 x:0 0 0 2024-02-19T19:08:43.780 INFO:tasks.workunit.client.0.smithi046.stdout:5/815: symlink d2/dd/d2f/d34/l100 0 2024-02-19T19:08:43.782 INFO:tasks.workunit.client.0.smithi046.stdout:6/829: truncate d4/d6/dd/d10/d29/d2d/fb4 1136035 0 2024-02-19T19:08:43.782 INFO:tasks.workunit.client.0.smithi046.stdout:5/816: dread d2/fd0 [4194304,4194304] 0 2024-02-19T19:08:43.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/817: rename d2/d27/c80 to d2/d27/d4b/dfb/c101 0 2024-02-19T19:08:43.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/818: fdatasync d2/dd/f1a 0 2024-02-19T19:08:43.788 INFO:tasks.workunit.client.0.smithi046.stdout:5/819: mknod d2/d27/d4b/dfb/c102 0 2024-02-19T19:08:43.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/820: mknod d2/dd/d26/da9/dbf/dd7/c103 0 2024-02-19T19:08:43.798 INFO:tasks.workunit.client.0.smithi046.stdout:6/830: dwrite d4/d6/dd/d10/d29/fa9 [0,4194304] 0 2024-02-19T19:08:43.799 INFO:tasks.workunit.client.0.smithi046.stdout:6/831: stat d4/d6/dd/d10/c1f 0 2024-02-19T19:08:43.799 INFO:tasks.workunit.client.0.smithi046.stdout:6/832: write d4/d6/d22/db0/fed [94953,74415] 0 2024-02-19T19:08:43.799 INFO:tasks.workunit.client.0.smithi046.stdout:6/833: chown d4/d6/d1c/d64/f80 488 1 2024-02-19T19:08:43.812 INFO:tasks.workunit.client.0.smithi046.stdout:5/821: dwrite d2/d27/d4b/f9e [0,4194304] 0 2024-02-19T19:08:43.816 INFO:tasks.workunit.client.0.smithi046.stdout:9/658: dwrite db/d20/f3f [0,4194304] 0 2024-02-19T19:08:43.816 INFO:tasks.workunit.client.0.smithi046.stdout:9/659: write db/d20/fb3 [934186,20130] 0 2024-02-19T19:08:43.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/660: mknod db/d1e/d99/cc8 0 2024-02-19T19:08:43.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/661: readlink db/d20/d8a/l8f 0 2024-02-19T19:08:43.821 INFO:tasks.workunit.client.0.smithi046.stdout:6/834: dwrite d4/d6/d1c/d64/f9f [4194304,4194304] 0 2024-02-19T19:08:43.844 INFO:tasks.workunit.client.0.smithi046.stdout:7/894: write d0/d4/d24/f2e [4072363,68256] 0 2024-02-19T19:08:43.845 INFO:tasks.workunit.client.0.smithi046.stdout:9/662: dwrite db/d1e/d52/fb4 [0,4194304] 0 2024-02-19T19:08:43.846 INFO:tasks.workunit.client.0.smithi046.stdout:7/895: mkdir d0/d11c 0 2024-02-19T19:08:43.846 INFO:tasks.workunit.client.0.smithi046.stdout:7/896: readlink d0/l86 0 2024-02-19T19:08:43.848 INFO:tasks.workunit.client.0.smithi046.stdout:6/835: dwrite d4/d6/dd/d10/d29/da2/db7/fb9 [0,4194304] 0 2024-02-19T19:08:43.848 INFO:tasks.workunit.client.0.smithi046.stdout:7/897: dread d0/d45/d98/d116/ff7 [0,4194304] 0 2024-02-19T19:08:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:9/663: mknod db/d1e/d99/dc4/cc9 0 2024-02-19T19:08:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/836: truncate d4/d6/dd/d10/d29/d2d/d35/d3c/f4a 1043007 0 2024-02-19T19:08:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/837: write d4/d6/dd/d10/f82 [840996,2685] 0 2024-02-19T19:08:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:1/897: dread d5/d13/fe5 [0,4194304] 0 2024-02-19T19:08:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:6/838: write d4/d6/dd/f56 [562794,79396] 0 2024-02-19T19:08:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:6/839: write d4/d6/dd/d10/d29/d2d/d35/da5/fde [995006,62295] 0 2024-02-19T19:08:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:6/840: mknod d4/d6/dd/d10/d29/da2/db7/c105 0 2024-02-19T19:08:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:6/841: truncate d4/d6/d22/f6e 561918 0 2024-02-19T19:08:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:6/842: fdatasync d4/d6/dd/d10/d29/d2d/dc0/fe7 0 2024-02-19T19:08:43.860 INFO:tasks.workunit.client.0.smithi046.stdout:7/898: write d0/d4/d7b/f88 [3211037,85449] 0 2024-02-19T19:08:43.862 INFO:tasks.workunit.client.0.smithi046.stdout:9/664: write db/d20/f56 [852907,30935] 0 2024-02-19T19:08:43.863 INFO:tasks.workunit.client.0.smithi046.stdout:9/665: read - db/d20/d8a/d96/f9b zero size 2024-02-19T19:08:43.863 INFO:tasks.workunit.client.0.smithi046.stdout:0/989: dwrite d0/d19/db/de7/df6/f132 [0,4194304] 0 2024-02-19T19:08:43.864 INFO:tasks.workunit.client.0.smithi046.stdout:9/666: creat db/fca x:0 0 0 2024-02-19T19:08:43.865 INFO:tasks.workunit.client.0.smithi046.stdout:1/898: write d5/d2f/d9f/d3b/d4e/d91/d122/d37/fa9 [3438875,112756] 0 2024-02-19T19:08:43.865 INFO:tasks.workunit.client.0.smithi046.stdout:7/899: dread d0/f18 [0,4194304] 0 2024-02-19T19:08:43.868 INFO:tasks.workunit.client.0.smithi046.stdout:9/667: mkdir db/d20/d4e/dcb 0 2024-02-19T19:08:43.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/990: dread d0/d24/d56/da1/f28 [0,4194304] 0 2024-02-19T19:08:43.870 INFO:tasks.workunit.client.0.smithi046.stdout:1/899: creat d5/d21/d9a/f136 x:0 0 0 2024-02-19T19:08:43.873 INFO:tasks.workunit.client.0.smithi046.stdout:7/900: link d0/d45/d98/d116/dbe/cfb d0/d4/d24/db9/d113/d118/c11d 0 2024-02-19T19:08:43.874 INFO:tasks.workunit.client.0.smithi046.stdout:0/991: rename d0/d19/d8/d37/fef to d0/d19/d8/d92/d13e/f143 0 2024-02-19T19:08:43.879 INFO:tasks.workunit.client.0.smithi046.stdout:7/901: getdents d0/d4 0 2024-02-19T19:08:43.880 INFO:tasks.workunit.client.0.smithi046.stdout:0/992: mknod d0/d19/d8/c144 0 2024-02-19T19:08:43.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/993: symlink d0/d19/d4d/da5/da7/d142/l145 0 2024-02-19T19:08:43.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/994: truncate d0/d19/d88/f139 866320 0 2024-02-19T19:08:43.888 INFO:tasks.workunit.client.0.smithi046.stdout:0/995: creat d0/d24/d2f/dac/d128/f146 x:0 0 0 2024-02-19T19:08:43.890 INFO:tasks.workunit.client.0.smithi046.stdout:0/996: creat d0/d24/d5b/d7f/dfc/f147 x:0 0 0 2024-02-19T19:08:43.891 INFO:tasks.workunit.client.0.smithi046.stdout:0/997: read d0/d19/f8e [602232,9458] 0 2024-02-19T19:08:43.891 INFO:tasks.workunit.client.0.smithi046.stdout:7/902: dread d0/d4/f29 [0,4194304] 0 2024-02-19T19:08:43.892 INFO:tasks.workunit.client.0.smithi046.stdout:0/998: rename d0/d24/d5b/d7f/f12c to d0/d19/d70/f148 0 2024-02-19T19:08:43.894 INFO:tasks.workunit.client.0.smithi046.stdout:7/903: unlink d0/d45/d71/d4b/f61 0 2024-02-19T19:08:43.895 INFO:tasks.workunit.client.0.smithi046.stdout:1/900: dwrite d5/d2f/d9f/d55/fb1 [0,4194304] 0 2024-02-19T19:08:43.895 INFO:tasks.workunit.client.0.smithi046.stdout:7/904: write d0/d45/d98/d116/dbe/df9/fb3 [9284961,125311] 0 2024-02-19T19:08:43.895 INFO:tasks.workunit.client.0.smithi046.stdout:7/905: chown d0/d45/c70 1326413606 1 2024-02-19T19:08:43.895 INFO:tasks.workunit.client.0.smithi046.stdout:7/906: stat d0/d45/d98 0 2024-02-19T19:08:43.895 INFO:tasks.workunit.client.0.smithi046.stdout:7/907: fdatasync d0/d45/d98/d116/ff7 0 2024-02-19T19:08:43.897 INFO:tasks.workunit.client.0.smithi046.stdout:1/901: creat d5/f137 x:0 0 0 2024-02-19T19:08:43.897 INFO:tasks.workunit.client.0.smithi046.stdout:1/902: readlink d5/d2f/d9f/l51 0 2024-02-19T19:08:43.897 INFO:tasks.workunit.client.0.smithi046.stdout:1/903: chown d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d75/dcf/cfa 0 1 2024-02-19T19:08:43.897 INFO:tasks.workunit.client.0.smithi046.stdout:1/904: chown d5/d2f/d9f/d3b/d3c/d3f/f43 16955 1 2024-02-19T19:08:43.898 INFO:tasks.workunit.client.0.smithi046.stdout:7/908: truncate d0/d45/d71/d4b/f72 549404 0 2024-02-19T19:08:43.899 INFO:tasks.workunit.client.0.smithi046.stdout:1/905: mkdir d5/d2f/d9f/d3b/d3c/d3f/d11d/d138 0 2024-02-19T19:08:43.900 INFO:tasks.workunit.client.0.smithi046.stdout:7/909: creat d0/f11e x:0 0 0 2024-02-19T19:08:43.900 INFO:tasks.workunit.client.0.smithi046.stdout:7/910: fsync d0/d45/d56/fb5 0 2024-02-19T19:08:43.900 INFO:tasks.workunit.client.0.smithi046.stdout:7/911: fsync d0/d45/d98/d116/db4/fed 0 2024-02-19T19:08:43.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/906: mkdir d5/d21/d9a/dd0/d80/d139 0 2024-02-19T19:08:43.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/907: creat d5/d21/d9a/dd0/d80/d139/f13a x:0 0 0 2024-02-19T19:08:43.904 INFO:tasks.workunit.client.0.smithi046.stdout:0/999: dread d0/d19/f1a [0,4194304] 0 2024-02-19T19:08:43.911 INFO:tasks.workunit.client.0.smithi046.stdout:7/912: read d0/d45/f100 [1625254,72833] 0 2024-02-19T19:08:43.911 INFO:tasks.workunit.client.0.smithi046.stdout:7/913: write d0/d45/d98/d116/dbe/fd7 [434876,77856] 0 2024-02-19T19:08:43.933 INFO:tasks.workunit.client.0.smithi046.stdout:7/914: dwrite d0/d45/d71/d41/d5f/fa4 [0,4194304] 0 2024-02-19T19:08:43.935 INFO:tasks.workunit.client.0.smithi046.stdout:7/915: symlink d0/d45/d4a/d78/d9d/l11f 0 2024-02-19T19:08:43.937 INFO:tasks.workunit.client.0.smithi046.stdout:7/916: getdents d0/d45/d71/d41/d5f 0 2024-02-19T19:08:43.937 INFO:tasks.workunit.client.0.smithi046.stdout:7/917: readlink d0/d45/d98/ld6 0 2024-02-19T19:08:43.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/918: mkdir d0/d45/d98/d120 0 2024-02-19T19:08:43.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/919: dread - d0/f11e zero size 2024-02-19T19:08:43.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/920: write d0/fdb [18036,109133] 0 2024-02-19T19:08:44.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/675: sync 2024-02-19T19:08:44.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/676: chown da/d8a/d9f 41568761 1 2024-02-19T19:08:44.164 INFO:tasks.workunit.client.0.smithi046.stdout:3/677: write da/d1d/d63/f85 [1431681,87328] 0 2024-02-19T19:08:44.165 INFO:tasks.workunit.client.0.smithi046.stdout:3/678: symlink da/dbe/lc5 0 2024-02-19T19:08:44.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/679: dread da/d30/f57 [8388608,4194304] 0 2024-02-19T19:08:44.184 INFO:tasks.workunit.client.0.smithi046.stdout:3/680: dread da/d1d/d63/f85 [0,4194304] 0 2024-02-19T19:08:44.185 INFO:tasks.workunit.client.0.smithi046.stdout:3/681: truncate da/d30/d38/d54/fa2 1490180 0 2024-02-19T19:08:44.185 INFO:tasks.workunit.client.0.smithi046.stdout:3/682: truncate da/d1d/d10/f1e 1941653 0 2024-02-19T19:08:44.186 INFO:tasks.workunit.client.0.smithi046.stdout:3/683: mkdir da/d30/d38/dc6 0 2024-02-19T19:08:44.186 INFO:tasks.workunit.client.0.smithi046.stdout:3/684: readlink da/d30/d38/d66/l9b 0 2024-02-19T19:08:44.190 INFO:tasks.workunit.client.0.smithi046.stdout:3/685: write da/d1d/d63/d92/f98 [627036,26343] 0 2024-02-19T19:08:44.191 INFO:tasks.workunit.client.0.smithi046.stdout:3/686: getdents da/d1d/d82 0 2024-02-19T19:08:44.191 INFO:tasks.workunit.client.0.smithi046.stdout:3/687: creat da/d30/d38/d54/db2/fc7 x:0 0 0 2024-02-19T19:08:44.193 INFO:tasks.workunit.client.0.smithi046.stdout:3/688: link da/d1d/d8e/fb5 da/d30/d38/dc6/fc8 0 2024-02-19T19:08:44.193 INFO:tasks.workunit.client.0.smithi046.stdout:3/689: fdatasync da/d1d/d10/f4c 0 2024-02-19T19:08:44.209 INFO:tasks.workunit.client.0.smithi046.stdout:3/690: dwrite da/d30/d38/f7a [0,4194304] 0 2024-02-19T19:08:44.225 INFO:tasks.workunit.client.0.smithi046.stdout:3/691: dwrite da/d30/d38/d54/f5b [0,4194304] 0 2024-02-19T19:08:44.229 INFO:tasks.workunit.client.0.smithi046.stdout:3/692: getdents da/d1d/d8e 0 2024-02-19T19:08:44.229 INFO:tasks.workunit.client.0.smithi046.stdout:3/693: read da/d1d/d10/f1b [418319,8687] 0 2024-02-19T19:08:44.229 INFO:tasks.workunit.client.0.smithi046.stdout:3/694: stat da/d30/d38/dc6 0 2024-02-19T19:08:44.229 INFO:tasks.workunit.client.0.smithi046.stdout:3/695: creat da/d30/d38/d54/db2/fc9 x:0 0 0 2024-02-19T19:08:44.236 INFO:tasks.workunit.client.0.smithi046.stdout:5/822: sync 2024-02-19T19:08:44.236 INFO:tasks.workunit.client.0.smithi046.stdout:9/668: sync 2024-02-19T19:08:44.238 INFO:tasks.workunit.client.0.smithi046.stdout:9/669: write db/d20/fb3 [148985,23040] 0 2024-02-19T19:08:44.238 INFO:tasks.workunit.client.0.smithi046.stdout:9/670: fdatasync db/d1e/d32/d47/d5b/d94/fa2 0 2024-02-19T19:08:44.238 INFO:tasks.workunit.client.0.smithi046.stdout:9/671: chown db/d20/d71 2 1 2024-02-19T19:08:44.245 INFO:tasks.workunit.client.0.smithi046.stdout:5/823: write d2/dd/d2f/d34/d5d/f43 [4813602,111719] 0 2024-02-19T19:08:44.247 INFO:tasks.workunit.client.0.smithi046.stdout:5/824: mkdir d2/dd/d29/d3b/d104 0 2024-02-19T19:08:44.247 INFO:tasks.workunit.client.0.smithi046.stdout:5/825: write d2/f16 [3698322,33364] 0 2024-02-19T19:08:44.249 INFO:tasks.workunit.client.0.smithi046.stdout:5/826: creat d2/d27/f105 x:0 0 0 2024-02-19T19:08:44.249 INFO:tasks.workunit.client.0.smithi046.stdout:5/827: chown d2/dd/d29/d3b/cb4 286399101 1 2024-02-19T19:08:44.249 INFO:tasks.workunit.client.0.smithi046.stdout:5/828: write d2/dd/d29/f82 [420344,12234] 0 2024-02-19T19:08:44.249 INFO:tasks.workunit.client.0.smithi046.stdout:5/829: dread - d2/d27/d47/d54/fc4 zero size 2024-02-19T19:08:44.249 INFO:tasks.workunit.client.0.smithi046.stdout:5/830: write d2/f3c [3121817,94847] 0 2024-02-19T19:08:44.250 INFO:tasks.workunit.client.0.smithi046.stdout:9/672: write f0 [7075721,120580] 0 2024-02-19T19:08:44.250 INFO:tasks.workunit.client.0.smithi046.stdout:3/696: dwrite da/d30/d38/f8f [4194304,4194304] 0 2024-02-19T19:08:44.251 INFO:tasks.workunit.client.0.smithi046.stdout:9/673: mkdir db/d20/d71/dcc 0 2024-02-19T19:08:44.252 INFO:tasks.workunit.client.0.smithi046.stdout:9/674: unlink db/d53/cbb 0 2024-02-19T19:08:44.259 INFO:tasks.workunit.client.0.smithi046.stdout:5/831: write d2/d27/d47/d54/db8/fc5 [1963437,117526] 0 2024-02-19T19:08:44.259 INFO:tasks.workunit.client.0.smithi046.stdout:5/832: chown d2/f85 7782 1 2024-02-19T19:08:44.260 INFO:tasks.workunit.client.0.smithi046.stdout:3/697: dread da/d1d/d10/f5e [0,4194304] 0 2024-02-19T19:08:44.260 INFO:tasks.workunit.client.0.smithi046.stdout:3/698: fdatasync da/f2c 0 2024-02-19T19:08:44.260 INFO:tasks.workunit.client.0.smithi046.stdout:3/699: fdatasync da/d30/d38/d66/f69 0 2024-02-19T19:08:44.261 INFO:tasks.workunit.client.0.smithi046.stdout:5/833: creat d2/d27/d47/d54/f106 x:0 0 0 2024-02-19T19:08:44.261 INFO:tasks.workunit.client.0.smithi046.stdout:5/834: read - d2/d5e/ff1 zero size 2024-02-19T19:08:44.261 INFO:tasks.workunit.client.0.smithi046.stdout:3/700: rmdir da/dbe 39 2024-02-19T19:08:44.263 INFO:tasks.workunit.client.0.smithi046.stdout:5/835: rename d2/dd/f44 to d2/dd/d26/da9/f107 0 2024-02-19T19:08:44.264 INFO:tasks.workunit.client.0.smithi046.stdout:5/836: link d2/dd/d2f/c78 d2/dd/d29/d3b/d104/c108 0 2024-02-19T19:08:44.266 INFO:tasks.workunit.client.0.smithi046.stdout:5/837: creat d2/dd/d26/da9/f109 x:0 0 0 2024-02-19T19:08:44.266 INFO:tasks.workunit.client.0.smithi046.stdout:5/838: chown d2/dd/l1b 1276497368 1 2024-02-19T19:08:44.271 INFO:tasks.workunit.client.0.smithi046.stdout:3/701: write da/d30/d38/f8f [4133800,35824] 0 2024-02-19T19:08:44.272 INFO:tasks.workunit.client.0.smithi046.stdout:3/702: truncate da/d30/d38/d66/fa5 720669 0 2024-02-19T19:08:44.273 INFO:tasks.workunit.client.0.smithi046.stdout:3/703: creat da/d30/d38/dc6/fca x:0 0 0 2024-02-19T19:08:44.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/839: dwrite d2/dd/d2f/d34/f3e [0,4194304] 0 2024-02-19T19:08:44.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/840: chown d2/dd/d2f 2083147235 1 2024-02-19T19:08:44.291 INFO:tasks.workunit.client.0.smithi046.stdout:3/704: dwrite da/d1d/d8e/f97 [0,4194304] 0 2024-02-19T19:08:44.292 INFO:tasks.workunit.client.0.smithi046.stdout:3/705: chown da/d30/d38/d66/f67 370871923 1 2024-02-19T19:08:44.292 INFO:tasks.workunit.client.0.smithi046.stdout:5/841: truncate d2/dd/d29/fb9 8051358 0 2024-02-19T19:08:44.292 INFO:tasks.workunit.client.0.smithi046.stdout:5/842: write d2/d27/d4b/dc2/fed [2149171,14814] 0 2024-02-19T19:08:44.295 INFO:tasks.workunit.client.0.smithi046.stdout:5/843: symlink d2/d27/d47/d54/db8/l10a 0 2024-02-19T19:08:44.296 INFO:tasks.workunit.client.0.smithi046.stdout:5/844: symlink d2/dd/d29/d89/l10b 0 2024-02-19T19:08:44.296 INFO:tasks.workunit.client.0.smithi046.stdout:5/845: read - d2/dd/d26/d65/d5f/f88 zero size 2024-02-19T19:08:44.297 INFO:tasks.workunit.client.0.smithi046.stdout:5/846: mkdir d2/dd/d2f/d34/dfe/d10c 0 2024-02-19T19:08:44.298 INFO:tasks.workunit.client.0.smithi046.stdout:5/847: mknod d2/dd/d2f/d34/dfe/d10c/c10d 0 2024-02-19T19:08:44.300 INFO:tasks.workunit.client.0.smithi046.stdout:5/848: mkdir d2/dd/d2f/d34/dfe/d10e 0 2024-02-19T19:08:44.300 INFO:tasks.workunit.client.0.smithi046.stdout:5/849: fsync d2/dd/f1c 0 2024-02-19T19:08:44.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/706: dwrite da/d1d/f68 [0,4194304] 0 2024-02-19T19:08:44.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/707: read - da/fc3 zero size 2024-02-19T19:08:44.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/708: chown da/d1d/d10 38938 1 2024-02-19T19:08:44.360 INFO:tasks.workunit.client.0.smithi046.stdout:5/850: dwrite d2/f2d [4194304,4194304] 0 2024-02-19T19:08:44.360 INFO:tasks.workunit.client.0.smithi046.stdout:5/851: creat d2/dd/d26/da9/f10f x:0 0 0 2024-02-19T19:08:44.361 INFO:tasks.workunit.client.0.smithi046.stdout:3/709: dread da/d1d/f28 [0,4194304] 0 2024-02-19T19:08:44.361 INFO:tasks.workunit.client.0.smithi046.stdout:3/710: creat da/d1d/d3f/fcb x:0 0 0 2024-02-19T19:08:44.361 INFO:tasks.workunit.client.0.smithi046.stdout:3/711: fsync da/d1d/d10/f5e 0 2024-02-19T19:08:44.361 INFO:tasks.workunit.client.0.smithi046.stdout:3/712: dread - da/d30/d38/d54/db2/fc9 zero size 2024-02-19T19:08:44.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/852: creat d2/d27/d4b/f110 x:0 0 0 2024-02-19T19:08:44.364 INFO:tasks.workunit.client.0.smithi046.stdout:3/713: mknod da/ccc 0 2024-02-19T19:08:44.364 INFO:tasks.workunit.client.0.smithi046.stdout:3/714: fsync da/d1d/d63/d92/fbb 0 2024-02-19T19:08:44.364 INFO:tasks.workunit.client.0.smithi046.stdout:3/715: fdatasync da/d30/d38/d54/db2/fc9 0 2024-02-19T19:08:44.365 INFO:tasks.workunit.client.0.smithi046.stdout:5/853: symlink d2/dd/d26/d65/l111 0 2024-02-19T19:08:44.369 INFO:tasks.workunit.client.0.smithi046.stdout:7/921: sync 2024-02-19T19:08:44.369 INFO:tasks.workunit.client.0.smithi046.stdout:1/908: sync 2024-02-19T19:08:44.370 INFO:tasks.workunit.client.0.smithi046.stdout:7/922: getdents d0/d45 0 2024-02-19T19:08:44.371 INFO:tasks.workunit.client.0.smithi046.stdout:3/716: dread da/d1d/d10/f5e [0,4194304] 0 2024-02-19T19:08:44.372 INFO:tasks.workunit.client.0.smithi046.stdout:7/923: mkdir d0/d45/d98/d116/dbe/d121 0 2024-02-19T19:08:44.373 INFO:tasks.workunit.client.0.smithi046.stdout:7/924: chown d0/d45/d71/d41/db8/f8a 1 1 2024-02-19T19:08:44.374 INFO:tasks.workunit.client.0.smithi046.stdout:7/925: creat d0/d45/d4a/d58/d91/f122 x:0 0 0 2024-02-19T19:08:44.379 INFO:tasks.workunit.client.0.smithi046.stdout:3/717: dread da/d1d/d63/f85 [0,4194304] 0 2024-02-19T19:08:44.379 INFO:tasks.workunit.client.0.smithi046.stdout:3/718: fdatasync da/d1d/d3f/fcb 0 2024-02-19T19:08:44.379 INFO:tasks.workunit.client.0.smithi046.stdout:1/909: dread d5/d21/f23 [0,4194304] 0 2024-02-19T19:08:44.380 INFO:tasks.workunit.client.0.smithi046.stdout:1/910: mknod d5/d2f/d5e/c13b 0 2024-02-19T19:08:44.380 INFO:tasks.workunit.client.0.smithi046.stdout:1/911: write d5/d13/f19 [1663402,91982] 0 2024-02-19T19:08:44.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/854: dwrite d2/dd/d29/d89/ff5 [0,4194304] 0 2024-02-19T19:08:44.388 INFO:tasks.workunit.client.0.smithi046.stdout:5/855: creat d2/dd/d26/da9/dbf/dd7/df3/f112 x:0 0 0 2024-02-19T19:08:44.399 INFO:tasks.workunit.client.0.smithi046.stdout:3/719: dwrite da/d1d/d10/f58 [0,4194304] 0 2024-02-19T19:08:44.410 INFO:tasks.workunit.client.0.smithi046.stdout:3/720: dread da/d30/d38/d54/f5d [0,4194304] 0 2024-02-19T19:08:44.412 INFO:tasks.workunit.client.0.smithi046.stdout:3/721: getdents da/d30/d38/d54/db2 0 2024-02-19T19:08:44.412 INFO:tasks.workunit.client.0.smithi046.stdout:3/722: fdatasync da/d30/d38/d93/fb1 0 2024-02-19T19:08:44.413 INFO:tasks.workunit.client.0.smithi046.stdout:3/723: creat da/d8a/d9f/fcd x:0 0 0 2024-02-19T19:08:44.414 INFO:tasks.workunit.client.0.smithi046.stdout:3/724: truncate da/f2c 2534546 0 2024-02-19T19:08:44.414 INFO:tasks.workunit.client.0.smithi046.stdout:3/725: chown da/d30/d38/d54 1621369176 1 2024-02-19T19:08:44.414 INFO:tasks.workunit.client.0.smithi046.stdout:3/726: fdatasync da/d30/d38/d66/fa5 0 2024-02-19T19:08:44.415 INFO:tasks.workunit.client.0.smithi046.stdout:3/727: creat da/d30/fce x:0 0 0 2024-02-19T19:08:44.415 INFO:tasks.workunit.client.0.smithi046.stdout:3/728: stat c5 0 2024-02-19T19:08:44.415 INFO:tasks.workunit.client.0.smithi046.stdout:3/729: stat da/d1d/d82/fa3 0 2024-02-19T19:08:44.438 INFO:tasks.workunit.client.0.smithi046.stdout:3/730: dwrite da/d1d/f96 [0,4194304] 0 2024-02-19T19:08:44.438 INFO:tasks.workunit.client.0.smithi046.stdout:3/731: readlink da/d30/d38/l3a 0 2024-02-19T19:08:44.452 INFO:tasks.workunit.client.0.smithi046.stdout:3/732: dwrite da/d1d/d63/d64/f7b [4194304,4194304] 0 2024-02-19T19:08:44.453 INFO:tasks.workunit.client.0.smithi046.stdout:3/733: write da/d1d/d63/f85 [2884530,46580] 0 2024-02-19T19:08:44.453 INFO:tasks.workunit.client.0.smithi046.stdout:3/734: write da/d30/f44 [2093821,53661] 0 2024-02-19T19:08:44.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/735: dread da/d1d/d10/f4c [0,4194304] 0 2024-02-19T19:08:44.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/736: dread - da/d30/d38/d54/db2/fc9 zero size 2024-02-19T19:08:44.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/737: creat da/d30/d38/d93/fcf x:0 0 0 2024-02-19T19:08:44.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/738: read da/d1d/d10/f1e [1325731,82082] 0 2024-02-19T19:08:44.460 INFO:tasks.workunit.client.0.smithi046.stdout:3/739: readlink da/d1d/d3f/d8d/lbf 0 2024-02-19T19:08:44.460 INFO:tasks.workunit.client.0.smithi046.stdout:3/740: chown da/d30/c7e 17 1 2024-02-19T19:08:44.460 INFO:tasks.workunit.client.0.smithi046.stdout:3/741: stat da/d1d/laa 0 2024-02-19T19:08:44.460 INFO:tasks.workunit.client.0.smithi046.stdout:3/742: chown c5 46734356 1 2024-02-19T19:08:44.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/743: creat da/d30/d38/d93/fd0 x:0 0 0 2024-02-19T19:08:44.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/744: truncate da/d1d/d82/fa7 129180 0 2024-02-19T19:08:44.831 INFO:tasks.workunit.client.0.smithi046.stdout:6/843: dread d4/d6/dd/d10/f86 [0,4194304] 0 2024-02-19T19:08:44.831 INFO:tasks.workunit.client.0.smithi046.stdout:6/844: fsync d4/f26 0 2024-02-19T19:08:44.832 INFO:tasks.workunit.client.0.smithi046.stdout:6/845: creat d4/d6/dd/d10/d29/da2/db7/d101/f106 x:0 0 0 2024-02-19T19:08:44.834 INFO:tasks.workunit.client.0.smithi046.stdout:6/846: unlink d4/d6/d8e/f90 0 2024-02-19T19:08:44.838 INFO:tasks.workunit.client.0.smithi046.stdout:6/847: rename d4/d6/dd/d10/d29/d2d/dc0/df9 to d4/d6/dd/d10/d29/d2d/d35/da5/dfd/d107 0 2024-02-19T19:08:44.841 INFO:tasks.workunit.client.0.smithi046.stdout:6/848: rename d4/d6/dd/d10/d29/da2/db7/le9 to d4/d6/dd/d10/d29/d2d/d35/da5/df0/l108 0 2024-02-19T19:08:44.842 INFO:tasks.workunit.client.0.smithi046.stdout:6/849: creat d4/d6/dd/f109 x:0 0 0 2024-02-19T19:08:44.843 INFO:tasks.workunit.client.0.smithi046.stdout:6/850: truncate d4/d6/d1c/d64/f9b 37329 0 2024-02-19T19:08:44.846 INFO:tasks.workunit.client.0.smithi046.stdout:6/851: mkdir d4/d6/d1c/d20/d7a/d10a 0 2024-02-19T19:08:44.854 INFO:tasks.workunit.client.0.smithi046.stdout:1/912: dwrite d5/d21/d9a/dd0/d80/fac [0,4194304] 0 2024-02-19T19:08:44.857 INFO:tasks.workunit.client.0.smithi046.stdout:6/852: dread d4/d6/dd/d10/d29/d2d/d35/da5/df0/ff2 [4194304,4194304] 0 2024-02-19T19:08:44.859 INFO:tasks.workunit.client.0.smithi046.stdout:6/853: rename d4/d6/d1c/d20/l32 to d4/d6/d1c/d20/d7a/d10a/l10b 0 2024-02-19T19:08:44.862 INFO:tasks.workunit.client.0.smithi046.stdout:6/854: mkdir d4/d6/dd/d10/d29/d2d/dc0/d10c 0 2024-02-19T19:08:44.870 INFO:tasks.workunit.client.0.smithi046.stdout:3/745: sync 2024-02-19T19:08:44.870 INFO:tasks.workunit.client.0.smithi046.stdout:7/926: sync 2024-02-19T19:08:44.870 INFO:tasks.workunit.client.0.smithi046.stdout:7/927: write d0/d45/d98/d116/dbe/df9/f6b [4945589,32688] 0 2024-02-19T19:08:44.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/675: sync 2024-02-19T19:08:44.871 INFO:tasks.workunit.client.0.smithi046.stdout:5/856: sync 2024-02-19T19:08:44.871 INFO:tasks.workunit.client.0.smithi046.stdout:5/857: readlink d2/dd/d3f/lf9 0 2024-02-19T19:08:44.871 INFO:tasks.workunit.client.0.smithi046.stdout:5/858: write d2/dd/d29/f82 [423363,124418] 0 2024-02-19T19:08:44.871 INFO:tasks.workunit.client.0.smithi046.stdout:5/859: chown d2/dd/d26/f3d 1389897 1 2024-02-19T19:08:44.872 INFO:tasks.workunit.client.0.smithi046.stdout:3/746: creat da/d1d/d63/d64/fd1 x:0 0 0 2024-02-19T19:08:44.872 INFO:tasks.workunit.client.0.smithi046.stdout:3/747: write da/d30/d38/d54/db2/fc9 [166152,31087] 0 2024-02-19T19:08:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:7/928: mkdir d0/d45/d71/da3/d123 0 2024-02-19T19:08:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:7/929: chown d0/d45/d98/d116/ddc/d107 12996909 1 2024-02-19T19:08:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:7/930: chown d0/d45/d71/d41/d5f/c10c 15603 1 2024-02-19T19:08:44.876 INFO:tasks.workunit.client.0.smithi046.stdout:9/676: rename db/d53/f66 to db/d1e/d52/fcd 0 2024-02-19T19:08:44.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/860: symlink d2/dd/d26/da9/dbf/dd7/l113 0 2024-02-19T19:08:44.878 INFO:tasks.workunit.client.0.smithi046.stdout:7/931: getdents d0/d4/d68 0 2024-02-19T19:08:44.880 INFO:tasks.workunit.client.0.smithi046.stdout:1/913: dwrite d5/d2f/d9f/d3b/d4e/f6e [0,4194304] 0 2024-02-19T19:08:44.881 INFO:tasks.workunit.client.0.smithi046.stdout:9/677: link db/d20/d6b/d54/db7/dc6/l9e db/d20/d8a/d96/lce 0 2024-02-19T19:08:44.882 INFO:tasks.workunit.client.0.smithi046.stdout:9/678: readlink db/d20/d8a/l90 0 2024-02-19T19:08:44.882 INFO:tasks.workunit.client.0.smithi046.stdout:9/679: write db/d53/faa [180854,57146] 0 2024-02-19T19:08:44.883 INFO:tasks.workunit.client.0.smithi046.stdout:5/861: mkdir d2/dd/d114 0 2024-02-19T19:08:44.883 INFO:tasks.workunit.client.0.smithi046.stdout:3/748: rmdir da/d1d/d63/d64/d74 39 2024-02-19T19:08:44.883 INFO:tasks.workunit.client.0.smithi046.stdout:3/749: fdatasync da/d1d/f28 0 2024-02-19T19:08:44.883 INFO:tasks.workunit.client.0.smithi046.stdout:3/750: readlink da/d1d/l33 0 2024-02-19T19:08:44.885 INFO:tasks.workunit.client.0.smithi046.stdout:7/932: symlink d0/d45/d98/l124 0 2024-02-19T19:08:44.889 INFO:tasks.workunit.client.0.smithi046.stdout:1/914: rename d5/d2f/d9f/d3b/d4e/d91/d122/d37/f79 to d5/d21/d9a/dd0/d80/daf/db5/dbe/dd3/f13c 0 2024-02-19T19:08:44.890 INFO:tasks.workunit.client.0.smithi046.stdout:9/680: mkdir db/d82/dcf 0 2024-02-19T19:08:44.891 INFO:tasks.workunit.client.0.smithi046.stdout:5/862: rmdir d2/dd/d29/d3b/d104 39 2024-02-19T19:08:44.894 INFO:tasks.workunit.client.0.smithi046.stdout:1/915: unlink d5/d21/lca 0 2024-02-19T19:08:44.895 INFO:tasks.workunit.client.0.smithi046.stdout:5/863: truncate d2/dd/f77 3422914 0 2024-02-19T19:08:44.897 INFO:tasks.workunit.client.0.smithi046.stdout:1/916: rmdir d5/d2f/d9f/d3b 39 2024-02-19T19:08:44.897 INFO:tasks.workunit.client.0.smithi046.stdout:7/933: dread d0/d4/d24/f51 [0,4194304] 0 2024-02-19T19:08:44.897 INFO:tasks.workunit.client.0.smithi046.stdout:7/934: write d0/d45/d98/f10a [741757,54022] 0 2024-02-19T19:08:44.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/917: link d5/d2f/d9f/d3b/d4e/d91/d122/f36 d5/d2f/d9f/d3b/d4e/d91/f13d 0 2024-02-19T19:08:44.902 INFO:tasks.workunit.client.0.smithi046.stdout:9/681: dread db/d20/d6f/fba [0,4194304] 0 2024-02-19T19:08:44.912 INFO:tasks.workunit.client.0.smithi046.stdout:9/682: write db/d20/d6b/d54/db7/dc6/fa3 [4321066,85842] 0 2024-02-19T19:08:44.923 INFO:tasks.workunit.client.0.smithi046.stdout:5/864: dwrite d2/d27/d47/d54/db8/fc5 [0,4194304] 0 2024-02-19T19:08:44.924 INFO:tasks.workunit.client.0.smithi046.stdout:7/935: dwrite d0/d45/fa6 [0,4194304] 0 2024-02-19T19:08:44.924 INFO:tasks.workunit.client.0.smithi046.stdout:5/865: rmdir d2/dd/d26/da9/dc0 39 2024-02-19T19:08:44.924 INFO:tasks.workunit.client.0.smithi046.stdout:5/866: fsync d2/d27/d47/fee 0 2024-02-19T19:08:44.924 INFO:tasks.workunit.client.0.smithi046.stdout:7/936: creat d0/d4/d68/f125 x:0 0 0 2024-02-19T19:08:44.925 INFO:tasks.workunit.client.0.smithi046.stdout:5/867: mkdir d2/dd/d2f/d115 0 2024-02-19T19:08:44.927 INFO:tasks.workunit.client.0.smithi046.stdout:7/937: rename d0/fdb to d0/d45/d4a/d58/f126 0 2024-02-19T19:08:44.927 INFO:tasks.workunit.client.0.smithi046.stdout:7/938: creat d0/d45/d71/da3/dd0/f127 x:0 0 0 2024-02-19T19:08:44.928 INFO:tasks.workunit.client.0.smithi046.stdout:5/868: unlink d2/dd/d29/c98 0 2024-02-19T19:08:44.930 INFO:tasks.workunit.client.0.smithi046.stdout:7/939: rename d0/cbb to d0/d45/d98/d116/dbe/dff/c128 0 2024-02-19T19:08:44.930 INFO:tasks.workunit.client.0.smithi046.stdout:7/940: readlink d0/d4/l15 0 2024-02-19T19:08:44.930 INFO:tasks.workunit.client.0.smithi046.stdout:1/918: dwrite d5/d2f/d9f/d3b/d4e/d91/d122/f41 [4194304,4194304] 0 2024-02-19T19:08:44.930 INFO:tasks.workunit.client.0.smithi046.stdout:5/869: getdents d2/dd/d26/d65/d5f 0 2024-02-19T19:08:44.932 INFO:tasks.workunit.client.0.smithi046.stdout:7/941: creat d0/d45/d4a/daf/f129 x:0 0 0 2024-02-19T19:08:44.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/683: dwrite db/d1e/d32/f61 [0,4194304] 0 2024-02-19T19:08:44.932 INFO:tasks.workunit.client.0.smithi046.stdout:1/919: creat d5/d21/d9a/dd0/d80/daf/db5/dbe/dd3/f13e x:0 0 0 2024-02-19T19:08:44.933 INFO:tasks.workunit.client.0.smithi046.stdout:7/942: mkdir d0/d45/d71/d41/db8/dd1/d12a 0 2024-02-19T19:08:44.934 INFO:tasks.workunit.client.0.smithi046.stdout:1/920: mkdir d5/d2f/d9f/d3b/d4e/d91/d122/d13f 0 2024-02-19T19:08:44.936 INFO:tasks.workunit.client.0.smithi046.stdout:1/921: mkdir d5/d21/d9a/dd0/d140 0 2024-02-19T19:08:44.946 INFO:tasks.workunit.client.0.smithi046.stdout:9/684: write db/d1e/d52/fb4 [1499605,86702] 0 2024-02-19T19:08:44.954 INFO:tasks.workunit.client.0.smithi046.stdout:1/922: write d5/fc [6983302,57577] 0 2024-02-19T19:08:44.954 INFO:tasks.workunit.client.0.smithi046.stdout:1/923: write d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/f6b [1181457,55708] 0 2024-02-19T19:08:44.957 INFO:tasks.workunit.client.0.smithi046.stdout:9/685: write db/d1e/d52/fcd [1025969,23920] 0 2024-02-19T19:08:44.958 INFO:tasks.workunit.client.0.smithi046.stdout:9/686: dread - db/d20/dac/faf zero size 2024-02-19T19:08:44.958 INFO:tasks.workunit.client.0.smithi046.stdout:9/687: fsync db/f7b 0 2024-02-19T19:08:44.958 INFO:tasks.workunit.client.0.smithi046.stdout:9/688: mkdir db/d20/d6b/d54/db7/dd0 0 2024-02-19T19:08:44.964 INFO:tasks.workunit.client.0.smithi046.stdout:5/870: dwrite d2/dd/d29/d89/dca/ff2 [0,4194304] 0 2024-02-19T19:08:44.964 INFO:tasks.workunit.client.0.smithi046.stdout:5/871: creat d2/d27/d47/d54/d57/f116 x:0 0 0 2024-02-19T19:08:44.964 INFO:tasks.workunit.client.0.smithi046.stdout:5/872: fsync d2/dd/d29/d3b/d93/fae 0 2024-02-19T19:08:44.969 INFO:tasks.workunit.client.0.smithi046.stdout:1/924: dread d5/d21/d9a/dd0/d80/fac [0,4194304] 0 2024-02-19T19:08:44.969 INFO:tasks.workunit.client.0.smithi046.stdout:7/943: dwrite d0/d4/d24/f51 [0,4194304] 0 2024-02-19T19:08:44.970 INFO:tasks.workunit.client.0.smithi046.stdout:1/925: creat d5/d2f/d9f/d3b/d4e/d91/d122/d13f/f141 x:0 0 0 2024-02-19T19:08:44.971 INFO:tasks.workunit.client.0.smithi046.stdout:7/944: write d0/d45/d71/d4b/d8d/fef [90044,100554] 0 2024-02-19T19:08:44.975 INFO:tasks.workunit.client.0.smithi046.stdout:9/689: dwrite db/d1e/f4c [4194304,4194304] 0 2024-02-19T19:08:44.975 INFO:tasks.workunit.client.0.smithi046.stdout:9/690: fsync db/d1e/d32/d47/d5b/d94/fa2 0 2024-02-19T19:08:44.977 INFO:tasks.workunit.client.0.smithi046.stdout:7/945: rename d0/d45/d56 to d0/d45/d4a/daf/d12b 0 2024-02-19T19:08:44.980 INFO:tasks.workunit.client.0.smithi046.stdout:5/873: dread d2/f81 [0,4194304] 0 2024-02-19T19:08:44.983 INFO:tasks.workunit.client.0.smithi046.stdout:1/926: getdents d5/d2f/d9f/d3b/d4e/d91/d122/d37 0 2024-02-19T19:08:44.989 INFO:tasks.workunit.client.0.smithi046.stdout:9/691: dread db/d1e/f4c [4194304,4194304] 0 2024-02-19T19:08:45.008 INFO:tasks.workunit.client.0.smithi046.stdout:1/927: dwrite d5/d21/d9a/dd0/fd1 [4194304,4194304] 0 2024-02-19T19:08:45.008 INFO:tasks.workunit.client.0.smithi046.stdout:1/928: dread - d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d75/dcf/d11e/f128 zero size 2024-02-19T19:08:45.008 INFO:tasks.workunit.client.0.smithi046.stdout:1/929: chown d5/d21 5 1 2024-02-19T19:08:45.009 INFO:tasks.workunit.client.0.smithi046.stdout:5/874: write d2/f70 [2263938,76573] 0 2024-02-19T19:08:45.009 INFO:tasks.workunit.client.0.smithi046.stdout:7/946: dwrite d0/d45/d71/d41/db8/f97 [0,4194304] 0 2024-02-19T19:08:45.010 INFO:tasks.workunit.client.0.smithi046.stdout:7/947: getdents d0/d45/d98/d116/db4 0 2024-02-19T19:08:45.010 INFO:tasks.workunit.client.0.smithi046.stdout:7/948: chown d0/d45/d98/d116/cac 732881249 1 2024-02-19T19:08:45.010 INFO:tasks.workunit.client.0.smithi046.stdout:7/949: readlink d0/d45/d71/d4b/lfa 0 2024-02-19T19:08:45.011 INFO:tasks.workunit.client.0.smithi046.stdout:9/692: truncate db/d1e/d32/f61 3600232 0 2024-02-19T19:08:45.012 INFO:tasks.workunit.client.0.smithi046.stdout:9/693: stat db/d20/d6b/d54/db7/dc6/da6/ca8 0 2024-02-19T19:08:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:9/694: mkdir db/d20/d8a/dd1 0 2024-02-19T19:08:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:9/695: fsync db/d20/f56 0 2024-02-19T19:08:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/875: write d2/dd/d26/f3d [4251249,73939] 0 2024-02-19T19:08:45.016 INFO:tasks.workunit.client.0.smithi046.stdout:9/696: creat db/d20/fd2 x:0 0 0 2024-02-19T19:08:45.016 INFO:tasks.workunit.client.0.smithi046.stdout:5/876: truncate d2/dd/d26/daa/fb2 3253689 0 2024-02-19T19:08:45.018 INFO:tasks.workunit.client.0.smithi046.stdout:5/877: mkdir d2/dd/d2f/d34/dfe/d117 0 2024-02-19T19:08:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:9/697: truncate db/d20/d6b/d54/db7/dc6/fa3 4169681 0 2024-02-19T19:08:45.030 INFO:tasks.workunit.client.0.smithi046.stdout:9/698: getdents db/d20/d71 0 2024-02-19T19:08:45.031 INFO:tasks.workunit.client.0.smithi046.stdout:9/699: link db/d20/d6b/d54/fa5 db/d20/d6b/d54/db7/dd0/fd3 0 2024-02-19T19:08:45.031 INFO:tasks.workunit.client.0.smithi046.stdout:9/700: write db/d1e/f88 [938272,2839] 0 2024-02-19T19:08:45.031 INFO:tasks.workunit.client.0.smithi046.stdout:9/701: truncate db/d20/fd2 797227 0 2024-02-19T19:08:45.033 INFO:tasks.workunit.client.0.smithi046.stdout:9/702: symlink db/d20/d8a/dd1/ld4 0 2024-02-19T19:08:45.034 INFO:tasks.workunit.client.0.smithi046.stdout:9/703: mkdir db/d1e/d52/dd5 0 2024-02-19T19:08:45.034 INFO:tasks.workunit.client.0.smithi046.stdout:9/704: fdatasync db/d20/d6b/d54/fab 0 2024-02-19T19:08:45.035 INFO:tasks.workunit.client.0.smithi046.stdout:9/705: unlink db/d1e/d52/fcd 0 2024-02-19T19:08:45.035 INFO:tasks.workunit.client.0.smithi046.stdout:9/706: creat db/d20/d4e/fd6 x:0 0 0 2024-02-19T19:08:45.040 INFO:tasks.workunit.client.0.smithi046.stdout:7/950: dwrite d0/d45/d4a/d58/f126 [0,4194304] 0 2024-02-19T19:08:45.040 INFO:tasks.workunit.client.0.smithi046.stdout:1/930: dwrite d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/fab [0,4194304] 0 2024-02-19T19:08:45.040 INFO:tasks.workunit.client.0.smithi046.stdout:1/931: chown d5/d21/d9a/dd0/d80/daf/db5/cc5 264226 1 2024-02-19T19:08:45.040 INFO:tasks.workunit.client.0.smithi046.stdout:5/878: dwrite d2/dd/d2f/d34/d5d/f61 [0,4194304] 0 2024-02-19T19:08:45.045 INFO:tasks.workunit.client.0.smithi046.stdout:7/951: creat d0/d45/d4a/d58/dc6/d83/f12c x:0 0 0 2024-02-19T19:08:45.046 INFO:tasks.workunit.client.0.smithi046.stdout:1/932: mknod d5/d21/d9a/dd0/d80/d139/c142 0 2024-02-19T19:08:45.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/879: mkdir d2/dd/d26/d118 0 2024-02-19T19:08:45.049 INFO:tasks.workunit.client.0.smithi046.stdout:7/952: link d0/d45/d98/d116/dbe/df9/fb3 d0/d4/d24/db9/f12d 0 2024-02-19T19:08:45.049 INFO:tasks.workunit.client.0.smithi046.stdout:7/953: creat d0/d45/d4a/d78/d9d/f12e x:0 0 0 2024-02-19T19:08:45.050 INFO:tasks.workunit.client.0.smithi046.stdout:1/933: link d5/f137 d5/d21/d9a/dd0/d80/daf/db5/dbe/f143 0 2024-02-19T19:08:45.051 INFO:tasks.workunit.client.0.smithi046.stdout:5/880: mkdir d2/dd/d26/da9/dbf/d119 0 2024-02-19T19:08:45.053 INFO:tasks.workunit.client.0.smithi046.stdout:5/881: mknod d2/dd/d26/da9/dbf/d119/c11a 0 2024-02-19T19:08:45.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/707: dwrite db/d20/fb3 [0,4194304] 0 2024-02-19T19:08:45.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/708: creat db/fd7 x:0 0 0 2024-02-19T19:08:45.065 INFO:tasks.workunit.client.0.smithi046.stdout:1/934: dread d5/d2f/d9f/f95 [0,4194304] 0 2024-02-19T19:08:45.066 INFO:tasks.workunit.client.0.smithi046.stdout:7/954: dwrite d0/d4/d24/fc7 [0,4194304] 0 2024-02-19T19:08:45.066 INFO:tasks.workunit.client.0.smithi046.stdout:7/955: creat d0/d45/d4a/daf/f12f x:0 0 0 2024-02-19T19:08:45.066 INFO:tasks.workunit.client.0.smithi046.stdout:7/956: write d0/d45/d98/d116/fa9 [1506519,108598] 0 2024-02-19T19:08:45.066 INFO:tasks.workunit.client.0.smithi046.stdout:7/957: dread - d0/d45/d98/d116/db4/fed zero size 2024-02-19T19:08:45.067 INFO:tasks.workunit.client.0.smithi046.stdout:1/935: truncate d5/d21/fc2 1060394 0 2024-02-19T19:08:45.072 INFO:tasks.workunit.client.0.smithi046.stdout:5/882: getdents d2/dd/d26/da9/dbf 0 2024-02-19T19:08:45.073 INFO:tasks.workunit.client.0.smithi046.stdout:1/936: rmdir d5/d2f/d9f/d3b/d4e 39 2024-02-19T19:08:45.073 INFO:tasks.workunit.client.0.smithi046.stdout:1/937: chown d5/d2f/d9f/d55/c89 7 1 2024-02-19T19:08:45.073 INFO:tasks.workunit.client.0.smithi046.stdout:1/938: read d5/d2f/d9f/d3b/d4e/d91/d122/d37/fa9 [2915929,93048] 0 2024-02-19T19:08:45.075 INFO:tasks.workunit.client.0.smithi046.stdout:1/939: creat d5/d2f/d9f/d3b/d4e/d91/d122/d37/db0/f144 x:0 0 0 2024-02-19T19:08:45.075 INFO:tasks.workunit.client.0.smithi046.stdout:1/940: fsync d5/d2f/d9f/d3b/d4e/d91/d122/f41 0 2024-02-19T19:08:45.075 INFO:tasks.workunit.client.0.smithi046.stdout:1/941: write d5/d21/d9a/dd0/d80/daf/f12b [820549,82805] 0 2024-02-19T19:08:45.075 INFO:tasks.workunit.client.0.smithi046.stdout:1/942: fsync d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/fab 0 2024-02-19T19:08:45.075 INFO:tasks.workunit.client.0.smithi046.stdout:1/943: fsync d5/d2f/d9f/d55/f63 0 2024-02-19T19:08:45.075 INFO:tasks.workunit.client.0.smithi046.stdout:1/944: fsync d5/d21/faa 0 2024-02-19T19:08:45.075 INFO:tasks.workunit.client.0.smithi046.stdout:1/945: chown d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/ffb 2361 1 2024-02-19T19:08:45.076 INFO:tasks.workunit.client.0.smithi046.stdout:7/958: read d0/d45/d71/da3/f93 [126709,28872] 0 2024-02-19T19:08:45.076 INFO:tasks.workunit.client.0.smithi046.stdout:7/959: creat d0/d45/d71/da3/dd0/f130 x:0 0 0 2024-02-19T19:08:45.076 INFO:tasks.workunit.client.0.smithi046.stdout:7/960: fsync d0/d45/d71/f4c 0 2024-02-19T19:08:45.079 INFO:tasks.workunit.client.0.smithi046.stdout:1/946: creat d5/d2f/f145 x:0 0 0 2024-02-19T19:08:45.079 INFO:tasks.workunit.client.0.smithi046.stdout:5/883: dread d2/fb [0,4194304] 0 2024-02-19T19:08:45.079 INFO:tasks.workunit.client.0.smithi046.stdout:1/947: creat d5/d21/d9a/dd0/d80/daf/db5/d10f/f146 x:0 0 0 2024-02-19T19:08:45.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/961: getdents d0/d45/d71 0 2024-02-19T19:08:45.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/962: truncate d0/d45/d4a/d78/d9d/f12e 677871 0 2024-02-19T19:08:45.080 INFO:tasks.workunit.client.0.smithi046.stdout:5/884: mknod d2/dd/d29/d72/c11b 0 2024-02-19T19:08:45.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:44 smithi046 ceph-mon[88928]: pgmap v137: 65 pgs: 1 peering, 1 active+undersized+remapped, 1 active+recovering+undersized+degraded+remapped, 9 active+recovery_wait+undersized+degraded+remapped, 53 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 64 MiB/s rd, 82 MiB/s wr, 397 op/s; 3354/39093 objects degraded (8.580%); 56 MiB/s, 382 objects/s recovering 2024-02-19T19:08:45.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:44 smithi046 ceph-mon[88928]: osdmap e86: 6 total, 6 up, 6 in 2024-02-19T19:08:45.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:44 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 3354/39093 objects degraded (8.580%), 10 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:45.082 INFO:tasks.workunit.client.0.smithi046.stdout:7/963: link d0/d45/d98/d116/dbe/df9/ld5 d0/d45/d4a/d58/dc6/d83/l131 0 2024-02-19T19:08:45.083 INFO:tasks.workunit.client.0.smithi046.stdout:5/885: creat d2/dd/d26/d118/f11c x:0 0 0 2024-02-19T19:08:45.084 INFO:tasks.workunit.client.0.smithi046.stdout:7/964: mknod d0/d45/d98/d120/c132 0 2024-02-19T19:08:45.088 INFO:tasks.workunit.client.0.smithi046.stdout:1/948: dread d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d75/fbc [0,4194304] 0 2024-02-19T19:08:45.088 INFO:tasks.workunit.client.0.smithi046.stdout:1/949: read d5/d21/d9a/dd0/f5d [3947267,40820] 0 2024-02-19T19:08:45.088 INFO:tasks.workunit.client.0.smithi046.stdout:1/950: creat d5/d2f/d9f/d3b/d4e/d91/d122/d37/d121/f147 x:0 0 0 2024-02-19T19:08:45.088 INFO:tasks.workunit.client.0.smithi046.stdout:1/951: creat d5/d2f/d9f/d3b/d4e/d91/d122/d13f/f148 x:0 0 0 2024-02-19T19:08:45.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/952: mkdir d5/d21/d9a/d149 0 2024-02-19T19:08:45.097 INFO:tasks.workunit.client.0.smithi046.stdout:5/886: dread d2/dd/d26/d65/d5f/fa6 [0,4194304] 0 2024-02-19T19:08:45.097 INFO:tasks.workunit.client.0.smithi046.stdout:5/887: readlink d2/dd/l18 0 2024-02-19T19:08:45.106 INFO:tasks.workunit.client.0.smithi046.stdout:5/888: dread d2/d27/d47/d54/db8/fc5 [0,4194304] 0 2024-02-19T19:08:45.107 INFO:tasks.workunit.client.0.smithi046.stdout:7/965: dwrite d0/d45/d4a/d58/fa7 [0,4194304] 0 2024-02-19T19:08:45.107 INFO:tasks.workunit.client.0.smithi046.stdout:7/966: chown d0/cb 440138291 1 2024-02-19T19:08:45.109 INFO:tasks.workunit.client.0.smithi046.stdout:7/967: creat d0/d45/d71/da3/f133 x:0 0 0 2024-02-19T19:08:45.111 INFO:tasks.workunit.client.0.smithi046.stdout:1/953: dwrite d5/f17 [4194304,4194304] 0 2024-02-19T19:08:45.111 INFO:tasks.workunit.client.0.smithi046.stdout:7/968: truncate d0/d45/d4a/d78/feb 2049680 0 2024-02-19T19:08:45.111 INFO:tasks.workunit.client.0.smithi046.stdout:7/969: symlink d0/d45/d71/d41/l134 0 2024-02-19T19:08:45.114 INFO:tasks.workunit.client.0.smithi046.stdout:7/970: unlink d0/d45/d98/d116/db4/f3a 0 2024-02-19T19:08:45.115 INFO:tasks.workunit.client.0.smithi046.stdout:7/971: truncate d0/d4/d24/db9/ffd 125962 0 2024-02-19T19:08:45.115 INFO:tasks.workunit.client.0.smithi046.stdout:7/972: creat d0/d45/d98/f135 x:0 0 0 2024-02-19T19:08:45.117 INFO:tasks.workunit.client.0.smithi046.stdout:7/973: rename d0/de2 to d0/d45/d71/d41/db8/dd1/d136 0 2024-02-19T19:08:45.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:44 smithi142 ceph-mon[69118]: pgmap v137: 65 pgs: 1 peering, 1 active+undersized+remapped, 1 active+recovering+undersized+degraded+remapped, 9 active+recovery_wait+undersized+degraded+remapped, 53 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 64 MiB/s rd, 82 MiB/s wr, 397 op/s; 3354/39093 objects degraded (8.580%); 56 MiB/s, 382 objects/s recovering 2024-02-19T19:08:45.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:44 smithi142 ceph-mon[69118]: osdmap e86: 6 total, 6 up, 6 in 2024-02-19T19:08:45.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:44 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 3354/39093 objects degraded (8.580%), 10 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:45.347 INFO:tasks.workunit.client.0.smithi046.stdout:3/751: sync 2024-02-19T19:08:45.347 INFO:tasks.workunit.client.0.smithi046.stdout:3/752: dread - da/d30/fce zero size 2024-02-19T19:08:45.347 INFO:tasks.workunit.client.0.smithi046.stdout:3/753: mkdir da/d30/d38/d54/dd2 0 2024-02-19T19:08:45.349 INFO:tasks.workunit.client.0.smithi046.stdout:3/754: creat da/d1d/d82/fd3 x:0 0 0 2024-02-19T19:08:45.349 INFO:tasks.workunit.client.0.smithi046.stdout:3/755: readlink da/d30/la8 0 2024-02-19T19:08:45.364 INFO:tasks.workunit.client.0.smithi046.stdout:3/756: dwrite da/d30/d38/d93/fb1 [0,4194304] 0 2024-02-19T19:08:45.366 INFO:tasks.workunit.client.0.smithi046.stdout:3/757: truncate da/d1d/d10/f21 198317 0 2024-02-19T19:08:45.367 INFO:tasks.workunit.client.0.smithi046.stdout:3/758: fdatasync da/d30/fce 0 2024-02-19T19:08:45.367 INFO:tasks.workunit.client.0.smithi046.stdout:3/759: rmdir da/d30/d38/d54 39 2024-02-19T19:08:45.376 INFO:tasks.workunit.client.0.smithi046.stdout:3/760: dread da/d30/d38/f7a [0,4194304] 0 2024-02-19T19:08:45.377 INFO:tasks.workunit.client.0.smithi046.stdout:3/761: rename da/d30/l84 to da/dbe/ld4 0 2024-02-19T19:08:45.378 INFO:tasks.workunit.client.0.smithi046.stdout:3/762: mkdir da/d1d/d63/d92/dd5 0 2024-02-19T19:08:45.380 INFO:tasks.workunit.client.0.smithi046.stdout:3/763: rename da/l94 to da/d1d/d8e/ld6 0 2024-02-19T19:08:45.389 INFO:tasks.workunit.client.0.smithi046.stdout:3/764: dread da/d30/d38/dc6/fc8 [0,4194304] 0 2024-02-19T19:08:45.404 INFO:tasks.workunit.client.0.smithi046.stdout:3/765: dwrite da/d1d/d10/f21 [0,4194304] 0 2024-02-19T19:08:45.423 INFO:tasks.workunit.client.0.smithi046.stdout:3/766: dwrite da/d30/d38/d54/f5b [0,4194304] 0 2024-02-19T19:08:45.423 INFO:tasks.workunit.client.0.smithi046.stdout:3/767: read da/d30/d38/f3d [2574536,95383] 0 2024-02-19T19:08:45.424 INFO:tasks.workunit.client.0.smithi046.stdout:3/768: symlink da/d1d/d3f/d8d/ld7 0 2024-02-19T19:08:45.424 INFO:tasks.workunit.client.0.smithi046.stdout:3/769: fsync da/d30/d38/d93/fd0 0 2024-02-19T19:08:45.424 INFO:tasks.workunit.client.0.smithi046.stdout:3/770: readlink da/d30/l73 0 2024-02-19T19:08:45.424 INFO:tasks.workunit.client.0.smithi046.stdout:3/771: write da/d30/f99 [1465130,64285] 0 2024-02-19T19:08:45.426 INFO:tasks.workunit.client.0.smithi046.stdout:3/772: rename da/d1d/d63/d64/d74/cb6 to da/d30/cd8 0 2024-02-19T19:08:45.426 INFO:tasks.workunit.client.0.smithi046.stdout:3/773: chown da/d1d/d82/d90 373 1 2024-02-19T19:08:45.427 INFO:tasks.workunit.client.0.smithi046.stdout:3/774: rmdir da/d1d/d63/d92/dd5 0 2024-02-19T19:08:45.428 INFO:tasks.workunit.client.0.smithi046.stdout:3/775: mkdir da/d1d/d63/dd9 0 2024-02-19T19:08:45.429 INFO:tasks.workunit.client.0.smithi046.stdout:3/776: symlink da/d1d/d3f/d8d/lda 0 2024-02-19T19:08:45.430 INFO:tasks.workunit.client.0.smithi046.stdout:3/777: creat da/d1d/d63/fdb x:0 0 0 2024-02-19T19:08:45.430 INFO:tasks.workunit.client.0.smithi046.stdout:3/778: chown da/d1d/d10/f1b 14 1 2024-02-19T19:08:45.431 INFO:tasks.workunit.client.0.smithi046.stdout:3/779: rename da/ca4 to da/d30/d38/cdc 0 2024-02-19T19:08:45.433 INFO:tasks.workunit.client.0.smithi046.stdout:3/780: dread da/d1d/d10/f2e [0,4194304] 0 2024-02-19T19:08:45.435 INFO:tasks.workunit.client.0.smithi046.stdout:3/781: getdents da/d1d/d3f 0 2024-02-19T19:08:45.435 INFO:tasks.workunit.client.0.smithi046.stdout:3/782: write da/d1d/d10/f2e [437842,12935] 0 2024-02-19T19:08:45.436 INFO:tasks.workunit.client.0.smithi046.stdout:3/783: dread da/d1d/d63/d92/fbb [0,4194304] 0 2024-02-19T19:08:45.444 INFO:tasks.workunit.client.0.smithi046.stdout:9/709: sync 2024-02-19T19:08:45.444 INFO:tasks.workunit.client.0.smithi046.stdout:5/889: sync 2024-02-19T19:08:45.445 INFO:tasks.workunit.client.0.smithi046.stdout:3/784: dread da/d30/d38/d54/f5b [0,4194304] 0 2024-02-19T19:08:45.446 INFO:tasks.workunit.client.0.smithi046.stdout:9/710: rename db/d20/d4e/f6a to db/d1e/d99/dc4/fd8 0 2024-02-19T19:08:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:9/711: write db/f7b [320503,83353] 0 2024-02-19T19:08:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:9/712: chown db/l14 12227 1 2024-02-19T19:08:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:3/785: dread da/d1d/d10/f6e [0,4194304] 0 2024-02-19T19:08:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/890: symlink d2/dd/d29/l11d 0 2024-02-19T19:08:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/891: fdatasync d2/dd/d26/da9/dbf/fd9 0 2024-02-19T19:08:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/892: chown d2/d27/d47/fee 392 1 2024-02-19T19:08:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/893: chown d2/dd/f1c 38 1 2024-02-19T19:08:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/894: creat d2/dd/d26/d65/d5f/dba/f11e x:0 0 0 2024-02-19T19:08:45.447 INFO:tasks.workunit.client.0.smithi046.stdout:9/713: symlink db/ld9 0 2024-02-19T19:08:45.449 INFO:tasks.workunit.client.0.smithi046.stdout:5/895: getdents d2/dd/d2f/d34/dfe 0 2024-02-19T19:08:45.450 INFO:tasks.workunit.client.0.smithi046.stdout:9/714: creat db/d20/d6b/d54/db7/dd0/fda x:0 0 0 2024-02-19T19:08:45.451 INFO:tasks.workunit.client.0.smithi046.stdout:9/715: symlink db/d82/dcf/ldb 0 2024-02-19T19:08:45.451 INFO:tasks.workunit.client.0.smithi046.stdout:9/716: readlink db/d1e/d52/l5e 0 2024-02-19T19:08:45.451 INFO:tasks.workunit.client.0.smithi046.stdout:9/717: creat db/d1e/d32/d47/d5b/d94/fdc x:0 0 0 2024-02-19T19:08:45.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/718: creat db/d20/d6b/d54/db7/dc6/da6/fdd x:0 0 0 2024-02-19T19:08:45.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/719: chown db/d1e/d32/d47/ca0 106484 1 2024-02-19T19:08:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/786: dread da/d1d/d10/f58 [0,4194304] 0 2024-02-19T19:08:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/896: rmdir d2/dd/d26/d65/d5f/dba 39 2024-02-19T19:08:45.457 INFO:tasks.workunit.client.0.smithi046.stdout:9/720: dread db/d20/d6b/f8d [0,4194304] 0 2024-02-19T19:08:45.457 INFO:tasks.workunit.client.0.smithi046.stdout:9/721: fsync db/d20/fb3 0 2024-02-19T19:08:45.457 INFO:tasks.workunit.client.0.smithi046.stdout:9/722: fdatasync db/f1c 0 2024-02-19T19:08:45.458 INFO:tasks.workunit.client.0.smithi046.stdout:5/897: mknod d2/dd/d2f/d34/c11f 0 2024-02-19T19:08:45.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/787: getdents da/d1d/d10 0 2024-02-19T19:08:45.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/898: symlink d2/d27/d47/l120 0 2024-02-19T19:08:45.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/788: mknod da/d1d/d3f/cdd 0 2024-02-19T19:08:45.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/899: rmdir d2/dd/d26/da9/dbf/dd7/df3 39 2024-02-19T19:08:45.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/900: creat d2/dd/d26/d65/f121 x:0 0 0 2024-02-19T19:08:45.472 INFO:tasks.workunit.client.0.smithi046.stdout:3/789: dread da/d1d/d8e/f97 [0,4194304] 0 2024-02-19T19:08:45.474 INFO:tasks.workunit.client.0.smithi046.stdout:9/723: dwrite db/d20/dac/faf [0,4194304] 0 2024-02-19T19:08:45.476 INFO:tasks.workunit.client.0.smithi046.stdout:9/724: getdents db/d82/dcf 0 2024-02-19T19:08:45.481 INFO:tasks.workunit.client.0.smithi046.stdout:3/790: dread da/d30/f99 [0,4194304] 0 2024-02-19T19:08:45.481 INFO:tasks.workunit.client.0.smithi046.stdout:3/791: write da/d1d/d10/f4c [2619384,6036] 0 2024-02-19T19:08:45.483 INFO:tasks.workunit.client.0.smithi046.stdout:5/901: dwrite d2/d27/d47/d54/f106 [0,4194304] 0 2024-02-19T19:08:45.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/902: truncate d2/dd/d29/d3b/d93/fae 5659210 0 2024-02-19T19:08:45.495 INFO:tasks.workunit.client.0.smithi046.stdout:3/792: dwrite da/d1d/d10/f9c [0,4194304] 0 2024-02-19T19:08:45.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/793: fsync da/f2c 0 2024-02-19T19:08:45.504 INFO:tasks.workunit.client.0.smithi046.stdout:3/794: dread da/d30/d38/dc6/fc8 [0,4194304] 0 2024-02-19T19:08:45.510 INFO:tasks.workunit.client.0.smithi046.stdout:3/795: write da/d1d/d8e/fb5 [1844390,8238] 0 2024-02-19T19:08:45.510 INFO:tasks.workunit.client.0.smithi046.stdout:3/796: chown da/d30/d38/d54/fa2 887319 1 2024-02-19T19:08:45.510 INFO:tasks.workunit.client.0.smithi046.stdout:3/797: write da/d1d/d82/fa3 [1040615,43849] 0 2024-02-19T19:08:45.510 INFO:tasks.workunit.client.0.smithi046.stdout:3/798: write da/d1d/fb0 [214046,58501] 0 2024-02-19T19:08:45.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/799: dwrite da/d30/d38/d66/f67 [0,4194304] 0 2024-02-19T19:08:45.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/800: truncate da/fc3 639061 0 2024-02-19T19:08:45.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/801: write da/d30/f57 [3029024,127250] 0 2024-02-19T19:08:45.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/802: mknod da/d1d/d8e/cde 0 2024-02-19T19:08:45.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/803: creat da/d1d/d63/d64/fdf x:0 0 0 2024-02-19T19:08:45.526 INFO:tasks.workunit.client.0.smithi046.stdout:3/804: creat da/d1d/d3f/fe0 x:0 0 0 2024-02-19T19:08:45.534 INFO:tasks.workunit.client.0.smithi046.stdout:3/805: write da/d1d/d10/f21 [1860563,89548] 0 2024-02-19T19:08:45.535 INFO:tasks.workunit.client.0.smithi046.stdout:3/806: rmdir da/d1d/d63/d64/d74 39 2024-02-19T19:08:45.535 INFO:tasks.workunit.client.0.smithi046.stdout:3/807: stat da/d30/c39 0 2024-02-19T19:08:45.536 INFO:tasks.workunit.client.0.smithi046.stdout:3/808: rename da/d30/c31 to da/d30/d38/d54/dd2/ce1 0 2024-02-19T19:08:45.553 INFO:tasks.workunit.client.0.smithi046.stdout:3/809: dwrite da/d1d/d10/f21 [4194304,4194304] 0 2024-02-19T19:08:45.556 INFO:tasks.workunit.client.0.smithi046.stdout:3/810: rmdir da/d8a/d9f 39 2024-02-19T19:08:45.556 INFO:tasks.workunit.client.0.smithi046.stdout:3/811: dread - da/d30/d38/d93/fcf zero size 2024-02-19T19:08:45.558 INFO:tasks.workunit.client.0.smithi046.stdout:3/812: dread da/d30/f99 [0,4194304] 0 2024-02-19T19:08:45.558 INFO:tasks.workunit.client.0.smithi046.stdout:3/813: creat da/d30/d38/d93/fe2 x:0 0 0 2024-02-19T19:08:45.559 INFO:tasks.workunit.client.0.smithi046.stdout:3/814: dread - da/d1d/d82/d90/fc1 zero size 2024-02-19T19:08:45.559 INFO:tasks.workunit.client.0.smithi046.stdout:3/815: stat da/d1d/d63/d64/cac 0 2024-02-19T19:08:45.560 INFO:tasks.workunit.client.0.smithi046.stdout:3/816: mknod da/d1d/d10/ce3 0 2024-02-19T19:08:45.560 INFO:tasks.workunit.client.0.smithi046.stdout:3/817: fsync da/d30/d38/d66/f67 0 2024-02-19T19:08:45.565 INFO:tasks.workunit.client.0.smithi046.stdout:3/818: read da/d30/d38/d54/f5b [1025574,74565] 0 2024-02-19T19:08:45.566 INFO:tasks.workunit.client.0.smithi046.stdout:3/819: truncate da/d1d/f60 3571198 0 2024-02-19T19:08:45.567 INFO:tasks.workunit.client.0.smithi046.stdout:3/820: link da/d1d/d63/cb8 da/d1d/d82/ce4 0 2024-02-19T19:08:45.569 INFO:tasks.workunit.client.0.smithi046.stdout:3/821: unlink da/d1d/d63/c87 0 2024-02-19T19:08:45.584 INFO:tasks.workunit.client.0.smithi046.stdout:3/822: dwrite da/d1d/d10/f1e [0,4194304] 0 2024-02-19T19:08:45.587 INFO:tasks.workunit.client.0.smithi046.stdout:3/823: creat da/d1d/d63/d64/d74/fe5 x:0 0 0 2024-02-19T19:08:45.587 INFO:tasks.workunit.client.0.smithi046.stdout:3/824: fdatasync da/d8a/d9f/fcd 0 2024-02-19T19:08:45.587 INFO:tasks.workunit.client.0.smithi046.stdout:3/825: truncate da/d30/d38/f7d 1311808 0 2024-02-19T19:08:45.590 INFO:tasks.workunit.client.0.smithi046.stdout:3/826: stat da/d1d/d63/d64/c88 0 2024-02-19T19:08:45.782 INFO:tasks.workunit.client.0.smithi046.stdout:3/827: sync 2024-02-19T19:08:45.782 INFO:tasks.workunit.client.0.smithi046.stdout:9/725: sync 2024-02-19T19:08:45.782 INFO:tasks.workunit.client.0.smithi046.stdout:3/828: readlink da/d1d/l17 0 2024-02-19T19:08:45.782 INFO:tasks.workunit.client.0.smithi046.stdout:9/726: chown db/d1e/d52/c62 452607340 1 2024-02-19T19:08:45.782 INFO:tasks.workunit.client.0.smithi046.stdout:5/903: sync 2024-02-19T19:08:45.783 INFO:tasks.workunit.client.0.smithi046.stdout:9/727: mkdir db/d20/d6b/d54/db7/dc6/da6/dde 0 2024-02-19T19:08:45.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/904: mknod d2/d27/c122 0 2024-02-19T19:08:45.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/905: mknod d2/dd/d26/da9/dbf/dd7/df3/c123 0 2024-02-19T19:08:45.786 INFO:tasks.workunit.client.0.smithi046.stdout:5/906: unlink d2/d27/d47/c6a 0 2024-02-19T19:08:45.788 INFO:tasks.workunit.client.0.smithi046.stdout:5/907: rmdir d2/dd/d2f/d34/dfe/d10e 0 2024-02-19T19:08:45.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/908: rename d2/dd/d29/d72/fa0 to d2/dd/d2f/d34/dfe/d117/f124 0 2024-02-19T19:08:45.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/909: write d2/dd/d29/d3b/ff8 [2540587,120783] 0 2024-02-19T19:08:45.792 INFO:tasks.workunit.client.0.smithi046.stdout:3/829: dread da/d30/d38/f8f [4194304,4194304] 0 2024-02-19T19:08:45.794 INFO:tasks.workunit.client.0.smithi046.stdout:3/830: mkdir da/d1d/d3f/de6 0 2024-02-19T19:08:45.794 INFO:tasks.workunit.client.0.smithi046.stdout:3/831: chown da/d30/fce 2961 1 2024-02-19T19:08:45.796 INFO:tasks.workunit.client.0.smithi046.stdout:3/832: rmdir da/d1d/d82 39 2024-02-19T19:08:45.796 INFO:tasks.workunit.client.0.smithi046.stdout:3/833: creat da/d30/d38/d66/fe7 x:0 0 0 2024-02-19T19:08:45.798 INFO:tasks.workunit.client.0.smithi046.stdout:3/834: truncate da/d30/d38/d54/f5b 3352581 0 2024-02-19T19:08:45.799 INFO:tasks.workunit.client.0.smithi046.stdout:3/835: symlink da/d1d/d63/d64/le8 0 2024-02-19T19:08:45.802 INFO:tasks.workunit.client.0.smithi046.stdout:3/836: rename da/d1d/d10/f4c to da/d1d/d82/d90/fe9 0 2024-02-19T19:08:45.813 INFO:tasks.workunit.client.0.smithi046.stdout:5/910: dwrite d2/d27/d4b/f8e [4194304,4194304] 0 2024-02-19T19:08:45.816 INFO:tasks.workunit.client.0.smithi046.stdout:5/911: rename d2/dd/d26/la7 to d2/d27/d47/d54/db8/l125 0 2024-02-19T19:08:45.820 INFO:tasks.workunit.client.0.smithi046.stdout:3/837: dwrite da/d1d/f28 [0,4194304] 0 2024-02-19T19:08:45.820 INFO:tasks.workunit.client.0.smithi046.stdout:3/838: dread - da/d30/d38/d66/fe7 zero size 2024-02-19T19:08:45.820 INFO:tasks.workunit.client.0.smithi046.stdout:3/839: chown da/d1d/f96 8539 1 2024-02-19T19:08:45.826 INFO:tasks.workunit.client.0.smithi046.stdout:5/912: rename d2/d27/d47/d54/db8/l125 to d2/dd/d2f/d34/dfe/l126 0 2024-02-19T19:08:45.826 INFO:tasks.workunit.client.0.smithi046.stdout:5/913: creat d2/dd/d26/da9/f127 x:0 0 0 2024-02-19T19:08:45.830 INFO:tasks.workunit.client.0.smithi046.stdout:5/914: mknod d2/dd/d114/c128 0 2024-02-19T19:08:45.832 INFO:tasks.workunit.client.0.smithi046.stdout:5/915: unlink d2/dd/d2f/d34/dfe/d117/f124 0 2024-02-19T19:08:45.832 INFO:tasks.workunit.client.0.smithi046.stdout:5/916: fsync d2/dd/d26/d65/fd3 0 2024-02-19T19:08:45.832 INFO:tasks.workunit.client.0.smithi046.stdout:5/917: chown d2/d27/d47/d54/db8/fc5 380635 1 2024-02-19T19:08:45.835 INFO:tasks.workunit.client.0.smithi046.stdout:5/918: unlink d2/f3c 0 2024-02-19T19:08:45.836 INFO:tasks.workunit.client.0.smithi046.stdout:5/919: unlink d2/dd/d2f/d34/f3e 0 2024-02-19T19:08:45.837 INFO:tasks.workunit.client.0.smithi046.stdout:5/920: mkdir d2/dd/d29/d3b/d93/d129 0 2024-02-19T19:08:45.839 INFO:tasks.workunit.client.0.smithi046.stdout:3/840: dwrite da/d1d/d8e/f97 [4194304,4194304] 0 2024-02-19T19:08:45.839 INFO:tasks.workunit.client.0.smithi046.stdout:5/921: rename d2/dd/d29/d72/l8b to d2/dd/d26/d65/d5f/dba/l12a 0 2024-02-19T19:08:45.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/841: symlink da/d30/d38/lea 0 2024-02-19T19:08:45.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/842: write da/d30/d38/d93/fe2 [870291,45898] 0 2024-02-19T19:08:45.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/843: stat da/d1d/d3f/fcb 0 2024-02-19T19:08:45.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/844: chown da/d1d/l27 5 1 2024-02-19T19:08:45.842 INFO:tasks.workunit.client.0.smithi046.stdout:5/922: mknod d2/c12b 0 2024-02-19T19:08:45.843 INFO:tasks.workunit.client.0.smithi046.stdout:5/923: getdents d2/d27/d47/d54/db8 0 2024-02-19T19:08:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/924: mkdir d2/dd/d2f/d34/dfe/d10c/d12c 0 2024-02-19T19:08:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/925: chown d2/dd/f20 53327152 1 2024-02-19T19:08:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/926: chown d2/d27/d4b/f96 31543998 1 2024-02-19T19:08:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/927: truncate d2/dd/d3f/fda 221355 0 2024-02-19T19:08:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/928: stat d2/dd/d29/l8c 0 2024-02-19T19:08:45.845 INFO:tasks.workunit.client.0.smithi046.stdout:5/929: creat d2/dd/d26/da9/dbf/dd7/df3/df6/f12d x:0 0 0 2024-02-19T19:08:45.845 INFO:tasks.workunit.client.0.smithi046.stdout:5/930: fdatasync d2/dd/d26/f48 0 2024-02-19T19:08:45.860 INFO:tasks.workunit.client.0.smithi046.stdout:6/855: dread d4/d6/d22/f7d [0,4194304] 0 2024-02-19T19:08:45.861 INFO:tasks.workunit.client.0.smithi046.stdout:1/954: dread d5/d21/d9a/dd0/d80/daf/db5/dbe/fc8 [0,4194304] 0 2024-02-19T19:08:45.861 INFO:tasks.workunit.client.0.smithi046.stdout:1/955: chown d5/c92 308310 1 2024-02-19T19:08:45.861 INFO:tasks.workunit.client.0.smithi046.stdout:6/856: rmdir d4/d6/d1c 39 2024-02-19T19:08:45.863 INFO:tasks.workunit.client.0.smithi046.stdout:3/845: dwrite da/d1d/d63/d64/d74/fe5 [0,4194304] 0 2024-02-19T19:08:45.863 INFO:tasks.workunit.client.0.smithi046.stdout:3/846: fdatasync da/d30/d38/dc6/fca 0 2024-02-19T19:08:45.863 INFO:tasks.workunit.client.0.smithi046.stdout:3/847: getdents da/d30/d38/d54/db2 0 2024-02-19T19:08:45.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/857: rename d4/d6/dd/d10/d29/d2d/d35/da5/df0/ff2 to d4/d6/dd/d10/d29/f10d 0 2024-02-19T19:08:45.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/858: chown d4/d6/d1c/d20/d98 3004 1 2024-02-19T19:08:45.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/859: readlink d4/l16 0 2024-02-19T19:08:45.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/931: dwrite d2/dd/f5c [0,4194304] 0 2024-02-19T19:08:45.869 INFO:tasks.workunit.client.0.smithi046.stdout:7/974: write d0/d45/d71/d41/d5f/fa4 [1293262,66205] 0 2024-02-19T19:08:45.869 INFO:tasks.workunit.client.0.smithi046.stdout:7/975: creat d0/d4/d68/f137 x:0 0 0 2024-02-19T19:08:45.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/932: symlink d2/dd/d29/d72/l12e 0 2024-02-19T19:08:45.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/933: readlink d2/dd/d29/l7c 0 2024-02-19T19:08:45.885 INFO:tasks.workunit.client.0.smithi046.stdout:7/976: dwrite d0/d45/d98/f101 [0,4194304] 0 2024-02-19T19:08:45.889 INFO:tasks.workunit.client.0.smithi046.stdout:7/977: rename d0/d45/d4a/d58/l96 to d0/d45/d71/d4b/l138 0 2024-02-19T19:08:45.889 INFO:tasks.workunit.client.0.smithi046.stdout:7/978: readlink d0/d45/d98/ld6 0 2024-02-19T19:08:45.889 INFO:tasks.workunit.client.0.smithi046.stdout:7/979: mkdir d0/d45/d98/d120/d139 0 2024-02-19T19:08:45.891 INFO:tasks.workunit.client.0.smithi046.stdout:7/980: rename d0/d45/d98/d116/dbe/df9/cec to d0/d4/d24/db9/d113/c13a 0 2024-02-19T19:08:45.891 INFO:tasks.workunit.client.0.smithi046.stdout:5/934: dwrite d2/d27/d4b/f96 [0,4194304] 0 2024-02-19T19:08:45.892 INFO:tasks.workunit.client.0.smithi046.stdout:5/935: mknod d2/dd/d26/da9/dbf/dd7/c12f 0 2024-02-19T19:08:45.892 INFO:tasks.workunit.client.0.smithi046.stdout:5/936: chown d2/dd/d26/d65/l111 490930776 1 2024-02-19T19:08:45.900 INFO:tasks.workunit.client.0.smithi046.stdout:7/981: dread d0/d45/fa6 [0,4194304] 0 2024-02-19T19:08:45.902 INFO:tasks.workunit.client.0.smithi046.stdout:7/982: dread d0/d4/d24/db9/ffd [0,4194304] 0 2024-02-19T19:08:45.902 INFO:tasks.workunit.client.0.smithi046.stdout:7/983: creat d0/d45/d98/f13b x:0 0 0 2024-02-19T19:08:45.903 INFO:tasks.workunit.client.0.smithi046.stdout:7/984: getdents d0/d45/d4a/d58/d91 0 2024-02-19T19:08:45.908 INFO:tasks.workunit.client.0.smithi046.stdout:5/937: dwrite d2/dd/f20 [0,4194304] 0 2024-02-19T19:08:45.910 INFO:tasks.workunit.client.0.smithi046.stdout:5/938: creat d2/d27/d4b/dfb/f130 x:0 0 0 2024-02-19T19:08:45.914 INFO:tasks.workunit.client.0.smithi046.stdout:7/985: write d0/d4/d24/db9/ffd [677643,26016] 0 2024-02-19T19:08:45.915 INFO:tasks.workunit.client.0.smithi046.stdout:7/986: link d0/d45/d98/d116/db4/f104 d0/d45/d71/d41/db8/dd1/d136/f13c 0 2024-02-19T19:08:45.917 INFO:tasks.workunit.client.0.smithi046.stdout:7/987: rename d0/ff to d0/d45/d71/d41/db8/f13d 0 2024-02-19T19:08:45.925 INFO:tasks.workunit.client.0.smithi046.stdout:7/988: read d0/d4/f7 [1605361,83158] 0 2024-02-19T19:08:45.925 INFO:tasks.workunit.client.0.smithi046.stdout:7/989: chown d0/d45/d71/d4b/f9e 25702371 1 2024-02-19T19:08:45.926 INFO:tasks.workunit.client.0.smithi046.stdout:7/990: fdatasync d0/d4/f7 0 2024-02-19T19:08:45.926 INFO:tasks.workunit.client.0.smithi046.stdout:7/991: write d0/d4/d7b/f111 [692445,88777] 0 2024-02-19T19:08:45.926 INFO:tasks.workunit.client.0.smithi046.stdout:7/992: creat d0/d45/d4a/d58/f13e x:0 0 0 2024-02-19T19:08:45.926 INFO:tasks.workunit.client.0.smithi046.stdout:7/993: readlink d0/l47 0 2024-02-19T19:08:45.926 INFO:tasks.workunit.client.0.smithi046.stdout:7/994: dread - d0/d45/d4a/d78/d9d/f102 zero size 2024-02-19T19:08:45.926 INFO:tasks.workunit.client.0.smithi046.stdout:7/995: mkdir d0/d45/d71/d41/d5f/d13f 0 2024-02-19T19:08:45.930 INFO:tasks.workunit.client.0.smithi046.stdout:5/939: dwrite d2/dd/d26/d65/fa4 [0,4194304] 0 2024-02-19T19:08:45.931 INFO:tasks.workunit.client.0.smithi046.stdout:5/940: dread - d2/d27/d47/d54/fc4 zero size 2024-02-19T19:08:45.933 INFO:tasks.workunit.client.0.smithi046.stdout:5/941: rmdir d2/d27/d47 39 2024-02-19T19:08:45.934 INFO:tasks.workunit.client.0.smithi046.stdout:5/942: mknod d2/dd/d26/d65/d5f/c131 0 2024-02-19T19:08:45.946 INFO:tasks.workunit.client.0.smithi046.stdout:7/996: dwrite d0/fc8 [4194304,4194304] 0 2024-02-19T19:08:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:7/997: rmdir d0/d45/d71/da3/dd0 39 2024-02-19T19:08:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:7/998: write d0/d4/d24/fbc [607723,59758] 0 2024-02-19T19:08:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:7/999: mknod d0/d45/d98/d116/dbe/d121/c140 0 2024-02-19T19:08:45.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/943: dwrite d2/d27/d4b/f73 [0,4194304] 0 2024-02-19T19:08:45.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/944: write d2/dd/d3f/faf [656186,93690] 0 2024-02-19T19:08:45.955 INFO:tasks.workunit.client.0.smithi046.stdout:5/945: dread d2/d5e/fe1 [0,4194304] 0 2024-02-19T19:08:45.957 INFO:tasks.workunit.client.0.smithi046.stdout:5/946: dread d2/dd/d26/d65/d5f/f92 [0,4194304] 0 2024-02-19T19:08:45.958 INFO:tasks.workunit.client.0.smithi046.stdout:5/947: mknod d2/dd/d29/d3b/d93/c132 0 2024-02-19T19:08:45.958 INFO:tasks.workunit.client.0.smithi046.stdout:5/948: chown d2/dd/d29/d89/fd2 2219 1 2024-02-19T19:08:45.958 INFO:tasks.workunit.client.0.smithi046.stdout:5/949: symlink d2/dd/d26/l133 0 2024-02-19T19:08:45.959 INFO:tasks.workunit.client.0.smithi046.stdout:5/950: chown d2/fb 353 1 2024-02-19T19:08:45.968 INFO:tasks.workunit.client.0.smithi046.stdout:5/951: dread d2/dd/f1c [0,4194304] 0 2024-02-19T19:08:45.968 INFO:tasks.workunit.client.0.smithi046.stdout:5/952: chown d2/d5e/cb6 117618744 1 2024-02-19T19:08:45.968 INFO:tasks.workunit.client.0.smithi046.stdout:5/953: creat d2/d27/d4b/dfb/f134 x:0 0 0 2024-02-19T19:08:45.969 INFO:tasks.workunit.client.0.smithi046.stdout:5/954: truncate d2/dd/f37 883960 0 2024-02-19T19:08:45.970 INFO:tasks.workunit.client.0.smithi046.stdout:5/955: dread - d2/dd/d26/daa/fb5 zero size 2024-02-19T19:08:45.970 INFO:tasks.workunit.client.0.smithi046.stdout:5/956: dread - d2/dd/d26/da9/dbf/fd9 zero size 2024-02-19T19:08:45.970 INFO:tasks.workunit.client.0.smithi046.stdout:5/957: mknod d2/dd/d2f/d34/dfe/d10c/d12c/c135 0 2024-02-19T19:08:45.971 INFO:tasks.workunit.client.0.smithi046.stdout:5/958: symlink d2/d27/d4b/dfb/l136 0 2024-02-19T19:08:45.978 INFO:tasks.workunit.client.0.smithi046.stdout:5/959: dread d2/dd/d29/d3b/d93/fae [0,4194304] 0 2024-02-19T19:08:45.979 INFO:tasks.workunit.client.0.smithi046.stdout:5/960: chown d2/dd/d2f/d34/l4e 528622910 1 2024-02-19T19:08:45.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/961: read d2/dd/f20 [23165,107081] 0 2024-02-19T19:08:45.985 INFO:tasks.workunit.client.0.smithi046.stdout:5/962: mkdir d2/dd/d26/da9/dbf/d119/d137 0 2024-02-19T19:08:45.985 INFO:tasks.workunit.client.0.smithi046.stdout:5/963: chown d2/dd/d3f/f7b 4520976 1 2024-02-19T19:08:45.987 INFO:tasks.workunit.client.0.smithi046.stdout:5/964: dread d2/d27/d47/d54/d57/fcc [0,4194304] 0 2024-02-19T19:08:45.988 INFO:tasks.workunit.client.0.smithi046.stdout:5/965: symlink d2/dd/d26/da9/dbf/dd7/df3/df6/l138 0 2024-02-19T19:08:45.995 INFO:tasks.workunit.client.0.smithi046.stdout:5/966: dread d2/dd/d2f/d34/d5d/f61 [0,4194304] 0 2024-02-19T19:08:45.995 INFO:tasks.workunit.client.0.smithi046.stdout:5/967: chown d2/dd/d26/d65/d5f 43370 1 2024-02-19T19:08:45.995 INFO:tasks.workunit.client.0.smithi046.stdout:5/968: truncate d2/d5e/ff1 864538 0 2024-02-19T19:08:46.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/969: dwrite d2/dd/d26/d65/d5f/fa6 [0,4194304] 0 2024-02-19T19:08:46.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/970: chown d2/d27/d47/d54/db8 580 1 2024-02-19T19:08:46.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/971: stat d2/dd/d2f/d34/d5d/c6c 0 2024-02-19T19:08:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:5/972: getdents d2/d27/d47/d54/d57 0 2024-02-19T19:08:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:5/973: fsync d2/dd/d29/fcd 0 2024-02-19T19:08:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/974: creat d2/dd/d26/da9/dbf/dd7/f139 x:0 0 0 2024-02-19T19:08:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/975: dread - d2/d27/f53 zero size 2024-02-19T19:08:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/976: chown d2/fb 185549135 1 2024-02-19T19:08:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/977: mkdir d2/d27/d13a 0 2024-02-19T19:08:46.017 INFO:tasks.workunit.client.0.smithi046.stdout:5/978: link d2/dd/d2f/d34/c11f d2/d27/d47/c13b 0 2024-02-19T19:08:46.017 INFO:tasks.workunit.client.0.smithi046.stdout:5/979: fdatasync d2/dd/d29/fcd 0 2024-02-19T19:08:46.019 INFO:tasks.workunit.client.0.smithi046.stdout:5/980: link d2/dd/d3f/la2 d2/l13c 0 2024-02-19T19:08:46.019 INFO:tasks.workunit.client.0.smithi046.stdout:5/981: write d2/dd/d26/da9/f127 [979502,92614] 0 2024-02-19T19:08:46.019 INFO:tasks.workunit.client.0.smithi046.stdout:5/982: truncate d2/dd/d26/d65/d5f/fe8 934918 0 2024-02-19T19:08:46.036 INFO:tasks.workunit.client.0.smithi046.stdout:5/983: dwrite d2/d27/f105 [0,4194304] 0 2024-02-19T19:08:46.057 INFO:tasks.workunit.client.0.smithi046.stdout:5/984: dwrite d2/dd/d3f/f7b [0,4194304] 0 2024-02-19T19:08:46.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:45 smithi046 ceph-mon[88928]: osdmap e87: 6 total, 6 up, 6 in 2024-02-19T19:08:46.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:46.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:46.093 INFO:tasks.workunit.client.0.smithi046.stdout:9/728: sync 2024-02-19T19:08:46.094 INFO:tasks.workunit.client.0.smithi046.stdout:9/729: getdents db/d20/d6b/d54 0 2024-02-19T19:08:46.174 INFO:tasks.workunit.client.0.smithi046.stdout:9/730: dwrite db/d20/f3f [0,4194304] 0 2024-02-19T19:08:46.175 INFO:tasks.workunit.client.0.smithi046.stdout:9/731: fdatasync db/d20/fd2 0 2024-02-19T19:08:46.175 INFO:tasks.workunit.client.0.smithi046.stdout:9/732: fdatasync db/d1e/d99/fae 0 2024-02-19T19:08:46.176 INFO:tasks.workunit.client.0.smithi046.stdout:9/733: mknod db/d20/dac/cdf 0 2024-02-19T19:08:46.187 INFO:tasks.workunit.client.0.smithi046.stdout:9/734: dwrite db/d1e/d32/d7c/fb2 [4194304,4194304] 0 2024-02-19T19:08:46.190 INFO:tasks.workunit.client.0.smithi046.stdout:9/735: rmdir db/d20/d4e/dcb 0 2024-02-19T19:08:46.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:45 smithi142 ceph-mon[69118]: osdmap e87: 6 total, 6 up, 6 in 2024-02-19T19:08:46.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:46.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:46.206 INFO:tasks.workunit.client.0.smithi046.stdout:9/736: dwrite db/d20/f39 [0,4194304] 0 2024-02-19T19:08:46.208 INFO:tasks.workunit.client.0.smithi046.stdout:9/737: getdents db/d1e 0 2024-02-19T19:08:46.208 INFO:tasks.workunit.client.0.smithi046.stdout:9/738: write db/d20/dac/fb9 [405454,107307] 0 2024-02-19T19:08:46.209 INFO:tasks.workunit.client.0.smithi046.stdout:9/739: stat db/d20/d4e/l69 0 2024-02-19T19:08:46.209 INFO:tasks.workunit.client.0.smithi046.stdout:9/740: creat db/d1e/d32/d47/d5b/fe0 x:0 0 0 2024-02-19T19:08:46.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/741: dwrite db/d1e/d32/f5f [0,4194304] 0 2024-02-19T19:08:46.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/742: fsync db/d20/d6b/d54/fab 0 2024-02-19T19:08:46.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/743: chown db/d1e/d32/d47/d5b/fe0 965 1 2024-02-19T19:08:46.231 INFO:tasks.workunit.client.0.smithi046.stdout:9/744: stat db/d53/l67 0 2024-02-19T19:08:46.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/745: link db/d1e/d32/d47/c55 db/d20/d6b/d54/ce1 0 2024-02-19T19:08:46.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/746: fdatasync db/d1e/d32/d47/d5b/f91 0 2024-02-19T19:08:46.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/747: dread - db/d20/d8a/d96/fa1 zero size 2024-02-19T19:08:46.237 INFO:tasks.workunit.client.0.smithi046.stdout:9/748: mkdir db/d1e/d99/dc4/de2 0 2024-02-19T19:08:46.239 INFO:tasks.workunit.client.0.smithi046.stdout:9/749: getdents db/d1e/d32/d7c 0 2024-02-19T19:08:46.240 INFO:tasks.workunit.client.0.smithi046.stdout:9/750: symlink db/d20/le3 0 2024-02-19T19:08:46.243 INFO:tasks.workunit.client.0.smithi046.stdout:9/751: dread db/f4b [0,4194304] 0 2024-02-19T19:08:46.244 INFO:tasks.workunit.client.0.smithi046.stdout:9/752: mknod db/d82/dcf/ce4 0 2024-02-19T19:08:46.385 INFO:tasks.workunit.client.0.smithi046.stdout:6/860: sync 2024-02-19T19:08:46.385 INFO:tasks.workunit.client.0.smithi046.stdout:1/956: sync 2024-02-19T19:08:46.386 INFO:tasks.workunit.client.0.smithi046.stdout:5/985: sync 2024-02-19T19:08:46.386 INFO:tasks.workunit.client.0.smithi046.stdout:3/848: sync 2024-02-19T19:08:46.386 INFO:tasks.workunit.client.0.smithi046.stdout:5/986: read - d2/dd/d26/d65/d5f/f88 zero size 2024-02-19T19:08:46.386 INFO:tasks.workunit.client.0.smithi046.stdout:3/849: chown da/d1d/d10/f21 3 1 2024-02-19T19:08:46.386 INFO:tasks.workunit.client.0.smithi046.stdout:9/753: sync 2024-02-19T19:08:46.386 INFO:tasks.workunit.client.0.smithi046.stdout:9/754: chown db/d1e/d32/d47/d5b/c85 37 1 2024-02-19T19:08:46.386 INFO:tasks.workunit.client.0.smithi046.stdout:9/755: fsync db/d1e/f4c 0 2024-02-19T19:08:46.387 INFO:tasks.workunit.client.0.smithi046.stdout:3/850: mknod da/d1d/d63/dd9/ceb 0 2024-02-19T19:08:46.387 INFO:tasks.workunit.client.0.smithi046.stdout:9/756: creat db/d20/d8a/dd1/fe5 x:0 0 0 2024-02-19T19:08:46.388 INFO:tasks.workunit.client.0.smithi046.stdout:9/757: truncate db/f87 2703258 0 2024-02-19T19:08:46.389 INFO:tasks.workunit.client.0.smithi046.stdout:3/851: getdents da/d30 0 2024-02-19T19:08:46.390 INFO:tasks.workunit.client.0.smithi046.stdout:9/758: rmdir db/d20/dac 39 2024-02-19T19:08:46.390 INFO:tasks.workunit.client.0.smithi046.stdout:9/759: chown db/d20/d8a/d96/lce 1087177 1 2024-02-19T19:08:46.391 INFO:tasks.workunit.client.0.smithi046.stdout:9/760: symlink db/d20/d8a/dd1/le6 0 2024-02-19T19:08:46.391 INFO:tasks.workunit.client.0.smithi046.stdout:9/761: write db/d20/d4e/f7a [446079,13415] 0 2024-02-19T19:08:46.398 INFO:tasks.workunit.client.0.smithi046.stdout:6/861: write d4/d6/f3b [5014352,112148] 0 2024-02-19T19:08:46.401 INFO:tasks.workunit.client.0.smithi046.stdout:6/862: unlink d4/d6/d22/f71 0 2024-02-19T19:08:46.401 INFO:tasks.workunit.client.0.smithi046.stdout:6/863: truncate d4/d6/d1c/d60/fc6 314239 0 2024-02-19T19:08:46.401 INFO:tasks.workunit.client.0.smithi046.stdout:6/864: stat d4/d6/dd/l53 0 2024-02-19T19:08:46.401 INFO:tasks.workunit.client.0.smithi046.stdout:6/865: dread - d4/d6/faa zero size 2024-02-19T19:08:46.405 INFO:tasks.workunit.client.0.smithi046.stdout:5/987: dread d2/d27/d47/fee [0,4194304] 0 2024-02-19T19:08:46.406 INFO:tasks.workunit.client.0.smithi046.stdout:5/988: unlink d2/dd/d3f/f7b 0 2024-02-19T19:08:46.408 INFO:tasks.workunit.client.0.smithi046.stdout:5/989: mknod d2/dd/d29/c13d 0 2024-02-19T19:08:46.408 INFO:tasks.workunit.client.0.smithi046.stdout:5/990: stat d2/f85 0 2024-02-19T19:08:46.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/991: link d2/d27/d47/d54/db8/fc5 d2/dd/d2f/d34/dfe/d117/f13e 0 2024-02-19T19:08:46.414 INFO:tasks.workunit.client.0.smithi046.stdout:9/762: dwrite db/d53/faa [0,4194304] 0 2024-02-19T19:08:46.426 INFO:tasks.workunit.client.0.smithi046.stdout:5/992: dwrite d2/dd/d26/d118/f11c [0,4194304] 0 2024-02-19T19:08:46.428 INFO:tasks.workunit.client.0.smithi046.stdout:5/993: creat d2/dd/d26/da9/dbf/dd7/df3/f13f x:0 0 0 2024-02-19T19:08:46.429 INFO:tasks.workunit.client.0.smithi046.stdout:5/994: mkdir d2/d27/d13a/d140 0 2024-02-19T19:08:46.429 INFO:tasks.workunit.client.0.smithi046.stdout:9/763: dwrite db/d20/d71/fa9 [0,4194304] 0 2024-02-19T19:08:46.439 INFO:tasks.workunit.client.0.smithi046.stdout:9/764: write db/d1e/d32/d47/d5b/f91 [1719710,121026] 0 2024-02-19T19:08:46.441 INFO:tasks.workunit.client.0.smithi046.stdout:9/765: rename db/d20/dac/fb9 to db/d1e/d99/dc4/fe7 0 2024-02-19T19:08:46.442 INFO:tasks.workunit.client.0.smithi046.stdout:9/766: fdatasync db/d53/f65 0 2024-02-19T19:08:46.442 INFO:tasks.workunit.client.0.smithi046.stdout:9/767: chown db/d20/d6b/d54/db7/dc6/l93 239484 1 2024-02-19T19:08:46.443 INFO:tasks.workunit.client.0.smithi046.stdout:9/768: creat db/d1e/d52/fe8 x:0 0 0 2024-02-19T19:08:46.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/995: dwrite d2/dd/d26/d118/f11c [0,4194304] 0 2024-02-19T19:08:46.448 INFO:tasks.workunit.client.0.smithi046.stdout:5/996: getdents d2/d5e 0 2024-02-19T19:08:46.450 INFO:tasks.workunit.client.0.smithi046.stdout:5/997: mknod d2/dd/d26/d65/d5f/dba/c141 0 2024-02-19T19:08:46.450 INFO:tasks.workunit.client.0.smithi046.stdout:9/769: getdents db/d20/dac 0 2024-02-19T19:08:46.451 INFO:tasks.workunit.client.0.smithi046.stdout:9/770: readlink db/l3b 0 2024-02-19T19:08:46.451 INFO:tasks.workunit.client.0.smithi046.stdout:5/998: rmdir d2/dd/d29/d72 39 2024-02-19T19:08:46.451 INFO:tasks.workunit.client.0.smithi046.stdout:5/999: creat d2/dd/d26/da9/f142 x:0 0 0 2024-02-19T19:08:46.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/771: mkdir db/d20/de9 0 2024-02-19T19:08:46.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/772: creat db/d53/fea x:0 0 0 2024-02-19T19:08:46.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/773: fsync db/f7b 0 2024-02-19T19:08:46.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/774: symlink db/d53/leb 0 2024-02-19T19:08:46.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/775: dread - db/d1e/d32/d47/d5b/d94/fdc zero size 2024-02-19T19:08:46.463 INFO:tasks.workunit.client.0.smithi046.stdout:9/776: rmdir db/d1e/d32/d47/d5b/d94 39 2024-02-19T19:08:46.464 INFO:tasks.workunit.client.0.smithi046.stdout:9/777: truncate db/d20/d6b/d54/f70 3875409 0 2024-02-19T19:08:46.465 INFO:tasks.workunit.client.0.smithi046.stdout:9/778: creat db/d20/dac/fec x:0 0 0 2024-02-19T19:08:46.465 INFO:tasks.workunit.client.0.smithi046.stdout:9/779: read - db/d1e/d32/fc5 zero size 2024-02-19T19:08:46.466 INFO:tasks.workunit.client.0.smithi046.stdout:9/780: rename db/d1e/d52/c62 to db/d20/d6b/dbf/ced 0 2024-02-19T19:08:46.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/781: creat db/d20/d6b/d54/db7/fee x:0 0 0 2024-02-19T19:08:46.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/782: creat db/d20/d8a/dd1/fef x:0 0 0 2024-02-19T19:08:46.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/783: chown db/d20/d6b/d54/db7/dc6/fa3 6200 1 2024-02-19T19:08:46.484 INFO:tasks.workunit.client.0.smithi046.stdout:9/784: dwrite db/d20/d6b/d54/db7/fc2 [0,4194304] 0 2024-02-19T19:08:46.658 INFO:tasks.workunit.client.0.smithi046.stdout:3/852: sync 2024-02-19T19:08:46.658 INFO:tasks.workunit.client.0.smithi046.stdout:6/866: sync 2024-02-19T19:08:46.659 INFO:tasks.workunit.client.0.smithi046.stdout:6/867: chown d4/d6/dd/d10/d29/l7c 0 1 2024-02-19T19:08:46.669 INFO:tasks.workunit.client.0.smithi046.stdout:6/868: dread d4/d6/dd/d10/f13 [4194304,4194304] 0 2024-02-19T19:08:46.686 INFO:tasks.workunit.client.0.smithi046.stdout:3/853: dwrite da/d30/d38/d93/fa0 [0,4194304] 0 2024-02-19T19:08:46.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/869: dwrite d4/d6/d1c/d20/ff4 [0,4194304] 0 2024-02-19T19:08:46.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/870: truncate d4/d6/d1c/d64/f9b 226480 0 2024-02-19T19:08:46.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/854: truncate da/d1d/d10/f1e 809009 0 2024-02-19T19:08:46.691 INFO:tasks.workunit.client.0.smithi046.stdout:6/871: symlink d4/d6/d22/db0/l10e 0 2024-02-19T19:08:46.696 INFO:tasks.workunit.client.0.smithi046.stdout:3/855: write da/d30/d38/d54/f5d [3462161,43703] 0 2024-02-19T19:08:46.700 INFO:tasks.workunit.client.0.smithi046.stdout:6/872: read d4/d6/dd/d10/d29/da2/fa8 [3067392,16807] 0 2024-02-19T19:08:46.701 INFO:tasks.workunit.client.0.smithi046.stdout:3/856: write da/d30/d38/f4a [2222070,119505] 0 2024-02-19T19:08:46.702 INFO:tasks.workunit.client.0.smithi046.stdout:3/857: symlink da/d30/d38/dc6/lec 0 2024-02-19T19:08:46.709 INFO:tasks.workunit.client.0.smithi046.stdout:6/873: dread d4/d6/f3b [0,4194304] 0 2024-02-19T19:08:46.709 INFO:tasks.workunit.client.0.smithi046.stdout:6/874: dread - d4/d6/dd/d10/d29/d2d/d35/d3c/fd8 zero size 2024-02-19T19:08:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:6/875: unlink d4/d6/d1c/d20/ld1 0 2024-02-19T19:08:46.713 INFO:tasks.workunit.client.0.smithi046.stdout:6/876: truncate d4/d6/dd/d10/d29/d2d/d35/f4f 1947369 0 2024-02-19T19:08:46.714 INFO:tasks.workunit.client.0.smithi046.stdout:6/877: mkdir d4/d6/d10f 0 2024-02-19T19:08:46.716 INFO:tasks.workunit.client.0.smithi046.stdout:6/878: unlink d4/d6/d1c/d20/d98/lff 0 2024-02-19T19:08:46.717 INFO:tasks.workunit.client.0.smithi046.stdout:6/879: truncate d4/d6/d1c/d20/d7a/fa0 51475 0 2024-02-19T19:08:46.717 INFO:tasks.workunit.client.0.smithi046.stdout:6/880: readlink d4/d6/d1c/l24 0 2024-02-19T19:08:46.718 INFO:tasks.workunit.client.0.smithi046.stdout:6/881: truncate d4/f6a 4886124 0 2024-02-19T19:08:46.720 INFO:tasks.workunit.client.0.smithi046.stdout:6/882: creat d4/d6/dd/d10/d29/da2/f110 x:0 0 0 2024-02-19T19:08:46.722 INFO:tasks.workunit.client.0.smithi046.stdout:3/858: dwrite da/d30/d38/d54/f5b [0,4194304] 0 2024-02-19T19:08:46.722 INFO:tasks.workunit.client.0.smithi046.stdout:6/883: symlink d4/d6/d1c/dd7/l111 0 2024-02-19T19:08:46.722 INFO:tasks.workunit.client.0.smithi046.stdout:6/884: write d4/f8f [38515,128747] 0 2024-02-19T19:08:46.727 INFO:tasks.workunit.client.0.smithi046.stdout:6/885: rmdir d4/d6/d1c/d64 39 2024-02-19T19:08:46.727 INFO:tasks.workunit.client.0.smithi046.stdout:6/886: chown d4/d6/dd/d10/d29/d2d/d35/d66/l95 526314056 1 2024-02-19T19:08:46.729 INFO:tasks.workunit.client.0.smithi046.stdout:6/887: creat d4/d6/d1c/d20/dc5/f112 x:0 0 0 2024-02-19T19:08:46.730 INFO:tasks.workunit.client.0.smithi046.stdout:6/888: truncate d4/f5 7399833 0 2024-02-19T19:08:46.734 INFO:tasks.workunit.client.0.smithi046.stdout:6/889: mkdir d4/d113 0 2024-02-19T19:08:46.735 INFO:tasks.workunit.client.0.smithi046.stdout:6/890: mkdir d4/d6/d1c/d114 0 2024-02-19T19:08:46.740 INFO:tasks.workunit.client.0.smithi046.stdout:9/785: sync 2024-02-19T19:08:46.741 INFO:tasks.workunit.client.0.smithi046.stdout:6/891: rmdir d4/d6/d1c/d20 39 2024-02-19T19:08:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:6/892: truncate d4/f39 3225366 0 2024-02-19T19:08:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:6/893: read - d4/d6/d1c/d20/d7a/fa4 zero size 2024-02-19T19:08:46.750 INFO:tasks.workunit.client.0.smithi046.stdout:9/786: dread db/d20/d6b/d54/db7/fc2 [0,4194304] 0 2024-02-19T19:08:46.751 INFO:tasks.workunit.client.0.smithi046.stdout:6/894: dread d4/d6/dd/d10/d29/da2/fa8 [0,4194304] 0 2024-02-19T19:08:46.751 INFO:tasks.workunit.client.0.smithi046.stdout:6/895: chown d4/d6/dd/d10/d29/da2/fe1 32243 1 2024-02-19T19:08:46.752 INFO:tasks.workunit.client.0.smithi046.stdout:6/896: link d4/f28 d4/d6/dd/d10/d29/d2d/d35/f115 0 2024-02-19T19:08:46.758 INFO:tasks.workunit.client.0.smithi046.stdout:9/787: dread db/d20/d6b/d54/fa5 [0,4194304] 0 2024-02-19T19:08:46.758 INFO:tasks.workunit.client.0.smithi046.stdout:6/897: dread d4/d6/dd/d10/d29/f36 [0,4194304] 0 2024-02-19T19:08:46.759 INFO:tasks.workunit.client.0.smithi046.stdout:9/788: mkdir db/d1e/d52/df0 0 2024-02-19T19:08:46.759 INFO:tasks.workunit.client.0.smithi046.stdout:9/789: fsync db/d20/d8a/d96/fa1 0 2024-02-19T19:08:46.759 INFO:tasks.workunit.client.0.smithi046.stdout:9/790: write db/d20/d6b/d54/db7/dc6/f8b [123031,100721] 0 2024-02-19T19:08:46.761 INFO:tasks.workunit.client.0.smithi046.stdout:6/898: creat d4/d6/dd/d10/d29/d2d/dc0/df1/f116 x:0 0 0 2024-02-19T19:08:46.761 INFO:tasks.workunit.client.0.smithi046.stdout:6/899: write d4/d6/d1c/d20/d7a/fd5 [718947,28521] 0 2024-02-19T19:08:46.761 INFO:tasks.workunit.client.0.smithi046.stdout:6/900: chown d4/d6/dd/f57 995700 1 2024-02-19T19:08:46.761 INFO:tasks.workunit.client.0.smithi046.stdout:6/901: chown d4/d6/d1c/d20/d7a/d10a/l10b 14642 1 2024-02-19T19:08:46.762 INFO:tasks.workunit.client.0.smithi046.stdout:9/791: rename db/d20/d6b/l58 to db/d53/lf1 0 2024-02-19T19:08:46.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/792: symlink db/d1e/d52/lf2 0 2024-02-19T19:08:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/793: rmdir db/d20/d6b/d54/db7 39 2024-02-19T19:08:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/794: write db/d20/d8a/dd1/fe5 [647261,8191] 0 2024-02-19T19:08:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/795: chown db/d1e/d32/f61 30993689 1 2024-02-19T19:08:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/796: creat db/d20/d8a/dd1/ff3 x:0 0 0 2024-02-19T19:08:46.768 INFO:tasks.workunit.client.0.smithi046.stdout:9/797: unlink db/fd7 0 2024-02-19T19:08:46.769 INFO:tasks.workunit.client.0.smithi046.stdout:9/798: symlink db/d20/d6b/lf4 0 2024-02-19T19:08:46.771 INFO:tasks.workunit.client.0.smithi046.stdout:9/799: unlink db/d1e/d32/d47/d5b/fe0 0 2024-02-19T19:08:46.771 INFO:tasks.workunit.client.0.smithi046.stdout:9/800: truncate db/d20/d6b/d54/fab 4197225 0 2024-02-19T19:08:46.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/902: dwrite d4/d6/dd/d10/d29/d2d/dc0/df1/f116 [0,4194304] 0 2024-02-19T19:08:46.781 INFO:tasks.workunit.client.0.smithi046.stdout:6/903: mkdir d4/d6/d1c/dd7/d117 0 2024-02-19T19:08:46.783 INFO:tasks.workunit.client.0.smithi046.stdout:6/904: mkdir d4/d6/d1c/d20/d118 0 2024-02-19T19:08:46.794 INFO:tasks.workunit.client.0.smithi046.stdout:6/905: dread d4/f39 [0,4194304] 0 2024-02-19T19:08:46.794 INFO:tasks.workunit.client.0.smithi046.stdout:9/801: dwrite db/d1e/d32/d7c/fb2 [0,4194304] 0 2024-02-19T19:08:46.795 INFO:tasks.workunit.client.0.smithi046.stdout:6/906: creat d4/d6/d1c/d60/def/f119 x:0 0 0 2024-02-19T19:08:46.797 INFO:tasks.workunit.client.0.smithi046.stdout:6/907: creat d4/d6/d10f/f11a x:0 0 0 2024-02-19T19:08:46.798 INFO:tasks.workunit.client.0.smithi046.stdout:6/908: mkdir d4/d6/d10f/d11b 0 2024-02-19T19:08:46.799 INFO:tasks.workunit.client.0.smithi046.stdout:6/909: symlink d4/d6/dd/d10/d29/l11c 0 2024-02-19T19:08:46.801 INFO:tasks.workunit.client.0.smithi046.stdout:6/910: mkdir d4/d6/dd/d10/d29/d2d/d35/d3c/d11d 0 2024-02-19T19:08:46.802 INFO:tasks.workunit.client.0.smithi046.stdout:6/911: getdents d4/d6/d1c/d20/dc5 0 2024-02-19T19:08:46.803 INFO:tasks.workunit.client.0.smithi046.stdout:6/912: write d4/d6/dd/d10/d29/d2d/f104 [246017,111568] 0 2024-02-19T19:08:46.804 INFO:tasks.workunit.client.0.smithi046.stdout:6/913: mknod d4/d6/dd/d10/d29/da2/db7/c11e 0 2024-02-19T19:08:46.805 INFO:tasks.workunit.client.0.smithi046.stdout:6/914: mkdir d4/d6/d11f 0 2024-02-19T19:08:46.806 INFO:tasks.workunit.client.0.smithi046.stdout:6/915: dread d4/f73 [0,4194304] 0 2024-02-19T19:08:46.807 INFO:tasks.workunit.client.0.smithi046.stdout:6/916: fdatasync d4/d6/d1c/d20/d7a/fa0 0 2024-02-19T19:08:46.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/917: mknod d4/d6/d1c/d60/c120 0 2024-02-19T19:08:46.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/918: chown d4/d6/d1c/d94/lc9 1 1 2024-02-19T19:08:46.818 INFO:tasks.workunit.client.0.smithi046.stdout:9/802: dwrite db/d1e/d52/f59 [0,4194304] 0 2024-02-19T19:08:46.819 INFO:tasks.workunit.client.0.smithi046.stdout:9/803: mkdir db/d1e/d52/dd5/df5 0 2024-02-19T19:08:46.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/804: fsync db/d20/d6b/f6e 0 2024-02-19T19:08:46.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/805: creat db/d20/d71/ff6 x:0 0 0 2024-02-19T19:08:46.825 INFO:tasks.workunit.client.0.smithi046.stdout:6/919: dwrite d4/d6/dd/d10/d29/d2d/d35/d3c/f72 [0,4194304] 0 2024-02-19T19:08:46.825 INFO:tasks.workunit.client.0.smithi046.stdout:6/920: chown d4/l93 1000518 1 2024-02-19T19:08:46.844 INFO:tasks.workunit.client.0.smithi046.stdout:9/806: dwrite db/d20/d6b/d54/fa5 [4194304,4194304] 0 2024-02-19T19:08:46.844 INFO:tasks.workunit.client.0.smithi046.stdout:6/921: write d4/d6/dd/d10/d29/d2d/dc0/df1/f116 [3981799,42645] 0 2024-02-19T19:08:46.844 INFO:tasks.workunit.client.0.smithi046.stdout:6/922: write d4/d6/d22/db0/db6/feb [486725,36522] 0 2024-02-19T19:08:46.872 INFO:tasks.workunit.client.0.smithi046.stdout:9/807: dwrite db/d20/d6b/d54/f70 [0,4194304] 0 2024-02-19T19:08:46.872 INFO:tasks.workunit.client.0.smithi046.stdout:9/808: write db/d1e/d99/dc4/fe7 [414021,124697] 0 2024-02-19T19:08:46.873 INFO:tasks.workunit.client.0.smithi046.stdout:9/809: getdents db/d20/d4e 0 2024-02-19T19:08:46.875 INFO:tasks.workunit.client.0.smithi046.stdout:9/810: unlink db/d1e/c4a 0 2024-02-19T19:08:46.875 INFO:tasks.workunit.client.0.smithi046.stdout:9/811: fdatasync db/d20/d6b/d54/db7/dc6/da6/fb6 0 2024-02-19T19:08:46.877 INFO:tasks.workunit.client.0.smithi046.stdout:9/812: link db/d1e/d32/c76 db/d1e/d99/dc4/cf7 0 2024-02-19T19:08:46.877 INFO:tasks.workunit.client.0.smithi046.stdout:9/813: creat db/d20/d71/ff8 x:0 0 0 2024-02-19T19:08:46.878 INFO:tasks.workunit.client.0.smithi046.stdout:9/814: symlink db/d20/d8a/lf9 0 2024-02-19T19:08:46.878 INFO:tasks.workunit.client.0.smithi046.stdout:9/815: write db/d20/d6b/d54/db7/fee [428610,124938] 0 2024-02-19T19:08:46.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/816: creat db/d20/ffa x:0 0 0 2024-02-19T19:08:46.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/817: write db/d20/d6b/d54/db7/dd0/fda [708634,48722] 0 2024-02-19T19:08:46.918 INFO:tasks.workunit.client.0.smithi046.stdout:9/818: dwrite db/d1e/d32/d47/d5b/d94/f9c [0,4194304] 0 2024-02-19T19:08:46.920 INFO:tasks.workunit.client.0.smithi046.stdout:9/819: mkdir db/d20/dac/dfb 0 2024-02-19T19:08:46.920 INFO:tasks.workunit.client.0.smithi046.stdout:9/820: write db/d20/d71/ff6 [74856,67367] 0 2024-02-19T19:08:46.920 INFO:tasks.workunit.client.0.smithi046.stdout:9/821: read - db/d20/d8a/dd1/fef zero size 2024-02-19T19:08:46.921 INFO:tasks.workunit.client.0.smithi046.stdout:9/822: rename db/d20/dac/fec to db/d20/d4e/ffc 0 2024-02-19T19:08:46.923 INFO:tasks.workunit.client.0.smithi046.stdout:9/823: unlink db/d20/c9a 0 2024-02-19T19:08:46.924 INFO:tasks.workunit.client.0.smithi046.stdout:1/957: dread d5/d21/d9a/dd0/f8c [0,4194304] 0 2024-02-19T19:08:46.926 INFO:tasks.workunit.client.0.smithi046.stdout:9/824: rename db/d1e/d52/fb4 to db/d1e/d32/ffd 0 2024-02-19T19:08:46.927 INFO:tasks.workunit.client.0.smithi046.stdout:1/958: creat d5/d2f/d9f/d3b/f14a x:0 0 0 2024-02-19T19:08:46.930 INFO:tasks.workunit.client.0.smithi046.stdout:9/825: getdents db/d1e/d32/d47/d5b 0 2024-02-19T19:08:46.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/826: mkdir db/d20/d6b/dbf/dfe 0 2024-02-19T19:08:46.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/827: stat db/d20/d6b 0 2024-02-19T19:08:46.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/828: fdatasync db/d20/d8a/d96/fa1 0 2024-02-19T19:08:46.938 INFO:tasks.workunit.client.0.smithi046.stdout:3/859: dwrite da/d30/f44 [0,4194304] 0 2024-02-19T19:08:46.940 INFO:tasks.workunit.client.0.smithi046.stdout:9/829: fsync db/d1e/d32/ffd 0 2024-02-19T19:08:46.942 INFO:tasks.workunit.client.0.smithi046.stdout:3/860: getdents da/d30/d38/d93 0 2024-02-19T19:08:46.942 INFO:tasks.workunit.client.0.smithi046.stdout:3/861: chown da/d30/d38/d54/dd2/ce1 18036957 1 2024-02-19T19:08:46.943 INFO:tasks.workunit.client.0.smithi046.stdout:3/862: dread da/d1d/d82/fa7 [0,4194304] 0 2024-02-19T19:08:46.943 INFO:tasks.workunit.client.0.smithi046.stdout:3/863: stat da/d1d/d63/d64/l71 0 2024-02-19T19:08:46.944 INFO:tasks.workunit.client.0.smithi046.stdout:3/864: unlink da/d1d/d3f/d8d/lbf 0 2024-02-19T19:08:46.945 INFO:tasks.workunit.client.0.smithi046.stdout:3/865: write da/d1d/d63/d64/fd1 [386492,118412] 0 2024-02-19T19:08:46.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/866: dread da/f20 [0,4194304] 0 2024-02-19T19:08:46.948 INFO:tasks.workunit.client.0.smithi046.stdout:3/867: mknod da/d1d/ced 0 2024-02-19T19:08:46.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/868: creat da/d1d/d82/d90/fee x:0 0 0 2024-02-19T19:08:46.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/869: read - da/d1d/d82/d90/fc1 zero size 2024-02-19T19:08:46.950 INFO:tasks.workunit.client.0.smithi046.stdout:3/870: chown da/d1d/d10/ce3 5360 1 2024-02-19T19:08:46.952 INFO:tasks.workunit.client.0.smithi046.stdout:1/959: dwrite d5/d21/d9a/dd0/d80/d139/f13a [0,4194304] 0 2024-02-19T19:08:46.955 INFO:tasks.workunit.client.0.smithi046.stdout:1/960: creat d5/d21/d9a/dd0/f14b x:0 0 0 2024-02-19T19:08:46.957 INFO:tasks.workunit.client.0.smithi046.stdout:9/830: write db/d1e/f49 [1306182,100575] 0 2024-02-19T19:08:46.957 INFO:tasks.workunit.client.0.smithi046.stdout:9/831: fdatasync db/d20/d4e/fd6 0 2024-02-19T19:08:46.957 INFO:tasks.workunit.client.0.smithi046.stdout:9/832: fdatasync db/d20/d6b/d54/fab 0 2024-02-19T19:08:46.957 INFO:tasks.workunit.client.0.smithi046.stdout:1/961: creat d5/d2f/d9f/f14c x:0 0 0 2024-02-19T19:08:46.959 INFO:tasks.workunit.client.0.smithi046.stdout:1/962: getdents d5/d21/d9a/dd0/d80 0 2024-02-19T19:08:46.959 INFO:tasks.workunit.client.0.smithi046.stdout:1/963: chown d5/d2f/d9f/d3b/d4e/d91/d122/f36 180 1 2024-02-19T19:08:46.959 INFO:tasks.workunit.client.0.smithi046.stdout:3/871: write da/d30/d38/d66/f67 [844383,94124] 0 2024-02-19T19:08:46.959 INFO:tasks.workunit.client.0.smithi046.stdout:3/872: stat da/dbe 0 2024-02-19T19:08:46.965 INFO:tasks.workunit.client.0.smithi046.stdout:9/833: write db/d20/d6b/d54/db7/dd0/fd3 [506927,23964] 0 2024-02-19T19:08:46.969 INFO:tasks.workunit.client.0.smithi046.stdout:9/834: creat db/d20/d6b/d54/db7/fff x:0 0 0 2024-02-19T19:08:46.972 INFO:tasks.workunit.client.0.smithi046.stdout:9/835: mkdir db/d20/d6b/d54/db7/dc6/d100 0 2024-02-19T19:08:46.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/836: mknod db/d20/d6b/dbf/c101 0 2024-02-19T19:08:46.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/837: chown db/d1e/d32/d47/d5b/d94/f9c 1074 1 2024-02-19T19:08:46.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/838: chown db/d20/d6f/c81 129348 1 2024-02-19T19:08:46.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/839: fsync db/f87 0 2024-02-19T19:08:46.976 INFO:tasks.workunit.client.0.smithi046.stdout:9/840: creat db/d82/f102 x:0 0 0 2024-02-19T19:08:46.978 INFO:tasks.workunit.client.0.smithi046.stdout:9/841: rename db/d20/cbc to db/d20/de9/c103 0 2024-02-19T19:08:46.980 INFO:tasks.workunit.client.0.smithi046.stdout:9/842: rename db/l16 to db/d20/d6b/l104 0 2024-02-19T19:08:46.981 INFO:tasks.workunit.client.0.smithi046.stdout:9/843: chown db/d20/d8a/dd1 165524088 1 2024-02-19T19:08:46.981 INFO:tasks.workunit.client.0.smithi046.stdout:9/844: write db/d1e/f49 [1572117,57361] 0 2024-02-19T19:08:46.991 INFO:tasks.workunit.client.0.smithi046.stdout:1/964: dwrite d5/d2f/d9f/d3b/f14a [0,4194304] 0 2024-02-19T19:08:46.991 INFO:tasks.workunit.client.0.smithi046.stdout:3/873: dwrite da/d1d/f60 [4194304,4194304] 0 2024-02-19T19:08:46.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/965: mknod d5/d2f/d9f/d3b/d4e/d91/d122/d37/d121/c14d 0 2024-02-19T19:08:46.996 INFO:tasks.workunit.client.0.smithi046.stdout:3/874: mkdir da/d1d/d63/d92/def 0 2024-02-19T19:08:46.996 INFO:tasks.workunit.client.0.smithi046.stdout:9/845: read db/d1e/f27 [4095099,70683] 0 2024-02-19T19:08:46.999 INFO:tasks.workunit.client.0.smithi046.stdout:3/875: symlink da/d1d/d3f/lf0 0 2024-02-19T19:08:47.002 INFO:tasks.workunit.client.0.smithi046.stdout:1/966: rename d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d87 to d5/d2f/d9f/d3b/d4e/d91/d14e 0 2024-02-19T19:08:47.003 INFO:tasks.workunit.client.0.smithi046.stdout:1/967: write d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/fab [4992801,21499] 0 2024-02-19T19:08:47.011 INFO:tasks.workunit.client.0.smithi046.stdout:3/876: dread da/d30/d38/f7d [0,4194304] 0 2024-02-19T19:08:47.015 INFO:tasks.workunit.client.0.smithi046.stdout:3/877: unlink da/d30/d38/d93/fb1 0 2024-02-19T19:08:47.015 INFO:tasks.workunit.client.0.smithi046.stdout:3/878: fsync da/d30/d38/d93/fe2 0 2024-02-19T19:08:47.018 INFO:tasks.workunit.client.0.smithi046.stdout:3/879: mkdir da/d30/d38/dc6/df1 0 2024-02-19T19:08:47.027 INFO:tasks.workunit.client.0.smithi046.stdout:9/846: dwrite db/d20/fb3 [0,4194304] 0 2024-02-19T19:08:47.027 INFO:tasks.workunit.client.0.smithi046.stdout:1/968: dwrite d5/d21/d9a/df3/f110 [0,4194304] 0 2024-02-19T19:08:47.029 INFO:tasks.workunit.client.0.smithi046.stdout:9/847: mkdir db/d1e/d99/d105 0 2024-02-19T19:08:47.035 INFO:tasks.workunit.client.0.smithi046.stdout:1/969: mkdir d5/d2f/d9f/d3b/d4e/d91/d122/d37/d121/d14f 0 2024-02-19T19:08:47.036 INFO:tasks.workunit.client.0.smithi046.stdout:3/880: dwrite da/d1d/d63/d64/fd1 [0,4194304] 0 2024-02-19T19:08:47.036 INFO:tasks.workunit.client.0.smithi046.stdout:9/848: rename db/d20/d6b/d54/db7/dc6/da6/fdd to db/d1e/d32/d7c/f106 0 2024-02-19T19:08:47.038 INFO:tasks.workunit.client.0.smithi046.stdout:1/970: link d5/f1f d5/d21/d9a/dd0/d140/f150 0 2024-02-19T19:08:47.038 INFO:tasks.workunit.client.0.smithi046.stdout:1/971: write d5/d2f/d9f/d3b/d4e/d91/d122/d13f/f141 [528851,48518] 0 2024-02-19T19:08:47.039 INFO:tasks.workunit.client.0.smithi046.stdout:9/849: symlink db/d1e/d52/l107 0 2024-02-19T19:08:47.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/850: read - db/d20/d8a/dd1/ff3 zero size 2024-02-19T19:08:47.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/851: write db/d20/f3f [4322846,76628] 0 2024-02-19T19:08:47.044 INFO:tasks.workunit.client.0.smithi046.stdout:3/881: dread da/d30/f44 [0,4194304] 0 2024-02-19T19:08:47.047 INFO:tasks.workunit.client.0.smithi046.stdout:3/882: rename da/d1d/d8e/fb5 to da/d1d/d3f/de6/ff2 0 2024-02-19T19:08:47.049 INFO:tasks.workunit.client.0.smithi046.stdout:3/883: link da/d1d/d63/d64/f7b da/d1d/ff3 0 2024-02-19T19:08:47.049 INFO:tasks.workunit.client.0.smithi046.stdout:3/884: write da/d1d/fb0 [414349,61314] 0 2024-02-19T19:08:47.050 INFO:tasks.workunit.client.0.smithi046.stdout:9/852: dread db/d20/d6b/f8d [0,4194304] 0 2024-02-19T19:08:47.051 INFO:tasks.workunit.client.0.smithi046.stdout:9/853: write db/d1e/d52/fe8 [747791,119919] 0 2024-02-19T19:08:47.051 INFO:tasks.workunit.client.0.smithi046.stdout:9/854: truncate db/f24 4583805 0 2024-02-19T19:08:47.051 INFO:tasks.workunit.client.0.smithi046.stdout:3/885: creat da/d1d/d3f/d8d/ff4 x:0 0 0 2024-02-19T19:08:47.051 INFO:tasks.workunit.client.0.smithi046.stdout:3/886: dread - da/d30/d38/d93/fcf zero size 2024-02-19T19:08:47.051 INFO:tasks.workunit.client.0.smithi046.stdout:9/855: mkdir db/d20/d108 0 2024-02-19T19:08:47.052 INFO:tasks.workunit.client.0.smithi046.stdout:9/856: chown db/d20/d6b/dbf/dfe 295 1 2024-02-19T19:08:47.052 INFO:tasks.workunit.client.0.smithi046.stdout:9/857: chown db/d1e/d99/cc8 12 1 2024-02-19T19:08:47.052 INFO:tasks.workunit.client.0.smithi046.stdout:3/887: unlink da/d30/l43 0 2024-02-19T19:08:47.053 INFO:tasks.workunit.client.0.smithi046.stdout:3/888: mkdir da/dbe/df5 0 2024-02-19T19:08:47.053 INFO:tasks.workunit.client.0.smithi046.stdout:3/889: chown da/d1d/f96 1158163 1 2024-02-19T19:08:47.054 INFO:tasks.workunit.client.0.smithi046.stdout:3/890: chown da/l14 1 1 2024-02-19T19:08:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:1/972: dwrite d5/d21/d9a/dd0/f5d [0,4194304] 0 2024-02-19T19:08:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:9/858: read db/d1e/f4c [6804408,29059] 0 2024-02-19T19:08:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:9/859: dread - db/d20/d8a/d96/f9b zero size 2024-02-19T19:08:47.062 INFO:tasks.workunit.client.0.smithi046.stdout:1/973: link d5/d21/d9a/dd0/f47 d5/d21/d9a/dd0/d140/f151 0 2024-02-19T19:08:47.062 INFO:tasks.workunit.client.0.smithi046.stdout:3/891: write da/d1d/f28 [3405514,84516] 0 2024-02-19T19:08:47.063 INFO:tasks.workunit.client.0.smithi046.stdout:9/860: rename db/d1e/d52/l5e to db/d20/d6b/d54/db7/dc6/da6/dde/l109 0 2024-02-19T19:08:47.063 INFO:tasks.workunit.client.0.smithi046.stdout:9/861: write db/d20/d6f/f86 [951294,107163] 0 2024-02-19T19:08:47.065 INFO:tasks.workunit.client.0.smithi046.stdout:1/974: unlink d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d75/dcf/ff0 0 2024-02-19T19:08:47.065 INFO:tasks.workunit.client.0.smithi046.stdout:1/975: creat d5/d2f/d5e/f152 x:0 0 0 2024-02-19T19:08:47.065 INFO:tasks.workunit.client.0.smithi046.stdout:3/892: rmdir da/d1d/d10 39 2024-02-19T19:08:47.066 INFO:tasks.workunit.client.0.smithi046.stdout:9/862: mknod db/d20/d6f/c10a 0 2024-02-19T19:08:47.066 INFO:tasks.workunit.client.0.smithi046.stdout:9/863: stat db/d20/d6b/dbf/dfe 0 2024-02-19T19:08:47.068 INFO:tasks.workunit.client.0.smithi046.stdout:1/976: getdents d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/d75 0 2024-02-19T19:08:47.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/893: symlink da/d30/lf6 0 2024-02-19T19:08:47.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/894: fsync da/d1d/d10/f6e 0 2024-02-19T19:08:47.072 INFO:tasks.workunit.client.0.smithi046.stdout:1/977: dread d5/d2f/d9f/d3b/d4e/d91/d14e/f11a [0,4194304] 0 2024-02-19T19:08:47.072 INFO:tasks.workunit.client.0.smithi046.stdout:1/978: stat d5/d2f/d9f/d3b/d4e/d91/d122/d37/d64/dce/lda 0 2024-02-19T19:08:47.073 INFO:tasks.workunit.client.0.smithi046.stdout:1/979: symlink d5/d21/d9a/dd0/d129/l153 0 2024-02-19T19:08:47.074 INFO:tasks.workunit.client.0.smithi046.stdout:1/980: creat d5/d2f/d9f/d3b/d3c/d3f/d11d/f154 x:0 0 0 2024-02-19T19:08:47.079 INFO:tasks.workunit.client.0.smithi046.stdout:3/895: read da/d1d/d8e/f97 [4582167,18413] 0 2024-02-19T19:08:47.083 INFO:tasks.workunit.client.0.smithi046.stdout:3/896: dread da/d1d/d3f/f76 [0,4194304] 0 2024-02-19T19:08:47.084 INFO:tasks.workunit.client.0.smithi046.stdout:1/981: write d5/d13/f31 [3482396,105682] 0 2024-02-19T19:08:47.085 INFO:tasks.workunit.client.0.smithi046.stdout:1/982: write d5/d21/f69 [718764,114377] 0 2024-02-19T19:08:47.087 INFO:tasks.workunit.client.0.smithi046.stdout:1/983: symlink d5/d21/d9a/dd0/d80/daf/l155 0 2024-02-19T19:08:47.090 INFO:tasks.workunit.client.0.smithi046.stdout:1/984: rename d5/l4d to d5/d2f/d9f/d3b/d4e/d76/l156 0 2024-02-19T19:08:47.090 INFO:tasks.workunit.client.0.smithi046.stdout:1/985: fsync d5/d2f/d9f/dc9/ff8 0 2024-02-19T19:08:47.092 INFO:tasks.workunit.client.0.smithi046.stdout:1/986: mkdir d5/d21/d9a/dd0/d80/daf/db5/dbe/d157 0 2024-02-19T19:08:47.092 INFO:tasks.workunit.client.0.smithi046.stdout:1/987: chown d5/f17 32490304 1 2024-02-19T19:08:47.092 INFO:tasks.workunit.client.0.smithi046.stdout:1/988: write d5/d2f/d9f/f14c [49151,128092] 0 2024-02-19T19:08:47.092 INFO:tasks.workunit.client.0.smithi046.stdout:1/989: write d5/d21/d9a/dd0/d80/daf/f12b [1528019,15304] 0 2024-02-19T19:08:47.094 INFO:tasks.workunit.client.0.smithi046.stdout:1/990: creat d5/d21/d9a/dd0/d80/daf/db5/f158 x:0 0 0 2024-02-19T19:08:47.095 INFO:tasks.workunit.client.0.smithi046.stdout:1/991: rename d5/c16 to d5/d13/c159 0 2024-02-19T19:08:47.096 INFO:tasks.workunit.client.0.smithi046.stdout:1/992: creat d5/d21/d9a/dd0/d80/daf/db5/dbe/f15a x:0 0 0 2024-02-19T19:08:47.098 INFO:tasks.workunit.client.0.smithi046.stdout:1/993: rename d5/d2f/d9f/d55/c56 to d5/d21/d9a/dd0/d80/daf/db5/dbe/dd3/c15b 0 2024-02-19T19:08:47.102 INFO:tasks.workunit.client.0.smithi046.stdout:3/897: dwrite da/d1d/d63/f85 [0,4194304] 0 2024-02-19T19:08:47.103 INFO:tasks.workunit.client.0.smithi046.stdout:3/898: creat da/dbe/df5/ff7 x:0 0 0 2024-02-19T19:08:47.103 INFO:tasks.workunit.client.0.smithi046.stdout:3/899: chown da/d1d/fb0 103190 1 2024-02-19T19:08:47.121 INFO:tasks.workunit.client.0.smithi046.stdout:1/994: dwrite d5/d2f/d9f/d3b/d4e/d91/d122/f94 [0,4194304] 0 2024-02-19T19:08:47.121 INFO:tasks.workunit.client.0.smithi046.stdout:1/995: chown d5/d21/d9a/dd0/d80/l96 32166553 1 2024-02-19T19:08:47.121 INFO:tasks.workunit.client.0.smithi046.stdout:3/900: dwrite da/d1d/d3f/fab [0,4194304] 0 2024-02-19T19:08:47.123 INFO:tasks.workunit.client.0.smithi046.stdout:1/996: symlink d5/d2f/d9f/dc4/l15c 0 2024-02-19T19:08:47.125 INFO:tasks.workunit.client.0.smithi046.stdout:3/901: rename da/d1d/d3f/fe0 to da/d1d/d3f/de6/ff8 0 2024-02-19T19:08:47.128 INFO:tasks.workunit.client.0.smithi046.stdout:1/997: rename d5/d2f/d9f/d3b/de9 to d5/d2f/d9f/d15d 0 2024-02-19T19:08:47.150 INFO:tasks.workunit.client.0.smithi046.stdout:1/998: dwrite d5/d2f/d9f/d55/f63 [0,4194304] 0 2024-02-19T19:08:47.160 INFO:tasks.workunit.client.0.smithi046.stdout:1/999: write d5/d21/d9a/dd0/f4b [3681856,48116] 0 2024-02-19T19:08:47.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:46 smithi142 ceph-mon[69118]: pgmap v140: 65 pgs: 1 peering, 1 active+undersized+remapped, 2 active+recovering+undersized+degraded+remapped, 7 active+recovery_wait+undersized+degraded+remapped, 54 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 71 MiB/s rd, 79 MiB/s wr, 388 op/s; 2728/38286 objects degraded (7.125%); 72 MiB/s, 505 objects/s recovering 2024-02-19T19:08:47.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:46 smithi142 ceph-mon[69118]: osdmap e88: 6 total, 6 up, 6 in 2024-02-19T19:08:47.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:46 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:47.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:46 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:47.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:46 smithi046 ceph-mon[88928]: pgmap v140: 65 pgs: 1 peering, 1 active+undersized+remapped, 2 active+recovering+undersized+degraded+remapped, 7 active+recovery_wait+undersized+degraded+remapped, 54 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 71 MiB/s rd, 79 MiB/s wr, 388 op/s; 2728/38286 objects degraded (7.125%); 72 MiB/s, 505 objects/s recovering 2024-02-19T19:08:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:46 smithi046 ceph-mon[88928]: osdmap e88: 6 total, 6 up, 6 in 2024-02-19T19:08:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:46 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:47.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:46 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:47.891 INFO:tasks.workunit.client.0.smithi046.stdout:6/923: sync 2024-02-19T19:08:47.891 INFO:tasks.workunit.client.0.smithi046.stdout:6/924: rmdir d4/d6/d1c/d20/d98/dc4 39 2024-02-19T19:08:47.893 INFO:tasks.workunit.client.0.smithi046.stdout:6/925: unlink d4/d6/dd/d10/d29/da2/fa8 0 2024-02-19T19:08:47.893 INFO:tasks.workunit.client.0.smithi046.stdout:6/926: truncate d4/d6/d22/fb1 931237 0 2024-02-19T19:08:47.894 INFO:tasks.workunit.client.0.smithi046.stdout:6/927: mkdir d4/d6/dd/d10/d29/d2d/d35/d3c/d121 0 2024-02-19T19:08:47.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/928: rename d4/d6/d22/fb1 to d4/d6/d1c/d20/d98/dc4/dce/f122 0 2024-02-19T19:08:47.901 INFO:tasks.workunit.client.0.smithi046.stdout:6/929: write d4/d6/dd/d10/f13 [4495084,87] 0 2024-02-19T19:08:47.908 INFO:tasks.workunit.client.0.smithi046.stdout:6/930: write d4/d6/d1c/d60/fc6 [839078,22971] 0 2024-02-19T19:08:47.920 INFO:tasks.workunit.client.0.smithi046.stdout:6/931: write d4/d6/dd/d10/d29/f48 [890899,26215] 0 2024-02-19T19:08:47.920 INFO:tasks.workunit.client.0.smithi046.stdout:6/932: write d4/d6/d1c/d60/f85 [1020565,4653] 0 2024-02-19T19:08:47.921 INFO:tasks.workunit.client.0.smithi046.stdout:6/933: unlink d4/d6/dd/d10/d29/d2d/d35/f79 0 2024-02-19T19:08:47.921 INFO:tasks.workunit.client.0.smithi046.stdout:6/934: read d4/d6/dd/f56 [229277,121908] 0 2024-02-19T19:08:47.922 INFO:tasks.workunit.client.0.smithi046.stdout:6/935: fdatasync d4/d6/d1c/d20/dc5/fea 0 2024-02-19T19:08:48.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:47 smithi046 ceph-mon[88928]: osdmap e89: 6 total, 6 up, 6 in 2024-02-19T19:08:48.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:47 smithi142 ceph-mon[69118]: osdmap e89: 6 total, 6 up, 6 in 2024-02-19T19:08:48.277 INFO:tasks.workunit.client.0.smithi046.stdout:9/864: sync 2024-02-19T19:08:48.277 INFO:tasks.workunit.client.0.smithi046.stdout:3/902: sync 2024-02-19T19:08:48.277 INFO:tasks.workunit.client.0.smithi046.stdout:3/903: chown da/d1d/d8e 27 1 2024-02-19T19:08:48.278 INFO:tasks.workunit.client.0.smithi046.stdout:9/865: link db/d1e/d32/d47/d5b/f89 db/d20/d71/f10b 0 2024-02-19T19:08:48.279 INFO:tasks.workunit.client.0.smithi046.stdout:3/904: unlink da/d1d/d63/d64/d74/fe5 0 2024-02-19T19:08:48.285 INFO:tasks.workunit.client.0.smithi046.stdout:9/866: dread db/d20/f56 [0,4194304] 0 2024-02-19T19:08:48.296 INFO:tasks.workunit.client.0.smithi046.stdout:3/905: dwrite da/d1d/d3f/fcb [0,4194304] 0 2024-02-19T19:08:48.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/906: creat da/d30/d38/d54/dd2/ff9 x:0 0 0 2024-02-19T19:08:48.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/907: write da/d1d/d3f/de6/ff8 [718597,94220] 0 2024-02-19T19:08:48.304 INFO:tasks.workunit.client.0.smithi046.stdout:9/867: dwrite db/d1e/d99/dc4/fe7 [0,4194304] 0 2024-02-19T19:08:48.304 INFO:tasks.workunit.client.0.smithi046.stdout:9/868: chown db/d20/d6b/l104 500815229 1 2024-02-19T19:08:48.307 INFO:tasks.workunit.client.0.smithi046.stdout:3/908: dread da/d1d/d10/f9c [0,4194304] 0 2024-02-19T19:08:48.307 INFO:tasks.workunit.client.0.smithi046.stdout:9/869: dread db/f4b [0,4194304] 0 2024-02-19T19:08:48.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/909: creat da/ffa x:0 0 0 2024-02-19T19:08:48.309 INFO:tasks.workunit.client.0.smithi046.stdout:9/870: mknod db/d20/d6b/dbf/dfe/c10c 0 2024-02-19T19:08:48.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/910: symlink da/d30/lfb 0 2024-02-19T19:08:48.311 INFO:tasks.workunit.client.0.smithi046.stdout:9/871: rename db/d20/d6b/d54/fa5 to db/d20/d6b/d54/f10d 0 2024-02-19T19:08:48.312 INFO:tasks.workunit.client.0.smithi046.stdout:9/872: creat db/d20/dac/f10e x:0 0 0 2024-02-19T19:08:48.313 INFO:tasks.workunit.client.0.smithi046.stdout:3/911: unlink da/d30/d38/l47 0 2024-02-19T19:08:48.314 INFO:tasks.workunit.client.0.smithi046.stdout:9/873: mkdir db/d20/d4e/d10f 0 2024-02-19T19:08:48.317 INFO:tasks.workunit.client.0.smithi046.stdout:9/874: dread db/f7b [0,4194304] 0 2024-02-19T19:08:48.317 INFO:tasks.workunit.client.0.smithi046.stdout:9/875: write db/d1e/d32/d47/d5b/d94/fdc [340297,126420] 0 2024-02-19T19:08:48.317 INFO:tasks.workunit.client.0.smithi046.stdout:9/876: write db/d20/dac/f10e [651209,38469] 0 2024-02-19T19:08:48.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/877: creat db/d20/d6b/d54/db7/dd0/f110 x:0 0 0 2024-02-19T19:08:48.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/878: write db/d1e/d32/d47/d5b/f91 [4708444,89568] 0 2024-02-19T19:08:48.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/879: stat db/f1b 0 2024-02-19T19:08:48.319 INFO:tasks.workunit.client.0.smithi046.stdout:9/880: symlink db/d82/l111 0 2024-02-19T19:08:48.319 INFO:tasks.workunit.client.0.smithi046.stdout:9/881: truncate db/d20/d6b/d54/db7/dd0/fda 1102967 0 2024-02-19T19:08:48.320 INFO:tasks.workunit.client.0.smithi046.stdout:9/882: unlink db/l3b 0 2024-02-19T19:08:48.321 INFO:tasks.workunit.client.0.smithi046.stdout:9/883: creat db/d1e/d52/df0/f112 x:0 0 0 2024-02-19T19:08:48.321 INFO:tasks.workunit.client.0.smithi046.stdout:9/884: chown db/f7b 1 1 2024-02-19T19:08:48.322 INFO:tasks.workunit.client.0.smithi046.stdout:9/885: rmdir db/d1e/d32/d47/d5b 39 2024-02-19T19:08:48.322 INFO:tasks.workunit.client.0.smithi046.stdout:9/886: chown db/d20/d6b/d54/db7/dc6/da6 1 1 2024-02-19T19:08:48.337 INFO:tasks.workunit.client.0.smithi046.stdout:9/887: dwrite db/d20/d6f/f86 [0,4194304] 0 2024-02-19T19:08:48.339 INFO:tasks.workunit.client.0.smithi046.stdout:9/888: symlink db/d20/d8a/d96/l113 0 2024-02-19T19:08:48.340 INFO:tasks.workunit.client.0.smithi046.stdout:9/889: mkdir db/d20/dac/dfb/d114 0 2024-02-19T19:08:48.348 INFO:tasks.workunit.client.0.smithi046.stdout:9/890: read db/d1e/d32/f5f [2505389,101930] 0 2024-02-19T19:08:49.134 INFO:tasks.workunit.client.0.smithi046.stdout:6/936: sync 2024-02-19T19:08:49.135 INFO:tasks.workunit.client.0.smithi046.stdout:3/912: sync 2024-02-19T19:08:49.135 INFO:tasks.workunit.client.0.smithi046.stdout:9/891: sync 2024-02-19T19:08:49.135 INFO:tasks.workunit.client.0.smithi046.stdout:6/937: readlink d4/d6/l1b 0 2024-02-19T19:08:49.135 INFO:tasks.workunit.client.0.smithi046.stdout:9/892: write db/d1e/d32/f5f [621199,88229] 0 2024-02-19T19:08:49.135 INFO:tasks.workunit.client.0.smithi046.stdout:9/893: readlink db/d1e/d52/lf2 0 2024-02-19T19:08:49.135 INFO:tasks.workunit.client.0.smithi046.stdout:3/913: mkdir da/d1d/d3f/de6/dfc 0 2024-02-19T19:08:49.136 INFO:tasks.workunit.client.0.smithi046.stdout:3/914: chown da/d1d/d82/fa3 11056 1 2024-02-19T19:08:49.136 INFO:tasks.workunit.client.0.smithi046.stdout:3/915: dread - da/d1d/d63/d64/fdf zero size 2024-02-19T19:08:49.136 INFO:tasks.workunit.client.0.smithi046.stdout:3/916: write da/d1d/d10/f58 [4294565,91481] 0 2024-02-19T19:08:49.137 INFO:tasks.workunit.client.0.smithi046.stdout:6/938: creat d4/d113/f123 x:0 0 0 2024-02-19T19:08:49.137 INFO:tasks.workunit.client.0.smithi046.stdout:6/939: chown d4/d6/d1c/dd7/d117 496771 1 2024-02-19T19:08:49.137 INFO:tasks.workunit.client.0.smithi046.stdout:6/940: stat d4/d6 0 2024-02-19T19:08:49.137 INFO:tasks.workunit.client.0.smithi046.stdout:6/941: stat d4/d6/d22/ca6 0 2024-02-19T19:08:49.139 INFO:tasks.workunit.client.0.smithi046.stdout:9/894: mkdir db/d20/dac/dfb/d114/d115 0 2024-02-19T19:08:49.139 INFO:tasks.workunit.client.0.smithi046.stdout:9/895: chown db/d1e/f49 1630209822 1 2024-02-19T19:08:49.140 INFO:tasks.workunit.client.0.smithi046.stdout:3/917: mkdir da/d30/dfd 0 2024-02-19T19:08:49.141 INFO:tasks.workunit.client.0.smithi046.stdout:6/942: creat d4/d6/f124 x:0 0 0 2024-02-19T19:08:49.145 INFO:tasks.workunit.client.0.smithi046.stdout:3/918: link da/d1d/d10/c6c da/d1d/d63/d64/cfe 0 2024-02-19T19:08:49.147 INFO:tasks.workunit.client.0.smithi046.stdout:9/896: rmdir db/d20/d8a/d96 39 2024-02-19T19:08:49.149 INFO:tasks.workunit.client.0.smithi046.stdout:6/943: creat d4/d6/d1c/d20/d7a/f125 x:0 0 0 2024-02-19T19:08:49.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/919: dread da/d1d/f96 [0,4194304] 0 2024-02-19T19:08:49.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/920: fdatasync da/d1d/d3f/f76 0 2024-02-19T19:08:49.167 INFO:tasks.workunit.client.0.smithi046.stdout:9/897: dwrite db/d20/d6b/d54/db7/fff [0,4194304] 0 2024-02-19T19:08:49.168 INFO:tasks.workunit.client.0.smithi046.stdout:9/898: fdatasync db/f36 0 2024-02-19T19:08:49.178 INFO:tasks.workunit.client.0.smithi046.stdout:6/944: dwrite d4/d6/dd/d10/d29/d2d/d35/d3c/f72 [0,4194304] 0 2024-02-19T19:08:49.182 INFO:tasks.workunit.client.0.smithi046.stdout:3/921: dwrite da/d1d/d63/d64/fd1 [0,4194304] 0 2024-02-19T19:08:49.184 INFO:tasks.workunit.client.0.smithi046.stdout:3/922: dread da/fa6 [0,4194304] 0 2024-02-19T19:08:49.186 INFO:tasks.workunit.client.0.smithi046.stdout:3/923: mkdir da/d1d/d63/d64/dff 0 2024-02-19T19:08:49.186 INFO:tasks.workunit.client.0.smithi046.stdout:9/899: dwrite db/d1e/f4c [0,4194304] 0 2024-02-19T19:08:49.186 INFO:tasks.workunit.client.0.smithi046.stdout:9/900: creat db/d20/dac/f116 x:0 0 0 2024-02-19T19:08:49.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:48 smithi142 ceph-mon[69118]: pgmap v143: 65 pgs: 1 peering, 1 active+undersized+remapped, 2 active+recovering+undersized+degraded+remapped, 7 active+recovery_wait+undersized+degraded+remapped, 54 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 25 MiB/s rd, 31 MiB/s wr, 174 op/s; 2728/38286 objects degraded (7.125%); 16 MiB/s, 123 objects/s recovering 2024-02-19T19:08:49.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:48 smithi142 ceph-mon[69118]: osdmap e90: 6 total, 6 up, 6 in 2024-02-19T19:08:49.206 INFO:tasks.workunit.client.0.smithi046.stdout:6/945: dwrite d4/d6/d1c/d20/f4d [0,4194304] 0 2024-02-19T19:08:49.206 INFO:tasks.workunit.client.0.smithi046.stdout:6/946: write d4/d6/dd/d10/d29/da2/db7/fe0 [95798,124605] 0 2024-02-19T19:08:49.206 INFO:tasks.workunit.client.0.smithi046.stdout:6/947: write d4/d6/dd/d10/d29/d2d/f47 [299055,45204] 0 2024-02-19T19:08:49.212 INFO:tasks.workunit.client.0.smithi046.stdout:9/901: dwrite db/d20/d6b/d54/db7/dc6/fa3 [0,4194304] 0 2024-02-19T19:08:49.212 INFO:tasks.workunit.client.0.smithi046.stdout:9/902: getdents db/d20/d6b/d54/db7/dc6/da6/dde 0 2024-02-19T19:08:49.212 INFO:tasks.workunit.client.0.smithi046.stdout:9/903: truncate db/d20/d8a/d96/f9b 633410 0 2024-02-19T19:08:49.212 INFO:tasks.workunit.client.0.smithi046.stdout:3/924: dwrite da/d1d/f60 [4194304,4194304] 0 2024-02-19T19:08:49.227 INFO:tasks.workunit.client.0.smithi046.stdout:6/948: dwrite d4/d6/dd/d10/d29/d2d/d35/d66/fdf [0,4194304] 0 2024-02-19T19:08:49.228 INFO:tasks.workunit.client.0.smithi046.stdout:9/904: dwrite db/d20/f2c [4194304,4194304] 0 2024-02-19T19:08:49.232 INFO:tasks.workunit.client.0.smithi046.stdout:6/949: mkdir d4/d126 0 2024-02-19T19:08:49.232 INFO:tasks.workunit.client.0.smithi046.stdout:6/950: chown d4/d6/d1c/d64/cc2 131187420 1 2024-02-19T19:08:49.237 INFO:tasks.workunit.client.0.smithi046.stdout:3/925: dwrite da/d1d/d10/f58 [0,4194304] 0 2024-02-19T19:08:49.239 INFO:tasks.workunit.client.0.smithi046.stdout:3/926: rename da/d1d/d3f/f76 to da/d1d/d63/d64/d74/f100 0 2024-02-19T19:08:49.241 INFO:tasks.workunit.client.0.smithi046.stdout:3/927: rename da/d1d/d10/f21 to da/d30/d38/d93/f101 0 2024-02-19T19:08:49.241 INFO:tasks.workunit.client.0.smithi046.stdout:6/951: dread d4/d6/dd/d10/d29/d2d/dc0/df1/f116 [0,4194304] 0 2024-02-19T19:08:49.241 INFO:tasks.workunit.client.0.smithi046.stdout:6/952: fsync d4/d6/f1a 0 2024-02-19T19:08:49.243 INFO:tasks.workunit.client.0.smithi046.stdout:3/928: dread da/d30/d38/d93/fe2 [0,4194304] 0 2024-02-19T19:08:49.243 INFO:tasks.workunit.client.0.smithi046.stdout:3/929: write da/f20 [2307997,84433] 0 2024-02-19T19:08:49.244 INFO:tasks.workunit.client.0.smithi046.stdout:3/930: symlink da/d30/dfd/l102 0 2024-02-19T19:08:49.244 INFO:tasks.workunit.client.0.smithi046.stdout:3/931: chown da/d30/d38/d54/db2 37 1 2024-02-19T19:08:49.246 INFO:tasks.workunit.client.0.smithi046.stdout:3/932: creat da/d1d/d63/dd9/f103 x:0 0 0 2024-02-19T19:08:49.246 INFO:tasks.workunit.client.0.smithi046.stdout:3/933: fdatasync da/d1d/d3f/d8d/fb3 0 2024-02-19T19:08:49.246 INFO:tasks.workunit.client.0.smithi046.stdout:3/934: stat da/d1d/d63/d64/cac 0 2024-02-19T19:08:49.246 INFO:tasks.workunit.client.0.smithi046.stdout:3/935: write da/d1d/d63/d64/d74/f75 [175649,128656] 0 2024-02-19T19:08:49.246 INFO:tasks.workunit.client.0.smithi046.stdout:3/936: chown da/ffa 0 1 2024-02-19T19:08:49.246 INFO:tasks.workunit.client.0.smithi046.stdout:3/937: creat da/d1d/d63/d64/d74/f104 x:0 0 0 2024-02-19T19:08:49.246 INFO:tasks.workunit.client.0.smithi046.stdout:9/905: dwrite db/d20/f56 [0,4194304] 0 2024-02-19T19:08:49.247 INFO:tasks.workunit.client.0.smithi046.stdout:3/938: read da/d30/d38/d66/f69 [1356600,12919] 0 2024-02-19T19:08:49.247 INFO:tasks.workunit.client.0.smithi046.stdout:9/906: read db/d20/d4e/f7a [71389,20569] 0 2024-02-19T19:08:49.250 INFO:tasks.workunit.client.0.smithi046.stdout:9/907: dread db/d1e/d99/fae [0,4194304] 0 2024-02-19T19:08:49.252 INFO:tasks.workunit.client.0.smithi046.stdout:9/908: creat db/d20/dac/dfb/f117 x:0 0 0 2024-02-19T19:08:49.253 INFO:tasks.workunit.client.0.smithi046.stdout:9/909: symlink db/d20/d6b/d54/db7/l118 0 2024-02-19T19:08:49.267 INFO:tasks.workunit.client.0.smithi046.stdout:9/910: dread db/d20/dac/faf [0,4194304] 0 2024-02-19T19:08:49.268 INFO:tasks.workunit.client.0.smithi046.stdout:6/953: dwrite d4/d6/dd/f57 [0,4194304] 0 2024-02-19T19:08:49.268 INFO:tasks.workunit.client.0.smithi046.stdout:3/939: dwrite da/d30/d38/d66/fe7 [0,4194304] 0 2024-02-19T19:08:49.268 INFO:tasks.workunit.client.0.smithi046.stdout:9/911: symlink db/d20/d6b/d54/l119 0 2024-02-19T19:08:49.270 INFO:tasks.workunit.client.0.smithi046.stdout:6/954: symlink d4/d6/dd/d10/d29/l127 0 2024-02-19T19:08:49.273 INFO:tasks.workunit.client.0.smithi046.stdout:3/940: link da/d30/l46 da/d1d/d63/d64/l105 0 2024-02-19T19:08:49.273 INFO:tasks.workunit.client.0.smithi046.stdout:3/941: dread - da/d1d/d82/fd3 zero size 2024-02-19T19:08:49.273 INFO:tasks.workunit.client.0.smithi046.stdout:3/942: creat da/d8a/f106 x:0 0 0 2024-02-19T19:08:49.277 INFO:tasks.workunit.client.0.smithi046.stdout:9/912: dread db/d20/d6b/d54/f10d [4194304,4194304] 0 2024-02-19T19:08:49.277 INFO:tasks.workunit.client.0.smithi046.stdout:9/913: fsync db/d20/d6b/d54/f70 0 2024-02-19T19:08:49.277 INFO:tasks.workunit.client.0.smithi046.stdout:6/955: rmdir d4/d6/d10f 39 2024-02-19T19:08:49.279 INFO:tasks.workunit.client.0.smithi046.stdout:6/956: dread d4/d6/d1c/d64/f80 [0,4194304] 0 2024-02-19T19:08:49.290 INFO:tasks.workunit.client.0.smithi046.stdout:6/957: write d4/d6/dd/d10/d29/d2d/d35/d3c/f55 [2299,52210] 0 2024-02-19T19:08:49.291 INFO:tasks.workunit.client.0.smithi046.stdout:6/958: rmdir d4/d6/dd/d10/d29/d2d/d35/d66 39 2024-02-19T19:08:49.291 INFO:tasks.workunit.client.0.smithi046.stdout:6/959: stat d4/d6/d1c/d60/f85 0 2024-02-19T19:08:49.295 INFO:tasks.workunit.client.0.smithi046.stdout:3/943: dwrite da/d30/d38/d54/f5d [0,4194304] 0 2024-02-19T19:08:49.295 INFO:tasks.workunit.client.0.smithi046.stdout:3/944: write da/d30/d38/d93/f101 [2366139,62836] 0 2024-02-19T19:08:49.297 INFO:tasks.workunit.client.0.smithi046.stdout:3/945: write da/d30/f99 [568225,63877] 0 2024-02-19T19:08:49.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/946: symlink da/d1d/d63/d64/l107 0 2024-02-19T19:08:49.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/947: symlink da/d1d/d3f/l108 0 2024-02-19T19:08:49.302 INFO:tasks.workunit.client.0.smithi046.stdout:9/914: dwrite db/d20/d6b/d54/db7/dc6/f8b [0,4194304] 0 2024-02-19T19:08:49.303 INFO:tasks.workunit.client.0.smithi046.stdout:9/915: write db/d20/d8a/dd1/fe5 [267587,56178] 0 2024-02-19T19:08:49.303 INFO:tasks.workunit.client.0.smithi046.stdout:9/916: write db/d1e/d32/d47/d5b/d94/fdc [918309,5161] 0 2024-02-19T19:08:49.305 INFO:tasks.workunit.client.0.smithi046.stdout:9/917: rmdir db/d20/d6b/d54/db7/dd0 39 2024-02-19T19:08:49.305 INFO:tasks.workunit.client.0.smithi046.stdout:9/918: readlink db/l45 0 2024-02-19T19:08:49.306 INFO:tasks.workunit.client.0.smithi046.stdout:9/919: symlink db/d20/d4e/d10f/l11a 0 2024-02-19T19:08:49.306 INFO:tasks.workunit.client.0.smithi046.stdout:9/920: dread - db/d20/dac/f116 zero size 2024-02-19T19:08:49.307 INFO:tasks.workunit.client.0.smithi046.stdout:6/960: dread d4/d6/f4c [0,4194304] 0 2024-02-19T19:08:49.307 INFO:tasks.workunit.client.0.smithi046.stdout:6/961: stat d4/d6/d22/c2e 0 2024-02-19T19:08:49.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/948: dread da/d30/f44 [0,4194304] 0 2024-02-19T19:08:49.308 INFO:tasks.workunit.client.0.smithi046.stdout:6/962: creat d4/d6/d1c/d20/f128 x:0 0 0 2024-02-19T19:08:49.310 INFO:tasks.workunit.client.0.smithi046.stdout:6/963: symlink d4/d6/d1c/l129 0 2024-02-19T19:08:49.314 INFO:tasks.workunit.client.0.smithi046.stdout:9/921: dread db/d20/d6b/d54/db7/fff [0,4194304] 0 2024-02-19T19:08:49.318 INFO:tasks.workunit.client.0.smithi046.stdout:3/949: rmdir da 39 2024-02-19T19:08:49.319 INFO:tasks.workunit.client.0.smithi046.stdout:6/964: mkdir d4/d113/d12a 0 2024-02-19T19:08:49.319 INFO:tasks.workunit.client.0.smithi046.stdout:6/965: chown d4/cad 1879 1 2024-02-19T19:08:49.320 INFO:tasks.workunit.client.0.smithi046.stdout:6/966: read - d4/d6/dd/d10/d29/da2/fe1 zero size 2024-02-19T19:08:49.320 INFO:tasks.workunit.client.0.smithi046.stdout:3/950: mknod da/d1d/d3f/de6/c109 0 2024-02-19T19:08:49.320 INFO:tasks.workunit.client.0.smithi046.stdout:3/951: write da/d30/d38/d93/fcf [760457,13520] 0 2024-02-19T19:08:49.321 INFO:tasks.workunit.client.0.smithi046.stdout:6/967: mknod d4/d6/dd/d10/d29/d2d/c12b 0 2024-02-19T19:08:49.321 INFO:tasks.workunit.client.0.smithi046.stdout:6/968: creat d4/d6/d22/db0/f12c x:0 0 0 2024-02-19T19:08:49.324 INFO:tasks.workunit.client.0.smithi046.stdout:3/952: mknod da/d30/d38/c10a 0 2024-02-19T19:08:49.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:48 smithi046 ceph-mon[88928]: pgmap v143: 65 pgs: 1 peering, 1 active+undersized+remapped, 2 active+recovering+undersized+degraded+remapped, 7 active+recovery_wait+undersized+degraded+remapped, 54 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 25 MiB/s rd, 31 MiB/s wr, 174 op/s; 2728/38286 objects degraded (7.125%); 16 MiB/s, 123 objects/s recovering 2024-02-19T19:08:49.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:48 smithi046 ceph-mon[88928]: osdmap e90: 6 total, 6 up, 6 in 2024-02-19T19:08:49.326 INFO:tasks.workunit.client.0.smithi046.stdout:6/969: unlink d4/d6/d1c/d20/d7a/l88 0 2024-02-19T19:08:49.328 INFO:tasks.workunit.client.0.smithi046.stdout:3/953: link da/d1d/d10/f2b da/dbe/f10b 0 2024-02-19T19:08:49.334 INFO:tasks.workunit.client.0.smithi046.stdout:3/954: dread da/d1d/d10/f5e [0,4194304] 0 2024-02-19T19:08:49.335 INFO:tasks.workunit.client.0.smithi046.stdout:6/970: dread d4/d6/dd/f44 [0,4194304] 0 2024-02-19T19:08:49.336 INFO:tasks.workunit.client.0.smithi046.stdout:6/971: chown d4/d6/dd/d10/d29/f36 248 1 2024-02-19T19:08:49.336 INFO:tasks.workunit.client.0.smithi046.stdout:3/955: rename da/d1d/c23 to da/d1d/d3f/d8d/c10c 0 2024-02-19T19:08:49.336 INFO:tasks.workunit.client.0.smithi046.stdout:6/972: link d4/d6/dd/d10/d29/l127 d4/d6/d1c/d20/dc5/l12d 0 2024-02-19T19:08:49.337 INFO:tasks.workunit.client.0.smithi046.stdout:3/956: mkdir da/d30/d38/d93/d10d 0 2024-02-19T19:08:49.337 INFO:tasks.workunit.client.0.smithi046.stdout:3/957: chown da/d1d/d63/cb8 14 1 2024-02-19T19:08:49.355 INFO:tasks.workunit.client.0.smithi046.stdout:6/973: dwrite d4/d6/dd/d10/d29/d2d/d35/f115 [0,4194304] 0 2024-02-19T19:08:49.356 INFO:tasks.workunit.client.0.smithi046.stdout:6/974: fdatasync d4/f26 0 2024-02-19T19:08:49.357 INFO:tasks.workunit.client.0.smithi046.stdout:6/975: unlink d4/d6/dd/d10/d29/d2d/d35/d66/lcb 0 2024-02-19T19:08:49.357 INFO:tasks.workunit.client.0.smithi046.stdout:6/976: dread - d4/d6/dd/d10/d29/da2/fe1 zero size 2024-02-19T19:08:49.357 INFO:tasks.workunit.client.0.smithi046.stdout:6/977: readlink d4/d6/d22/l2f 0 2024-02-19T19:08:49.357 INFO:tasks.workunit.client.0.smithi046.stdout:6/978: fdatasync d4/d6/dd/d10/d29/d2d/d35/d66/fdf 0 2024-02-19T19:08:49.358 INFO:tasks.workunit.client.0.smithi046.stdout:6/979: mkdir d4/d6/dd/d10/d29/d2d/d35/d3c/d12e 0 2024-02-19T19:08:49.360 INFO:tasks.workunit.client.0.smithi046.stdout:3/958: dwrite da/d30/f44 [0,4194304] 0 2024-02-19T19:08:49.360 INFO:tasks.workunit.client.0.smithi046.stdout:3/959: chown da/d30/d38/d93/fa0 303926201 1 2024-02-19T19:08:49.360 INFO:tasks.workunit.client.0.smithi046.stdout:3/960: dread - da/d1d/d8e/f91 zero size 2024-02-19T19:08:49.360 INFO:tasks.workunit.client.0.smithi046.stdout:6/980: rename d4/d6/dd/d10/d29/c87 to d4/d6/d1c/d20/d98/dc4/dce/c12f 0 2024-02-19T19:08:49.361 INFO:tasks.workunit.client.0.smithi046.stdout:3/961: unlink da/d1d/d82/fd3 0 2024-02-19T19:08:49.362 INFO:tasks.workunit.client.0.smithi046.stdout:3/962: mkdir da/d1d/d63/d64/d10e 0 2024-02-19T19:08:49.363 INFO:tasks.workunit.client.0.smithi046.stdout:3/963: creat da/d30/d38/f10f x:0 0 0 2024-02-19T19:08:49.375 INFO:tasks.workunit.client.0.smithi046.stdout:6/981: dread d4/d6/dd/d10/d29/d2d/d35/d66/fdf [0,4194304] 0 2024-02-19T19:08:49.376 INFO:tasks.workunit.client.0.smithi046.stdout:6/982: mknod d4/d6/d1c/d20/d98/dc4/dce/c130 0 2024-02-19T19:08:49.377 INFO:tasks.workunit.client.0.smithi046.stdout:6/983: link d4/d6/dd/d10/d29/l7c d4/d6/dd/d10/d29/d2d/d35/da5/dfd/d107/l131 0 2024-02-19T19:08:49.379 INFO:tasks.workunit.client.0.smithi046.stdout:6/984: unlink d4/d6/d1c/c5c 0 2024-02-19T19:08:49.379 INFO:tasks.workunit.client.0.smithi046.stdout:6/985: write d4/d6/d1c/d60/f61 [4375760,71108] 0 2024-02-19T19:08:49.380 INFO:tasks.workunit.client.0.smithi046.stdout:6/986: creat d4/d6/d1c/dd7/d117/f132 x:0 0 0 2024-02-19T19:08:49.380 INFO:tasks.workunit.client.0.smithi046.stdout:6/987: dread - d4/d113/f123 zero size 2024-02-19T19:08:49.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/964: dwrite da/d30/d38/f4a [0,4194304] 0 2024-02-19T19:08:49.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/965: truncate da/d8a/fb9 673777 0 2024-02-19T19:08:49.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/966: readlink da/d30/d38/d66/l9b 0 2024-02-19T19:08:49.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/967: chown da/d1d/d63/d64/cfe 0 1 2024-02-19T19:08:49.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/968: chown da/d1d/d10/f5e 16222 1 2024-02-19T19:08:49.384 INFO:tasks.workunit.client.0.smithi046.stdout:6/988: dread d4/d6/dd/d10/d29/d2d/f47 [0,4194304] 0 2024-02-19T19:08:49.386 INFO:tasks.workunit.client.0.smithi046.stdout:6/989: rename d4/l77 to d4/d6/dd/d10/d29/d2d/l133 0 2024-02-19T19:08:49.386 INFO:tasks.workunit.client.0.smithi046.stdout:6/990: creat d4/d6/dd/d10/d29/d2d/dc0/f134 x:0 0 0 2024-02-19T19:08:49.386 INFO:tasks.workunit.client.0.smithi046.stdout:6/991: write d4/d6/dd/d10/d29/f10d [8811969,102340] 0 2024-02-19T19:08:49.387 INFO:tasks.workunit.client.0.smithi046.stdout:6/992: dread - d4/d6/d10f/f11a zero size 2024-02-19T19:08:49.387 INFO:tasks.workunit.client.0.smithi046.stdout:6/993: stat d4/d6/d10f/d11b 0 2024-02-19T19:08:49.388 INFO:tasks.workunit.client.0.smithi046.stdout:6/994: rmdir d4/d6/dd/d10/d29/d2d/d35/d3c/d12e 0 2024-02-19T19:08:49.389 INFO:tasks.workunit.client.0.smithi046.stdout:6/995: rmdir d4/d6/d1c/d60 39 2024-02-19T19:08:49.389 INFO:tasks.workunit.client.0.smithi046.stdout:6/996: fdatasync d4/d6/d1c/f75 0 2024-02-19T19:08:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/997: creat d4/d6/d11f/f135 x:0 0 0 2024-02-19T19:08:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/998: write d4/d6/d1c/d20/dc5/f112 [828648,108260] 0 2024-02-19T19:08:49.392 INFO:tasks.workunit.client.0.smithi046.stdout:6/999: symlink d4/d6/d1c/d60/l136 0 2024-02-19T19:08:49.394 INFO:tasks.workunit.client.0.smithi046.stdout:3/969: dwrite da/d1d/fb0 [0,4194304] 0 2024-02-19T19:08:49.394 INFO:tasks.workunit.client.0.smithi046.stdout:3/970: fsync da/d1d/d10/f1e 0 2024-02-19T19:08:49.406 INFO:tasks.workunit.client.0.smithi046.stdout:3/971: dread da/d30/d38/f7a [0,4194304] 0 2024-02-19T19:08:49.406 INFO:tasks.workunit.client.0.smithi046.stdout:3/972: write da/d30/d38/f3d [3322792,15546] 0 2024-02-19T19:08:49.407 INFO:tasks.workunit.client.0.smithi046.stdout:3/973: creat da/d1d/d82/d90/f110 x:0 0 0 2024-02-19T19:08:49.423 INFO:tasks.workunit.client.0.smithi046.stdout:3/974: dwrite da/d1d/d63/d92/f98 [0,4194304] 0 2024-02-19T19:08:49.875 INFO:tasks.workunit.client.0.smithi046.stdout:3/975: dread da/f20 [0,4194304] 0 2024-02-19T19:08:49.892 INFO:tasks.workunit.client.0.smithi046.stdout:3/976: dread da/d1d/d63/d64/f7b [0,4194304] 0 2024-02-19T19:08:49.892 INFO:tasks.workunit.client.0.smithi046.stdout:3/977: readlink da/d1d/laa 0 2024-02-19T19:08:49.895 INFO:tasks.workunit.client.0.smithi046.stdout:3/978: rename da/d1d/d63/d64/d10e to da/d1d/d63/dd9/d111 0 2024-02-19T19:08:49.911 INFO:tasks.workunit.client.0.smithi046.stdout:3/979: dwrite da/d30/d38/d66/f69 [0,4194304] 0 2024-02-19T19:08:49.915 INFO:tasks.workunit.client.0.smithi046.stdout:3/980: symlink da/d30/dfd/l112 0 2024-02-19T19:08:49.929 INFO:tasks.workunit.client.0.smithi046.stdout:3/981: dwrite da/d30/f44 [0,4194304] 0 2024-02-19T19:08:49.930 INFO:tasks.workunit.client.0.smithi046.stdout:9/922: sync 2024-02-19T19:08:49.934 INFO:tasks.workunit.client.0.smithi046.stdout:9/923: getdents db/d1e 0 2024-02-19T19:08:49.936 INFO:tasks.workunit.client.0.smithi046.stdout:3/982: write da/d30/d38/f56 [3455455,29766] 0 2024-02-19T19:08:49.939 INFO:tasks.workunit.client.0.smithi046.stdout:3/983: symlink da/dbe/l113 0 2024-02-19T19:08:49.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/984: write da/d30/d38/f4a [3654716,1221] 0 2024-02-19T19:08:49.949 INFO:tasks.workunit.client.0.smithi046.stdout:3/985: symlink da/d30/d38/dc6/df1/l114 0 2024-02-19T19:08:49.951 INFO:tasks.workunit.client.0.smithi046.stdout:3/986: rename da/d1d/d8e/ld6 to da/d1d/d63/d64/l115 0 2024-02-19T19:08:49.952 INFO:tasks.workunit.client.0.smithi046.stdout:3/987: getdents da/dbe/df5 0 2024-02-19T19:08:49.955 INFO:tasks.workunit.client.0.smithi046.stdout:3/988: mknod da/d8a/d9f/c116 0 2024-02-19T19:08:49.957 INFO:tasks.workunit.client.0.smithi046.stdout:3/989: rename da/d30/la8 to da/d1d/d10/l117 0 2024-02-19T19:08:49.958 INFO:tasks.workunit.client.0.smithi046.stdout:3/990: write da/d30/f99 [1513537,58054] 0 2024-02-19T19:08:49.959 INFO:tasks.workunit.client.0.smithi046.stdout:3/991: dread da/d1d/d82/fa7 [0,4194304] 0 2024-02-19T19:08:49.959 INFO:tasks.workunit.client.0.smithi046.stdout:3/992: chown da/d1d/d63/dd9/d111 6906 1 2024-02-19T19:08:49.959 INFO:tasks.workunit.client.0.smithi046.stdout:3/993: dread - da/d1d/d63/d64/fdf zero size 2024-02-19T19:08:49.959 INFO:tasks.workunit.client.0.smithi046.stdout:3/994: dread - da/d1d/d63/fdb zero size 2024-02-19T19:08:49.968 INFO:tasks.workunit.client.0.smithi046.stdout:3/995: write da/d30/d38/d93/fa0 [2856781,17748] 0 2024-02-19T19:08:49.968 INFO:tasks.workunit.client.0.smithi046.stdout:3/996: write da/d1d/d63/d64/fdf [805502,34603] 0 2024-02-19T19:08:49.972 INFO:tasks.workunit.client.0.smithi046.stdout:3/997: unlink da/d1d/d3f/l108 0 2024-02-19T19:08:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:3/998: symlink da/d1d/d63/dd9/l118 0 2024-02-19T19:08:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:3/999: write da/d1d/d63/d92/fbb [285853,76734] 0 2024-02-19T19:08:50.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:49 smithi046 ceph-mon[88928]: osdmap e91: 6 total, 6 up, 6 in 2024-02-19T19:08:50.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:49 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 2728/38286 objects degraded (7.125%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:50.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:49 smithi046 ceph-mon[88928]: osdmap e92: 6 total, 6 up, 6 in 2024-02-19T19:08:50.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:49 smithi142 ceph-mon[69118]: osdmap e91: 6 total, 6 up, 6 in 2024-02-19T19:08:50.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:49 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 2728/38286 objects degraded (7.125%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:50.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:49 smithi142 ceph-mon[69118]: osdmap e92: 6 total, 6 up, 6 in 2024-02-19T19:08:50.466 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-19T19:08:50.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-19T19:08:50.685 INFO:tasks.workunit.client.0.smithi046.stdout:9/924: sync 2024-02-19T19:08:50.691 INFO:tasks.workunit.client.0.smithi046.stdout:9/925: write db/f1b [1624686,113027] 0 2024-02-19T19:08:50.694 INFO:tasks.workunit.client.0.smithi046.stdout:9/926: creat db/d20/d6b/d54/db7/dd0/f11b x:0 0 0 2024-02-19T19:08:50.694 INFO:tasks.workunit.client.0.smithi046.stdout:9/927: readlink db/d20/d6b/lf4 0 2024-02-19T19:08:50.694 INFO:tasks.workunit.client.0.smithi046.stdout:9/928: getdents db/d1e/d32/d7c 0 2024-02-19T19:08:50.695 INFO:tasks.workunit.client.0.smithi046.stdout:9/929: chown db/d1e/d52/dd5 6779846 1 2024-02-19T19:08:50.695 INFO:tasks.workunit.client.0.smithi046.stdout:9/930: dread - db/d1e/d52/df0/f112 zero size 2024-02-19T19:08:50.696 INFO:tasks.workunit.client.0.smithi046.stdout:9/931: read db/d20/d6b/d54/db7/dd0/fda [243683,79795] 0 2024-02-19T19:08:50.696 INFO:tasks.workunit.client.0.smithi046.stdout:9/932: getdents db/d20/d108 0 2024-02-19T19:08:50.702 INFO:tasks.workunit.client.0.smithi046.stdout:9/933: read db/d20/d6b/d54/f74 [2066938,129276] 0 2024-02-19T19:08:50.702 INFO:tasks.workunit.client.0.smithi046.stdout:9/934: truncate db/fca 104017 0 2024-02-19T19:08:50.703 INFO:tasks.workunit.client.0.smithi046.stdout:9/935: symlink db/d53/l11c 0 2024-02-19T19:08:50.703 INFO:tasks.workunit.client.0.smithi046.stdout:9/936: readlink db/d1e/d52/l107 0 2024-02-19T19:08:50.704 INFO:tasks.workunit.client.0.smithi046.stdout:9/937: symlink db/d20/l11d 0 2024-02-19T19:08:50.705 INFO:tasks.workunit.client.0.smithi046.stdout:9/938: mkdir db/d20/d6b/d11e 0 2024-02-19T19:08:50.713 INFO:tasks.workunit.client.0.smithi046.stdout:9/939: dread db/d1e/d32/d47/d5b/d94/f9c [0,4194304] 0 2024-02-19T19:08:50.724 INFO:tasks.workunit.client.0.smithi046.stdout:9/940: mkdir db/d20/d11f 0 2024-02-19T19:08:50.724 INFO:tasks.workunit.client.0.smithi046.stdout:9/941: write db/d53/fea [827248,71263] 0 2024-02-19T19:08:50.725 INFO:tasks.workunit.client.0.smithi046.stdout:9/942: truncate db/d1e/f22 642573 0 2024-02-19T19:08:50.727 INFO:tasks.workunit.client.0.smithi046.stdout:9/943: mknod db/d20/dac/dfb/d114/d115/c120 0 2024-02-19T19:08:50.727 INFO:tasks.workunit.client.0.smithi046.stdout:9/944: truncate db/d20/d71/f10b 341122 0 2024-02-19T19:08:50.732 INFO:tasks.workunit.client.0.smithi046.stdout:9/945: dread db/d20/d6f/fba [0,4194304] 0 2024-02-19T19:08:50.748 DEBUG:teuthology.parallel:result is None 2024-02-19T19:08:50.754 INFO:tasks.workunit.client.0.smithi046.stdout:9/946: dwrite db/d20/d8a/dd1/fe5 [0,4194304] 0 2024-02-19T19:08:50.758 INFO:tasks.workunit.client.0.smithi046.stdout:9/947: mknod db/d20/dac/dfb/d114/c121 0 2024-02-19T19:08:50.759 INFO:tasks.workunit.client.0.smithi046.stdout:9/948: dread db/f19 [0,4194304] 0 2024-02-19T19:08:50.761 INFO:tasks.workunit.client.0.smithi046.stdout:9/949: creat db/d1e/d99/dc4/de2/f122 x:0 0 0 2024-02-19T19:08:51.029 INFO:tasks.workunit.client.0.smithi046.stdout:9/950: sync 2024-02-19T19:08:51.030 INFO:tasks.workunit.client.0.smithi046.stdout:9/951: truncate db/f7b 967263 0 2024-02-19T19:08:51.030 INFO:tasks.workunit.client.0.smithi046.stdout:9/952: creat db/d20/d6b/d54/db7/dd0/f123 x:0 0 0 2024-02-19T19:08:51.031 INFO:tasks.workunit.client.0.smithi046.stdout:9/953: symlink db/d20/d6b/d11e/l124 0 2024-02-19T19:08:51.031 INFO:tasks.workunit.client.0.smithi046.stdout:9/954: chown db/d82/f102 614806 1 2024-02-19T19:08:51.050 INFO:tasks.workunit.client.0.smithi046.stdout:9/955: dwrite db/d20/fb3 [0,4194304] 0 2024-02-19T19:08:51.050 INFO:tasks.workunit.client.0.smithi046.stdout:9/956: chown db/d1e/d99/cc8 5726952 1 2024-02-19T19:08:51.051 INFO:tasks.workunit.client.0.smithi046.stdout:9/957: creat db/d82/f125 x:0 0 0 2024-02-19T19:08:51.052 INFO:tasks.workunit.client.0.smithi046.stdout:9/958: creat db/d1e/d32/d47/d5b/d94/f126 x:0 0 0 2024-02-19T19:08:51.054 INFO:tasks.workunit.client.0.smithi046.stdout:9/959: creat db/d1e/d52/df0/f127 x:0 0 0 2024-02-19T19:08:51.075 INFO:tasks.workunit.client.0.smithi046.stdout:9/960: dwrite db/f43 [0,4194304] 0 2024-02-19T19:08:51.076 INFO:tasks.workunit.client.0.smithi046.stdout:9/961: mkdir db/d20/de9/d128 0 2024-02-19T19:08:51.081 INFO:tasks.workunit.client.0.smithi046.stdout:9/962: dread db/d1e/d32/d47/d5b/d94/f9c [0,4194304] 0 2024-02-19T19:08:51.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:50 smithi046 ceph-mon[88928]: pgmap v146: 65 pgs: 1 peering, 5 active+recovery_wait+undersized+degraded+remapped, 59 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 79 MiB/s wr, 291 op/s; 1769/36675 objects degraded (4.823%); 37 MiB/s, 302 objects/s recovering 2024-02-19T19:08:51.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:50 smithi046 ceph-mon[88928]: osdmap e93: 6 total, 6 up, 6 in 2024-02-19T19:08:51.082 INFO:tasks.workunit.client.0.smithi046.stdout:9/963: readlink db/d20/d6b/l63 0 2024-02-19T19:08:51.083 INFO:tasks.workunit.client.0.smithi046.stdout:9/964: link db/d1e/f1f db/d20/d4e/d10f/f129 0 2024-02-19T19:08:51.084 INFO:tasks.workunit.client.0.smithi046.stdout:9/965: mkdir db/d1e/d99/d105/d12a 0 2024-02-19T19:08:51.086 INFO:tasks.workunit.client.0.smithi046.stdout:9/966: rename db/d20/d6b/d54/db7/dc6/da6/dde to db/d20/d6f/d12b 0 2024-02-19T19:08:51.086 INFO:tasks.workunit.client.0.smithi046.stdout:9/967: mknod db/d1e/c12c 0 2024-02-19T19:08:51.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:50 smithi142 ceph-mon[69118]: pgmap v146: 65 pgs: 1 peering, 5 active+recovery_wait+undersized+degraded+remapped, 59 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 79 MiB/s wr, 291 op/s; 1769/36675 objects degraded (4.823%); 37 MiB/s, 302 objects/s recovering 2024-02-19T19:08:51.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:50 smithi142 ceph-mon[69118]: osdmap e93: 6 total, 6 up, 6 in 2024-02-19T19:08:51.882 INFO:tasks.workunit.client.0.smithi046.stdout:9/968: read db/d20/d8a/d96/f9b [396380,80571] 0 2024-02-19T19:08:51.882 INFO:tasks.workunit.client.0.smithi046.stdout:9/969: mknod db/d20/d108/c12d 0 2024-02-19T19:08:51.883 INFO:tasks.workunit.client.0.smithi046.stdout:9/970: getdents db/d82/dcf 0 2024-02-19T19:08:51.885 INFO:tasks.workunit.client.0.smithi046.stdout:9/971: dread db/d20/d6b/d54/db7/dd0/fda [0,4194304] 0 2024-02-19T19:08:51.886 INFO:tasks.workunit.client.0.smithi046.stdout:9/972: read db/d20/d6b/f8d [754620,32132] 0 2024-02-19T19:08:51.889 INFO:tasks.workunit.client.0.smithi046.stdout:9/973: rename db/d20/d6b/d54/db7/fc2 to db/d1e/f12e 0 2024-02-19T19:08:51.891 INFO:tasks.workunit.client.0.smithi046.stdout:9/974: link db/d20/ffa db/d20/d11f/f12f 0 2024-02-19T19:08:51.893 INFO:tasks.workunit.client.0.smithi046.stdout:9/975: rename db/d1e/d32/ffd to db/d20/d6b/d54/db7/f130 0 2024-02-19T19:08:51.899 INFO:tasks.workunit.client.0.smithi046.stdout:9/976: rename db/d20/de9 to db/d1e/d52/dbe/d131 0 2024-02-19T19:08:51.899 INFO:tasks.workunit.client.0.smithi046.stdout:9/977: chown db/d1e/d99/dc4/fd8 13349767 1 2024-02-19T19:08:51.899 INFO:tasks.workunit.client.0.smithi046.stdout:9/978: stat db/d20/dac/faf 0 2024-02-19T19:08:51.902 INFO:tasks.workunit.client.0.smithi046.stdout:9/979: rename db/f36 to db/d1e/d99/d105/f132 0 2024-02-19T19:08:51.905 INFO:tasks.workunit.client.0.smithi046.stdout:9/980: rename db/d1e/d32/d47/d5b/d94/f9c to db/d20/f133 0 2024-02-19T19:08:51.908 INFO:tasks.workunit.client.0.smithi046.stdout:9/981: creat db/d1e/d32/d47/d5b/f134 x:0 0 0 2024-02-19T19:08:51.926 INFO:tasks.workunit.client.0.smithi046.stdout:9/982: dwrite db/d53/f65 [0,4194304] 0 2024-02-19T19:08:51.927 INFO:tasks.workunit.client.0.smithi046.stdout:9/983: rename db/d20/d6b/c48 to db/d1e/d52/dbe/c135 0 2024-02-19T19:08:51.929 INFO:tasks.workunit.client.0.smithi046.stdout:9/984: truncate db/d1e/f4c 3721537 0 2024-02-19T19:08:51.930 INFO:tasks.workunit.client.0.smithi046.stdout:9/985: link db/d1e/d52/l95 db/d20/d6b/d54/db7/dc6/d100/l136 0 2024-02-19T19:08:51.930 INFO:tasks.workunit.client.0.smithi046.stdout:9/986: fdatasync db/d1e/d32/f5f 0 2024-02-19T19:08:51.937 INFO:tasks.workunit.client.0.smithi046.stdout:9/987: write db/d20/d6f/f86 [2528486,29075] 0 2024-02-19T19:08:51.938 INFO:tasks.workunit.client.0.smithi046.stdout:9/988: readlink db/d53/l11c 0 2024-02-19T19:08:51.951 INFO:tasks.workunit.client.0.smithi046.stdout:9/989: dwrite db/d1e/f4c [0,4194304] 0 2024-02-19T19:08:51.962 INFO:tasks.workunit.client.0.smithi046.stdout:9/990: dread db/d20/fb3 [0,4194304] 0 2024-02-19T19:08:51.962 INFO:tasks.workunit.client.0.smithi046.stdout:9/991: read db/f1c [1777003,64246] 0 2024-02-19T19:08:51.963 INFO:tasks.workunit.client.0.smithi046.stdout:9/992: write db/d20/d6b/d54/db7/dd0/fda [770027,86567] 0 2024-02-19T19:08:51.964 INFO:tasks.workunit.client.0.smithi046.stdout:9/993: link db/d82/c8e db/d1e/d52/df0/c137 0 2024-02-19T19:08:51.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/994: dread db/d20/d6b/d54/db7/dc6/da6/fb6 [0,4194304] 0 2024-02-19T19:08:51.995 INFO:tasks.workunit.client.0.smithi046.stdout:9/995: dwrite db/f4b [0,4194304] 0 2024-02-19T19:08:51.995 INFO:tasks.workunit.client.0.smithi046.stdout:9/996: creat db/d1e/d52/df0/f138 x:0 0 0 2024-02-19T19:08:51.998 INFO:tasks.workunit.client.0.smithi046.stdout:9/997: rename db/cc to db/d20/d6b/c139 0 2024-02-19T19:08:52.001 INFO:tasks.workunit.client.0.smithi046.stdout:9/998: unlink db/d20/l30 0 2024-02-19T19:08:52.001 INFO:tasks.workunit.client.0.smithi046.stdout:9/999: getdents db/d1e/d32/d7c 0 2024-02-19T19:08:52.005 INFO:tasks.workunit.client.0.smithi046.stderr:+ rm -rf -- ./tmp.cMgmsMQCOp 2024-02-19T19:08:53.071 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:52 smithi046 ceph-mon[88928]: pgmap v149: 65 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 59 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 78 MiB/s rd, 101 MiB/s wr, 402 op/s; 1414/36186 objects degraded (3.908%); 37 MiB/s, 372 objects/s recovering 2024-02-19T19:08:53.071 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:52 smithi046 ceph-mon[88928]: osdmap e94: 6 total, 6 up, 6 in 2024-02-19T19:08:53.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:52 smithi142 ceph-mon[69118]: pgmap v149: 65 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 59 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 78 MiB/s rd, 101 MiB/s wr, 402 op/s; 1414/36186 objects degraded (3.908%); 37 MiB/s, 372 objects/s recovering 2024-02-19T19:08:53.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:52 smithi142 ceph-mon[69118]: osdmap e94: 6 total, 6 up, 6 in 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: osdmap e95: 6 total, 6 up, 6 in 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:08:54.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:08:54.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:53 smithi046 ceph-mon[88928]: Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2024-02-19T19:08:54.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: osdmap e95: 6 total, 6 up, 6 in 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:08:54.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:53 smithi142 ceph-mon[69118]: Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2024-02-19T19:08:55.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:54 smithi142 ceph-mon[69118]: pgmap v152: 65 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 62 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 41 MiB/s rd, 50 MiB/s wr, 335 op/s; 354/34737 objects degraded (1.019%); 17 MiB/s, 246 objects/s recovering 2024-02-19T19:08:55.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:54 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 1414/36186 objects degraded (3.908%), 5 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:55.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:54 smithi046 ceph-mon[88928]: pgmap v152: 65 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 1 active+recovery_wait+undersized+degraded+remapped, 62 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 41 MiB/s rd, 50 MiB/s wr, 335 op/s; 354/34737 objects degraded (1.019%); 17 MiB/s, 246 objects/s recovering 2024-02-19T19:08:55.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:54 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 1414/36186 objects degraded (3.908%), 5 pgs degraded (PG_DEGRADED) 2024-02-19T19:08:56.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:55 smithi142 ceph-mon[69118]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 354/34737 objects degraded (1.019%), 2 pgs degraded) 2024-02-19T19:08:56.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:55 smithi142 ceph-mon[69118]: Cluster is now healthy 2024-02-19T19:08:56.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:55 smithi046 ceph-mon[88928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 354/34737 objects degraded (1.019%), 2 pgs degraded) 2024-02-19T19:08:56.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:55 smithi046 ceph-mon[88928]: Cluster is now healthy 2024-02-19T19:08:57.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:56 smithi142 ceph-mon[69118]: pgmap v153: 65 pgs: 1 peering, 64 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 30 MiB/s rd, 35 MiB/s wr, 254 op/s; 27 MiB/s, 241 objects/s recovering 2024-02-19T19:08:57.232 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:56 smithi046 ceph-mon[88928]: pgmap v153: 65 pgs: 1 peering, 64 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 30 MiB/s rd, 35 MiB/s wr, 254 op/s; 27 MiB/s, 241 objects/s recovering 2024-02-19T19:08:59.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:58 smithi046 ceph-mon[88928]: pgmap v154: 65 pgs: 1 peering, 64 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 19 MiB/s rd, 18 MiB/s wr, 152 op/s; 23 MiB/s, 165 objects/s recovering 2024-02-19T19:08:59.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:59.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:08:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:59.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:58 smithi142 ceph-mon[69118]: pgmap v154: 65 pgs: 1 peering, 64 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 19 MiB/s rd, 18 MiB/s wr, 152 op/s; 23 MiB/s, 165 objects/s recovering 2024-02-19T19:08:59.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:08:59.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:08:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:00.781 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-19T19:09:00.781 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-19T19:09:01.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:00 smithi046 ceph-mon[88928]: pgmap v155: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 16 MiB/s wr, 233 op/s; 25 MiB/s, 185 objects/s recovering 2024-02-19T19:09:01.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:00 smithi142 ceph-mon[69118]: pgmap v155: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 16 MiB/s wr, 233 op/s; 25 MiB/s, 185 objects/s recovering 2024-02-19T19:09:03.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:02 smithi046 ceph-mon[88928]: pgmap v156: 65 pgs: 65 active+clean; 987 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 13 MiB/s rd, 13 MiB/s wr, 209 op/s; 20 MiB/s, 151 objects/s recovering 2024-02-19T19:09:03.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:02 smithi142 ceph-mon[69118]: pgmap v156: 65 pgs: 65 active+clean; 987 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 13 MiB/s rd, 13 MiB/s wr, 209 op/s; 20 MiB/s, 151 objects/s recovering 2024-02-19T19:09:04.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:04 smithi142 ceph-mon[69118]: pgmap v157: 65 pgs: 65 active+clean; 417 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s rd, 9.2 MiB/s wr, 245 op/s; 12 MiB/s, 71 objects/s recovering 2024-02-19T19:09:05.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:04 smithi046 ceph-mon[88928]: pgmap v157: 65 pgs: 65 active+clean; 417 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s rd, 9.2 MiB/s wr, 245 op/s; 12 MiB/s, 71 objects/s recovering 2024-02-19T19:09:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.238+0000 7f517fb48700 1 -- 172.21.15.46:0/603403065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5178100e60 msgr2=0x7f5178104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.238+0000 7f517fb48700 1 --2- 172.21.15.46:0/603403065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5178100e60 0x7f5178104e30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5168009910 tx=0x7f5168009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.238+0000 7f517fb48700 1 -- 172.21.15.46:0/603403065 shutdown_connections 2024-02-19T19:09:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.238+0000 7f517fb48700 1 --2- 172.21.15.46:0/603403065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5178100e60 0x7f5178104e30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.238+0000 7f517fb48700 1 --2- 172.21.15.46:0/603403065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51781004c0 0x7f5178100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.238+0000 7f517fb48700 1 -- 172.21.15.46:0/603403065 >> 172.21.15.46:0/603403065 conn(0x7f51780fbd80 msgr2=0x7f51780fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.238+0000 7f517fb48700 1 -- 172.21.15.46:0/603403065 shutdown_connections 2024-02-19T19:09:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.238+0000 7f517fb48700 1 -- 172.21.15.46:0/603403065 wait complete. 2024-02-19T19:09:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.239+0000 7f517fb48700 1 Processor -- start 2024-02-19T19:09:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.239+0000 7f517fb48700 1 -- start start 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.239+0000 7f517fb48700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51781004c0 0x7f5178195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.239+0000 7f517fb48700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5178100e60 0x7f5178196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.239+0000 7f517fb48700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5178196b10 con 0x7f5178100e60 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.239+0000 7f517fb48700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517819a8a0 con 0x7f51781004c0 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.239+0000 7f517d0e3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5178100e60 0x7f5178196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.239+0000 7f517d0e3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5178100e60 0x7f5178196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38804/0 (socket says 172.21.15.46:38804) 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.239+0000 7f517d0e3700 1 -- 172.21.15.46:0/3312166431 learned_addr learned my addr 172.21.15.46:0/3312166431 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.239+0000 7f517d8e4700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51781004c0 0x7f5178195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.240+0000 7f517d0e3700 1 -- 172.21.15.46:0/3312166431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51781004c0 msgr2=0x7f5178195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.240+0000 7f517d0e3700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51781004c0 0x7f5178195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.240+0000 7f517d0e3700 1 -- 172.21.15.46:0/3312166431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51680095f0 con 0x7f5178100e60 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.240+0000 7f517d0e3700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5178100e60 0x7f5178196430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f516800bda0 tx=0x7f516800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.240+0000 7f516effd700 1 -- 172.21.15.46:0/3312166431 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f516801d070 con 0x7f5178100e60 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.240+0000 7f516effd700 1 -- 172.21.15.46:0/3312166431 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5168005dc0 con 0x7f5178100e60 2024-02-19T19:09:05.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.240+0000 7f517fb48700 1 -- 172.21.15.46:0/3312166431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517819ab20 con 0x7f5178100e60 2024-02-19T19:09:05.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.240+0000 7f516effd700 1 -- 172.21.15.46:0/3312166431 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5168017400 con 0x7f5178100e60 2024-02-19T19:09:05.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.240+0000 7f517fb48700 1 -- 172.21.15.46:0/3312166431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517819b010 con 0x7f5178100e60 2024-02-19T19:09:05.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.241+0000 7f517fb48700 1 -- 172.21.15.46:0/3312166431 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5178108830 con 0x7f5178100e60 2024-02-19T19:09:05.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.242+0000 7f516effd700 1 -- 172.21.15.46:0/3312166431 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f516800f6f0 con 0x7f5178100e60 2024-02-19T19:09:05.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.242+0000 7f516effd700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f516406d8a0 0x7f516406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:05.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.242+0000 7f516effd700 1 -- 172.21.15.46:0/3312166431 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f516808e8c0 con 0x7f5178100e60 2024-02-19T19:09:05.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.242+0000 7f517d8e4700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f516406d8a0 0x7f516406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:05.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.243+0000 7f517d8e4700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f516406d8a0 0x7f516406fd50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5174005950 tx=0x7f517400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:05.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.249+0000 7f516effd700 1 -- 172.21.15.46:0/3312166431 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5168058090 con 0x7f5178100e60 2024-02-19T19:09:05.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.492+0000 7f517fb48700 1 -- 172.21.15.46:0/3312166431 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f517819b280 con 0x7f516406d8a0 2024-02-19T19:09:05.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.494+0000 7f516effd700 1 -- 172.21.15.46:0/3312166431 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f517819b280 con 0x7f516406d8a0 2024-02-19T19:09:05.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.496+0000 7f517fb48700 1 -- 172.21.15.46:0/3312166431 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f516406d8a0 msgr2=0x7f516406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:05.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.496+0000 7f517fb48700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f516406d8a0 0x7f516406fd50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5174005950 tx=0x7f517400b410 comp rx=0 tx=0).stop 2024-02-19T19:09:05.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.496+0000 7f517fb48700 1 -- 172.21.15.46:0/3312166431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5178100e60 msgr2=0x7f5178196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:05.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.496+0000 7f517fb48700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5178100e60 0x7f5178196430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f516800bda0 tx=0x7f516800bdd0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.496+0000 7f517fb48700 1 -- 172.21.15.46:0/3312166431 shutdown_connections 2024-02-19T19:09:05.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.496+0000 7f517fb48700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f516406d8a0 0x7f516406fd50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.496+0000 7f517fb48700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51781004c0 0x7f5178195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.496+0000 7f517fb48700 1 --2- 172.21.15.46:0/3312166431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5178100e60 0x7f5178196430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.496+0000 7f517fb48700 1 -- 172.21.15.46:0/3312166431 >> 172.21.15.46:0/3312166431 conn(0x7f51780fbd80 msgr2=0x7f51780fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:05.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.496+0000 7f517fb48700 1 -- 172.21.15.46:0/3312166431 shutdown_connections 2024-02-19T19:09:05.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.497+0000 7f517fb48700 1 -- 172.21.15.46:0/3312166431 wait complete. 2024-02-19T19:09:05.528 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:09:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.626+0000 7f9b0a978700 1 -- 172.21.15.46:0/3235998416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b04069140 msgr2=0x7f9b04104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.626+0000 7f9b0a978700 1 --2- 172.21.15.46:0/3235998416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b04069140 0x7f9b04104eb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009910 tx=0x7f9af8009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.626+0000 7f9b0a978700 1 -- 172.21.15.46:0/3235998416 shutdown_connections 2024-02-19T19:09:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.626+0000 7f9b0a978700 1 --2- 172.21.15.46:0/3235998416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b04069140 0x7f9b04104eb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.626+0000 7f9b0a978700 1 --2- 172.21.15.46:0/3235998416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b040687a0 0x7f9b04068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.626+0000 7f9b0a978700 1 -- 172.21.15.46:0/3235998416 >> 172.21.15.46:0/3235998416 conn(0x7f9b04075130 msgr2=0x7f9b04075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.626+0000 7f9b0a978700 1 -- 172.21.15.46:0/3235998416 shutdown_connections 2024-02-19T19:09:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.626+0000 7f9b0a978700 1 -- 172.21.15.46:0/3235998416 wait complete. 2024-02-19T19:09:05.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.627+0000 7f9b0a978700 1 Processor -- start 2024-02-19T19:09:05.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.627+0000 7f9b0a978700 1 -- start start 2024-02-19T19:09:05.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.627+0000 7f9b0a978700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b040687a0 0x7f9b04195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:05.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.627+0000 7f9b0a978700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b04069140 0x7f9b041963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:05.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.627+0000 7f9b0a978700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b04196a80 con 0x7f9b040687a0 2024-02-19T19:09:05.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.627+0000 7f9b0a978700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0419a810 con 0x7f9b04069140 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.627+0000 7f9b03fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b040687a0 0x7f9b04195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b03fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b040687a0 0x7f9b04195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38822/0 (socket says 172.21.15.46:38822) 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b03fff700 1 -- 172.21.15.46:0/3601401598 learned_addr learned my addr 172.21.15.46:0/3601401598 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b037fe700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b04069140 0x7f9b041963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b03fff700 1 -- 172.21.15.46:0/3601401598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b04069140 msgr2=0x7f9b041963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b03fff700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b04069140 0x7f9b041963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b03fff700 1 -- 172.21.15.46:0/3601401598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af80095f0 con 0x7f9b040687a0 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b037fe700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b04069140 0x7f9b041963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b03fff700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b040687a0 0x7f9b04195e60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9af400d900 tx=0x7f9af400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b017fa700 1 -- 172.21.15.46:0/3601401598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af40041f0 con 0x7f9b040687a0 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b017fa700 1 -- 172.21.15.46:0/3601401598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9af4004cf0 con 0x7f9b040687a0 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b017fa700 1 -- 172.21.15.46:0/3601401598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af400b750 con 0x7f9b040687a0 2024-02-19T19:09:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b0a978700 1 -- 172.21.15.46:0/3601401598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0419aaf0 con 0x7f9b040687a0 2024-02-19T19:09:05.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.628+0000 7f9b0a978700 1 -- 172.21.15.46:0/3601401598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0419aff0 con 0x7f9b040687a0 2024-02-19T19:09:05.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.630+0000 7f9b0a978700 1 -- 172.21.15.46:0/3601401598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b04108750 con 0x7f9b040687a0 2024-02-19T19:09:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.630+0000 7f9b017fa700 1 -- 172.21.15.46:0/3601401598 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9af4004750 con 0x7f9b040687a0 2024-02-19T19:09:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.631+0000 7f9b017fa700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9aec06d8a0 0x7f9aec06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.631+0000 7f9b017fa700 1 -- 172.21.15.46:0/3601401598 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f9af408d440 con 0x7f9b040687a0 2024-02-19T19:09:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.631+0000 7f9b037fe700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9aec06d8a0 0x7f9aec06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.631+0000 7f9b037fe700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9aec06d8a0 0x7f9aec06fd50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9b04197480 tx=0x7f9af801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:05.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.636+0000 7f9b017fa700 1 -- 172.21.15.46:0/3601401598 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9af4056b90 con 0x7f9b040687a0 2024-02-19T19:09:05.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:05 smithi046 ceph-mon[88928]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:05.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.954+0000 7f9b0a978700 1 -- 172.21.15.46:0/3601401598 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b0419b260 con 0x7f9aec06d8a0 2024-02-19T19:09:05.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.957+0000 7f9b017fa700 1 -- 172.21.15.46:0/3601401598 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9b0419b260 con 0x7f9aec06d8a0 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.961+0000 7f9b0a978700 1 -- 172.21.15.46:0/3601401598 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9aec06d8a0 msgr2=0x7f9aec06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.961+0000 7f9b0a978700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9aec06d8a0 0x7f9aec06fd50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9b04197480 tx=0x7f9af801a040 comp rx=0 tx=0).stop 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.961+0000 7f9b0a978700 1 -- 172.21.15.46:0/3601401598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b040687a0 msgr2=0x7f9b04195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.961+0000 7f9b0a978700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b040687a0 0x7f9b04195e60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9af400d900 tx=0x7f9af400dc10 comp rx=0 tx=0).stop 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.961+0000 7f9b0a978700 1 -- 172.21.15.46:0/3601401598 shutdown_connections 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.961+0000 7f9b0a978700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9aec06d8a0 0x7f9aec06fd50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.961+0000 7f9b0a978700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b040687a0 0x7f9b04195e60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.961+0000 7f9b0a978700 1 --2- 172.21.15.46:0/3601401598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b04069140 0x7f9b041963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.961+0000 7f9b0a978700 1 -- 172.21.15.46:0/3601401598 >> 172.21.15.46:0/3601401598 conn(0x7f9b04075130 msgr2=0x7f9b04104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.961+0000 7f9b0a978700 1 -- 172.21.15.46:0/3601401598 shutdown_connections 2024-02-19T19:09:05.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:05.962+0000 7f9b0a978700 1 -- 172.21.15.46:0/3601401598 wait complete. 2024-02-19T19:09:06.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.103+0000 7fd827d0b700 1 -- 172.21.15.46:0/2821852838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd820101d30 msgr2=0x7fd82010a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:06.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.103+0000 7fd827d0b700 1 --2- 172.21.15.46:0/2821852838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd820101d30 0x7fd82010a230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd810009910 tx=0x7fd810009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:06.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.103+0000 7fd827d0b700 1 -- 172.21.15.46:0/2821852838 shutdown_connections 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.103+0000 7fd827d0b700 1 --2- 172.21.15.46:0/2821852838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd820101d30 0x7fd82010a230 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.103+0000 7fd827d0b700 1 --2- 172.21.15.46:0/2821852838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd820101420 0x7fd8201017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.103+0000 7fd827d0b700 1 -- 172.21.15.46:0/2821852838 >> 172.21.15.46:0/2821852838 conn(0x7fd8200fac60 msgr2=0x7fd8200fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.103+0000 7fd827d0b700 1 -- 172.21.15.46:0/2821852838 shutdown_connections 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.103+0000 7fd827d0b700 1 -- 172.21.15.46:0/2821852838 wait complete. 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd827d0b700 1 Processor -- start 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd827d0b700 1 -- start start 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd827d0b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd820101420 0x7fd820195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd827d0b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd820101d30 0x7fd820196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd827d0b700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd820196a70 con 0x7fd820101d30 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd827d0b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82019a800 con 0x7fd820101420 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd8252a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd820101d30 0x7fd820196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:06.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd8252a6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd820101d30 0x7fd820196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38852/0 (socket says 172.21.15.46:38852) 2024-02-19T19:09:06.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd8252a6700 1 -- 172.21.15.46:0/2717607042 learned_addr learned my addr 172.21.15.46:0/2717607042 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:06.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd825aa7700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd820101420 0x7fd820195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd8252a6700 1 -- 172.21.15.46:0/2717607042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd820101420 msgr2=0x7fd820195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd8252a6700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd820101420 0x7fd820195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.104+0000 7fd8252a6700 1 -- 172.21.15.46:0/2717607042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100095f0 con 0x7fd820101d30 2024-02-19T19:09:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.105+0000 7fd8252a6700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd820101d30 0x7fd820196390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd810006010 tx=0x7fd81000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.105+0000 7fd816ffd700 1 -- 172.21.15.46:0/2717607042 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd81001d070 con 0x7fd820101d30 2024-02-19T19:09:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.105+0000 7fd816ffd700 1 -- 172.21.15.46:0/2717607042 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd810005dc0 con 0x7fd820101d30 2024-02-19T19:09:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.105+0000 7fd827d0b700 1 -- 172.21.15.46:0/2717607042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82019aa80 con 0x7fd820101d30 2024-02-19T19:09:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.105+0000 7fd816ffd700 1 -- 172.21.15.46:0/2717607042 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd810017400 con 0x7fd820101d30 2024-02-19T19:09:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.105+0000 7fd827d0b700 1 -- 172.21.15.46:0/2717607042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82019af70 con 0x7fd820101d30 2024-02-19T19:09:06.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.106+0000 7fd827d0b700 1 -- 172.21.15.46:0/2717607042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8201078a0 con 0x7fd820101d30 2024-02-19T19:09:06.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.107+0000 7fd816ffd700 1 -- 172.21.15.46:0/2717607042 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd810003a60 con 0x7fd820101d30 2024-02-19T19:09:06.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.107+0000 7fd816ffd700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd80c06d8a0 0x7fd80c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:06.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.107+0000 7fd816ffd700 1 -- 172.21.15.46:0/2717607042 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fd81008e960 con 0x7fd820101d30 2024-02-19T19:09:06.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.107+0000 7fd825aa7700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd80c06d8a0 0x7fd80c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:06.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.108+0000 7fd825aa7700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd80c06d8a0 0x7fd80c06fd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd81c005950 tx=0x7fd81c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:06.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.112+0000 7fd816ffd700 1 -- 172.21.15.46:0/2717607042 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd810058130 con 0x7fd820101d30 2024-02-19T19:09:06.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:05 smithi142 ceph-mon[69118]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:06.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.345+0000 7fd827d0b700 1 -- 172.21.15.46:0/2717607042 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd82019b2a0 con 0x7fd80c06d8a0 2024-02-19T19:09:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.357+0000 7fd816ffd700 1 -- 172.21.15.46:0/2717607042 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd82019b2a0 con 0x7fd80c06d8a0 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 21s ago 15m 25.7M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (16m) 21s ago 16m 8572k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (14m) 2m ago 14m 7960k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (2m) 21s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (2m) 2m ago 14m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (4m) 21s ago 15m 88.1M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (9m) 21s ago 9m 140M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (9m) 21s ago 9m 17.0M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (9m) 2m ago 9m 16.6M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:09:06.379 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (9m) 2m ago 9m 25.4M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (6m) 21s ago 17m 507M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (6m) 2m ago 14m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (3m) 21s ago 17m 49.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (3m) 2m ago 14m 34.1M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (6m) 21s ago 15m 16.6M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (6m) 2m ago 14m 16.8M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (2m) 21s ago 13m 231M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (92s) 21s ago 12m 250M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 974e56511c36 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (40s) 21s ago 12m 15.1M 1217M 19.0.0-1450-gf78a58c0 f081f847070a a31225ea4dec 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (12m) 2m ago 12m 49.8M 2240M 18.2.0 dc2bc1663786 b89597766276 2024-02-19T19:09:06.380 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (11m) 2m ago 11m 47.8M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:09:06.381 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (11m) 2m ago 11m 48.8M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:09:06.381 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 21s ago 14m 68.2M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:09:06.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 -- 172.21.15.46:0/2717607042 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd80c06d8a0 msgr2=0x7fd80c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd80c06d8a0 0x7fd80c06fd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd81c005950 tx=0x7fd81c00b410 comp rx=0 tx=0).stop 2024-02-19T19:09:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 -- 172.21.15.46:0/2717607042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd820101d30 msgr2=0x7fd820196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd820101d30 0x7fd820196390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd810006010 tx=0x7fd81000bd70 comp rx=0 tx=0).stop 2024-02-19T19:09:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 -- 172.21.15.46:0/2717607042 shutdown_connections 2024-02-19T19:09:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd80c06d8a0 0x7fd80c06fd50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd820101420 0x7fd820195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 --2- 172.21.15.46:0/2717607042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd820101d30 0x7fd820196390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 -- 172.21.15.46:0/2717607042 >> 172.21.15.46:0/2717607042 conn(0x7fd8200fac60 msgr2=0x7fd8201049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 -- 172.21.15.46:0/2717607042 shutdown_connections 2024-02-19T19:09:06.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.360+0000 7fd827d0b700 1 -- 172.21.15.46:0/2717607042 wait complete. 2024-02-19T19:09:06.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.485+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1440244064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e981026a0 msgr2=0x7f3e98102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:06.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.485+0000 7f3e9cddf700 1 --2- 172.21.15.46:0/1440244064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e981026a0 0x7f3e98102a70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009910 tx=0x7f3e88009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:06.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.485+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1440244064 shutdown_connections 2024-02-19T19:09:06.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.485+0000 7f3e9cddf700 1 --2- 172.21.15.46:0/1440244064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e98103040 0x7f3e98107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.485+0000 7f3e9cddf700 1 --2- 172.21.15.46:0/1440244064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e981026a0 0x7f3e98102a70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.485+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1440244064 >> 172.21.15.46:0/1440244064 conn(0x7f3e980fdf40 msgr2=0x7f3e98100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:06.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.485+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1440244064 shutdown_connections 2024-02-19T19:09:06.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.485+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1440244064 wait complete. 2024-02-19T19:09:06.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.485+0000 7f3e9cddf700 1 Processor -- start 2024-02-19T19:09:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e9cddf700 1 -- start start 2024-02-19T19:09:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e9cddf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e981026a0 0x7f3e98198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e9cddf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e98103040 0x7f3e98198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e9cddf700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98198cc0 con 0x7f3e98103040 2024-02-19T19:09:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e9cddf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98198e00 con 0x7f3e981026a0 2024-02-19T19:09:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e95d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e98103040 0x7f3e98198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e95d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e98103040 0x7f3e98198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38866/0 (socket says 172.21.15.46:38866) 2024-02-19T19:09:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e95d9b700 1 -- 172.21.15.46:0/1088760065 learned_addr learned my addr 172.21.15.46:0/1088760065 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e9659c700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e981026a0 0x7f3e98198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:06.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e95d9b700 1 -- 172.21.15.46:0/1088760065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e981026a0 msgr2=0x7f3e98198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e95d9b700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e981026a0 0x7f3e98198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e95d9b700 1 -- 172.21.15.46:0/1088760065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e880095f0 con 0x7f3e98103040 2024-02-19T19:09:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.486+0000 7f3e95d9b700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e98103040 0x7f3e98198670 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00c960 tx=0x7f3e8c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.487+0000 7f3e877fe700 1 -- 172.21.15.46:0/1088760065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e8c007a70 con 0x7f3e98103040 2024-02-19T19:09:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.487+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1088760065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9819cc50 con 0x7f3e98103040 2024-02-19T19:09:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.487+0000 7f3e877fe700 1 -- 172.21.15.46:0/1088760065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e8c007bd0 con 0x7f3e98103040 2024-02-19T19:09:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.487+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1088760065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9819d1a0 con 0x7f3e98103040 2024-02-19T19:09:06.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.487+0000 7f3e877fe700 1 -- 172.21.15.46:0/1088760065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e8c018630 con 0x7f3e98103040 2024-02-19T19:09:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.488+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1088760065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9810a9b0 con 0x7f3e98103040 2024-02-19T19:09:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.488+0000 7f3e877fe700 1 -- 172.21.15.46:0/1088760065 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f3e8c00f450 con 0x7f3e98103040 2024-02-19T19:09:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.489+0000 7f3e877fe700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3e8006d8a0 0x7f3e8006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:06.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.489+0000 7f3e877fe700 1 -- 172.21.15.46:0/1088760065 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f3e8c08d490 con 0x7f3e98103040 2024-02-19T19:09:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.489+0000 7f3e9659c700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3e8006d8a0 0x7f3e8006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:06.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.490+0000 7f3e9659c700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3e8006d8a0 0x7f3e8006fd50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3e88006010 tx=0x7f3e8801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:06.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.494+0000 7f3e877fe700 1 -- 172.21.15.46:0/1088760065 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3e8c056d10 con 0x7f3e98103040 2024-02-19T19:09:06.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.893+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1088760065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e9810a390 con 0x7f3e98103040 2024-02-19T19:09:06.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.894+0000 7f3e877fe700 1 -- 172.21.15.46:0/1088760065 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f3e8c05a3d0 con 0x7f3e98103040 2024-02-19T19:09:06.916 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:09:06.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:09:06.916 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:09:06.916 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:09:06.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:09:06.916 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:09:06.916 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:09:06.916 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:09:06.916 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-02-19T19:09:06.916 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 3 2024-02-19T19:09:06.917 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:09:06.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:09:06.917 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:09:06.917 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:09:06.917 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:09:06.917 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-02-19T19:09:06.917 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 7 2024-02-19T19:09:06.917 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:09:06.917 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:09:06.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1088760065 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3e8006d8a0 msgr2=0x7f3e8006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:06.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3e8006d8a0 0x7f3e8006fd50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3e88006010 tx=0x7f3e8801a040 comp rx=0 tx=0).stop 2024-02-19T19:09:06.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1088760065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e98103040 msgr2=0x7f3e98198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:06.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e98103040 0x7f3e98198670 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00c960 tx=0x7f3e8c00cc70 comp rx=0 tx=0).stop 2024-02-19T19:09:06.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1088760065 shutdown_connections 2024-02-19T19:09:06.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3e8006d8a0 0x7f3e8006fd50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e981026a0 0x7f3e98198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 --2- 172.21.15.46:0/1088760065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e98103040 0x7f3e98198670 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:06.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1088760065 >> 172.21.15.46:0/1088760065 conn(0x7f3e980fdf40 msgr2=0x7f3e980ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:06.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1088760065 shutdown_connections 2024-02-19T19:09:06.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:06.898+0000 7f3e9cddf700 1 -- 172.21.15.46:0/1088760065 wait complete. 2024-02-19T19:09:07.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:06 smithi046 ceph-mon[88928]: pgmap v158: 65 pgs: 65 active+clean; 330 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 182 op/s; 11 MiB/s, 65 objects/s recovering 2024-02-19T19:09:07.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:06 smithi046 ceph-mon[88928]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:07.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:06 smithi046 ceph-mon[88928]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:07.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.068+0000 7fe57a9a8700 1 -- 172.21.15.46:0/305579617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740ffd60 msgr2=0x7fe574103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:07.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.068+0000 7fe57a9a8700 1 --2- 172.21.15.46:0/305579617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740ffd60 0x7fe574103d30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe568009910 tx=0x7fe568009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:07.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.068+0000 7fe57a9a8700 1 -- 172.21.15.46:0/305579617 shutdown_connections 2024-02-19T19:09:07.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.068+0000 7fe57a9a8700 1 --2- 172.21.15.46:0/305579617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740ffd60 0x7fe574103d30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.068+0000 7fe57a9a8700 1 --2- 172.21.15.46:0/305579617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5740ff3c0 0x7fe5740ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.068+0000 7fe57a9a8700 1 -- 172.21.15.46:0/305579617 >> 172.21.15.46:0/305579617 conn(0x7fe5740fac80 msgr2=0x7fe5740fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:07.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.068+0000 7fe57a9a8700 1 -- 172.21.15.46:0/305579617 shutdown_connections 2024-02-19T19:09:07.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.068+0000 7fe57a9a8700 1 -- 172.21.15.46:0/305579617 wait complete. 2024-02-19T19:09:07.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.069+0000 7fe57a9a8700 1 Processor -- start 2024-02-19T19:09:07.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.069+0000 7fe57a9a8700 1 -- start start 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.069+0000 7fe57a9a8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740ff3c0 0x7fe574195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.069+0000 7fe57a9a8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5740ffd60 0x7fe574196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.069+0000 7fe57a9a8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe574196ae0 con 0x7fe5740ff3c0 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.069+0000 7fe57a9a8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe574196c20 con 0x7fe5740ffd60 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.069+0000 7fe573fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740ff3c0 0x7fe574195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe573fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740ff3c0 0x7fe574195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38894/0 (socket says 172.21.15.46:38894) 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe573fff700 1 -- 172.21.15.46:0/914587344 learned_addr learned my addr 172.21.15.46:0/914587344 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe5737fe700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5740ffd60 0x7fe574196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe573fff700 1 -- 172.21.15.46:0/914587344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5740ffd60 msgr2=0x7fe574196490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe573fff700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5740ffd60 0x7fe574196490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe573fff700 1 -- 172.21.15.46:0/914587344 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680095f0 con 0x7fe5740ff3c0 2024-02-19T19:09:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe573fff700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740ff3c0 0x7fe574195f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe56400c930 tx=0x7fe56400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe5717fa700 1 -- 172.21.15.46:0/914587344 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe564007ad0 con 0x7fe5740ff3c0 2024-02-19T19:09:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe57a9a8700 1 -- 172.21.15.46:0/914587344 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57419aa70 con 0x7fe5740ff3c0 2024-02-19T19:09:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe5717fa700 1 -- 172.21.15.46:0/914587344 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe56400ce80 con 0x7fe5740ff3c0 2024-02-19T19:09:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe5717fa700 1 -- 172.21.15.46:0/914587344 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe564018630 con 0x7fe5740ff3c0 2024-02-19T19:09:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.070+0000 7fe57a9a8700 1 -- 172.21.15.46:0/914587344 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57419af90 con 0x7fe5740ff3c0 2024-02-19T19:09:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.071+0000 7fe57a9a8700 1 -- 172.21.15.46:0/914587344 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe574108740 con 0x7fe5740ff3c0 2024-02-19T19:09:07.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.072+0000 7fe5717fa700 1 -- 172.21.15.46:0/914587344 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe564007c30 con 0x7fe5740ff3c0 2024-02-19T19:09:07.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.072+0000 7fe5717fa700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe55c06d8a0 0x7fe55c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:07.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.072+0000 7fe5717fa700 1 -- 172.21.15.46:0/914587344 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fe56408d5c0 con 0x7fe5740ff3c0 2024-02-19T19:09:07.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.073+0000 7fe5737fe700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe55c06d8a0 0x7fe55c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:07.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.073+0000 7fe5737fe700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe55c06d8a0 0x7fe55c06fd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe568006010 tx=0x7fe56801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:07.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.081+0000 7fe5717fa700 1 -- 172.21.15.46:0/914587344 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe564056d10 con 0x7fe5740ff3c0 2024-02-19T19:09:07.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:06 smithi142 ceph-mon[69118]: pgmap v158: 65 pgs: 65 active+clean; 330 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 182 op/s; 11 MiB/s, 65 objects/s recovering 2024-02-19T19:09:07.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:06 smithi142 ceph-mon[69118]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:07.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:06 smithi142 ceph-mon[69118]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.408+0000 7fe57a9a8700 1 -- 172.21.15.46:0/914587344 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe574108120 con 0x7fe5740ff3c0 2024-02-19T19:09:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.409+0000 7fe5717fa700 1 -- 172.21.15.46:0/914587344 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1890 (secure 0 0 0) 0x7fe56405a3d0 con 0x7fe5740ff3c0 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout:e19 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 19 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:09:07.431 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T19:08:21.613462+0000 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T19:09:07.432 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:09:07.433 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:09:07.434 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:09:07.434 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:09:07.434 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:07.434 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.412+0000 7fe57a9a8700 1 -- 172.21.15.46:0/914587344 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe55c06d8a0 msgr2=0x7fe55c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.412+0000 7fe57a9a8700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe55c06d8a0 0x7fe55c06fd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe568006010 tx=0x7fe56801a040 comp rx=0 tx=0).stop 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.412+0000 7fe57a9a8700 1 -- 172.21.15.46:0/914587344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740ff3c0 msgr2=0x7fe574195f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.412+0000 7fe57a9a8700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740ff3c0 0x7fe574195f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe56400c930 tx=0x7fe56400cc40 comp rx=0 tx=0).stop 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.412+0000 7fe57a9a8700 1 -- 172.21.15.46:0/914587344 shutdown_connections 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.412+0000 7fe57a9a8700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe55c06d8a0 0x7fe55c06fd50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.412+0000 7fe57a9a8700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5740ff3c0 0x7fe574195f50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.412+0000 7fe57a9a8700 1 --2- 172.21.15.46:0/914587344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5740ffd60 0x7fe574196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.412+0000 7fe57a9a8700 1 -- 172.21.15.46:0/914587344 >> 172.21.15.46:0/914587344 conn(0x7fe5740fac80 msgr2=0x7fe574069050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.412+0000 7fe57a9a8700 1 -- 172.21.15.46:0/914587344 shutdown_connections 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.413+0000 7fe57a9a8700 1 -- 172.21.15.46:0/914587344 wait complete. 2024-02-19T19:09:07.435 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-02-19T19:09:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.530+0000 7fe988657700 1 -- 172.21.15.46:0/1681216441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9801004e0 msgr2=0x7fe9801008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.530+0000 7fe988657700 1 --2- 172.21.15.46:0/1681216441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9801004e0 0x7fe9801008b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009910 tx=0x7fe97c009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.530+0000 7fe988657700 1 -- 172.21.15.46:0/1681216441 shutdown_connections 2024-02-19T19:09:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.530+0000 7fe988657700 1 --2- 172.21.15.46:0/1681216441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe980100e80 0x7fe980104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.530+0000 7fe988657700 1 --2- 172.21.15.46:0/1681216441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9801004e0 0x7fe9801008b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.530+0000 7fe988657700 1 -- 172.21.15.46:0/1681216441 >> 172.21.15.46:0/1681216441 conn(0x7fe9800fbda0 msgr2=0x7fe9800fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:07.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.531+0000 7fe988657700 1 -- 172.21.15.46:0/1681216441 shutdown_connections 2024-02-19T19:09:07.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.531+0000 7fe988657700 1 -- 172.21.15.46:0/1681216441 wait complete. 2024-02-19T19:09:07.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.531+0000 7fe988657700 1 Processor -- start 2024-02-19T19:09:07.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.531+0000 7fe988657700 1 -- start start 2024-02-19T19:09:07.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe988657700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9801004e0 0x7fe980195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe988657700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe980100e80 0x7fe980196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe988657700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe980196b10 con 0x7fe9801004e0 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe988657700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98019a8a0 con 0x7fe980100e80 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe9863f3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9801004e0 0x7fe980195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe9863f3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9801004e0 0x7fe980195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33656/0 (socket says 172.21.15.46:33656) 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe9863f3700 1 -- 172.21.15.46:0/102564119 learned_addr learned my addr 172.21.15.46:0/102564119 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe985bf2700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe980100e80 0x7fe980196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe9863f3700 1 -- 172.21.15.46:0/102564119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe980100e80 msgr2=0x7fe980196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe9863f3700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe980100e80 0x7fe980196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe9863f3700 1 -- 172.21.15.46:0/102564119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c0095f0 con 0x7fe9801004e0 2024-02-19T19:09:07.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe9863f3700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9801004e0 0x7fe980195ef0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe97c006010 tx=0x7fe97c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe9777fe700 1 -- 172.21.15.46:0/102564119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe97c01d070 con 0x7fe9801004e0 2024-02-19T19:09:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe9777fe700 1 -- 172.21.15.46:0/102564119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe97c005dc0 con 0x7fe9801004e0 2024-02-19T19:09:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.532+0000 7fe988657700 1 -- 172.21.15.46:0/102564119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98019ab20 con 0x7fe9801004e0 2024-02-19T19:09:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.533+0000 7fe9777fe700 1 -- 172.21.15.46:0/102564119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe97c017400 con 0x7fe9801004e0 2024-02-19T19:09:07.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.533+0000 7fe988657700 1 -- 172.21.15.46:0/102564119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98019b010 con 0x7fe9801004e0 2024-02-19T19:09:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.534+0000 7fe988657700 1 -- 172.21.15.46:0/102564119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9801087f0 con 0x7fe9801004e0 2024-02-19T19:09:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.534+0000 7fe9777fe700 1 -- 172.21.15.46:0/102564119 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe97c003a60 con 0x7fe9801004e0 2024-02-19T19:09:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.535+0000 7fe9777fe700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe96c06d8a0 0x7fe96c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.535+0000 7fe9777fe700 1 -- 172.21.15.46:0/102564119 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fe97c08ea10 con 0x7fe9801004e0 2024-02-19T19:09:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.535+0000 7fe985bf2700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe96c06d8a0 0x7fe96c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:07.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.535+0000 7fe985bf2700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe96c06d8a0 0x7fe96c06fd50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe980197510 tx=0x7fe97000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:07.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.540+0000 7fe9777fe700 1 -- 172.21.15.46:0/102564119 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe97c058160 con 0x7fe9801004e0 2024-02-19T19:09:07.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.833+0000 7fe988657700 1 -- 172.21.15.46:0/102564119 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe98019b1a0 con 0x7fe96c06d8a0 2024-02-19T19:09:07.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.834+0000 7fe9777fe700 1 -- 172.21.15.46:0/102564119 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe98019b1a0 con 0x7fe96c06d8a0 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "9/23 daemons upgraded", 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:09:07.856 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:09:07.857 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:09:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.836+0000 7fe988657700 1 -- 172.21.15.46:0/102564119 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe96c06d8a0 msgr2=0x7fe96c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.836+0000 7fe988657700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe96c06d8a0 0x7fe96c06fd50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe980197510 tx=0x7fe97000b410 comp rx=0 tx=0).stop 2024-02-19T19:09:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.836+0000 7fe988657700 1 -- 172.21.15.46:0/102564119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9801004e0 msgr2=0x7fe980195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.836+0000 7fe988657700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9801004e0 0x7fe980195ef0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe97c006010 tx=0x7fe97c00bd70 comp rx=0 tx=0).stop 2024-02-19T19:09:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.837+0000 7fe988657700 1 -- 172.21.15.46:0/102564119 shutdown_connections 2024-02-19T19:09:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.837+0000 7fe988657700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe96c06d8a0 0x7fe96c06fd50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.837+0000 7fe988657700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9801004e0 0x7fe980195ef0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.837+0000 7fe988657700 1 --2- 172.21.15.46:0/102564119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe980100e80 0x7fe980196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.837+0000 7fe988657700 1 -- 172.21.15.46:0/102564119 >> 172.21.15.46:0/102564119 conn(0x7fe9800fbda0 msgr2=0x7fe9800fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.837+0000 7fe988657700 1 -- 172.21.15.46:0/102564119 shutdown_connections 2024-02-19T19:09:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:07.837+0000 7fe988657700 1 -- 172.21.15.46:0/102564119 wait complete. 2024-02-19T19:09:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.000+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2987929826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b84068540 msgr2=0x7f8b840689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.000+0000 7f8b8c77f700 1 --2- 172.21.15.46:0/2987929826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b84068540 0x7f8b840689b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009910 tx=0x7f8b74009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:08.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:07 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1088760065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:08.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:07 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/914587344' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:09:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.001+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2987929826 shutdown_connections 2024-02-19T19:09:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.001+0000 7f8b8c77f700 1 --2- 172.21.15.46:0/2987929826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b84068540 0x7f8b840689b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.001+0000 7f8b8c77f700 1 --2- 172.21.15.46:0/2987929826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84106320 0x7f8b841066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.001+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2987929826 >> 172.21.15.46:0/2987929826 conn(0x7f8b84075130 msgr2=0x7f8b84075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.001+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2987929826 shutdown_connections 2024-02-19T19:09:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.001+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2987929826 wait complete. 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.002+0000 7f8b8c77f700 1 Processor -- start 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.002+0000 7f8b8c77f700 1 -- start start 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.002+0000 7f8b8c77f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84068540 0x7f8b84195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.002+0000 7f8b8c77f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b84106320 0x7f8b841963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.002+0000 7f8b8c77f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b84196a80 con 0x7f8b84106320 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.002+0000 7f8b89d1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b84106320 0x7f8b841963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.002+0000 7f8b89d1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b84106320 0x7f8b841963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33668/0 (socket says 172.21.15.46:33668) 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.002+0000 7f8b89d1a700 1 -- 172.21.15.46:0/2919866788 learned_addr learned my addr 172.21.15.46:0/2919866788 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.002+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8419a7a0 con 0x7f8b84068540 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.002+0000 7f8b8a51b700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84068540 0x7f8b84195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.003+0000 7f8b89d1a700 1 -- 172.21.15.46:0/2919866788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84068540 msgr2=0x7f8b84195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.003+0000 7f8b89d1a700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84068540 0x7f8b84195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.003+0000 7f8b89d1a700 1 -- 172.21.15.46:0/2919866788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b740095f0 con 0x7f8b84106320 2024-02-19T19:09:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.003+0000 7f8b89d1a700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b84106320 0x7f8b841963a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8b74005f50 tx=0x7f8b7400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.003+0000 7f8b7b7fe700 1 -- 172.21.15.46:0/2919866788 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b7401d070 con 0x7f8b84106320 2024-02-19T19:09:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.003+0000 7f8b7b7fe700 1 -- 172.21.15.46:0/2919866788 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b7400b610 con 0x7f8b84106320 2024-02-19T19:09:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.004+0000 7f8b7b7fe700 1 -- 172.21.15.46:0/2919866788 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b74022470 con 0x7f8b84106320 2024-02-19T19:09:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.004+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8419aa20 con 0x7f8b84106320 2024-02-19T19:09:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.004+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8419af10 con 0x7f8b84106320 2024-02-19T19:09:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.005+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b84108770 con 0x7f8b84106320 2024-02-19T19:09:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.006+0000 7f8b7b7fe700 1 -- 172.21.15.46:0/2919866788 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8b74003780 con 0x7f8b84106320 2024-02-19T19:09:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.006+0000 7f8b7b7fe700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b7006d8a0 0x7f8b7006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.006+0000 7f8b7b7fe700 1 -- 172.21.15.46:0/2919866788 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f8b7408e840 con 0x7f8b84106320 2024-02-19T19:09:08.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.006+0000 7f8b8a51b700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b7006d8a0 0x7f8b7006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:08.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.007+0000 7f8b8a51b700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b7006d8a0 0x7f8b7006fd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009c60 tx=0x7f8b80009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:08.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.011+0000 7f8b7b7fe700 1 -- 172.21.15.46:0/2919866788 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8b74058180 con 0x7f8b84106320 2024-02-19T19:09:08.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:07 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1088760065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:08.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:07 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/914587344' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:09:08.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.486+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8b84108150 con 0x7f8b84106320 2024-02-19T19:09:08.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.486+0000 7f8b7b7fe700 1 -- 172.21.15.46:0/2919866788 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8b7405b840 con 0x7f8b84106320 2024-02-19T19:09:08.508 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_OK 2024-02-19T19:09:08.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b7006d8a0 msgr2=0x7f8b7006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:08.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b7006d8a0 0x7f8b7006fd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009c60 tx=0x7f8b80009260 comp rx=0 tx=0).stop 2024-02-19T19:09:08.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b84106320 msgr2=0x7f8b841963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:08.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b84106320 0x7f8b841963a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8b74005f50 tx=0x7f8b7400f690 comp rx=0 tx=0).stop 2024-02-19T19:09:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 shutdown_connections 2024-02-19T19:09:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b7006d8a0 0x7f8b7006fd50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84068540 0x7f8b84195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 --2- 172.21.15.46:0/2919866788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b84106320 0x7f8b841963a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 >> 172.21.15.46:0/2919866788 conn(0x7f8b84075130 msgr2=0x7f8b840febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 shutdown_connections 2024-02-19T19:09:08.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:08.489+0000 7f8b8c77f700 1 -- 172.21.15.46:0/2919866788 wait complete. 2024-02-19T19:09:09.054 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:08 smithi142 ceph-mon[69118]: pgmap v159: 65 pgs: 65 active+clean; 330 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 169 op/s; 3.3 MiB/s, 29 objects/s recovering 2024-02-19T19:09:09.054 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:09.054 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:08 smithi142 ceph-mon[69118]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:09.054 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:09:09.054 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:08 smithi142 ceph-mon[69118]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:09:09.054 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:08 smithi142 ceph-mon[69118]: Upgrade: osd.3 is safe to restart 2024-02-19T19:09:09.054 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:08 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2919866788' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:09:09.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:08 smithi046 ceph-mon[88928]: pgmap v159: 65 pgs: 65 active+clean; 330 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 169 op/s; 3.3 MiB/s, 29 objects/s recovering 2024-02-19T19:09:09.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:09.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:08 smithi046 ceph-mon[88928]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:09.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:09:09.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:08 smithi046 ceph-mon[88928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:09:09.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:08 smithi046 ceph-mon[88928]: Upgrade: osd.3 is safe to restart 2024-02-19T19:09:09.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:08 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2919866788' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:09:11.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:11 smithi142 ceph-mon[69118]: pgmap v160: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.5 MiB/s wr, 276 op/s; 3.3 MiB/s, 29 objects/s recovering 2024-02-19T19:09:11.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:11 smithi142 ceph-mon[69118]: Upgrade: Updating osd.3 2024-02-19T19:09:11.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:11.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T19:09:11.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:11.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:11 smithi142 ceph-mon[69118]: Deploying daemon osd.3 on smithi142 2024-02-19T19:09:11.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:11 smithi046 ceph-mon[88928]: pgmap v160: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 38 KiB/s rd, 1.5 MiB/s wr, 276 op/s; 3.3 MiB/s, 29 objects/s recovering 2024-02-19T19:09:11.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:11 smithi046 ceph-mon[88928]: Upgrade: Updating osd.3 2024-02-19T19:09:11.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:11.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T19:09:11.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:11.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:11 smithi046 ceph-mon[88928]: Deploying daemon osd.3 on smithi142 2024-02-19T19:09:13.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:13 smithi142 ceph-mon[69118]: pgmap v161: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 238 op/s 2024-02-19T19:09:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:13.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:13 smithi046 ceph-mon[88928]: pgmap v161: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 238 op/s 2024-02-19T19:09:13.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:14.100 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:13 smithi142 systemd[1]: Stopping Ceph osd.3 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:09:14.368 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:14 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[43200]: 2024-02-19T19:09:14.080+0000 7f14f6b1b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:09:14.368 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:14 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[43200]: 2024-02-19T19:09:14.080+0000 7f14f6b1b700 -1 osd.3 95 *** Got signal Terminated *** 2024-02-19T19:09:14.368 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:14 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[43200]: 2024-02-19T19:09:14.080+0000 7f14f6b1b700 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:09:14.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:14 smithi142 ceph-mon[69118]: osd.3 marked itself down and dead 2024-02-19T19:09:14.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:14 smithi046 ceph-mon[88928]: osd.3 marked itself down and dead 2024-02-19T19:09:15.427 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:14 smithi142 podman[78641]: 2024-02-19 19:09:14.975146692 +0000 UTC m=+0.994598332 container died b8959776627682cf5e23ded68bf3af7cb9f4522b6b0bc464d5190b94585f3729 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:09:15.702 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:15 smithi142 podman[78641]: 2024-02-19 19:09:15.558931172 +0000 UTC m=+1.578382808 container cleanup b8959776627682cf5e23ded68bf3af7cb9f4522b6b0bc464d5190b94585f3729 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, io.buildah.version=1.29.1) 2024-02-19T19:09:15.702 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:15 smithi142 bash[78641]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3 2024-02-19T19:09:15.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:15 smithi142 ceph-mon[69118]: pgmap v162: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 340 op/s 2024-02-19T19:09:15.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:15 smithi142 ceph-mon[69118]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:09:15.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:15 smithi142 ceph-mon[69118]: osdmap e96: 6 total, 5 up, 6 in 2024-02-19T19:09:15.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:15 smithi046 ceph-mon[88928]: pgmap v162: 65 pgs: 65 active+clean; 314 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 340 op/s 2024-02-19T19:09:15.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:15 smithi046 ceph-mon[88928]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:09:15.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:15 smithi046 ceph-mon[88928]: osdmap e96: 6 total, 5 up, 6 in 2024-02-19T19:09:16.202 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:15 smithi142 podman[78670]: 2024-02-19 19:09:15.827020021 +0000 UTC m=+0.848701720 container remove b8959776627682cf5e23ded68bf3af7cb9f4522b6b0bc464d5190b94585f3729 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.29.1, org.label-schema.build-date=20231212) 2024-02-19T19:09:16.459 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:16 smithi142 ceph-mon[69118]: osdmap e97: 6 total, 5 up, 6 in 2024-02-19T19:09:16.459 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:16 smithi142 podman[78758]: 2024-02-19 19:09:16.087671563 +0000 UTC m=+0.020086465 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:09:16.460 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:16 smithi142 podman[78758]: 2024-02-19 19:09:16.194323612 +0000 UTC m=+0.126738506 container create d51b990ba26f3311d23295540f6c88db5a9cab49462dff3898b042f29f19ad94 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True) 2024-02-19T19:09:16.460 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:16 smithi142 podman[78758]: 2024-02-19 19:09:16.438891013 +0000 UTC m=+0.371305912 container init d51b990ba26f3311d23295540f6c88db5a9cab49462dff3898b042f29f19ad94 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-02-19T19:09:16.749 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:16 smithi142 podman[78758]: 2024-02-19 19:09:16.442338761 +0000 UTC m=+0.374753659 container start d51b990ba26f3311d23295540f6c88db5a9cab49462dff3898b042f29f19ad94 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True) 2024-02-19T19:09:16.749 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:16 smithi142 podman[78758]: 2024-02-19 19:09:16.546870579 +0000 UTC m=+0.479285485 container attach d51b990ba26f3311d23295540f6c88db5a9cab49462dff3898b042f29f19ad94 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:09:16.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:16 smithi046 ceph-mon[88928]: osdmap e97: 6 total, 5 up, 6 in 2024-02-19T19:09:17.070 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:16 smithi142 podman[78758]: 2024-02-19 19:09:16.727705093 +0000 UTC m=+0.660120005 container died d51b990ba26f3311d23295540f6c88db5a9cab49462dff3898b042f29f19ad94 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:09:17.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:17 smithi142 ceph-mon[69118]: pgmap v165: 65 pgs: 8 peering, 11 stale+active+clean, 46 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 436 op/s 2024-02-19T19:09:17.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:17 smithi142 ceph-mon[69118]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-19T19:09:17.703 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:17 smithi142 podman[78784]: 2024-02-19 19:09:17.325586002 +0000 UTC m=+0.592216706 container remove d51b990ba26f3311d23295540f6c88db5a9cab49462dff3898b042f29f19ad94 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:09:17.703 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:17 smithi142 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-19T19:09:17.703 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:17 smithi142 systemd[1]: Stopped Ceph osd.3 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:09:17.703 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:17 smithi142 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.3.service: Consumed 56.342s CPU time. 2024-02-19T19:09:17.703 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:17 smithi142 systemd[1]: Starting Ceph osd.3 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:09:17.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:17 smithi046 ceph-mon[88928]: pgmap v165: 65 pgs: 8 peering, 11 stale+active+clean, 46 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 2.0 MiB/s wr, 436 op/s 2024-02-19T19:09:17.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:17 smithi046 ceph-mon[88928]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-19T19:09:18.083 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:17 smithi142 podman[78889]: 2024-02-19 19:09:17.751973337 +0000 UTC m=+0.108843741 container create d0b962dff5bf058d0fe9ac83fb5af4310b11cedb3f43909f5642bc9a4dc43481 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, ceph=True, io.buildah.version=1.33.5) 2024-02-19T19:09:18.084 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:17 smithi142 podman[78889]: 2024-02-19 19:09:17.661478737 +0000 UTC m=+0.018349141 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:09:18.084 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:17 smithi142 podman[78889]: 2024-02-19 19:09:17.97135918 +0000 UTC m=+0.328229590 container init d0b962dff5bf058d0fe9ac83fb5af4310b11cedb3f43909f5642bc9a4dc43481 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-19T19:09:18.084 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:17 smithi142 podman[78889]: 2024-02-19 19:09:17.976010886 +0000 UTC m=+0.332881295 container start d0b962dff5bf058d0fe9ac83fb5af4310b11cedb3f43909f5642bc9a4dc43481 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:09:18.084 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 podman[78889]: 2024-02-19 19:09:18.062730142 +0000 UTC m=+0.419600552 container attach d0b962dff5bf058d0fe9ac83fb5af4310b11cedb3f43909f5642bc9a4dc43481 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-02-19T19:09:18.786 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate[78903]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate[78903]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 bash[78889]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 bash[78889]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 bash[78889]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 bash[78889]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 bash[78889]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 bash[78889]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 bash[78889]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate[78903]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate[78903]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate[78903]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-19T19:09:18.787 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate[78903]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-19T19:09:18.788 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate[78903]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-19T19:09:18.788 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:18 smithi142 podman[78889]: 2024-02-19 19:09:18.464004339 +0000 UTC m=+0.820874744 container died d0b962dff5bf058d0fe9ac83fb5af4310b11cedb3f43909f5642bc9a4dc43481 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD) 2024-02-19T19:09:19.355 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:19 smithi142 podman[79029]: 2024-02-19 19:09:19.066668645 +0000 UTC m=+0.597945191 container remove d0b962dff5bf058d0fe9ac83fb5af4310b11cedb3f43909f5642bc9a4dc43481 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-02-19T19:09:19.355 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:19 smithi142 podman[79089]: 2024-02-19 19:09:19.207420883 +0000 UTC m=+0.024318733 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:09:19.355 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:19 smithi142 podman[79089]: 2024-02-19 19:09:19.334480566 +0000 UTC m=+0.151378385 container create b46795b87c3eb6bba5e40a9765f783d9da6a0fe7f8ebafaee6c5a570f2f79b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:09:19.606 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:19 smithi142 ceph-mon[69118]: pgmap v166: 65 pgs: 8 peering, 11 stale+active+clean, 46 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.5 MiB/s wr, 276 op/s 2024-02-19T19:09:19.606 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:19 smithi142 podman[79089]: 2024-02-19 19:09:19.562208916 +0000 UTC m=+0.379106735 container init b46795b87c3eb6bba5e40a9765f783d9da6a0fe7f8ebafaee6c5a570f2f79b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:09:19.606 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:19 smithi142 podman[79089]: 2024-02-19 19:09:19.56547366 +0000 UTC m=+0.382371479 container start b46795b87c3eb6bba5e40a9765f783d9da6a0fe7f8ebafaee6c5a570f2f79b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-19T19:09:19.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:19 smithi046 ceph-mon[88928]: pgmap v166: 65 pgs: 8 peering, 11 stale+active+clean, 46 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 22 KiB/s rd, 1.5 MiB/s wr, 276 op/s 2024-02-19T19:09:19.952 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:19 smithi142 ceph-osd[79107]: -- 172.21.15.142:0/36523492 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b14ca671e0 con 0x55b14ca39000 2024-02-19T19:09:19.952 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:19 smithi142 bash[79089]: b46795b87c3eb6bba5e40a9765f783d9da6a0fe7f8ebafaee6c5a570f2f79b14 2024-02-19T19:09:19.952 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:19 smithi142 systemd[1]: Started Ceph osd.3 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:09:20.452 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:20 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[79103]: 2024-02-19T19:09:20.101+0000 7fd5f02ed7c0 -1 Falling back to public interface 2024-02-19T19:09:20.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:20.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:20 smithi142 ceph-mon[69118]: pgmap v167: 65 pgs: 25 active+undersized+degraded, 8 peering, 32 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 368 op/s; 2634/18708 objects degraded (14.080%) 2024-02-19T19:09:20.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:20.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:21.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:21.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:20 smithi046 ceph-mon[88928]: pgmap v167: 65 pgs: 25 active+undersized+degraded, 8 peering, 32 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 368 op/s; 2634/18708 objects degraded (14.080%) 2024-02-19T19:09:21.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:21.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:22.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:21 smithi046 ceph-mon[88928]: Health check failed: Degraded data redundancy: 2634/18708 objects degraded (14.080%), 25 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:22.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:21 smithi142 ceph-mon[69118]: Health check failed: Degraded data redundancy: 2634/18708 objects degraded (14.080%), 25 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:23.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:22 smithi046 ceph-mon[88928]: pgmap v168: 65 pgs: 33 active+undersized+degraded, 32 active+clean; 300 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 988 KiB/s wr, 234 op/s; 2987/17718 objects degraded (16.859%) 2024-02-19T19:09:23.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:22 smithi046 ceph-mon[88928]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-19T19:09:23.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:22 smithi142 ceph-mon[69118]: pgmap v168: 65 pgs: 33 active+undersized+degraded, 32 active+clean; 300 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 988 KiB/s wr, 234 op/s; 2987/17718 objects degraded (16.859%) 2024-02-19T19:09:23.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:22 smithi142 ceph-mon[69118]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-19T19:09:24.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:24 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:24.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:24 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:24.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:24 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:24.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:24 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:24.952 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:24 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[79103]: 2024-02-19T19:09:24.649+0000 7fd5f02ed7c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-19T19:09:25.298 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:25 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[79103]: 2024-02-19T19:09:25.199+0000 7fd5f02ed7c0 -1 osd.3 95 log_to_monitors true 2024-02-19T19:09:25.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:25 smithi046 ceph-mon[88928]: pgmap v169: 65 pgs: 33 active+undersized+degraded, 32 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 1.1 MiB/s wr, 369 op/s; 2190/13335 objects degraded (16.423%) 2024-02-19T19:09:25.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:25.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:25.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:25 smithi046 ceph-mon[88928]: from='osd.3 [v2:172.21.15.142:6800/3729925777,v1:172.21.15.142:6801/3729925777]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T19:09:25.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:25 smithi046 ceph-mon[88928]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T19:09:25.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:25 smithi142 ceph-mon[69118]: pgmap v169: 65 pgs: 33 active+undersized+degraded, 32 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 1.1 MiB/s wr, 369 op/s; 2190/13335 objects degraded (16.423%) 2024-02-19T19:09:25.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:25.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:25.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:25 smithi142 ceph-mon[69118]: from='osd.3 [v2:172.21.15.142:6800/3729925777,v1:172.21.15.142:6801/3729925777]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T19:09:25.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:25 smithi142 ceph-mon[69118]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T19:09:26.337 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 19:09:26 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[79103]: 2024-02-19T19:09:26.212+0000 7fd5dd73d700 -1 osd.3 95 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:09:26.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:26 smithi142 ceph-mon[69118]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T19:09:26.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:26 smithi142 ceph-mon[69118]: osdmap e98: 6 total, 5 up, 6 in 2024-02-19T19:09:26.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:26 smithi142 ceph-mon[69118]: from='osd.3 [v2:172.21.15.142:6800/3729925777,v1:172.21.15.142:6801/3729925777]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:09:26.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:26 smithi142 ceph-mon[69118]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:09:26.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:26 smithi142 ceph-mon[69118]: from='osd.3 ' entity='osd.3' 2024-02-19T19:09:26.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:26 smithi046 ceph-mon[88928]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T19:09:26.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:26 smithi046 ceph-mon[88928]: osdmap e98: 6 total, 5 up, 6 in 2024-02-19T19:09:26.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:26 smithi046 ceph-mon[88928]: from='osd.3 [v2:172.21.15.142:6800/3729925777,v1:172.21.15.142:6801/3729925777]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:09:26.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:26 smithi046 ceph-mon[88928]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:09:26.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:26 smithi046 ceph-mon[88928]: from='osd.3 ' entity='osd.3' 2024-02-19T19:09:27.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:27 smithi142 ceph-mon[69118]: pgmap v171: 65 pgs: 33 active+undersized+degraded, 32 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 340 op/s; 2108/12387 objects degraded (17.018%) 2024-02-19T19:09:27.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:27 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 2108/12387 objects degraded (17.018%), 33 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:27.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:27 smithi142 ceph-mon[69118]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:09:27.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:27 smithi142 ceph-mon[69118]: osd.3 [v2:172.21.15.142:6800/3729925777,v1:172.21.15.142:6801/3729925777] boot 2024-02-19T19:09:27.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:27 smithi142 ceph-mon[69118]: osdmap e99: 6 total, 6 up, 6 in 2024-02-19T19:09:27.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:09:27.733 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:27 smithi046 ceph-mon[88928]: pgmap v171: 65 pgs: 33 active+undersized+degraded, 32 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 340 op/s; 2108/12387 objects degraded (17.018%) 2024-02-19T19:09:27.733 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:27 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 2108/12387 objects degraded (17.018%), 33 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:27.733 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:27 smithi046 ceph-mon[88928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:09:27.733 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:27 smithi046 ceph-mon[88928]: osd.3 [v2:172.21.15.142:6800/3729925777,v1:172.21.15.142:6801/3729925777] boot 2024-02-19T19:09:27.734 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:27 smithi046 ceph-mon[88928]: osdmap e99: 6 total, 6 up, 6 in 2024-02-19T19:09:27.734 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:09:29.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: pgmap v173: 65 pgs: 33 active+undersized+degraded, 32 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 877 KiB/s wr, 287 op/s; 2108/12387 objects degraded (17.018%) 2024-02-19T19:09:29.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:29.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:29.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:29.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-02-19T19:09:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:28 smithi046 ceph-mon[88928]: osdmap e100: 6 total, 6 up, 6 in 2024-02-19T19:09:29.103 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: pgmap v173: 65 pgs: 33 active+undersized+degraded, 32 active+clean; 299 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 877 KiB/s wr, 287 op/s; 2108/12387 objects degraded (17.018%) 2024-02-19T19:09:29.103 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:09:29.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-02-19T19:09:29.105 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:28 smithi142 ceph-mon[69118]: osdmap e100: 6 total, 6 up, 6 in 2024-02-19T19:09:30.567 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:30 smithi142 ceph-mon[69118]: osdmap e101: 6 total, 6 up, 6 in 2024-02-19T19:09:30.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:30 smithi046 ceph-mon[88928]: osdmap e101: 6 total, 6 up, 6 in 2024-02-19T19:09:31.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:31 smithi046 ceph-mon[88928]: pgmap v176: 65 pgs: 4 remapped+peering, 6 peering, 19 active+undersized+degraded, 36 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 154 op/s; 976/11049 objects degraded (8.833%); 526 KiB/s, 21 objects/s recovering 2024-02-19T19:09:31.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:31 smithi046 ceph-mon[88928]: osdmap e102: 6 total, 6 up, 6 in 2024-02-19T19:09:31.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:31 smithi142 ceph-mon[69118]: pgmap v176: 65 pgs: 4 remapped+peering, 6 peering, 19 active+undersized+degraded, 36 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 154 op/s; 976/11049 objects degraded (8.833%); 526 KiB/s, 21 objects/s recovering 2024-02-19T19:09:31.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:31 smithi142 ceph-mon[69118]: osdmap e102: 6 total, 6 up, 6 in 2024-02-19T19:09:32.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:32 smithi046 ceph-mon[88928]: osdmap e103: 6 total, 6 up, 6 in 2024-02-19T19:09:32.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:32 smithi142 ceph-mon[69118]: osdmap e103: 6 total, 6 up, 6 in 2024-02-19T19:09:33.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:33 smithi046 ceph-mon[88928]: pgmap v179: 65 pgs: 4 remapped+peering, 8 peering, 53 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 2.7 MiB/s wr, 252 op/s; 2.6 MiB/s, 932 keys/s, 196 objects/s recovering 2024-02-19T19:09:33.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:33 smithi046 ceph-mon[88928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 976/11049 objects degraded (8.833%), 19 pgs degraded) 2024-02-19T19:09:33.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:33 smithi046 ceph-mon[88928]: Cluster is now healthy 2024-02-19T19:09:33.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:33 smithi046 ceph-mon[88928]: osdmap e104: 6 total, 6 up, 6 in 2024-02-19T19:09:33.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:33 smithi142 ceph-mon[69118]: pgmap v179: 65 pgs: 4 remapped+peering, 8 peering, 53 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 2.7 MiB/s wr, 252 op/s; 2.6 MiB/s, 932 keys/s, 196 objects/s recovering 2024-02-19T19:09:33.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:33 smithi142 ceph-mon[69118]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 976/11049 objects degraded (8.833%), 19 pgs degraded) 2024-02-19T19:09:33.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:33 smithi142 ceph-mon[69118]: Cluster is now healthy 2024-02-19T19:09:33.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:33 smithi142 ceph-mon[69118]: osdmap e104: 6 total, 6 up, 6 in 2024-02-19T19:09:35.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:35 smithi046 ceph-mon[88928]: pgmap v181: 65 pgs: 2 peering, 63 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 217 op/s; 2.3 MiB/s, 829 keys/s, 338 objects/s recovering 2024-02-19T19:09:35.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:35 smithi142 ceph-mon[69118]: pgmap v181: 65 pgs: 2 peering, 63 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.4 MiB/s wr, 217 op/s; 2.3 MiB/s, 829 keys/s, 338 objects/s recovering 2024-02-19T19:09:37.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:37 smithi046 ceph-mon[88928]: pgmap v182: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 2.2 MiB/s wr, 297 op/s; 1.7 MiB/s, 621 keys/s, 253 objects/s recovering 2024-02-19T19:09:37.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:37 smithi142 ceph-mon[69118]: pgmap v182: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 2.2 MiB/s wr, 297 op/s; 1.7 MiB/s, 621 keys/s, 253 objects/s recovering 2024-02-19T19:09:38.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.650+0000 7effb167e700 1 -- 172.21.15.46:0/896040767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effac0ff3b0 msgr2=0x7effac0ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:38.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.650+0000 7effb167e700 1 --2- 172.21.15.46:0/896040767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effac0ff3b0 0x7effac0ff780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00b0a0 tx=0x7eff9c00b3b0 comp rx=0 tx=0).stop 2024-02-19T19:09:38.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.650+0000 7effb167e700 1 -- 172.21.15.46:0/896040767 shutdown_connections 2024-02-19T19:09:38.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.650+0000 7effb167e700 1 --2- 172.21.15.46:0/896040767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effac0ffd50 0x7effac103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:38.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.650+0000 7effb167e700 1 --2- 172.21.15.46:0/896040767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effac0ff3b0 0x7effac0ff780 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:38.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.650+0000 7effb167e700 1 -- 172.21.15.46:0/896040767 >> 172.21.15.46:0/896040767 conn(0x7effac0fac90 msgr2=0x7effac0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:38.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.650+0000 7effb167e700 1 -- 172.21.15.46:0/896040767 shutdown_connections 2024-02-19T19:09:38.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.650+0000 7effb167e700 1 -- 172.21.15.46:0/896040767 wait complete. 2024-02-19T19:09:38.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.651+0000 7effb167e700 1 Processor -- start 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.651+0000 7effb167e700 1 -- start start 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.651+0000 7effb167e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effac0ff3b0 0x7effac196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.651+0000 7effb167e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effac0ffd50 0x7effac197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.651+0000 7effb167e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac1978a0 con 0x7effac0ff3b0 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.651+0000 7effb167e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac197a10 con 0x7effac0ffd50 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.651+0000 7effaaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effac0ff3b0 0x7effac196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.651+0000 7effaaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effac0ff3b0 0x7effac196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37170/0 (socket says 172.21.15.46:37170) 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.651+0000 7effaaffd700 1 -- 172.21.15.46:0/4161198505 learned_addr learned my addr 172.21.15.46:0/4161198505 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.651+0000 7effaa7fc700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effac0ffd50 0x7effac197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.652+0000 7effaaffd700 1 -- 172.21.15.46:0/4161198505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effac0ffd50 msgr2=0x7effac197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.652+0000 7effaaffd700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effac0ffd50 0x7effac197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.652+0000 7effaaffd700 1 -- 172.21.15.46:0/4161198505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c009d00 con 0x7effac0ff3b0 2024-02-19T19:09:38.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.652+0000 7effaaffd700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effac0ff3b0 0x7effac196d40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff9c000f80 tx=0x7eff9c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:38.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.652+0000 7effa3fff700 1 -- 172.21.15.46:0/4161198505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff9c00e040 con 0x7effac0ff3b0 2024-02-19T19:09:38.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.652+0000 7effa3fff700 1 -- 172.21.15.46:0/4161198505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff9c003c10 con 0x7effac0ff3b0 2024-02-19T19:09:38.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.652+0000 7effb167e700 1 -- 172.21.15.46:0/4161198505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac194b30 con 0x7effac0ff3b0 2024-02-19T19:09:38.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.652+0000 7effa3fff700 1 -- 172.21.15.46:0/4161198505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff9c01d6b0 con 0x7effac0ff3b0 2024-02-19T19:09:38.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.652+0000 7effb167e700 1 -- 172.21.15.46:0/4161198505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac195020 con 0x7effac0ff3b0 2024-02-19T19:09:38.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.653+0000 7effb167e700 1 -- 172.21.15.46:0/4161198505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac1076c0 con 0x7effac0ff3b0 2024-02-19T19:09:38.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.654+0000 7effa3fff700 1 -- 172.21.15.46:0/4161198505 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7eff9c004040 con 0x7effac0ff3b0 2024-02-19T19:09:38.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.654+0000 7effa3fff700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7eff9806d8f0 0x7eff9806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:38.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.654+0000 7effa3fff700 1 -- 172.21.15.46:0/4161198505 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6683+0+0 (secure 0 0 0) 0x7eff9c08edc0 con 0x7effac0ff3b0 2024-02-19T19:09:38.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.654+0000 7effaa7fc700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7eff9806d8f0 0x7eff9806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:38.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.655+0000 7effaa7fc700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7eff9806d8f0 0x7eff9806fda0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effac0696c0 tx=0x7eff9400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:38.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.660+0000 7effa3fff700 1 -- 172.21.15.46:0/4161198505 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7eff9c058470 con 0x7effac0ff3b0 2024-02-19T19:09:38.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.907+0000 7effb167e700 1 -- 172.21.15.46:0/4161198505 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7effac061190 con 0x7eff9806d8f0 2024-02-19T19:09:38.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.909+0000 7effa3fff700 1 -- 172.21.15.46:0/4161198505 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7effac061190 con 0x7eff9806d8f0 2024-02-19T19:09:38.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 -- 172.21.15.46:0/4161198505 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7eff9806d8f0 msgr2=0x7eff9806fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:38.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7eff9806d8f0 0x7eff9806fda0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effac0696c0 tx=0x7eff9400b410 comp rx=0 tx=0).stop 2024-02-19T19:09:38.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 -- 172.21.15.46:0/4161198505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effac0ff3b0 msgr2=0x7effac196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:38.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effac0ff3b0 0x7effac196d40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7eff9c000f80 tx=0x7eff9c00cd20 comp rx=0 tx=0).stop 2024-02-19T19:09:38.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 -- 172.21.15.46:0/4161198505 shutdown_connections 2024-02-19T19:09:38.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7eff9806d8f0 0x7eff9806fda0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:38.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effac0ff3b0 0x7effac196d40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:38.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 --2- 172.21.15.46:0/4161198505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effac0ffd50 0x7effac197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:38.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 -- 172.21.15.46:0/4161198505 >> 172.21.15.46:0/4161198505 conn(0x7effac0fac90 msgr2=0x7effac0fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:38.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 -- 172.21.15.46:0/4161198505 shutdown_connections 2024-02-19T19:09:38.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:38.912+0000 7effb167e700 1 -- 172.21.15.46:0/4161198505 wait complete. 2024-02-19T19:09:38.944 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:09:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.026+0000 7fd227364700 1 -- 172.21.15.46:0/2721349693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd220100e60 msgr2=0x7fd220104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.026+0000 7fd227364700 1 --2- 172.21.15.46:0/2721349693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd220100e60 0x7fd220104e30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009910 tx=0x7fd21c009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.026+0000 7fd227364700 1 -- 172.21.15.46:0/2721349693 shutdown_connections 2024-02-19T19:09:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.026+0000 7fd227364700 1 --2- 172.21.15.46:0/2721349693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd220100e60 0x7fd220104e30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.026+0000 7fd227364700 1 --2- 172.21.15.46:0/2721349693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2201004c0 0x7fd220100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.026+0000 7fd227364700 1 -- 172.21.15.46:0/2721349693 >> 172.21.15.46:0/2721349693 conn(0x7fd2200fbd80 msgr2=0x7fd2200fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.026+0000 7fd227364700 1 -- 172.21.15.46:0/2721349693 shutdown_connections 2024-02-19T19:09:39.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.026+0000 7fd227364700 1 -- 172.21.15.46:0/2721349693 wait complete. 2024-02-19T19:09:39.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.027+0000 7fd227364700 1 Processor -- start 2024-02-19T19:09:39.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.027+0000 7fd227364700 1 -- start start 2024-02-19T19:09:39.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.027+0000 7fd227364700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2201004c0 0x7fd220073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:39.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.027+0000 7fd227364700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd220100e60 0x7fd220073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:39.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.027+0000 7fd227364700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd220073ad0 con 0x7fd220100e60 2024-02-19T19:09:39.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.027+0000 7fd227364700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd220073c10 con 0x7fd2201004c0 2024-02-19T19:09:39.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.027+0000 7fd2248ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd220100e60 0x7fd220073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:39.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.027+0000 7fd2248ff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd220100e60 0x7fd220073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37190/0 (socket says 172.21.15.46:37190) 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.027+0000 7fd2248ff700 1 -- 172.21.15.46:0/401419236 learned_addr learned my addr 172.21.15.46:0/401419236 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.027+0000 7fd225100700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2201004c0 0x7fd220073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.028+0000 7fd2248ff700 1 -- 172.21.15.46:0/401419236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2201004c0 msgr2=0x7fd220073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.028+0000 7fd2248ff700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2201004c0 0x7fd220073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.028+0000 7fd2248ff700 1 -- 172.21.15.46:0/401419236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c0095f0 con 0x7fd220100e60 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.028+0000 7fd225100700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2201004c0 0x7fd220073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.028+0000 7fd2248ff700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd220100e60 0x7fd220073590 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00bda0 tx=0x7fd21c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.028+0000 7fd2127fc700 1 -- 172.21.15.46:0/401419236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd21c01d070 con 0x7fd220100e60 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.028+0000 7fd227364700 1 -- 172.21.15.46:0/401419236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd220073e90 con 0x7fd220100e60 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.028+0000 7fd2127fc700 1 -- 172.21.15.46:0/401419236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd21c004fb0 con 0x7fd220100e60 2024-02-19T19:09:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.028+0000 7fd227364700 1 -- 172.21.15.46:0/401419236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2201a23f0 con 0x7fd220100e60 2024-02-19T19:09:39.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.028+0000 7fd2127fc700 1 -- 172.21.15.46:0/401419236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd21c00f480 con 0x7fd220100e60 2024-02-19T19:09:39.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.029+0000 7fd227364700 1 -- 172.21.15.46:0/401419236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd204005320 con 0x7fd220100e60 2024-02-19T19:09:39.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.030+0000 7fd2127fc700 1 -- 172.21.15.46:0/401419236 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd21c004af0 con 0x7fd220100e60 2024-02-19T19:09:39.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.030+0000 7fd2127fc700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd20c06d8a0 0x7fd20c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:39.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.030+0000 7fd2127fc700 1 -- 172.21.15.46:0/401419236 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fd21c08e9b0 con 0x7fd220100e60 2024-02-19T19:09:39.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.031+0000 7fd225100700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd20c06d8a0 0x7fd20c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:39.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.031+0000 7fd225100700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd20c06d8a0 0x7fd20c06fd50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd214005950 tx=0x7fd214005f50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:39.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.035+0000 7fd2127fc700 1 -- 172.21.15.46:0/401419236 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd21c0582b0 con 0x7fd220100e60 2024-02-19T19:09:39.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.356+0000 7fd227364700 1 -- 172.21.15.46:0/401419236 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd204000bf0 con 0x7fd20c06d8a0 2024-02-19T19:09:39.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.358+0000 7fd2127fc700 1 -- 172.21.15.46:0/401419236 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd204000bf0 con 0x7fd20c06d8a0 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 -- 172.21.15.46:0/401419236 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd20c06d8a0 msgr2=0x7fd20c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd20c06d8a0 0x7fd20c06fd50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd214005950 tx=0x7fd214005f50 comp rx=0 tx=0).stop 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 -- 172.21.15.46:0/401419236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd220100e60 msgr2=0x7fd220073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd220100e60 0x7fd220073590 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00bda0 tx=0x7fd21c00be80 comp rx=0 tx=0).stop 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 -- 172.21.15.46:0/401419236 shutdown_connections 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd20c06d8a0 0x7fd20c06fd50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2201004c0 0x7fd220073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 --2- 172.21.15.46:0/401419236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd220100e60 0x7fd220073590 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 -- 172.21.15.46:0/401419236 >> 172.21.15.46:0/401419236 conn(0x7fd2200fbd80 msgr2=0x7fd2200fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 -- 172.21.15.46:0/401419236 shutdown_connections 2024-02-19T19:09:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.360+0000 7fd227364700 1 -- 172.21.15.46:0/401419236 wait complete. 2024-02-19T19:09:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.492+0000 7f1585499700 1 -- 172.21.15.46:0/577097153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15800ffd60 msgr2=0x7f1580103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:39.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.492+0000 7f1585499700 1 --2- 172.21.15.46:0/577097153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15800ffd60 0x7f1580103d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1574009910 tx=0x7f1574009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:39.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.492+0000 7f1585499700 1 -- 172.21.15.46:0/577097153 shutdown_connections 2024-02-19T19:09:39.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.492+0000 7f1585499700 1 --2- 172.21.15.46:0/577097153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15800ffd60 0x7f1580103d30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.492+0000 7f1585499700 1 --2- 172.21.15.46:0/577097153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15800ff3c0 0x7f15800ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.492+0000 7f1585499700 1 -- 172.21.15.46:0/577097153 >> 172.21.15.46:0/577097153 conn(0x7f15800fac60 msgr2=0x7f15800fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:39.514 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:39 smithi046 ceph-mon[88928]: pgmap v183: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 1.3 MiB/s wr, 221 op/s; 863 KiB/s, 163 objects/s recovering 2024-02-19T19:09:39.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.492+0000 7f1585499700 1 -- 172.21.15.46:0/577097153 shutdown_connections 2024-02-19T19:09:39.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.492+0000 7f1585499700 1 -- 172.21.15.46:0/577097153 wait complete. 2024-02-19T19:09:39.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.493+0000 7f1585499700 1 Processor -- start 2024-02-19T19:09:39.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.493+0000 7f1585499700 1 -- start start 2024-02-19T19:09:39.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.493+0000 7f1585499700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15800ff3c0 0x7f1580198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:39.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.493+0000 7f1585499700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15800ffd60 0x7f1580198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:39.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.493+0000 7f1585499700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1580198d40 con 0x7f15800ff3c0 2024-02-19T19:09:39.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.493+0000 7f1585499700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158019cad0 con 0x7f15800ffd60 2024-02-19T19:09:39.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.493+0000 7f157effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15800ff3c0 0x7f1580198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:39.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.493+0000 7f157effd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15800ff3c0 0x7f1580198120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37208/0 (socket says 172.21.15.46:37208) 2024-02-19T19:09:39.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.493+0000 7f157effd700 1 -- 172.21.15.46:0/875168740 learned_addr learned my addr 172.21.15.46:0/875168740 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:39.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.493+0000 7f157e7fc700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15800ffd60 0x7f1580198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:39.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.494+0000 7f157effd700 1 -- 172.21.15.46:0/875168740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15800ffd60 msgr2=0x7f1580198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:39.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.494+0000 7f157effd700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15800ffd60 0x7f1580198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.494+0000 7f157effd700 1 -- 172.21.15.46:0/875168740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15740095f0 con 0x7f15800ff3c0 2024-02-19T19:09:39.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.494+0000 7f157effd700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15800ff3c0 0x7f1580198120 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f157000e920 tx=0x7f157000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:39.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.494+0000 7f1567fff700 1 -- 172.21.15.46:0/875168740 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157000c9d0 con 0x7f15800ff3c0 2024-02-19T19:09:39.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.494+0000 7f1567fff700 1 -- 172.21.15.46:0/875168740 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1570010430 con 0x7f15800ff3c0 2024-02-19T19:09:39.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.494+0000 7f1585499700 1 -- 172.21.15.46:0/875168740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158019cdb0 con 0x7f15800ff3c0 2024-02-19T19:09:39.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.494+0000 7f1567fff700 1 -- 172.21.15.46:0/875168740 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1570018630 con 0x7f15800ff3c0 2024-02-19T19:09:39.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.494+0000 7f1585499700 1 -- 172.21.15.46:0/875168740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158019d2d0 con 0x7f15800ff3c0 2024-02-19T19:09:39.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.496+0000 7f1585499700 1 -- 172.21.15.46:0/875168740 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1580107730 con 0x7f15800ff3c0 2024-02-19T19:09:39.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.496+0000 7f1567fff700 1 -- 172.21.15.46:0/875168740 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f15700105a0 con 0x7f15800ff3c0 2024-02-19T19:09:39.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.496+0000 7f1567fff700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f156806d8a0 0x7f156806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:39.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.496+0000 7f1567fff700 1 -- 172.21.15.46:0/875168740 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f1570014070 con 0x7f15800ff3c0 2024-02-19T19:09:39.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.496+0000 7f157e7fc700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f156806d8a0 0x7f156806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:39.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.497+0000 7f157e7fc700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f156806d8a0 0x7f156806fd50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f15740059d0 tx=0x7f1574005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:39.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.502+0000 7f1567fff700 1 -- 172.21.15.46:0/875168740 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1570052d20 con 0x7f15800ff3c0 2024-02-19T19:09:39.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:39 smithi142 ceph-mon[69118]: pgmap v183: 65 pgs: 65 active+clean; 310 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 1.3 MiB/s wr, 221 op/s; 863 KiB/s, 163 objects/s recovering 2024-02-19T19:09:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.751+0000 7f1585499700 1 -- 172.21.15.46:0/875168740 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f158019d4f0 con 0x7f156806d8a0 2024-02-19T19:09:39.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.762+0000 7f1567fff700 1 -- 172.21.15.46:0/875168740 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f158019d4f0 con 0x7f156806d8a0 2024-02-19T19:09:39.784 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:09:39.784 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 54s ago 16m 25.7M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:09:39.784 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (16m) 54s ago 16m 8572k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:09:39.784 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (14m) 16s ago 14m 8182k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:09:39.784 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (3m) 54s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:09:39.784 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (3m) 16s ago 14m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:09:39.784 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 54s ago 15m 88.1M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (10m) 54s ago 10m 140M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (10m) 54s ago 10m 17.0M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (10m) 16s ago 10m 17.8M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (10m) 16s ago 10m 123M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (7m) 54s ago 17m 507M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (6m) 16s ago 14m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (4m) 54s ago 17m 49.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (3m) 16s ago 14m 40.1M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (6m) 54s ago 16m 16.6M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (6m) 16s ago 14m 16.9M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (2m) 54s ago 13m 231M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (2m) 54s ago 13m 250M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 974e56511c36 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (74s) 54s ago 12m 15.1M 1217M 19.0.0-1450-gf78a58c0 f081f847070a a31225ea4dec 2024-02-19T19:09:39.785 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (20s) 16s ago 12m 12.8M 2240M 19.0.0-1450-gf78a58c0 f081f847070a b46795b87c3e 2024-02-19T19:09:39.786 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (12m) 16s ago 12m 238M 2240M 18.2.0 dc2bc1663786 4b1ded49236e 2024-02-19T19:09:39.786 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (11m) 16s ago 11m 240M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:09:39.786 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (6m) 54s ago 15m 68.2M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:09:39.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 -- 172.21.15.46:0/875168740 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f156806d8a0 msgr2=0x7f156806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f156806d8a0 0x7f156806fd50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f15740059d0 tx=0x7f1574005940 comp rx=0 tx=0).stop 2024-02-19T19:09:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 -- 172.21.15.46:0/875168740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15800ff3c0 msgr2=0x7f1580198120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15800ff3c0 0x7f1580198120 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f157000e920 tx=0x7f157000ec30 comp rx=0 tx=0).stop 2024-02-19T19:09:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 -- 172.21.15.46:0/875168740 shutdown_connections 2024-02-19T19:09:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f156806d8a0 0x7f156806fd50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15800ff3c0 0x7f1580198120 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 --2- 172.21.15.46:0/875168740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15800ffd60 0x7f1580198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 -- 172.21.15.46:0/875168740 >> 172.21.15.46:0/875168740 conn(0x7f15800fac60 msgr2=0x7f15800fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 -- 172.21.15.46:0/875168740 shutdown_connections 2024-02-19T19:09:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.765+0000 7f1585499700 1 -- 172.21.15.46:0/875168740 wait complete. 2024-02-19T19:09:39.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.879+0000 7f044ca8d700 1 -- 172.21.15.46:0/1021604953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04480ffd60 msgr2=0x7f0448103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:39.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.879+0000 7f044ca8d700 1 --2- 172.21.15.46:0/1021604953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04480ffd60 0x7f0448103d30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f043c009910 tx=0x7f043c009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:39.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.880+0000 7f044ca8d700 1 -- 172.21.15.46:0/1021604953 shutdown_connections 2024-02-19T19:09:39.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.880+0000 7f044ca8d700 1 --2- 172.21.15.46:0/1021604953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04480ffd60 0x7f0448103d30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.880+0000 7f044ca8d700 1 --2- 172.21.15.46:0/1021604953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04480ff3c0 0x7f04480ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.880+0000 7f044ca8d700 1 -- 172.21.15.46:0/1021604953 >> 172.21.15.46:0/1021604953 conn(0x7f04480fac60 msgr2=0x7f04480fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:39.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.880+0000 7f044ca8d700 1 -- 172.21.15.46:0/1021604953 shutdown_connections 2024-02-19T19:09:39.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.880+0000 7f044ca8d700 1 -- 172.21.15.46:0/1021604953 wait complete. 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f044ca8d700 1 Processor -- start 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f044ca8d700 1 -- start start 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f044ca8d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04480ff3c0 0x7f0448100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f044ca8d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04480ffd60 0x7f0448101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f044ca8d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448101850 con 0x7f04480ff3c0 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f044ca8d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448101990 con 0x7f04480ffd60 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f044659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04480ff3c0 0x7f0448100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f044659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04480ff3c0 0x7f0448100dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37226/0 (socket says 172.21.15.46:37226) 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f044659c700 1 -- 172.21.15.46:0/860691718 learned_addr learned my addr 172.21.15.46:0/860691718 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f0445d9b700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04480ffd60 0x7f0448101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.881+0000 7f044659c700 1 -- 172.21.15.46:0/860691718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04480ffd60 msgr2=0x7f0448101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:39.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.882+0000 7f044659c700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04480ffd60 0x7f0448101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:39.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.882+0000 7f044659c700 1 -- 172.21.15.46:0/860691718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0095f0 con 0x7f04480ff3c0 2024-02-19T19:09:39.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.882+0000 7f0445d9b700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04480ffd60 0x7f0448101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:09:39.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.882+0000 7f044659c700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04480ff3c0 0x7f0448100dd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f043800e920 tx=0x7f043800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:39.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.882+0000 7f04377fe700 1 -- 172.21.15.46:0/860691718 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0438009790 con 0x7f04480ff3c0 2024-02-19T19:09:39.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.882+0000 7f04377fe700 1 -- 172.21.15.46:0/860691718 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f043800cba0 con 0x7f04480ff3c0 2024-02-19T19:09:39.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.882+0000 7f044ca8d700 1 -- 172.21.15.46:0/860691718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04481a2060 con 0x7f04480ff3c0 2024-02-19T19:09:39.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.882+0000 7f04377fe700 1 -- 172.21.15.46:0/860691718 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0438018650 con 0x7f04480ff3c0 2024-02-19T19:09:39.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.882+0000 7f044ca8d700 1 -- 172.21.15.46:0/860691718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04481a2470 con 0x7f04480ff3c0 2024-02-19T19:09:39.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.883+0000 7f044ca8d700 1 -- 172.21.15.46:0/860691718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0448108740 con 0x7f04480ff3c0 2024-02-19T19:09:39.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.884+0000 7f04377fe700 1 -- 172.21.15.46:0/860691718 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f043800cd10 con 0x7f04480ff3c0 2024-02-19T19:09:39.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.884+0000 7f04377fe700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f043006d8a0 0x7f043006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:39.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.884+0000 7f0445d9b700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f043006d8a0 0x7f043006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:39.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.884+0000 7f04377fe700 1 -- 172.21.15.46:0/860691718 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f0438014070 con 0x7f04480ff3c0 2024-02-19T19:09:39.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.885+0000 7f0445d9b700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f043006d8a0 0x7f043006fd50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f043c0059d0 tx=0x7f043c005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:39.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:39.889+0000 7f04377fe700 1 -- 172.21.15.46:0/860691718 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0438052d20 con 0x7f04480ff3c0 2024-02-19T19:09:40.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.280+0000 7f044ca8d700 1 -- 172.21.15.46:0/860691718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0448108120 con 0x7f04480ff3c0 2024-02-19T19:09:40.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.280+0000 7f04377fe700 1 -- 172.21.15.46:0/860691718 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f043805abe0 con 0x7f04480ff3c0 2024-02-19T19:09:40.302 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:09:40.302 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:09:40.302 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:09:40.302 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:09:40.302 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:09:40.302 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 8 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:09:40.303 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:09:40.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.282+0000 7f044ca8d700 1 -- 172.21.15.46:0/860691718 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f043006d8a0 msgr2=0x7f043006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:40.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.282+0000 7f044ca8d700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f043006d8a0 0x7f043006fd50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f043c0059d0 tx=0x7f043c005940 comp rx=0 tx=0).stop 2024-02-19T19:09:40.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.282+0000 7f044ca8d700 1 -- 172.21.15.46:0/860691718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04480ff3c0 msgr2=0x7f0448100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:40.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.282+0000 7f044ca8d700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04480ff3c0 0x7f0448100dd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f043800e920 tx=0x7f043800ece0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.282+0000 7f044ca8d700 1 -- 172.21.15.46:0/860691718 shutdown_connections 2024-02-19T19:09:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.282+0000 7f044ca8d700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f043006d8a0 0x7f043006fd50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.282+0000 7f044ca8d700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04480ff3c0 0x7f0448100dd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.282+0000 7f044ca8d700 1 --2- 172.21.15.46:0/860691718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04480ffd60 0x7f0448101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.282+0000 7f044ca8d700 1 -- 172.21.15.46:0/860691718 >> 172.21.15.46:0/860691718 conn(0x7f04480fac60 msgr2=0x7f0448069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.283+0000 7f044ca8d700 1 -- 172.21.15.46:0/860691718 shutdown_connections 2024-02-19T19:09:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.283+0000 7f044ca8d700 1 -- 172.21.15.46:0/860691718 wait complete. 2024-02-19T19:09:40.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.399+0000 7fe973f15700 1 -- 172.21.15.46:0/3735423265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe96c104130 msgr2=0x7fe96c104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:40.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.399+0000 7fe973f15700 1 --2- 172.21.15.46:0/3735423265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe96c104130 0x7fe96c104500 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe968009910 tx=0x7fe968009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:40.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.399+0000 7fe973f15700 1 -- 172.21.15.46:0/3735423265 shutdown_connections 2024-02-19T19:09:40.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.399+0000 7fe973f15700 1 --2- 172.21.15.46:0/3735423265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0ffbd0 0x7fe96c100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.399+0000 7fe973f15700 1 --2- 172.21.15.46:0/3735423265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe96c104130 0x7fe96c104500 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.399+0000 7fe973f15700 1 -- 172.21.15.46:0/3735423265 >> 172.21.15.46:0/3735423265 conn(0x7fe96c075130 msgr2=0x7fe96c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:40.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.399+0000 7fe973f15700 1 -- 172.21.15.46:0/3735423265 shutdown_connections 2024-02-19T19:09:40.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.399+0000 7fe973f15700 1 -- 172.21.15.46:0/3735423265 wait complete. 2024-02-19T19:09:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.400+0000 7fe973f15700 1 Processor -- start 2024-02-19T19:09:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.400+0000 7fe973f15700 1 -- start start 2024-02-19T19:09:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.400+0000 7fe973f15700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0ffbd0 0x7fe96c198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.400+0000 7fe973f15700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe96c104130 0x7fe96c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.400+0000 7fe973f15700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c198c60 con 0x7fe96c104130 2024-02-19T19:09:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.400+0000 7fe973f15700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c19c9f0 con 0x7fe96c0ffbd0 2024-02-19T19:09:40.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.400+0000 7fe9714b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe96c104130 0x7fe96c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.400+0000 7fe9714b0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe96c104130 0x7fe96c198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37238/0 (socket says 172.21.15.46:37238) 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.400+0000 7fe9714b0700 1 -- 172.21.15.46:0/753913123 learned_addr learned my addr 172.21.15.46:0/753913123 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.400+0000 7fe971cb1700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0ffbd0 0x7fe96c198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.401+0000 7fe9714b0700 1 -- 172.21.15.46:0/753913123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0ffbd0 msgr2=0x7fe96c198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.401+0000 7fe9714b0700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0ffbd0 0x7fe96c198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.401+0000 7fe9714b0700 1 -- 172.21.15.46:0/753913123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9680095f0 con 0x7fe96c104130 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.401+0000 7fe9714b0700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe96c104130 0x7fe96c198580 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00e920 tx=0x7fe95c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.401+0000 7fe962ffd700 1 -- 172.21.15.46:0/753913123 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe95c00c9d0 con 0x7fe96c104130 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.401+0000 7fe962ffd700 1 -- 172.21.15.46:0/753913123 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe95c010430 con 0x7fe96c104130 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.401+0000 7fe973f15700 1 -- 172.21.15.46:0/753913123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c19ccd0 con 0x7fe96c104130 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.401+0000 7fe962ffd700 1 -- 172.21.15.46:0/753913123 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe95c018630 con 0x7fe96c104130 2024-02-19T19:09:40.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.401+0000 7fe973f15700 1 -- 172.21.15.46:0/753913123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c19d220 con 0x7fe96c104130 2024-02-19T19:09:40.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.402+0000 7fe973f15700 1 -- 172.21.15.46:0/753913123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c04f2a0 con 0x7fe96c104130 2024-02-19T19:09:40.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.403+0000 7fe962ffd700 1 -- 172.21.15.46:0/753913123 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe95c0105a0 con 0x7fe96c104130 2024-02-19T19:09:40.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.403+0000 7fe962ffd700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe95806d8a0 0x7fe95806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:40.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.403+0000 7fe962ffd700 1 -- 172.21.15.46:0/753913123 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fe95c014070 con 0x7fe96c104130 2024-02-19T19:09:40.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.403+0000 7fe971cb1700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe95806d8a0 0x7fe95806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:40.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.404+0000 7fe971cb1700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe95806d8a0 0x7fe95806fd50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe968000c00 tx=0x7fe968009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:40.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.408+0000 7fe962ffd700 1 -- 172.21.15.46:0/753913123 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe95c052d20 con 0x7fe96c104130 2024-02-19T19:09:40.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:40 smithi046 ceph-mon[88928]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:40.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:40 smithi046 ceph-mon[88928]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:40.665 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:40 smithi142 ceph-mon[69118]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:40.665 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:40 smithi142 ceph-mon[69118]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:40.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.758+0000 7fe973f15700 1 -- 172.21.15.46:0/753913123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe96c19ce60 con 0x7fe96c104130 2024-02-19T19:09:40.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.758+0000 7fe962ffd700 1 -- 172.21.15.46:0/753913123 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1890 (secure 0 0 0) 0x7fe96c19ce60 con 0x7fe96c104130 2024-02-19T19:09:40.780 INFO:teuthology.orchestra.run.smithi046.stdout:e19 2024-02-19T19:09:40.780 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:09:40.780 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:09:40.780 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:09:40.780 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:09:40.780 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:09:40.780 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:09:40.780 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 19 2024-02-19T19:09:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:09:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:09:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T19:08:21.613462+0000 2024-02-19T19:09:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:09:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:09:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:09:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:09:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:09:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:09:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:09:40.783 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:09:40.783 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:09:40.784 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:09:40.785 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:40.785 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:40.785 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:09:40.785 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:09:40.785 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:09:40.785 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:09:40.785 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:40.785 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:40.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.760+0000 7fe973f15700 1 -- 172.21.15.46:0/753913123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe95806d8a0 msgr2=0x7fe95806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:40.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.760+0000 7fe973f15700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe95806d8a0 0x7fe95806fd50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe968000c00 tx=0x7fe968009f70 comp rx=0 tx=0).stop 2024-02-19T19:09:40.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.760+0000 7fe973f15700 1 -- 172.21.15.46:0/753913123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe96c104130 msgr2=0x7fe96c198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:40.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.760+0000 7fe973f15700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe96c104130 0x7fe96c198580 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00e920 tx=0x7fe95c00ec30 comp rx=0 tx=0).stop 2024-02-19T19:09:40.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.761+0000 7fe973f15700 1 -- 172.21.15.46:0/753913123 shutdown_connections 2024-02-19T19:09:40.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.761+0000 7fe973f15700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe95806d8a0 0x7fe95806fd50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.761+0000 7fe973f15700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0ffbd0 0x7fe96c198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.761+0000 7fe973f15700 1 --2- 172.21.15.46:0/753913123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe96c104130 0x7fe96c198580 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.761+0000 7fe973f15700 1 -- 172.21.15.46:0/753913123 >> 172.21.15.46:0/753913123 conn(0x7fe96c075130 msgr2=0x7fe96c1095e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:40.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.761+0000 7fe973f15700 1 -- 172.21.15.46:0/753913123 shutdown_connections 2024-02-19T19:09:40.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.761+0000 7fe973f15700 1 -- 172.21.15.46:0/753913123 wait complete. 2024-02-19T19:09:40.787 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-02-19T19:09:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.889+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4203187684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e40ffbd0 msgr2=0x7f15e4100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.889+0000 7f15ebbb0700 1 --2- 172.21.15.46:0/4203187684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e40ffbd0 0x7f15e4100040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009910 tx=0x7f15d4009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.889+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4203187684 shutdown_connections 2024-02-19T19:09:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.889+0000 7f15ebbb0700 1 --2- 172.21.15.46:0/4203187684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e40ffbd0 0x7f15e4100040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.889+0000 7f15ebbb0700 1 --2- 172.21.15.46:0/4203187684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15e4104130 0x7f15e4104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.889+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4203187684 >> 172.21.15.46:0/4203187684 conn(0x7f15e4075130 msgr2=0x7f15e4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.889+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4203187684 shutdown_connections 2024-02-19T19:09:40.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.889+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4203187684 wait complete. 2024-02-19T19:09:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15ebbb0700 1 Processor -- start 2024-02-19T19:09:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15ebbb0700 1 -- start start 2024-02-19T19:09:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15ebbb0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15e40ffbd0 0x7f15e4196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15ebbb0700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e4104130 0x7f15e41971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15ebbb0700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4197800 con 0x7f15e4104130 2024-02-19T19:09:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15ebbb0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4197940 con 0x7f15e40ffbd0 2024-02-19T19:09:40.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15e914b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e4104130 0x7f15e41971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15e914b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e4104130 0x7f15e41971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37258/0 (socket says 172.21.15.46:37258) 2024-02-19T19:09:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15e994c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15e40ffbd0 0x7f15e4196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15e914b700 1 -- 172.21.15.46:0/4135577318 learned_addr learned my addr 172.21.15.46:0/4135577318 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15e914b700 1 -- 172.21.15.46:0/4135577318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15e40ffbd0 msgr2=0x7f15e4196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15e914b700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15e40ffbd0 0x7f15e4196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15e914b700 1 -- 172.21.15.46:0/4135577318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d40095f0 con 0x7f15e4104130 2024-02-19T19:09:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.890+0000 7f15e994c700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15e40ffbd0 0x7f15e4196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:09:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.891+0000 7f15e914b700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e4104130 0x7f15e41971e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f15d400b7d0 tx=0x7f15d400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.891+0000 7f15daffd700 1 -- 172.21.15.46:0/4135577318 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15d401d070 con 0x7f15e4104130 2024-02-19T19:09:40.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.891+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4135577318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e419fd10 con 0x7f15e4104130 2024-02-19T19:09:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.891+0000 7f15daffd700 1 -- 172.21.15.46:0/4135577318 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15d40052a0 con 0x7f15e4104130 2024-02-19T19:09:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.891+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4135577318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e41a0120 con 0x7f15e4104130 2024-02-19T19:09:40.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.891+0000 7f15daffd700 1 -- 172.21.15.46:0/4135577318 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15d4022470 con 0x7f15e4104130 2024-02-19T19:09:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.892+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4135577318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e404f2a0 con 0x7f15e4104130 2024-02-19T19:09:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.893+0000 7f15daffd700 1 -- 172.21.15.46:0/4135577318 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f15d400f850 con 0x7f15e4104130 2024-02-19T19:09:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.893+0000 7f15daffd700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f15d006d8a0 0x7f15d006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.893+0000 7f15daffd700 1 -- 172.21.15.46:0/4135577318 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f15d408ea60 con 0x7f15e4104130 2024-02-19T19:09:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.893+0000 7f15e994c700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f15d006d8a0 0x7f15d006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:40.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.894+0000 7f15e994c700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f15d006d8a0 0x7f15d006fd50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15e0011490 tx=0x7f15e0009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:40.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:40.898+0000 7f15daffd700 1 -- 172.21.15.46:0/4135577318 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f15d40581b0 con 0x7f15e4104130 2024-02-19T19:09:41.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.200+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4135577318 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15e40ff240 con 0x7f15d006d8a0 2024-02-19T19:09:41.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.203+0000 7f15daffd700 1 -- 172.21.15.46:0/4135577318 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f15e40ff240 con 0x7f15d006d8a0 2024-02-19T19:09:41.224 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:09:41.224 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:09:41.224 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:09:41.224 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:09:41.224 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:09:41.224 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:09:41.225 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-02-19T19:09:41.225 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:09:41.225 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:09:41.225 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "10/23 daemons upgraded", 2024-02-19T19:09:41.225 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:09:41.225 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:09:41.225 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:09:41.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.205+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4135577318 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f15d006d8a0 msgr2=0x7f15d006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:41.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.205+0000 7f15ebbb0700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f15d006d8a0 0x7f15d006fd50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15e0011490 tx=0x7f15e0009260 comp rx=0 tx=0).stop 2024-02-19T19:09:41.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.205+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4135577318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e4104130 msgr2=0x7f15e41971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:41.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.205+0000 7f15ebbb0700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e4104130 0x7f15e41971e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f15d400b7d0 tx=0x7f15d400bf90 comp rx=0 tx=0).stop 2024-02-19T19:09:41.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.205+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4135577318 shutdown_connections 2024-02-19T19:09:41.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.205+0000 7f15ebbb0700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f15d006d8a0 0x7f15d006fd50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:41.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.205+0000 7f15ebbb0700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15e40ffbd0 0x7f15e4196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:41.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.205+0000 7f15ebbb0700 1 --2- 172.21.15.46:0/4135577318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e4104130 0x7f15e41971e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:41.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.205+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4135577318 >> 172.21.15.46:0/4135577318 conn(0x7f15e4075130 msgr2=0x7f15e40feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:41.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.206+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4135577318 shutdown_connections 2024-02-19T19:09:41.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.206+0000 7f15ebbb0700 1 -- 172.21.15.46:0/4135577318 wait complete. 2024-02-19T19:09:41.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.322+0000 7fd20ca72700 1 -- 172.21.15.46:0/528889602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd208069140 msgr2=0x7fd208104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:41.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.322+0000 7fd20ca72700 1 --2- 172.21.15.46:0/528889602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd208069140 0x7fd208104eb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009910 tx=0x7fd1fc009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:41.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.322+0000 7fd20ca72700 1 -- 172.21.15.46:0/528889602 shutdown_connections 2024-02-19T19:09:41.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.322+0000 7fd20ca72700 1 --2- 172.21.15.46:0/528889602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd208069140 0x7fd208104eb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:41.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.322+0000 7fd20ca72700 1 --2- 172.21.15.46:0/528889602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2080687a0 0x7fd208068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:41.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.322+0000 7fd20ca72700 1 -- 172.21.15.46:0/528889602 >> 172.21.15.46:0/528889602 conn(0x7fd208075130 msgr2=0x7fd208075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:41.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.322+0000 7fd20ca72700 1 -- 172.21.15.46:0/528889602 shutdown_connections 2024-02-19T19:09:41.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.322+0000 7fd20ca72700 1 -- 172.21.15.46:0/528889602 wait complete. 2024-02-19T19:09:41.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd20ca72700 1 Processor -- start 2024-02-19T19:09:41.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd20ca72700 1 -- start start 2024-02-19T19:09:41.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd20ca72700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2080687a0 0x7fd208195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:41.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd20ca72700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd208069140 0x7fd2081963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:41.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd20ca72700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208196a80 con 0x7fd2080687a0 2024-02-19T19:09:41.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd20ca72700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20819a810 con 0x7fd208069140 2024-02-19T19:09:41.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd20659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2080687a0 0x7fd208195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:41.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd20659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2080687a0 0x7fd208195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37274/0 (socket says 172.21.15.46:37274) 2024-02-19T19:09:41.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd20659c700 1 -- 172.21.15.46:0/3417035096 learned_addr learned my addr 172.21.15.46:0/3417035096 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd205d9b700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd208069140 0x7fd2081963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd205d9b700 1 -- 172.21.15.46:0/3417035096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2080687a0 msgr2=0x7fd208195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd205d9b700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2080687a0 0x7fd208195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd205d9b700 1 -- 172.21.15.46:0/3417035096 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0095f0 con 0x7fd208069140 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.323+0000 7fd20659c700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2080687a0 0x7fd208195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.324+0000 7fd205d9b700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd208069140 0x7fd2081963a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd208069620 tx=0x7fd1fc00bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.324+0000 7fd1f77fe700 1 -- 172.21.15.46:0/3417035096 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1fc01d070 con 0x7fd208069140 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.324+0000 7fd1f77fe700 1 -- 172.21.15.46:0/3417035096 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1fc005dc0 con 0x7fd208069140 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.324+0000 7fd20ca72700 1 -- 172.21.15.46:0/3417035096 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20819aa90 con 0x7fd208069140 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.324+0000 7fd1f77fe700 1 -- 172.21.15.46:0/3417035096 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1fc017400 con 0x7fd208069140 2024-02-19T19:09:41.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.324+0000 7fd20ca72700 1 -- 172.21.15.46:0/3417035096 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20819af80 con 0x7fd208069140 2024-02-19T19:09:41.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.325+0000 7fd20ca72700 1 -- 172.21.15.46:0/3417035096 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208108750 con 0x7fd208069140 2024-02-19T19:09:41.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.326+0000 7fd1f77fe700 1 -- 172.21.15.46:0/3417035096 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd1fc003a60 con 0x7fd208069140 2024-02-19T19:09:41.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.326+0000 7fd1f77fe700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd1f006d8a0 0x7fd1f006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:41.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.326+0000 7fd20659c700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd1f006d8a0 0x7fd1f006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:41.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.326+0000 7fd1f77fe700 1 -- 172.21.15.46:0/3417035096 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fd1fc08e970 con 0x7fd208069140 2024-02-19T19:09:41.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.327+0000 7fd20659c700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd1f006d8a0 0x7fd1f006fd50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8005950 tx=0x7fd1f800b500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:41.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.331+0000 7fd1f77fe700 1 -- 172.21.15.46:0/3417035096 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd1fc058020 con 0x7fd208069140 2024-02-19T19:09:41.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:41 smithi046 ceph-mon[88928]: pgmap v184: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 292 op/s; 276 KiB/s, 97 objects/s recovering 2024-02-19T19:09:41.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:41 smithi046 ceph-mon[88928]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:41.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:41 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/860691718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:41.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:41 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/753913123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:09:41.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:41 smithi142 ceph-mon[69118]: pgmap v184: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 292 op/s; 276 KiB/s, 97 objects/s recovering 2024-02-19T19:09:41.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:41 smithi142 ceph-mon[69118]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:41.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:41 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/860691718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:41.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:41 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/753913123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:09:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.744+0000 7fd20ca72700 1 -- 172.21.15.46:0/3417035096 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd20802cc30 con 0x7fd208069140 2024-02-19T19:09:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.744+0000 7fd1f77fe700 1 -- 172.21.15.46:0/3417035096 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd1fc05b6e0 con 0x7fd208069140 2024-02-19T19:09:41.766 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_OK 2024-02-19T19:09:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 -- 172.21.15.46:0/3417035096 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd1f006d8a0 msgr2=0x7fd1f006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd1f006d8a0 0x7fd1f006fd50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8005950 tx=0x7fd1f800b500 comp rx=0 tx=0).stop 2024-02-19T19:09:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 -- 172.21.15.46:0/3417035096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd208069140 msgr2=0x7fd2081963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd208069140 0x7fd2081963a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd208069620 tx=0x7fd1fc00bd70 comp rx=0 tx=0).stop 2024-02-19T19:09:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 -- 172.21.15.46:0/3417035096 shutdown_connections 2024-02-19T19:09:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd1f006d8a0 0x7fd1f006fd50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2080687a0 0x7fd208195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 --2- 172.21.15.46:0/3417035096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd208069140 0x7fd2081963a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 -- 172.21.15.46:0/3417035096 >> 172.21.15.46:0/3417035096 conn(0x7fd208075130 msgr2=0x7fd208104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 -- 172.21.15.46:0/3417035096 shutdown_connections 2024-02-19T19:09:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:09:41.746+0000 7fd20ca72700 1 -- 172.21.15.46:0/3417035096 wait complete. 2024-02-19T19:09:42.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:42 smithi046 ceph-mon[88928]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:42.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:42 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3417035096' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:09:42.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:42 smithi142 ceph-mon[69118]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:42.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:42 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3417035096' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:09:42.951 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-19T19:09:42.952 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-19T19:09:43.344 DEBUG:teuthology.parallel:result is None 2024-02-19T19:09:43.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-19T19:09:43.393 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-19T19:09:43.394 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-19T19:09:43.431 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-19T19:09:43.431 DEBUG:teuthology.parallel:result is None 2024-02-19T19:09:43.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:43 smithi046 ceph-mon[88928]: pgmap v185: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 308 op/s; 234 KiB/s, 82 objects/s recovering 2024-02-19T19:09:43.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:43.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:43.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:43.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:09:43.644 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:43 smithi142 ceph-mon[69118]: pgmap v185: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 308 op/s; 234 KiB/s, 82 objects/s recovering 2024-02-19T19:09:43.644 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:43.644 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:43.644 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:43.644 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:09:44.550 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:44 smithi142 ceph-mon[69118]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:09:44.550 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:44 smithi142 ceph-mon[69118]: Upgrade: osd.4 is safe to restart 2024-02-19T19:09:44.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:44 smithi046 ceph-mon[88928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:09:44.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:44 smithi046 ceph-mon[88928]: Upgrade: osd.4 is safe to restart 2024-02-19T19:09:45.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:45 smithi046 ceph-mon[88928]: pgmap v186: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.7 MiB/s wr, 355 op/s; 204 KiB/s, 71 objects/s recovering 2024-02-19T19:09:45.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:45 smithi046 ceph-mon[88928]: Upgrade: Updating osd.4 2024-02-19T19:09:45.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:45.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T19:09:45.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:45.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:45 smithi046 ceph-mon[88928]: Deploying daemon osd.4 on smithi142 2024-02-19T19:09:45.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:45 smithi142 ceph-mon[69118]: pgmap v186: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.7 MiB/s wr, 355 op/s; 204 KiB/s, 71 objects/s recovering 2024-02-19T19:09:45.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:45 smithi142 ceph-mon[69118]: Upgrade: Updating osd.4 2024-02-19T19:09:45.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:45.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T19:09:45.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:45.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:45 smithi142 ceph-mon[69118]: Deploying daemon osd.4 on smithi142 2024-02-19T19:09:47.861 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:47 smithi142 ceph-mon[69118]: pgmap v187: 65 pgs: 65 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 328 op/s 2024-02-19T19:09:47.861 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:47 smithi142 systemd[1]: Stopping Ceph osd.4 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:09:48.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:47 smithi046 ceph-mon[88928]: pgmap v187: 65 pgs: 65 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.6 MiB/s wr, 328 op/s 2024-02-19T19:09:48.202 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:47 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[47837]: 2024-02-19T19:09:47.838+0000 7f5e27043700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:09:48.202 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:47 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[47837]: 2024-02-19T19:09:47.838+0000 7f5e27043700 -1 osd.4 104 *** Got signal Terminated *** 2024-02-19T19:09:48.202 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:47 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[47837]: 2024-02-19T19:09:47.838+0000 7f5e27043700 -1 osd.4 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:09:48.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:48 smithi142 ceph-mon[69118]: osd.4 marked itself down and dead 2024-02-19T19:09:49.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:48 smithi046 ceph-mon[88928]: osd.4 marked itself down and dead 2024-02-19T19:09:49.452 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:49 smithi142 podman[83587]: 2024-02-19 19:09:49.136072927 +0000 UTC m=+1.392951424 container died 4b1ded49236ed18f8a2dae178dad38ffd0b8b8ca14c6d0a407974fa361ff5aeb (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-19T19:09:49.819 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:49 smithi142 ceph-mon[69118]: pgmap v188: 65 pgs: 65 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.0 MiB/s wr, 261 op/s 2024-02-19T19:09:49.819 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:49 smithi142 ceph-mon[69118]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:09:49.819 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:49 smithi142 ceph-mon[69118]: osdmap e105: 6 total, 5 up, 6 in 2024-02-19T19:09:49.820 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:49 smithi142 podman[83587]: 2024-02-19 19:09:49.538911084 +0000 UTC m=+1.795789591 container cleanup 4b1ded49236ed18f8a2dae178dad38ffd0b8b8ca14c6d0a407974fa361ff5aeb (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1) 2024-02-19T19:09:49.820 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:49 smithi142 bash[83587]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4 2024-02-19T19:09:50.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:49 smithi046 ceph-mon[88928]: pgmap v188: 65 pgs: 65 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.0 MiB/s wr, 261 op/s 2024-02-19T19:09:50.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:49 smithi046 ceph-mon[88928]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:09:50.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:49 smithi046 ceph-mon[88928]: osdmap e105: 6 total, 5 up, 6 in 2024-02-19T19:09:50.138 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:49 smithi142 podman[83604]: 2024-02-19 19:09:49.798660966 +0000 UTC m=+0.659578074 container remove 4b1ded49236ed18f8a2dae178dad38ffd0b8b8ca14c6d0a407974fa361ff5aeb (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:09:50.439 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:50 smithi142 podman[83697]: 2024-02-19 19:09:50.019788104 +0000 UTC m=+0.018808687 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:09:50.440 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:50 smithi142 podman[83697]: 2024-02-19 19:09:50.124470746 +0000 UTC m=+0.123491366 container create ec6d55b1d96c04cbc5db312807c2fb51ae55adc8f492d17a0232ba69186e2f73 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214) 2024-02-19T19:09:50.440 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:50 smithi142 podman[83697]: 2024-02-19 19:09:50.327380627 +0000 UTC m=+0.326401211 container init ec6d55b1d96c04cbc5db312807c2fb51ae55adc8f492d17a0232ba69186e2f73 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:09:50.440 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:50 smithi142 podman[83697]: 2024-02-19 19:09:50.331013424 +0000 UTC m=+0.330034020 container start ec6d55b1d96c04cbc5db312807c2fb51ae55adc8f492d17a0232ba69186e2f73 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-19T19:09:50.440 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:50 smithi142 podman[83697]: 2024-02-19 19:09:50.418552297 +0000 UTC m=+0.417572876 container attach ec6d55b1d96c04cbc5db312807c2fb51ae55adc8f492d17a0232ba69186e2f73 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-19T19:09:50.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:50 smithi142 ceph-mon[69118]: osdmap e106: 6 total, 5 up, 6 in 2024-02-19T19:09:50.702 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:50 smithi142 podman[83697]: 2024-02-19 19:09:50.626436121 +0000 UTC m=+0.625456711 container died ec6d55b1d96c04cbc5db312807c2fb51ae55adc8f492d17a0232ba69186e2f73 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS) 2024-02-19T19:09:51.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:50 smithi046 ceph-mon[88928]: osdmap e106: 6 total, 5 up, 6 in 2024-02-19T19:09:51.608 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:51 smithi142 podman[83723]: 2024-02-19 19:09:51.222160633 +0000 UTC m=+0.590519030 container remove ec6d55b1d96c04cbc5db312807c2fb51ae55adc8f492d17a0232ba69186e2f73 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:09:51.608 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:51 smithi142 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-19T19:09:51.608 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:51 smithi142 systemd[1]: Stopped Ceph osd.4 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:09:51.608 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:51 smithi142 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.4.service: Consumed 55.573s CPU time. 2024-02-19T19:09:51.608 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:51 smithi142 systemd[1]: Starting Ceph osd.4 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:09:51.880 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:51 smithi142 ceph-mon[69118]: pgmap v191: 65 pgs: 4 peering, 4 stale+active+clean, 57 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 752 KiB/s wr, 199 op/s 2024-02-19T19:09:51.880 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:51 smithi142 ceph-mon[69118]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-19T19:09:51.881 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:51 smithi142 podman[83824]: 2024-02-19 19:09:51.554722169 +0000 UTC m=+0.018765206 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:09:51.881 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:51 smithi142 podman[83824]: 2024-02-19 19:09:51.673958417 +0000 UTC m=+0.138001481 container create c161776c4436f0886b14c42ddb22c6b390ceac830ef24ccca761f332bbcc40b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-02-19T19:09:51.881 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:51 smithi142 podman[83824]: 2024-02-19 19:09:51.859628176 +0000 UTC m=+0.323671195 container init c161776c4436f0886b14c42ddb22c6b390ceac830ef24ccca761f332bbcc40b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:09:52.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:51 smithi046 ceph-mon[88928]: pgmap v191: 65 pgs: 4 peering, 4 stale+active+clean, 57 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 752 KiB/s wr, 199 op/s 2024-02-19T19:09:52.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:51 smithi046 ceph-mon[88928]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-19T19:09:52.202 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:51 smithi142 podman[83824]: 2024-02-19 19:09:51.862681041 +0000 UTC m=+0.326724069 container start c161776c4436f0886b14c42ddb22c6b390ceac830ef24ccca761f332bbcc40b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240214, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-19T19:09:52.202 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:51 smithi142 podman[83824]: 2024-02-19 19:09:51.917694692 +0000 UTC m=+0.381737730 container attach c161776c4436f0886b14c42ddb22c6b390ceac830ef24ccca761f332bbcc40b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-19T19:09:52.662 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate[83839]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-19T19:09:52.662 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate[83839]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-19T19:09:52.662 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 bash[83824]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-19T19:09:52.662 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 bash[83824]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-19T19:09:52.662 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 bash[83824]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-19T19:09:52.662 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 bash[83824]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-19T19:09:52.662 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 bash[83824]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-19T19:09:52.663 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 bash[83824]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-19T19:09:52.663 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 bash[83824]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-19T19:09:52.663 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate[83839]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-19T19:09:52.663 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate[83839]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-19T19:09:52.663 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate[83839]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-19T19:09:52.663 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate[83839]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-19T19:09:52.663 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate[83839]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-19T19:09:52.663 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 podman[83824]: 2024-02-19 19:09:52.329314013 +0000 UTC m=+0.793357035 container died c161776c4436f0886b14c42ddb22c6b390ceac830ef24ccca761f332bbcc40b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-19T19:09:52.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:52 smithi142 ceph-mon[69118]: pgmap v192: 65 pgs: 9 active+undersized, 12 active+undersized+degraded, 4 peering, 2 stale+active+clean, 38 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 144 KiB/s wr, 75 op/s; 47/351 objects degraded (13.390%) 2024-02-19T19:09:52.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:52 smithi142 ceph-mon[69118]: Health check failed: Degraded data redundancy: 47/351 objects degraded (13.390%), 12 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:52.952 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:52 smithi142 podman[83960]: 2024-02-19 19:09:52.846176972 +0000 UTC m=+0.509201803 container remove c161776c4436f0886b14c42ddb22c6b390ceac830ef24ccca761f332bbcc40b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-activate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:09:53.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:52 smithi046 ceph-mon[88928]: pgmap v192: 65 pgs: 9 active+undersized, 12 active+undersized+degraded, 4 peering, 2 stale+active+clean, 38 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 144 KiB/s wr, 75 op/s; 47/351 objects degraded (13.390%) 2024-02-19T19:09:53.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:52 smithi046 ceph-mon[88928]: Health check failed: Degraded data redundancy: 47/351 objects degraded (13.390%), 12 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:53.354 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:53 smithi142 podman[84027]: 2024-02-19 19:09:52.962691066 +0000 UTC m=+0.017596930 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:09:53.354 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:53 smithi142 podman[84027]: 2024-02-19 19:09:53.063892248 +0000 UTC m=+0.118798145 container create 645517de8ff6ccacde27285d26fc0325ed81482732713e904e05911efdbbdad6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD) 2024-02-19T19:09:53.354 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:53 smithi142 podman[84027]: 2024-02-19 19:09:53.274727534 +0000 UTC m=+0.329633389 container init 645517de8ff6ccacde27285d26fc0325ed81482732713e904e05911efdbbdad6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:09:53.354 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:53 smithi142 podman[84027]: 2024-02-19 19:09:53.277553827 +0000 UTC m=+0.332459687 container start 645517de8ff6ccacde27285d26fc0325ed81482732713e904e05911efdbbdad6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-19T19:09:53.354 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:53 smithi142 ceph-osd[84047]: -- 172.21.15.142:0/2926845604 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5614472511e0 con 0x561447223000 2024-02-19T19:09:53.354 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:53 smithi142 bash[84027]: 645517de8ff6ccacde27285d26fc0325ed81482732713e904e05911efdbbdad6 2024-02-19T19:09:53.702 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:53 smithi142 systemd[1]: Started Ceph osd.4 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:09:54.167 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:53 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T19:09:53.824+0000 7f0609ad97c0 -1 Falling back to public interface 2024-02-19T19:09:54.443 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:54.443 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:54.443 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:54.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:54.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:54.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:55.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:55 smithi142 ceph-mon[69118]: pgmap v193: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 5.5 KiB/s wr, 12 op/s; 58/351 objects degraded (16.524%) 2024-02-19T19:09:55.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:55 smithi142 ceph-mon[69118]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-19T19:09:55.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:55 smithi046 ceph-mon[88928]: pgmap v193: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 296 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 5.5 KiB/s wr, 12 op/s; 58/351 objects degraded (16.524%) 2024-02-19T19:09:55.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:55 smithi046 ceph-mon[88928]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-19T19:09:57.634 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:57 smithi046 ceph-mon[88928]: pgmap v194: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s; 58/351 objects degraded (16.524%) 2024-02-19T19:09:57.634 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:57.634 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:57.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:57 smithi142 ceph-mon[69118]: pgmap v194: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s; 58/351 objects degraded (16.524%) 2024-02-19T19:09:57.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:57.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:58.394 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:58 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T19:09:58.321+0000 7f0609ad97c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-19T19:09:58.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:58.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:58.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:58.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:58.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:58.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:58.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:09:58.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:59.106 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:58 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T19:09:58.779+0000 7f0609ad97c0 -1 osd.4 104 log_to_monitors true 2024-02-19T19:09:59.651 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 19:09:59 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T19:09:59.555+0000 7f05faf31700 -1 osd.4 104 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:09:59.651 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:59 smithi142 ceph-mon[69118]: pgmap v195: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 1 op/s; 58/351 objects degraded (16.524%) 2024-02-19T19:09:59.651 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:59 smithi142 ceph-mon[69118]: from='osd.4 [v2:172.21.15.142:6808/1150732284,v1:172.21.15.142:6809/1150732284]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T19:09:59.651 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:59 smithi142 ceph-mon[69118]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T19:09:59.651 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:09:59 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 58/351 objects degraded (16.524%), 16 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:59.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:59 smithi046 ceph-mon[88928]: pgmap v195: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 1 op/s; 58/351 objects degraded (16.524%) 2024-02-19T19:09:59.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:59 smithi046 ceph-mon[88928]: from='osd.4 [v2:172.21.15.142:6808/1150732284,v1:172.21.15.142:6809/1150732284]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T19:09:59.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:59 smithi046 ceph-mon[88928]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T19:09:59.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:09:59 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 58/351 objects degraded (16.524%), 16 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:00.796 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T19:10:00.796 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: osdmap e107: 6 total, 5 up, 6 in 2024-02-19T19:10:00.796 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: from='osd.4 [v2:172.21.15.142:6808/1150732284,v1:172.21.15.142:6809/1150732284]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: Health detail: HEALTH_WARN 1 osds down; Degraded data redundancy: 58/351 objects degraded (16.524%), 16 pgs degraded 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: [WRN] OSD_DOWN: 1 osds down 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: osd.4 (root=default,host=smithi142) is down 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: [WRN] PG_DEGRADED: Degraded data redundancy: 58/351 objects degraded (16.524%), 16 pgs degraded 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.7 is active+undersized+degraded, acting [1,2] 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.a is active+undersized+degraded, acting [1,3] 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.b is active+undersized+degraded, acting [3,5] 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-19T19:10:00.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-02-19T19:10:00.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.13 is active+undersized+degraded, acting [1,2] 2024-02-19T19:10:00.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-02-19T19:10:00.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-02-19T19:10:00.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-02-19T19:10:00.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.1a is active+undersized+degraded, acting [1,5] 2024-02-19T19:10:00.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-19T19:10:00.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:00 smithi142 ceph-mon[69118]: pg 2.1f is active+undersized+degraded, acting [1,2] 2024-02-19T19:10:00.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T19:10:00.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: osdmap e107: 6 total, 5 up, 6 in 2024-02-19T19:10:00.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: from='osd.4 [v2:172.21.15.142:6808/1150732284,v1:172.21.15.142:6809/1150732284]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:10:00.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:10:00.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: Health detail: HEALTH_WARN 1 osds down; Degraded data redundancy: 58/351 objects degraded (16.524%), 16 pgs degraded 2024-02-19T19:10:00.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: [WRN] OSD_DOWN: 1 osds down 2024-02-19T19:10:00.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: osd.4 (root=default,host=smithi142) is down 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: [WRN] PG_DEGRADED: Degraded data redundancy: 58/351 objects degraded (16.524%), 16 pgs degraded 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.7 is active+undersized+degraded, acting [1,2] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.a is active+undersized+degraded, acting [1,3] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.b is active+undersized+degraded, acting [3,5] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.13 is active+undersized+degraded, acting [1,2] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-02-19T19:10:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-02-19T19:10:00.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.1a is active+undersized+degraded, acting [1,5] 2024-02-19T19:10:00.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-19T19:10:00.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:00 smithi046 ceph-mon[88928]: pg 2.1f is active+undersized+degraded, acting [1,2] 2024-02-19T19:10:01.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: pgmap v197: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 818 B/s wr, 0 op/s; 58/351 objects degraded (16.524%) 2024-02-19T19:10:01.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:10:01.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: osd.4 [v2:172.21.15.142:6808/1150732284,v1:172.21.15.142:6809/1150732284] boot 2024-02-19T19:10:01.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: osdmap e108: 6 total, 6 up, 6 in 2024-02-19T19:10:01.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:10:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:10:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: pgmap v197: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 818 B/s wr, 0 op/s; 58/351 objects degraded (16.524%) 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: osd.4 [v2:172.21.15.142:6808/1150732284,v1:172.21.15.142:6809/1150732284] boot 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: osdmap e108: 6 total, 6 up, 6 in 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:01.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:01.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:01.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:10:02.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:02 smithi046 ceph-mon[88928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:10:02.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:02 smithi046 ceph-mon[88928]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-02-19T19:10:02.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:02 smithi046 ceph-mon[88928]: osdmap e109: 6 total, 6 up, 6 in 2024-02-19T19:10:02.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:02 smithi142 ceph-mon[69118]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:10:02.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:02 smithi142 ceph-mon[69118]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-02-19T19:10:02.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:02 smithi142 ceph-mon[69118]: osdmap e109: 6 total, 6 up, 6 in 2024-02-19T19:10:03.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:03 smithi046 ceph-mon[88928]: pgmap v200: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/351 objects degraded (16.524%) 2024-02-19T19:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:03 smithi142 ceph-mon[69118]: pgmap v200: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/351 objects degraded (16.524%) 2024-02-19T19:10:04.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:04 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 51/351 objects degraded (14.530%), 14 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:05.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:04 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 51/351 objects degraded (14.530%), 14 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:05.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:05 smithi142 ceph-mon[69118]: pgmap v201: 65 pgs: 10 active+undersized, 14 active+undersized+degraded, 41 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/351 objects degraded (14.530%) 2024-02-19T19:10:06.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:05 smithi046 ceph-mon[88928]: pgmap v201: 65 pgs: 10 active+undersized, 14 active+undersized+degraded, 41 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/351 objects degraded (14.530%) 2024-02-19T19:10:06.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:06 smithi142 ceph-mon[69118]: pgmap v202: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 182 B/s, 0 objects/s recovering 2024-02-19T19:10:06.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:06 smithi142 ceph-mon[69118]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/351 objects degraded (14.530%), 14 pgs degraded) 2024-02-19T19:10:06.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:06 smithi142 ceph-mon[69118]: Cluster is now healthy 2024-02-19T19:10:07.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:06 smithi046 ceph-mon[88928]: pgmap v202: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 182 B/s, 0 objects/s recovering 2024-02-19T19:10:07.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:06 smithi046 ceph-mon[88928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/351 objects degraded (14.530%), 14 pgs degraded) 2024-02-19T19:10:07.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:06 smithi046 ceph-mon[88928]: Cluster is now healthy 2024-02-19T19:10:09.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:08 smithi046 ceph-mon[88928]: pgmap v203: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 142 B/s, 0 objects/s recovering 2024-02-19T19:10:09.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:08 smithi142 ceph-mon[69118]: pgmap v203: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 142 B/s, 0 objects/s recovering 2024-02-19T19:10:11.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:10 smithi046 ceph-mon[88928]: pgmap v204: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 123 B/s, 0 objects/s recovering 2024-02-19T19:10:11.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:10 smithi142 ceph-mon[69118]: pgmap v204: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 123 B/s, 0 objects/s recovering 2024-02-19T19:10:11.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.867+0000 7f041c8a1700 1 -- 172.21.15.46:0/2256317376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04180ffd50 msgr2=0x7f0418103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:11.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.867+0000 7f041c8a1700 1 --2- 172.21.15.46:0/2256317376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04180ffd50 0x7f0418103d20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f040c009910 tx=0x7f040c009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.868+0000 7f041c8a1700 1 -- 172.21.15.46:0/2256317376 shutdown_connections 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.868+0000 7f041c8a1700 1 --2- 172.21.15.46:0/2256317376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04180ffd50 0x7f0418103d20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.868+0000 7f041c8a1700 1 --2- 172.21.15.46:0/2256317376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04180ff3b0 0x7f04180ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.868+0000 7f041c8a1700 1 -- 172.21.15.46:0/2256317376 >> 172.21.15.46:0/2256317376 conn(0x7f04180fac90 msgr2=0x7f04180fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.868+0000 7f041c8a1700 1 -- 172.21.15.46:0/2256317376 shutdown_connections 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.868+0000 7f041c8a1700 1 -- 172.21.15.46:0/2256317376 wait complete. 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.868+0000 7f041c8a1700 1 Processor -- start 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.868+0000 7f041c8a1700 1 -- start start 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041c8a1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04180ff3b0 0x7f0418195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041c8a1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04180ffd50 0x7f04181963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041c8a1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0418196a30 con 0x7f04180ff3b0 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041c8a1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0418196b70 con 0x7f04180ffd50 2024-02-19T19:10:11.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04180ff3b0 0x7f0418195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04180ff3b0 0x7f0418195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34460/0 (socket says 172.21.15.46:34460) 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041659c700 1 -- 172.21.15.46:0/3387644030 learned_addr learned my addr 172.21.15.46:0/3387644030 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041659c700 1 -- 172.21.15.46:0/3387644030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04180ffd50 msgr2=0x7f04181963e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041659c700 1 --2- 172.21.15.46:0/3387644030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04180ffd50 0x7f04181963e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041659c700 1 -- 172.21.15.46:0/3387644030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c0095f0 con 0x7f04180ff3b0 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f041659c700 1 --2- 172.21.15.46:0/3387644030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04180ff3b0 0x7f0418195ea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f040800c930 tx=0x7f040800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f04077fe700 1 -- 172.21.15.46:0/3387644030 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0408007ad0 con 0x7f04180ff3b0 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.869+0000 7f04077fe700 1 -- 172.21.15.46:0/3387644030 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0408007c30 con 0x7f04180ff3b0 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.870+0000 7f041c8a1700 1 -- 172.21.15.46:0/3387644030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041819a9c0 con 0x7f04180ff3b0 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.870+0000 7f04077fe700 1 -- 172.21.15.46:0/3387644030 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0408018610 con 0x7f04180ff3b0 2024-02-19T19:10:11.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.870+0000 7f041c8a1700 1 -- 172.21.15.46:0/3387644030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041819af10 con 0x7f04180ff3b0 2024-02-19T19:10:11.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.871+0000 7f041c8a1700 1 -- 172.21.15.46:0/3387644030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041804f2a0 con 0x7f04180ff3b0 2024-02-19T19:10:11.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.871+0000 7f04077fe700 1 -- 172.21.15.46:0/3387644030 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f040800f450 con 0x7f04180ff3b0 2024-02-19T19:10:11.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.872+0000 7f04077fe700 1 --2- 172.21.15.46:0/3387644030 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f040006d8a0 0x7f040006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:11.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.872+0000 7f0415d9b700 1 --2- 172.21.15.46:0/3387644030 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f040006d8a0 0x7f040006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:11.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.872+0000 7f04077fe700 1 -- 172.21.15.46:0/3387644030 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f040808d700 con 0x7f04180ff3b0 2024-02-19T19:10:11.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.872+0000 7f0415d9b700 1 --2- 172.21.15.46:0/3387644030 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f040006d8a0 0x7f040006fd50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f040c000c00 tx=0x7f040c005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:11.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:11.877+0000 7f04077fe700 1 -- 172.21.15.46:0/3387644030 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0408056ed0 con 0x7f04180ff3b0 2024-02-19T19:10:12.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.102+0000 7f041c8a1700 1 -- 172.21.15.46:0/3387644030 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f041819b320 con 0x7f040006d8a0 2024-02-19T19:10:12.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.103+0000 7f04077fe700 1 -- 172.21.15.46:0/3387644030 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f041819b320 con 0x7f040006d8a0 2024-02-19T19:10:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 -- 172.21.15.46:0/3387644030 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f040006d8a0 msgr2=0x7f040006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 --2- 172.21.15.46:0/3387644030 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f040006d8a0 0x7f040006fd50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f040c000c00 tx=0x7f040c005fb0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 -- 172.21.15.46:0/3387644030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04180ff3b0 msgr2=0x7f0418195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 --2- 172.21.15.46:0/3387644030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04180ff3b0 0x7f0418195ea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f040800c930 tx=0x7f040800ccf0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 -- 172.21.15.46:0/3387644030 shutdown_connections 2024-02-19T19:10:12.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 --2- 172.21.15.46:0/3387644030 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f040006d8a0 0x7f040006fd50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 --2- 172.21.15.46:0/3387644030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04180ff3b0 0x7f0418195ea0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 --2- 172.21.15.46:0/3387644030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04180ffd50 0x7f04181963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 -- 172.21.15.46:0/3387644030 >> 172.21.15.46:0/3387644030 conn(0x7f04180fac90 msgr2=0x7f0418068f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:12.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 -- 172.21.15.46:0/3387644030 shutdown_connections 2024-02-19T19:10:12.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.105+0000 7f041c8a1700 1 -- 172.21.15.46:0/3387644030 wait complete. 2024-02-19T19:10:12.138 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:10:12.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.212+0000 7f1681fd3700 1 -- 172.21.15.46:0/4232723837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c1038b0 msgr2=0x7f167c103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.212+0000 7f1681fd3700 1 --2- 172.21.15.46:0/4232723837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c1038b0 0x7f167c103c80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1674009910 tx=0x7f1674009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:12.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.212+0000 7f1681fd3700 1 -- 172.21.15.46:0/4232723837 shutdown_connections 2024-02-19T19:10:12.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.212+0000 7f1681fd3700 1 --2- 172.21.15.46:0/4232723837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f167c0ff350 0x7f167c0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.212+0000 7f1681fd3700 1 --2- 172.21.15.46:0/4232723837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c1038b0 0x7f167c103c80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.212+0000 7f1681fd3700 1 -- 172.21.15.46:0/4232723837 >> 172.21.15.46:0/4232723837 conn(0x7f167c0748b0 msgr2=0x7f167c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:12.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.212+0000 7f1681fd3700 1 -- 172.21.15.46:0/4232723837 shutdown_connections 2024-02-19T19:10:12.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.212+0000 7f1681fd3700 1 -- 172.21.15.46:0/4232723837 wait complete. 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.213+0000 7f1681fd3700 1 Processor -- start 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.213+0000 7f1681fd3700 1 -- start start 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.213+0000 7f1681fd3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f167c0ff350 0x7f167c195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.213+0000 7f1681fd3700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c1038b0 0x7f167c196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.213+0000 7f1681fd3700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c196b70 con 0x7f167c1038b0 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.213+0000 7f1681fd3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c19a900 con 0x7f167c0ff350 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.213+0000 7f167affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c1038b0 0x7f167c196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.213+0000 7f167affd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c1038b0 0x7f167c196490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34484/0 (socket says 172.21.15.46:34484) 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.213+0000 7f167affd700 1 -- 172.21.15.46:0/2010219409 learned_addr learned my addr 172.21.15.46:0/2010219409 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.214+0000 7f167b7fe700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f167c0ff350 0x7f167c195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.214+0000 7f167affd700 1 -- 172.21.15.46:0/2010219409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f167c0ff350 msgr2=0x7f167c195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.214+0000 7f167affd700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f167c0ff350 0x7f167c195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.214+0000 7f167affd700 1 -- 172.21.15.46:0/2010219409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740095f0 con 0x7f167c1038b0 2024-02-19T19:10:12.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.214+0000 7f167affd700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c1038b0 0x7f167c196490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f166400b4b0 tx=0x7f166400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:12.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.214+0000 7f1678ff9700 1 -- 172.21.15.46:0/2010219409 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1664011800 con 0x7f167c1038b0 2024-02-19T19:10:12.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.214+0000 7f1678ff9700 1 -- 172.21.15.46:0/2010219409 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1664011e20 con 0x7f167c1038b0 2024-02-19T19:10:12.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.214+0000 7f1681fd3700 1 -- 172.21.15.46:0/2010219409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167c19abe0 con 0x7f167c1038b0 2024-02-19T19:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.215+0000 7f1678ff9700 1 -- 172.21.15.46:0/2010219409 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f166400f2e0 con 0x7f167c1038b0 2024-02-19T19:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.215+0000 7f1681fd3700 1 -- 172.21.15.46:0/2010219409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167c19b130 con 0x7f167c1038b0 2024-02-19T19:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.216+0000 7f1678ff9700 1 -- 172.21.15.46:0/2010219409 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1664010380 con 0x7f167c1038b0 2024-02-19T19:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.216+0000 7f1681fd3700 1 -- 172.21.15.46:0/2010219409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c102c90 con 0x7f167c1038b0 2024-02-19T19:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.216+0000 7f1678ff9700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f166806d8a0 0x7f166806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.216+0000 7f1678ff9700 1 -- 172.21.15.46:0/2010219409 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f166408d0a0 con 0x7f167c1038b0 2024-02-19T19:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.216+0000 7f167b7fe700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f166806d8a0 0x7f166806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:12.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.217+0000 7f167b7fe700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f166806d8a0 0x7f166806fd50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1674006010 tx=0x7f167400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:12.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.221+0000 7f1678ff9700 1 -- 172.21.15.46:0/2010219409 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1664056870 con 0x7f167c1038b0 2024-02-19T19:10:12.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.447+0000 7f1681fd3700 1 -- 172.21.15.46:0/2010219409 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f167c19b400 con 0x7f166806d8a0 2024-02-19T19:10:12.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.448+0000 7f1678ff9700 1 -- 172.21.15.46:0/2010219409 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f167c19b400 con 0x7f166806d8a0 2024-02-19T19:10:12.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 -- 172.21.15.46:0/2010219409 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f166806d8a0 msgr2=0x7f166806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f166806d8a0 0x7f166806fd50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1674006010 tx=0x7f167400b540 comp rx=0 tx=0).stop 2024-02-19T19:10:12.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 -- 172.21.15.46:0/2010219409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c1038b0 msgr2=0x7f167c196490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c1038b0 0x7f167c196490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f166400b4b0 tx=0x7f166400b870 comp rx=0 tx=0).stop 2024-02-19T19:10:12.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 -- 172.21.15.46:0/2010219409 shutdown_connections 2024-02-19T19:10:12.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f166806d8a0 0x7f166806fd50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f167c0ff350 0x7f167c195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 --2- 172.21.15.46:0/2010219409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f167c1038b0 0x7f167c196490 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 -- 172.21.15.46:0/2010219409 >> 172.21.15.46:0/2010219409 conn(0x7f167c0748b0 msgr2=0x7f167c108890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:12.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 -- 172.21.15.46:0/2010219409 shutdown_connections 2024-02-19T19:10:12.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.450+0000 7f1681fd3700 1 -- 172.21.15.46:0/2010219409 wait complete. 2024-02-19T19:10:12.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.556+0000 7f13e099e700 1 -- 172.21.15.46:0/3071433474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13dc100e80 msgr2=0x7f13dc104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.556+0000 7f13e099e700 1 --2- 172.21.15.46:0/3071433474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13dc100e80 0x7f13dc104e50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009910 tx=0x7f13c4009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:12.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.556+0000 7f13e099e700 1 -- 172.21.15.46:0/3071433474 shutdown_connections 2024-02-19T19:10:12.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.556+0000 7f13e099e700 1 --2- 172.21.15.46:0/3071433474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13dc100e80 0x7f13dc104e50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.556+0000 7f13e099e700 1 --2- 172.21.15.46:0/3071433474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13dc1004e0 0x7f13dc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.556+0000 7f13e099e700 1 -- 172.21.15.46:0/3071433474 >> 172.21.15.46:0/3071433474 conn(0x7f13dc0fbda0 msgr2=0x7f13dc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:12.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.556+0000 7f13e099e700 1 -- 172.21.15.46:0/3071433474 shutdown_connections 2024-02-19T19:10:12.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.556+0000 7f13e099e700 1 -- 172.21.15.46:0/3071433474 wait complete. 2024-02-19T19:10:12.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.557+0000 7f13e099e700 1 Processor -- start 2024-02-19T19:10:12.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.557+0000 7f13e099e700 1 -- start start 2024-02-19T19:10:12.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13e099e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13dc1004e0 0x7f13dc196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:12.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13e099e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13dc100e80 0x7f13dc196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13e099e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc196c20 con 0x7f13dc100e80 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13e099e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc19a9b0 con 0x7f13dc1004e0 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13d9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13dc100e80 0x7f13dc196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13d9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13dc100e80 0x7f13dc196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34502/0 (socket says 172.21.15.46:34502) 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13d9d9b700 1 -- 172.21.15.46:0/2099813960 learned_addr learned my addr 172.21.15.46:0/2099813960 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13da59c700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13dc1004e0 0x7f13dc196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13d9d9b700 1 -- 172.21.15.46:0/2099813960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13dc1004e0 msgr2=0x7f13dc196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13d9d9b700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13dc1004e0 0x7f13dc196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13d9d9b700 1 -- 172.21.15.46:0/2099813960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c40095f0 con 0x7f13dc100e80 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13da59c700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13dc1004e0 0x7f13dc196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13d9d9b700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13dc100e80 0x7f13dc196540 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f13c4005f50 tx=0x7f13c400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13d37fe700 1 -- 172.21.15.46:0/2099813960 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13c401d070 con 0x7f13dc100e80 2024-02-19T19:10:12.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13d37fe700 1 -- 172.21.15.46:0/2099813960 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13c400f460 con 0x7f13dc100e80 2024-02-19T19:10:12.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13e099e700 1 -- 172.21.15.46:0/2099813960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc19ac30 con 0x7f13dc100e80 2024-02-19T19:10:12.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.558+0000 7f13d37fe700 1 -- 172.21.15.46:0/2099813960 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13c4017630 con 0x7f13dc100e80 2024-02-19T19:10:12.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.559+0000 7f13e099e700 1 -- 172.21.15.46:0/2099813960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc19b120 con 0x7f13dc100e80 2024-02-19T19:10:12.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.559+0000 7f13e099e700 1 -- 172.21.15.46:0/2099813960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc1087a0 con 0x7f13dc100e80 2024-02-19T19:10:12.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.560+0000 7f13d37fe700 1 -- 172.21.15.46:0/2099813960 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f13c40178a0 con 0x7f13dc100e80 2024-02-19T19:10:12.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.560+0000 7f13d37fe700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f13c806d8a0 0x7f13c806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:12.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.560+0000 7f13d37fe700 1 -- 172.21.15.46:0/2099813960 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f13c408eb80 con 0x7f13dc100e80 2024-02-19T19:10:12.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.560+0000 7f13da59c700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f13c806d8a0 0x7f13c806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:12.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.561+0000 7f13da59c700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f13c806d8a0 0x7f13c806fd50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f13cc007900 tx=0x7f13cc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:12.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.565+0000 7f13d37fe700 1 -- 172.21.15.46:0/2099813960 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f13c4058420 con 0x7f13dc100e80 2024-02-19T19:10:12.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.783+0000 7f13e099e700 1 -- 172.21.15.46:0/2099813960 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f13dc02cca0 con 0x7f13c806d8a0 2024-02-19T19:10:12.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.795+0000 7f13d37fe700 1 -- 172.21.15.46:0/2099813960 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f13dc02cca0 con 0x7f13c806d8a0 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (6m) 87s ago 16m 25.7M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (17m) 87s ago 17m 8572k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (15m) 16s ago 15m 8388k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (3m) 87s ago 17m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (3m) 16s ago 15m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 87s ago 16m 88.1M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (10m) 87s ago 10m 140M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (10m) 87s ago 10m 17.0M - 18.2.0 dc2bc1663786 695c6f9526a8 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (10m) 16s ago 10m 18.0M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:10:12.817 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (10m) 16s ago 10m 120M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (7m) 87s ago 18m 507M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (7m) 16s ago 15m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (4m) 87s ago 18m 49.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (4m) 16s ago 15m 42.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 87s ago 16m 16.6M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (7m) 16s ago 15m 16.7M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (3m) 87s ago 14m 231M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (2m) 87s ago 14m 250M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 974e56511c36 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (107s) 87s ago 13m 15.1M 1217M 19.0.0-1450-gf78a58c0 f081f847070a a31225ea4dec 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (53s) 16s ago 13m 143M 2240M 19.0.0-1450-gf78a58c0 f081f847070a b46795b87c3e 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (19s) 16s ago 12m 12.4M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 645517de8ff6 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (12m) 16s ago 12m 252M 2240M 18.2.0 dc2bc1663786 77516bfca468 2024-02-19T19:10:12.818 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (6m) 87s ago 15m 68.2M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:10:12.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 -- 172.21.15.46:0/2099813960 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f13c806d8a0 msgr2=0x7f13c806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f13c806d8a0 0x7f13c806fd50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f13cc007900 tx=0x7f13cc008040 comp rx=0 tx=0).stop 2024-02-19T19:10:12.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 -- 172.21.15.46:0/2099813960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13dc100e80 msgr2=0x7f13dc196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13dc100e80 0x7f13dc196540 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f13c4005f50 tx=0x7f13c400be20 comp rx=0 tx=0).stop 2024-02-19T19:10:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 -- 172.21.15.46:0/2099813960 shutdown_connections 2024-02-19T19:10:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f13c806d8a0 0x7f13c806fd50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13dc1004e0 0x7f13dc196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 --2- 172.21.15.46:0/2099813960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13dc100e80 0x7f13dc196540 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 -- 172.21.15.46:0/2099813960 >> 172.21.15.46:0/2099813960 conn(0x7f13dc0fbda0 msgr2=0x7f13dc0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 -- 172.21.15.46:0/2099813960 shutdown_connections 2024-02-19T19:10:12.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.797+0000 7f13e099e700 1 -- 172.21.15.46:0/2099813960 wait complete. 2024-02-19T19:10:12.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:12 smithi046 ceph-mon[88928]: pgmap v205: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 111 B/s, 0 objects/s recovering 2024-02-19T19:10:12.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:12 smithi046 ceph-mon[88928]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:12.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:12 smithi046 ceph-mon[88928]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:12.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:12.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.902+0000 7fa12c7a4700 1 -- 172.21.15.46:0/911763973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa124100460 msgr2=0x7fa124100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.902+0000 7fa12c7a4700 1 --2- 172.21.15.46:0/911763973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa124100460 0x7fa124100830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa11400b0d0 tx=0x7fa11400b3e0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.902+0000 7fa12c7a4700 1 -- 172.21.15.46:0/911763973 shutdown_connections 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.902+0000 7fa12c7a4700 1 --2- 172.21.15.46:0/911763973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa124100d70 0x7fa1241094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.902+0000 7fa12c7a4700 1 --2- 172.21.15.46:0/911763973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa124100460 0x7fa124100830 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.902+0000 7fa12c7a4700 1 -- 172.21.15.46:0/911763973 >> 172.21.15.46:0/911763973 conn(0x7fa1240748b0 msgr2=0x7fa124074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.902+0000 7fa12c7a4700 1 -- 172.21.15.46:0/911763973 shutdown_connections 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.902+0000 7fa12c7a4700 1 -- 172.21.15.46:0/911763973 wait complete. 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12c7a4700 1 Processor -- start 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12c7a4700 1 -- start start 2024-02-19T19:10:12.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12c7a4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa124100460 0x7fa124198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12c7a4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa124100d70 0x7fa1241985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12c7a4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa124198c90 con 0x7fa124100460 2024-02-19T19:10:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12c7a4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12419ca20 con 0x7fa124100d70 2024-02-19T19:10:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12a540700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa124100460 0x7fa124198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12a540700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa124100460 0x7fa124198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34514/0 (socket says 172.21.15.46:34514) 2024-02-19T19:10:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12a540700 1 -- 172.21.15.46:0/537748683 learned_addr learned my addr 172.21.15.46:0/537748683 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12a540700 1 -- 172.21.15.46:0/537748683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa124100d70 msgr2=0x7fa1241985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12a540700 1 --2- 172.21.15.46:0/537748683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa124100d70 0x7fa1241985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.903+0000 7fa12a540700 1 -- 172.21.15.46:0/537748683 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa114009d00 con 0x7fa124100460 2024-02-19T19:10:12.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.904+0000 7fa12a540700 1 --2- 172.21.15.46:0/537748683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa124100460 0x7fa124198070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa114006130 tx=0x7fa11400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:12.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.904+0000 7fa1237fe700 1 -- 172.21.15.46:0/537748683 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa11400e040 con 0x7fa124100460 2024-02-19T19:10:12.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.904+0000 7fa1237fe700 1 -- 172.21.15.46:0/537748683 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa114003e50 con 0x7fa124100460 2024-02-19T19:10:12.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.904+0000 7fa12c7a4700 1 -- 172.21.15.46:0/537748683 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12419cca0 con 0x7fa124100460 2024-02-19T19:10:12.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.904+0000 7fa1237fe700 1 -- 172.21.15.46:0/537748683 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa11401da80 con 0x7fa124100460 2024-02-19T19:10:12.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.904+0000 7fa12c7a4700 1 -- 172.21.15.46:0/537748683 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12419d1f0 con 0x7fa124100460 2024-02-19T19:10:12.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.905+0000 7fa12c7a4700 1 -- 172.21.15.46:0/537748683 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12404f2a0 con 0x7fa124100460 2024-02-19T19:10:12.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.905+0000 7fa1237fe700 1 -- 172.21.15.46:0/537748683 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa11401dcf0 con 0x7fa124100460 2024-02-19T19:10:12.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.906+0000 7fa1237fe700 1 --2- 172.21.15.46:0/537748683 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa10c06d8a0 0x7fa10c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:12.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.906+0000 7fa1237fe700 1 -- 172.21.15.46:0/537748683 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fa11408f040 con 0x7fa124100460 2024-02-19T19:10:12.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.906+0000 7fa129d3f700 1 --2- 172.21.15.46:0/537748683 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa10c06d8a0 0x7fa10c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:12.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.906+0000 7fa129d3f700 1 --2- 172.21.15.46:0/537748683 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa10c06d8a0 0x7fa10c06fd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa124199690 tx=0x7fa118006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:12.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:12.910+0000 7fa1237fe700 1 -- 172.21.15.46:0/537748683 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa114058790 con 0x7fa124100460 2024-02-19T19:10:13.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:12 smithi142 ceph-mon[69118]: pgmap v205: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 111 B/s, 0 objects/s recovering 2024-02-19T19:10:13.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:12 smithi142 ceph-mon[69118]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:13.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:12 smithi142 ceph-mon[69118]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:13.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:13.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:13.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.201+0000 7fa12c7a4700 1 -- 172.21.15.46:0/537748683 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa1241993d0 con 0x7fa124100460 2024-02-19T19:10:13.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.202+0000 7fa1237fe700 1 -- 172.21.15.46:0/537748683 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fa11405be50 con 0x7fa124100460 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:10:13.224 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:10:13.225 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-19T19:10:13.225 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:10:13.225 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:10:13.225 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-02-19T19:10:13.225 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 9 2024-02-19T19:10:13.225 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:10:13.225 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:10:13.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.204+0000 7fa12c7a4700 1 -- 172.21.15.46:0/537748683 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa10c06d8a0 msgr2=0x7fa10c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:13.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.205+0000 7fa12c7a4700 1 --2- 172.21.15.46:0/537748683 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa10c06d8a0 0x7fa10c06fd50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa124199690 tx=0x7fa118006d20 comp rx=0 tx=0).stop 2024-02-19T19:10:13.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.205+0000 7fa12c7a4700 1 -- 172.21.15.46:0/537748683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa124100460 msgr2=0x7fa124198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:13.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.205+0000 7fa12c7a4700 1 --2- 172.21.15.46:0/537748683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa124100460 0x7fa124198070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa114006130 tx=0x7fa11400ce30 comp rx=0 tx=0).stop 2024-02-19T19:10:13.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.205+0000 7fa12c7a4700 1 -- 172.21.15.46:0/537748683 shutdown_connections 2024-02-19T19:10:13.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.205+0000 7fa12c7a4700 1 --2- 172.21.15.46:0/537748683 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa10c06d8a0 0x7fa10c06fd50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.205+0000 7fa12c7a4700 1 --2- 172.21.15.46:0/537748683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa124100460 0x7fa124198070 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.205+0000 7fa12c7a4700 1 --2- 172.21.15.46:0/537748683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa124100d70 0x7fa1241985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.205+0000 7fa12c7a4700 1 -- 172.21.15.46:0/537748683 >> 172.21.15.46:0/537748683 conn(0x7fa1240748b0 msgr2=0x7fa1240fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:13.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.205+0000 7fa12c7a4700 1 -- 172.21.15.46:0/537748683 shutdown_connections 2024-02-19T19:10:13.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.205+0000 7fa12c7a4700 1 -- 172.21.15.46:0/537748683 wait complete. 2024-02-19T19:10:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.310+0000 7fc7a316e700 1 -- 172.21.15.46:0/172366502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc79c1004e0 msgr2=0x7fc79c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.310+0000 7fc7a316e700 1 --2- 172.21.15.46:0/172366502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc79c1004e0 0x7fc79c1008b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc790009910 tx=0x7fc790009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.310+0000 7fc7a316e700 1 -- 172.21.15.46:0/172366502 shutdown_connections 2024-02-19T19:10:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.310+0000 7fc7a316e700 1 --2- 172.21.15.46:0/172366502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc79c100e80 0x7fc79c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.310+0000 7fc7a316e700 1 --2- 172.21.15.46:0/172366502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc79c1004e0 0x7fc79c1008b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.310+0000 7fc7a316e700 1 -- 172.21.15.46:0/172366502 >> 172.21.15.46:0/172366502 conn(0x7fc79c0fbda0 msgr2=0x7fc79c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.310+0000 7fc7a316e700 1 -- 172.21.15.46:0/172366502 shutdown_connections 2024-02-19T19:10:13.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.310+0000 7fc7a316e700 1 -- 172.21.15.46:0/172366502 wait complete. 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.311+0000 7fc7a316e700 1 Processor -- start 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.311+0000 7fc7a316e700 1 -- start start 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.311+0000 7fc7a316e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc79c1004e0 0x7fc79c1980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.311+0000 7fc7a316e700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc79c100e80 0x7fc79c1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.311+0000 7fc7a316e700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c198c30 con 0x7fc79c100e80 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.311+0000 7fc7a316e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c198d70 con 0x7fc79c1004e0 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.311+0000 7fc79bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc79c100e80 0x7fc79c1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.311+0000 7fc79bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc79c100e80 0x7fc79c1985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34534/0 (socket says 172.21.15.46:34534) 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.311+0000 7fc79bfff700 1 -- 172.21.15.46:0/2787506808 learned_addr learned my addr 172.21.15.46:0/2787506808 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.312+0000 7fc7a0f0a700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc79c1004e0 0x7fc79c1980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.312+0000 7fc79bfff700 1 -- 172.21.15.46:0/2787506808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc79c1004e0 msgr2=0x7fc79c1980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:13.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.312+0000 7fc79bfff700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc79c1004e0 0x7fc79c1980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.312+0000 7fc79bfff700 1 -- 172.21.15.46:0/2787506808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7900095f0 con 0x7fc79c100e80 2024-02-19T19:10:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.312+0000 7fc79bfff700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc79c100e80 0x7fc79c1985e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc78800c960 tx=0x7fc78800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.312+0000 7fc799ffb700 1 -- 172.21.15.46:0/2787506808 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc788007a70 con 0x7fc79c100e80 2024-02-19T19:10:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.312+0000 7fc799ffb700 1 -- 172.21.15.46:0/2787506808 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc788007bd0 con 0x7fc79c100e80 2024-02-19T19:10:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.312+0000 7fc7a316e700 1 -- 172.21.15.46:0/2787506808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c19cbc0 con 0x7fc79c100e80 2024-02-19T19:10:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.312+0000 7fc799ffb700 1 -- 172.21.15.46:0/2787506808 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7880186c0 con 0x7fc79c100e80 2024-02-19T19:10:13.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.312+0000 7fc7a316e700 1 -- 172.21.15.46:0/2787506808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c19d110 con 0x7fc79c100e80 2024-02-19T19:10:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.313+0000 7fc7a316e700 1 -- 172.21.15.46:0/2787506808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c1045d0 con 0x7fc79c100e80 2024-02-19T19:10:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.314+0000 7fc799ffb700 1 -- 172.21.15.46:0/2787506808 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc78800faa0 con 0x7fc79c100e80 2024-02-19T19:10:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.314+0000 7fc799ffb700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc78c06d8a0 0x7fc78c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.314+0000 7fc799ffb700 1 -- 172.21.15.46:0/2787506808 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fc78808d5c0 con 0x7fc79c100e80 2024-02-19T19:10:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.314+0000 7fc7a0f0a700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc78c06d8a0 0x7fc78c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:13.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.314+0000 7fc7a0f0a700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc78c06d8a0 0x7fc78c06fd50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc790006010 tx=0x7fc79001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:13.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.319+0000 7fc799ffb700 1 -- 172.21.15.46:0/2787506808 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc78805a840 con 0x7fc79c100e80 2024-02-19T19:10:13.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.576+0000 7fc7a316e700 1 -- 172.21.15.46:0/2787506808 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc79c02cc30 con 0x7fc79c100e80 2024-02-19T19:10:13.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.576+0000 7fc799ffb700 1 -- 172.21.15.46:0/2787506808 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1890 (secure 0 0 0) 0x7fc78805a3d0 con 0x7fc79c100e80 2024-02-19T19:10:13.598 INFO:teuthology.orchestra.run.smithi046.stdout:e19 2024-02-19T19:10:13.598 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:10:13.598 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:10:13.598 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:10:13.598 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:10:13.598 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:10:13.598 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 19 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T19:08:21.613462+0000 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:10:13.599 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 46 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14494,1=24265} 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:10:13.600 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:10:13.601 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{0:14494} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.46:6828/2235495765,v1:172.21.15.46:6829/2235495765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:13.601 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{1:24265} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.142:6824/445093561,v1:172.21.15.142:6825/445093561] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:13.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:10:13.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:10:13.601 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:10:13.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:10:13.601 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:14506} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3116160429,v1:172.21.15.46:6827/3116160429] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:13.601 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:13.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 -- 172.21.15.46:0/2787506808 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc78c06d8a0 msgr2=0x7fc78c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:13.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc78c06d8a0 0x7fc78c06fd50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc790006010 tx=0x7fc79001a040 comp rx=0 tx=0).stop 2024-02-19T19:10:13.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 -- 172.21.15.46:0/2787506808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc79c100e80 msgr2=0x7fc79c1985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:13.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc79c100e80 0x7fc79c1985e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc78800c960 tx=0x7fc78800cd20 comp rx=0 tx=0).stop 2024-02-19T19:10:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 -- 172.21.15.46:0/2787506808 shutdown_connections 2024-02-19T19:10:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc78c06d8a0 0x7fc78c06fd50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc79c1004e0 0x7fc79c1980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 --2- 172.21.15.46:0/2787506808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc79c100e80 0x7fc79c1985e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 -- 172.21.15.46:0/2787506808 >> 172.21.15.46:0/2787506808 conn(0x7fc79c0fbda0 msgr2=0x7fc79c0fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 -- 172.21.15.46:0/2787506808 shutdown_connections 2024-02-19T19:10:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.578+0000 7fc7a316e700 1 -- 172.21.15.46:0/2787506808 wait complete. 2024-02-19T19:10:13.603 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-02-19T19:10:13.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.686+0000 7fbd89abd700 1 -- 172.21.15.46:0/1694854490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd841003d0 msgr2=0x7fbd841007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:13.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.686+0000 7fbd89abd700 1 --2- 172.21.15.46:0/1694854490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd841003d0 0x7fbd841007a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009910 tx=0x7fbd74009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:13.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.686+0000 7fbd89abd700 1 -- 172.21.15.46:0/1694854490 shutdown_connections 2024-02-19T19:10:13.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.686+0000 7fbd89abd700 1 --2- 172.21.15.46:0/1694854490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd84100d70 0x7fbd84104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.686+0000 7fbd89abd700 1 --2- 172.21.15.46:0/1694854490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd841003d0 0x7fbd841007a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.686+0000 7fbd89abd700 1 -- 172.21.15.46:0/1694854490 >> 172.21.15.46:0/1694854490 conn(0x7fbd840fbcb0 msgr2=0x7fbd840fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:13.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.686+0000 7fbd89abd700 1 -- 172.21.15.46:0/1694854490 shutdown_connections 2024-02-19T19:10:13.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.686+0000 7fbd89abd700 1 -- 172.21.15.46:0/1694854490 wait complete. 2024-02-19T19:10:13.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.686+0000 7fbd89abd700 1 Processor -- start 2024-02-19T19:10:13.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd89abd700 1 -- start start 2024-02-19T19:10:13.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd89abd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd841003d0 0x7fbd84195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:13.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd89abd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd84100d70 0x7fbd84196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd89abd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84196a50 con 0x7fbd841003d0 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd89abd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8419a7e0 con 0x7fbd84100d70 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd837fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd841003d0 0x7fbd84195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd837fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd841003d0 0x7fbd84195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34552/0 (socket says 172.21.15.46:34552) 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd837fe700 1 -- 172.21.15.46:0/932212988 learned_addr learned my addr 172.21.15.46:0/932212988 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd82ffd700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd84100d70 0x7fbd84196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd837fe700 1 -- 172.21.15.46:0/932212988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd84100d70 msgr2=0x7fbd84196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd837fe700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd84100d70 0x7fbd84196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.687+0000 7fbd837fe700 1 -- 172.21.15.46:0/932212988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd740095f0 con 0x7fbd841003d0 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.688+0000 7fbd837fe700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd841003d0 0x7fbd84195e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd74006010 tx=0x7fbd7400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.688+0000 7fbd80ff9700 1 -- 172.21.15.46:0/932212988 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd7401d070 con 0x7fbd841003d0 2024-02-19T19:10:13.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.688+0000 7fbd89abd700 1 -- 172.21.15.46:0/932212988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8419aa60 con 0x7fbd841003d0 2024-02-19T19:10:13.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.688+0000 7fbd80ff9700 1 -- 172.21.15.46:0/932212988 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd7400f460 con 0x7fbd841003d0 2024-02-19T19:10:13.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.688+0000 7fbd80ff9700 1 -- 172.21.15.46:0/932212988 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd74017630 con 0x7fbd841003d0 2024-02-19T19:10:13.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.688+0000 7fbd89abd700 1 -- 172.21.15.46:0/932212988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8419af50 con 0x7fbd841003d0 2024-02-19T19:10:13.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.689+0000 7fbd89abd700 1 -- 172.21.15.46:0/932212988 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd841087f0 con 0x7fbd841003d0 2024-02-19T19:10:13.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.689+0000 7fbd80ff9700 1 -- 172.21.15.46:0/932212988 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fbd7400f5d0 con 0x7fbd841003d0 2024-02-19T19:10:13.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.690+0000 7fbd80ff9700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbd6c06d8a0 0x7fbd6c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:13.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.690+0000 7fbd82ffd700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbd6c06d8a0 0x7fbd6c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:13.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.690+0000 7fbd80ff9700 1 -- 172.21.15.46:0/932212988 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6683+0+0 (secure 0 0 0) 0x7fbd7408ea60 con 0x7fbd841003d0 2024-02-19T19:10:13.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.690+0000 7fbd82ffd700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbd6c06d8a0 0x7fbd6c06fd50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd78005950 tx=0x7fbd780058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:13.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.695+0000 7fbd80ff9700 1 -- 172.21.15.46:0/932212988 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbd740581b0 con 0x7fbd841003d0 2024-02-19T19:10:13.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.923+0000 7fbd89abd700 1 -- 172.21.15.46:0/932212988 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd8419b230 con 0x7fbd6c06d8a0 2024-02-19T19:10:13.945 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:13 smithi046 ceph-mon[88928]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:13.945 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:13.945 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:13 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/537748683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:13.945 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:13 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2787506808' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:10:13.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.924+0000 7fbd80ff9700 1 -- 172.21.15.46:0/932212988 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fbd8419b230 con 0x7fbd6c06d8a0 2024-02-19T19:10:13.946 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:10:13.946 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:10:13.946 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:10:13.946 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:10:13.946 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:10:13.946 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:10:13.946 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-02-19T19:10:13.946 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:10:13.947 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:10:13.947 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "11/23 daemons upgraded", 2024-02-19T19:10:13.947 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:10:13.947 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:10:13.947 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:10:13.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 -- 172.21.15.46:0/932212988 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbd6c06d8a0 msgr2=0x7fbd6c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:13.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbd6c06d8a0 0x7fbd6c06fd50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd78005950 tx=0x7fbd780058e0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 -- 172.21.15.46:0/932212988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd841003d0 msgr2=0x7fbd84195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:13.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd841003d0 0x7fbd84195e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd74006010 tx=0x7fbd7400be20 comp rx=0 tx=0).stop 2024-02-19T19:10:13.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 -- 172.21.15.46:0/932212988 shutdown_connections 2024-02-19T19:10:13.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbd6c06d8a0 0x7fbd6c06fd50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd841003d0 0x7fbd84195e30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 --2- 172.21.15.46:0/932212988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd84100d70 0x7fbd84196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:13.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 -- 172.21.15.46:0/932212988 >> 172.21.15.46:0/932212988 conn(0x7fbd840fbcb0 msgr2=0x7fbd840fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:13.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 -- 172.21.15.46:0/932212988 shutdown_connections 2024-02-19T19:10:13.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:13.927+0000 7fbd89abd700 1 -- 172.21.15.46:0/932212988 wait complete. 2024-02-19T19:10:14.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.033+0000 7f60241fd700 1 -- 172.21.15.46:0/3670220830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f601c100e80 msgr2=0x7f601c104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.033+0000 7f60241fd700 1 --2- 172.21.15.46:0/3670220830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f601c100e80 0x7f601c104e50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f600c009910 tx=0x7f600c009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.033+0000 7f60241fd700 1 -- 172.21.15.46:0/3670220830 shutdown_connections 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.033+0000 7f60241fd700 1 --2- 172.21.15.46:0/3670220830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f601c100e80 0x7f601c104e50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.033+0000 7f60241fd700 1 --2- 172.21.15.46:0/3670220830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f601c1004e0 0x7f601c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.033+0000 7f60241fd700 1 -- 172.21.15.46:0/3670220830 >> 172.21.15.46:0/3670220830 conn(0x7f601c0fbda0 msgr2=0x7f601c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.033+0000 7f60241fd700 1 -- 172.21.15.46:0/3670220830 shutdown_connections 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.033+0000 7f60241fd700 1 -- 172.21.15.46:0/3670220830 wait complete. 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f60241fd700 1 Processor -- start 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f60241fd700 1 -- start start 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f60241fd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f601c1004e0 0x7f601c195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f60241fd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f601c100e80 0x7f601c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:14.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f60241fd700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c196b30 con 0x7f601c1004e0 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f60241fd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c19a8c0 con 0x7f601c100e80 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f6021f99700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f601c1004e0 0x7f601c195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f6021f99700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f601c1004e0 0x7f601c195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34578/0 (socket says 172.21.15.46:34578) 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f6021f99700 1 -- 172.21.15.46:0/3724229918 learned_addr learned my addr 172.21.15.46:0/3724229918 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f6021f99700 1 -- 172.21.15.46:0/3724229918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f601c100e80 msgr2=0x7f601c196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f6021f99700 1 --2- 172.21.15.46:0/3724229918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f601c100e80 0x7f601c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.034+0000 7f6021f99700 1 -- 172.21.15.46:0/3724229918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0095f0 con 0x7f601c1004e0 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.035+0000 7f6021f99700 1 --2- 172.21.15.46:0/3724229918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f601c1004e0 0x7f601c195f10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f601800c8a0 tx=0x7f601800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.035+0000 7f6012ffd700 1 -- 172.21.15.46:0/3724229918 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f601800cea0 con 0x7f601c1004e0 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.035+0000 7f6012ffd700 1 -- 172.21.15.46:0/3724229918 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6018004830 con 0x7f601c1004e0 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.035+0000 7f60241fd700 1 -- 172.21.15.46:0/3724229918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c19aba0 con 0x7f601c1004e0 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.035+0000 7f6012ffd700 1 -- 172.21.15.46:0/3724229918 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60180055b0 con 0x7f601c1004e0 2024-02-19T19:10:14.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.035+0000 7f60241fd700 1 -- 172.21.15.46:0/3724229918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c19b0f0 con 0x7f601c1004e0 2024-02-19T19:10:14.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.036+0000 7f60241fd700 1 -- 172.21.15.46:0/3724229918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601c108850 con 0x7f601c1004e0 2024-02-19T19:10:14.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.036+0000 7f6012ffd700 1 -- 172.21.15.46:0/3724229918 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f60180049a0 con 0x7f601c1004e0 2024-02-19T19:10:14.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.037+0000 7f6012ffd700 1 --2- 172.21.15.46:0/3724229918 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f600806d8a0 0x7f600806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:14.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.037+0000 7f6012ffd700 1 -- 172.21.15.46:0/3724229918 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6683+0+0 (secure 0 0 0) 0x7f601808d160 con 0x7f601c1004e0 2024-02-19T19:10:14.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.037+0000 7f6021798700 1 --2- 172.21.15.46:0/3724229918 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f600806d8a0 0x7f600806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:14.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.037+0000 7f6021798700 1 --2- 172.21.15.46:0/3724229918 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f600806d8a0 0x7f600806fd50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f600c006010 tx=0x7f600c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:14.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.041+0000 7f6012ffd700 1 -- 172.21.15.46:0/3724229918 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6018056930 con 0x7f601c1004e0 2024-02-19T19:10:14.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:13 smithi142 ceph-mon[69118]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:14.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:14.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:13 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/537748683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:14.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:13 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2787506808' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:10:14.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.333+0000 7f60241fd700 1 -- 172.21.15.46:0/3724229918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f601c197370 con 0x7f601c1004e0 2024-02-19T19:10:14.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.334+0000 7f6012ffd700 1 -- 172.21.15.46:0/3724229918 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f601801d020 con 0x7f601c1004e0 2024-02-19T19:10:14.356 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_OK 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 -- 172.21.15.46:0/3724229918 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f600806d8a0 msgr2=0x7f600806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 --2- 172.21.15.46:0/3724229918 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f600806d8a0 0x7f600806fd50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f600c006010 tx=0x7f600c00b540 comp rx=0 tx=0).stop 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 -- 172.21.15.46:0/3724229918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f601c1004e0 msgr2=0x7f601c195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 --2- 172.21.15.46:0/3724229918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f601c1004e0 0x7f601c195f10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f601800c8a0 tx=0x7f601800cc60 comp rx=0 tx=0).stop 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 -- 172.21.15.46:0/3724229918 shutdown_connections 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 --2- 172.21.15.46:0/3724229918 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f600806d8a0 0x7f600806fd50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 --2- 172.21.15.46:0/3724229918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f601c1004e0 0x7f601c195f10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 --2- 172.21.15.46:0/3724229918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f601c100e80 0x7f601c196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 -- 172.21.15.46:0/3724229918 >> 172.21.15.46:0/3724229918 conn(0x7f601c0fbda0 msgr2=0x7f601c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 -- 172.21.15.46:0/3724229918 shutdown_connections 2024-02-19T19:10:14.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:14.336+0000 7f60241fd700 1 -- 172.21.15.46:0/3724229918 wait complete. 2024-02-19T19:10:15.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:14 smithi046 ceph-mon[88928]: pgmap v206: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 94 B/s, 0 objects/s recovering 2024-02-19T19:10:15.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:14 smithi046 ceph-mon[88928]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:15.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:14 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3724229918' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:10:15.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:14 smithi142 ceph-mon[69118]: pgmap v206: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 94 B/s, 0 objects/s recovering 2024-02-19T19:10:15.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:14 smithi142 ceph-mon[69118]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:15.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:14 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3724229918' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:10:17.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:16 smithi046 ceph-mon[88928]: pgmap v207: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 94 B/s, 0 objects/s recovering 2024-02-19T19:10:17.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:10:17.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:16 smithi046 ceph-mon[88928]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:10:17.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:16 smithi046 ceph-mon[88928]: Upgrade: osd.5 is safe to restart 2024-02-19T19:10:17.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:16 smithi142 ceph-mon[69118]: pgmap v207: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 94 B/s, 0 objects/s recovering 2024-02-19T19:10:17.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:10:17.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:16 smithi142 ceph-mon[69118]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:10:17.091 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:16 smithi142 ceph-mon[69118]: Upgrade: osd.5 is safe to restart 2024-02-19T19:10:18.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:18 smithi142 ceph-mon[69118]: pgmap v208: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:18.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:18 smithi142 ceph-mon[69118]: Upgrade: Updating osd.5 2024-02-19T19:10:18.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:18 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:18.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:18 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T19:10:18.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:18 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:18.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:18 smithi142 ceph-mon[69118]: Deploying daemon osd.5 on smithi142 2024-02-19T19:10:19.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:18 smithi046 ceph-mon[88928]: pgmap v208: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:19.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:18 smithi046 ceph-mon[88928]: Upgrade: Updating osd.5 2024-02-19T19:10:19.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:18 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:19.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:18 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T19:10:19.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:18 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:19.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:18 smithi046 ceph-mon[88928]: Deploying daemon osd.5 on smithi142 2024-02-19T19:10:20.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:20 smithi142 ceph-mon[69118]: pgmap v209: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:21.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:20 smithi046 ceph-mon[88928]: pgmap v209: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:21.287 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:20 smithi142 systemd[1]: Stopping Ceph osd.5 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:10:21.288 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:21 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[52488]: 2024-02-19T19:10:21.232+0000 7f046df0c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:10:21.288 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:21 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[52488]: 2024-02-19T19:10:21.232+0000 7f046df0c700 -1 osd.5 109 *** Got signal Terminated *** 2024-02-19T19:10:21.288 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:21 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[52488]: 2024-02-19T19:10:21.232+0000 7f046df0c700 -1 osd.5 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:10:22.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:21 smithi046 ceph-mon[88928]: osd.5 marked itself down and dead 2024-02-19T19:10:22.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:21 smithi142 ceph-mon[69118]: osd.5 marked itself down and dead 2024-02-19T19:10:22.603 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:22 smithi142 podman[88954]: 2024-02-19 19:10:22.27754973 +0000 UTC m=+1.141531188 container died 77516bfca468e4b51de5761da12429a8fefde7a54f1313f9f866562c339ba973 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, ceph=True) 2024-02-19T19:10:22.603 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:22 smithi142 podman[88954]: 2024-02-19 19:10:22.582476901 +0000 UTC m=+1.446458375 container cleanup 77516bfca468e4b51de5761da12429a8fefde7a54f1313f9f866562c339ba973 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-19T19:10:22.952 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:22 smithi142 bash[88954]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5 2024-02-19T19:10:22.952 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:22 smithi142 podman[88972]: 2024-02-19 19:10:22.808801726 +0000 UTC m=+0.523837334 container remove 77516bfca468e4b51de5761da12429a8fefde7a54f1313f9f866562c339ba973 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:10:22.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:22 smithi142 ceph-mon[69118]: pgmap v210: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:22.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:22 smithi142 ceph-mon[69118]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:10:22.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:22 smithi142 ceph-mon[69118]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-19T19:10:22.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:22 smithi142 ceph-mon[69118]: osdmap e110: 6 total, 5 up, 6 in 2024-02-19T19:10:23.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:22 smithi046 ceph-mon[88928]: pgmap v210: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:23.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:22 smithi046 ceph-mon[88928]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:10:23.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:22 smithi046 ceph-mon[88928]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-19T19:10:23.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:22 smithi046 ceph-mon[88928]: osdmap e110: 6 total, 5 up, 6 in 2024-02-19T19:10:23.383 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:23 smithi142 podman[89066]: 2024-02-19 19:10:23.012695764 +0000 UTC m=+0.018597211 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:10:23.384 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:23 smithi142 podman[89066]: 2024-02-19 19:10:23.11785429 +0000 UTC m=+0.123755731 container create 9d15f29ffb5e22f48280a3dd776d04598264da7060c55d07268c35c23f5a5153 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-02-19T19:10:23.672 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:23 smithi142 podman[89066]: 2024-02-19 19:10:23.362223503 +0000 UTC m=+0.368124955 container init 9d15f29ffb5e22f48280a3dd776d04598264da7060c55d07268c35c23f5a5153 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-19T19:10:23.672 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:23 smithi142 podman[89066]: 2024-02-19 19:10:23.365957459 +0000 UTC m=+0.371858902 container start 9d15f29ffb5e22f48280a3dd776d04598264da7060c55d07268c35c23f5a5153 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:10:23.672 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:23 smithi142 podman[89066]: 2024-02-19 19:10:23.461807748 +0000 UTC m=+0.467709190 container attach 9d15f29ffb5e22f48280a3dd776d04598264da7060c55d07268c35c23f5a5153 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-02-19T19:10:23.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:23 smithi142 ceph-mon[69118]: osdmap e111: 6 total, 5 up, 6 in 2024-02-19T19:10:23.953 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:23 smithi142 podman[89066]: 2024-02-19 19:10:23.651083323 +0000 UTC m=+0.656984775 container died 9d15f29ffb5e22f48280a3dd776d04598264da7060c55d07268c35c23f5a5153 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-19T19:10:24.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:23 smithi046 ceph-mon[88928]: osdmap e111: 6 total, 5 up, 6 in 2024-02-19T19:10:24.703 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:24 smithi142 podman[89092]: 2024-02-19 19:10:24.3154674 +0000 UTC m=+0.658834374 container remove 9d15f29ffb5e22f48280a3dd776d04598264da7060c55d07268c35c23f5a5153 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-19T19:10:24.703 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:24 smithi142 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-19T19:10:24.703 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:24 smithi142 systemd[1]: Stopped Ceph osd.5 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:10:24.703 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:24 smithi142 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.5.service: Consumed 1min 3.626s CPU time. 2024-02-19T19:10:24.703 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:24 smithi142 systemd[1]: Starting Ceph osd.5 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T19:10:25.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:24 smithi142 ceph-mon[69118]: pgmap v213: 65 pgs: 6 active+undersized, 4 active+undersized+degraded, 7 stale+active+clean, 48 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 10/351 objects degraded (2.849%) 2024-02-19T19:10:25.019 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:24 smithi142 ceph-mon[69118]: Health check failed: Degraded data redundancy: 10/351 objects degraded (2.849%), 4 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:25.019 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:24 smithi142 podman[89192]: 2024-02-19 19:10:24.648496227 +0000 UTC m=+0.018289118 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:10:25.019 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:24 smithi142 podman[89192]: 2024-02-19 19:10:24.750154834 +0000 UTC m=+0.119947762 container create 4f1cd4b81ce62f7a0ea8b1c54a408de0c209465b6c65f722372d2195d463dbc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-19T19:10:25.019 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:24 smithi142 podman[89192]: 2024-02-19 19:10:24.994390185 +0000 UTC m=+0.364183072 container init 4f1cd4b81ce62f7a0ea8b1c54a408de0c209465b6c65f722372d2195d463dbc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:10:25.019 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:24 smithi142 podman[89192]: 2024-02-19 19:10:24.997994963 +0000 UTC m=+0.367787846 container start 4f1cd4b81ce62f7a0ea8b1c54a408de0c209465b6c65f722372d2195d463dbc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-19T19:10:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:24 smithi046 ceph-mon[88928]: pgmap v213: 65 pgs: 6 active+undersized, 4 active+undersized+degraded, 7 stale+active+clean, 48 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 10/351 objects degraded (2.849%) 2024-02-19T19:10:25.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:24 smithi046 ceph-mon[88928]: Health check failed: Degraded data redundancy: 10/351 objects degraded (2.849%), 4 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:25.452 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 podman[89192]: 2024-02-19 19:10:25.094138322 +0000 UTC m=+0.463931215 container attach 4f1cd4b81ce62f7a0ea8b1c54a408de0c209465b6c65f722372d2195d463dbc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-19T19:10:25.760 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate[89206]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-19T19:10:25.760 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate[89206]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-19T19:10:25.760 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 bash[89192]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 bash[89192]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 bash[89192]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 bash[89192]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 bash[89192]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 bash[89192]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 bash[89192]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate[89206]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate[89206]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate[89206]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate[89206]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate[89206]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-19T19:10:25.761 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:25 smithi142 podman[89192]: 2024-02-19 19:10:25.465022771 +0000 UTC m=+0.834815672 container died 4f1cd4b81ce62f7a0ea8b1c54a408de0c209465b6c65f722372d2195d463dbc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-02-19T19:10:26.396 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:26 smithi142 podman[89338]: 2024-02-19 19:10:26.031338179 +0000 UTC m=+0.561032439 container remove 4f1cd4b81ce62f7a0ea8b1c54a408de0c209465b6c65f722372d2195d463dbc3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-02-19T19:10:26.396 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:26 smithi142 podman[89402]: 2024-02-19 19:10:26.150391864 +0000 UTC m=+0.018651195 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:10:26.396 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:26 smithi142 podman[89402]: 2024-02-19 19:10:26.24855391 +0000 UTC m=+0.116813251 container create 510ea3b4a23b3ffadd54a39f34f0e81ee0d6f87b1ee36e6cd8314a2b296c3d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:10:26.802 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:26 smithi142 podman[89402]: 2024-02-19 19:10:26.467502273 +0000 UTC m=+0.335761604 container init 510ea3b4a23b3ffadd54a39f34f0e81ee0d6f87b1ee36e6cd8314a2b296c3d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=) 2024-02-19T19:10:26.802 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:26 smithi142 podman[89402]: 2024-02-19 19:10:26.470393219 +0000 UTC m=+0.338652551 container start 510ea3b4a23b3ffadd54a39f34f0e81ee0d6f87b1ee36e6cd8314a2b296c3d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True) 2024-02-19T19:10:26.802 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:26 smithi142 bash[89402]: 510ea3b4a23b3ffadd54a39f34f0e81ee0d6f87b1ee36e6cd8314a2b296c3d39 2024-02-19T19:10:26.802 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:26 smithi142 systemd[1]: Started Ceph osd.5 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T19:10:27.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:26 smithi046 ceph-mon[88928]: pgmap v214: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/351 objects degraded (16.239%) 2024-02-19T19:10:27.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:27.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:27.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:27.202 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:27 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T19:10:27.021+0000 7f4da61f77c0 -1 Falling back to public interface 2024-02-19T19:10:27.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:26 smithi142 ceph-mon[69118]: pgmap v214: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/351 objects degraded (16.239%) 2024-02-19T19:10:27.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:27.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:27.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:29.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:28 smithi046 ceph-mon[88928]: pgmap v215: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/351 objects degraded (16.239%) 2024-02-19T19:10:29.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:29.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:29.120 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:28 smithi142 ceph-mon[69118]: pgmap v215: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/351 objects degraded (16.239%) 2024-02-19T19:10:29.120 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:29.121 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:30.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:29 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 57/351 objects degraded (16.239%), 15 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:30.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:30.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:29 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 57/351 objects degraded (16.239%), 15 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:30.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:31.050 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:30 smithi046 ceph-mon[88928]: pgmap v216: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/351 objects degraded (16.239%) 2024-02-19T19:10:31.050 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:30 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:31.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:30 smithi142 ceph-mon[69118]: pgmap v216: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/351 objects degraded (16.239%) 2024-02-19T19:10:31.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:30 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:31.777 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:31 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T19:10:31.488+0000 7f4da61f77c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-19T19:10:32.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:32.134 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:32.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:32.202 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:32.202 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:31 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T19:10:31.911+0000 7f4da61f77c0 -1 osd.5 109 log_to_monitors true 2024-02-19T19:10:32.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:32 smithi142 ceph-mon[69118]: pgmap v217: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/351 objects degraded (16.239%) 2024-02-19T19:10:32.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:32 smithi142 ceph-mon[69118]: from='osd.5 [v2:172.21.15.142:6816/1673341131,v1:172.21.15.142:6817/1673341131]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:10:32.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:32 smithi142 ceph-mon[69118]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:10:33.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:32 smithi046 ceph-mon[88928]: pgmap v217: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 57/351 objects degraded (16.239%) 2024-02-19T19:10:33.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:32 smithi046 ceph-mon[88928]: from='osd.5 [v2:172.21.15.142:6816/1673341131,v1:172.21.15.142:6817/1673341131]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:10:33.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:32 smithi046 ceph-mon[88928]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:10:33.952 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 19:10:33 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T19:10:33.699+0000 7f4d93647700 -1 osd.5 109 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:10:33.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:33 smithi142 ceph-mon[69118]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T19:10:33.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:33 smithi142 ceph-mon[69118]: osdmap e112: 6 total, 5 up, 6 in 2024-02-19T19:10:33.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:33 smithi142 ceph-mon[69118]: from='osd.5 [v2:172.21.15.142:6816/1673341131,v1:172.21.15.142:6817/1673341131]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:10:33.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:33 smithi142 ceph-mon[69118]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:10:33.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:33 smithi142 ceph-mon[69118]: from='osd.5 ' entity='osd.5' 2024-02-19T19:10:34.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:33 smithi046 ceph-mon[88928]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T19:10:34.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:33 smithi046 ceph-mon[88928]: osdmap e112: 6 total, 5 up, 6 in 2024-02-19T19:10:34.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:33 smithi046 ceph-mon[88928]: from='osd.5 [v2:172.21.15.142:6816/1673341131,v1:172.21.15.142:6817/1673341131]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:10:34.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:33 smithi046 ceph-mon[88928]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-02-19T19:10:34.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:33 smithi046 ceph-mon[88928]: from='osd.5 ' entity='osd.5' 2024-02-19T19:10:35.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:34 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046[88924]: 2024-02-19T19:10:34.708+0000 7ff54c774700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T19:10:35.638 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: pgmap v219: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 57/351 objects degraded (16.239%) 2024-02-19T19:10:35.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:35.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:35.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:35.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:10:35.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:35.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:35.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:35.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:35.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:35.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: Upgrade: Setting container_image for all osd 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-19T19:10:35.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: Upgrade: Setting require_osd_release to 19 squid 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: osd.5 [v2:172.21.15.142:6816/1673341131,v1:172.21.15.142:6817/1673341131] boot 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: osdmap e113: 6 total, 6 up, 6 in 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: osdmap e114: 6 total, 6 up, 6 in 2024-02-19T19:10:35.641 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:35 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-19T19:10:35.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: pgmap v219: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 57/351 objects degraded (16.239%) 2024-02-19T19:10:35.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:35.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:35.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: Upgrade: Setting container_image for all osd 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-19T19:10:35.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: Upgrade: Setting require_osd_release to 19 squid 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: osd.5 [v2:172.21.15.142:6816/1673341131,v1:172.21.15.142:6817/1673341131] boot 2024-02-19T19:10:35.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: osdmap e113: 6 total, 6 up, 6 in 2024-02-19T19:10:35.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:10:35.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-19T19:10:35.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-19T19:10:35.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T19:10:35.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-19T19:10:35.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: osdmap e114: 6 total, 6 up, 6 in 2024-02-19T19:10:35.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:35 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-19T19:10:36.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:36 smithi142 ceph-mon[69118]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-19T19:10:36.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:36 smithi142 ceph-mon[69118]: osdmap e115: 6 total, 6 up, 6 in 2024-02-19T19:10:36.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:36 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6828/214941826,v1:172.21.15.46:6829/214941826] up:boot 2024-02-19T19:10:36.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:36 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.142:6824/3279846196,v1:172.21.15.142:6825/3279846196] up:boot 2024-02-19T19:10:36.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:36 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:10:36.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:36 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:10:36.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:36 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:10:36.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:36 smithi046 ceph-mon[88928]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-19T19:10:36.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:36 smithi046 ceph-mon[88928]: osdmap e115: 6 total, 6 up, 6 in 2024-02-19T19:10:36.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:36 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6828/214941826,v1:172.21.15.46:6829/214941826] up:boot 2024-02-19T19:10:36.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:36 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.142:6824/3279846196,v1:172.21.15.142:6825/3279846196] up:boot 2024-02-19T19:10:36.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:36 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:10:36.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:36 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:10:36.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:36 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:10:37.774 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:37 smithi046 ceph-mon[88928]: pgmap v223: 65 pgs: 10 active+undersized, 9 active+undersized+degraded, 46 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27/351 objects degraded (7.692%) 2024-02-19T19:10:37.774 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:37 smithi046 ceph-mon[88928]: Upgrade: Updating mds.cephfs.smithi046.hrbbel 2024-02-19T19:10:37.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:37.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hrbbel", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:10:37.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:37.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:37 smithi046 ceph-mon[88928]: Deploying daemon mds.cephfs.smithi046.hrbbel on smithi046 2024-02-19T19:10:37.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:37 smithi046 ceph-mon[88928]: Health check update: Degraded data redundancy: 27/351 objects degraded (7.692%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:37.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:37 smithi142 ceph-mon[69118]: pgmap v223: 65 pgs: 10 active+undersized, 9 active+undersized+degraded, 46 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27/351 objects degraded (7.692%) 2024-02-19T19:10:37.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:37 smithi142 ceph-mon[69118]: Upgrade: Updating mds.cephfs.smithi046.hrbbel 2024-02-19T19:10:37.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:37.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hrbbel", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:10:37.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:37.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:37 smithi142 ceph-mon[69118]: Deploying daemon mds.cephfs.smithi046.hrbbel on smithi046 2024-02-19T19:10:37.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:37 smithi142 ceph-mon[69118]: Health check update: Degraded data redundancy: 27/351 objects degraded (7.692%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:39.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:39 smithi046 ceph-mon[88928]: pgmap v224: 65 pgs: 10 active+undersized, 9 active+undersized+degraded, 46 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27/351 objects degraded (7.692%) 2024-02-19T19:10:39.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:39 smithi142 ceph-mon[69118]: pgmap v224: 65 pgs: 10 active+undersized, 9 active+undersized+degraded, 46 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27/351 objects degraded (7.692%) 2024-02-19T19:10:40.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:40 smithi046 ceph-mon[88928]: osdmap e116: 6 total, 6 up, 6 in 2024-02-19T19:10:40.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:40 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:10:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:40 smithi142 ceph-mon[69118]: osdmap e116: 6 total, 6 up, 6 in 2024-02-19T19:10:40.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:40 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:10:41.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:41 smithi046 ceph-mon[88928]: pgmap v226: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:41.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:41 smithi046 ceph-mon[88928]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/351 objects degraded (7.692%), 9 pgs degraded) 2024-02-19T19:10:41.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:41 smithi142 ceph-mon[69118]: pgmap v226: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:41.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:41 smithi142 ceph-mon[69118]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/351 objects degraded (7.692%), 9 pgs degraded) 2024-02-19T19:10:43.785 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:43 smithi046 ceph-mon[88928]: pgmap v227: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:43.785 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:43.785 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:43.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:43 smithi142 ceph-mon[69118]: pgmap v227: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:43.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:43.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.451+0000 7fb4904ea700 1 -- 172.21.15.46:0/3703790888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4880ff3c0 msgr2=0x7fb4880ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.451+0000 7fb4904ea700 1 --2- 172.21.15.46:0/3703790888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4880ff3c0 0x7fb4880ff790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb484009910 tx=0x7fb484009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.452+0000 7fb4904ea700 1 -- 172.21.15.46:0/3703790888 shutdown_connections 2024-02-19T19:10:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.452+0000 7fb4904ea700 1 --2- 172.21.15.46:0/3703790888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4880ffd60 0x7fb488103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.452+0000 7fb4904ea700 1 --2- 172.21.15.46:0/3703790888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4880ff3c0 0x7fb4880ff790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.452+0000 7fb4904ea700 1 -- 172.21.15.46:0/3703790888 >> 172.21.15.46:0/3703790888 conn(0x7fb4880fac80 msgr2=0x7fb4880fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:44.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.452+0000 7fb4904ea700 1 -- 172.21.15.46:0/3703790888 shutdown_connections 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.452+0000 7fb4904ea700 1 -- 172.21.15.46:0/3703790888 wait complete. 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.452+0000 7fb4904ea700 1 Processor -- start 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.452+0000 7fb4904ea700 1 -- start start 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb4904ea700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4880ff3c0 0x7fb4881980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb4904ea700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4880ffd60 0x7fb488198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb4904ea700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb488198ce0 con 0x7fb4880ff3c0 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb4904ea700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48819ca70 con 0x7fb4880ffd60 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb48e286700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4880ff3c0 0x7fb4881980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb48e286700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4880ff3c0 0x7fb4881980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40036/0 (socket says 172.21.15.46:40036) 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb48e286700 1 -- 172.21.15.46:0/2154897320 learned_addr learned my addr 172.21.15.46:0/2154897320 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb48da85700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4880ffd60 0x7fb488198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:44.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb48e286700 1 -- 172.21.15.46:0/2154897320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4880ffd60 msgr2=0x7fb488198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb48e286700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4880ffd60 0x7fb488198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.453+0000 7fb48e286700 1 -- 172.21.15.46:0/2154897320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840095f0 con 0x7fb4880ff3c0 2024-02-19T19:10:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.454+0000 7fb48e286700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4880ff3c0 0x7fb4881980c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb484005f50 tx=0x7fb48400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.454+0000 7fb47f7fe700 1 -- 172.21.15.46:0/2154897320 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48401d070 con 0x7fb4880ff3c0 2024-02-19T19:10:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.454+0000 7fb47f7fe700 1 -- 172.21.15.46:0/2154897320 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb48400b610 con 0x7fb4880ff3c0 2024-02-19T19:10:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.454+0000 7fb4904ea700 1 -- 172.21.15.46:0/2154897320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48819ccf0 con 0x7fb4880ff3c0 2024-02-19T19:10:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.454+0000 7fb47f7fe700 1 -- 172.21.15.46:0/2154897320 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb484022470 con 0x7fb4880ff3c0 2024-02-19T19:10:44.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.454+0000 7fb4904ea700 1 -- 172.21.15.46:0/2154897320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48819d1e0 con 0x7fb4880ff3c0 2024-02-19T19:10:44.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.455+0000 7fb4904ea700 1 -- 172.21.15.46:0/2154897320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48804f2a0 con 0x7fb4880ff3c0 2024-02-19T19:10:44.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.456+0000 7fb47f7fe700 1 -- 172.21.15.46:0/2154897320 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb48400fca0 con 0x7fb4880ff3c0 2024-02-19T19:10:44.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.456+0000 7fb47f7fe700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47406d8a0 0x7fb47406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:44.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.456+0000 7fb47f7fe700 1 -- 172.21.15.46:0/2154897320 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fb48408e9b0 con 0x7fb4880ff3c0 2024-02-19T19:10:44.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.456+0000 7fb48da85700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47406d8a0 0x7fb47406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:44.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.457+0000 7fb48da85700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47406d8a0 0x7fb47406fd50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4881996e0 tx=0x7fb478009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:44.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.461+0000 7fb47f7fe700 1 -- 172.21.15.46:0/2154897320 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb4840580d0 con 0x7fb4880ff3c0 2024-02-19T19:10:44.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.712+0000 7fb4904ea700 1 -- 172.21.15.46:0/2154897320 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb48819d5c0 con 0x7fb47406d8a0 2024-02-19T19:10:44.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.713+0000 7fb47f7fe700 1 -- 172.21.15.46:0/2154897320 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb48819d5c0 con 0x7fb47406d8a0 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 -- 172.21.15.46:0/2154897320 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47406d8a0 msgr2=0x7fb47406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47406d8a0 0x7fb47406fd50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4881996e0 tx=0x7fb478009260 comp rx=0 tx=0).stop 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 -- 172.21.15.46:0/2154897320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4880ff3c0 msgr2=0x7fb4881980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4880ff3c0 0x7fb4881980c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb484005f50 tx=0x7fb48400f740 comp rx=0 tx=0).stop 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 -- 172.21.15.46:0/2154897320 shutdown_connections 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb47406d8a0 0x7fb47406fd50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4880ff3c0 0x7fb4881980c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 --2- 172.21.15.46:0/2154897320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4880ffd60 0x7fb488198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 -- 172.21.15.46:0/2154897320 >> 172.21.15.46:0/2154897320 conn(0x7fb4880fac80 msgr2=0x7fb4880696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 -- 172.21.15.46:0/2154897320 shutdown_connections 2024-02-19T19:10:44.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.716+0000 7fb4904ea700 1 -- 172.21.15.46:0/2154897320 wait complete. 2024-02-19T19:10:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:10:44.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.824+0000 7fecdf22a700 1 -- 172.21.15.46:0/1310456926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd80ff350 msgr2=0x7fecd80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:44.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.824+0000 7fecdf22a700 1 --2- 172.21.15.46:0/1310456926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd80ff350 0x7fecd80ff720 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feccc009910 tx=0x7feccc009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:44.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.824+0000 7fecdf22a700 1 -- 172.21.15.46:0/1310456926 shutdown_connections 2024-02-19T19:10:44.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.824+0000 7fecdf22a700 1 --2- 172.21.15.46:0/1310456926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80ffc60 0x7fecd810a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:44.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.824+0000 7fecdf22a700 1 --2- 172.21.15.46:0/1310456926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd80ff350 0x7fecd80ff720 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:44.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.824+0000 7fecdf22a700 1 -- 172.21.15.46:0/1310456926 >> 172.21.15.46:0/1310456926 conn(0x7fecd80748b0 msgr2=0x7fecd8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:44.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.824+0000 7fecdf22a700 1 -- 172.21.15.46:0/1310456926 shutdown_connections 2024-02-19T19:10:44.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.824+0000 7fecdf22a700 1 -- 172.21.15.46:0/1310456926 wait complete. 2024-02-19T19:10:44.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.825+0000 7fecdf22a700 1 Processor -- start 2024-02-19T19:10:44.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.825+0000 7fecdf22a700 1 -- start start 2024-02-19T19:10:44.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecdf22a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80ff350 0x7fecd8195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:44.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecdf22a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd80ffc60 0x7fecd8196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:44.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecdf22a700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd8196b30 con 0x7fecd80ffc60 2024-02-19T19:10:44.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecdf22a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd819a8c0 con 0x7fecd80ff350 2024-02-19T19:10:44.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecd7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd80ffc60 0x7fecd8196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:44.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecd7fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd80ffc60 0x7fecd8196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40060/0 (socket says 172.21.15.46:40060) 2024-02-19T19:10:44.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecd7fff700 1 -- 172.21.15.46:0/605015244 learned_addr learned my addr 172.21.15.46:0/605015244 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecdcfc6700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80ff350 0x7fecd8195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecd7fff700 1 -- 172.21.15.46:0/605015244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80ff350 msgr2=0x7fecd8195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecd7fff700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80ff350 0x7fecd8195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecd7fff700 1 -- 172.21.15.46:0/605015244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc0095f0 con 0x7fecd80ffc60 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecd7fff700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd80ffc60 0x7fecd8196450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fecc400d900 tx=0x7fecc400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.826+0000 7fecd5ffb700 1 -- 172.21.15.46:0/605015244 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecc40041f0 con 0x7fecd80ffc60 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.827+0000 7fecd5ffb700 1 -- 172.21.15.46:0/605015244 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fecc4004cf0 con 0x7fecd80ffc60 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.827+0000 7fecdf22a700 1 -- 172.21.15.46:0/605015244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd819aba0 con 0x7fecd80ffc60 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.827+0000 7fecd5ffb700 1 -- 172.21.15.46:0/605015244 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecc400b750 con 0x7fecd80ffc60 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.827+0000 7fecdf22a700 1 -- 172.21.15.46:0/605015244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd819b0f0 con 0x7fecd80ffc60 2024-02-19T19:10:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.828+0000 7fecdf22a700 1 -- 172.21.15.46:0/605015244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd8107dd0 con 0x7fecd80ffc60 2024-02-19T19:10:44.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.828+0000 7fecd5ffb700 1 -- 172.21.15.46:0/605015244 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fecc4004830 con 0x7fecd80ffc60 2024-02-19T19:10:44.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.829+0000 7fecd5ffb700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fecc806d8a0 0x7fecc806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:44.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.829+0000 7fecd5ffb700 1 -- 172.21.15.46:0/605015244 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fecc408d480 con 0x7fecd80ffc60 2024-02-19T19:10:44.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.829+0000 7fecdcfc6700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fecc806d8a0 0x7fecc806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:44.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.829+0000 7fecdcfc6700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fecc806d8a0 0x7fecc806fd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feccc006010 tx=0x7feccc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:44.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:44.834+0000 7fecd5ffb700 1 -- 172.21.15.46:0/605015244 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fecc4056ba0 con 0x7fecd80ffc60 2024-02-19T19:10:45.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:44 smithi046 ceph-mon[88928]: pgmap v228: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:45.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:44 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:45.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:44 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:45.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:44 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:45.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:44 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] up:boot 2024-02-19T19:10:45.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:44 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:10:45.076 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:44 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T19:10:45.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.067+0000 7fecdf22a700 1 -- 172.21.15.46:0/605015244 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fecd819b360 con 0x7fecc806d8a0 2024-02-19T19:10:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.069+0000 7fecd5ffb700 1 -- 172.21.15.46:0/605015244 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fecd819b360 con 0x7fecc806d8a0 2024-02-19T19:10:45.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 -- 172.21.15.46:0/605015244 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fecc806d8a0 msgr2=0x7fecc806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:45.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fecc806d8a0 0x7fecc806fd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feccc006010 tx=0x7feccc01a040 comp rx=0 tx=0).stop 2024-02-19T19:10:45.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 -- 172.21.15.46:0/605015244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd80ffc60 msgr2=0x7fecd8196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:45.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd80ffc60 0x7fecd8196450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fecc400d900 tx=0x7fecc400dc10 comp rx=0 tx=0).stop 2024-02-19T19:10:45.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 -- 172.21.15.46:0/605015244 shutdown_connections 2024-02-19T19:10:45.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fecc806d8a0 0x7fecc806fd50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80ff350 0x7fecd8195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 --2- 172.21.15.46:0/605015244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecd80ffc60 0x7fecd8196450 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 -- 172.21.15.46:0/605015244 >> 172.21.15.46:0/605015244 conn(0x7fecd80748b0 msgr2=0x7fecd8104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:45.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 -- 172.21.15.46:0/605015244 shutdown_connections 2024-02-19T19:10:45.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.071+0000 7fecdf22a700 1 -- 172.21.15.46:0/605015244 wait complete. 2024-02-19T19:10:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.180+0000 7fa263abb700 1 -- 172.21.15.46:0/710692844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa25c1004c0 msgr2=0x7fa25c100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.180+0000 7fa263abb700 1 --2- 172.21.15.46:0/710692844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa25c1004c0 0x7fa25c100890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa258009910 tx=0x7fa258009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.180+0000 7fa263abb700 1 -- 172.21.15.46:0/710692844 shutdown_connections 2024-02-19T19:10:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.180+0000 7fa263abb700 1 --2- 172.21.15.46:0/710692844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa25c100e60 0x7fa25c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.180+0000 7fa263abb700 1 --2- 172.21.15.46:0/710692844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa25c1004c0 0x7fa25c100890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.180+0000 7fa263abb700 1 -- 172.21.15.46:0/710692844 >> 172.21.15.46:0/710692844 conn(0x7fa25c0fbd80 msgr2=0x7fa25c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.181+0000 7fa263abb700 1 -- 172.21.15.46:0/710692844 shutdown_connections 2024-02-19T19:10:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.181+0000 7fa263abb700 1 -- 172.21.15.46:0/710692844 wait complete. 2024-02-19T19:10:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.181+0000 7fa263abb700 1 Processor -- start 2024-02-19T19:10:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.181+0000 7fa263abb700 1 -- start start 2024-02-19T19:10:45.204 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:44 smithi142 ceph-mon[69118]: pgmap v228: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:45.204 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:44 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:45.204 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:44 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:45.204 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:44 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:45.204 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:44 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] up:boot 2024-02-19T19:10:45.204 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:44 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:10:45.204 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:44 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.181+0000 7fa263abb700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa25c1004c0 0x7fa25c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.181+0000 7fa263abb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa25c100e60 0x7fa25c196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.181+0000 7fa263abb700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c196b50 con 0x7fa25c1004c0 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.181+0000 7fa263abb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c19a8e0 con 0x7fa25c100e60 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.181+0000 7fa261857700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa25c1004c0 0x7fa25c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa261857700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa25c1004c0 0x7fa25c195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40080/0 (socket says 172.21.15.46:40080) 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa261857700 1 -- 172.21.15.46:0/1324394327 learned_addr learned my addr 172.21.15.46:0/1324394327 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa261056700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa25c100e60 0x7fa25c196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa261857700 1 -- 172.21.15.46:0/1324394327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa25c100e60 msgr2=0x7fa25c196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa261857700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa25c100e60 0x7fa25c196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa261857700 1 -- 172.21.15.46:0/1324394327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2580095f0 con 0x7fa25c1004c0 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa261857700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa25c1004c0 0x7fa25c195f30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2580092e0 tx=0x7fa25800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa252ffd700 1 -- 172.21.15.46:0/1324394327 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa25801d070 con 0x7fa25c1004c0 2024-02-19T19:10:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa252ffd700 1 -- 172.21.15.46:0/1324394327 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa258005e00 con 0x7fa25c1004c0 2024-02-19T19:10:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa263abb700 1 -- 172.21.15.46:0/1324394327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c19ab60 con 0x7fa25c1004c0 2024-02-19T19:10:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa263abb700 1 -- 172.21.15.46:0/1324394327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c19b050 con 0x7fa25c1004c0 2024-02-19T19:10:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.182+0000 7fa252ffd700 1 -- 172.21.15.46:0/1324394327 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa258017400 con 0x7fa25c1004c0 2024-02-19T19:10:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.183+0000 7fa263abb700 1 -- 172.21.15.46:0/1324394327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c1087d0 con 0x7fa25c1004c0 2024-02-19T19:10:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.184+0000 7fa252ffd700 1 -- 172.21.15.46:0/1324394327 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa25800f6f0 con 0x7fa25c1004c0 2024-02-19T19:10:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.184+0000 7fa252ffd700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d8a0 0x7fa24806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.184+0000 7fa252ffd700 1 -- 172.21.15.46:0/1324394327 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fa25808eae0 con 0x7fa25c1004c0 2024-02-19T19:10:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.184+0000 7fa261056700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d8a0 0x7fa24806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.185+0000 7fa261056700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d8a0 0x7fa24806fd50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa25c197550 tx=0x7fa24c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:45.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.190+0000 7fa252ffd700 1 -- 172.21.15.46:0/1324394327 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa258058180 con 0x7fa25c1004c0 2024-02-19T19:10:45.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.433+0000 7fa263abb700 1 -- 172.21.15.46:0/1324394327 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa25c19b2c0 con 0x7fa24806d8a0 2024-02-19T19:10:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.452+0000 7fa252ffd700 1 -- 172.21.15.46:0/1324394327 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa25c19b2c0 con 0x7fa24806d8a0 2024-02-19T19:10:45.474 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (7m) 2m ago 17m 25.7M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (17m) 2m ago 17m 8572k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (16m) 15s ago 16m 8652k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (4m) 2m ago 17m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (4m) 15s ago 15m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 2m ago 16m 88.1M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (11m) 2m ago 11m 140M - 18.2.0 dc2bc1663786 7b3338a8085e 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 starting - - - - 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (11m) 15s ago 11m 18.2M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (11m) 15s ago 11m 119M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (8m) 2m ago 18m 507M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (7m) 15s ago 15m 451M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (5m) 2m ago 19m 49.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (5m) 15s ago 15m 41.8M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:10:45.475 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 2m ago 17m 16.6M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:10:45.476 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (7m) 15s ago 15m 17.1M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:10:45.476 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (3m) 2m ago 15m 231M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:10:45.476 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (3m) 2m ago 14m 250M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 974e56511c36 2024-02-19T19:10:45.476 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (2m) 2m ago 14m 15.1M 1217M 19.0.0-1450-gf78a58c0 f081f847070a a31225ea4dec 2024-02-19T19:10:45.476 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (86s) 15s ago 13m 143M 2240M 19.0.0-1450-gf78a58c0 f081f847070a b46795b87c3e 2024-02-19T19:10:45.476 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (52s) 15s ago 13m 86.6M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 645517de8ff6 2024-02-19T19:10:45.476 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (19s) 15s ago 12m 12.6M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 510ea3b4a23b 2024-02-19T19:10:45.476 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (7m) 2m ago 16m 68.2M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 -- 172.21.15.46:0/1324394327 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d8a0 msgr2=0x7fa24806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d8a0 0x7fa24806fd50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa25c197550 tx=0x7fa24c00b410 comp rx=0 tx=0).stop 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 -- 172.21.15.46:0/1324394327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa25c1004c0 msgr2=0x7fa25c195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa25c1004c0 0x7fa25c195f30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2580092e0 tx=0x7fa25800bd70 comp rx=0 tx=0).stop 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 -- 172.21.15.46:0/1324394327 shutdown_connections 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d8a0 0x7fa24806fd50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa25c1004c0 0x7fa25c195f30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 --2- 172.21.15.46:0/1324394327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa25c100e60 0x7fa25c196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 -- 172.21.15.46:0/1324394327 >> 172.21.15.46:0/1324394327 conn(0x7fa25c0fbd80 msgr2=0x7fa25c0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 -- 172.21.15.46:0/1324394327 shutdown_connections 2024-02-19T19:10:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.455+0000 7fa263abb700 1 -- 172.21.15.46:0/1324394327 wait complete. 2024-02-19T19:10:45.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.576+0000 7f24fcb9d700 1 -- 172.21.15.46:0/4198534317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f81061b0 msgr2=0x7f24f8106580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.576+0000 7f24fcb9d700 1 --2- 172.21.15.46:0/4198534317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f81061b0 0x7f24f8106580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009910 tx=0x7f24e8009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.576+0000 7f24fcb9d700 1 -- 172.21.15.46:0/4198534317 shutdown_connections 2024-02-19T19:10:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.576+0000 7f24fcb9d700 1 --2- 172.21.15.46:0/4198534317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24f8068540 0x7f24f80689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.576+0000 7f24fcb9d700 1 --2- 172.21.15.46:0/4198534317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f81061b0 0x7f24f8106580 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.576+0000 7f24fcb9d700 1 -- 172.21.15.46:0/4198534317 >> 172.21.15.46:0/4198534317 conn(0x7f24f8074fa0 msgr2=0x7f24f80753a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.576+0000 7f24fcb9d700 1 -- 172.21.15.46:0/4198534317 shutdown_connections 2024-02-19T19:10:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.576+0000 7f24fcb9d700 1 -- 172.21.15.46:0/4198534317 wait complete. 2024-02-19T19:10:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.577+0000 7f24fcb9d700 1 Processor -- start 2024-02-19T19:10:45.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.577+0000 7f24fcb9d700 1 -- start start 2024-02-19T19:10:45.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.577+0000 7f24fcb9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8068540 0x7f24f8197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24fcb9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24f81061b0 0x7f24f81982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24fcb9d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f8198980 con 0x7f24f8068540 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24fcb9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f819c710 con 0x7f24f81061b0 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24f77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8068540 0x7f24f8197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24f77fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8068540 0x7f24f8197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40102/0 (socket says 172.21.15.46:40102) 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24f77fe700 1 -- 172.21.15.46:0/2741101624 learned_addr learned my addr 172.21.15.46:0/2741101624 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24f77fe700 1 -- 172.21.15.46:0/2741101624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24f81061b0 msgr2=0x7f24f81982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24f77fe700 1 --2- 172.21.15.46:0/2741101624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24f81061b0 0x7f24f81982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24f77fe700 1 -- 172.21.15.46:0/2741101624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e80095f0 con 0x7f24f8068540 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24f77fe700 1 --2- 172.21.15.46:0/2741101624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8068540 0x7f24f8197d60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f24e8006010 tx=0x7f24e800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.578+0000 7f24f4ff9700 1 -- 172.21.15.46:0/2741101624 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e801d070 con 0x7f24f8068540 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.579+0000 7f24f4ff9700 1 -- 172.21.15.46:0/2741101624 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24e800f460 con 0x7f24f8068540 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.579+0000 7f24fcb9d700 1 -- 172.21.15.46:0/2741101624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f819c990 con 0x7f24f8068540 2024-02-19T19:10:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.579+0000 7f24f4ff9700 1 -- 172.21.15.46:0/2741101624 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e8017630 con 0x7f24f8068540 2024-02-19T19:10:45.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.579+0000 7f24fcb9d700 1 -- 172.21.15.46:0/2741101624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f819cf00 con 0x7f24f8068540 2024-02-19T19:10:45.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.580+0000 7f24fcb9d700 1 -- 172.21.15.46:0/2741101624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f8062380 con 0x7f24f8068540 2024-02-19T19:10:45.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.580+0000 7f24f4ff9700 1 -- 172.21.15.46:0/2741101624 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f24e800f5d0 con 0x7f24f8068540 2024-02-19T19:10:45.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.581+0000 7f24f4ff9700 1 --2- 172.21.15.46:0/2741101624 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f24e006d8a0 0x7f24e006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:45.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.581+0000 7f24f4ff9700 1 -- 172.21.15.46:0/2741101624 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f24e808ea40 con 0x7f24f8068540 2024-02-19T19:10:45.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.581+0000 7f24f6ffd700 1 --2- 172.21.15.46:0/2741101624 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f24e006d8a0 0x7f24e006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:45.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.581+0000 7f24f6ffd700 1 --2- 172.21.15.46:0/2741101624 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f24e006d8a0 0x7f24e006fd50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f24ec005950 tx=0x7f24ec0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:45.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.586+0000 7f24f4ff9700 1 -- 172.21.15.46:0/2741101624 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f24e8058160 con 0x7f24f8068540 2024-02-19T19:10:45.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.895+0000 7f24fcb9d700 1 -- 172.21.15.46:0/2741101624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f24f819d350 con 0x7f24f8068540 2024-02-19T19:10:45.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.896+0000 7f24f4ff9700 1 -- 172.21.15.46:0/2741101624 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7f24e805b820 con 0x7f24f8068540 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-02-19T19:10:45.918 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:10:45.919 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:10:45.919 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:10:45.919 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-02-19T19:10:45.919 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 11 2024-02-19T19:10:45.919 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:10:45.919 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:10:45.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 -- 172.21.15.46:0/2741101624 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f24e006d8a0 msgr2=0x7f24e006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 --2- 172.21.15.46:0/2741101624 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f24e006d8a0 0x7f24e006fd50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f24ec005950 tx=0x7f24ec0058e0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 -- 172.21.15.46:0/2741101624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8068540 msgr2=0x7f24f8197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 --2- 172.21.15.46:0/2741101624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8068540 0x7f24f8197d60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f24e8006010 tx=0x7f24e800be20 comp rx=0 tx=0).stop 2024-02-19T19:10:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 -- 172.21.15.46:0/2741101624 shutdown_connections 2024-02-19T19:10:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 --2- 172.21.15.46:0/2741101624 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f24e006d8a0 0x7f24e006fd50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 --2- 172.21.15.46:0/2741101624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24f8068540 0x7f24f8197d60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 --2- 172.21.15.46:0/2741101624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24f81061b0 0x7f24f81982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 -- 172.21.15.46:0/2741101624 >> 172.21.15.46:0/2741101624 conn(0x7f24f8074fa0 msgr2=0x7f24f80fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 -- 172.21.15.46:0/2741101624 shutdown_connections 2024-02-19T19:10:45.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:45.898+0000 7f24fcb9d700 1 -- 172.21.15.46:0/2741101624 wait complete. 2024-02-19T19:10:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.009+0000 7efe0cae7700 1 -- 172.21.15.46:0/792679643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080ff3c0 msgr2=0x7efe080ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.009+0000 7efe0cae7700 1 --2- 172.21.15.46:0/792679643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080ff3c0 0x7efe080ff790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009910 tx=0x7efdf8009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.009+0000 7efe0cae7700 1 -- 172.21.15.46:0/792679643 shutdown_connections 2024-02-19T19:10:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.009+0000 7efe0cae7700 1 --2- 172.21.15.46:0/792679643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe080ffd60 0x7efe08103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.009+0000 7efe0cae7700 1 --2- 172.21.15.46:0/792679643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080ff3c0 0x7efe080ff790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.009+0000 7efe0cae7700 1 -- 172.21.15.46:0/792679643 >> 172.21.15.46:0/792679643 conn(0x7efe080fac80 msgr2=0x7efe080fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.009+0000 7efe0cae7700 1 -- 172.21.15.46:0/792679643 shutdown_connections 2024-02-19T19:10:46.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.009+0000 7efe0cae7700 1 -- 172.21.15.46:0/792679643 wait complete. 2024-02-19T19:10:46.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.010+0000 7efe0cae7700 1 Processor -- start 2024-02-19T19:10:46.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.010+0000 7efe0cae7700 1 -- start start 2024-02-19T19:10:46.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.010+0000 7efe0cae7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe080ff3c0 0x7efe08194b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:46.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.010+0000 7efe0cae7700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080ffd60 0x7efe08195060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:46.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.010+0000 7efe0cae7700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe081955a0 con 0x7efe080ffd60 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.010+0000 7efe0cae7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe08195710 con 0x7efe080ff3c0 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.010+0000 7efe05d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080ffd60 0x7efe08195060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.010+0000 7efe05d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080ffd60 0x7efe08195060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40108/0 (socket says 172.21.15.46:40108) 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.010+0000 7efe05d9b700 1 -- 172.21.15.46:0/3200621860 learned_addr learned my addr 172.21.15.46:0/3200621860 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.010+0000 7efe0659c700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe080ff3c0 0x7efe08194b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.011+0000 7efe05d9b700 1 -- 172.21.15.46:0/3200621860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe080ff3c0 msgr2=0x7efe08194b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.011+0000 7efe05d9b700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe080ff3c0 0x7efe08194b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.011+0000 7efe05d9b700 1 -- 172.21.15.46:0/3200621860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80095f0 con 0x7efe080ffd60 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.011+0000 7efe05d9b700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080ffd60 0x7efe08195060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00d8d0 tx=0x7efdfc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.011+0000 7efdf77fe700 1 -- 172.21.15.46:0/3200621860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdfc004a00 con 0x7efe080ffd60 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.011+0000 7efe0cae7700 1 -- 172.21.15.46:0/3200621860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe081a2190 con 0x7efe080ffd60 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.011+0000 7efe0cae7700 1 -- 172.21.15.46:0/3200621860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe081a24f0 con 0x7efe080ffd60 2024-02-19T19:10:46.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.011+0000 7efdf77fe700 1 -- 172.21.15.46:0/3200621860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdfc0054e0 con 0x7efe080ffd60 2024-02-19T19:10:46.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.011+0000 7efdf77fe700 1 -- 172.21.15.46:0/3200621860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdfc00fbf0 con 0x7efe080ffd60 2024-02-19T19:10:46.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.012+0000 7efe0cae7700 1 -- 172.21.15.46:0/3200621860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde8005320 con 0x7efe080ffd60 2024-02-19T19:10:46.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.013+0000 7efdf77fe700 1 -- 172.21.15.46:0/3200621860 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7efdfc00fd50 con 0x7efe080ffd60 2024-02-19T19:10:46.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.014+0000 7efdf77fe700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efdf006d8f0 0x7efdf006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:46.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.014+0000 7efdf77fe700 1 -- 172.21.15.46:0/3200621860 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6855+0+0 (secure 0 0 0) 0x7efdfc08cee0 con 0x7efe080ffd60 2024-02-19T19:10:46.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.014+0000 7efe0659c700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efdf006d8f0 0x7efdf006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:46.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.014+0000 7efe0659c700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efdf006d8f0 0x7efdf006fda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efdf8006010 tx=0x7efdf801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.019+0000 7efdf77fe700 1 -- 172.21.15.46:0/3200621860 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efdfc05a010 con 0x7efe080ffd60 2024-02-19T19:10:46.211 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:45 smithi046 ceph-mon[88928]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:46.211 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:45 smithi046 ceph-mon[88928]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:46.211 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:45 smithi046 ceph-mon[88928]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:46.211 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:45 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2741101624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:46.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.298+0000 7efe0cae7700 1 -- 172.21.15.46:0/3200621860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efde8006200 con 0x7efe080ffd60 2024-02-19T19:10:46.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.299+0000 7efdf77fe700 1 -- 172.21.15.46:0/3200621860 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1840 (secure 0 0 0) 0x7efdfc020740 con 0x7efe080ffd60 2024-02-19T19:10:46.321 INFO:teuthology.orchestra.run.smithi046.stdout:e23 2024-02-19T19:10:46.321 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:10:46.321 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:10:46.321 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:10:46.321 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:10:46.321 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:10:46.321 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:10:46.321 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T19:10:34.708956+0000 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 114 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:10:46.322 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:10:46.323 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:10:46.324 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:10:46.324 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:46.324 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{-1:34406} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/214941826,v1:172.21.15.46:6829/214941826] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:46.324 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:34412} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:10:46.324 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6824/3279846196,v1:172.21.15.142:6825/3279846196] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 -- 172.21.15.46:0/3200621860 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efdf006d8f0 msgr2=0x7efdf006fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efdf006d8f0 0x7efdf006fda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efdf8006010 tx=0x7efdf801a040 comp rx=0 tx=0).stop 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 -- 172.21.15.46:0/3200621860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080ffd60 msgr2=0x7efe08195060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080ffd60 0x7efe08195060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00d8d0 tx=0x7efdfc00dbe0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 -- 172.21.15.46:0/3200621860 shutdown_connections 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7efdf006d8f0 0x7efdf006fda0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe080ff3c0 0x7efe08194b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 --2- 172.21.15.46:0/3200621860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe080ffd60 0x7efe08195060 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 -- 172.21.15.46:0/3200621860 >> 172.21.15.46:0/3200621860 conn(0x7efe080fac80 msgr2=0x7efe080fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 -- 172.21.15.46:0/3200621860 shutdown_connections 2024-02-19T19:10:46.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.301+0000 7efe0cae7700 1 -- 172.21.15.46:0/3200621860 wait complete. 2024-02-19T19:10:46.326 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 23 2024-02-19T19:10:46.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.423+0000 7fb0a7c06700 1 -- 172.21.15.46:0/3814637214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0a00ff3c0 msgr2=0x7fb0a00ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:46.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.423+0000 7fb0a7c06700 1 --2- 172.21.15.46:0/3814637214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0a00ff3c0 0x7fb0a00ff790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb09000b0a0 tx=0x7fb09000b3b0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.423+0000 7fb0a7c06700 1 -- 172.21.15.46:0/3814637214 shutdown_connections 2024-02-19T19:10:46.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.423+0000 7fb0a7c06700 1 --2- 172.21.15.46:0/3814637214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0a00ffd60 0x7fb0a0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.423+0000 7fb0a7c06700 1 --2- 172.21.15.46:0/3814637214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0a00ff3c0 0x7fb0a00ff790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.423+0000 7fb0a7c06700 1 -- 172.21.15.46:0/3814637214 >> 172.21.15.46:0/3814637214 conn(0x7fb0a00fac80 msgr2=0x7fb0a00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:46.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.423+0000 7fb0a7c06700 1 -- 172.21.15.46:0/3814637214 shutdown_connections 2024-02-19T19:10:46.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.423+0000 7fb0a7c06700 1 -- 172.21.15.46:0/3814637214 wait complete. 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.424+0000 7fb0a7c06700 1 Processor -- start 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.424+0000 7fb0a7c06700 1 -- start start 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.424+0000 7fb0a7c06700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0a00ff3c0 0x7fb0a0196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.424+0000 7fb0a7c06700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0a00ffd60 0x7fb0a0197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.424+0000 7fb0a7c06700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a0197830 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.424+0000 7fb0a7c06700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a01979a0 con 0x7fb0a00ffd60 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.424+0000 7fb0a59a2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0a00ff3c0 0x7fb0a0196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.424+0000 7fb0a59a2700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0a00ff3c0 0x7fb0a0196cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40124/0 (socket says 172.21.15.46:40124) 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.424+0000 7fb0a59a2700 1 -- 172.21.15.46:0/2307192124 learned_addr learned my addr 172.21.15.46:0/2307192124 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.424+0000 7fb0a51a1700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0a00ffd60 0x7fb0a0197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.425+0000 7fb0a59a2700 1 -- 172.21.15.46:0/2307192124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0a00ffd60 msgr2=0x7fb0a0197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:46.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.425+0000 7fb0a59a2700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0a00ffd60 0x7fb0a0197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.425+0000 7fb0a59a2700 1 -- 172.21.15.46:0/2307192124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090009d00 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.425+0000 7fb0a59a2700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0a00ff3c0 0x7fb0a0196cd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb090000f80 tx=0x7fb09000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:46.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.425+0000 7fb09effd700 1 -- 172.21.15.46:0/2307192124 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb09000e040 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.425+0000 7fb09effd700 1 -- 172.21.15.46:0/2307192124 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb090003c10 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.425+0000 7fb0a7c06700 1 -- 172.21.15.46:0/2307192124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a019fd40 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.425+0000 7fb09effd700 1 -- 172.21.15.46:0/2307192124 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb09001d6b0 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.425+0000 7fb0a7c06700 1 -- 172.21.15.46:0/2307192124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a01a01b0 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.426+0000 7fb0a7c06700 1 -- 172.21.15.46:0/2307192124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a01076d0 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.427+0000 7fb09effd700 1 -- 172.21.15.46:0/2307192124 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb090004040 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.427+0000 7fb09effd700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb08806d8a0 0x7fb08806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:46.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.427+0000 7fb09effd700 1 -- 172.21.15.46:0/2307192124 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fb09008ee00 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.427+0000 7fb0a51a1700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb08806d8a0 0x7fb08806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:46.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.428+0000 7fb0a51a1700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb08806d8a0 0x7fb08806fd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00696a0 tx=0x7fb09400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:46.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:45 smithi142 ceph-mon[69118]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:46.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:45 smithi142 ceph-mon[69118]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:46.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:45 smithi142 ceph-mon[69118]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:46.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:45 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2741101624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:46.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.432+0000 7fb09effd700 1 -- 172.21.15.46:0/2307192124 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb0900584a0 con 0x7fb0a00ff3c0 2024-02-19T19:10:46.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.664+0000 7fb0a7c06700 1 -- 172.21.15.46:0/2307192124 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0a0061190 con 0x7fb08806d8a0 2024-02-19T19:10:46.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.666+0000 7fb09effd700 1 -- 172.21.15.46:0/2307192124 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb0a0061190 con 0x7fb08806d8a0 2024-02-19T19:10:46.687 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "12/23 daemons upgraded", 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:10:46.688 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:10:46.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 -- 172.21.15.46:0/2307192124 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb08806d8a0 msgr2=0x7fb08806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:46.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb08806d8a0 0x7fb08806fd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00696a0 tx=0x7fb09400b410 comp rx=0 tx=0).stop 2024-02-19T19:10:46.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 -- 172.21.15.46:0/2307192124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0a00ff3c0 msgr2=0x7fb0a0196cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:46.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0a00ff3c0 0x7fb0a0196cd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb090000f80 tx=0x7fb09000cd20 comp rx=0 tx=0).stop 2024-02-19T19:10:46.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 -- 172.21.15.46:0/2307192124 shutdown_connections 2024-02-19T19:10:46.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb08806d8a0 0x7fb08806fd50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0a00ff3c0 0x7fb0a0196cd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 --2- 172.21.15.46:0/2307192124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0a00ffd60 0x7fb0a0197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 -- 172.21.15.46:0/2307192124 >> 172.21.15.46:0/2307192124 conn(0x7fb0a00fac80 msgr2=0x7fb0a00fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:46.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 -- 172.21.15.46:0/2307192124 shutdown_connections 2024-02-19T19:10:46.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.668+0000 7fb0a7c06700 1 -- 172.21.15.46:0/2307192124 wait complete. 2024-02-19T19:10:46.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.774+0000 7fb8424f8700 1 -- 172.21.15.46:0/2911299936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb83c073a00 msgr2=0x7fb83c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:46.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.774+0000 7fb8424f8700 1 --2- 172.21.15.46:0/2911299936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb83c073a00 0x7fb83c10c580 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb830009910 tx=0x7fb830009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:46.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.775+0000 7fb8424f8700 1 -- 172.21.15.46:0/2911299936 shutdown_connections 2024-02-19T19:10:46.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.775+0000 7fb8424f8700 1 --2- 172.21.15.46:0/2911299936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb83c073a00 0x7fb83c10c580 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.775+0000 7fb8424f8700 1 --2- 172.21.15.46:0/2911299936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83c0730f0 0x7fb83c0734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.775+0000 7fb8424f8700 1 -- 172.21.15.46:0/2911299936 >> 172.21.15.46:0/2911299936 conn(0x7fb83c0fbda0 msgr2=0x7fb83c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:46.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.775+0000 7fb8424f8700 1 -- 172.21.15.46:0/2911299936 shutdown_connections 2024-02-19T19:10:46.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.775+0000 7fb8424f8700 1 -- 172.21.15.46:0/2911299936 wait complete. 2024-02-19T19:10:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.775+0000 7fb8424f8700 1 Processor -- start 2024-02-19T19:10:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.775+0000 7fb8424f8700 1 -- start start 2024-02-19T19:10:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb8424f8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83c0730f0 0x7fb83c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb8424f8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb83c073a00 0x7fb83c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb8424f8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c19c930 con 0x7fb83c073a00 2024-02-19T19:10:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb8424f8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c19caa0 con 0x7fb83c0730f0 2024-02-19T19:10:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb83b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb83c073a00 0x7fb83c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb83b7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb83c073a00 0x7fb83c1985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40130/0 (socket says 172.21.15.46:40130) 2024-02-19T19:10:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb83b7fe700 1 -- 172.21.15.46:0/2271982851 learned_addr learned my addr 172.21.15.46:0/2271982851 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:10:46.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb83bfff700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83c0730f0 0x7fb83c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb83b7fe700 1 -- 172.21.15.46:0/2271982851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83c0730f0 msgr2=0x7fb83c197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb83b7fe700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83c0730f0 0x7fb83c197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.776+0000 7fb83b7fe700 1 -- 172.21.15.46:0/2271982851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8300095f0 con 0x7fb83c073a00 2024-02-19T19:10:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.777+0000 7fb83b7fe700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb83c073a00 0x7fb83c1985f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb83000b5c0 tx=0x7fb83000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.777+0000 7fb8397fa700 1 -- 172.21.15.46:0/2271982851 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb83001d070 con 0x7fb83c073a00 2024-02-19T19:10:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.777+0000 7fb8397fa700 1 -- 172.21.15.46:0/2271982851 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb830005e00 con 0x7fb83c073a00 2024-02-19T19:10:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.777+0000 7fb8424f8700 1 -- 172.21.15.46:0/2271982851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c19cd80 con 0x7fb83c073a00 2024-02-19T19:10:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.777+0000 7fb8397fa700 1 -- 172.21.15.46:0/2271982851 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb830017400 con 0x7fb83c073a00 2024-02-19T19:10:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.777+0000 7fb8424f8700 1 -- 172.21.15.46:0/2271982851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c19d2d0 con 0x7fb83c073a00 2024-02-19T19:10:46.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.778+0000 7fb8424f8700 1 -- 172.21.15.46:0/2271982851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c109c80 con 0x7fb83c073a00 2024-02-19T19:10:46.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.778+0000 7fb8397fa700 1 -- 172.21.15.46:0/2271982851 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb83000f6f0 con 0x7fb83c073a00 2024-02-19T19:10:46.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.779+0000 7fb8397fa700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb82406d8f0 0x7fb82406fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:46.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.779+0000 7fb8397fa700 1 -- 172.21.15.46:0/2271982851 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fb83008ea90 con 0x7fb83c073a00 2024-02-19T19:10:46.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.779+0000 7fb83bfff700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb82406d8f0 0x7fb82406fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:46.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.779+0000 7fb83bfff700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb82406d8f0 0x7fb82406fda0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb82c005950 tx=0x7fb82c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:46.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:46.783+0000 7fb8397fa700 1 -- 172.21.15.46:0/2271982851 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb830058110 con 0x7fb83c073a00 2024-02-19T19:10:47.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:46 smithi046 ceph-mon[88928]: pgmap v229: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:47.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:46 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3200621860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:10:47.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.085+0000 7fb8424f8700 1 -- 172.21.15.46:0/2271982851 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb83c1992e0 con 0x7fb83c073a00 2024-02-19T19:10:47.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.085+0000 7fb8397fa700 1 -- 172.21.15.46:0/2271982851 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fb83005b7d0 con 0x7fb83c073a00 2024-02-19T19:10:47.107 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-19T19:10:47.107 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-19T19:10:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-02-19T19:10:47.107 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-19T19:10:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-19T19:10:47.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.087+0000 7fb8424f8700 1 -- 172.21.15.46:0/2271982851 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb82406d8f0 msgr2=0x7fb82406fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:47.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.087+0000 7fb8424f8700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb82406d8f0 0x7fb82406fda0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb82c005950 tx=0x7fb82c00b410 comp rx=0 tx=0).stop 2024-02-19T19:10:47.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.087+0000 7fb8424f8700 1 -- 172.21.15.46:0/2271982851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb83c073a00 msgr2=0x7fb83c1985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:47.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.087+0000 7fb8424f8700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb83c073a00 0x7fb83c1985f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb83000b5c0 tx=0x7fb83000bd70 comp rx=0 tx=0).stop 2024-02-19T19:10:47.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.087+0000 7fb8424f8700 1 -- 172.21.15.46:0/2271982851 shutdown_connections 2024-02-19T19:10:47.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.087+0000 7fb8424f8700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb82406d8f0 0x7fb82406fda0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:47.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.087+0000 7fb8424f8700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb83c0730f0 0x7fb83c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:47.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.087+0000 7fb8424f8700 1 --2- 172.21.15.46:0/2271982851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb83c073a00 0x7fb83c1985f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:47.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.087+0000 7fb8424f8700 1 -- 172.21.15.46:0/2271982851 >> 172.21.15.46:0/2271982851 conn(0x7fb83c0fbda0 msgr2=0x7fb83c106dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:47.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.088+0000 7fb8424f8700 1 -- 172.21.15.46:0/2271982851 shutdown_connections 2024-02-19T19:10:47.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:10:47.088+0000 7fb8424f8700 1 -- 172.21.15.46:0/2271982851 wait complete. 2024-02-19T19:10:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:46 smithi142 ceph-mon[69118]: pgmap v229: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:47.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:46 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3200621860' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:10:48.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:47 smithi046 ceph-mon[88928]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:48.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:47 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2271982851' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:10:48.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:48.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:47 smithi142 ceph-mon[69118]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:48.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:47 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2271982851' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:10:48.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:49.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:48 smithi046 ceph-mon[88928]: pgmap v230: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:49.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:48 smithi142 ceph-mon[69118]: pgmap v230: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:50.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:50 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:50.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:50 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:50.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:50 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:50.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:50 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:51.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:51 smithi046 ceph-mon[88928]: pgmap v231: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:51.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:51 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:51.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:51 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:51.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:51 smithi142 ceph-mon[69118]: pgmap v231: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:51.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:51 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:51.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:51 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:53.785 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:53 smithi046 ceph-mon[88928]: pgmap v232: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:53.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:53 smithi142 ceph-mon[69118]: pgmap v232: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: pgmap v233: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:55.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:55.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: pgmap v233: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:55.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:55.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:55.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:55.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:10:55.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:55.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:55.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:55.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:55.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:55.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:56.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:56 smithi046 ceph-mon[88928]: Upgrade: Updating mds.cephfs.smithi046.bwvkwa 2024-02-19T19:10:56.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:56 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:56.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:56 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.bwvkwa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:10:56.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:56 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:56.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:56 smithi142 ceph-mon[69118]: Upgrade: Updating mds.cephfs.smithi046.bwvkwa 2024-02-19T19:10:56.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:56 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:10:56.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:56 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.bwvkwa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:10:56.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:56 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:57.764 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:57 smithi046 ceph-mon[88928]: Deploying daemon mds.cephfs.smithi046.bwvkwa on smithi046 2024-02-19T19:10:57.764 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:57 smithi046 ceph-mon[88928]: pgmap v234: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:57.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:57 smithi142 ceph-mon[69118]: Deploying daemon mds.cephfs.smithi046.bwvkwa on smithi046 2024-02-19T19:10:57.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:57 smithi142 ceph-mon[69118]: pgmap v234: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:58.772 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:58 smithi046 ceph-mon[88928]: pgmap v235: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:58.772 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:58.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:58 smithi142 ceph-mon[69118]: pgmap v235: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:10:58.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:59.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:59 smithi046 ceph-mon[88928]: osdmap e117: 6 total, 6 up, 6 in 2024-02-19T19:10:59.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:10:59 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:10:59.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:59 smithi142 ceph-mon[69118]: osdmap e117: 6 total, 6 up, 6 in 2024-02-19T19:10:59.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:10:59 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:11:01.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:01 smithi046 ceph-mon[88928]: pgmap v237: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:01.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:01.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:01.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:01.581 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:01 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] up:boot 2024-02-19T19:11:01.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:01 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:11:01.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:11:01.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:01 smithi142 ceph-mon[69118]: pgmap v237: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:01.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:01.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:01 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] up:boot 2024-02-19T19:11:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:01 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:11:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:11:03.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:03 smithi046 ceph-mon[88928]: pgmap v238: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:03 smithi142 ceph-mon[69118]: pgmap v238: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:05.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:05 smithi046 ceph-mon[88928]: pgmap v239: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:05.870 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:05 smithi142 ceph-mon[69118]: pgmap v239: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:06.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:06 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:06.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:06 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:06.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:06 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:06.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:06 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:07.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:07 smithi046 ceph-mon[88928]: pgmap v240: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:07.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:07.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:07.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:07 smithi142 ceph-mon[69118]: pgmap v240: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:07.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:07.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:09.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:09 smithi046 ceph-mon[88928]: pgmap v241: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:09.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:09 smithi142 ceph-mon[69118]: pgmap v241: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:11.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: pgmap v242: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:11.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:11.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:11.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:11.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:11:11.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:11.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:11.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:11.506 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:11.506 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:11.506 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:11.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: pgmap v242: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:11.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:11.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:11.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:11.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:11:11.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:11.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:11.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:11.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:11.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:11.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:13.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:13 smithi142 ceph-mon[69118]: pgmap v243: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:13.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:13 smithi142 ceph-mon[69118]: Upgrade: Updating mds.cephfs.smithi142.maazlq 2024-02-19T19:11:13.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:13.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.maazlq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:11:13.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:13.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:13 smithi142 ceph-mon[69118]: Deploying daemon mds.cephfs.smithi142.maazlq on smithi142 2024-02-19T19:11:13.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:13.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:13 smithi046 ceph-mon[88928]: pgmap v243: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:13.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:13 smithi046 ceph-mon[88928]: Upgrade: Updating mds.cephfs.smithi142.maazlq 2024-02-19T19:11:13.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.maazlq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:11:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:13 smithi046 ceph-mon[88928]: Deploying daemon mds.cephfs.smithi142.maazlq on smithi142 2024-02-19T19:11:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:15.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:15 smithi046 ceph-mon[88928]: pgmap v244: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:15.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:15 smithi142 ceph-mon[69118]: pgmap v244: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:16.553 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:16 smithi046 ceph-mon[88928]: osdmap e118: 6 total, 6 up, 6 in 2024-02-19T19:11:16.553 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:16 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:11:16.554 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:11:16.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:16 smithi142 ceph-mon[69118]: osdmap e118: 6 total, 6 up, 6 in 2024-02-19T19:11:16.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:16 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:11:16.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:11:17.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.211+0000 7f048cd53700 1 -- 172.21.15.46:0/2721229931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04880687a0 msgr2=0x7f0488068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:17.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.211+0000 7f048cd53700 1 --2- 172.21.15.46:0/2721229931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04880687a0 0x7f0488068b70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f047800b0a0 tx=0x7f047800b3b0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.211+0000 7f048cd53700 1 -- 172.21.15.46:0/2721229931 shutdown_connections 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.211+0000 7f048cd53700 1 --2- 172.21.15.46:0/2721229931 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0488069140 0x7f0488104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.211+0000 7f048cd53700 1 --2- 172.21.15.46:0/2721229931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04880687a0 0x7f0488068b70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.211+0000 7f048cd53700 1 -- 172.21.15.46:0/2721229931 >> 172.21.15.46:0/2721229931 conn(0x7f0488075130 msgr2=0x7f0488075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.211+0000 7f048cd53700 1 -- 172.21.15.46:0/2721229931 shutdown_connections 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.211+0000 7f048cd53700 1 -- 172.21.15.46:0/2721229931 wait complete. 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.212+0000 7f048cd53700 1 Processor -- start 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.212+0000 7f048cd53700 1 -- start start 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.212+0000 7f048cd53700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04880687a0 0x7f0488195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.212+0000 7f048cd53700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0488069140 0x7f0488196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.212+0000 7f048cd53700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0488196b40 con 0x7f04880687a0 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.212+0000 7f048cd53700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048819a8d0 con 0x7f0488069140 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.212+0000 7f048659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04880687a0 0x7f0488195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.212+0000 7f048659c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04880687a0 0x7f0488195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52974/0 (socket says 172.21.15.46:52974) 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.212+0000 7f048659c700 1 -- 172.21.15.46:0/2628455175 learned_addr learned my addr 172.21.15.46:0/2628455175 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:17.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f0485d9b700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0488069140 0x7f0488196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:17.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f048659c700 1 -- 172.21.15.46:0/2628455175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0488069140 msgr2=0x7f0488196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:17.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f048659c700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0488069140 0x7f0488196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f048659c700 1 -- 172.21.15.46:0/2628455175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478009d00 con 0x7f04880687a0 2024-02-19T19:11:17.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f0485d9b700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0488069140 0x7f0488196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:11:17.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f048659c700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04880687a0 0x7f0488195f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f047800b070 tx=0x7f047800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:17.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f047f7fe700 1 -- 172.21.15.46:0/2628455175 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f047800e040 con 0x7f04880687a0 2024-02-19T19:11:17.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f048cd53700 1 -- 172.21.15.46:0/2628455175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048819ab50 con 0x7f04880687a0 2024-02-19T19:11:17.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f047f7fe700 1 -- 172.21.15.46:0/2628455175 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0478003de0 con 0x7f04880687a0 2024-02-19T19:11:17.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f047f7fe700 1 -- 172.21.15.46:0/2628455175 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f047801d8e0 con 0x7f04880687a0 2024-02-19T19:11:17.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.213+0000 7f048cd53700 1 -- 172.21.15.46:0/2628455175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048819b040 con 0x7f04880687a0 2024-02-19T19:11:17.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.214+0000 7f048cd53700 1 -- 172.21.15.46:0/2628455175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0488108790 con 0x7f04880687a0 2024-02-19T19:11:17.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.215+0000 7f047f7fe700 1 -- 172.21.15.46:0/2628455175 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0478004040 con 0x7f04880687a0 2024-02-19T19:11:17.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.215+0000 7f047f7fe700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047406d8a0 0x7f047406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:17.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.215+0000 7f047f7fe700 1 -- 172.21.15.46:0/2628455175 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f047808eeb0 con 0x7f04880687a0 2024-02-19T19:11:17.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.215+0000 7f0485d9b700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047406d8a0 0x7f047406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:17.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.216+0000 7f0485d9b700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047406d8a0 0x7f047406fd50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0470005950 tx=0x7f04700058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:17.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.220+0000 7f047f7fe700 1 -- 172.21.15.46:0/2628455175 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0478058550 con 0x7f04880687a0 2024-02-19T19:11:17.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.446+0000 7f048cd53700 1 -- 172.21.15.46:0/2628455175 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f048819b260 con 0x7f047406d8a0 2024-02-19T19:11:17.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.447+0000 7f047f7fe700 1 -- 172.21.15.46:0/2628455175 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f048819b260 con 0x7f047406d8a0 2024-02-19T19:11:17.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 -- 172.21.15.46:0/2628455175 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047406d8a0 msgr2=0x7f047406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:17.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047406d8a0 0x7f047406fd50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0470005950 tx=0x7f04700058e0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 -- 172.21.15.46:0/2628455175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04880687a0 msgr2=0x7f0488195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04880687a0 0x7f0488195f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f047800b070 tx=0x7f047800cdd0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 -- 172.21.15.46:0/2628455175 shutdown_connections 2024-02-19T19:11:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f047406d8a0 0x7f047406fd50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04880687a0 0x7f0488195f20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 --2- 172.21.15.46:0/2628455175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0488069140 0x7f0488196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 -- 172.21.15.46:0/2628455175 >> 172.21.15.46:0/2628455175 conn(0x7f0488075130 msgr2=0x7f04880fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 -- 172.21.15.46:0/2628455175 shutdown_connections 2024-02-19T19:11:17.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.449+0000 7f048cd53700 1 -- 172.21.15.46:0/2628455175 wait complete. 2024-02-19T19:11:17.482 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:11:17.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.557+0000 7f58b21f6700 1 -- 172.21.15.46:0/3752170413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ac0ff350 msgr2=0x7f58ac0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:17.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.557+0000 7f58b21f6700 1 --2- 172.21.15.46:0/3752170413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ac0ff350 0x7f58ac0ff720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f589c009910 tx=0x7f589c009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:17.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.557+0000 7f58b21f6700 1 -- 172.21.15.46:0/3752170413 shutdown_connections 2024-02-19T19:11:17.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.557+0000 7f58b21f6700 1 --2- 172.21.15.46:0/3752170413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58ac0ffc60 0x7f58ac10a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.557+0000 7f58b21f6700 1 --2- 172.21.15.46:0/3752170413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ac0ff350 0x7f58ac0ff720 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.557+0000 7f58b21f6700 1 -- 172.21.15.46:0/3752170413 >> 172.21.15.46:0/3752170413 conn(0x7f58ac0748b0 msgr2=0x7f58ac074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:17.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:17 smithi046 ceph-mon[88928]: pgmap v246: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.557+0000 7f58b21f6700 1 -- 172.21.15.46:0/3752170413 shutdown_connections 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.557+0000 7f58b21f6700 1 -- 172.21.15.46:0/3752170413 wait complete. 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.558+0000 7f58b21f6700 1 Processor -- start 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.558+0000 7f58b21f6700 1 -- start start 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.558+0000 7f58b21f6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58ac0ff350 0x7f58ac195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.558+0000 7f58b21f6700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ac0ffc60 0x7f58ac196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.558+0000 7f58b21f6700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac196a20 con 0x7f58ac0ffc60 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.558+0000 7f58b21f6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac19a7b0 con 0x7f58ac0ff350 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.558+0000 7f58aaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ac0ffc60 0x7f58ac196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.558+0000 7f58aaffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ac0ffc60 0x7f58ac196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39444/0 (socket says 172.21.15.46:39444) 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.558+0000 7f58aaffd700 1 -- 172.21.15.46:0/3915108810 learned_addr learned my addr 172.21.15.46:0/3915108810 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.558+0000 7f58ab7fe700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58ac0ff350 0x7f58ac195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.559+0000 7f58aaffd700 1 -- 172.21.15.46:0/3915108810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58ac0ff350 msgr2=0x7f58ac195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.559+0000 7f58aaffd700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58ac0ff350 0x7f58ac195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.559+0000 7f58aaffd700 1 -- 172.21.15.46:0/3915108810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c0095f0 con 0x7f58ac0ffc60 2024-02-19T19:11:17.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.559+0000 7f58aaffd700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ac0ffc60 0x7f58ac196340 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f58a000c8a0 tx=0x7f58a000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:17.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.559+0000 7f58a8ff9700 1 -- 172.21.15.46:0/3915108810 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a00078e0 con 0x7f58ac0ffc60 2024-02-19T19:11:17.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.559+0000 7f58a8ff9700 1 -- 172.21.15.46:0/3915108810 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58a000f450 con 0x7f58ac0ffc60 2024-02-19T19:11:17.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.559+0000 7f58b21f6700 1 -- 172.21.15.46:0/3915108810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac19aa90 con 0x7f58ac0ffc60 2024-02-19T19:11:17.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.559+0000 7f58a8ff9700 1 -- 172.21.15.46:0/3915108810 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a000e5e0 con 0x7f58ac0ffc60 2024-02-19T19:11:17.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.559+0000 7f58b21f6700 1 -- 172.21.15.46:0/3915108810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac19afe0 con 0x7f58ac0ffc60 2024-02-19T19:11:17.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.560+0000 7f58b21f6700 1 -- 172.21.15.46:0/3915108810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ac107dd0 con 0x7f58ac0ffc60 2024-02-19T19:11:17.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.561+0000 7f58a8ff9700 1 -- 172.21.15.46:0/3915108810 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f58a000f5c0 con 0x7f58ac0ffc60 2024-02-19T19:11:17.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.561+0000 7f58a8ff9700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f589406d8a0 0x7f589406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:17.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.561+0000 7f58a8ff9700 1 -- 172.21.15.46:0/3915108810 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f58a008d620 con 0x7f58ac0ffc60 2024-02-19T19:11:17.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.561+0000 7f58ab7fe700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f589406d8a0 0x7f589406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:17.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.562+0000 7f58ab7fe700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f589406d8a0 0x7f589406fd50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f589c006010 tx=0x7f589c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:17.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.566+0000 7f58a8ff9700 1 -- 172.21.15.46:0/3915108810 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f58a0056cc0 con 0x7f58ac0ffc60 2024-02-19T19:11:17.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:17 smithi142 ceph-mon[69118]: pgmap v246: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:17.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.793+0000 7f58b21f6700 1 -- 172.21.15.46:0/3915108810 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58ac19b2b0 con 0x7f589406d8a0 2024-02-19T19:11:17.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.794+0000 7f58a8ff9700 1 -- 172.21.15.46:0/3915108810 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f58ac19b2b0 con 0x7f589406d8a0 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 -- 172.21.15.46:0/3915108810 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f589406d8a0 msgr2=0x7f589406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f589406d8a0 0x7f589406fd50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f589c006010 tx=0x7f589c01a040 comp rx=0 tx=0).stop 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 -- 172.21.15.46:0/3915108810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ac0ffc60 msgr2=0x7f58ac196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ac0ffc60 0x7f58ac196340 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f58a000c8a0 tx=0x7f58a000cbb0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 -- 172.21.15.46:0/3915108810 shutdown_connections 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f589406d8a0 0x7f589406fd50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58ac0ff350 0x7f58ac195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 --2- 172.21.15.46:0/3915108810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58ac0ffc60 0x7f58ac196340 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 -- 172.21.15.46:0/3915108810 >> 172.21.15.46:0/3915108810 conn(0x7f58ac0748b0 msgr2=0x7f58ac104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 -- 172.21.15.46:0/3915108810 shutdown_connections 2024-02-19T19:11:17.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.796+0000 7f58b21f6700 1 -- 172.21.15.46:0/3915108810 wait complete. 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.903+0000 7f4030380700 1 -- 172.21.15.46:0/1146366043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40280ff3c0 msgr2=0x7f40280ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.903+0000 7f4030380700 1 --2- 172.21.15.46:0/1146366043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40280ff3c0 0x7f40280ff790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f402000b0a0 tx=0x7f402000b3b0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.903+0000 7f4030380700 1 -- 172.21.15.46:0/1146366043 shutdown_connections 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.903+0000 7f4030380700 1 --2- 172.21.15.46:0/1146366043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40280ffd60 0x7f4028103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.903+0000 7f4030380700 1 --2- 172.21.15.46:0/1146366043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40280ff3c0 0x7f40280ff790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.903+0000 7f4030380700 1 -- 172.21.15.46:0/1146366043 >> 172.21.15.46:0/1146366043 conn(0x7f40280fac80 msgr2=0x7f40280fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.903+0000 7f4030380700 1 -- 172.21.15.46:0/1146366043 shutdown_connections 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.903+0000 7f4030380700 1 -- 172.21.15.46:0/1146366043 wait complete. 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.903+0000 7f4030380700 1 Processor -- start 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.903+0000 7f4030380700 1 -- start start 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f4030380700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40280ff3c0 0x7f4028195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:17.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f4030380700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40280ffd60 0x7f40281963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f4030380700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4028196ad0 con 0x7f40280ff3c0 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f4030380700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402819a860 con 0x7f40280ffd60 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f402e11c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40280ff3c0 0x7f4028195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f402e11c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40280ff3c0 0x7f4028195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39468/0 (socket says 172.21.15.46:39468) 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f402e11c700 1 -- 172.21.15.46:0/3261716262 learned_addr learned my addr 172.21.15.46:0/3261716262 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f402d91b700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40280ffd60 0x7f40281963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f402e11c700 1 -- 172.21.15.46:0/3261716262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40280ffd60 msgr2=0x7f40281963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f402e11c700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40280ffd60 0x7f40281963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f402e11c700 1 -- 172.21.15.46:0/3261716262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4020009d00 con 0x7f40280ff3c0 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f402d91b700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40280ffd60 0x7f40281963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f402e11c700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40280ff3c0 0x7f4028195eb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f402000b070 tx=0x7f402000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f401f7fe700 1 -- 172.21.15.46:0/3261716262 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f402000e040 con 0x7f40280ff3c0 2024-02-19T19:11:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f401f7fe700 1 -- 172.21.15.46:0/3261716262 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4020003de0 con 0x7f40280ff3c0 2024-02-19T19:11:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f4030380700 1 -- 172.21.15.46:0/3261716262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402819aae0 con 0x7f40280ff3c0 2024-02-19T19:11:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.904+0000 7f401f7fe700 1 -- 172.21.15.46:0/3261716262 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f402001d8e0 con 0x7f40280ff3c0 2024-02-19T19:11:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.905+0000 7f4030380700 1 -- 172.21.15.46:0/3261716262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402819afd0 con 0x7f40280ff3c0 2024-02-19T19:11:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.906+0000 7f4030380700 1 -- 172.21.15.46:0/3261716262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40281086e0 con 0x7f40280ff3c0 2024-02-19T19:11:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.906+0000 7f401f7fe700 1 -- 172.21.15.46:0/3261716262 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4020004040 con 0x7f40280ff3c0 2024-02-19T19:11:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.906+0000 7f401f7fe700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f401406d8a0 0x7f401406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.907+0000 7f401f7fe700 1 -- 172.21.15.46:0/3261716262 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f402008eeb0 con 0x7f40280ff3c0 2024-02-19T19:11:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.907+0000 7f402d91b700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f401406d8a0 0x7f401406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.907+0000 7f402d91b700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f401406d8a0 0x7f401406fd50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40281974d0 tx=0x7f401800b5f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:17.911+0000 7f401f7fe700 1 -- 172.21.15.46:0/3261716262 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4020058550 con 0x7f40280ff3c0 2024-02-19T19:11:18.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.128+0000 7f4030380700 1 -- 172.21.15.46:0/3261716262 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f402802cca0 con 0x7f401406d8a0 2024-02-19T19:11:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.139+0000 7f401f7fe700 1 -- 172.21.15.46:0/3261716262 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f402802cca0 con 0x7f401406d8a0 2024-02-19T19:11:18.161 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (7m) 12s ago 17m 25.7M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (18m) 12s ago 18m 9139k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (16m) 48s ago 16m 8652k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (4m) 12s ago 18m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (4m) 48s ago 16m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (7m) 12s ago 17m 85.9M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (18s) 12s ago 11m 14.7M - 19.0.0-1450-gf78a58c0 f081f847070a 594407d08977 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (34s) 12s ago 11m 15.5M - 19.0.0-1450-gf78a58c0 f081f847070a c532c6eef6c1 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (11m) 48s ago 11m 18.2M - 18.2.0 dc2bc1663786 3df37a291447 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (11m) 48s ago 11m 119M - 18.2.0 dc2bc1663786 824926ba014b 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (9m) 12s ago 19m 511M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (8m) 48s ago 16m 451M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (5m) 12s ago 19m 56.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:11:18.162 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (5m) 48s ago 16m 41.8M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:11:18.163 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 12s ago 18m 16.7M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:11:18.163 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (8m) 48s ago 16m 17.1M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:11:18.163 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (4m) 12s ago 15m 275M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:11:18.163 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (3m) 12s ago 15m 330M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 974e56511c36 2024-02-19T19:11:18.163 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (2m) 12s ago 14m 193M 1217M 19.0.0-1450-gf78a58c0 f081f847070a a31225ea4dec 2024-02-19T19:11:18.163 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (118s) 48s ago 14m 143M 2240M 19.0.0-1450-gf78a58c0 f081f847070a b46795b87c3e 2024-02-19T19:11:18.163 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (85s) 48s ago 13m 86.6M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 645517de8ff6 2024-02-19T19:11:18.163 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (51s) 48s ago 13m 12.6M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 510ea3b4a23b 2024-02-19T19:11:18.163 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (7m) 12s ago 16m 68.5M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:11:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.141+0000 7f4030380700 1 -- 172.21.15.46:0/3261716262 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f401406d8a0 msgr2=0x7f401406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.141+0000 7f4030380700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f401406d8a0 0x7f401406fd50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40281974d0 tx=0x7f401800b5f0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.141+0000 7f4030380700 1 -- 172.21.15.46:0/3261716262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40280ff3c0 msgr2=0x7f4028195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.141+0000 7f4030380700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40280ff3c0 0x7f4028195eb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f402000b070 tx=0x7f402000cdd0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.141+0000 7f4030380700 1 -- 172.21.15.46:0/3261716262 shutdown_connections 2024-02-19T19:11:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.141+0000 7f4030380700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f401406d8a0 0x7f401406fd50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.141+0000 7f4030380700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40280ff3c0 0x7f4028195eb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.141+0000 7f4030380700 1 --2- 172.21.15.46:0/3261716262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40280ffd60 0x7f40281963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.141+0000 7f4030380700 1 -- 172.21.15.46:0/3261716262 >> 172.21.15.46:0/3261716262 conn(0x7f40280fac80 msgr2=0x7f4028069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:18.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.142+0000 7f4030380700 1 -- 172.21.15.46:0/3261716262 shutdown_connections 2024-02-19T19:11:18.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.142+0000 7f4030380700 1 -- 172.21.15.46:0/3261716262 wait complete. 2024-02-19T19:11:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.246+0000 7f941701c700 1 -- 172.21.15.46:0/263710388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94101003b0 msgr2=0x7f9410100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.246+0000 7f941701c700 1 --2- 172.21.15.46:0/263710388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94101003b0 0x7f9410100780 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f940800b0a0 tx=0x7f940800b3b0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.246+0000 7f941701c700 1 -- 172.21.15.46:0/263710388 shutdown_connections 2024-02-19T19:11:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.246+0000 7f941701c700 1 --2- 172.21.15.46:0/263710388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9410100d50 0x7f9410104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.246+0000 7f941701c700 1 --2- 172.21.15.46:0/263710388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94101003b0 0x7f9410100780 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.246+0000 7f941701c700 1 -- 172.21.15.46:0/263710388 >> 172.21.15.46:0/263710388 conn(0x7f94100fbc70 msgr2=0x7f94100fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.247+0000 7f941701c700 1 -- 172.21.15.46:0/263710388 shutdown_connections 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.247+0000 7f941701c700 1 -- 172.21.15.46:0/263710388 wait complete. 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f941701c700 1 Processor -- start 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f941701c700 1 -- start start 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f941701c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94101003b0 0x7f9410073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f941701c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9410100d50 0x7f9410073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f941701c700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9410073ad0 con 0x7f94101003b0 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f941701c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9410073c10 con 0x7f9410100d50 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f9414db8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94101003b0 0x7f9410073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f9414db8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94101003b0 0x7f9410073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39488/0 (socket says 172.21.15.46:39488) 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f9414db8700 1 -- 172.21.15.46:0/2008567016 learned_addr learned my addr 172.21.15.46:0/2008567016 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:18.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f9414db8700 1 -- 172.21.15.46:0/2008567016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9410100d50 msgr2=0x7f9410073590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:11:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f9414db8700 1 --2- 172.21.15.46:0/2008567016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9410100d50 0x7f9410073590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.248+0000 7f9414db8700 1 -- 172.21.15.46:0/2008567016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9408009d00 con 0x7f94101003b0 2024-02-19T19:11:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.249+0000 7f9414db8700 1 --2- 172.21.15.46:0/2008567016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94101003b0 0x7f9410073050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9408000f80 tx=0x7f940800bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.249+0000 7f940dffb700 1 -- 172.21.15.46:0/2008567016 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f940800e040 con 0x7f94101003b0 2024-02-19T19:11:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.249+0000 7f941701c700 1 -- 172.21.15.46:0/2008567016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9410073e90 con 0x7f94101003b0 2024-02-19T19:11:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.249+0000 7f940dffb700 1 -- 172.21.15.46:0/2008567016 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9408003c10 con 0x7f94101003b0 2024-02-19T19:11:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.249+0000 7f940dffb700 1 -- 172.21.15.46:0/2008567016 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f940801d730 con 0x7f94101003b0 2024-02-19T19:11:18.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.249+0000 7f941701c700 1 -- 172.21.15.46:0/2008567016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94101a21f0 con 0x7f94101003b0 2024-02-19T19:11:18.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.250+0000 7f941701c700 1 -- 172.21.15.46:0/2008567016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94101086c0 con 0x7f94101003b0 2024-02-19T19:11:18.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.251+0000 7f940dffb700 1 -- 172.21.15.46:0/2008567016 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9408019070 con 0x7f94101003b0 2024-02-19T19:11:18.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.251+0000 7f940dffb700 1 --2- 172.21.15.46:0/2008567016 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f93fc06d8a0 0x7f93fc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:18.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.251+0000 7f940dffb700 1 -- 172.21.15.46:0/2008567016 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f940808eb00 con 0x7f94101003b0 2024-02-19T19:11:18.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.251+0000 7f940ffff700 1 --2- 172.21.15.46:0/2008567016 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f93fc06d8a0 0x7f93fc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:18.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.252+0000 7f940ffff700 1 --2- 172.21.15.46:0/2008567016 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f93fc06d8a0 0x7f93fc06fd50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9410074840 tx=0x7f9400009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:18.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.256+0000 7f940dffb700 1 -- 172.21.15.46:0/2008567016 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f94080581a0 con 0x7f94101003b0 2024-02-19T19:11:18.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.552+0000 7f941701c700 1 -- 172.21.15.46:0/2008567016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f941004f2a0 con 0x7f94101003b0 2024-02-19T19:11:18.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:18 smithi046 ceph-mon[88928]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:18.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.553+0000 7f940dffb700 1 -- 172.21.15.46:0/2008567016 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7f940805b860 con 0x7f94101003b0 2024-02-19T19:11:18.575 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:11:18.575 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:11:18.575 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:11:18.575 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:11:18.575 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:11:18.575 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 12 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:11:18.576 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:11:18.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 -- 172.21.15.46:0/2008567016 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f93fc06d8a0 msgr2=0x7f93fc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:18.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 --2- 172.21.15.46:0/2008567016 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f93fc06d8a0 0x7f93fc06fd50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9410074840 tx=0x7f9400009260 comp rx=0 tx=0).stop 2024-02-19T19:11:18.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 -- 172.21.15.46:0/2008567016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94101003b0 msgr2=0x7f9410073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:18.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 --2- 172.21.15.46:0/2008567016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94101003b0 0x7f9410073050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9408000f80 tx=0x7f940800bd10 comp rx=0 tx=0).stop 2024-02-19T19:11:18.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 -- 172.21.15.46:0/2008567016 shutdown_connections 2024-02-19T19:11:18.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 --2- 172.21.15.46:0/2008567016 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f93fc06d8a0 0x7f93fc06fd50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 --2- 172.21.15.46:0/2008567016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94101003b0 0x7f9410073050 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 --2- 172.21.15.46:0/2008567016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9410100d50 0x7f9410073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 -- 172.21.15.46:0/2008567016 >> 172.21.15.46:0/2008567016 conn(0x7f94100fbc70 msgr2=0x7f94100fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 -- 172.21.15.46:0/2008567016 shutdown_connections 2024-02-19T19:11:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.555+0000 7f941701c700 1 -- 172.21.15.46:0/2008567016 wait complete. 2024-02-19T19:11:18.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:18 smithi142 ceph-mon[69118]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.661+0000 7feaa9cf8700 1 -- 172.21.15.46:0/606248652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa4104130 msgr2=0x7feaa4104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.661+0000 7feaa9cf8700 1 --2- 172.21.15.46:0/606248652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa4104130 0x7feaa4104500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea94009910 tx=0x7fea94009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.661+0000 7feaa9cf8700 1 -- 172.21.15.46:0/606248652 shutdown_connections 2024-02-19T19:11:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.661+0000 7feaa9cf8700 1 --2- 172.21.15.46:0/606248652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa40ffbd0 0x7feaa4100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.661+0000 7feaa9cf8700 1 --2- 172.21.15.46:0/606248652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa4104130 0x7feaa4104500 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.661+0000 7feaa9cf8700 1 -- 172.21.15.46:0/606248652 >> 172.21.15.46:0/606248652 conn(0x7feaa4075130 msgr2=0x7feaa4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.661+0000 7feaa9cf8700 1 -- 172.21.15.46:0/606248652 shutdown_connections 2024-02-19T19:11:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.661+0000 7feaa9cf8700 1 -- 172.21.15.46:0/606248652 wait complete. 2024-02-19T19:11:18.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.662+0000 7feaa9cf8700 1 Processor -- start 2024-02-19T19:11:18.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.662+0000 7feaa9cf8700 1 -- start start 2024-02-19T19:11:18.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.662+0000 7feaa9cf8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa40ffbd0 0x7feaa4196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:18.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.662+0000 7feaa9cf8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa4104130 0x7feaa41971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:18.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.662+0000 7feaa9cf8700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa4197810 con 0x7feaa4104130 2024-02-19T19:11:18.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.662+0000 7feaa9cf8700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa4197950 con 0x7feaa40ffbd0 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.662+0000 7feaa2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa4104130 0x7feaa41971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.662+0000 7feaa2ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa4104130 0x7feaa41971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39502/0 (socket says 172.21.15.46:39502) 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.662+0000 7feaa2ffd700 1 -- 172.21.15.46:0/1054699323 learned_addr learned my addr 172.21.15.46:0/1054699323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.663+0000 7feaa2ffd700 1 -- 172.21.15.46:0/1054699323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa40ffbd0 msgr2=0x7feaa4196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.663+0000 7feaa2ffd700 1 --2- 172.21.15.46:0/1054699323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa40ffbd0 0x7feaa4196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.663+0000 7feaa2ffd700 1 -- 172.21.15.46:0/1054699323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea940095f0 con 0x7feaa4104130 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.663+0000 7feaa2ffd700 1 --2- 172.21.15.46:0/1054699323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa4104130 0x7feaa41971f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fea9800d8d0 tx=0x7fea9800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.663+0000 7feaa0ff9700 1 -- 172.21.15.46:0/1054699323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea98009940 con 0x7feaa4104130 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.663+0000 7feaa0ff9700 1 -- 172.21.15.46:0/1054699323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea98010460 con 0x7feaa4104130 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.663+0000 7feaa9cf8700 1 -- 172.21.15.46:0/1054699323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa419fd20 con 0x7feaa4104130 2024-02-19T19:11:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.663+0000 7feaa0ff9700 1 -- 172.21.15.46:0/1054699323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9800f5f0 con 0x7feaa4104130 2024-02-19T19:11:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.663+0000 7feaa9cf8700 1 -- 172.21.15.46:0/1054699323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa41a01e0 con 0x7feaa4104130 2024-02-19T19:11:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.664+0000 7feaa9cf8700 1 -- 172.21.15.46:0/1054699323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa41076a0 con 0x7feaa4104130 2024-02-19T19:11:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.665+0000 7feaa0ff9700 1 -- 172.21.15.46:0/1054699323 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fea980105d0 con 0x7feaa4104130 2024-02-19T19:11:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.665+0000 7feaa0ff9700 1 --2- 172.21.15.46:0/1054699323 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fea8c06d8a0 0x7fea8c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.665+0000 7feaa0ff9700 1 -- 172.21.15.46:0/1054699323 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fea9808d540 con 0x7feaa4104130 2024-02-19T19:11:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.665+0000 7feaa37fe700 1 --2- 172.21.15.46:0/1054699323 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fea8c06d8a0 0x7fea8c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.665+0000 7feaa37fe700 1 --2- 172.21.15.46:0/1054699323 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fea8c06d8a0 0x7fea8c06fd50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fea9400b5c0 tx=0x7fea94005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:18.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.670+0000 7feaa0ff9700 1 -- 172.21.15.46:0/1054699323 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fea98056c60 con 0x7feaa4104130 2024-02-19T19:11:18.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.924+0000 7feaa9cf8700 1 -- 172.21.15.46:0/1054699323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feaa404f2a0 con 0x7feaa4104130 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.924+0000 7feaa0ff9700 1 -- 172.21.15.46:0/1054699323 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1664 (secure 0 0 0) 0x7fea98016690 con 0x7feaa4104130 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stdout:e26 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-19T19:11:18.947 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T19:10:34.708956+0000 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 114 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:11:18.948 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:11:18.949 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:11:18.950 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.142:6826/3954531771,v1:172.21.15.142:6827/3954531771] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:11:18.950 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{-1:34412} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:11:18.950 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{-1:34444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:11:18.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 -- 172.21.15.46:0/1054699323 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fea8c06d8a0 msgr2=0x7fea8c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:18.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 --2- 172.21.15.46:0/1054699323 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fea8c06d8a0 0x7fea8c06fd50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fea9400b5c0 tx=0x7fea94005e20 comp rx=0 tx=0).stop 2024-02-19T19:11:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 -- 172.21.15.46:0/1054699323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa4104130 msgr2=0x7feaa41971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 --2- 172.21.15.46:0/1054699323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa4104130 0x7feaa41971f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fea9800d8d0 tx=0x7fea9800dc90 comp rx=0 tx=0).stop 2024-02-19T19:11:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 -- 172.21.15.46:0/1054699323 shutdown_connections 2024-02-19T19:11:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 --2- 172.21.15.46:0/1054699323 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fea8c06d8a0 0x7fea8c06fd50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 --2- 172.21.15.46:0/1054699323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa40ffbd0 0x7feaa4196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 --2- 172.21.15.46:0/1054699323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa4104130 0x7feaa41971f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 -- 172.21.15.46:0/1054699323 >> 172.21.15.46:0/1054699323 conn(0x7feaa4075130 msgr2=0x7feaa40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 -- 172.21.15.46:0/1054699323 shutdown_connections 2024-02-19T19:11:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:18.927+0000 7feaa9cf8700 1 -- 172.21.15.46:0/1054699323 wait complete. 2024-02-19T19:11:18.951 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 26 2024-02-19T19:11:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.034+0000 7fe637f13700 1 -- 172.21.15.46:0/3347875870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe630106320 msgr2=0x7fe6301066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.034+0000 7fe637f13700 1 --2- 172.21.15.46:0/3347875870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe630106320 0x7fe6301066f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe62800b0a0 tx=0x7fe62800b3b0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.034+0000 7fe637f13700 1 -- 172.21.15.46:0/3347875870 shutdown_connections 2024-02-19T19:11:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.034+0000 7fe637f13700 1 --2- 172.21.15.46:0/3347875870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe630068540 0x7fe6300689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.034+0000 7fe637f13700 1 --2- 172.21.15.46:0/3347875870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe630106320 0x7fe6301066f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.034+0000 7fe637f13700 1 -- 172.21.15.46:0/3347875870 >> 172.21.15.46:0/3347875870 conn(0x7fe630075130 msgr2=0x7fe630075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.034+0000 7fe637f13700 1 -- 172.21.15.46:0/3347875870 shutdown_connections 2024-02-19T19:11:19.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.034+0000 7fe637f13700 1 -- 172.21.15.46:0/3347875870 wait complete. 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.034+0000 7fe637f13700 1 Processor -- start 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe637f13700 1 -- start start 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe637f13700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe630068540 0x7fe6300ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe637f13700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe630106320 0x7fe6301001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe637f13700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6301007b0 con 0x7fe630068540 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe637f13700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe630100920 con 0x7fe630106320 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe635caf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe630068540 0x7fe6300ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe635caf700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe630068540 0x7fe6300ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39524/0 (socket says 172.21.15.46:39524) 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe635caf700 1 -- 172.21.15.46:0/4051647190 learned_addr learned my addr 172.21.15.46:0/4051647190 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe6354ae700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe630106320 0x7fe6301001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe635caf700 1 -- 172.21.15.46:0/4051647190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe630106320 msgr2=0x7fe6301001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe635caf700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe630106320 0x7fe6301001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe635caf700 1 -- 172.21.15.46:0/4051647190 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628009d00 con 0x7fe630068540 2024-02-19T19:11:19.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe635caf700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe630068540 0x7fe6300ffca0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe628000f80 tx=0x7fe628003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.035+0000 7fe62effd700 1 -- 172.21.15.46:0/4051647190 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe62800e040 con 0x7fe630068540 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.036+0000 7fe637f13700 1 -- 172.21.15.46:0/4051647190 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6301a2040 con 0x7fe630068540 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.036+0000 7fe62effd700 1 -- 172.21.15.46:0/4051647190 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe628007c00 con 0x7fe630068540 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.036+0000 7fe62effd700 1 -- 172.21.15.46:0/4051647190 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe62801d6b0 con 0x7fe630068540 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.036+0000 7fe637f13700 1 -- 172.21.15.46:0/4051647190 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6301a23f0 con 0x7fe630068540 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.036+0000 7fe637f13700 1 -- 172.21.15.46:0/4051647190 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe630108790 con 0x7fe630068540 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.037+0000 7fe62effd700 1 -- 172.21.15.46:0/4051647190 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe628004590 con 0x7fe630068540 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.037+0000 7fe62effd700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe61806d8a0 0x7fe61806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.037+0000 7fe62effd700 1 -- 172.21.15.46:0/4051647190 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fe62808ed70 con 0x7fe630068540 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.037+0000 7fe6354ae700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe61806d8a0 0x7fe61806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:19.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.038+0000 7fe6354ae700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe61806d8a0 0x7fe61806fd50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe630101490 tx=0x7fe62400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:19.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.042+0000 7fe62effd700 1 -- 172.21.15.46:0/4051647190 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe628058410 con 0x7fe630068540 2024-02-19T19:11:19.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.267+0000 7fe637f13700 1 -- 172.21.15.46:0/4051647190 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe630061190 con 0x7fe61806d8a0 2024-02-19T19:11:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.268+0000 7fe62effd700 1 -- 172.21.15.46:0/4051647190 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe630061190 con 0x7fe61806d8a0 2024-02-19T19:11:19.290 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:11:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:11:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "14/23 daemons upgraded", 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:11:19.291 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.270+0000 7fe637f13700 1 -- 172.21.15.46:0/4051647190 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe61806d8a0 msgr2=0x7fe61806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.270+0000 7fe637f13700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe61806d8a0 0x7fe61806fd50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe630101490 tx=0x7fe62400b410 comp rx=0 tx=0).stop 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.270+0000 7fe637f13700 1 -- 172.21.15.46:0/4051647190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe630068540 msgr2=0x7fe6300ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.270+0000 7fe637f13700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe630068540 0x7fe6300ffca0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe628000f80 tx=0x7fe628003c30 comp rx=0 tx=0).stop 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.271+0000 7fe637f13700 1 -- 172.21.15.46:0/4051647190 shutdown_connections 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.271+0000 7fe637f13700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fe61806d8a0 0x7fe61806fd50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.271+0000 7fe637f13700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe630068540 0x7fe6300ffca0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.271+0000 7fe637f13700 1 --2- 172.21.15.46:0/4051647190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe630106320 0x7fe6301001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.271+0000 7fe637f13700 1 -- 172.21.15.46:0/4051647190 >> 172.21.15.46:0/4051647190 conn(0x7fe630075130 msgr2=0x7fe6300fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.271+0000 7fe637f13700 1 -- 172.21.15.46:0/4051647190 shutdown_connections 2024-02-19T19:11:19.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.271+0000 7fe637f13700 1 -- 172.21.15.46:0/4051647190 wait complete. 2024-02-19T19:11:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.378+0000 7f66a9a34700 1 -- 172.21.15.46:0/2311345371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66a40ff3c0 msgr2=0x7f66a40ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.378+0000 7f66a9a34700 1 --2- 172.21.15.46:0/2311345371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66a40ff3c0 0x7f66a40ff790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f669400b0a0 tx=0x7f669400b3b0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.378+0000 7f66a9a34700 1 -- 172.21.15.46:0/2311345371 shutdown_connections 2024-02-19T19:11:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.378+0000 7f66a9a34700 1 --2- 172.21.15.46:0/2311345371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a40ffd60 0x7f66a4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.378+0000 7f66a9a34700 1 --2- 172.21.15.46:0/2311345371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66a40ff3c0 0x7f66a40ff790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.378+0000 7f66a9a34700 1 -- 172.21.15.46:0/2311345371 >> 172.21.15.46:0/2311345371 conn(0x7f66a40fac80 msgr2=0x7f66a40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:19.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.378+0000 7f66a9a34700 1 -- 172.21.15.46:0/2311345371 shutdown_connections 2024-02-19T19:11:19.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.378+0000 7f66a9a34700 1 -- 172.21.15.46:0/2311345371 wait complete. 2024-02-19T19:11:19.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.378+0000 7f66a9a34700 1 Processor -- start 2024-02-19T19:11:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a9a34700 1 -- start start 2024-02-19T19:11:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a9a34700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a40ff3c0 0x7f66a4195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a9a34700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66a40ffd60 0x7f66a4196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a9a34700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a4196b20 con 0x7f66a40ffd60 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a9a34700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a419a8b0 con 0x7f66a40ff3c0 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a27fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66a40ffd60 0x7f66a4196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a40ff3c0 0x7f66a4195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a27fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66a40ffd60 0x7f66a4196440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39534/0 (socket says 172.21.15.46:39534) 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a27fc700 1 -- 172.21.15.46:0/3583652976 learned_addr learned my addr 172.21.15.46:0/3583652976 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a27fc700 1 -- 172.21.15.46:0/3583652976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a40ff3c0 msgr2=0x7f66a4195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a27fc700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a40ff3c0 0x7f66a4195f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a27fc700 1 -- 172.21.15.46:0/3583652976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009d00 con 0x7f66a40ffd60 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a2ffd700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a40ff3c0 0x7f66a4195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.379+0000 7f66a27fc700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66a40ffd60 0x7f66a4196440 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f669800d900 tx=0x7f669800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.380+0000 7f66a8a32700 1 -- 172.21.15.46:0/3583652976 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6698009900 con 0x7f66a40ffd60 2024-02-19T19:11:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.380+0000 7f66a9a34700 1 -- 172.21.15.46:0/3583652976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a419ab90 con 0x7f66a40ffd60 2024-02-19T19:11:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.380+0000 7f66a8a32700 1 -- 172.21.15.46:0/3583652976 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6698010460 con 0x7f66a40ffd60 2024-02-19T19:11:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.380+0000 7f66a8a32700 1 -- 172.21.15.46:0/3583652976 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f669800f5f0 con 0x7f66a40ffd60 2024-02-19T19:11:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.380+0000 7f66a9a34700 1 -- 172.21.15.46:0/3583652976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a419b0e0 con 0x7f66a40ffd60 2024-02-19T19:11:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.381+0000 7f66a9a34700 1 -- 172.21.15.46:0/3583652976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a404f2a0 con 0x7f66a40ffd60 2024-02-19T19:11:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.381+0000 7f66a8a32700 1 -- 172.21.15.46:0/3583652976 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f66980105d0 con 0x7f66a40ffd60 2024-02-19T19:11:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.381+0000 7f66a8a32700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f668c06d8a0 0x7f668c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.382+0000 7f66a8a32700 1 -- 172.21.15.46:0/3583652976 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f669808d1f0 con 0x7f66a40ffd60 2024-02-19T19:11:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.382+0000 7f66a2ffd700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f668c06d8a0 0x7f668c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.382+0000 7f66a2ffd700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f668c06d8a0 0x7f668c06fd50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6694000f80 tx=0x7f66940060c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:19.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.386+0000 7f66a8a32700 1 -- 172.21.15.46:0/3583652976 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6698056890 con 0x7f66a40ffd60 2024-02-19T19:11:19.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:19 smithi142 ceph-mon[69118]: pgmap v247: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:19.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:19 smithi142 ceph-mon[69118]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:19.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:19 smithi142 ceph-mon[69118]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:19.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:19 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2008567016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:19.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:19 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1054699323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:11:19.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:19 smithi046 ceph-mon[88928]: pgmap v247: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:19.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:19 smithi046 ceph-mon[88928]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:19.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:19 smithi046 ceph-mon[88928]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:19.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:19 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2008567016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:19.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:19 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1054699323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:11:19.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.679+0000 7f66a9a34700 1 -- 172.21.15.46:0/3583652976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f66a419b300 con 0x7f66a40ffd60 2024-02-19T19:11:19.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.679+0000 7f66a8a32700 1 -- 172.21.15.46:0/3583652976 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f6698059f50 con 0x7f66a40ffd60 2024-02-19T19:11:19.701 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-19T19:11:19.701 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-19T19:11:19.701 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-02-19T19:11:19.702 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-19T19:11:19.702 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.681+0000 7f66a9a34700 1 -- 172.21.15.46:0/3583652976 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f668c06d8a0 msgr2=0x7f668c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.681+0000 7f66a9a34700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f668c06d8a0 0x7f668c06fd50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6694000f80 tx=0x7f66940060c0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.681+0000 7f66a9a34700 1 -- 172.21.15.46:0/3583652976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66a40ffd60 msgr2=0x7f66a4196440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.681+0000 7f66a9a34700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66a40ffd60 0x7f66a4196440 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f669800d900 tx=0x7f669800dc10 comp rx=0 tx=0).stop 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.681+0000 7f66a9a34700 1 -- 172.21.15.46:0/3583652976 shutdown_connections 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.681+0000 7f66a9a34700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f668c06d8a0 0x7f668c06fd50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.681+0000 7f66a9a34700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66a40ff3c0 0x7f66a4195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.681+0000 7f66a9a34700 1 --2- 172.21.15.46:0/3583652976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66a40ffd60 0x7f66a4196440 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.681+0000 7f66a9a34700 1 -- 172.21.15.46:0/3583652976 >> 172.21.15.46:0/3583652976 conn(0x7f66a40fac80 msgr2=0x7f66a41034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.682+0000 7f66a9a34700 1 -- 172.21.15.46:0/3583652976 shutdown_connections 2024-02-19T19:11:19.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:19.682+0000 7f66a9a34700 1 -- 172.21.15.46:0/3583652976 wait complete. 2024-02-19T19:11:20.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:20 smithi046 ceph-mon[88928]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:20.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:20 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3583652976' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:11:20.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:20.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:20.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:20.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:20 smithi142 ceph-mon[69118]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:20.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:20 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3583652976' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:11:20.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:20.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:20.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:21.405 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:21 smithi142 ceph-mon[69118]: pgmap v248: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:21.405 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:21 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.142:6824/315214117,v1:172.21.15.142:6825/315214117] up:boot 2024-02-19T19:11:21.405 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:21 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:11:21.405 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:21 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:11:21.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:21 smithi046 ceph-mon[88928]: pgmap v248: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:21.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:21 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.142:6824/315214117,v1:172.21.15.142:6825/315214117] up:boot 2024-02-19T19:11:21.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:21 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:11:21.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:21 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:11:23.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:23 smithi046 ceph-mon[88928]: pgmap v249: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:23.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:23.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:23.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:23 smithi142 ceph-mon[69118]: pgmap v249: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:23.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:23.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:25.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:25 smithi142 ceph-mon[69118]: pgmap v250: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:25.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:25.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:25.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:25 smithi046 ceph-mon[88928]: pgmap v250: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:25.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:25.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:27.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:27 smithi142 ceph-mon[69118]: pgmap v251: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:27.372 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:27 smithi046 ceph-mon[88928]: pgmap v251: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:28.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:11:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:11:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:28.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:28.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:29.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:29 smithi142 ceph-mon[69118]: pgmap v252: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:29.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:29.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.eqnctx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:11:29.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:30.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:29 smithi046 ceph-mon[88928]: pgmap v252: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:30.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:30.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.eqnctx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:11:30.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:30.867 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:30 smithi142 ceph-mon[69118]: Upgrade: Updating mds.cephfs.smithi142.eqnctx 2024-02-19T19:11:30.867 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:30 smithi142 ceph-mon[69118]: Deploying daemon mds.cephfs.smithi142.eqnctx on smithi142 2024-02-19T19:11:31.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:30 smithi046 ceph-mon[88928]: Upgrade: Updating mds.cephfs.smithi142.eqnctx 2024-02-19T19:11:31.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:30 smithi046 ceph-mon[88928]: Deploying daemon mds.cephfs.smithi142.eqnctx on smithi142 2024-02-19T19:11:31.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:31 smithi142 ceph-mon[69118]: pgmap v253: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:32.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:31 smithi046 ceph-mon[88928]: pgmap v253: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:32.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:32 smithi142 ceph-mon[69118]: osdmap e119: 6 total, 6 up, 6 in 2024-02-19T19:11:32.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:32 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:11:33.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:32 smithi046 ceph-mon[88928]: osdmap e119: 6 total, 6 up, 6 in 2024-02-19T19:11:33.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:32 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:11:33.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:33 smithi142 ceph-mon[69118]: pgmap v255: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:34.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:33 smithi046 ceph-mon[88928]: pgmap v255: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:34.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:34 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:11:35.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:34 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:11:35.663 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:35 smithi142 ceph-mon[69118]: pgmap v256: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:36.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:35 smithi046 ceph-mon[88928]: pgmap v256: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:37.914 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:37 smithi142 ceph-mon[69118]: pgmap v257: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:37.914 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:37.914 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:37.914 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:38.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:37 smithi046 ceph-mon[88928]: pgmap v257: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:38.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:38.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:38.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:38.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:38 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.142:6826/2993903126,v1:172.21.15.142:6827/2993903126] up:boot 2024-02-19T19:11:38.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:38 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:11:38.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:38 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:11:38.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:38 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.142:6826/2993903126,v1:172.21.15.142:6827/2993903126] up:boot 2024-02-19T19:11:38.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:38 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:11:38.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:38 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:11:39.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:39 smithi142 ceph-mon[69118]: pgmap v258: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:40.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:39 smithi046 ceph-mon[88928]: pgmap v258: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:41.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:40 smithi142 ceph-mon[69118]: pgmap v259: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:41.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:40 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:41.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:40 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:41.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:40 smithi046 ceph-mon[88928]: pgmap v259: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:41.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:40 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:41.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:40 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:42.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:42.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:42.316 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:42.316 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:43.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:43 smithi046 ceph-mon[88928]: pgmap v260: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:43.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:43.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:43 smithi142 ceph-mon[69118]: pgmap v260: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:43.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:45.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: pgmap v261: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:45.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:45.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:45.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:45.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:11:45.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:45.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:45.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:45.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.bwvkwa"}]': finished 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.hrbbel"}]': finished 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.eqnctx"}]': finished 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.maazlq"}]': finished 2024-02-19T19:11:45.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-19T19:11:45.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: pgmap v261: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:45.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:45.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.bwvkwa"}]: dispatch 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.bwvkwa"}]': finished 2024-02-19T19:11:45.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.hrbbel"}]: dispatch 2024-02-19T19:11:45.455 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.hrbbel"}]': finished 2024-02-19T19:11:45.455 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.eqnctx"}]: dispatch 2024-02-19T19:11:45.455 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.eqnctx"}]': finished 2024-02-19T19:11:45.455 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.maazlq"}]: dispatch 2024-02-19T19:11:45.455 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.maazlq"}]': finished 2024-02-19T19:11:45.455 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-19T19:11:46.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: Upgrade: Setting container_image for all mds 2024-02-19T19:11:46.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: Upgrade: Setting filesystem cephfs Joinable 2024-02-19T19:11:46.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-19T19:11:46.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: Standby daemon mds.cephfs.smithi046.hrbbel assigned to filesystem cephfs as rank 0 2024-02-19T19:11:46.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: Standby daemon mds.cephfs.smithi046.bwvkwa assigned to filesystem cephfs as rank 1 2024-02-19T19:11:46.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-19T19:11:46.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:11:46.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: fsmap cephfs:2/2 {0=cephfs.smithi046.hrbbel=up:replay,1=cephfs.smithi046.bwvkwa=up:replay} 2 up:standby 2024-02-19T19:11:46.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:46.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:46.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:46.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:46.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:46 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:46.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: Upgrade: Setting container_image for all mds 2024-02-19T19:11:46.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: Upgrade: Setting filesystem cephfs Joinable 2024-02-19T19:11:46.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-19T19:11:46.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: Standby daemon mds.cephfs.smithi046.hrbbel assigned to filesystem cephfs as rank 0 2024-02-19T19:11:46.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: Standby daemon mds.cephfs.smithi046.bwvkwa assigned to filesystem cephfs as rank 1 2024-02-19T19:11:46.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-19T19:11:46.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:11:46.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: fsmap cephfs:2/2 {0=cephfs.smithi046.hrbbel=up:replay,1=cephfs.smithi046.bwvkwa=up:replay} 2 up:standby 2024-02-19T19:11:46.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:46.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:46.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:46.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:46.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:46 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:47.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:47 smithi046 ceph-mon[88928]: pgmap v262: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:47.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:47 smithi046 ceph-mon[88928]: Upgrade: Setting container_image for all rgw 2024-02-19T19:11:47.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:47 smithi046 ceph-mon[88928]: Upgrade: Setting container_image for all rbd-mirror 2024-02-19T19:11:47.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:47 smithi142 ceph-mon[69118]: pgmap v262: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:47.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:47 smithi142 ceph-mon[69118]: Upgrade: Setting container_image for all rgw 2024-02-19T19:11:47.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:47 smithi142 ceph-mon[69118]: Upgrade: Setting container_image for all rbd-mirror 2024-02-19T19:11:49.197 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:49 smithi046 ceph-mon[88928]: pgmap v263: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:49.197 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:49 smithi046 ceph-mon[88928]: Upgrade: Updating ceph-exporter.smithi046 (1/2) 2024-02-19T19:11:49.197 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:49.197 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:11:49.197 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:49.197 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:49 smithi046 ceph-mon[88928]: Deploying daemon ceph-exporter.smithi046 on smithi046 2024-02-19T19:11:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:49 smithi142 ceph-mon[69118]: pgmap v263: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:11:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:49 smithi142 ceph-mon[69118]: Upgrade: Updating ceph-exporter.smithi046 (1/2) 2024-02-19T19:11:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:11:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:49.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:49 smithi142 ceph-mon[69118]: Deploying daemon ceph-exporter.smithi046 on smithi046 2024-02-19T19:11:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.855+0000 7f6b9c57f700 1 -- 172.21.15.46:0/4093905306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b94069140 msgr2=0x7f6b94104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.855+0000 7f6b9c57f700 1 --2- 172.21.15.46:0/4093905306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b94069140 0x7f6b94104eb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009910 tx=0x7f6b84009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.855+0000 7f6b9c57f700 1 -- 172.21.15.46:0/4093905306 shutdown_connections 2024-02-19T19:11:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.855+0000 7f6b9c57f700 1 --2- 172.21.15.46:0/4093905306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b94069140 0x7f6b94104eb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:49.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.855+0000 7f6b9c57f700 1 --2- 172.21.15.46:0/4093905306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b940687a0 0x7f6b94068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.855+0000 7f6b9c57f700 1 -- 172.21.15.46:0/4093905306 >> 172.21.15.46:0/4093905306 conn(0x7f6b94075130 msgr2=0x7f6b94075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.855+0000 7f6b9c57f700 1 -- 172.21.15.46:0/4093905306 shutdown_connections 2024-02-19T19:11:49.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.855+0000 7f6b9c57f700 1 -- 172.21.15.46:0/4093905306 wait complete. 2024-02-19T19:11:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.856+0000 7f6b9c57f700 1 Processor -- start 2024-02-19T19:11:49.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.857+0000 7f6b9c57f700 1 -- start start 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.857+0000 7f6b9c57f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b940687a0 0x7f6b94195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.857+0000 7f6b9c57f700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b94069140 0x7f6b941964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.857+0000 7f6b9c57f700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94196ba0 con 0x7f6b94069140 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.857+0000 7f6b9c57f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9419a930 con 0x7f6b940687a0 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.857+0000 7f6b99b1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b94069140 0x7f6b941964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.857+0000 7f6b99b1a700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b94069140 0x7f6b941964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46742/0 (socket says 172.21.15.46:46742) 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.857+0000 7f6b99b1a700 1 -- 172.21.15.46:0/3192983577 learned_addr learned my addr 172.21.15.46:0/3192983577 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.857+0000 7f6b9a31b700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b940687a0 0x7f6b94195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.858+0000 7f6b99b1a700 1 -- 172.21.15.46:0/3192983577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b940687a0 msgr2=0x7f6b94195f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.858+0000 7f6b99b1a700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b940687a0 0x7f6b94195f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.858+0000 7f6b99b1a700 1 -- 172.21.15.46:0/3192983577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840095f0 con 0x7f6b94069140 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.858+0000 7f6b99b1a700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b94069140 0x7f6b941964c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6b84005f50 tx=0x7f6b8400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.858+0000 7f6b8b7fe700 1 -- 172.21.15.46:0/3192983577 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b8401d070 con 0x7f6b94069140 2024-02-19T19:11:49.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.858+0000 7f6b9c57f700 1 -- 172.21.15.46:0/3192983577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9419abb0 con 0x7f6b94069140 2024-02-19T19:11:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.858+0000 7f6b8b7fe700 1 -- 172.21.15.46:0/3192983577 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b8400f460 con 0x7f6b94069140 2024-02-19T19:11:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.858+0000 7f6b8b7fe700 1 -- 172.21.15.46:0/3192983577 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b84017630 con 0x7f6b94069140 2024-02-19T19:11:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.858+0000 7f6b9c57f700 1 -- 172.21.15.46:0/3192983577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9419b0a0 con 0x7f6b94069140 2024-02-19T19:11:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.860+0000 7f6b9c57f700 1 -- 172.21.15.46:0/3192983577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b941087e0 con 0x7f6b94069140 2024-02-19T19:11:49.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.860+0000 7f6b8b7fe700 1 -- 172.21.15.46:0/3192983577 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6b8400f5d0 con 0x7f6b94069140 2024-02-19T19:11:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.861+0000 7f6b8b7fe700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6b8006d8a0 0x7f6b8006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.861+0000 7f6b8b7fe700 1 -- 172.21.15.46:0/3192983577 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f6b8408eba0 con 0x7f6b94069140 2024-02-19T19:11:49.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.861+0000 7f6b9a31b700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6b8006d8a0 0x7f6b8006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:49.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.862+0000 7f6b9a31b700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6b8006d8a0 0x7f6b8006fd50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009a10 tx=0x7f6b90009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:49.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:49.866+0000 7f6b8b7fe700 1 -- 172.21.15.46:0/3192983577 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6b84058240 con 0x7f6b94069140 2024-02-19T19:11:50.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.191+0000 7f6b9c57f700 1 -- 172.21.15.46:0/3192983577 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b941973f0 con 0x7f6b8006d8a0 2024-02-19T19:11:50.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.193+0000 7f6b8b7fe700 1 -- 172.21.15.46:0/3192983577 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f6b941973f0 con 0x7f6b8006d8a0 2024-02-19T19:11:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.195+0000 7f6b9c57f700 1 -- 172.21.15.46:0/3192983577 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6b8006d8a0 msgr2=0x7f6b8006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.195+0000 7f6b9c57f700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6b8006d8a0 0x7f6b8006fd50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009a10 tx=0x7f6b90009190 comp rx=0 tx=0).stop 2024-02-19T19:11:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.196+0000 7f6b9c57f700 1 -- 172.21.15.46:0/3192983577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b94069140 msgr2=0x7f6b941964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.196+0000 7f6b9c57f700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b94069140 0x7f6b941964c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6b84005f50 tx=0x7f6b8400bd70 comp rx=0 tx=0).stop 2024-02-19T19:11:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.196+0000 7f6b9c57f700 1 -- 172.21.15.46:0/3192983577 shutdown_connections 2024-02-19T19:11:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.196+0000 7f6b9c57f700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6b8006d8a0 0x7f6b8006fd50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.196+0000 7f6b9c57f700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b940687a0 0x7f6b94195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.196+0000 7f6b9c57f700 1 --2- 172.21.15.46:0/3192983577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b94069140 0x7f6b941964c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.196+0000 7f6b9c57f700 1 -- 172.21.15.46:0/3192983577 >> 172.21.15.46:0/3192983577 conn(0x7f6b94075130 msgr2=0x7f6b940fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.196+0000 7f6b9c57f700 1 -- 172.21.15.46:0/3192983577 shutdown_connections 2024-02-19T19:11:50.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.196+0000 7f6b9c57f700 1 -- 172.21.15.46:0/3192983577 wait complete. 2024-02-19T19:11:50.233 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:11:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.313+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3721991867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e24068540 msgr2=0x7f1e240689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.313+0000 7f1e2a82d700 1 --2- 172.21.15.46:0/3721991867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e24068540 0x7f1e240689b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009910 tx=0x7f1e18009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.313+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3721991867 shutdown_connections 2024-02-19T19:11:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.313+0000 7f1e2a82d700 1 --2- 172.21.15.46:0/3721991867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e24068540 0x7f1e240689b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.313+0000 7f1e2a82d700 1 --2- 172.21.15.46:0/3721991867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e24106320 0x7f1e241066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.313+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3721991867 >> 172.21.15.46:0/3721991867 conn(0x7f1e24075130 msgr2=0x7f1e24075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:50.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.314+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3721991867 shutdown_connections 2024-02-19T19:11:50.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.314+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3721991867 wait complete. 2024-02-19T19:11:50.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.315+0000 7f1e2a82d700 1 Processor -- start 2024-02-19T19:11:50.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.315+0000 7f1e2a82d700 1 -- start start 2024-02-19T19:11:50.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.315+0000 7f1e2a82d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e24068540 0x7f1e24193ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:50.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.315+0000 7f1e2a82d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e24106320 0x7f1e24194000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.315+0000 7f1e2a82d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24196c40 con 0x7f1e24106320 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.315+0000 7f1e2a82d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24196db0 con 0x7f1e24068540 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.316+0000 7f1e23fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e24068540 0x7f1e24193ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.316+0000 7f1e23fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e24068540 0x7f1e24193ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:37084/0 (socket says 172.21.15.46:37084) 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.316+0000 7f1e23fff700 1 -- 172.21.15.46:0/3923421877 learned_addr learned my addr 172.21.15.46:0/3923421877 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.316+0000 7f1e237fe700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e24106320 0x7f1e24194000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.316+0000 7f1e237fe700 1 -- 172.21.15.46:0/3923421877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e24068540 msgr2=0x7f1e24193ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.317+0000 7f1e237fe700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e24068540 0x7f1e24193ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.317+0000 7f1e237fe700 1 -- 172.21.15.46:0/3923421877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180095f0 con 0x7f1e24106320 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.317+0000 7f1e23fff700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e24068540 0x7f1e24193ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.317+0000 7f1e237fe700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e24106320 0x7f1e24194000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009910 tx=0x7f1e180057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:50.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.317+0000 7f1e217fa700 1 -- 172.21.15.46:0/3923421877 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e18003680 con 0x7f1e24106320 2024-02-19T19:11:50.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.317+0000 7f1e217fa700 1 -- 172.21.15.46:0/3923421877 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e1802e070 con 0x7f1e24106320 2024-02-19T19:11:50.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.317+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3923421877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e24194600 con 0x7f1e24106320 2024-02-19T19:11:50.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.317+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3923421877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e241970f0 con 0x7f1e24106320 2024-02-19T19:11:50.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.317+0000 7f1e217fa700 1 -- 172.21.15.46:0/3923421877 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e1800fc50 con 0x7f1e24106320 2024-02-19T19:11:50.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.319+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3923421877 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e10005320 con 0x7f1e24106320 2024-02-19T19:11:50.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.319+0000 7f1e217fa700 1 -- 172.21.15.46:0/3923421877 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1e18030030 con 0x7f1e24106320 2024-02-19T19:11:50.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.320+0000 7f1e217fa700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1e0c06d8a0 0x7f1e0c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:50.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.320+0000 7f1e217fa700 1 -- 172.21.15.46:0/3923421877 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f1e1809f560 con 0x7f1e24106320 2024-02-19T19:11:50.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.320+0000 7f1e23fff700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1e0c06d8a0 0x7f1e0c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:50.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.321+0000 7f1e23fff700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1e0c06d8a0 0x7f1e0c06fd50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1e14005950 tx=0x7f1e1400b500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:50.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.325+0000 7f1e217fa700 1 -- 172.21.15.46:0/3923421877 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1e18068b60 con 0x7f1e24106320 2024-02-19T19:11:50.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.661+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3923421877 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e10000bf0 con 0x7f1e0c06d8a0 2024-02-19T19:11:50.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.663+0000 7f1e217fa700 1 -- 172.21.15.46:0/3923421877 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f1e10000bf0 con 0x7f1e0c06d8a0 2024-02-19T19:11:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1e0c06d8a0 msgr2=0x7f1e0c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1e0c06d8a0 0x7f1e0c06fd50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1e14005950 tx=0x7f1e1400b500 comp rx=0 tx=0).stop 2024-02-19T19:11:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e24106320 msgr2=0x7f1e24194000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e24106320 0x7f1e24194000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009910 tx=0x7f1e180057e0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3923421877 shutdown_connections 2024-02-19T19:11:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1e0c06d8a0 0x7f1e0c06fd50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e24068540 0x7f1e24193ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 --2- 172.21.15.46:0/3923421877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e24106320 0x7f1e24194000 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3923421877 >> 172.21.15.46:0/3923421877 conn(0x7f1e24075130 msgr2=0x7f1e240fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3923421877 shutdown_connections 2024-02-19T19:11:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.665+0000 7f1e2a82d700 1 -- 172.21.15.46:0/3923421877 wait complete. 2024-02-19T19:11:50.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.777+0000 7fb78aef4700 1 -- 172.21.15.46:0/3867248726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7840ffd60 msgr2=0x7fb784103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:50.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.777+0000 7fb78aef4700 1 --2- 172.21.15.46:0/3867248726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7840ffd60 0x7fb784103d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb770009910 tx=0x7fb770009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:50.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.777+0000 7fb78aef4700 1 -- 172.21.15.46:0/3867248726 shutdown_connections 2024-02-19T19:11:50.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.777+0000 7fb78aef4700 1 --2- 172.21.15.46:0/3867248726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7840ffd60 0x7fb784103d30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.777+0000 7fb78aef4700 1 --2- 172.21.15.46:0/3867248726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7840ff3c0 0x7fb7840ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.777+0000 7fb78aef4700 1 -- 172.21.15.46:0/3867248726 >> 172.21.15.46:0/3867248726 conn(0x7fb7840fac60 msgr2=0x7fb7840fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:50.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.777+0000 7fb78aef4700 1 -- 172.21.15.46:0/3867248726 shutdown_connections 2024-02-19T19:11:50.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.777+0000 7fb78aef4700 1 -- 172.21.15.46:0/3867248726 wait complete. 2024-02-19T19:11:50.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.778+0000 7fb78aef4700 1 Processor -- start 2024-02-19T19:11:50.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.778+0000 7fb78aef4700 1 -- start start 2024-02-19T19:11:50.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.779+0000 7fb78aef4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7840ff3c0 0x7fb784194db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:50.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.779+0000 7fb78aef4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7840ffd60 0x7fb7841952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:50.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.779+0000 7fb783fff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7840ffd60 0x7fb7841952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:50.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.779+0000 7fb788c90700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7840ff3c0 0x7fb784194db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:50.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.779+0000 7fb788c90700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7840ff3c0 0x7fb784194db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:37090/0 (socket says 172.21.15.46:37090) 2024-02-19T19:11:50.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.779+0000 7fb788c90700 1 -- 172.21.15.46:0/1133606404 learned_addr learned my addr 172.21.15.46:0/1133606404 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:50.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.779+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7841959d0 con 0x7fb7840ffd60 2024-02-19T19:11:50.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.779+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb784199760 con 0x7fb7840ff3c0 2024-02-19T19:11:50.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.780+0000 7fb783fff700 1 -- 172.21.15.46:0/1133606404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7840ff3c0 msgr2=0x7fb784194db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:50.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.780+0000 7fb783fff700 1 --2- 172.21.15.46:0/1133606404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7840ff3c0 0x7fb784194db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:50.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.780+0000 7fb783fff700 1 -- 172.21.15.46:0/1133606404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700095f0 con 0x7fb7840ffd60 2024-02-19T19:11:50.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.780+0000 7fb783fff700 1 --2- 172.21.15.46:0/1133606404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7840ffd60 0x7fb7841952f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb784067fb0 tx=0x7fb77000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:50.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.780+0000 7fb781ffb700 1 -- 172.21.15.46:0/1133606404 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77001d070 con 0x7fb7840ffd60 2024-02-19T19:11:50.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.780+0000 7fb781ffb700 1 -- 172.21.15.46:0/1133606404 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb770005dc0 con 0x7fb7840ffd60 2024-02-19T19:11:50.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.780+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7841999e0 con 0x7fb7840ffd60 2024-02-19T19:11:50.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.780+0000 7fb781ffb700 1 -- 172.21.15.46:0/1133606404 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77000fe80 con 0x7fb7840ffd60 2024-02-19T19:11:50.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.781+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb784199dc0 con 0x7fb7840ffd60 2024-02-19T19:11:50.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.782+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78404f2a0 con 0x7fb7840ffd60 2024-02-19T19:11:50.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.783+0000 7fb781ffb700 1 -- 172.21.15.46:0/1133606404 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb77000f6f0 con 0x7fb7840ffd60 2024-02-19T19:11:50.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.783+0000 7fb781ffb700 1 --2- 172.21.15.46:0/1133606404 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb77406fab0 0x7fb774071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:50.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.783+0000 7fb781ffb700 1 -- 172.21.15.46:0/1133606404 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fb77008e920 con 0x7fb7840ffd60 2024-02-19T19:11:50.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.784+0000 7fb788c90700 1 --2- 172.21.15.46:0/1133606404 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb77406fab0 0x7fb774071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:50.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.784+0000 7fb788c90700 1 --2- 172.21.15.46:0/1133606404 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb77406fab0 0x7fb774071f60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb778009550 tx=0x7fb778009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:50.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:50.792+0000 7fb781ffb700 1 -- 172.21.15.46:0/1133606404 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb770058040 con 0x7fb7840ffd60 2024-02-19T19:11:51.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.021+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb78419a1a0 con 0x7fb77406fab0 2024-02-19T19:11:51.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.034+0000 7fb781ffb700 1 -- 172.21.15.46:0/1133606404 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fb78419a1a0 con 0x7fb77406fab0 2024-02-19T19:11:51.056 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:11:51.056 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (8m) 45s ago 18m 25.7M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:11:51.056 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (18m) 45s ago 18m 9139k - 18.2.0 dc2bc1663786 f48fbac1f303 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (17m) 11s ago 17m 8766k - 18.2.0 dc2bc1663786 8f759778dd94 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (5m) 45s ago 18m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (5m) 11s ago 17m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (7m) 45s ago 17m 85.9M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (50s) 45s ago 12m 14.7M - 19.0.0-1450-gf78a58c0 f081f847070a 594407d08977 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (67s) 45s ago 12m 15.5M - 19.0.0-1450-gf78a58c0 f081f847070a c532c6eef6c1 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (14s) 11s ago 12m 13.7M - 19.0.0-1450-gf78a58c0 f081f847070a dbe9e8c442ce 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (31s) 11s ago 12m 12.5M - 19.0.0-1450-gf78a58c0 f081f847070a 8bb16a987136 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (9m) 45s ago 19m 511M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (9m) 11s ago 16m 451M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (6m) 45s ago 20m 56.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:11:51.057 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (6m) 11s ago 16m 46.5M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:11:51.058 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 45s ago 18m 16.7M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:11:51.058 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (8m) 11s ago 16m 16.5M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:11:51.058 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (4m) 45s ago 16m 275M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:11:51.058 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (4m) 45s ago 15m 330M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 974e56511c36 2024-02-19T19:11:51.058 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (3m) 45s ago 15m 193M 1217M 19.0.0-1450-gf78a58c0 f081f847070a a31225ea4dec 2024-02-19T19:11:51.058 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (2m) 11s ago 14m 144M 2240M 19.0.0-1450-gf78a58c0 f081f847070a b46795b87c3e 2024-02-19T19:11:51.058 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (118s) 11s ago 14m 87.2M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 645517de8ff6 2024-02-19T19:11:51.058 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (84s) 11s ago 13m 91.2M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 510ea3b4a23b 2024-02-19T19:11:51.058 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (8m) 45s ago 17m 68.5M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:11:51.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb77406fab0 msgr2=0x7fb774071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:51.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 --2- 172.21.15.46:0/1133606404 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb77406fab0 0x7fb774071f60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb778009550 tx=0x7fb778009040 comp rx=0 tx=0).stop 2024-02-19T19:11:51.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7840ffd60 msgr2=0x7fb7841952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:51.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 --2- 172.21.15.46:0/1133606404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7840ffd60 0x7fb7841952f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb784067fb0 tx=0x7fb77000bd70 comp rx=0 tx=0).stop 2024-02-19T19:11:51.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 shutdown_connections 2024-02-19T19:11:51.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 --2- 172.21.15.46:0/1133606404 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb77406fab0 0x7fb774071f60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 --2- 172.21.15.46:0/1133606404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7840ff3c0 0x7fb784194db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 --2- 172.21.15.46:0/1133606404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7840ffd60 0x7fb7841952f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 >> 172.21.15.46:0/1133606404 conn(0x7fb7840fac60 msgr2=0x7fb7840fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:51.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 shutdown_connections 2024-02-19T19:11:51.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.037+0000 7fb78aef4700 1 -- 172.21.15.46:0/1133606404 wait complete. 2024-02-19T19:11:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.151+0000 7f3a04fda700 1 -- 172.21.15.46:0/3484133430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a00104130 msgr2=0x7f3a00104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.151+0000 7f3a04fda700 1 --2- 172.21.15.46:0/3484133430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a00104130 0x7f3a00104500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009910 tx=0x7f39f0009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.151+0000 7f3a04fda700 1 -- 172.21.15.46:0/3484133430 shutdown_connections 2024-02-19T19:11:51.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.151+0000 7f3a04fda700 1 --2- 172.21.15.46:0/3484133430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a000ffbd0 0x7f3a00100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.151+0000 7f3a04fda700 1 --2- 172.21.15.46:0/3484133430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a00104130 0x7f3a00104500 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.151+0000 7f3a04fda700 1 -- 172.21.15.46:0/3484133430 >> 172.21.15.46:0/3484133430 conn(0x7f3a00075130 msgr2=0x7f3a00075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.151+0000 7f3a04fda700 1 -- 172.21.15.46:0/3484133430 shutdown_connections 2024-02-19T19:11:51.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.151+0000 7f3a04fda700 1 -- 172.21.15.46:0/3484133430 wait complete. 2024-02-19T19:11:51.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.152+0000 7f3a04fda700 1 Processor -- start 2024-02-19T19:11:51.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.152+0000 7f3a04fda700 1 -- start start 2024-02-19T19:11:51.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.152+0000 7f3a04fda700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a000ffbd0 0x7f3a00195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:51.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.152+0000 7f3a04fda700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a00104130 0x7f3a00196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:51.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.152+0000 7f3a04fda700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a00196bf0 con 0x7f3a000ffbd0 2024-02-19T19:11:51.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.152+0000 7f3a04fda700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0019a980 con 0x7f3a00104130 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.152+0000 7f39fe59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a000ffbd0 0x7f3a00195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.152+0000 7f39fdd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a00104130 0x7f3a00196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.152+0000 7f39fe59c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a000ffbd0 0x7f3a00195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46796/0 (socket says 172.21.15.46:46796) 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.152+0000 7f39fe59c700 1 -- 172.21.15.46:0/4209759293 learned_addr learned my addr 172.21.15.46:0/4209759293 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.153+0000 7f39fdd9b700 1 -- 172.21.15.46:0/4209759293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a000ffbd0 msgr2=0x7f3a00195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.153+0000 7f39fdd9b700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a000ffbd0 0x7f3a00195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.153+0000 7f39fdd9b700 1 -- 172.21.15.46:0/4209759293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00095f0 con 0x7f3a00104130 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.153+0000 7f39fe59c700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a000ffbd0 0x7f3a00195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.153+0000 7f39fdd9b700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a00104130 0x7f3a00196510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f39f400f9e0 tx=0x7f39f400fcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.153+0000 7f39ef7fe700 1 -- 172.21.15.46:0/4209759293 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f401a650 con 0x7f3a00104130 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.153+0000 7f39ef7fe700 1 -- 172.21.15.46:0/4209759293 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39f400d2e0 con 0x7f3a00104130 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.153+0000 7f3a04fda700 1 -- 172.21.15.46:0/4209759293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0019ac00 con 0x7f3a00104130 2024-02-19T19:11:51.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.153+0000 7f39ef7fe700 1 -- 172.21.15.46:0/4209759293 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39f400bc40 con 0x7f3a00104130 2024-02-19T19:11:51.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.153+0000 7f3a04fda700 1 -- 172.21.15.46:0/4209759293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0019b150 con 0x7f3a00104130 2024-02-19T19:11:51.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.155+0000 7f3a04fda700 1 -- 172.21.15.46:0/4209759293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0004f2a0 con 0x7f3a00104130 2024-02-19T19:11:51.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.155+0000 7f39ef7fe700 1 -- 172.21.15.46:0/4209759293 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f39f401a7b0 con 0x7f3a00104130 2024-02-19T19:11:51.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.155+0000 7f39ef7fe700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f39e806d8f0 0x7f39e806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:51.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.155+0000 7f39ef7fe700 1 -- 172.21.15.46:0/4209759293 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f39f4015070 con 0x7f3a00104130 2024-02-19T19:11:51.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.155+0000 7f39fe59c700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f39e806d8f0 0x7f39e806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:51.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.156+0000 7f39fe59c700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f39e806d8f0 0x7f39e806fda0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39f0005850 tx=0x7f39f001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:51.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.160+0000 7f39ef7fe700 1 -- 172.21.15.46:0/4209759293 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f39f405a4d0 con 0x7f3a00104130 2024-02-19T19:11:51.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:51 smithi046 ceph-mon[88928]: pgmap v264: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.3 MiB/s rd, 1 op/s 2024-02-19T19:11:51.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:51 smithi046 ceph-mon[88928]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:51.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:51 smithi142 ceph-mon[69118]: pgmap v264: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.3 MiB/s rd, 1 op/s 2024-02-19T19:11:51.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:51 smithi142 ceph-mon[69118]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:51.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.460+0000 7f3a04fda700 1 -- 172.21.15.46:0/4209759293 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3a0019b3c0 con 0x7f3a00104130 2024-02-19T19:11:51.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.460+0000 7f39ef7fe700 1 -- 172.21.15.46:0/4209759293 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f39f400be60 con 0x7f3a00104130 2024-02-19T19:11:51.483 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:11:51.483 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:11:51.483 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:11:51.483 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:11:51.483 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:11:51.483 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:11:51.483 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:11:51.483 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:11:51.483 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:11:51.484 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:11:51.484 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:11:51.484 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:11:51.484 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:11:51.484 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:11:51.484 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-19T19:11:51.484 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:11:51.484 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:11:51.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 -- 172.21.15.46:0/4209759293 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f39e806d8f0 msgr2=0x7f39e806fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f39e806d8f0 0x7f39e806fda0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39f0005850 tx=0x7f39f001a040 comp rx=0 tx=0).stop 2024-02-19T19:11:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 -- 172.21.15.46:0/4209759293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a00104130 msgr2=0x7f3a00196510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a00104130 0x7f3a00196510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f39f400f9e0 tx=0x7f39f400fcf0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 -- 172.21.15.46:0/4209759293 shutdown_connections 2024-02-19T19:11:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f39e806d8f0 0x7f39e806fda0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a000ffbd0 0x7f3a00195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 --2- 172.21.15.46:0/4209759293 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a00104130 0x7f3a00196510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 -- 172.21.15.46:0/4209759293 >> 172.21.15.46:0/4209759293 conn(0x7f3a00075130 msgr2=0x7f3a00109220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 -- 172.21.15.46:0/4209759293 shutdown_connections 2024-02-19T19:11:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.463+0000 7f3a04fda700 1 -- 172.21.15.46:0/4209759293 wait complete. 2024-02-19T19:11:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.575+0000 7f6d92828700 1 -- 172.21.15.46:0/1006375267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d8c0ff350 msgr2=0x7f6d8c0ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.575+0000 7f6d92828700 1 --2- 172.21.15.46:0/1006375267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d8c0ff350 0x7f6d8c0ff7c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000aa20 tx=0x7f6d8000ad30 comp rx=0 tx=0).stop 2024-02-19T19:11:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.575+0000 7f6d92828700 1 -- 172.21.15.46:0/1006375267 shutdown_connections 2024-02-19T19:11:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.575+0000 7f6d92828700 1 --2- 172.21.15.46:0/1006375267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d8c0ff350 0x7f6d8c0ff7c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.575+0000 7f6d92828700 1 --2- 172.21.15.46:0/1006375267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d8c1038b0 0x7f6d8c103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.575+0000 7f6d92828700 1 -- 172.21.15.46:0/1006375267 >> 172.21.15.46:0/1006375267 conn(0x7f6d8c0748b0 msgr2=0x7f6d8c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.575+0000 7f6d92828700 1 -- 172.21.15.46:0/1006375267 shutdown_connections 2024-02-19T19:11:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.575+0000 7f6d92828700 1 -- 172.21.15.46:0/1006375267 wait complete. 2024-02-19T19:11:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.576+0000 7f6d92828700 1 Processor -- start 2024-02-19T19:11:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.576+0000 7f6d92828700 1 -- start start 2024-02-19T19:11:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.576+0000 7f6d92828700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d8c0ff350 0x7f6d8c195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.576+0000 7f6d92828700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d8c1038b0 0x7f6d8c196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.576+0000 7f6d92828700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c196ae0 con 0x7f6d8c0ff350 2024-02-19T19:11:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.576+0000 7f6d92828700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c19a870 con 0x7f6d8c1038b0 2024-02-19T19:11:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.576+0000 7f6d8bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d8c0ff350 0x7f6d8c195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.576+0000 7f6d8bfff700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d8c0ff350 0x7f6d8c195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46812/0 (socket says 172.21.15.46:46812) 2024-02-19T19:11:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.576+0000 7f6d8bfff700 1 -- 172.21.15.46:0/2871219263 learned_addr learned my addr 172.21.15.46:0/2871219263 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d8b7fe700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d8c1038b0 0x7f6d8c196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d8bfff700 1 -- 172.21.15.46:0/2871219263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d8c1038b0 msgr2=0x7f6d8c196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d8bfff700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d8c1038b0 0x7f6d8c196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d8bfff700 1 -- 172.21.15.46:0/2871219263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8000a700 con 0x7f6d8c0ff350 2024-02-19T19:11:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d8b7fe700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d8c1038b0 0x7f6d8c196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:11:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d8bfff700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d8c0ff350 0x7f6d8c195ec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00b4b0 tx=0x7f6d7c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d897fa700 1 -- 172.21.15.46:0/2871219263 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d7c011800 con 0x7f6d8c0ff350 2024-02-19T19:11:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d92828700 1 -- 172.21.15.46:0/2871219263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8c19ab50 con 0x7f6d8c0ff350 2024-02-19T19:11:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d897fa700 1 -- 172.21.15.46:0/2871219263 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d7c011e20 con 0x7f6d8c0ff350 2024-02-19T19:11:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d897fa700 1 -- 172.21.15.46:0/2871219263 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d7c00f2e0 con 0x7f6d8c0ff350 2024-02-19T19:11:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.577+0000 7f6d92828700 1 -- 172.21.15.46:0/2871219263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8c19b0a0 con 0x7f6d8c0ff350 2024-02-19T19:11:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.578+0000 7f6d92828700 1 -- 172.21.15.46:0/2871219263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8c106e20 con 0x7f6d8c0ff350 2024-02-19T19:11:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.579+0000 7f6d897fa700 1 -- 172.21.15.46:0/2871219263 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6d7c010380 con 0x7f6d8c0ff350 2024-02-19T19:11:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.579+0000 7f6d897fa700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6d7406d8a0 0x7f6d7406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.580+0000 7f6d897fa700 1 -- 172.21.15.46:0/2871219263 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f6d7c08d600 con 0x7f6d8c0ff350 2024-02-19T19:11:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.580+0000 7f6d8b7fe700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6d7406d8a0 0x7f6d7406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:51.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.580+0000 7f6d8b7fe700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6d7406d8a0 0x7f6d7406fd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000c6d0 tx=0x7f6d8000cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.587+0000 7f6d897fa700 1 -- 172.21.15.46:0/2871219263 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6d7c056d20 con 0x7f6d8c0ff350 2024-02-19T19:11:51.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.844+0000 7f6d92828700 1 -- 172.21.15.46:0/2871219263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6d8c04f2a0 con 0x7f6d8c0ff350 2024-02-19T19:11:51.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.845+0000 7f6d897fa700 1 -- 172.21.15.46:0/2871219263 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f6d7c05a3e0 con 0x7f6d8c0ff350 2024-02-19T19:11:51.867 INFO:teuthology.orchestra.run.smithi046.stdout:e32 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 32 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T19:11:50.498523+0000 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:11:51.868 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 114 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=34412,1=34444} 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:11:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{0:34412} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{1:34444} state up:resolve seq 14 join_fscid=1 addr [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:11:51.870 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:11:51.871 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{-1:44355} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6824/315214117,v1:172.21.15.142:6825/315214117] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:11:51.871 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:44359} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/2993903126,v1:172.21.15.142:6827/2993903126] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:11:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.848+0000 7f6d92828700 1 -- 172.21.15.46:0/2871219263 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6d7406d8a0 msgr2=0x7f6d7406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.848+0000 7f6d92828700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6d7406d8a0 0x7f6d7406fd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000c6d0 tx=0x7f6d8000cf90 comp rx=0 tx=0).stop 2024-02-19T19:11:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.848+0000 7f6d92828700 1 -- 172.21.15.46:0/2871219263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d8c0ff350 msgr2=0x7f6d8c195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.848+0000 7f6d92828700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d8c0ff350 0x7f6d8c195ec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00b4b0 tx=0x7f6d7c00b870 comp rx=0 tx=0).stop 2024-02-19T19:11:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.849+0000 7f6d92828700 1 -- 172.21.15.46:0/2871219263 shutdown_connections 2024-02-19T19:11:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.849+0000 7f6d92828700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6d7406d8a0 0x7f6d7406fd50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.849+0000 7f6d92828700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d8c0ff350 0x7f6d8c195ec0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.849+0000 7f6d92828700 1 --2- 172.21.15.46:0/2871219263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d8c1038b0 0x7f6d8c196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.849+0000 7f6d92828700 1 -- 172.21.15.46:0/2871219263 >> 172.21.15.46:0/2871219263 conn(0x7f6d8c0748b0 msgr2=0x7f6d8c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.849+0000 7f6d92828700 1 -- 172.21.15.46:0/2871219263 shutdown_connections 2024-02-19T19:11:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:51.849+0000 7f6d92828700 1 -- 172.21.15.46:0/2871219263 wait complete. 2024-02-19T19:11:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 32 2024-02-19T19:11:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.018+0000 7fc1790fc700 1 -- 172.21.15.46:0/2640957706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc174101420 msgr2=0x7fc1741017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.018+0000 7fc1790fc700 1 --2- 172.21.15.46:0/2640957706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc174101420 0x7fc1741017f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc164009910 tx=0x7fc164009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.018+0000 7fc1790fc700 1 -- 172.21.15.46:0/2640957706 shutdown_connections 2024-02-19T19:11:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.018+0000 7fc1790fc700 1 --2- 172.21.15.46:0/2640957706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc174101d30 0x7fc17410a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.018+0000 7fc1790fc700 1 --2- 172.21.15.46:0/2640957706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc174101420 0x7fc1741017f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.018+0000 7fc1790fc700 1 -- 172.21.15.46:0/2640957706 >> 172.21.15.46:0/2640957706 conn(0x7fc1740fac60 msgr2=0x7fc1740fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.018+0000 7fc1790fc700 1 -- 172.21.15.46:0/2640957706 shutdown_connections 2024-02-19T19:11:52.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.018+0000 7fc1790fc700 1 -- 172.21.15.46:0/2640957706 wait complete. 2024-02-19T19:11:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.019+0000 7fc1790fc700 1 Processor -- start 2024-02-19T19:11:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.019+0000 7fc1790fc700 1 -- start start 2024-02-19T19:11:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc1790fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc174101420 0x7fc1740ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc1790fc700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc174101d30 0x7fc1740ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc17259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc174101d30 0x7fc1740ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc1790fc700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740ffb00 con 0x7fc174101d30 2024-02-19T19:11:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc17259c700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc174101d30 0x7fc1740ff5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46832/0 (socket says 172.21.15.46:46832) 2024-02-19T19:11:52.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740ffc40 con 0x7fc174101420 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc17259c700 1 -- 172.21.15.46:0/2324576594 learned_addr learned my addr 172.21.15.46:0/2324576594 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc172d9d700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc174101420 0x7fc1740ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc17259c700 1 -- 172.21.15.46:0/2324576594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc174101420 msgr2=0x7fc1740ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc17259c700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc174101420 0x7fc1740ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc17259c700 1 -- 172.21.15.46:0/2324576594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640095f0 con 0x7fc174101d30 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.020+0000 7fc17259c700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc174101d30 0x7fc1740ff5c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc16800b4b0 tx=0x7fc16800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.021+0000 7fc15bfff700 1 -- 172.21.15.46:0/2324576594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc168011800 con 0x7fc174101d30 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.021+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1741a2180 con 0x7fc174101d30 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.021+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1741a2530 con 0x7fc174101d30 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.021+0000 7fc15bfff700 1 -- 172.21.15.46:0/2324576594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc168011e20 con 0x7fc174101d30 2024-02-19T19:11:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.021+0000 7fc15bfff700 1 -- 172.21.15.46:0/2324576594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1680193b0 con 0x7fc174101d30 2024-02-19T19:11:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.022+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc160005320 con 0x7fc174101d30 2024-02-19T19:11:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.023+0000 7fc15bfff700 1 -- 172.21.15.46:0/2324576594 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc168011960 con 0x7fc174101d30 2024-02-19T19:11:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.023+0000 7fc15bfff700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc15c06d8a0 0x7fc15c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.023+0000 7fc15bfff700 1 -- 172.21.15.46:0/2324576594 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fc16808cfd0 con 0x7fc174101d30 2024-02-19T19:11:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.023+0000 7fc172d9d700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc15c06d8a0 0x7fc15c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.024+0000 7fc172d9d700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc15c06d8a0 0x7fc15c06fd50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc164006010 tx=0x7fc16401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:52.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.028+0000 7fc15bfff700 1 -- 172.21.15.46:0/2324576594 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc1680566f0 con 0x7fc174101d30 2024-02-19T19:11:52.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.341+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc160000bf0 con 0x7fc15c06d8a0 2024-02-19T19:11:52.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.343+0000 7fc15bfff700 1 -- 172.21.15.46:0/2324576594 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fc160000bf0 con 0x7fc15c06d8a0 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-02-19T19:11:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-02-19T19:11:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:11:52.367 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:11:52.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.345+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc15c06d8a0 msgr2=0x7fc15c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:52.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.345+0000 7fc1790fc700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc15c06d8a0 0x7fc15c06fd50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc164006010 tx=0x7fc16401a040 comp rx=0 tx=0).stop 2024-02-19T19:11:52.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.345+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc174101d30 msgr2=0x7fc1740ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:52.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.345+0000 7fc1790fc700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc174101d30 0x7fc1740ff5c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc16800b4b0 tx=0x7fc16800b7c0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.345+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 shutdown_connections 2024-02-19T19:11:52.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.345+0000 7fc1790fc700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc15c06d8a0 0x7fc15c06fd50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.345+0000 7fc1790fc700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc174101420 0x7fc1740ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.345+0000 7fc1790fc700 1 --2- 172.21.15.46:0/2324576594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc174101d30 0x7fc1740ff5c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.345+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 >> 172.21.15.46:0/2324576594 conn(0x7fc1740fac60 msgr2=0x7fc174104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:52.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.346+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 shutdown_connections 2024-02-19T19:11:52.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.346+0000 7fc1790fc700 1 -- 172.21.15.46:0/2324576594 wait complete. 2024-02-19T19:11:52.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:52 smithi142 ceph-mon[69118]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:52.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:52 smithi142 ceph-mon[69118]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:52.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:52 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] up:resolve 2024-02-19T19:11:52.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:52 smithi142 ceph-mon[69118]: fsmap cephfs:2/2 {0=cephfs.smithi046.hrbbel=up:replay,1=cephfs.smithi046.bwvkwa=up:resolve} 2 up:standby 2024-02-19T19:11:52.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:52 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/4209759293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:52.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:52 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2871219263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:11:52.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.456+0000 7fb0b9c70700 1 -- 172.21.15.46:0/1550679520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40687a0 msgr2=0x7fb0b4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:52.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.456+0000 7fb0b9c70700 1 --2- 172.21.15.46:0/1550679520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40687a0 0x7fb0b4068b70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009910 tx=0x7fb0a4009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:52.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.456+0000 7fb0b9c70700 1 -- 172.21.15.46:0/1550679520 shutdown_connections 2024-02-19T19:11:52.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.456+0000 7fb0b9c70700 1 --2- 172.21.15.46:0/1550679520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b4069140 0x7fb0b4104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.479 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:52 smithi046 ceph-mon[88928]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:52.479 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:52 smithi046 ceph-mon[88928]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:52.479 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:52 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] up:resolve 2024-02-19T19:11:52.479 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:52 smithi046 ceph-mon[88928]: fsmap cephfs:2/2 {0=cephfs.smithi046.hrbbel=up:replay,1=cephfs.smithi046.bwvkwa=up:resolve} 2 up:standby 2024-02-19T19:11:52.479 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:52 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/4209759293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:52.479 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:52 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2871219263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:11:52.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.456+0000 7fb0b9c70700 1 --2- 172.21.15.46:0/1550679520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b40687a0 0x7fb0b4068b70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.456+0000 7fb0b9c70700 1 -- 172.21.15.46:0/1550679520 >> 172.21.15.46:0/1550679520 conn(0x7fb0b4075130 msgr2=0x7fb0b4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:52.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.456+0000 7fb0b9c70700 1 -- 172.21.15.46:0/1550679520 shutdown_connections 2024-02-19T19:11:52.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.456+0000 7fb0b9c70700 1 -- 172.21.15.46:0/1550679520 wait complete. 2024-02-19T19:11:52.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.457+0000 7fb0b9c70700 1 Processor -- start 2024-02-19T19:11:52.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.457+0000 7fb0b9c70700 1 -- start start 2024-02-19T19:11:52.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.458+0000 7fb0b9c70700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b40687a0 0x7fb0b4195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.458+0000 7fb0b9c70700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b4069140 0x7fb0b41964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.458+0000 7fb0b9c70700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4196b80 con 0x7fb0b4069140 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.458+0000 7fb0b9c70700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b419a910 con 0x7fb0b40687a0 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.458+0000 7fb0b37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b40687a0 0x7fb0b4195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.458+0000 7fb0b37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b40687a0 0x7fb0b4195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.46:37160/0 (socket says 172.21.15.46:37160) 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.458+0000 7fb0b37fe700 1 -- 172.21.15.46:0/497011331 learned_addr learned my addr 172.21.15.46:0/497011331 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.458+0000 7fb0b2ffd700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b4069140 0x7fb0b41964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.459+0000 7fb0b2ffd700 1 -- 172.21.15.46:0/497011331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b40687a0 msgr2=0x7fb0b4195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.459+0000 7fb0b2ffd700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b40687a0 0x7fb0b4195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.459+0000 7fb0b2ffd700 1 -- 172.21.15.46:0/497011331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40095f0 con 0x7fb0b4069140 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.459+0000 7fb0b37fe700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b40687a0 0x7fb0b4195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.459+0000 7fb0b2ffd700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b4069140 0x7fb0b41964a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4069620 tx=0x7fb0a800b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:52.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.459+0000 7fb0b0ff9700 1 -- 172.21.15.46:0/497011331 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a8011800 con 0x7fb0b4069140 2024-02-19T19:11:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.459+0000 7fb0b0ff9700 1 -- 172.21.15.46:0/497011331 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0a800be60 con 0x7fb0b4069140 2024-02-19T19:11:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.459+0000 7fb0b0ff9700 1 -- 172.21.15.46:0/497011331 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a8010e40 con 0x7fb0b4069140 2024-02-19T19:11:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.460+0000 7fb0b9c70700 1 -- 172.21.15.46:0/497011331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b419ab90 con 0x7fb0b4069140 2024-02-19T19:11:52.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.460+0000 7fb0b9c70700 1 -- 172.21.15.46:0/497011331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b419b060 con 0x7fb0b4069140 2024-02-19T19:11:52.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.462+0000 7fb0b9c70700 1 -- 172.21.15.46:0/497011331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b4108770 con 0x7fb0b4069140 2024-02-19T19:11:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.462+0000 7fb0b0ff9700 1 -- 172.21.15.46:0/497011331 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb0a801a410 con 0x7fb0b4069140 2024-02-19T19:11:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.463+0000 7fb0b0ff9700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb09c06d850 0x7fb09c06fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.463+0000 7fb0b0ff9700 1 -- 172.21.15.46:0/497011331 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fb0a808cde0 con 0x7fb0b4069140 2024-02-19T19:11:52.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.463+0000 7fb0b37fe700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb09c06d850 0x7fb09c06fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:52.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.464+0000 7fb0b37fe700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb09c06d850 0x7fb09c06fd00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009fd0 tx=0x7fb0a401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.472+0000 7fb0b0ff9700 1 -- 172.21.15.46:0/497011331 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb0a8056480 con 0x7fb0b4069140 2024-02-19T19:11:52.821 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem is degraded 2024-02-19T19:11:52.821 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-19T19:11:52.821 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-02-19T19:11:52.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.798+0000 7fb0b9c70700 1 -- 172.21.15.46:0/497011331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb0b419b330 con 0x7fb0b4069140 2024-02-19T19:11:52.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.798+0000 7fb0b0ff9700 1 -- 172.21.15.46:0/497011331 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7fb0a8059b40 con 0x7fb0b4069140 2024-02-19T19:11:52.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 -- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb09c06d850 msgr2=0x7fb09c06fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:52.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb09c06d850 0x7fb09c06fd00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009fd0 tx=0x7fb0a401a040 comp rx=0 tx=0).stop 2024-02-19T19:11:52.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 -- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b4069140 msgr2=0x7fb0b41964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:52.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b4069140 0x7fb0b41964a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4069620 tx=0x7fb0a800b6b0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 -- 172.21.15.46:0/497011331 shutdown_connections 2024-02-19T19:11:52.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb09c06d850 0x7fb09c06fd00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0b40687a0 0x7fb0b4195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 --2- 172.21.15.46:0/497011331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb0b4069140 0x7fb0b41964a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:52.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 -- 172.21.15.46:0/497011331 >> 172.21.15.46:0/497011331 conn(0x7fb0b4075130 msgr2=0x7fb0b40fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:52.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 -- 172.21.15.46:0/497011331 shutdown_connections 2024-02-19T19:11:52.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:11:52.802+0000 7fb0b9c70700 1 -- 172.21.15.46:0/497011331 wait complete. 2024-02-19T19:11:53.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:53 smithi046 ceph-mon[88928]: pgmap v265: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-02-19T19:11:53.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:53 smithi046 ceph-mon[88928]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:53.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:53 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/497011331' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:11:53.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:53 smithi142 ceph-mon[69118]: pgmap v265: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-02-19T19:11:53.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:53 smithi142 ceph-mon[69118]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:53.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:53 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/497011331' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:11:54.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:54.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:54.488 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:54.488 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:55.491 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:55 smithi046 ceph-mon[88928]: pgmap v266: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-02-19T19:11:55.491 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:55.491 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:11:55.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:55.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:55 smithi142 ceph-mon[69118]: pgmap v266: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-02-19T19:11:55.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:55.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:11:55.505 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:56.337 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:56 smithi142 ceph-mon[69118]: Upgrade: Updating ceph-exporter.smithi142 (2/2) 2024-02-19T19:11:56.337 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:56 smithi142 ceph-mon[69118]: Deploying daemon ceph-exporter.smithi142 on smithi142 2024-02-19T19:11:56.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:56 smithi046 ceph-mon[88928]: Upgrade: Updating ceph-exporter.smithi142 (2/2) 2024-02-19T19:11:56.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:56 smithi046 ceph-mon[88928]: Deploying daemon ceph-exporter.smithi142 on smithi142 2024-02-19T19:11:57.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:57 smithi142 ceph-mon[69118]: pgmap v267: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-02-19T19:11:57.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:57 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] up:resolve 2024-02-19T19:11:57.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:57 smithi142 ceph-mon[69118]: fsmap cephfs:2/2 {0=cephfs.smithi046.hrbbel=up:resolve,1=cephfs.smithi046.bwvkwa=up:resolve} 2 up:standby 2024-02-19T19:11:57.484 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:57 smithi046 ceph-mon[88928]: pgmap v267: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-02-19T19:11:57.484 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:57 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] up:resolve 2024-02-19T19:11:57.484 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:57 smithi046 ceph-mon[88928]: fsmap cephfs:2/2 {0=cephfs.smithi046.hrbbel=up:resolve,1=cephfs.smithi046.bwvkwa=up:resolve} 2 up:standby 2024-02-19T19:11:58.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:58 smithi046 ceph-mon[88928]: reconnect by client.14548 v1:192.168.0.1:0/920633814 after 0.000999989 2024-02-19T19:11:58.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:58 smithi046 ceph-mon[88928]: reconnect by client.14548 v1:192.168.0.1:0/920633814 after 0.000999989 2024-02-19T19:11:58.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:58 smithi046 ceph-mon[88928]: reconnect by client.24313 v1:192.168.0.1:0/3968508409 after 0.000999989 2024-02-19T19:11:58.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:58 smithi046 ceph-mon[88928]: reconnect by client.24313 v1:192.168.0.1:0/3968508409 after 0.000999989 2024-02-19T19:11:58.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:58 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] up:reconnect 2024-02-19T19:11:58.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:58 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] up:reconnect 2024-02-19T19:11:58.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:58 smithi046 ceph-mon[88928]: fsmap cephfs:2/2 {0=cephfs.smithi046.hrbbel=up:reconnect,1=cephfs.smithi046.bwvkwa=up:reconnect} 2 up:standby 2024-02-19T19:11:58.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:58.429 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:58.455 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:58 smithi142 ceph-mon[69118]: reconnect by client.14548 v1:192.168.0.1:0/920633814 after 0.000999989 2024-02-19T19:11:58.455 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:58 smithi142 ceph-mon[69118]: reconnect by client.14548 v1:192.168.0.1:0/920633814 after 0.000999989 2024-02-19T19:11:58.456 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:58 smithi142 ceph-mon[69118]: reconnect by client.24313 v1:192.168.0.1:0/3968508409 after 0.000999989 2024-02-19T19:11:58.456 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:58 smithi142 ceph-mon[69118]: reconnect by client.24313 v1:192.168.0.1:0/3968508409 after 0.000999989 2024-02-19T19:11:58.456 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:58 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] up:reconnect 2024-02-19T19:11:58.456 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:58 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] up:reconnect 2024-02-19T19:11:58.456 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:58 smithi142 ceph-mon[69118]: fsmap cephfs:2/2 {0=cephfs.smithi046.hrbbel=up:reconnect,1=cephfs.smithi046.bwvkwa=up:reconnect} 2 up:standby 2024-02-19T19:11:58.456 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:58.456 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:59.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:59 smithi142 ceph-mon[69118]: pgmap v268: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-02-19T19:11:59.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:59 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] up:rejoin 2024-02-19T19:11:59.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:59 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] up:rejoin 2024-02-19T19:11:59.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:59 smithi142 ceph-mon[69118]: fsmap cephfs:2/2 {0=cephfs.smithi046.hrbbel=up:rejoin,1=cephfs.smithi046.bwvkwa=up:rejoin} 2 up:standby 2024-02-19T19:11:59.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:59 smithi142 ceph-mon[69118]: daemon mds.cephfs.smithi046.bwvkwa is now active in filesystem cephfs as rank 1 2024-02-19T19:11:59.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:59 smithi142 ceph-mon[69118]: daemon mds.cephfs.smithi046.hrbbel is now active in filesystem cephfs as rank 0 2024-02-19T19:11:59.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:59.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:59.454 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:11:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:59.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:59 smithi046 ceph-mon[88928]: pgmap v268: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-02-19T19:11:59.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:59 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] up:rejoin 2024-02-19T19:11:59.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:59 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] up:rejoin 2024-02-19T19:11:59.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:59 smithi046 ceph-mon[88928]: fsmap cephfs:2/2 {0=cephfs.smithi046.hrbbel=up:rejoin,1=cephfs.smithi046.bwvkwa=up:rejoin} 2 up:standby 2024-02-19T19:11:59.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:59 smithi046 ceph-mon[88928]: daemon mds.cephfs.smithi046.bwvkwa is now active in filesystem cephfs as rank 1 2024-02-19T19:11:59.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:59 smithi046 ceph-mon[88928]: daemon mds.cephfs.smithi046.hrbbel is now active in filesystem cephfs as rank 0 2024-02-19T19:11:59.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:59.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:11:59.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:11:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:00.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:00 smithi046 ceph-mon[88928]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-19T19:12:00.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:00 smithi046 ceph-mon[88928]: Cluster is now healthy 2024-02-19T19:12:00.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:00 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] up:active 2024-02-19T19:12:00.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:00 smithi046 ceph-mon[88928]: mds.? [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] up:active 2024-02-19T19:12:00.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:00 smithi046 ceph-mon[88928]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi046.bwvkwa=up:active} 2 up:standby 2024-02-19T19:12:00.627 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:00 smithi142 ceph-mon[69118]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-19T19:12:00.627 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:00 smithi142 ceph-mon[69118]: Cluster is now healthy 2024-02-19T19:12:00.627 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:00 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] up:active 2024-02-19T19:12:00.627 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:00 smithi142 ceph-mon[69118]: mds.? [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] up:active 2024-02-19T19:12:00.627 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:00 smithi142 ceph-mon[69118]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi046.bwvkwa=up:active} 2 up:standby 2024-02-19T19:12:01.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:01 smithi046 ceph-mon[88928]: pgmap v269: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 8 op/s 2024-02-19T19:12:01.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:01.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:01 smithi142 ceph-mon[69118]: pgmap v269: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 8 op/s 2024-02-19T19:12:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:03.110 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:02 smithi046 ceph-mon[88928]: pgmap v270: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 426 B/s wr, 10 op/s 2024-02-19T19:12:03.110 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:02 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:03.110 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:02 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:03.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:02 smithi142 ceph-mon[69118]: pgmap v270: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 426 B/s wr, 10 op/s 2024-02-19T19:12:03.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:02 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:03.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:02 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:05.072 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:04 smithi142 ceph-mon[69118]: pgmap v271: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.3 MiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-02-19T19:12:05.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:04 smithi046 ceph-mon[88928]: pgmap v271: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.3 MiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-02-19T19:12:06.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:06 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:06.453 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:06 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:06.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:06 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:06.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:06 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:07.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:07 smithi142 ceph-mon[69118]: pgmap v272: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.3 MiB/s rd, 5.5 KiB/s wr, 11 op/s 2024-02-19T19:12:07.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:07.203 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:07.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:07 smithi046 ceph-mon[88928]: pgmap v272: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.3 MiB/s rd, 5.5 KiB/s wr, 11 op/s 2024-02-19T19:12:07.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:07.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:08.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:08.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:08.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:08.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:09.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:09 smithi046 ceph-mon[88928]: pgmap v273: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 660 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-02-19T19:12:09.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:09 smithi142 ceph-mon[69118]: pgmap v273: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 660 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-02-19T19:12:11.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: pgmap v274: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 660 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-02-19T19:12:11.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:11.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:11.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:11.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:12:11.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:11.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:11.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:11.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:11.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:11.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:11.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:11.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-19T19:12:11.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: pgmap v274: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 660 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-02-19T19:12:11.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:11.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:11.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:11.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:12:11.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:11.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:11.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:11.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:11.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:11.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:11.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:11.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-19T19:12:12.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: Upgrade: Setting filesystem cephfs Joinable 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi046.bwvkwa=up:active} 2 up:standby 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi046"}]: dispatch 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi046"}]': finished 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]: dispatch 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]': finished 2024-02-19T19:12:12.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-19T19:12:12.585 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.586 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-19T19:12:12.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-19T19:12:12.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:12.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:12.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:12:12.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:12.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:12.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:12:12.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: Upgrade: Setting filesystem cephfs Joinable 2024-02-19T19:12:12.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: fsmap cephfs:2 {0=cephfs.smithi046.hrbbel=up:active,1=cephfs.smithi046.bwvkwa=up:active} 2 up:standby 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi046"}]: dispatch 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi046"}]': finished 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]: dispatch 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]': finished 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-19T19:12:12.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-19T19:12:12.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:12:12.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:12.708 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:12.708 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:12.708 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:12:12.708 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:13 smithi046 ceph-mon[88928]: pgmap v275: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-02-19T19:12:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:13 smithi046 ceph-mon[88928]: Upgrade: Setting container_image for all ceph-exporter 2024-02-19T19:12:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:13 smithi046 ceph-mon[88928]: Upgrade: Setting container_image for all iscsi 2024-02-19T19:12:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:13 smithi046 ceph-mon[88928]: Upgrade: Setting container_image for all nfs 2024-02-19T19:12:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:13 smithi046 ceph-mon[88928]: Upgrade: Setting container_image for all nvmeof 2024-02-19T19:12:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:13 smithi046 ceph-mon[88928]: Upgrade: Finalizing container_image settings 2024-02-19T19:12:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:13 smithi046 ceph-mon[88928]: Upgrade: Complete! 2024-02-19T19:12:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:13.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:13.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:13 smithi142 ceph-mon[69118]: pgmap v275: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:13 smithi142 ceph-mon[69118]: Upgrade: Setting container_image for all ceph-exporter 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:13 smithi142 ceph-mon[69118]: Upgrade: Setting container_image for all iscsi 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:13 smithi142 ceph-mon[69118]: Upgrade: Setting container_image for all nfs 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:13 smithi142 ceph-mon[69118]: Upgrade: Setting container_image for all nvmeof 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:13 smithi142 ceph-mon[69118]: Upgrade: Finalizing container_image settings 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:13 smithi142 ceph-mon[69118]: Upgrade: Complete! 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:13.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:12:15.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:15 smithi046 ceph-mon[88928]: pgmap v276: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-02-19T19:12:15.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:15 smithi142 ceph-mon[69118]: pgmap v276: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-02-19T19:12:17.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:17 smithi046 ceph-mon[88928]: pgmap v277: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s wr, 4 op/s 2024-02-19T19:12:17.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:17 smithi142 ceph-mon[69118]: pgmap v277: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s wr, 4 op/s 2024-02-19T19:12:19.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:19 smithi046 ceph-mon[88928]: pgmap v278: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.2 KiB/s wr, 1 op/s 2024-02-19T19:12:19.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:19 smithi142 ceph-mon[69118]: pgmap v278: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.2 KiB/s wr, 1 op/s 2024-02-19T19:12:21.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:21 smithi046 ceph-mon[88928]: pgmap v279: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.2 KiB/s wr, 1 op/s 2024-02-19T19:12:21.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:21 smithi142 ceph-mon[69118]: pgmap v279: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.2 KiB/s wr, 1 op/s 2024-02-19T19:12:22.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.919+0000 7f88fdcf1700 1 -- 172.21.15.46:0/2619138769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88f80ff3c0 msgr2=0x7f88f80ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:22.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.919+0000 7f88fdcf1700 1 --2- 172.21.15.46:0/2619138769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88f80ff3c0 0x7f88f80ff790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009910 tx=0x7f88e8009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:22.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.919+0000 7f88fdcf1700 1 -- 172.21.15.46:0/2619138769 shutdown_connections 2024-02-19T19:12:22.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.919+0000 7f88fdcf1700 1 --2- 172.21.15.46:0/2619138769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f80ffd60 0x7f88f8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:22.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.919+0000 7f88fdcf1700 1 --2- 172.21.15.46:0/2619138769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88f80ff3c0 0x7f88f80ff790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:22.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.919+0000 7f88fdcf1700 1 -- 172.21.15.46:0/2619138769 >> 172.21.15.46:0/2619138769 conn(0x7f88f80fac80 msgr2=0x7f88f80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:22.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.919+0000 7f88fdcf1700 1 -- 172.21.15.46:0/2619138769 shutdown_connections 2024-02-19T19:12:22.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.920+0000 7f88fdcf1700 1 -- 172.21.15.46:0/2619138769 wait complete. 2024-02-19T19:12:22.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.920+0000 7f88fdcf1700 1 Processor -- start 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.920+0000 7f88fdcf1700 1 -- start start 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.920+0000 7f88fdcf1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f80ff3c0 0x7f88f8195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.920+0000 7f88fdcf1700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88f80ffd60 0x7f88f81964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88fdcf1700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8196b90 con 0x7f88f80ffd60 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88fdcf1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f819a920 con 0x7f88f80ff3c0 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88f80ffd60 0x7f88f81964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f6ffd700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88f80ffd60 0x7f88f81964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47446/0 (socket says 172.21.15.46:47446) 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f6ffd700 1 -- 172.21.15.46:0/337008347 learned_addr learned my addr 172.21.15.46:0/337008347 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f77fe700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f80ff3c0 0x7f88f8195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f6ffd700 1 -- 172.21.15.46:0/337008347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f80ff3c0 msgr2=0x7f88f8195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:22.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f6ffd700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f80ff3c0 0x7f88f8195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f6ffd700 1 -- 172.21.15.46:0/337008347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e80095f0 con 0x7f88f80ffd60 2024-02-19T19:12:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f77fe700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f80ff3c0 0x7f88f8195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:12:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f6ffd700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88f80ffd60 0x7f88f81964b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00b480 tx=0x7f88ec00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f4ff9700 1 -- 172.21.15.46:0/337008347 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88ec0118c0 con 0x7f88f80ffd60 2024-02-19T19:12:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f4ff9700 1 -- 172.21.15.46:0/337008347 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88ec010380 con 0x7f88f80ffd60 2024-02-19T19:12:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88fdcf1700 1 -- 172.21.15.46:0/337008347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f819ac00 con 0x7f88f80ffd60 2024-02-19T19:12:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88f4ff9700 1 -- 172.21.15.46:0/337008347 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88ec00f4f0 con 0x7f88f80ffd60 2024-02-19T19:12:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.921+0000 7f88fdcf1700 1 -- 172.21.15.46:0/337008347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f819b150 con 0x7f88f80ffd60 2024-02-19T19:12:22.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.923+0000 7f88fdcf1700 1 -- 172.21.15.46:0/337008347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f81086e0 con 0x7f88f80ffd60 2024-02-19T19:12:22.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.923+0000 7f88f4ff9700 1 -- 172.21.15.46:0/337008347 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f88ec0104f0 con 0x7f88f80ffd60 2024-02-19T19:12:22.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.923+0000 7f88f4ff9700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f88e006d8a0 0x7f88e006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:22.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.923+0000 7f88f4ff9700 1 -- 172.21.15.46:0/337008347 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f88ec08d1b0 con 0x7f88f80ffd60 2024-02-19T19:12:22.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.923+0000 7f88f77fe700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f88e006d8a0 0x7f88e006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:22.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.924+0000 7f88f77fe700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f88e006d8a0 0x7f88e006fd50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f88e8006010 tx=0x7f88e800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:22.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:22.928+0000 7f88f4ff9700 1 -- 172.21.15.46:0/337008347 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f88ec0568d0 con 0x7f88f80ffd60 2024-02-19T19:12:23.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.156+0000 7f88fdcf1700 1 -- 172.21.15.46:0/337008347 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88f819b490 con 0x7f88e006d8a0 2024-02-19T19:12:23.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.157+0000 7f88f4ff9700 1 -- 172.21.15.46:0/337008347 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f88f819b490 con 0x7f88e006d8a0 2024-02-19T19:12:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.159+0000 7f88fdcf1700 1 -- 172.21.15.46:0/337008347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f88e006d8a0 msgr2=0x7f88e006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.159+0000 7f88fdcf1700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f88e006d8a0 0x7f88e006fd50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f88e8006010 tx=0x7f88e800b540 comp rx=0 tx=0).stop 2024-02-19T19:12:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.159+0000 7f88fdcf1700 1 -- 172.21.15.46:0/337008347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88f80ffd60 msgr2=0x7f88f81964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.159+0000 7f88fdcf1700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88f80ffd60 0x7f88f81964b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00b480 tx=0x7f88ec00b840 comp rx=0 tx=0).stop 2024-02-19T19:12:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.159+0000 7f88fdcf1700 1 -- 172.21.15.46:0/337008347 shutdown_connections 2024-02-19T19:12:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.159+0000 7f88fdcf1700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f88e006d8a0 0x7f88e006fd50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.159+0000 7f88fdcf1700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88f80ff3c0 0x7f88f8195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.159+0000 7f88fdcf1700 1 --2- 172.21.15.46:0/337008347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88f80ffd60 0x7f88f81964b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.159+0000 7f88fdcf1700 1 -- 172.21.15.46:0/337008347 >> 172.21.15.46:0/337008347 conn(0x7f88f80fac80 msgr2=0x7f88f8069150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:23.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.160+0000 7f88fdcf1700 1 -- 172.21.15.46:0/337008347 shutdown_connections 2024-02-19T19:12:23.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:23.160+0000 7f88fdcf1700 1 -- 172.21.15.46:0/337008347 wait complete. 2024-02-19T19:12:23.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:23 smithi046 ceph-mon[88928]: pgmap v280: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:23.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:23 smithi142 ceph-mon[69118]: pgmap v280: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:23.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-19T19:12:24.238 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:12:24.591 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:24 smithi046 ceph-mon[88928]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:24.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:24 smithi142 ceph-mon[69118]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:25.640 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:25 smithi046 ceph-mon[88928]: pgmap v281: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:25.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:25 smithi142 ceph-mon[69118]: pgmap v281: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:25.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.848+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/387225973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f480ffbd0 msgr2=0x7f2f48100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:25.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.848+0000 7f2f4fcd9700 1 --2- 172.21.15.46:0/387225973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f480ffbd0 0x7f2f48100040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009910 tx=0x7f2f44009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:25.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.848+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/387225973 shutdown_connections 2024-02-19T19:12:25.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.848+0000 7f2f4fcd9700 1 --2- 172.21.15.46:0/387225973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f480ffbd0 0x7f2f48100040 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:25.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.848+0000 7f2f4fcd9700 1 --2- 172.21.15.46:0/387225973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f48104130 0x7f2f48104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:25.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.848+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/387225973 >> 172.21.15.46:0/387225973 conn(0x7f2f48075130 msgr2=0x7f2f48075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:25.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.848+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/387225973 shutdown_connections 2024-02-19T19:12:25.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.848+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/387225973 wait complete. 2024-02-19T19:12:25.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.849+0000 7f2f4fcd9700 1 Processor -- start 2024-02-19T19:12:25.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.849+0000 7f2f4fcd9700 1 -- start start 2024-02-19T19:12:25.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.849+0000 7f2f4fcd9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f480ffbd0 0x7f2f48196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:25.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.849+0000 7f2f4fcd9700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48104130 0x7f2f481971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:25.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.849+0000 7f2f4fcd9700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48197800 con 0x7f2f48104130 2024-02-19T19:12:25.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.849+0000 7f2f4fcd9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48197940 con 0x7f2f480ffbd0 2024-02-19T19:12:25.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.849+0000 7f2f4d274700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48104130 0x7f2f481971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:25.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.849+0000 7f2f4d274700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48104130 0x7f2f481971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47472/0 (socket says 172.21.15.46:47472) 2024-02-19T19:12:25.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.849+0000 7f2f4d274700 1 -- 172.21.15.46:0/2771332680 learned_addr learned my addr 172.21.15.46:0/2771332680 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:12:25.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.849+0000 7f2f4da75700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f480ffbd0 0x7f2f48196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:25.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.850+0000 7f2f4d274700 1 -- 172.21.15.46:0/2771332680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f480ffbd0 msgr2=0x7f2f48196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:25.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.850+0000 7f2f4d274700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f480ffbd0 0x7f2f48196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:25.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.850+0000 7f2f4d274700 1 -- 172.21.15.46:0/2771332680 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f440095f0 con 0x7f2f48104130 2024-02-19T19:12:25.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.850+0000 7f2f4d274700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48104130 0x7f2f481971e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400bd70 tx=0x7f2f4400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:25.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.850+0000 7f2f3affd700 1 -- 172.21.15.46:0/2771332680 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f4401d070 con 0x7f2f48104130 2024-02-19T19:12:25.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.850+0000 7f2f3affd700 1 -- 172.21.15.46:0/2771332680 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f4400f460 con 0x7f2f48104130 2024-02-19T19:12:25.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.850+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/2771332680 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4819fd10 con 0x7f2f48104130 2024-02-19T19:12:25.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.850+0000 7f2f3affd700 1 -- 172.21.15.46:0/2771332680 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f44017630 con 0x7f2f48104130 2024-02-19T19:12:25.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.850+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/2771332680 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f481a0120 con 0x7f2f48104130 2024-02-19T19:12:25.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.851+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/2771332680 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4804f2a0 con 0x7f2f48104130 2024-02-19T19:12:25.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.851+0000 7f2f3affd700 1 -- 172.21.15.46:0/2771332680 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2f4400f5d0 con 0x7f2f48104130 2024-02-19T19:12:25.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.852+0000 7f2f3affd700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2f3406d8a0 0x7f2f3406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:25.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.852+0000 7f2f3affd700 1 -- 172.21.15.46:0/2771332680 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f2f4408eac0 con 0x7f2f48104130 2024-02-19T19:12:25.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.852+0000 7f2f4da75700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2f3406d8a0 0x7f2f3406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:25.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.852+0000 7f2f4da75700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2f3406d8a0 0x7f2f3406fd50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c005950 tx=0x7f2f3c00a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:25.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:25.857+0000 7f2f3affd700 1 -- 172.21.15.46:0/2771332680 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2f440581e0 con 0x7f2f48104130 2024-02-19T19:12:26.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.078+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/2771332680 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f480ff240 con 0x7f2f3406d8a0 2024-02-19T19:12:26.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.089+0000 7f2f3affd700 1 -- 172.21.15.46:0/2771332680 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f2f480ff240 con 0x7f2f3406d8a0 2024-02-19T19:12:26.112 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:12:26.112 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (8m) 19s ago 19m 25.7M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (33s) 19s ago 19m 7759k - 19.0.0-1450-gf78a58c0 f081f847070a 075a1e772814 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (28s) 25s ago 17m 6953k - 19.0.0-1450-gf78a58c0 f081f847070a 9942823fa52b 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (5m) 19s ago 19m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (5m) 25s ago 17m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (8m) 19s ago 18m 86.3M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (86s) 19s ago 12m 61.0M - 19.0.0-1450-gf78a58c0 f081f847070a 594407d08977 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (102s) 19s ago 13m 112M - 19.0.0-1450-gf78a58c0 f081f847070a c532c6eef6c1 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (49s) 25s ago 12m 15.8M - 19.0.0-1450-gf78a58c0 f081f847070a dbe9e8c442ce 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (66s) 25s ago 12m 12.6M - 19.0.0-1450-gf78a58c0 f081f847070a 8bb16a987136 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (10m) 19s ago 20m 513M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (9m) 25s ago 17m 451M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (7m) 19s ago 20m 60.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (6m) 25s ago 17m 48.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (9m) 19s ago 19m 16.9M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:12:26.113 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (9m) 25s ago 17m 17.1M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:12:26.114 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (5m) 19s ago 16m 277M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:12:26.114 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (4m) 19s ago 16m 332M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 974e56511c36 2024-02-19T19:12:26.114 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (4m) 19s ago 15m 197M 1217M 19.0.0-1450-gf78a58c0 f081f847070a a31225ea4dec 2024-02-19T19:12:26.114 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (3m) 25s ago 15m 150M 2240M 19.0.0-1450-gf78a58c0 f081f847070a b46795b87c3e 2024-02-19T19:12:26.114 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (2m) 25s ago 14m 91.6M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 645517de8ff6 2024-02-19T19:12:26.114 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (119s) 25s ago 14m 99.4M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 510ea3b4a23b 2024-02-19T19:12:26.114 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (9m) 19s ago 18m 70.7M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:12:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/2771332680 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2f3406d8a0 msgr2=0x7f2f3406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2f3406d8a0 0x7f2f3406fd50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c005950 tx=0x7f2f3c00a300 comp rx=0 tx=0).stop 2024-02-19T19:12:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/2771332680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48104130 msgr2=0x7f2f481971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48104130 0x7f2f481971e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400bd70 tx=0x7f2f4400bda0 comp rx=0 tx=0).stop 2024-02-19T19:12:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/2771332680 shutdown_connections 2024-02-19T19:12:26.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2f3406d8a0 0x7f2f3406fd50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f480ffbd0 0x7f2f48196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 --2- 172.21.15.46:0/2771332680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48104130 0x7f2f481971e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/2771332680 >> 172.21.15.46:0/2771332680 conn(0x7f2f48075130 msgr2=0x7f2f480feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/2771332680 shutdown_connections 2024-02-19T19:12:26.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:26.092+0000 7f2f4fcd9700 1 -- 172.21.15.46:0/2771332680 wait complete. 2024-02-19T19:12:26.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade status' 2024-02-19T19:12:27.031 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:12:27.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:27 smithi142 ceph-mon[69118]: pgmap v282: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:27.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:27 smithi142 ceph-mon[69118]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:27.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:27 smithi046 ceph-mon[88928]: pgmap v282: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:27.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:27 smithi046 ceph-mon[88928]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:28.410 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:28.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.663+0000 7f8803d85700 1 -- 172.21.15.46:0/1248547328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87fc1004e0 msgr2=0x7f87fc1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:28.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.663+0000 7f8803d85700 1 --2- 172.21.15.46:0/1248547328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87fc1004e0 0x7f87fc1008b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009910 tx=0x7f87f8009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:28.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.663+0000 7f8803d85700 1 -- 172.21.15.46:0/1248547328 shutdown_connections 2024-02-19T19:12:28.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.663+0000 7f8803d85700 1 --2- 172.21.15.46:0/1248547328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc100e80 0x7f87fc104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:28.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.663+0000 7f8803d85700 1 --2- 172.21.15.46:0/1248547328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87fc1004e0 0x7f87fc1008b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:28.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.663+0000 7f8803d85700 1 -- 172.21.15.46:0/1248547328 >> 172.21.15.46:0/1248547328 conn(0x7f87fc0fbda0 msgr2=0x7f87fc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:28.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.663+0000 7f8803d85700 1 -- 172.21.15.46:0/1248547328 shutdown_connections 2024-02-19T19:12:28.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.663+0000 7f8803d85700 1 -- 172.21.15.46:0/1248547328 wait complete. 2024-02-19T19:12:28.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.664+0000 7f8803d85700 1 Processor -- start 2024-02-19T19:12:28.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.664+0000 7f8803d85700 1 -- start start 2024-02-19T19:12:28.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.664+0000 7f8803d85700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc1004e0 0x7f87fc073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.664+0000 7f8803d85700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87fc100e80 0x7f87fc073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.664+0000 7f8803d85700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc073ad0 con 0x7f87fc100e80 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.664+0000 7f8803d85700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc073c10 con 0x7f87fc1004e0 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.664+0000 7f8801320700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87fc100e80 0x7f87fc073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.664+0000 7f8801320700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87fc100e80 0x7f87fc073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57372/0 (socket says 172.21.15.46:57372) 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f8801320700 1 -- 172.21.15.46:0/2261449163 learned_addr learned my addr 172.21.15.46:0/2261449163 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f8801b21700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc1004e0 0x7f87fc073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f8801320700 1 -- 172.21.15.46:0/2261449163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc1004e0 msgr2=0x7f87fc073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f8801320700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc1004e0 0x7f87fc073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f8801320700 1 -- 172.21.15.46:0/2261449163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f80095f0 con 0x7f87fc100e80 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f8801320700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87fc100e80 0x7f87fc073590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00b480 tx=0x7f87ec00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f87f2ffd700 1 -- 172.21.15.46:0/2261449163 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87ec0118c0 con 0x7f87fc100e80 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f8803d85700 1 -- 172.21.15.46:0/2261449163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87fc1a2160 con 0x7f87fc100e80 2024-02-19T19:12:28.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f87f2ffd700 1 -- 172.21.15.46:0/2261449163 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87ec010380 con 0x7f87fc100e80 2024-02-19T19:12:28.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f87f2ffd700 1 -- 172.21.15.46:0/2261449163 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87ec00f4f0 con 0x7f87fc100e80 2024-02-19T19:12:28.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.665+0000 7f8803d85700 1 -- 172.21.15.46:0/2261449163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87fc1a2570 con 0x7f87fc100e80 2024-02-19T19:12:28.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.666+0000 7f8803d85700 1 -- 172.21.15.46:0/2261449163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc1087f0 con 0x7f87fc100e80 2024-02-19T19:12:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.667+0000 7f87f2ffd700 1 -- 172.21.15.46:0/2261449163 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f87ec0104f0 con 0x7f87fc100e80 2024-02-19T19:12:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.667+0000 7f87f2ffd700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f87e806d8a0 0x7f87e806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.667+0000 7f87f2ffd700 1 -- 172.21.15.46:0/2261449163 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f87ec08d260 con 0x7f87fc100e80 2024-02-19T19:12:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.667+0000 7f8801b21700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f87e806d8a0 0x7f87e806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:28.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.668+0000 7f8801b21700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f87e806d8a0 0x7f87e806fd50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f87f8006010 tx=0x7f87f801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:28.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.672+0000 7f87f2ffd700 1 -- 172.21.15.46:0/2261449163 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f87ec056900 con 0x7f87fc100e80 2024-02-19T19:12:28.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:28.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.901+0000 7f8803d85700 1 -- 172.21.15.46:0/2261449163 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87fc061190 con 0x7f87e806d8a0 2024-02-19T19:12:28.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.902+0000 7f87f2ffd700 1 -- 172.21.15.46:0/2261449163 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f87fc061190 con 0x7f87e806d8a0 2024-02-19T19:12:28.925 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:12:28.925 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": null, 2024-02-19T19:12:28.926 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": false, 2024-02-19T19:12:28.926 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "", 2024-02-19T19:12:28.926 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-02-19T19:12:28.926 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": null, 2024-02-19T19:12:28.926 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "", 2024-02-19T19:12:28.926 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-02-19T19:12:28.926 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:12:28.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 -- 172.21.15.46:0/2261449163 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f87e806d8a0 msgr2=0x7f87e806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:28.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f87e806d8a0 0x7f87e806fd50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f87f8006010 tx=0x7f87f801a040 comp rx=0 tx=0).stop 2024-02-19T19:12:28.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 -- 172.21.15.46:0/2261449163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87fc100e80 msgr2=0x7f87fc073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:28.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87fc100e80 0x7f87fc073590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00b480 tx=0x7f87ec00b840 comp rx=0 tx=0).stop 2024-02-19T19:12:28.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 -- 172.21.15.46:0/2261449163 shutdown_connections 2024-02-19T19:12:28.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f87e806d8a0 0x7f87e806fd50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:28.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87fc1004e0 0x7f87fc073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:28.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 --2- 172.21.15.46:0/2261449163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87fc100e80 0x7f87fc073590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:28.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 -- 172.21.15.46:0/2261449163 >> 172.21.15.46:0/2261449163 conn(0x7f87fc0fbda0 msgr2=0x7f87fc0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:28.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 -- 172.21.15.46:0/2261449163 shutdown_connections 2024-02-19T19:12:28.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:28.904+0000 7f8803d85700 1 -- 172.21.15.46:0/2261449163 wait complete. 2024-02-19T19:12:29.529 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:29 smithi046 ceph-mon[88928]: pgmap v283: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:29.551 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph health detail' 2024-02-19T19:12:29.604 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:29 smithi142 ceph-mon[69118]: pgmap v283: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:29.766 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:12:30.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:30 smithi046 ceph-mon[88928]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:30.625 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:30 smithi142 ceph-mon[69118]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:31.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.284+0000 7f6dc3797700 1 -- 172.21.15.46:0/2689953545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dbc0ffd60 msgr2=0x7f6dbc103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.284+0000 7f6dc3797700 1 --2- 172.21.15.46:0/2689953545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dbc0ffd60 0x7f6dbc103d30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009910 tx=0x7f6db0009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.284+0000 7f6dc3797700 1 -- 172.21.15.46:0/2689953545 shutdown_connections 2024-02-19T19:12:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.284+0000 7f6dc3797700 1 --2- 172.21.15.46:0/2689953545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dbc0ffd60 0x7f6dbc103d30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.284+0000 7f6dc3797700 1 --2- 172.21.15.46:0/2689953545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dbc0ff3c0 0x7f6dbc0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.284+0000 7f6dc3797700 1 -- 172.21.15.46:0/2689953545 >> 172.21.15.46:0/2689953545 conn(0x7f6dbc0fac80 msgr2=0x7f6dbc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.284+0000 7f6dc3797700 1 -- 172.21.15.46:0/2689953545 shutdown_connections 2024-02-19T19:12:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.284+0000 7f6dc3797700 1 -- 172.21.15.46:0/2689953545 wait complete. 2024-02-19T19:12:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.284+0000 7f6dc3797700 1 Processor -- start 2024-02-19T19:12:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc3797700 1 -- start start 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc3797700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dbc0ff3c0 0x7f6dbc196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc3797700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dbc0ffd60 0x7f6dbc1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc3797700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc1978e0 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc3797700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc197a20 con 0x7f6dbc0ff3c0 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc0d32700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dbc0ffd60 0x7f6dbc1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc0d32700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dbc0ffd60 0x7f6dbc1972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57392/0 (socket says 172.21.15.46:57392) 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc0d32700 1 -- 172.21.15.46:0/3849538056 learned_addr learned my addr 172.21.15.46:0/3849538056 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc1533700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dbc0ff3c0 0x7f6dbc196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc0d32700 1 -- 172.21.15.46:0/3849538056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dbc0ff3c0 msgr2=0x7f6dbc196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc0d32700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dbc0ff3c0 0x7f6dbc196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc0d32700 1 -- 172.21.15.46:0/3849538056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00095f0 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.285+0000 7f6dc0d32700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dbc0ffd60 0x7f6dbc1972c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6db00092e0 tx=0x7f6db000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:31.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.286+0000 7f6dba7fc700 1 -- 172.21.15.46:0/3849538056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db001d070 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.286+0000 7f6dba7fc700 1 -- 172.21.15.46:0/3849538056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6db0005dc0 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.286+0000 7f6dc3797700 1 -- 172.21.15.46:0/3849538056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc19fdf0 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.286+0000 7f6dba7fc700 1 -- 172.21.15.46:0/3849538056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db0017400 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.286+0000 7f6dc3797700 1 -- 172.21.15.46:0/3849538056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc1a0200 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.287+0000 7f6dc3797700 1 -- 172.21.15.46:0/3849538056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc107730 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.287+0000 7f6dba7fc700 1 -- 172.21.15.46:0/3849538056 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6db000f6f0 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.287+0000 7f6dba7fc700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6da406d8a0 0x7f6da406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.288+0000 7f6dba7fc700 1 -- 172.21.15.46:0/3849538056 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f6db008e930 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.288+0000 7f6dc1533700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6da406d8a0 0x7f6da406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.288+0000 7f6dc1533700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6da406d8a0 0x7f6da406fd50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6db4005950 tx=0x7f6db400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:31.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.293+0000 7f6dba7fc700 1 -- 172.21.15.46:0/3849538056 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6db0058050 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.586+0000 7f6dc3797700 1 -- 172.21.15.46:0/3849538056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6dbc0694b0 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.610 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:31 smithi046 ceph-mon[88928]: pgmap v284: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:31.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.587+0000 7f6dba7fc700 1 -- 172.21.15.46:0/3849538056 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6db005b710 con 0x7f6dbc0ffd60 2024-02-19T19:12:31.611 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_OK 2024-02-19T19:12:31.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 -- 172.21.15.46:0/3849538056 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6da406d8a0 msgr2=0x7f6da406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:31.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6da406d8a0 0x7f6da406fd50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6db4005950 tx=0x7f6db400b410 comp rx=0 tx=0).stop 2024-02-19T19:12:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 -- 172.21.15.46:0/3849538056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dbc0ffd60 msgr2=0x7f6dbc1972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dbc0ffd60 0x7f6dbc1972c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6db00092e0 tx=0x7f6db000bd70 comp rx=0 tx=0).stop 2024-02-19T19:12:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 -- 172.21.15.46:0/3849538056 shutdown_connections 2024-02-19T19:12:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6da406d8a0 0x7f6da406fd50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dbc0ff3c0 0x7f6dbc196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 --2- 172.21.15.46:0/3849538056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dbc0ffd60 0x7f6dbc1972c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 -- 172.21.15.46:0/3849538056 >> 172.21.15.46:0/3849538056 conn(0x7f6dbc0fac80 msgr2=0x7f6dbc0fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 -- 172.21.15.46:0/3849538056 shutdown_connections 2024-02-19T19:12:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:31.589+0000 7f6dc3797700 1 -- 172.21.15.46:0/3849538056 wait complete. 2024-02-19T19:12:31.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:31 smithi142 ceph-mon[69118]: pgmap v284: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:32.385 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions' 2024-02-19T19:12:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:12:32.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:32 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3849538056' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:12:32.719 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:32 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3849538056' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:12:33.613 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:33 smithi142 ceph-mon[69118]: pgmap v285: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:33.685 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:33 smithi046 ceph-mon[88928]: pgmap v285: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:34.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.232+0000 7f1a48be4700 1 -- 172.21.15.46:0/4141425165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a440ffb10 msgr2=0x7f1a44103ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:34.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.232+0000 7f1a48be4700 1 --2- 172.21.15.46:0/4141425165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a440ffb10 0x7f1a44103ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009910 tx=0x7f1a38009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:34.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.232+0000 7f1a48be4700 1 -- 172.21.15.46:0/4141425165 shutdown_connections 2024-02-19T19:12:34.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.232+0000 7f1a48be4700 1 --2- 172.21.15.46:0/4141425165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a440ffb10 0x7f1a44103ff0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:34.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.232+0000 7f1a48be4700 1 --2- 172.21.15.46:0/4141425165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a440ff200 0x7f1a440ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:34.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.232+0000 7f1a48be4700 1 -- 172.21.15.46:0/4141425165 >> 172.21.15.46:0/4141425165 conn(0x7f1a440fac90 msgr2=0x7f1a440fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:34.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.232+0000 7f1a48be4700 1 -- 172.21.15.46:0/4141425165 shutdown_connections 2024-02-19T19:12:34.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.232+0000 7f1a48be4700 1 -- 172.21.15.46:0/4141425165 wait complete. 2024-02-19T19:12:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.233+0000 7f1a48be4700 1 Processor -- start 2024-02-19T19:12:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.233+0000 7f1a48be4700 1 -- start start 2024-02-19T19:12:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.233+0000 7f1a48be4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a440ff200 0x7f1a4419c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.233+0000 7f1a48be4700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a440ffb10 0x7f1a4419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:34.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.233+0000 7f1a48be4700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4419d0d0 con 0x7f1a440ffb10 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.233+0000 7f1a48be4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a441a0e60 con 0x7f1a440ff200 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a41d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a440ffb10 0x7f1a4419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a41d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a440ffb10 0x7f1a4419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57412/0 (socket says 172.21.15.46:57412) 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a41d9b700 1 -- 172.21.15.46:0/218186640 learned_addr learned my addr 172.21.15.46:0/218186640 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a4259c700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a440ff200 0x7f1a4419c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a41d9b700 1 -- 172.21.15.46:0/218186640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a440ff200 msgr2=0x7f1a4419c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a41d9b700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a440ff200 0x7f1a4419c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a41d9b700 1 -- 172.21.15.46:0/218186640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a380095f0 con 0x7f1a440ffb10 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a4259c700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a440ff200 0x7f1a4419c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a41d9b700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a440ffb10 0x7f1a4419c9f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1a38006010 tx=0x7f1a3800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a337fe700 1 -- 172.21.15.46:0/218186640 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a3801d070 con 0x7f1a440ffb10 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a337fe700 1 -- 172.21.15.46:0/218186640 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a3800f460 con 0x7f1a440ffb10 2024-02-19T19:12:34.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a48be4700 1 -- 172.21.15.46:0/218186640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a441a10e0 con 0x7f1a440ffb10 2024-02-19T19:12:34.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a337fe700 1 -- 172.21.15.46:0/218186640 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a38017630 con 0x7f1a440ffb10 2024-02-19T19:12:34.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.234+0000 7f1a48be4700 1 -- 172.21.15.46:0/218186640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a441a15d0 con 0x7f1a440ffb10 2024-02-19T19:12:34.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.235+0000 7f1a48be4700 1 -- 172.21.15.46:0/218186640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a441016c0 con 0x7f1a440ffb10 2024-02-19T19:12:34.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.236+0000 7f1a337fe700 1 -- 172.21.15.46:0/218186640 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1a3800f5d0 con 0x7f1a440ffb10 2024-02-19T19:12:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.236+0000 7f1a337fe700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1a2c06d8a0 0x7f1a2c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.236+0000 7f1a337fe700 1 -- 172.21.15.46:0/218186640 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f1a3808eac0 con 0x7f1a440ffb10 2024-02-19T19:12:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.236+0000 7f1a4259c700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1a2c06d8a0 0x7f1a2c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:34.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.237+0000 7f1a4259c700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1a2c06d8a0 0x7f1a2c06fd50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a34005fd0 tx=0x7f1a34005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:34.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.241+0000 7f1a337fe700 1 -- 172.21.15.46:0/218186640 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1a38058160 con 0x7f1a440ffb10 2024-02-19T19:12:34.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.535+0000 7f1a48be4700 1 -- 172.21.15.46:0/218186640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1a4402cc30 con 0x7f1a440ffb10 2024-02-19T19:12:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.535+0000 7f1a337fe700 1 -- 172.21.15.46:0/218186640 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f1a3805b820 con 0x7f1a440ffb10 2024-02-19T19:12:34.558 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:12:34.558 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:12:34.558 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:12:34.558 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:12:34.558 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:12:34.558 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:12:34.559 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 -- 172.21.15.46:0/218186640 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1a2c06d8a0 msgr2=0x7f1a2c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1a2c06d8a0 0x7f1a2c06fd50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a34005fd0 tx=0x7f1a34005ee0 comp rx=0 tx=0).stop 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 -- 172.21.15.46:0/218186640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a440ffb10 msgr2=0x7f1a4419c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a440ffb10 0x7f1a4419c9f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1a38006010 tx=0x7f1a3800be20 comp rx=0 tx=0).stop 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 -- 172.21.15.46:0/218186640 shutdown_connections 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f1a2c06d8a0 0x7f1a2c06fd50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a440ff200 0x7f1a4419c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 --2- 172.21.15.46:0/218186640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a440ffb10 0x7f1a4419c9f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 -- 172.21.15.46:0/218186640 >> 172.21.15.46:0/218186640 conn(0x7f1a440fac90 msgr2=0x7f1a44110670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 -- 172.21.15.46:0/218186640 shutdown_connections 2024-02-19T19:12:34.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:12:34.538+0000 7f1a48be4700 1 -- 172.21.15.46:0/218186640 wait complete. 2024-02-19T19:12:35.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-19T19:12:35.367 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:12:35.612 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:35 smithi046 ceph-mon[88928]: pgmap v286: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:35.612 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:35 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/218186640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:35.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:35 smithi142 ceph-mon[69118]: pgmap v286: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:35.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:35 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/218186640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:36.863 INFO:teuthology.orchestra.run.smithi046.stdout:wait for servicemap items w/ changing names to refresh 2024-02-19T19:12:37.399 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:37 smithi046 ceph-mon[88928]: pgmap v287: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:37.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'sleep 60' 2024-02-19T19:12:37.645 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:12:37.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:37 smithi142 ceph-mon[69118]: pgmap v287: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:39.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:39 smithi142 ceph-mon[69118]: pgmap v288: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:39.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:39 smithi046 ceph-mon[88928]: pgmap v288: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:41.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:41 smithi142 ceph-mon[69118]: pgmap v289: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:41.832 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:41 smithi046 ceph-mon[88928]: pgmap v289: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:43.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:43 smithi046 ceph-mon[88928]: pgmap v290: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:43.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:43.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:43 smithi142 ceph-mon[69118]: pgmap v290: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:43.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:45.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:45 smithi142 ceph-mon[69118]: pgmap v291: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:45.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:45 smithi046 ceph-mon[88928]: pgmap v291: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:47.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:47 smithi142 ceph-mon[69118]: pgmap v292: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:47.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:47 smithi046 ceph-mon[88928]: pgmap v292: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:49.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:49 smithi142 ceph-mon[69118]: pgmap v293: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:49.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:49 smithi046 ceph-mon[88928]: pgmap v293: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:51.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:51 smithi142 ceph-mon[69118]: pgmap v294: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:51.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:51 smithi046 ceph-mon[88928]: pgmap v294: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:53.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:53 smithi142 ceph-mon[69118]: pgmap v295: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:53.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:53 smithi046 ceph-mon[88928]: pgmap v295: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:55.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:55 smithi142 ceph-mon[69118]: pgmap v296: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:55.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:55 smithi046 ceph-mon[88928]: pgmap v296: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:57.638 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:57 smithi046 ceph-mon[88928]: pgmap v297: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:57.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:57 smithi142 ceph-mon[69118]: pgmap v297: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:58.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:58.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:59.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:12:59 smithi142 ceph-mon[69118]: pgmap v298: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:12:59.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:12:59 smithi046 ceph-mon[88928]: pgmap v298: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:01 smithi142 ceph-mon[69118]: pgmap v299: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:01.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:01 smithi046 ceph-mon[88928]: pgmap v299: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:03.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:03 smithi142 ceph-mon[69118]: pgmap v300: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:03.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:03 smithi046 ceph-mon[88928]: pgmap v300: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:05.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:05 smithi142 ceph-mon[69118]: pgmap v301: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:05.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:05 smithi046 ceph-mon[88928]: pgmap v301: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:07.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:07 smithi142 ceph-mon[69118]: pgmap v302: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:07.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:07 smithi046 ceph-mon[88928]: pgmap v302: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:09.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:09 smithi142 ceph-mon[69118]: pgmap v303: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:09.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:09 smithi046 ceph-mon[88928]: pgmap v303: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:11.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:11 smithi142 ceph-mon[69118]: pgmap v304: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:11.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:11 smithi046 ceph-mon[88928]: pgmap v304: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:12.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:12.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:13 smithi142 ceph-mon[69118]: pgmap v305: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:13.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:13:13.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:13:13.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:13 smithi046 ceph-mon[88928]: pgmap v305: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:13.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:13.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:13:13.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:13:14.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:14.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:13:14.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:13:14.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:14.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:13:14.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:13:15.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:15 smithi046 ceph-mon[88928]: pgmap v306: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:15.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:15 smithi142 ceph-mon[69118]: pgmap v306: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:17.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:17 smithi046 ceph-mon[88928]: pgmap v307: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:17.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:17 smithi142 ceph-mon[69118]: pgmap v307: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:19.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:19 smithi046 ceph-mon[88928]: pgmap v308: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:19.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:19 smithi142 ceph-mon[69118]: pgmap v308: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:21.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:21 smithi046 ceph-mon[88928]: pgmap v309: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:21.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:21 smithi142 ceph-mon[69118]: pgmap v309: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:23.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:23 smithi046 ceph-mon[88928]: pgmap v310: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:23.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:23 smithi142 ceph-mon[69118]: pgmap v310: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:25.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:25 smithi046 ceph-mon[88928]: pgmap v311: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:25.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:25 smithi142 ceph-mon[69118]: pgmap v311: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:27.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:27 smithi046 ceph-mon[88928]: pgmap v312: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:27.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:27 smithi142 ceph-mon[69118]: pgmap v312: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:28.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:29.726 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:29 smithi142 ceph-mon[69118]: pgmap v313: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:29.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:29 smithi046 ceph-mon[88928]: pgmap v313: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:31.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:31 smithi046 ceph-mon[88928]: pgmap v314: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:31.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:31 smithi142 ceph-mon[69118]: pgmap v314: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:33.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:33 smithi046 ceph-mon[88928]: pgmap v315: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:33.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:33 smithi142 ceph-mon[69118]: pgmap v315: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:35.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:35 smithi046 ceph-mon[88928]: pgmap v316: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:35.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:35 smithi142 ceph-mon[69118]: pgmap v316: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:37.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:37 smithi046 ceph-mon[88928]: pgmap v317: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:37.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:37 smithi142 ceph-mon[69118]: pgmap v317: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:39.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:39 smithi142 ceph-mon[69118]: pgmap v318: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:39.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:39 smithi046 ceph-mon[88928]: pgmap v318: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:39.891 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-19T19:13:40.114 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:13:41.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.647+0000 7fad6fb4d700 1 -- 172.21.15.46:0/1849514072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad681004e0 msgr2=0x7fad681008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:41.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.647+0000 7fad6fb4d700 1 --2- 172.21.15.46:0/1849514072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad681004e0 0x7fad681008b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad5800b0a0 tx=0x7fad5800b3b0 comp rx=0 tx=0).stop 2024-02-19T19:13:41.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.647+0000 7fad6fb4d700 1 -- 172.21.15.46:0/1849514072 shutdown_connections 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.647+0000 7fad6fb4d700 1 --2- 172.21.15.46:0/1849514072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad68100e80 0x7fad68104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.647+0000 7fad6fb4d700 1 --2- 172.21.15.46:0/1849514072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad681004e0 0x7fad681008b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.647+0000 7fad6fb4d700 1 -- 172.21.15.46:0/1849514072 >> 172.21.15.46:0/1849514072 conn(0x7fad680fbda0 msgr2=0x7fad680fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.647+0000 7fad6fb4d700 1 -- 172.21.15.46:0/1849514072 shutdown_connections 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.647+0000 7fad6fb4d700 1 -- 172.21.15.46:0/1849514072 wait complete. 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.647+0000 7fad6fb4d700 1 Processor -- start 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.647+0000 7fad6fb4d700 1 -- start start 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6fb4d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad681004e0 0x7fad68195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6fb4d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68100e80 0x7fad681964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6fb4d700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad68196b90 con 0x7fad68100e80 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6fb4d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6819a920 con 0x7fad681004e0 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6d0e8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68100e80 0x7fad681964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6d0e8700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68100e80 0x7fad681964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57712/0 (socket says 172.21.15.46:57712) 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6d0e8700 1 -- 172.21.15.46:0/3497901608 learned_addr learned my addr 172.21.15.46:0/3497901608 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6d8e9700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad681004e0 0x7fad68195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6d0e8700 1 -- 172.21.15.46:0/3497901608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad681004e0 msgr2=0x7fad68195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6d0e8700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad681004e0 0x7fad68195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6d0e8700 1 -- 172.21.15.46:0/3497901608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58009d00 con 0x7fad68100e80 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6d0e8700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68100e80 0x7fad681964b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c8f0 tx=0x7fad5c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad66ffd700 1 -- 172.21.15.46:0/3497901608 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad5c0078a0 con 0x7fad68100e80 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad66ffd700 1 -- 172.21.15.46:0/3497901608 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad5c00f450 con 0x7fad68100e80 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.648+0000 7fad6fb4d700 1 -- 172.21.15.46:0/3497901608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6819ac00 con 0x7fad68100e80 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.649+0000 7fad66ffd700 1 -- 172.21.15.46:0/3497901608 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad5c018610 con 0x7fad68100e80 2024-02-19T19:13:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.649+0000 7fad6fb4d700 1 -- 172.21.15.46:0/3497901608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6819b150 con 0x7fad68100e80 2024-02-19T19:13:41.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.650+0000 7fad6fb4d700 1 -- 172.21.15.46:0/3497901608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad681087f0 con 0x7fad68100e80 2024-02-19T19:13:41.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.650+0000 7fad66ffd700 1 -- 172.21.15.46:0/3497901608 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fad5c00f5c0 con 0x7fad68100e80 2024-02-19T19:13:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.650+0000 7fad66ffd700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5006d8a0 0x7fad5006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.650+0000 7fad66ffd700 1 -- 172.21.15.46:0/3497901608 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fad5c08d510 con 0x7fad68100e80 2024-02-19T19:13:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.650+0000 7fad6d8e9700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5006d8a0 0x7fad5006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.651+0000 7fad6d8e9700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5006d8a0 0x7fad5006fd50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fad58000f80 tx=0x7fad580097e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:41.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.655+0000 7fad66ffd700 1 -- 172.21.15.46:0/3497901608 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fad5c056c30 con 0x7fad68100e80 2024-02-19T19:13:41.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:41 smithi046 ceph-mon[88928]: pgmap v319: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:41.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.870+0000 7fad6fb4d700 1 -- 172.21.15.46:0/3497901608 --> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad681973e0 con 0x7fad5006d8a0 2024-02-19T19:13:41.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.882+0000 7fad66ffd700 1 -- 172.21.15.46:0/3497901608 <== mgr.34104 v2:172.21.15.46:6800/305588353 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fad681973e0 con 0x7fad5006d8a0 2024-02-19T19:13:41.904 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (10m) 95s ago 20m 25.7M - 0.25.0 c8568f914cd2 882935994a77 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (109s) 95s ago 20m 7759k - 19.0.0-1450-gf78a58c0 f081f847070a 075a1e772814 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi142 smithi142 running (103s) 101s ago 18m 6953k - 19.0.0-1450-gf78a58c0 f081f847070a 9942823fa52b 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (7m) 95s ago 20m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 40005123cb2c 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi142 smithi142 running (7m) 101s ago 18m 6665k - 19.0.0-1450-gf78a58c0 f081f847070a 691c4c1eaa9c 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (9m) 95s ago 19m 86.3M - 9.4.12 a0ea5e3c46d9 3ff678b5fdf0 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.bwvkwa smithi046 running (2m) 95s ago 14m 61.0M - 19.0.0-1450-gf78a58c0 f081f847070a 594407d08977 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hrbbel smithi046 running (2m) 95s ago 14m 112M - 19.0.0-1450-gf78a58c0 f081f847070a c532c6eef6c1 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.eqnctx smithi142 running (2m) 101s ago 14m 15.8M - 19.0.0-1450-gf78a58c0 f081f847070a dbe9e8c442ce 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi142.maazlq smithi142 running (2m) 101s ago 14m 12.6M - 19.0.0-1450-gf78a58c0 f081f847070a 8bb16a987136 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.qtceex smithi046 *:8443,9283,8765 running (11m) 95s ago 21m 513M - 19.0.0-1450-gf78a58c0 f081f847070a 3fe239137589 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi142.fwekwv smithi142 *:8443,9283,8765 running (10m) 101s ago 18m 451M - 19.0.0-1450-gf78a58c0 f081f847070a 4cd55c72c5fc 2024-02-19T19:13:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (8m) 95s ago 21m 60.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a ef2d7130eaee 2024-02-19T19:13:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi142 smithi142 running (7m) 101s ago 18m 48.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 013f41b4fcd9 2024-02-19T19:13:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (10m) 95s ago 20m 16.9M - 1.5.0 0da6a335fe13 d77d0275588a 2024-02-19T19:13:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi142 smithi142 *:9100 running (10m) 101s ago 18m 17.1M - 1.5.0 0da6a335fe13 ea830a1f48ec 2024-02-19T19:13:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (6m) 95s ago 17m 277M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 9a17e8a3661e 2024-02-19T19:13:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (6m) 95s ago 17m 332M 1217M 19.0.0-1450-gf78a58c0 f081f847070a 974e56511c36 2024-02-19T19:13:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (5m) 95s ago 17m 197M 1217M 19.0.0-1450-gf78a58c0 f081f847070a a31225ea4dec 2024-02-19T19:13:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi142 running (4m) 101s ago 16m 150M 2240M 19.0.0-1450-gf78a58c0 f081f847070a b46795b87c3e 2024-02-19T19:13:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi142 running (3m) 101s ago 16m 91.6M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 645517de8ff6 2024-02-19T19:13:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi142 running (3m) 101s ago 15m 99.4M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 510ea3b4a23b 2024-02-19T19:13:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (10m) 95s ago 19m 70.7M - 2.43.0 a07b618ecd1d 8bfaa0b34d97 2024-02-19T19:13:41.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 -- 172.21.15.46:0/3497901608 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5006d8a0 msgr2=0x7fad5006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:41.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5006d8a0 0x7fad5006fd50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fad58000f80 tx=0x7fad580097e0 comp rx=0 tx=0).stop 2024-02-19T19:13:41.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 -- 172.21.15.46:0/3497901608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68100e80 msgr2=0x7fad681964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:41.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68100e80 0x7fad681964b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c8f0 tx=0x7fad5c00cc00 comp rx=0 tx=0).stop 2024-02-19T19:13:41.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 -- 172.21.15.46:0/3497901608 shutdown_connections 2024-02-19T19:13:41.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5006d8a0 0x7fad5006fd50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:41.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad681004e0 0x7fad68195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:41.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 --2- 172.21.15.46:0/3497901608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68100e80 0x7fad681964b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:41.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 -- 172.21.15.46:0/3497901608 >> 172.21.15.46:0/3497901608 conn(0x7fad680fbda0 msgr2=0x7fad680fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:41.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 -- 172.21.15.46:0/3497901608 shutdown_connections 2024-02-19T19:13:41.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:41.884+0000 7fad6fb4d700 1 -- 172.21.15.46:0/3497901608 wait complete. 2024-02-19T19:13:41.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:41 smithi142 ceph-mon[69118]: pgmap v319: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:42.460 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions' 2024-02-19T19:13:42.672 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:13:43.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:43 smithi046 ceph-mon[88928]: pgmap v320: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:43.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:43 smithi046 ceph-mon[88928]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:43.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:43.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:43 smithi142 ceph-mon[69118]: pgmap v320: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:43.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:43 smithi142 ceph-mon[69118]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:43.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:44.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.252+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3884345156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaec100e80 msgr2=0x7fbaec104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:44.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.252+0000 7fbaf0a31700 1 --2- 172.21.15.46:0/3884345156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaec100e80 0x7fbaec104e50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009910 tx=0x7fbae0009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:44.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.252+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3884345156 shutdown_connections 2024-02-19T19:13:44.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.252+0000 7fbaf0a31700 1 --2- 172.21.15.46:0/3884345156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaec100e80 0x7fbaec104e50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:44.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.252+0000 7fbaf0a31700 1 --2- 172.21.15.46:0/3884345156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaec1004e0 0x7fbaec1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:44.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.252+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3884345156 >> 172.21.15.46:0/3884345156 conn(0x7fbaec0fbda0 msgr2=0x7fbaec0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:44.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.253+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3884345156 shutdown_connections 2024-02-19T19:13:44.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.253+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3884345156 wait complete. 2024-02-19T19:13:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.253+0000 7fbaf0a31700 1 Processor -- start 2024-02-19T19:13:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.253+0000 7fbaf0a31700 1 -- start start 2024-02-19T19:13:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbaf0a31700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaec1004e0 0x7fbaec195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbaf0a31700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaec100e80 0x7fbaec196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbaf0a31700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec196b30 con 0x7fbaec100e80 2024-02-19T19:13:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbaf0a31700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec19a8c0 con 0x7fbaec1004e0 2024-02-19T19:13:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbae9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaec100e80 0x7fbaec196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:44.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbae9d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaec100e80 0x7fbaec196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57730/0 (socket says 172.21.15.46:57730) 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbae9d9b700 1 -- 172.21.15.46:0/3875001226 learned_addr learned my addr 172.21.15.46:0/3875001226 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbaea59c700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaec1004e0 0x7fbaec195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbae9d9b700 1 -- 172.21.15.46:0/3875001226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaec1004e0 msgr2=0x7fbaec195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbae9d9b700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaec1004e0 0x7fbaec195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbae9d9b700 1 -- 172.21.15.46:0/3875001226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae00095f0 con 0x7fbaec100e80 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbae9d9b700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaec100e80 0x7fbaec196450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbae00092e0 tx=0x7fbae000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.254+0000 7fbadb7fe700 1 -- 172.21.15.46:0/3875001226 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbae001d070 con 0x7fbaec100e80 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.255+0000 7fbadb7fe700 1 -- 172.21.15.46:0/3875001226 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbae000f460 con 0x7fbaec100e80 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.255+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3875001226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaec19ab40 con 0x7fbaec100e80 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.255+0000 7fbadb7fe700 1 -- 172.21.15.46:0/3875001226 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbae00175d0 con 0x7fbaec100e80 2024-02-19T19:13:44.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.255+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3875001226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec19b030 con 0x7fbaec100e80 2024-02-19T19:13:44.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.256+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3875001226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec108850 con 0x7fbaec100e80 2024-02-19T19:13:44.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.256+0000 7fbadb7fe700 1 -- 172.21.15.46:0/3875001226 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fbae0003a60 con 0x7fbaec100e80 2024-02-19T19:13:44.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.256+0000 7fbadb7fe700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbad406d8a0 0x7fbad406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:44.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.257+0000 7fbadb7fe700 1 -- 172.21.15.46:0/3875001226 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fbae008ea20 con 0x7fbaec100e80 2024-02-19T19:13:44.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.257+0000 7fbaea59c700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbad406d8a0 0x7fbad406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:44.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.257+0000 7fbaea59c700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbad406d8a0 0x7fbad406fd50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbadc005950 tx=0x7fbadc00a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:44.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.261+0000 7fbadb7fe700 1 -- 172.21.15.46:0/3875001226 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbae0058140 con 0x7fbaec100e80 2024-02-19T19:13:44.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.554+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3875001226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbaec197270 con 0x7fbaec100e80 2024-02-19T19:13:44.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.555+0000 7fbadb7fe700 1 -- 172.21.15.46:0/3875001226 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fbae005b800 con 0x7fbaec100e80 2024-02-19T19:13:44.578 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-02-19T19:13:44.578 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-02-19T19:13:44.578 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:13:44.578 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:13:44.578 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-02-19T19:13:44.578 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:13:44.578 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:13:44.579 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-02-19T19:13:44.579 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:13:44.579 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:13:44.579 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-02-19T19:13:44.579 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:13:44.579 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-02-19T19:13:44.579 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-02-19T19:13:44.579 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-19T19:13:44.579 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-02-19T19:13:44.579 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-02-19T19:13:44.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.557+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3875001226 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbad406d8a0 msgr2=0x7fbad406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:44.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.557+0000 7fbaf0a31700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbad406d8a0 0x7fbad406fd50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbadc005950 tx=0x7fbadc00a300 comp rx=0 tx=0).stop 2024-02-19T19:13:44.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.557+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3875001226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaec100e80 msgr2=0x7fbaec196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.557+0000 7fbaf0a31700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaec100e80 0x7fbaec196450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbae00092e0 tx=0x7fbae000bd70 comp rx=0 tx=0).stop 2024-02-19T19:13:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.557+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3875001226 shutdown_connections 2024-02-19T19:13:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.557+0000 7fbaf0a31700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbad406d8a0 0x7fbad406fd50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.557+0000 7fbaf0a31700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaec1004e0 0x7fbaec195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.557+0000 7fbaf0a31700 1 --2- 172.21.15.46:0/3875001226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbaec100e80 0x7fbaec196450 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.557+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3875001226 >> 172.21.15.46:0/3875001226 conn(0x7fbaec0fbda0 msgr2=0x7fbaec0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.558+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3875001226 shutdown_connections 2024-02-19T19:13:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:44.558+0000 7fbaf0a31700 1 -- 172.21.15.46:0/3875001226 wait complete. 2024-02-19T19:13:45.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-19T19:13:45.377 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:13:45.756 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:45 smithi046 ceph-mon[88928]: pgmap v321: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:45.756 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:45 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3875001226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:45.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:45 smithi142 ceph-mon[69118]: pgmap v321: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:45.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:45 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3875001226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:47.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.983+0000 7ffaa6199700 1 -- 172.21.15.46:0/3088939588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa01004e0 msgr2=0x7ffaa01008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.983+0000 7ffaa6199700 1 --2- 172.21.15.46:0/3088939588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa01004e0 0x7ffaa01008b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009910 tx=0x7ffa90009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.983+0000 7ffaa6199700 1 -- 172.21.15.46:0/3088939588 shutdown_connections 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.983+0000 7ffaa6199700 1 --2- 172.21.15.46:0/3088939588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaa0100e80 0x7ffaa0104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.983+0000 7ffaa6199700 1 --2- 172.21.15.46:0/3088939588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa01004e0 0x7ffaa01008b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.983+0000 7ffaa6199700 1 -- 172.21.15.46:0/3088939588 >> 172.21.15.46:0/3088939588 conn(0x7ffaa00fbda0 msgr2=0x7ffaa00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.983+0000 7ffaa6199700 1 -- 172.21.15.46:0/3088939588 shutdown_connections 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.983+0000 7ffaa6199700 1 -- 172.21.15.46:0/3088939588 wait complete. 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.984+0000 7ffaa6199700 1 Processor -- start 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.984+0000 7ffaa6199700 1 -- start start 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.984+0000 7ffaa6199700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa01004e0 0x7ffaa0195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:47.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.984+0000 7ffaa6199700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaa0100e80 0x7ffaa01964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:47.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.984+0000 7ffaa6199700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0196bb0 con 0x7ffaa01004e0 2024-02-19T19:13:47.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.984+0000 7ffaa6199700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa019a940 con 0x7ffaa0100e80 2024-02-19T19:13:47.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffa9f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa01004e0 0x7ffaa0195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:47.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffa9f7fe700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa01004e0 0x7ffaa0195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57744/0 (socket says 172.21.15.46:57744) 2024-02-19T19:13:47.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffa9f7fe700 1 -- 172.21.15.46:0/783653788 learned_addr learned my addr 172.21.15.46:0/783653788 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:47.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffa9f7fe700 1 -- 172.21.15.46:0/783653788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaa0100e80 msgr2=0x7ffaa01964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:47.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffa9f7fe700 1 --2- 172.21.15.46:0/783653788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaa0100e80 0x7ffaa01964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:47.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffa9f7fe700 1 -- 172.21.15.46:0/783653788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900095f0 con 0x7ffaa01004e0 2024-02-19T19:13:47.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffa9f7fe700 1 --2- 172.21.15.46:0/783653788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa01004e0 0x7ffaa0195f90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffa90006010 tx=0x7ffa9000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:47.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffa9cff9700 1 -- 172.21.15.46:0/783653788 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa9001d070 con 0x7ffaa01004e0 2024-02-19T19:13:47.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffa9cff9700 1 -- 172.21.15.46:0/783653788 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa90004fb0 con 0x7ffaa01004e0 2024-02-19T19:13:47.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffaa6199700 1 -- 172.21.15.46:0/783653788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa019abc0 con 0x7ffaa01004e0 2024-02-19T19:13:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffa9cff9700 1 -- 172.21.15.46:0/783653788 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa90022ea0 con 0x7ffaa01004e0 2024-02-19T19:13:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.985+0000 7ffaa6199700 1 -- 172.21.15.46:0/783653788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa019b0b0 con 0x7ffaa01004e0 2024-02-19T19:13:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.986+0000 7ffaa6199700 1 -- 172.21.15.46:0/783653788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa01087f0 con 0x7ffaa01004e0 2024-02-19T19:13:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.987+0000 7ffa9cff9700 1 -- 172.21.15.46:0/783653788 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ffa90022470 con 0x7ffaa01004e0 2024-02-19T19:13:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.987+0000 7ffa9cff9700 1 --2- 172.21.15.46:0/783653788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ffa8806d8a0 0x7ffa8806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.987+0000 7ffa9cff9700 1 -- 172.21.15.46:0/783653788 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7ffa9008ead0 con 0x7ffaa01004e0 2024-02-19T19:13:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.987+0000 7ffa9effd700 1 --2- 172.21.15.46:0/783653788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ffa8806d8a0 0x7ffa8806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:47.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.988+0000 7ffa9effd700 1 --2- 172.21.15.46:0/783653788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ffa8806d8a0 0x7ffa8806fd50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffaa01975b0 tx=0x7ffa94006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:47.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:46.992+0000 7ffa9cff9700 1 -- 172.21.15.46:0/783653788 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffa900582a0 con 0x7ffaa01004e0 2024-02-19T19:13:47.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.285+0000 7ffaa6199700 1 -- 172.21.15.46:0/783653788 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffaa004f2a0 con 0x7ffaa01004e0 2024-02-19T19:13:47.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.285+0000 7ffa9cff9700 1 -- 172.21.15.46:0/783653788 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7ffa9005b960 con 0x7ffaa01004e0 2024-02-19T19:13:47.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.287+0000 7ffaa6199700 1 -- 172.21.15.46:0/783653788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ffa8806d8a0 msgr2=0x7ffa8806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:47.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.287+0000 7ffaa6199700 1 --2- 172.21.15.46:0/783653788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ffa8806d8a0 0x7ffa8806fd50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffaa01975b0 tx=0x7ffa94006d20 comp rx=0 tx=0).stop 2024-02-19T19:13:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.287+0000 7ffaa6199700 1 -- 172.21.15.46:0/783653788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa01004e0 msgr2=0x7ffaa0195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.287+0000 7ffaa6199700 1 --2- 172.21.15.46:0/783653788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa01004e0 0x7ffaa0195f90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffa90006010 tx=0x7ffa9000be20 comp rx=0 tx=0).stop 2024-02-19T19:13:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.287+0000 7ffaa6199700 1 -- 172.21.15.46:0/783653788 shutdown_connections 2024-02-19T19:13:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.287+0000 7ffaa6199700 1 --2- 172.21.15.46:0/783653788 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ffa8806d8a0 0x7ffa8806fd50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.287+0000 7ffaa6199700 1 --2- 172.21.15.46:0/783653788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffaa01004e0 0x7ffaa0195f90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.287+0000 7ffaa6199700 1 --2- 172.21.15.46:0/783653788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaa0100e80 0x7ffaa01964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.287+0000 7ffaa6199700 1 -- 172.21.15.46:0/783653788 >> 172.21.15.46:0/783653788 conn(0x7ffaa00fbda0 msgr2=0x7ffaa00fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.288+0000 7ffaa6199700 1 -- 172.21.15.46:0/783653788 shutdown_connections 2024-02-19T19:13:47.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:47.288+0000 7ffaa6199700 1 -- 172.21.15.46:0/783653788 wait complete. 2024-02-19T19:13:47.320 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-02-19T19:13:47.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:47 smithi046 ceph-mon[88928]: pgmap v322: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:47.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:47 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/783653788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:47.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:47 smithi142 ceph-mon[69118]: pgmap v322: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:47.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:47 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/783653788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:47.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-19T19:13:48.168 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:13:49.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:49 smithi142 ceph-mon[69118]: pgmap v323: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:49.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.733+0000 7f6ab5027700 1 -- 172.21.15.46:0/2645225617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab0100e80 msgr2=0x7f6ab0104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.733+0000 7f6ab5027700 1 --2- 172.21.15.46:0/2645225617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab0100e80 0x7f6ab0104e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009910 tx=0x7f6aa4009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.733+0000 7f6ab5027700 1 -- 172.21.15.46:0/2645225617 shutdown_connections 2024-02-19T19:13:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.733+0000 7f6ab5027700 1 --2- 172.21.15.46:0/2645225617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab0100e80 0x7f6ab0104e50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.733+0000 7f6ab5027700 1 --2- 172.21.15.46:0/2645225617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ab01004e0 0x7f6ab01008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.733+0000 7f6ab5027700 1 -- 172.21.15.46:0/2645225617 >> 172.21.15.46:0/2645225617 conn(0x7f6ab00fbda0 msgr2=0x7f6ab00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.733+0000 7f6ab5027700 1 -- 172.21.15.46:0/2645225617 shutdown_connections 2024-02-19T19:13:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.733+0000 7f6ab5027700 1 -- 172.21.15.46:0/2645225617 wait complete. 2024-02-19T19:13:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.734+0000 7f6ab5027700 1 Processor -- start 2024-02-19T19:13:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.734+0000 7f6ab5027700 1 -- start start 2024-02-19T19:13:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.734+0000 7f6ab5027700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab01004e0 0x7f6ab0073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.734+0000 7f6ab5027700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ab0100e80 0x7f6ab0073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.734+0000 7f6ab5027700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0073ad0 con 0x7f6ab01004e0 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.734+0000 7f6ab5027700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0073c10 con 0x7f6ab0100e80 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.734+0000 7f6aaed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab01004e0 0x7f6ab0073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.734+0000 7f6aaed9d700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab01004e0 0x7f6ab0073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40218/0 (socket says 172.21.15.46:40218) 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.734+0000 7f6aaed9d700 1 -- 172.21.15.46:0/2792119639 learned_addr learned my addr 172.21.15.46:0/2792119639 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.734+0000 7f6aae59c700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ab0100e80 0x7f6ab0073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.735+0000 7f6aaed9d700 1 -- 172.21.15.46:0/2792119639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ab0100e80 msgr2=0x7f6ab0073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.735+0000 7f6aaed9d700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ab0100e80 0x7f6ab0073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.735+0000 7f6aaed9d700 1 -- 172.21.15.46:0/2792119639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa40095f0 con 0x7f6ab01004e0 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.735+0000 7f6aaed9d700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab01004e0 0x7f6ab0073050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000b4b0 tx=0x7f6aa000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:49.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.735+0000 7f6a97fff700 1 -- 172.21.15.46:0/2792119639 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aa0011800 con 0x7f6ab01004e0 2024-02-19T19:13:49.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.735+0000 7f6a97fff700 1 -- 172.21.15.46:0/2792119639 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6aa0011e20 con 0x7f6ab01004e0 2024-02-19T19:13:49.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.735+0000 7f6ab5027700 1 -- 172.21.15.46:0/2792119639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab01a21d0 con 0x7f6ab01004e0 2024-02-19T19:13:49.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.735+0000 7f6a97fff700 1 -- 172.21.15.46:0/2792119639 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aa000f2e0 con 0x7f6ab01004e0 2024-02-19T19:13:49.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.735+0000 7f6ab5027700 1 -- 172.21.15.46:0/2792119639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab01a25e0 con 0x7f6ab01004e0 2024-02-19T19:13:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.736+0000 7f6ab5027700 1 -- 172.21.15.46:0/2792119639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab0108780 con 0x7f6ab01004e0 2024-02-19T19:13:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.736+0000 7f6a97fff700 1 -- 172.21.15.46:0/2792119639 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6aa0010380 con 0x7f6ab01004e0 2024-02-19T19:13:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.737+0000 7f6a97fff700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6a9806d8a0 0x7f6a9806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.737+0000 7f6a97fff700 1 -- 172.21.15.46:0/2792119639 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f6aa008d180 con 0x7f6ab01004e0 2024-02-19T19:13:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.737+0000 7f6aae59c700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6a9806d8a0 0x7f6a9806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.737+0000 7f6aae59c700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6a9806d8a0 0x7f6a9806fd50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0074840 tx=0x7f6aa401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:49.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:49.742+0000 7f6a97fff700 1 -- 172.21.15.46:0/2792119639 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6aa0056820 con 0x7f6ab01004e0 2024-02-19T19:13:49.764 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:49 smithi046 ceph-mon[88928]: pgmap v323: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:50.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.033+0000 7f6ab5027700 1 -- 172.21.15.46:0/2792119639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ab0108160 con 0x7f6ab01004e0 2024-02-19T19:13:50.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.033+0000 7f6a97fff700 1 -- 172.21.15.46:0/2792119639 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f6aa0059ee0 con 0x7f6ab01004e0 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.035+0000 7f6ab5027700 1 -- 172.21.15.46:0/2792119639 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6a9806d8a0 msgr2=0x7f6a9806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.035+0000 7f6ab5027700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6a9806d8a0 0x7f6a9806fd50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0074840 tx=0x7f6aa401a040 comp rx=0 tx=0).stop 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.035+0000 7f6ab5027700 1 -- 172.21.15.46:0/2792119639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab01004e0 msgr2=0x7f6ab0073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.035+0000 7f6ab5027700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab01004e0 0x7f6ab0073050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000b4b0 tx=0x7f6aa000b7c0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.035+0000 7f6ab5027700 1 -- 172.21.15.46:0/2792119639 shutdown_connections 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.035+0000 7f6ab5027700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6a9806d8a0 0x7f6a9806fd50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.035+0000 7f6ab5027700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ab01004e0 0x7f6ab0073050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.035+0000 7f6ab5027700 1 --2- 172.21.15.46:0/2792119639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ab0100e80 0x7f6ab0073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.036+0000 7f6ab5027700 1 -- 172.21.15.46:0/2792119639 >> 172.21.15.46:0/2792119639 conn(0x7f6ab00fbda0 msgr2=0x7f6ab00fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.036+0000 7f6ab5027700 1 -- 172.21.15.46:0/2792119639 shutdown_connections 2024-02-19T19:13:50.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:50.036+0000 7f6ab5027700 1 -- 172.21.15.46:0/2792119639 wait complete. 2024-02-19T19:13:50.068 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)" 2024-02-19T19:13:50.699 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:50 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2792119639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:50.720 DEBUG:teuthology.parallel:result is None 2024-02-19T19:13:50.720 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T19:13:50.733 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T19:13:50.733 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c412ec66-cf57-11ee-95bb-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-19T19:13:50.942 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/mon.smithi046/config 2024-02-19T19:13:50.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:50 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2792119639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:51.714 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:51 smithi046 ceph-mon[88928]: pgmap v324: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:51.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:51 smithi142 ceph-mon[69118]: pgmap v324: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.515+0000 7f0d2ca62700 1 -- 172.21.15.46:0/4033873247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d28101d30 msgr2=0x7f0d2810a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.515+0000 7f0d2ca62700 1 --2- 172.21.15.46:0/4033873247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d28101d30 0x7f0d2810a230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009910 tx=0x7f0d1c009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:52.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.515+0000 7f0d2ca62700 1 -- 172.21.15.46:0/4033873247 shutdown_connections 2024-02-19T19:13:52.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.515+0000 7f0d2ca62700 1 --2- 172.21.15.46:0/4033873247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d28101d30 0x7f0d2810a230 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:52.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.515+0000 7f0d2ca62700 1 --2- 172.21.15.46:0/4033873247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d28101420 0x7f0d281017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:52.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.515+0000 7f0d2ca62700 1 -- 172.21.15.46:0/4033873247 >> 172.21.15.46:0/4033873247 conn(0x7f0d280fac80 msgr2=0x7f0d280fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:52.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.515+0000 7f0d2ca62700 1 -- 172.21.15.46:0/4033873247 shutdown_connections 2024-02-19T19:13:52.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.515+0000 7f0d2ca62700 1 -- 172.21.15.46:0/4033873247 wait complete. 2024-02-19T19:13:52.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d2ca62700 1 Processor -- start 2024-02-19T19:13:52.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d2ca62700 1 -- start start 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d2ca62700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d28101420 0x7f0d28195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d2ca62700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d28101d30 0x7f0d28196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d2ca62700 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28196c10 con 0x7f0d28101d30 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d2ca62700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2819a9a0 con 0x7f0d28101420 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d25d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d28101d30 0x7f0d28196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d25d9b700 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d28101d30 0x7f0d28196530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40242/0 (socket says 172.21.15.46:40242) 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d25d9b700 1 -- 172.21.15.46:0/963183526 learned_addr learned my addr 172.21.15.46:0/963183526 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d2659c700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d28101420 0x7f0d28195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d25d9b700 1 -- 172.21.15.46:0/963183526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d28101420 msgr2=0x7f0d28195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d25d9b700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d28101420 0x7f0d28195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.516+0000 7f0d25d9b700 1 -- 172.21.15.46:0/963183526 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c0095f0 con 0x7f0d28101d30 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.517+0000 7f0d25d9b700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d28101d30 0x7f0d28196530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c006010 tx=0x7f0d1c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:52.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.517+0000 7f0d177fe700 1 -- 172.21.15.46:0/963183526 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d1c01d070 con 0x7f0d28101d30 2024-02-19T19:13:52.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.517+0000 7f0d2ca62700 1 -- 172.21.15.46:0/963183526 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2819ac20 con 0x7f0d28101d30 2024-02-19T19:13:52.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.517+0000 7f0d177fe700 1 -- 172.21.15.46:0/963183526 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d1c00f460 con 0x7f0d28101d30 2024-02-19T19:13:52.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.517+0000 7f0d177fe700 1 -- 172.21.15.46:0/963183526 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d1c017630 con 0x7f0d28101d30 2024-02-19T19:13:52.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.517+0000 7f0d2ca62700 1 -- 172.21.15.46:0/963183526 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2819b110 con 0x7f0d28101d30 2024-02-19T19:13:52.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.518+0000 7f0d2ca62700 1 -- 172.21.15.46:0/963183526 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d281078a0 con 0x7f0d28101d30 2024-02-19T19:13:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.519+0000 7f0d177fe700 1 -- 172.21.15.46:0/963183526 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0d1c00f5d0 con 0x7f0d28101d30 2024-02-19T19:13:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.519+0000 7f0d177fe700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0d1006d8a0 0x7f0d1006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.519+0000 7f0d177fe700 1 -- 172.21.15.46:0/963183526 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f0d1c08eb80 con 0x7f0d28101d30 2024-02-19T19:13:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.519+0000 7f0d2659c700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0d1006d8a0 0x7f0d1006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:52.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.519+0000 7f0d2659c700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0d1006d8a0 0x7f0d1006fd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009a10 tx=0x7f0d18009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:52.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.524+0000 7f0d177fe700 1 -- 172.21.15.46:0/963183526 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0d1c058220 con 0x7f0d28101d30 2024-02-19T19:13:52.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.777+0000 7f0d2ca62700 1 -- 172.21.15.46:0/963183526 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0d281973f0 con 0x7f0d28101d30 2024-02-19T19:13:52.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.777+0000 7f0d177fe700 1 -- 172.21.15.46:0/963183526 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1881 (secure 0 0 0) 0x7f0d1c05b8e0 con 0x7f0d28101d30 2024-02-19T19:13:52.800 INFO:teuthology.orchestra.run.smithi046.stdout:e37 2024-02-19T19:13:52.800 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 37 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-02-19T18:59:19.247749+0000 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-02-19T19:12:11.018282+0000 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-02-19T19:13:52.801 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 114 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=34412,1=34444} 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-02-19T19:13:52.802 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hrbbel{0:34412} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.46:6826/1638882103,v1:172.21.15.46:6827/1638882103] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.bwvkwa{1:34444} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.46:6828/3321378222,v1:172.21.15.46:6829/3321378222] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.maazlq{-1:44355} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6824/315214117,v1:172.21.15.142:6825/315214117] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:13:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi142.eqnctx{-1:44359} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/2993903126,v1:172.21.15.142:6827/2993903126] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:13:52.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 -- 172.21.15.46:0/963183526 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0d1006d8a0 msgr2=0x7f0d1006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:52.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0d1006d8a0 0x7f0d1006fd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009a10 tx=0x7f0d18009190 comp rx=0 tx=0).stop 2024-02-19T19:13:52.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 -- 172.21.15.46:0/963183526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d28101d30 msgr2=0x7f0d28196530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:52.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d28101d30 0x7f0d28196530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c006010 tx=0x7f0d1c00bd70 comp rx=0 tx=0).stop 2024-02-19T19:13:52.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 -- 172.21.15.46:0/963183526 shutdown_connections 2024-02-19T19:13:52.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f0d1006d8a0 0x7f0d1006fd50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:52.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d28101420 0x7f0d28195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:52.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 --2- 172.21.15.46:0/963183526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d28101d30 0x7f0d28196530 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:52.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 -- 172.21.15.46:0/963183526 >> 172.21.15.46:0/963183526 conn(0x7f0d280fac80 msgr2=0x7f0d281049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:52.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 -- 172.21.15.46:0/963183526 shutdown_connections 2024-02-19T19:13:52.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:52.780+0000 7f0d2ca62700 1 -- 172.21.15.46:0/963183526 wait complete. 2024-02-19T19:13:52.805 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 37 2024-02-19T19:13:53.502 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-19T19:13:53.514 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T19:13:53.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.599+0000 7fb806469640 1 -- 172.21.15.46:0/736310203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8001056a0 msgr2=0x7fb800105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:53.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.599+0000 7fb806469640 1 --2- 172.21.15.46:0/736310203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8001056a0 0x7fb800105a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009880 tx=0x7fb7f002bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:53.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 -- 172.21.15.46:0/736310203 shutdown_connections 2024-02-19T19:13:53.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 --2- 172.21.15.46:0/736310203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8000ff690 0x7fb8000ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:53.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 --2- 172.21.15.46:0/736310203 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8001056a0 0x7fb800105a70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:53.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 -- 172.21.15.46:0/736310203 >> 172.21.15.46:0/736310203 conn(0x7fb8000fb1d0 msgr2=0x7fb8000fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:53.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 -- 172.21.15.46:0/736310203 shutdown_connections 2024-02-19T19:13:53.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 -- 172.21.15.46:0/736310203 wait complete. 2024-02-19T19:13:53.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 Processor -- start 2024-02-19T19:13:53.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 -- start start 2024-02-19T19:13:53.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000ff690 0x7fb800072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:53.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8001056a0 0x7fb800072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:53.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb800072fe0 con 0x7fb8000ff690 2024-02-19T19:13:53.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.600+0000 7fb806469640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb800073150 con 0x7fb8001056a0 2024-02-19T19:13:53.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000ff690 0x7fb800072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000ff690 0x7fb800072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40260/0 (socket says 172.21.15.46:40260) 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7fffff640 1 -- 172.21.15.46:0/3521171793 learned_addr learned my addr 172.21.15.46:0/3521171793 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7fffff640 1 -- 172.21.15.46:0/3521171793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8001056a0 msgr2=0x7fb800072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7ff7fe640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8001056a0 0x7fb800072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7fffff640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8001056a0 0x7fb800072aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7fffff640 1 -- 172.21.15.46:0/3521171793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0009560 con 0x7fb8000ff690 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7fffff640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000ff690 0x7fb800072560 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009230 tx=0x7fb7f0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7fd7fa640 1 -- 172.21.15.46:0/3521171793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7f00037c0 con 0x7fb8000ff690 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7fd7fa640 1 -- 172.21.15.46:0/3521171793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7f0003de0 con 0x7fb8000ff690 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb806469640 1 -- 172.21.15.46:0/3521171793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb800073370 con 0x7fb8000ff690 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb7fd7fa640 1 -- 172.21.15.46:0/3521171793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7f0034440 con 0x7fb8000ff690 2024-02-19T19:13:53.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.601+0000 7fb806469640 1 -- 172.21.15.46:0/3521171793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8001a18a0 con 0x7fb8000ff690 2024-02-19T19:13:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.602+0000 7fb806469640 1 -- 172.21.15.46:0/3521171793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80004e000 con 0x7fb8000ff690 2024-02-19T19:13:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.603+0000 7fb7fd7fa640 1 -- 172.21.15.46:0/3521171793 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb7f0004fb0 con 0x7fb8000ff690 2024-02-19T19:13:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.603+0000 7fb7fd7fa640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb7ec06d8d0 0x7fb7ec06fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:53.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.603+0000 7fb7fd7fa640 1 -- 172.21.15.46:0/3521171793 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fb7f00afb60 con 0x7fb8000ff690 2024-02-19T19:13:53.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.603+0000 7fb7ff7fe640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb7ec06d8d0 0x7fb7ec06fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:53.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.604+0000 7fb7ff7fe640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb7ec06d8d0 0x7fb7ec06fd80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb800073d50 tx=0x7fb7e8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.608+0000 7fb7fd7fa640 1 -- 172.21.15.46:0/3521171793 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb7f0079200 con 0x7fb8000ff690 2024-02-19T19:13:53.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:53 smithi046 ceph-mon[88928]: pgmap v325: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:53.775 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:53 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/963183526' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:13:53.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.791+0000 7fb806469640 1 -- 172.21.15.46:0/3521171793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb80010cb70 con 0x7fb8000ff690 2024-02-19T19:13:53.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.792+0000 7fb7fd7fa640 1 -- 172.21.15.46:0/3521171793 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17233 (secure 0 0 0) 0x7fb7f007c8c0 con 0x7fb8000ff690 2024-02-19T19:13:53.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:53.815 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":119,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","created":"2024-02-19T18:51:43.710287+0000","modified":"2024-02-19T19:11:31.350224+0000","last_up_change":"2024-02-19T19:10:34.693287+0000","last_in_change":"2024-02-19T18:57:44.164228+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:56:48.450849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-19T18:59:17.631025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.059999942779541,"score_stable":2.059999942779541,"optimal_score":1,"raw_score_acting":2.059999942779541,"raw_score_stable":2.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-19T18:59:18.491487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ea35c0-be56-4830-9abc-c67aa3feed47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":113,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6803","nonce":389415197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6805","nonce":389415197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6809","nonce":389415197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6807","nonce":389415197}]},"public_addr":"172.21.15.46:6803/389415197","cluster_addr":"172.21.15.46:6805/389415197","heartbeat_back_addr":"172.21.15.46:6809/389415197","heartbeat_front_addr":"172.21.15.46:6807/389415197","state":["exists","up"]},{"osd":1,"uuid":"0dcb0202-8fa1-4a72-939d-dd8a5ced3a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":64,"up_thru":113,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6811","nonce":2409899830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6813","nonce":2409899830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6817","nonce":2409899830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6815","nonce":2409899830}]},"public_addr":"172.21.15.46:6811/2409899830","cluster_addr":"172.21.15.46:6813/2409899830","heartbeat_back_addr":"172.21.15.46:6817/2409899830","heartbeat_front_addr":"172.21.15.46:6815/2409899830","state":["exists","up"]},{"osd":2,"uuid":"a5ae09b3-9419-4fc7-8cd5-4a2553bca213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":73,"up_from":77,"up_thru":113,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6819","nonce":3010717446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6821","nonce":3010717446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6825","nonce":3010717446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6823","nonce":3010717446}]},"public_addr":"172.21.15.46:6819/3010717446","cluster_addr":"172.21.15.46:6821/3010717446","heartbeat_back_addr":"172.21.15.46:6825/3010717446","heartbeat_front_addr":"172.21.15.46:6823/3010717446","state":["exists","up"]},{"osd":3,"uuid":"3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":95,"up_from":99,"up_thru":113,"down_at":96,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6801","nonce":3729925777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6803","nonce":3729925777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6807","nonce":3729925777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6805","nonce":3729925777}]},"public_addr":"172.21.15.142:6801/3729925777","cluster_addr":"172.21.15.142:6803/3729925777","heartbeat_back_addr":"172.21.15.142:6807/3729925777","heartbeat_front_addr":"172.21.15.142:6805/3729925777","state":["exists","up"]},{"osd":4,"uuid":"0a0ce92a-f9ac-4f83-877f-93eff87a9f8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":104,"up_from":108,"up_thru":113,"down_at":105,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6809","nonce":1150732284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6811","nonce":1150732284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6815","nonce":1150732284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6813","nonce":1150732284}]},"public_addr":"172.21.15.142:6809/1150732284","cluster_addr":"172.21.15.142:6811/1150732284","heartbeat_back_addr":"172.21.15.142:6815/1150732284","heartbeat_front_addr":"172.21.15.142:6813/1150732284","state":["exists","up"]},{"osd":5,"uuid":"0eed1f5c-a999-43d8-95ae-1671ac54640b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":109,"up_from":113,"up_thru":113,"down_at":110,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6817","nonce":1673341131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6819","nonce":1673341131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6823","nonce":1673341131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6821","nonce":1673341131}]},"public_addr":"172.21.15.142:6817/1673341131","cluster_addr":"172.21.15.142:6819/1673341131","heartbeat_back_addr":"172.21.15.142:6823/1673341131","heartbeat_front_addr":"172.21.15.142:6821/1673341131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:55:49.856210+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:17.120054+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:46.102265+0000","dead_epoch":73},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:10.285252+0000","dead_epoch":95},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:35.715008+0000","dead_epoch":104},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:01.554947+0000","dead_epoch":109}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1","mappings":[{"from":0,"to":5}]},{"pgid":"2.7","mappings":[{"from":3,"to":1}]},{"pgid":"2.13","mappings":[{"from":0,"to":1}]},{"pgid":"2.1a","mappings":[{"from":3,"to":1}]},{"pgid":"2.1f","mappings":[{"from":0,"to":1},{"from":3,"to":2}]},{"pgid":"3.4","mappings":[{"from":3,"to":0}]},{"pgid":"3.9","mappings":[{"from":4,"to":1}]},{"pgid":"3.11","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6825/445093561":"2024-02-20T19:10:34.708948+0000","172.21.15.46:6829/2235495765":"2024-02-20T19:10:34.708919+0000","172.21.15.46:6801/1269498854":"2024-02-20T19:05:27.636848+0000","172.21.15.46:0/2954390908":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/1307799669":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6828/2235495765":"2024-02-20T19:10:34.708919+0000","172.21.15.46:6800/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6800/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/4057722486":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6801/1654096494":"2024-02-20T19:01:39.789970+0000","172.21.15.142:0/2865604743":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/3901080352":"2024-02-20T18:54:32.109212+0000","172.21.15.142:6829/3077186414":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/2407750441":"2024-02-20T18:52:11.766897+0000","172.21.15.142:6824/445093561":"2024-02-20T19:10:34.708948+0000","172.21.15.142:0/2657910934":"2024-02-20T19:02:24.351804+0000","172.21.15.46:6801/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/4120601315":"2024-02-20T19:05:27.636848+0000","172.21.15.142:6828/3077186414":"2024-02-20T19:02:24.351804+0000","172.21.15.142:0/4181796919":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/1304412033":"2024-02-20T19:01:39.789970+0000","172.21.15.142:0/2842979640":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/3708201410":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/3268130132":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/2139900052":"2024-02-20T19:01:39.789970+0000","172.21.15.142:0/3200406684":"2024-02-20T19:02:24.351804+0000","172.21.15.46:6800/1269498854":"2024-02-20T19:05:27.636848+0000","172.21.15.46:6800/1654096494":"2024-02-20T19:01:39.789970+0000","172.21.15.46:0/2827852709":"2024-02-20T19:01:39.789970+0000","172.21.15.46:6827/908936119":"2024-02-20T18:59:34.073482+0000","172.21.15.46:0/2538440870":"2024-02-20T19:01:39.789970+0000","172.21.15.46:6826/908936119":"2024-02-20T18:59:34.073482+0000","172.21.15.46:0/664839364":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6801/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/3870899516":"2024-02-20T19:05:27.636848+0000","172.21.15.142:0/1985647318":"2024-02-20T19:02:24.351804+0000","172.21.15.46:6800/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6801/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/1953665533":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/1046986291":"2024-02-20T19:05:27.636848+0000","172.21.15.46:0/2413107873":"2024-02-20T19:05:27.636848+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T19:13:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 -- 172.21.15.46:0/3521171793 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb7ec06d8d0 msgr2=0x7fb7ec06fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb7ec06d8d0 0x7fb7ec06fd80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb800073d50 tx=0x7fb7e8008040 comp rx=0 tx=0).stop 2024-02-19T19:13:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 -- 172.21.15.46:0/3521171793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000ff690 msgr2=0x7fb800072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000ff690 0x7fb800072560 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009230 tx=0x7fb7f0004270 comp rx=0 tx=0).stop 2024-02-19T19:13:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 -- 172.21.15.46:0/3521171793 shutdown_connections 2024-02-19T19:13:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb7ec06d8d0 0x7fb7ec06fd80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8001056a0 0x7fb800072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 --2- 172.21.15.46:0/3521171793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8000ff690 0x7fb800072560 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:53.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 -- 172.21.15.46:0/3521171793 >> 172.21.15.46:0/3521171793 conn(0x7fb8000fb1d0 msgr2=0x7fb8000fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:53.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 -- 172.21.15.46:0/3521171793 shutdown_connections 2024-02-19T19:13:53.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.794+0000 7fb806469640 1 -- 172.21.15.46:0/3521171793 wait complete. 2024-02-19T19:13:53.828 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T18:56:48.450849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-19T18:59:17.631025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 1, 'raw_score_acting': 2.059999942779541, 'raw_score_stable': 2.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-19T18:59:18.491487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T19:13:53.829 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T19:13:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.911+0000 7f152266a640 1 -- 172.21.15.46:0/585032866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f151c1011a0 msgr2=0x7f151c109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.911+0000 7f152266a640 1 --2- 172.21.15.46:0/585032866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f151c1011a0 0x7f151c109690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1510009880 tx=0x7f151002bd70 comp rx=0 tx=0).stop 2024-02-19T19:13:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.911+0000 7f152266a640 1 -- 172.21.15.46:0/585032866 shutdown_connections 2024-02-19T19:13:53.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.911+0000 7f152266a640 1 --2- 172.21.15.46:0/585032866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f151c1011a0 0x7f151c109690 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:53.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.911+0000 7f152266a640 1 --2- 172.21.15.46:0/585032866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f151c100890 0x7f151c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:53.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.911+0000 7f152266a640 1 -- 172.21.15.46:0/585032866 >> 172.21.15.46:0/585032866 conn(0x7f151c0fa060 msgr2=0x7f151c0fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:53.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.911+0000 7f152266a640 1 -- 172.21.15.46:0/585032866 shutdown_connections 2024-02-19T19:13:53.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.911+0000 7f152266a640 1 -- 172.21.15.46:0/585032866 wait complete. 2024-02-19T19:13:53.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.911+0000 7f152266a640 1 Processor -- start 2024-02-19T19:13:53.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f152266a640 1 -- start start 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f152266a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f151c100890 0x7f151c195320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f152266a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f151c1011a0 0x7f151c195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f152266a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c195ef0 con 0x7f151c100890 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f152266a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c199cc0 con 0x7f151c1011a0 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f151bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f151c100890 0x7f151c195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f151bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f151c100890 0x7f151c195320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40280/0 (socket says 172.21.15.46:40280) 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f151bfff640 1 -- 172.21.15.46:0/924678745 learned_addr learned my addr 172.21.15.46:0/924678745 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f151bfff640 1 -- 172.21.15.46:0/924678745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f151c1011a0 msgr2=0x7f151c195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f151bfff640 1 --2- 172.21.15.46:0/924678745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f151c1011a0 0x7f151c195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f151bfff640 1 -- 172.21.15.46:0/924678745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510009560 con 0x7f151c100890 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.912+0000 7f151bfff640 1 --2- 172.21.15.46:0/924678745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f151c100890 0x7f151c195320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f150c00d6f0 tx=0x7f150c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:53.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.913+0000 7f15197fa640 1 -- 172.21.15.46:0/924678745 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150c009a30 con 0x7f151c100890 2024-02-19T19:13:53.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.913+0000 7f152266a640 1 -- 172.21.15.46:0/924678745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c199fa0 con 0x7f151c100890 2024-02-19T19:13:53.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.913+0000 7f15197fa640 1 -- 172.21.15.46:0/924678745 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f150c0054e0 con 0x7f151c100890 2024-02-19T19:13:53.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.913+0000 7f15197fa640 1 -- 172.21.15.46:0/924678745 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150c010460 con 0x7f151c100890 2024-02-19T19:13:53.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.913+0000 7f152266a640 1 -- 172.21.15.46:0/924678745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c19a500 con 0x7f151c100890 2024-02-19T19:13:53.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.914+0000 7f152266a640 1 -- 172.21.15.46:0/924678745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c04e000 con 0x7f151c100890 2024-02-19T19:13:53.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.914+0000 7f15197fa640 1 -- 172.21.15.46:0/924678745 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f150c009b90 con 0x7f151c100890 2024-02-19T19:13:53.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.914+0000 7f15197fa640 1 --2- 172.21.15.46:0/924678745 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f150406d810 0x7f150406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:53.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.915+0000 7f15197fa640 1 -- 172.21.15.46:0/924678745 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f150c08d1d0 con 0x7f151c100890 2024-02-19T19:13:53.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.915+0000 7f151b7fe640 1 --2- 172.21.15.46:0/924678745 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f150406d810 0x7f150406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:53.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.915+0000 7f151b7fe640 1 --2- 172.21.15.46:0/924678745 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f150406d810 0x7f150406fcc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1510036040 tx=0x7f1510000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:53.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:53.919+0000 7f15197fa640 1 -- 172.21.15.46:0/924678745 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f150c056870 con 0x7f151c100890 2024-02-19T19:13:53.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:53 smithi142 ceph-mon[69118]: pgmap v325: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:53.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:53 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/963183526' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:13:54.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.100+0000 7f152266a640 1 -- 172.21.15.46:0/924678745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f151c10c860 con 0x7f151c100890 2024-02-19T19:13:54.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.100+0000 7f15197fa640 1 -- 172.21.15.46:0/924678745 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7f150c059f30 con 0x7f151c100890 2024-02-19T19:13:54.123 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T19:13:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 -- 172.21.15.46:0/924678745 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f150406d810 msgr2=0x7f150406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 --2- 172.21.15.46:0/924678745 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f150406d810 0x7f150406fcc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1510036040 tx=0x7f1510000bc0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 -- 172.21.15.46:0/924678745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f151c100890 msgr2=0x7f151c195320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 --2- 172.21.15.46:0/924678745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f151c100890 0x7f151c195320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f150c00d6f0 tx=0x7f150c00dbb0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 -- 172.21.15.46:0/924678745 shutdown_connections 2024-02-19T19:13:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 --2- 172.21.15.46:0/924678745 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f150406d810 0x7f150406fcc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 --2- 172.21.15.46:0/924678745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f151c1011a0 0x7f151c195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 --2- 172.21.15.46:0/924678745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f151c100890 0x7f151c195320 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 -- 172.21.15.46:0/924678745 >> 172.21.15.46:0/924678745 conn(0x7f151c0fa060 msgr2=0x7f151c103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 -- 172.21.15.46:0/924678745 shutdown_connections 2024-02-19T19:13:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.102+0000 7f152266a640 1 -- 172.21.15.46:0/924678745 wait complete. 2024-02-19T19:13:54.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-19T19:13:54.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.218+0000 7f625b45f640 1 -- 172.21.15.46:0/2478523368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6254105680 msgr2=0x7f6254105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.218+0000 7f625b45f640 1 --2- 172.21.15.46:0/2478523368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6254105680 0x7f6254105a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f624c009880 tx=0x7f624c02bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.218+0000 7f625b45f640 1 -- 172.21.15.46:0/2478523368 shutdown_connections 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.218+0000 7f625b45f640 1 --2- 172.21.15.46:0/2478523368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62540ff670 0x7f62540ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.218+0000 7f625b45f640 1 --2- 172.21.15.46:0/2478523368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6254105680 0x7f6254105a50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.218+0000 7f625b45f640 1 -- 172.21.15.46:0/2478523368 >> 172.21.15.46:0/2478523368 conn(0x7f62540fb190 msgr2=0x7f62540fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.218+0000 7f625b45f640 1 -- 172.21.15.46:0/2478523368 shutdown_connections 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.218+0000 7f625b45f640 1 -- 172.21.15.46:0/2478523368 wait complete. 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.218+0000 7f625b45f640 1 Processor -- start 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.218+0000 7f625b45f640 1 -- start start 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f625b45f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62540ff670 0x7f62541952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f625b45f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6254105680 0x7f6254195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f625b45f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6254195eb0 con 0x7f62540ff670 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f625b45f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6254199c80 con 0x7f6254105680 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f62591fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62540ff670 0x7f62541952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f62591fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62540ff670 0x7f62541952e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40302/0 (socket says 172.21.15.46:40302) 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f62591fb640 1 -- 172.21.15.46:0/3723522678 learned_addr learned my addr 172.21.15.46:0/3723522678 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f62589fa640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6254105680 0x7f6254195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f62591fb640 1 -- 172.21.15.46:0/3723522678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6254105680 msgr2=0x7f6254195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f62591fb640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6254105680 0x7f6254195820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f62591fb640 1 -- 172.21.15.46:0/3723522678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c009560 con 0x7f62540ff670 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f62591fb640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62540ff670 0x7f62541952e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f624c009230 tx=0x7f624c02c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f624a7fc640 1 -- 172.21.15.46:0/3723522678 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f624c0035f0 con 0x7f62540ff670 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f625b45f640 1 -- 172.21.15.46:0/3723522678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6254199f00 con 0x7f62540ff670 2024-02-19T19:13:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f624a7fc640 1 -- 172.21.15.46:0/3723522678 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f624c003c10 con 0x7f62540ff670 2024-02-19T19:13:54.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f624a7fc640 1 -- 172.21.15.46:0/3723522678 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f624c005600 con 0x7f62540ff670 2024-02-19T19:13:54.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.219+0000 7f625b45f640 1 -- 172.21.15.46:0/3723522678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625419a480 con 0x7f62540ff670 2024-02-19T19:13:54.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.220+0000 7f625b45f640 1 -- 172.21.15.46:0/3723522678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625404e000 con 0x7f62540ff670 2024-02-19T19:13:54.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.221+0000 7f624a7fc640 1 -- 172.21.15.46:0/3723522678 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f624c004dd0 con 0x7f62540ff670 2024-02-19T19:13:54.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.221+0000 7f624a7fc640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f624006d810 0x7f624006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:54.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.221+0000 7f624a7fc640 1 -- 172.21.15.46:0/3723522678 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f624c0afa50 con 0x7f62540ff670 2024-02-19T19:13:54.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.221+0000 7f62589fa640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f624006d810 0x7f624006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:54.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.222+0000 7f62589fa640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f624006d810 0x7f624006fcc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f62541968f0 tx=0x7f6244005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.226+0000 7f624a7fc640 1 -- 172.21.15.46:0/3723522678 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f624c0790f0 con 0x7f62540ff670 2024-02-19T19:13:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.405+0000 7f625b45f640 1 -- 172.21.15.46:0/3723522678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f6254196630 con 0x7f62540ff670 2024-02-19T19:13:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.405+0000 7f624a7fc640 1 -- 172.21.15.46:0/3723522678 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v119) v1 ==== 107+0+11 (secure 0 0 0) 0x7f624c07c7b0 con 0x7f62540ff670 2024-02-19T19:13:54.428 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T19:13:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 -- 172.21.15.46:0/3723522678 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f624006d810 msgr2=0x7f624006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f624006d810 0x7f624006fcc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f62541968f0 tx=0x7f6244005f90 comp rx=0 tx=0).stop 2024-02-19T19:13:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 -- 172.21.15.46:0/3723522678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62540ff670 msgr2=0x7f62541952e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62540ff670 0x7f62541952e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f624c009230 tx=0x7f624c02c750 comp rx=0 tx=0).stop 2024-02-19T19:13:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 -- 172.21.15.46:0/3723522678 shutdown_connections 2024-02-19T19:13:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f624006d810 0x7f624006fcc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6254105680 0x7f6254195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 --2- 172.21.15.46:0/3723522678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62540ff670 0x7f62541952e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 -- 172.21.15.46:0/3723522678 >> 172.21.15.46:0/3723522678 conn(0x7f62540fb190 msgr2=0x7f62540fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:54.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 -- 172.21.15.46:0/3723522678 shutdown_connections 2024-02-19T19:13:54.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.407+0000 7f625b45f640 1 -- 172.21.15.46:0/3723522678 wait complete. 2024-02-19T19:13:54.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-19T19:13:54.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.525+0000 7f7556451640 1 -- 172.21.15.46:0/1313781240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75500fe760 msgr2=0x7f75500febd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.525+0000 7f7556451640 1 --2- 172.21.15.46:0/1313781240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75500fe760 0x7f75500febd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7544009880 tx=0x7f754402bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.525+0000 7f7556451640 1 -- 172.21.15.46:0/1313781240 shutdown_connections 2024-02-19T19:13:54.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.525+0000 7f7556451640 1 --2- 172.21.15.46:0/1313781240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75500fe760 0x7f75500febd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.525+0000 7f7556451640 1 --2- 172.21.15.46:0/1313781240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7550104770 0x7f7550104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.525+0000 7f7556451640 1 -- 172.21.15.46:0/1313781240 >> 172.21.15.46:0/1313781240 conn(0x7f75500fa260 msgr2=0x7f75500fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.525+0000 7f7556451640 1 -- 172.21.15.46:0/1313781240 shutdown_connections 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.525+0000 7f7556451640 1 -- 172.21.15.46:0/1313781240 wait complete. 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f7556451640 1 Processor -- start 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f7556451640 1 -- start start 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f7556451640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75500fe760 0x7f7550195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f7556451640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7550104770 0x7f7550195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f7556451640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75501962b0 con 0x7f75500fe760 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f7556451640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7550198f80 con 0x7f7550104770 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f754ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75500fe760 0x7f7550195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f754ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75500fe760 0x7f7550195690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40324/0 (socket says 172.21.15.46:40324) 2024-02-19T19:13:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f754ffff640 1 -- 172.21.15.46:0/2437174658 learned_addr learned my addr 172.21.15.46:0/2437174658 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f754ffff640 1 -- 172.21.15.46:0/2437174658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7550104770 msgr2=0x7f7550195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f754ffff640 1 --2- 172.21.15.46:0/2437174658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7550104770 0x7f7550195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.526+0000 7f754ffff640 1 -- 172.21.15.46:0/2437174658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544009560 con 0x7f75500fe760 2024-02-19T19:13:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.527+0000 7f754ffff640 1 --2- 172.21.15.46:0/2437174658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75500fe760 0x7f7550195690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f754000b3d0 tx=0x7f754000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.527+0000 7f754d7fa640 1 -- 172.21.15.46:0/2437174658 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7540011800 con 0x7f75500fe760 2024-02-19T19:13:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.527+0000 7f754d7fa640 1 -- 172.21.15.46:0/2437174658 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7540011e20 con 0x7f75500fe760 2024-02-19T19:13:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.527+0000 7f7556451640 1 -- 172.21.15.46:0/2437174658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7550199260 con 0x7f75500fe760 2024-02-19T19:13:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.527+0000 7f754d7fa640 1 -- 172.21.15.46:0/2437174658 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f754000f510 con 0x7f75500fe760 2024-02-19T19:13:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.527+0000 7f7556451640 1 -- 172.21.15.46:0/2437174658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75501997c0 con 0x7f75500fe760 2024-02-19T19:13:54.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.528+0000 7f7556451640 1 -- 172.21.15.46:0/2437174658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755004e000 con 0x7f75500fe760 2024-02-19T19:13:54.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.528+0000 7f754d7fa640 1 -- 172.21.15.46:0/2437174658 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7540010380 con 0x7f75500fe760 2024-02-19T19:13:54.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.529+0000 7f754d7fa640 1 --2- 172.21.15.46:0/2437174658 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f753806d810 0x7f753806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:54.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.529+0000 7f754d7fa640 1 -- 172.21.15.46:0/2437174658 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f754008d290 con 0x7f75500fe760 2024-02-19T19:13:54.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.529+0000 7f754f7fe640 1 --2- 172.21.15.46:0/2437174658 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f753806d810 0x7f753806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:54.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.529+0000 7f754f7fe640 1 --2- 172.21.15.46:0/2437174658 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f753806d810 0x7f753806fcc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7544036040 tx=0x7f7544000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:54.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.533+0000 7f754d7fa640 1 -- 172.21.15.46:0/2437174658 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f75400569b0 con 0x7f75500fe760 2024-02-19T19:13:54.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:54 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3521171793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:13:54.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:54 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/924678745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:13:54.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:54 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3723522678' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:13:54.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.716+0000 7f7556451640 1 -- 172.21.15.46:0/2437174658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f7550066860 con 0x7f75500fe760 2024-02-19T19:13:54.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.717+0000 7f754d7fa640 1 -- 172.21.15.46:0/2437174658 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v119) v1 ==== 107+0+11 (secure 0 0 0) 0x7f754005a070 con 0x7f75500fe760 2024-02-19T19:13:54.740 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T19:13:54.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 -- 172.21.15.46:0/2437174658 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f753806d810 msgr2=0x7f753806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 --2- 172.21.15.46:0/2437174658 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f753806d810 0x7f753806fcc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7544036040 tx=0x7f7544000bc0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 -- 172.21.15.46:0/2437174658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75500fe760 msgr2=0x7f7550195690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 --2- 172.21.15.46:0/2437174658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75500fe760 0x7f7550195690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f754000b3d0 tx=0x7f754000b890 comp rx=0 tx=0).stop 2024-02-19T19:13:54.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 -- 172.21.15.46:0/2437174658 shutdown_connections 2024-02-19T19:13:54.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 --2- 172.21.15.46:0/2437174658 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f753806d810 0x7f753806fcc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 --2- 172.21.15.46:0/2437174658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7550104770 0x7f7550195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 --2- 172.21.15.46:0/2437174658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75500fe760 0x7f7550195690 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 -- 172.21.15.46:0/2437174658 >> 172.21.15.46:0/2437174658 conn(0x7f75500fa260 msgr2=0x7f75500684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:54.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 -- 172.21.15.46:0/2437174658 shutdown_connections 2024-02-19T19:13:54.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.719+0000 7f7556451640 1 -- 172.21.15.46:0/2437174658 wait complete. 2024-02-19T19:13:54.752 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:54 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3521171793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:13:54.752 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:54 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/924678745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:13:54.752 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:54 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3723522678' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:13:54.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T19:13:54.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 -- 172.21.15.46:0/574627129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf41058b0 msgr2=0x7f6cf4105c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 --2- 172.21.15.46:0/574627129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf41058b0 0x7f6cf4105c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009880 tx=0x7f6cec02bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 -- 172.21.15.46:0/574627129 shutdown_connections 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 --2- 172.21.15.46:0/574627129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf40ff8a0 0x7f6cf40ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 --2- 172.21.15.46:0/574627129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf41058b0 0x7f6cf4105c80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 -- 172.21.15.46:0/574627129 >> 172.21.15.46:0/574627129 conn(0x7f6cf40fb3a0 msgr2=0x7f6cf40fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 -- 172.21.15.46:0/574627129 shutdown_connections 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 -- 172.21.15.46:0/574627129 wait complete. 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 Processor -- start 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 -- start start 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.833+0000 7f6cfc799640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf40ff8a0 0x7f6cf41954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfc799640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf41058b0 0x7f6cf4195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfc799640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf41960b0 con 0x7f6cf40ff8a0 2024-02-19T19:13:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfc799640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf4199e80 con 0x7f6cf41058b0 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfa535640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf40ff8a0 0x7f6cf41954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfa535640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf40ff8a0 0x7f6cf41954e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40342/0 (socket says 172.21.15.46:40342) 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfa535640 1 -- 172.21.15.46:0/1370939347 learned_addr learned my addr 172.21.15.46:0/1370939347 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfa535640 1 -- 172.21.15.46:0/1370939347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf41058b0 msgr2=0x7f6cf4195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cf9d34640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf41058b0 0x7f6cf4195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfa535640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf41058b0 0x7f6cf4195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfa535640 1 -- 172.21.15.46:0/1370939347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec009560 con 0x7f6cf40ff8a0 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cf9d34640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf41058b0 0x7f6cf4195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfa535640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf40ff8a0 0x7f6cf41954e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009230 tx=0x7f6cec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cf37fe640 1 -- 172.21.15.46:0/1370939347 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cec0037c0 con 0x7f6cf40ff8a0 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfc799640 1 -- 172.21.15.46:0/1370939347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf419a100 con 0x7f6cf40ff8a0 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cf37fe640 1 -- 172.21.15.46:0/1370939347 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cec003de0 con 0x7f6cf40ff8a0 2024-02-19T19:13:54.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cf37fe640 1 -- 172.21.15.46:0/1370939347 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cec034440 con 0x7f6cf40ff8a0 2024-02-19T19:13:54.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.834+0000 7f6cfc799640 1 -- 172.21.15.46:0/1370939347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf419a680 con 0x7f6cf40ff8a0 2024-02-19T19:13:54.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.835+0000 7f6cfc799640 1 -- 172.21.15.46:0/1370939347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf404e000 con 0x7f6cf40ff8a0 2024-02-19T19:13:54.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.836+0000 7f6cf37fe640 1 -- 172.21.15.46:0/1370939347 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6cec004fb0 con 0x7f6cf40ff8a0 2024-02-19T19:13:54.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.836+0000 7f6cf37fe640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6cdc06d8d0 0x7f6cdc06fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:54.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.836+0000 7f6cf37fe640 1 -- 172.21.15.46:0/1370939347 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f6cec0afb80 con 0x7f6cf40ff8a0 2024-02-19T19:13:54.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.836+0000 7f6cf9d34640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6cdc06d8d0 0x7f6cdc06fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:54.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.837+0000 7f6cf9d34640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6cdc06d8d0 0x7f6cdc06fd80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8006fd0 tx=0x7f6ce8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:54.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:54.841+0000 7f6cf37fe640 1 -- 172.21.15.46:0/1370939347 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6cec079220 con 0x7f6cf40ff8a0 2024-02-19T19:13:55.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.058+0000 7f6cfc799640 1 -- 172.21.15.46:0/1370939347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cf410caf0 con 0x7f6cf40ff8a0 2024-02-19T19:13:55.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.059+0000 7f6cf37fe640 1 -- 172.21.15.46:0/1370939347 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+5017 (secure 0 0 0) 0x7f6cec07c8e0 con 0x7f6cf40ff8a0 2024-02-19T19:13:55.082 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:55.082 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44359,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2993903126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2993903126},{"type":"v1","addr":"172.21.15.142:6827","nonce":2993903126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:12:11.018282+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34412,"mds_1":34444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":0,"incarnation":31,"state":"up:active","state_seq":22,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":1,"incarnation":31,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:55.082 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 37 2024-02-19T19:13:55.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 -- 172.21.15.46:0/1370939347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6cdc06d8d0 msgr2=0x7f6cdc06fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6cdc06d8d0 0x7f6cdc06fd80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8006fd0 tx=0x7f6ce8008040 comp rx=0 tx=0).stop 2024-02-19T19:13:55.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 -- 172.21.15.46:0/1370939347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf40ff8a0 msgr2=0x7f6cf41954e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf40ff8a0 0x7f6cf41954e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009230 tx=0x7f6cec004270 comp rx=0 tx=0).stop 2024-02-19T19:13:55.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 -- 172.21.15.46:0/1370939347 shutdown_connections 2024-02-19T19:13:55.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f6cdc06d8d0 0x7f6cdc06fd80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf41058b0 0x7f6cf4195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 --2- 172.21.15.46:0/1370939347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf40ff8a0 0x7f6cf41954e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 -- 172.21.15.46:0/1370939347 >> 172.21.15.46:0/1370939347 conn(0x7f6cf40fb3a0 msgr2=0x7f6cf40fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:55.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 -- 172.21.15.46:0/1370939347 shutdown_connections 2024-02-19T19:13:55.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.061+0000 7f6cfc799640 1 -- 172.21.15.46:0/1370939347 wait complete. 2024-02-19T19:13:55.095 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 17, 'max_mds': 2, 'flags': 18} 2024-02-19T19:13:55.095 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-02-19T19:13:55.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.176+0000 7f7ade041640 1 -- 172.21.15.46:0/1722195224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad80fe7f0 msgr2=0x7f7ad80fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.176+0000 7f7ade041640 1 --2- 172.21.15.46:0/1722195224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad80fe7f0 0x7f7ad80fec60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009880 tx=0x7f7acc02bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.176+0000 7f7ade041640 1 -- 172.21.15.46:0/1722195224 shutdown_connections 2024-02-19T19:13:55.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.176+0000 7f7ade041640 1 --2- 172.21.15.46:0/1722195224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad80fe7f0 0x7f7ad80fec60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.176+0000 7f7ade041640 1 --2- 172.21.15.46:0/1722195224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad8104800 0x7f7ad8104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.176+0000 7f7ade041640 1 -- 172.21.15.46:0/1722195224 >> 172.21.15.46:0/1722195224 conn(0x7f7ad80fa2f0 msgr2=0x7f7ad80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.176+0000 7f7ade041640 1 -- 172.21.15.46:0/1722195224 shutdown_connections 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.176+0000 7f7ade041640 1 -- 172.21.15.46:0/1722195224 wait complete. 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ade041640 1 Processor -- start 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ade041640 1 -- start start 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ade041640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad80fe7f0 0x7f7ad81963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ade041640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad8104800 0x7f7ad81968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ade041640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8196eb0 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ade041640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8197020 con 0x7f7ad8104800 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ad77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad80fe7f0 0x7f7ad81963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ad77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad80fe7f0 0x7f7ad81963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40362/0 (socket says 172.21.15.46:40362) 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ad77fe640 1 -- 172.21.15.46:0/1244757733 learned_addr learned my addr 172.21.15.46:0/1244757733 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ad6ffd640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad8104800 0x7f7ad81968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:55.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ad77fe640 1 -- 172.21.15.46:0/1244757733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad8104800 msgr2=0x7f7ad81968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ad77fe640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad8104800 0x7f7ad81968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ad77fe640 1 -- 172.21.15.46:0/1244757733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc009560 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.177+0000 7f7ad6ffd640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad8104800 0x7f7ad81968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:13:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.178+0000 7f7ad77fe640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad80fe7f0 0x7f7ad81963a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c8f0 tx=0x7f7ac800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.178+0000 7f7ad4ff9640 1 -- 172.21.15.46:0/1244757733 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ac80041f0 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.178+0000 7f7ad4ff9640 1 -- 172.21.15.46:0/1244757733 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ac8007e70 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.178+0000 7f7ade041640 1 -- 172.21.15.46:0/1244757733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad819f410 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.178+0000 7f7ad4ff9640 1 -- 172.21.15.46:0/1244757733 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ac80049d0 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.178+0000 7f7ade041640 1 -- 172.21.15.46:0/1244757733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad819f940 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.179+0000 7f7ade041640 1 -- 172.21.15.46:0/1244757733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad804e000 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.179+0000 7f7ad4ff9640 1 -- 172.21.15.46:0/1244757733 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7ac8004350 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.180+0000 7f7ad4ff9640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ac006d810 0x7f7ac006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:55.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.180+0000 7f7ad6ffd640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ac006d810 0x7f7ac006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:55.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.180+0000 7f7ad4ff9640 1 -- 172.21.15.46:0/1244757733 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f7ac808d530 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.180+0000 7f7ad6ffd640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ac006d810 0x7f7ac006fcc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8068c10 tx=0x7f7acc02cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:55.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.184+0000 7f7ad4ff9640 1 -- 172.21.15.46:0/1244757733 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ac8056b30 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.404+0000 7f7ade041640 1 -- 172.21.15.46:0/1244757733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f7ad8066860 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.405+0000 7f7ad4ff9640 1 -- 172.21.15.46:0/1244757733 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v37) v1 ==== 107+0+4844 (secure 0 0 0) 0x7f7ac805a1f0 con 0x7f7ad80fe7f0 2024-02-19T19:13:55.428 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:55.428 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14506,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3116160429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3116160429},{"type":"v1","addr":"172.21.15.46:6827","nonce":3116160429}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:07:04.634090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14494,"mds_1":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14494":{"gid":14494,"name":"cephfs.smithi046.bwvkwa","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6829/2235495765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2235495765},{"type":"v1","addr":"172.21.15.46:6829","nonce":2235495765}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24265":{"gid":24265,"name":"cephfs.smithi142.maazlq","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6825/445093561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":445093561},{"type":"v1","addr":"172.21.15.142:6825","nonce":445093561}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:55.428 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-02-19T19:13:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 -- 172.21.15.46:0/1244757733 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ac006d810 msgr2=0x7f7ac006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ac006d810 0x7f7ac006fcc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8068c10 tx=0x7f7acc02cf90 comp rx=0 tx=0).stop 2024-02-19T19:13:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 -- 172.21.15.46:0/1244757733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad80fe7f0 msgr2=0x7f7ad81963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad80fe7f0 0x7f7ad81963a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c8f0 tx=0x7f7ac800cdb0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 -- 172.21.15.46:0/1244757733 shutdown_connections 2024-02-19T19:13:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f7ac006d810 0x7f7ac006fcc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad8104800 0x7f7ad81968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 --2- 172.21.15.46:0/1244757733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad80fe7f0 0x7f7ad81963a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 -- 172.21.15.46:0/1244757733 >> 172.21.15.46:0/1244757733 conn(0x7f7ad80fa2f0 msgr2=0x7f7ad80fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:55.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 -- 172.21.15.46:0/1244757733 shutdown_connections 2024-02-19T19:13:55.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.407+0000 7f7ade041640 1 -- 172.21.15.46:0/1244757733 wait complete. 2024-02-19T19:13:55.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-19T19:13:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.521+0000 7fadee4c0640 1 -- 172.21.15.46:0/2426104775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fade8105690 msgr2=0x7fade8105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.521+0000 7fadee4c0640 1 --2- 172.21.15.46:0/2426104775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fade8105690 0x7fade8105a60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faddc009880 tx=0x7faddc02bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.521+0000 7fadee4c0640 1 -- 172.21.15.46:0/2426104775 shutdown_connections 2024-02-19T19:13:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.521+0000 7fadee4c0640 1 --2- 172.21.15.46:0/2426104775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade8067350 0x7fade80677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.521+0000 7fadee4c0640 1 --2- 172.21.15.46:0/2426104775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fade8105690 0x7fade8105a60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.521+0000 7fadee4c0640 1 -- 172.21.15.46:0/2426104775 >> 172.21.15.46:0/2426104775 conn(0x7fade80743d0 msgr2=0x7fade80747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.521+0000 7fadee4c0640 1 -- 172.21.15.46:0/2426104775 shutdown_connections 2024-02-19T19:13:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.521+0000 7fadee4c0640 1 -- 172.21.15.46:0/2426104775 wait complete. 2024-02-19T19:13:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.522+0000 7fadee4c0640 1 Processor -- start 2024-02-19T19:13:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.522+0000 7fadee4c0640 1 -- start start 2024-02-19T19:13:55.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.522+0000 7fadee4c0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fade8067350 0x7fade81953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:55.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.522+0000 7fadee4c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade8105690 0x7fade8195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:55.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.522+0000 7fadee4c0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade8195fa0 con 0x7fade8067350 2024-02-19T19:13:55.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.522+0000 7fadee4c0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade8199d70 con 0x7fade8105690 2024-02-19T19:13:55.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.522+0000 7fade7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fade8067350 0x7fade81953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fade7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fade8067350 0x7fade81953d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40372/0 (socket says 172.21.15.46:40372) 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fade7fff640 1 -- 172.21.15.46:0/3991535946 learned_addr learned my addr 172.21.15.46:0/3991535946 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fade77fe640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade8105690 0x7fade8195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fade7fff640 1 -- 172.21.15.46:0/3991535946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade8105690 msgr2=0x7fade8195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fade7fff640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade8105690 0x7fade8195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fade7fff640 1 -- 172.21.15.46:0/3991535946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc009560 con 0x7fade8067350 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fade7fff640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fade8067350 0x7fade81953d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faddc009230 tx=0x7faddc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fade57fa640 1 -- 172.21.15.46:0/3991535946 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faddc0035f0 con 0x7fade8067350 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fade57fa640 1 -- 172.21.15.46:0/3991535946 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faddc003c10 con 0x7fade8067350 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fadee4c0640 1 -- 172.21.15.46:0/3991535946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade8199ff0 con 0x7fade8067350 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fade57fa640 1 -- 172.21.15.46:0/3991535946 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faddc034440 con 0x7fade8067350 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.523+0000 7fadee4c0640 1 -- 172.21.15.46:0/3991535946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade819a570 con 0x7fade8067350 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.524+0000 7fadee4c0640 1 -- 172.21.15.46:0/3991535946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade804e000 con 0x7fade8067350 2024-02-19T19:13:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.525+0000 7fade57fa640 1 -- 172.21.15.46:0/3991535946 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7faddc004fd0 con 0x7fade8067350 2024-02-19T19:13:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.525+0000 7fade57fa640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fadd006d810 0x7fadd006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.525+0000 7fade57fa640 1 -- 172.21.15.46:0/3991535946 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7faddc0afad0 con 0x7fade8067350 2024-02-19T19:13:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.525+0000 7fade77fe640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fadd006d810 0x7fadd006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.526+0000 7fade77fe640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fadd006d810 0x7fadd006fcc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fade81969e0 tx=0x7fadd8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:55.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.530+0000 7fade57fa640 1 -- 172.21.15.46:0/3991535946 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faddc079170 con 0x7fade8067350 2024-02-19T19:13:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.746+0000 7fadee4c0640 1 -- 172.21.15.46:0/3991535946 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fade8107aa0 con 0x7fade8067350 2024-02-19T19:13:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.747+0000 7fade57fa640 1 -- 172.21.15.46:0/3991535946 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v37) v1 ==== 107+0+4845 (secure 0 0 0) 0x7faddc07c830 con 0x7fade8067350 2024-02-19T19:13:55.770 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:55.770 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14506,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3116160429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3116160429},{"type":"v1","addr":"172.21.15.46:6827","nonce":3116160429}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:08:21.613462+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14494,"mds_1":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14494":{"gid":14494,"name":"cephfs.smithi046.bwvkwa","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6829/2235495765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2235495765},{"type":"v1","addr":"172.21.15.46:6829","nonce":2235495765}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24265":{"gid":24265,"name":"cephfs.smithi142.maazlq","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6825/445093561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":445093561},{"type":"v1","addr":"172.21.15.142:6825","nonce":445093561}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 19 2024-02-19T19:13:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 -- 172.21.15.46:0/3991535946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fadd006d810 msgr2=0x7fadd006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fadd006d810 0x7fadd006fcc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fade81969e0 tx=0x7fadd8008040 comp rx=0 tx=0).stop 2024-02-19T19:13:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 -- 172.21.15.46:0/3991535946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fade8067350 msgr2=0x7fade81953d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fade8067350 0x7fade81953d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faddc009230 tx=0x7faddc004040 comp rx=0 tx=0).stop 2024-02-19T19:13:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 -- 172.21.15.46:0/3991535946 shutdown_connections 2024-02-19T19:13:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fadd006d810 0x7fadd006fcc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fade8105690 0x7fade8195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 --2- 172.21.15.46:0/3991535946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fade8067350 0x7fade81953d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 -- 172.21.15.46:0/3991535946 >> 172.21.15.46:0/3991535946 conn(0x7fade80743d0 msgr2=0x7fade80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 -- 172.21.15.46:0/3991535946 shutdown_connections 2024-02-19T19:13:55.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.749+0000 7fadee4c0640 1 -- 172.21.15.46:0/3991535946 wait complete. 2024-02-19T19:13:55.781 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:55 smithi046 ceph-mon[88928]: pgmap v326: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:55.781 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:55 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2437174658' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:13:55.782 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:55 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1370939347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T19:13:55.782 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:55 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1244757733' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-19T19:13:55.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-19T19:13:55.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.863+0000 7f90df127640 1 -- 172.21.15.46:0/1573054963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d80ff870 msgr2=0x7f90d80ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.863+0000 7f90df127640 1 --2- 172.21.15.46:0/1573054963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d80ff870 0x7f90d80ffce0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f90c0009880 tx=0x7f90c002bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.863+0000 7f90df127640 1 -- 172.21.15.46:0/1573054963 shutdown_connections 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.863+0000 7f90df127640 1 --2- 172.21.15.46:0/1573054963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d80ff870 0x7f90d80ffce0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.863+0000 7f90df127640 1 --2- 172.21.15.46:0/1573054963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d8105880 0x7f90d8105c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.863+0000 7f90df127640 1 -- 172.21.15.46:0/1573054963 >> 172.21.15.46:0/1573054963 conn(0x7f90d80fb370 msgr2=0x7f90d80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.863+0000 7f90df127640 1 -- 172.21.15.46:0/1573054963 shutdown_connections 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.863+0000 7f90df127640 1 -- 172.21.15.46:0/1573054963 wait complete. 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90df127640 1 Processor -- start 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90df127640 1 -- start start 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90df127640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d80ff870 0x7f90d8072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:55.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90df127640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d8105880 0x7f90d8072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90df127640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8072fe0 con 0x7f90d80ff870 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90df127640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8073150 con 0x7f90d8105880 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90dcec3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d80ff870 0x7f90d8072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90dcec3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d80ff870 0x7f90d8072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40392/0 (socket says 172.21.15.46:40392) 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90dcec3640 1 -- 172.21.15.46:0/1748118789 learned_addr learned my addr 172.21.15.46:0/1748118789 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90d7fff640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d8105880 0x7f90d8072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90dcec3640 1 -- 172.21.15.46:0/1748118789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d8105880 msgr2=0x7f90d8072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90dcec3640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d8105880 0x7f90d8072aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90dcec3640 1 -- 172.21.15.46:0/1748118789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0009560 con 0x7f90d80ff870 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.864+0000 7f90dcec3640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d80ff870 0x7f90d8072560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f90d000d8d0 tx=0x7f90d000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.865+0000 7f90d5ffb640 1 -- 172.21.15.46:0/1748118789 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d0009a30 con 0x7f90d80ff870 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.865+0000 7f90d5ffb640 1 -- 172.21.15.46:0/1748118789 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90d0009b90 con 0x7f90d80ff870 2024-02-19T19:13:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.865+0000 7f90df127640 1 -- 172.21.15.46:0/1748118789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d80733d0 con 0x7f90d80ff870 2024-02-19T19:13:55.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.865+0000 7f90d5ffb640 1 -- 172.21.15.46:0/1748118789 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d000f680 con 0x7f90d80ff870 2024-02-19T19:13:55.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.865+0000 7f90df127640 1 -- 172.21.15.46:0/1748118789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d81a1b10 con 0x7f90d80ff870 2024-02-19T19:13:55.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.866+0000 7f90df127640 1 -- 172.21.15.46:0/1748118789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d804e000 con 0x7f90d80ff870 2024-02-19T19:13:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.866+0000 7f90d5ffb640 1 -- 172.21.15.46:0/1748118789 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f90d0009d00 con 0x7f90d80ff870 2024-02-19T19:13:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.867+0000 7f90d5ffb640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f90c406d810 0x7f90c406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.867+0000 7f90d7fff640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f90c406d810 0x7f90c406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.867+0000 7f90d5ffb640 1 -- 172.21.15.46:0/1748118789 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f90d008d2f0 con 0x7f90d80ff870 2024-02-19T19:13:55.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.867+0000 7f90d7fff640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f90c406d810 0x7f90c406fcc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f90d8073d50 tx=0x7f90c0000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:55.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:55.871+0000 7f90d5ffb640 1 -- 172.21.15.46:0/1748118789 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f90d0056990 con 0x7f90d80ff870 2024-02-19T19:13:55.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:55 smithi142 ceph-mon[69118]: pgmap v326: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:55.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:55 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2437174658' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:13:55.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:55 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1370939347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T19:13:55.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:55 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1244757733' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-19T19:13:56.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.090+0000 7f90df127640 1 -- 172.21.15.46:0/1748118789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f90d8066860 con 0x7f90d80ff870 2024-02-19T19:13:56.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.091+0000 7f90d5ffb640 1 -- 172.21.15.46:0/1748118789 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v37) v1 ==== 107+0+3265 (secure 0 0 0) 0x7f90d0017ce0 con 0x7f90d80ff870 2024-02-19T19:13:56.114 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:56.114 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14506,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3116160429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3116160429},{"type":"v1","addr":"172.21.15.46:6827","nonce":3116160429}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:10:34.708956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:56.114 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-02-19T19:13:56.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.092+0000 7f90df127640 1 -- 172.21.15.46:0/1748118789 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f90c406d810 msgr2=0x7f90c406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.092+0000 7f90df127640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f90c406d810 0x7f90c406fcc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f90d8073d50 tx=0x7f90c0000bc0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.093+0000 7f90df127640 1 -- 172.21.15.46:0/1748118789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d80ff870 msgr2=0x7f90d8072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.093+0000 7f90df127640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d80ff870 0x7f90d8072560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f90d000d8d0 tx=0x7f90d000dd90 comp rx=0 tx=0).stop 2024-02-19T19:13:56.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.093+0000 7f90df127640 1 -- 172.21.15.46:0/1748118789 shutdown_connections 2024-02-19T19:13:56.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.093+0000 7f90df127640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f90c406d810 0x7f90c406fcc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.093+0000 7f90df127640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d8105880 0x7f90d8072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.093+0000 7f90df127640 1 --2- 172.21.15.46:0/1748118789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f90d80ff870 0x7f90d8072560 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.093+0000 7f90df127640 1 -- 172.21.15.46:0/1748118789 >> 172.21.15.46:0/1748118789 conn(0x7f90d80fb370 msgr2=0x7f90d80fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:56.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.093+0000 7f90df127640 1 -- 172.21.15.46:0/1748118789 shutdown_connections 2024-02-19T19:13:56.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.093+0000 7f90df127640 1 -- 172.21.15.46:0/1748118789 wait complete. 2024-02-19T19:13:56.127 DEBUG:tasks.fs:max_mds not reduced in epoch 20 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-19T19:13:56.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-19T19:13:56.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.206+0000 7fa25f22f640 1 -- 172.21.15.46:0/1241461611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2581045b0 msgr2=0x7fa258104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.206+0000 7fa25f22f640 1 --2- 172.21.15.46:0/1241461611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2581045b0 0x7fa258104980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009880 tx=0x7fa24c02bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.206+0000 7fa25f22f640 1 -- 172.21.15.46:0/1241461611 shutdown_connections 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.206+0000 7fa25f22f640 1 --2- 172.21.15.46:0/1241461611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2580fe580 0x7fa2580fe9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.206+0000 7fa25f22f640 1 --2- 172.21.15.46:0/1241461611 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2581045b0 0x7fa258104980 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.206+0000 7fa25f22f640 1 -- 172.21.15.46:0/1241461611 >> 172.21.15.46:0/1241461611 conn(0x7fa2580fa060 msgr2=0x7fa2580fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.206+0000 7fa25f22f640 1 -- 172.21.15.46:0/1241461611 shutdown_connections 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.206+0000 7fa25f22f640 1 -- 172.21.15.46:0/1241461611 wait complete. 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.206+0000 7fa25f22f640 1 Processor -- start 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.206+0000 7fa25f22f640 1 -- start start 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa25f22f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2580fe580 0x7fa258195260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa25f22f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2581045b0 0x7fa2581957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa25f22f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa258195da0 con 0x7fa2581045b0 2024-02-19T19:13:56.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa25f22f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa258195f10 con 0x7fa2580fe580 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa257fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2581045b0 0x7fa2581957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa257fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2581045b0 0x7fa2581957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40406/0 (socket says 172.21.15.46:40406) 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa257fff640 1 -- 172.21.15.46:0/2278929761 learned_addr learned my addr 172.21.15.46:0/2278929761 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa25cfcb640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2580fe580 0x7fa258195260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa257fff640 1 -- 172.21.15.46:0/2278929761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2580fe580 msgr2=0x7fa258195260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa257fff640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2580fe580 0x7fa258195260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa257fff640 1 -- 172.21.15.46:0/2278929761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c009560 con 0x7fa2581045b0 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa25cfcb640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2580fe580 0x7fa258195260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa257fff640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2581045b0 0x7fa2581957a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa24400c8a0 tx=0x7fa24400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa255ffb640 1 -- 172.21.15.46:0/2278929761 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa244007b80 con 0x7fa2581045b0 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa255ffb640 1 -- 172.21.15.46:0/2278929761 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa244007ce0 con 0x7fa2581045b0 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa25f22f640 1 -- 172.21.15.46:0/2278929761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa258199da0 con 0x7fa2581045b0 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa255ffb640 1 -- 172.21.15.46:0/2278929761 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa244018810 con 0x7fa2581045b0 2024-02-19T19:13:56.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.207+0000 7fa25f22f640 1 -- 172.21.15.46:0/2278929761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25819a380 con 0x7fa2581045b0 2024-02-19T19:13:56.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.208+0000 7fa25f22f640 1 -- 172.21.15.46:0/2278929761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25804e000 con 0x7fa2581045b0 2024-02-19T19:13:56.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.209+0000 7fa255ffb640 1 -- 172.21.15.46:0/2278929761 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa244018970 con 0x7fa2581045b0 2024-02-19T19:13:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.209+0000 7fa255ffb640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d810 0x7fa24806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.209+0000 7fa255ffb640 1 -- 172.21.15.46:0/2278929761 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fa24408d770 con 0x7fa2581045b0 2024-02-19T19:13:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.209+0000 7fa25cfcb640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d810 0x7fa24806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.210+0000 7fa25cfcb640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d810 0x7fa24806fcc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa24c000c00 tx=0x7fa24c02cc20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.214+0000 7fa255ffb640 1 -- 172.21.15.46:0/2278929761 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa244056e90 con 0x7fa2581045b0 2024-02-19T19:13:56.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.431+0000 7fa25f22f640 1 -- 172.21.15.46:0/2278929761 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fa25810b990 con 0x7fa2581045b0 2024-02-19T19:13:56.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.432+0000 7fa255ffb640 1 -- 172.21.15.46:0/2278929761 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v37) v1 ==== 107+0+4823 (secure 0 0 0) 0x7fa24405a550 con 0x7fa2581045b0 2024-02-19T19:13:56.456 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:56.456 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14506,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3116160429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3116160429},{"type":"v1","addr":"172.21.15.46:6827","nonce":3116160429}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi046.bwvkwa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/214941826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":214941826},{"type":"v1","addr":"172.21.15.46:6829","nonce":214941826}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44299,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/3279846196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3279846196},{"type":"v1","addr":"172.21.15.142:6825","nonce":3279846196}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:10:34.708956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:56.456 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 21 2024-02-19T19:13:56.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 -- 172.21.15.46:0/2278929761 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d810 msgr2=0x7fa24806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d810 0x7fa24806fcc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa24c000c00 tx=0x7fa24c02cc20 comp rx=0 tx=0).stop 2024-02-19T19:13:56.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 -- 172.21.15.46:0/2278929761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2581045b0 msgr2=0x7fa2581957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2581045b0 0x7fa2581957a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa24400c8a0 tx=0x7fa24400cd60 comp rx=0 tx=0).stop 2024-02-19T19:13:56.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 -- 172.21.15.46:0/2278929761 shutdown_connections 2024-02-19T19:13:56.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fa24806d810 0x7fa24806fcc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa2581045b0 0x7fa2581957a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 --2- 172.21.15.46:0/2278929761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2580fe580 0x7fa258195260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 -- 172.21.15.46:0/2278929761 >> 172.21.15.46:0/2278929761 conn(0x7fa2580fa060 msgr2=0x7fa258068360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:56.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 -- 172.21.15.46:0/2278929761 shutdown_connections 2024-02-19T19:13:56.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.434+0000 7fa25f22f640 1 -- 172.21.15.46:0/2278929761 wait complete. 2024-02-19T19:13:56.469 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-19T19:13:56.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-19T19:13:56.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.549+0000 7fd9c3fff640 1 -- 172.21.15.46:0/2484425162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9c4100690 msgr2=0x7fd9c4100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.549+0000 7fd9c3fff640 1 --2- 172.21.15.46:0/2484425162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9c4100690 0x7fd9c4100a60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009880 tx=0x7fd9b402bd70 comp rx=0 tx=0).stop 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.549+0000 7fd9c3fff640 1 -- 172.21.15.46:0/2484425162 shutdown_connections 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.549+0000 7fd9c3fff640 1 --2- 172.21.15.46:0/2484425162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c4100fa0 0x7fd9c4109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.549+0000 7fd9c3fff640 1 --2- 172.21.15.46:0/2484425162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9c4100690 0x7fd9c4100a60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.549+0000 7fd9c3fff640 1 -- 172.21.15.46:0/2484425162 >> 172.21.15.46:0/2484425162 conn(0x7fd9c40f9e20 msgr2=0x7fd9c40fc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.549+0000 7fd9c3fff640 1 -- 172.21.15.46:0/2484425162 shutdown_connections 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.549+0000 7fd9c3fff640 1 -- 172.21.15.46:0/2484425162 wait complete. 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.549+0000 7fd9c3fff640 1 Processor -- start 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c3fff640 1 -- start start 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9c4100690 0x7fd9c41952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c4100fa0 0x7fd9c4195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c3fff640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c4195e90 con 0x7fd9c4100690 2024-02-19T19:13:56.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c3fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c4199c60 con 0x7fd9c4100fa0 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9c4100690 0x7fd9c41952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9c4100690 0x7fd9c41952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40418/0 (socket says 172.21.15.46:40418) 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c2ffd640 1 -- 172.21.15.46:0/3679112723 learned_addr learned my addr 172.21.15.46:0/3679112723 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9bbfff640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c4100fa0 0x7fd9c4195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c2ffd640 1 -- 172.21.15.46:0/3679112723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c4100fa0 msgr2=0x7fd9c4195800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c2ffd640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c4100fa0 0x7fd9c4195800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c2ffd640 1 -- 172.21.15.46:0/3679112723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b4009560 con 0x7fd9c4100690 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c2ffd640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9c4100690 0x7fd9c41952c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009230 tx=0x7fd9b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c0ff9640 1 -- 172.21.15.46:0/3679112723 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b40037c0 con 0x7fd9c4100690 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c0ff9640 1 -- 172.21.15.46:0/3679112723 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9b4004aa0 con 0x7fd9c4100690 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c3fff640 1 -- 172.21.15.46:0/3679112723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c4199ee0 con 0x7fd9c4100690 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.550+0000 7fd9c0ff9640 1 -- 172.21.15.46:0/3679112723 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b403e450 con 0x7fd9c4100690 2024-02-19T19:13:56.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.551+0000 7fd9c3fff640 1 -- 172.21.15.46:0/3679112723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c419a440 con 0x7fd9c4100690 2024-02-19T19:13:56.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.551+0000 7fd9c3fff640 1 -- 172.21.15.46:0/3679112723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c404e000 con 0x7fd9c4100690 2024-02-19T19:13:56.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.552+0000 7fd9c0ff9640 1 -- 172.21.15.46:0/3679112723 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd9b4005060 con 0x7fd9c4100690 2024-02-19T19:13:56.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.552+0000 7fd9c0ff9640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd9b006d810 0x7fd9b006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:56.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.552+0000 7fd9c0ff9640 1 -- 172.21.15.46:0/3679112723 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fd9b40b02a0 con 0x7fd9c4100690 2024-02-19T19:13:56.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.552+0000 7fd9bbfff640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd9b006d810 0x7fd9b006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:56.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.553+0000 7fd9bbfff640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd9b006d810 0x7fd9b006fcc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd9c41968d0 tx=0x7fd9ac008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:56.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.557+0000 7fd9c0ff9640 1 -- 172.21.15.46:0/3679112723 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd9b40799c0 con 0x7fd9c4100690 2024-02-19T19:13:56.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.776+0000 7fd9c3fff640 1 -- 172.21.15.46:0/3679112723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fd9c4106aa0 con 0x7fd9c4100690 2024-02-19T19:13:56.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.777+0000 7fd9c0ff9640 1 -- 172.21.15.46:0/3679112723 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v37) v1 ==== 107+0+4044 (secure 0 0 0) 0x7fd9b407d080 con 0x7fd9c4100690 2024-02-19T19:13:56.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:56.801 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi046.bwvkwa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/214941826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":214941826},{"type":"v1","addr":"172.21.15.46:6829","nonce":214941826}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44299,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/3279846196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3279846196},{"type":"v1","addr":"172.21.15.142:6825","nonce":3279846196}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:10:34.708956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:56.801 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 22 2024-02-19T19:13:56.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 -- 172.21.15.46:0/3679112723 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd9b006d810 msgr2=0x7fd9b006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd9b006d810 0x7fd9b006fcc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd9c41968d0 tx=0x7fd9ac008040 comp rx=0 tx=0).stop 2024-02-19T19:13:56.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 -- 172.21.15.46:0/3679112723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9c4100690 msgr2=0x7fd9c41952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9c4100690 0x7fd9c41952c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009230 tx=0x7fd9b4004270 comp rx=0 tx=0).stop 2024-02-19T19:13:56.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 -- 172.21.15.46:0/3679112723 shutdown_connections 2024-02-19T19:13:56.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd9b006d810 0x7fd9b006fcc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9c4100fa0 0x7fd9c4195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 --2- 172.21.15.46:0/3679112723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9c4100690 0x7fd9c41952c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 -- 172.21.15.46:0/3679112723 >> 172.21.15.46:0/3679112723 conn(0x7fd9c40f9e20 msgr2=0x7fd9c4103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:56.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 -- 172.21.15.46:0/3679112723 shutdown_connections 2024-02-19T19:13:56.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.779+0000 7fd9c3fff640 1 -- 172.21.15.46:0/3679112723 wait complete. 2024-02-19T19:13:56.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:56 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3991535946' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-19T19:13:56.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:56 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1748118789' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-19T19:13:56.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:56 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2278929761' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-19T19:13:56.814 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-19T19:13:56.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-19T19:13:56.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.893+0000 7f58ed7fa640 1 -- 172.21.15.46:0/274017054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58e8101430 msgr2=0x7f58e8109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.893+0000 7f58ed7fa640 1 --2- 172.21.15.46:0/274017054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58e8101430 0x7f58e8109920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009880 tx=0x7f58d002bd70 comp rx=0 tx=0).stop 2024-02-19T19:13:56.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.893+0000 7f58ed7fa640 1 -- 172.21.15.46:0/274017054 shutdown_connections 2024-02-19T19:13:56.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.893+0000 7f58ed7fa640 1 --2- 172.21.15.46:0/274017054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58e8101430 0x7f58e8109920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.893+0000 7f58ed7fa640 1 --2- 172.21.15.46:0/274017054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8100b20 0x7f58e8100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.893+0000 7f58ed7fa640 1 -- 172.21.15.46:0/274017054 >> 172.21.15.46:0/274017054 conn(0x7f58e80fa2f0 msgr2=0x7f58e80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:56.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.893+0000 7f58ed7fa640 1 -- 172.21.15.46:0/274017054 shutdown_connections 2024-02-19T19:13:56.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.893+0000 7f58ed7fa640 1 -- 172.21.15.46:0/274017054 wait complete. 2024-02-19T19:13:56.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58ed7fa640 1 Processor -- start 2024-02-19T19:13:56.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58ed7fa640 1 -- start start 2024-02-19T19:13:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58ed7fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58e8100b20 0x7f58e8195570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58ed7fa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8101430 0x7f58e8195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58ed7fa640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e8196140 con 0x7f58e8100b20 2024-02-19T19:13:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58ed7fa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e8199f10 con 0x7f58e8101430 2024-02-19T19:13:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58e6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58e8100b20 0x7f58e8195570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58e6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58e8100b20 0x7f58e8195570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40444/0 (socket says 172.21.15.46:40444) 2024-02-19T19:13:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58e6ffd640 1 -- 172.21.15.46:0/3905307682 learned_addr learned my addr 172.21.15.46:0/3905307682 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58e67fc640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8101430 0x7f58e8195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58e6ffd640 1 -- 172.21.15.46:0/3905307682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8101430 msgr2=0x7f58e8195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58e6ffd640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8101430 0x7f58e8195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.894+0000 7f58e6ffd640 1 -- 172.21.15.46:0/3905307682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0009560 con 0x7f58e8100b20 2024-02-19T19:13:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.895+0000 7f58e6ffd640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58e8100b20 0x7f58e8195570 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f58e000e970 tx=0x7f58e000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.895+0000 7f58dffff640 1 -- 172.21.15.46:0/3905307682 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e000cc90 con 0x7f58e8100b20 2024-02-19T19:13:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.895+0000 7f58ed7fa640 1 -- 172.21.15.46:0/3905307682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e819a1f0 con 0x7f58e8100b20 2024-02-19T19:13:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.895+0000 7f58dffff640 1 -- 172.21.15.46:0/3905307682 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58e000cdf0 con 0x7f58e8100b20 2024-02-19T19:13:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.895+0000 7f58dffff640 1 -- 172.21.15.46:0/3905307682 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e0010430 con 0x7f58e8100b20 2024-02-19T19:13:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.895+0000 7f58ed7fa640 1 -- 172.21.15.46:0/3905307682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e819a750 con 0x7f58e8100b20 2024-02-19T19:13:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.896+0000 7f58ed7fa640 1 -- 172.21.15.46:0/3905307682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e804e000 con 0x7f58e8100b20 2024-02-19T19:13:56.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.896+0000 7f58dffff640 1 -- 172.21.15.46:0/3905307682 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f58e00046c0 con 0x7f58e8100b20 2024-02-19T19:13:56.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.897+0000 7f58dffff640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58d406d810 0x7f58d406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:56.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.897+0000 7f58dffff640 1 -- 172.21.15.46:0/3905307682 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f58e0014070 con 0x7f58e8100b20 2024-02-19T19:13:56.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.897+0000 7f58e67fc640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58d406d810 0x7f58d406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.897+0000 7f58e67fc640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58d406d810 0x7f58d406fcc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f58e8196b80 tx=0x7f58d0000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:56.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:56.901+0000 7f58dffff640 1 -- 172.21.15.46:0/3905307682 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f58e0057300 con 0x7f58e8100b20 2024-02-19T19:13:56.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:56 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3991535946' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-19T19:13:56.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:56 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1748118789' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-19T19:13:56.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:56 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2278929761' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-19T19:13:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.121+0000 7f58ed7fa640 1 -- 172.21.15.46:0/3905307682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f58e8066860 con 0x7f58e8100b20 2024-02-19T19:13:57.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.122+0000 7f58dffff640 1 -- 172.21.15.46:0/3905307682 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v37) v1 ==== 107+0+4857 (secure 0 0 0) 0x7f58e005a9c0 con 0x7f58e8100b20 2024-02-19T19:13:57.146 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:57.146 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34406,"name":"cephfs.smithi046.bwvkwa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/214941826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":214941826},{"type":"v1","addr":"172.21.15.46:6829","nonce":214941826}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":44299,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/3279846196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3279846196},{"type":"v1","addr":"172.21.15.142:6825","nonce":3279846196}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:10:34.708956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:57.146 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 23 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.123+0000 7f58ed7fa640 1 -- 172.21.15.46:0/3905307682 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58d406d810 msgr2=0x7f58d406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.123+0000 7f58ed7fa640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58d406d810 0x7f58d406fcc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f58e8196b80 tx=0x7f58d0000bc0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.124+0000 7f58ed7fa640 1 -- 172.21.15.46:0/3905307682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58e8100b20 msgr2=0x7f58e8195570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.124+0000 7f58ed7fa640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58e8100b20 0x7f58e8195570 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f58e000e970 tx=0x7f58e000ed70 comp rx=0 tx=0).stop 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.124+0000 7f58ed7fa640 1 -- 172.21.15.46:0/3905307682 shutdown_connections 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.124+0000 7f58ed7fa640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f58d406d810 0x7f58d406fcc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.124+0000 7f58ed7fa640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8101430 0x7f58e8195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.124+0000 7f58ed7fa640 1 --2- 172.21.15.46:0/3905307682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58e8100b20 0x7f58e8195570 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.124+0000 7f58ed7fa640 1 -- 172.21.15.46:0/3905307682 >> 172.21.15.46:0/3905307682 conn(0x7f58e80fa2f0 msgr2=0x7f58e81040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.124+0000 7f58ed7fa640 1 -- 172.21.15.46:0/3905307682 shutdown_connections 2024-02-19T19:13:57.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.124+0000 7f58ed7fa640 1 -- 172.21.15.46:0/3905307682 wait complete. 2024-02-19T19:13:57.159 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-19T19:13:57.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-19T19:13:57.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.240+0000 7f8b3c14e640 1 -- 172.21.15.46:0/3285518638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b34104590 msgr2=0x7f8b34104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.240+0000 7f8b3c14e640 1 --2- 172.21.15.46:0/3285518638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b34104590 0x7f8b34104960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009880 tx=0x7f8b3002bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.240+0000 7f8b3c14e640 1 -- 172.21.15.46:0/3285518638 shutdown_connections 2024-02-19T19:13:57.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.240+0000 7f8b3c14e640 1 --2- 172.21.15.46:0/3285518638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b340fe5b0 0x7f8b340fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.240+0000 7f8b3c14e640 1 --2- 172.21.15.46:0/3285518638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b34104590 0x7f8b34104960 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.240+0000 7f8b3c14e640 1 -- 172.21.15.46:0/3285518638 >> 172.21.15.46:0/3285518638 conn(0x7f8b340743d0 msgr2=0x7f8b340747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:57.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.240+0000 7f8b3c14e640 1 -- 172.21.15.46:0/3285518638 shutdown_connections 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.240+0000 7f8b3c14e640 1 -- 172.21.15.46:0/3285518638 wait complete. 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.240+0000 7f8b3c14e640 1 Processor -- start 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.240+0000 7f8b3c14e640 1 -- start start 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b3c14e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fe5b0 0x7f8b34197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b3c14e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b34104590 0x7f8b34197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b3c14e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b341980e0 con 0x7f8b340fe5b0 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b3c14e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3419beb0 con 0x7f8b34104590 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b39eea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fe5b0 0x7f8b34197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b39eea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fe5b0 0x7f8b34197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40464/0 (socket says 172.21.15.46:40464) 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b39eea640 1 -- 172.21.15.46:0/1668510560 learned_addr learned my addr 172.21.15.46:0/1668510560 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:57.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b39eea640 1 -- 172.21.15.46:0/1668510560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b34104590 msgr2=0x7f8b34197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b39eea640 1 --2- 172.21.15.46:0/1668510560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b34104590 0x7f8b34197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b39eea640 1 -- 172.21.15.46:0/1668510560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30009560 con 0x7f8b340fe5b0 2024-02-19T19:13:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b39eea640 1 --2- 172.21.15.46:0/1668510560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fe5b0 0x7f8b34197510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b30000c00 tx=0x7f8b3002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b2affd640 1 -- 172.21.15.46:0/1668510560 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b30004520 con 0x7f8b340fe5b0 2024-02-19T19:13:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b2affd640 1 -- 172.21.15.46:0/1668510560 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b30003ab0 con 0x7f8b340fe5b0 2024-02-19T19:13:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b3c14e640 1 -- 172.21.15.46:0/1668510560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3419c130 con 0x7f8b340fe5b0 2024-02-19T19:13:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b2affd640 1 -- 172.21.15.46:0/1668510560 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b30034440 con 0x7f8b340fe5b0 2024-02-19T19:13:57.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.241+0000 7f8b3c14e640 1 -- 172.21.15.46:0/1668510560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3419c630 con 0x7f8b340fe5b0 2024-02-19T19:13:57.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.242+0000 7f8b3c14e640 1 -- 172.21.15.46:0/1668510560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3404e000 con 0x7f8b340fe5b0 2024-02-19T19:13:57.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.243+0000 7f8b2affd640 1 -- 172.21.15.46:0/1668510560 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8b30003c20 con 0x7f8b340fe5b0 2024-02-19T19:13:57.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.243+0000 7f8b2affd640 1 --2- 172.21.15.46:0/1668510560 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b2006d810 0x7f8b2006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:57.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.243+0000 7f8b2affd640 1 -- 172.21.15.46:0/1668510560 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f8b300afa00 con 0x7f8b340fe5b0 2024-02-19T19:13:57.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.243+0000 7f8b396e9640 1 --2- 172.21.15.46:0/1668510560 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b2006d810 0x7f8b2006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:57.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.244+0000 7f8b396e9640 1 --2- 172.21.15.46:0/1668510560 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b2006d810 0x7f8b2006fcc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b24005fd0 tx=0x7f8b24005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:57.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.248+0000 7f8b2affd640 1 -- 172.21.15.46:0/1668510560 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8b300790a0 con 0x7f8b340fe5b0 2024-02-19T19:13:57.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.468+0000 7f8b3c14e640 1 -- 172.21.15.46:0/1668510560 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f8b34198860 con 0x7f8b340fe5b0 2024-02-19T19:13:57.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.469+0000 7f8b2affd640 1 -- 172.21.15.46:0/1668510560 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v37) v1 ==== 107+0+4081 (secure 0 0 0) 0x7f8b3007c760 con 0x7f8b340fe5b0 2024-02-19T19:13:57.493 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:57.493 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":44299,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/3279846196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3279846196},{"type":"v1","addr":"172.21.15.142:6825","nonce":3279846196}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:10:34.708956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:57.493 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-02-19T19:13:57.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 -- 172.21.15.46:0/1668510560 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b2006d810 msgr2=0x7f8b2006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 --2- 172.21.15.46:0/1668510560 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b2006d810 0x7f8b2006fcc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b24005fd0 tx=0x7f8b24005850 comp rx=0 tx=0).stop 2024-02-19T19:13:57.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 -- 172.21.15.46:0/1668510560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fe5b0 msgr2=0x7f8b34197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 --2- 172.21.15.46:0/1668510560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fe5b0 0x7f8b34197510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b30000c00 tx=0x7f8b3002c850 comp rx=0 tx=0).stop 2024-02-19T19:13:57.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 -- 172.21.15.46:0/1668510560 shutdown_connections 2024-02-19T19:13:57.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 --2- 172.21.15.46:0/1668510560 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b2006d810 0x7f8b2006fcc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 --2- 172.21.15.46:0/1668510560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b34104590 0x7f8b34197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 --2- 172.21.15.46:0/1668510560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b340fe5b0 0x7f8b34197510 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 -- 172.21.15.46:0/1668510560 >> 172.21.15.46:0/1668510560 conn(0x7f8b340743d0 msgr2=0x7f8b340673b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:57.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 -- 172.21.15.46:0/1668510560 shutdown_connections 2024-02-19T19:13:57.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.471+0000 7f8b3c14e640 1 -- 172.21.15.46:0/1668510560 wait complete. 2024-02-19T19:13:57.506 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-19T19:13:57.507 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-19T19:13:57.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.587+0000 7f2a5520b640 1 -- 172.21.15.46:0/3057901729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a50105690 msgr2=0x7f2a50105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.587+0000 7f2a5520b640 1 --2- 172.21.15.46:0/3057901729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a50105690 0x7f2a50105a60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009880 tx=0x7f2a4402bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.587+0000 7f2a5520b640 1 -- 172.21.15.46:0/3057901729 shutdown_connections 2024-02-19T19:13:57.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.587+0000 7f2a5520b640 1 --2- 172.21.15.46:0/3057901729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50067350 0x7f2a500677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.587+0000 7f2a5520b640 1 --2- 172.21.15.46:0/3057901729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a50105690 0x7f2a50105a60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.587+0000 7f2a5520b640 1 -- 172.21.15.46:0/3057901729 >> 172.21.15.46:0/3057901729 conn(0x7f2a500743d0 msgr2=0x7f2a500747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:57.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.587+0000 7f2a5520b640 1 -- 172.21.15.46:0/3057901729 shutdown_connections 2024-02-19T19:13:57.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.587+0000 7f2a5520b640 1 -- 172.21.15.46:0/3057901729 wait complete. 2024-02-19T19:13:57.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.588+0000 7f2a5520b640 1 Processor -- start 2024-02-19T19:13:57.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.588+0000 7f2a5520b640 1 -- start start 2024-02-19T19:13:57.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.588+0000 7f2a5520b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a50067350 0x7f2a500fe640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:57.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.588+0000 7f2a5520b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50105690 0x7f2a500feb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:57.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.588+0000 7f2a5520b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500ff150 con 0x7f2a50067350 2024-02-19T19:13:57.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.588+0000 7f2a5520b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500ff290 con 0x7f2a50105690 2024-02-19T19:13:57.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a4ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a50067350 0x7f2a500fe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:57.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a4ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a50067350 0x7f2a500fe640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56984/0 (socket says 172.21.15.46:56984) 2024-02-19T19:13:57.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a4ed9d640 1 -- 172.21.15.46:0/3104654015 learned_addr learned my addr 172.21.15.46:0/3104654015 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:57.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a4e59c640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50105690 0x7f2a500feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a4ed9d640 1 -- 172.21.15.46:0/3104654015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50105690 msgr2=0x7f2a500feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a4ed9d640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50105690 0x7f2a500feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a4ed9d640 1 -- 172.21.15.46:0/3104654015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009560 con 0x7f2a50067350 2024-02-19T19:13:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a4e59c640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50105690 0x7f2a500feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:13:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a4ed9d640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a50067350 0x7f2a500fe640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009230 tx=0x7f2a44004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a37fff640 1 -- 172.21.15.46:0/3104654015 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a440035f0 con 0x7f2a50067350 2024-02-19T19:13:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a37fff640 1 -- 172.21.15.46:0/3104654015 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a44003c10 con 0x7f2a50067350 2024-02-19T19:13:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a37fff640 1 -- 172.21.15.46:0/3104654015 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a44005670 con 0x7f2a50067350 2024-02-19T19:13:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a5520b640 1 -- 172.21.15.46:0/3104654015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a500ff4c0 con 0x7f2a50067350 2024-02-19T19:13:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.589+0000 7f2a5520b640 1 -- 172.21.15.46:0/3104654015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a501a17f0 con 0x7f2a50067350 2024-02-19T19:13:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.590+0000 7f2a5520b640 1 -- 172.21.15.46:0/3104654015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5004e000 con 0x7f2a50067350 2024-02-19T19:13:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.591+0000 7f2a37fff640 1 -- 172.21.15.46:0/3104654015 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2a44004dd0 con 0x7f2a50067350 2024-02-19T19:13:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.591+0000 7f2a37fff640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2a3806d7c0 0x7f2a3806fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.591+0000 7f2a37fff640 1 -- 172.21.15.46:0/3104654015 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f2a440afa20 con 0x7f2a50067350 2024-02-19T19:13:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.591+0000 7f2a4e59c640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2a3806d7c0 0x7f2a3806fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.592+0000 7f2a4e59c640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2a3806d7c0 0x7f2a3806fc70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a400058c0 tx=0x7f2a40005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.596+0000 7f2a37fff640 1 -- 172.21.15.46:0/3104654015 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2a440790c0 con 0x7f2a50067350 2024-02-19T19:13:57.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:57 smithi046 ceph-mon[88928]: pgmap v327: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:57.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:57 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3679112723' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-19T19:13:57.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:57 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3905307682' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-19T19:13:57.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:57 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1668510560' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-19T19:13:57.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.816+0000 7f2a5520b640 1 -- 172.21.15.46:0/3104654015 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f2a500ffb70 con 0x7f2a50067350 2024-02-19T19:13:57.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.817+0000 7f2a37fff640 1 -- 172.21.15.46:0/3104654015 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v37) v1 ==== 107+0+4894 (secure 0 0 0) 0x7f2a4407c780 con 0x7f2a50067350 2024-02-19T19:13:57.841 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:57.841 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":44299,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/3279846196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":3279846196},{"type":"v1","addr":"172.21.15.142:6825","nonce":3279846196}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:10:34.708956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:57.841 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 25 2024-02-19T19:13:57.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 -- 172.21.15.46:0/3104654015 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2a3806d7c0 msgr2=0x7f2a3806fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2a3806d7c0 0x7f2a3806fc70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a400058c0 tx=0x7f2a40005850 comp rx=0 tx=0).stop 2024-02-19T19:13:57.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 -- 172.21.15.46:0/3104654015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a50067350 msgr2=0x7f2a500fe640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a50067350 0x7f2a500fe640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009230 tx=0x7f2a44004040 comp rx=0 tx=0).stop 2024-02-19T19:13:57.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 -- 172.21.15.46:0/3104654015 shutdown_connections 2024-02-19T19:13:57.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f2a3806d7c0 0x7f2a3806fc70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a50105690 0x7f2a500feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 --2- 172.21.15.46:0/3104654015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a50067350 0x7f2a500fe640 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 -- 172.21.15.46:0/3104654015 >> 172.21.15.46:0/3104654015 conn(0x7f2a500743d0 msgr2=0x7f2a500fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:57.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 -- 172.21.15.46:0/3104654015 shutdown_connections 2024-02-19T19:13:57.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.819+0000 7f2a5520b640 1 -- 172.21.15.46:0/3104654015 wait complete. 2024-02-19T19:13:57.854 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-19T19:13:57.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-19T19:13:57.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:57 smithi142 ceph-mon[69118]: pgmap v327: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:57.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:57 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3679112723' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-19T19:13:57.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:57 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3905307682' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-19T19:13:57.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:57 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1668510560' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-19T19:13:57.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.934+0000 7f5fbc378640 1 -- 172.21.15.46:0/3087940822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb4104590 msgr2=0x7f5fb4104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.934+0000 7f5fbc378640 1 --2- 172.21.15.46:0/3087940822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb4104590 0x7f5fb4104960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009880 tx=0x7f5fa402bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.934+0000 7f5fbc378640 1 -- 172.21.15.46:0/3087940822 shutdown_connections 2024-02-19T19:13:57.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.934+0000 7f5fbc378640 1 --2- 172.21.15.46:0/3087940822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb40fe5b0 0x7f5fb40fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.934+0000 7f5fbc378640 1 --2- 172.21.15.46:0/3087940822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb4104590 0x7f5fb4104960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.934+0000 7f5fbc378640 1 -- 172.21.15.46:0/3087940822 >> 172.21.15.46:0/3087940822 conn(0x7f5fb40743d0 msgr2=0x7f5fb40747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:57.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.934+0000 7f5fbc378640 1 -- 172.21.15.46:0/3087940822 shutdown_connections 2024-02-19T19:13:57.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.934+0000 7f5fbc378640 1 -- 172.21.15.46:0/3087940822 wait complete. 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.934+0000 7f5fbc378640 1 Processor -- start 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fbc378640 1 -- start start 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fbc378640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb40fe5b0 0x7f5fb4195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fbc378640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb4104590 0x7f5fb4195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fbc378640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb4195ed0 con 0x7f5fb40fe5b0 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fbc378640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb4199ca0 con 0x7f5fb4104590 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fba114640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb40fe5b0 0x7f5fb4195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fba114640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb40fe5b0 0x7f5fb4195300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57000/0 (socket says 172.21.15.46:57000) 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fba114640 1 -- 172.21.15.46:0/3563194822 learned_addr learned my addr 172.21.15.46:0/3563194822 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fb9913640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb4104590 0x7f5fb4195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fba114640 1 -- 172.21.15.46:0/3563194822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb4104590 msgr2=0x7f5fb4195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:57.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fba114640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb4104590 0x7f5fb4195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:57.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fba114640 1 -- 172.21.15.46:0/3563194822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4009560 con 0x7f5fb40fe5b0 2024-02-19T19:13:57.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fba114640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb40fe5b0 0x7f5fb4195300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009230 tx=0x7f5fa4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:57.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fab7fe640 1 -- 172.21.15.46:0/3563194822 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fa40035f0 con 0x7f5fb40fe5b0 2024-02-19T19:13:57.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fab7fe640 1 -- 172.21.15.46:0/3563194822 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5fa4003c10 con 0x7f5fb40fe5b0 2024-02-19T19:13:57.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fbc378640 1 -- 172.21.15.46:0/3563194822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb4199f20 con 0x7f5fb40fe5b0 2024-02-19T19:13:57.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.935+0000 7f5fab7fe640 1 -- 172.21.15.46:0/3563194822 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fa4005670 con 0x7f5fb40fe5b0 2024-02-19T19:13:57.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.936+0000 7f5fbc378640 1 -- 172.21.15.46:0/3563194822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb419a420 con 0x7f5fb40fe5b0 2024-02-19T19:13:57.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.937+0000 7f5fbc378640 1 -- 172.21.15.46:0/3563194822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb404e000 con 0x7f5fb40fe5b0 2024-02-19T19:13:57.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.937+0000 7f5fab7fe640 1 -- 172.21.15.46:0/3563194822 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f5fa4004dd0 con 0x7f5fb40fe5b0 2024-02-19T19:13:57.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.938+0000 7f5fab7fe640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5fa006d810 0x7f5fa006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:57.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.938+0000 7f5fb9913640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5fa006d810 0x7f5fa006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:57.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.938+0000 7f5fab7fe640 1 -- 172.21.15.46:0/3563194822 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f5fa40af930 con 0x7f5fb40fe5b0 2024-02-19T19:13:57.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.938+0000 7f5fb9913640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5fa006d810 0x7f5fa006fcc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4196910 tx=0x7f5fb000b590 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:57.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:57.942+0000 7f5fab7fe640 1 -- 172.21.15.46:0/3563194822 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5fa4079050 con 0x7f5fb40fe5b0 2024-02-19T19:13:58.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.161+0000 7f5fbc378640 1 -- 172.21.15.46:0/3563194822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f5fb4196650 con 0x7f5fb40fe5b0 2024-02-19T19:13:58.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.162+0000 7f5fab7fe640 1 -- 172.21.15.46:0/3563194822 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v37) v1 ==== 107+0+4112 (secure 0 0 0) 0x7f5fa407c710 con 0x7f5fb40fe5b0 2024-02-19T19:13:58.186 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:58.186 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:10:34.708956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:58.186 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 26 2024-02-19T19:13:58.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 -- 172.21.15.46:0/3563194822 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5fa006d810 msgr2=0x7f5fa006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:58.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5fa006d810 0x7f5fa006fcc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4196910 tx=0x7f5fb000b590 comp rx=0 tx=0).stop 2024-02-19T19:13:58.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 -- 172.21.15.46:0/3563194822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb40fe5b0 msgr2=0x7f5fb4195300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:58.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb40fe5b0 0x7f5fb4195300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009230 tx=0x7f5fa4004040 comp rx=0 tx=0).stop 2024-02-19T19:13:58.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 -- 172.21.15.46:0/3563194822 shutdown_connections 2024-02-19T19:13:58.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f5fa006d810 0x7f5fa006fcc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb4104590 0x7f5fb4195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 --2- 172.21.15.46:0/3563194822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fb40fe5b0 0x7f5fb4195300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 -- 172.21.15.46:0/3563194822 >> 172.21.15.46:0/3563194822 conn(0x7f5fb40743d0 msgr2=0x7f5fb4067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:58.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 -- 172.21.15.46:0/3563194822 shutdown_connections 2024-02-19T19:13:58.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.164+0000 7f5fbc378640 1 -- 172.21.15.46:0/3563194822 wait complete. 2024-02-19T19:13:58.199 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-19T19:13:58.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-19T19:13:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 -- 172.21.15.46:0/2259779819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a4104590 msgr2=0x7f55a4104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 --2- 172.21.15.46:0/2259779819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a4104590 0x7f55a4104960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5594009880 tx=0x7f559402bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 -- 172.21.15.46:0/2259779819 shutdown_connections 2024-02-19T19:13:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 --2- 172.21.15.46:0/2259779819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a40fe5b0 0x7f55a40fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 --2- 172.21.15.46:0/2259779819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a4104590 0x7f55a4104960 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 -- 172.21.15.46:0/2259779819 >> 172.21.15.46:0/2259779819 conn(0x7f55a40743d0 msgr2=0x7f55a40747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 -- 172.21.15.46:0/2259779819 shutdown_connections 2024-02-19T19:13:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 -- 172.21.15.46:0/2259779819 wait complete. 2024-02-19T19:13:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 Processor -- start 2024-02-19T19:13:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 -- start start 2024-02-19T19:13:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.291+0000 7f55abd7e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a40fe5b0 0x7f55a41953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55abd7e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a4104590 0x7f55a4195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55abd7e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4195fb0 con 0x7f55a40fe5b0 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55abd7e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4199d80 con 0x7f55a4104590 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55a9b1a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a40fe5b0 0x7f55a41953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55a9b1a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a40fe5b0 0x7f55a41953e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57006/0 (socket says 172.21.15.46:57006) 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55a9b1a640 1 -- 172.21.15.46:0/2010241434 learned_addr learned my addr 172.21.15.46:0/2010241434 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55a9b1a640 1 -- 172.21.15.46:0/2010241434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a4104590 msgr2=0x7f55a4195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55a9b1a640 1 --2- 172.21.15.46:0/2010241434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a4104590 0x7f55a4195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55a9b1a640 1 -- 172.21.15.46:0/2010241434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594009560 con 0x7f55a40fe5b0 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55a9b1a640 1 --2- 172.21.15.46:0/2010241434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a40fe5b0 0x7f55a41953e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5594009230 tx=0x7f5594004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f559affd640 1 -- 172.21.15.46:0/2010241434 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55940035f0 con 0x7f55a40fe5b0 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55abd7e640 1 -- 172.21.15.46:0/2010241434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a419a000 con 0x7f55a40fe5b0 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f559affd640 1 -- 172.21.15.46:0/2010241434 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5594003c10 con 0x7f55a40fe5b0 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f559affd640 1 -- 172.21.15.46:0/2010241434 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5594034440 con 0x7f55a40fe5b0 2024-02-19T19:13:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.292+0000 7f55abd7e640 1 -- 172.21.15.46:0/2010241434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a419a580 con 0x7f55a40fe5b0 2024-02-19T19:13:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.293+0000 7f55abd7e640 1 -- 172.21.15.46:0/2010241434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a404e000 con 0x7f55a40fe5b0 2024-02-19T19:13:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.294+0000 7f559affd640 1 -- 172.21.15.46:0/2010241434 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f5594004fd0 con 0x7f55a40fe5b0 2024-02-19T19:13:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.294+0000 7f559affd640 1 --2- 172.21.15.46:0/2010241434 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f559006d810 0x7f559006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.294+0000 7f559affd640 1 -- 172.21.15.46:0/2010241434 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f55940afad0 con 0x7f55a40fe5b0 2024-02-19T19:13:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.294+0000 7f55a9319640 1 --2- 172.21.15.46:0/2010241434 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f559006d810 0x7f559006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:58.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.295+0000 7f55a9319640 1 --2- 172.21.15.46:0/2010241434 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f559006d810 0x7f559006fcc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f55a41969f0 tx=0x7f55a0006c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.299+0000 7f559affd640 1 -- 172.21.15.46:0/2010241434 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5594079170 con 0x7f55a40fe5b0 2024-02-19T19:13:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.522+0000 7f55abd7e640 1 -- 172.21.15.46:0/2010241434 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f55a4196730 con 0x7f55a40fe5b0 2024-02-19T19:13:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.522+0000 7f559affd640 1 -- 172.21.15.46:0/2010241434 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v37) v1 ==== 107+0+4925 (secure 0 0 0) 0x7f559407c830 con 0x7f55a40fe5b0 2024-02-19T19:13:58.546 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:58.546 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.142:6827/3954531771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":3954531771},{"type":"v1","addr":"172.21.15.142:6827","nonce":3954531771}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:10:34.708956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2024-02-19T19:13:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.524+0000 7f55abd7e640 1 -- 172.21.15.46:0/2010241434 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f559006d810 msgr2=0x7f559006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.524+0000 7f55abd7e640 1 --2- 172.21.15.46:0/2010241434 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f559006d810 0x7f559006fcc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f55a41969f0 tx=0x7f55a0006c90 comp rx=0 tx=0).stop 2024-02-19T19:13:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.524+0000 7f55abd7e640 1 -- 172.21.15.46:0/2010241434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a40fe5b0 msgr2=0x7f55a41953e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.524+0000 7f55abd7e640 1 --2- 172.21.15.46:0/2010241434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a40fe5b0 0x7f55a41953e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5594009230 tx=0x7f5594004040 comp rx=0 tx=0).stop 2024-02-19T19:13:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.525+0000 7f55abd7e640 1 -- 172.21.15.46:0/2010241434 shutdown_connections 2024-02-19T19:13:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.525+0000 7f55abd7e640 1 --2- 172.21.15.46:0/2010241434 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f559006d810 0x7f559006fcc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.525+0000 7f55abd7e640 1 --2- 172.21.15.46:0/2010241434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a4104590 0x7f55a4195920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.525+0000 7f55abd7e640 1 --2- 172.21.15.46:0/2010241434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55a40fe5b0 0x7f55a41953e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.525+0000 7f55abd7e640 1 -- 172.21.15.46:0/2010241434 >> 172.21.15.46:0/2010241434 conn(0x7f55a40743d0 msgr2=0x7f55a4067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.525+0000 7f55abd7e640 1 -- 172.21.15.46:0/2010241434 shutdown_connections 2024-02-19T19:13:58.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.525+0000 7f55abd7e640 1 -- 172.21.15.46:0/2010241434 wait complete. 2024-02-19T19:13:58.560 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-19T19:13:58.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-19T19:13:58.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.643+0000 7f3601f77640 1 -- 172.21.15.46:0/4154024529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35fc0ff870 msgr2=0x7f35fc0ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:58.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.643+0000 7f3601f77640 1 --2- 172.21.15.46:0/4154024529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35fc0ff870 0x7f35fc0ffce0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009880 tx=0x7f35f002bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.643+0000 7f3601f77640 1 -- 172.21.15.46:0/4154024529 shutdown_connections 2024-02-19T19:13:58.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.643+0000 7f3601f77640 1 --2- 172.21.15.46:0/4154024529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35fc0ff870 0x7f35fc0ffce0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.643+0000 7f3601f77640 1 --2- 172.21.15.46:0/4154024529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc105880 0x7f35fc105c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.643+0000 7f3601f77640 1 -- 172.21.15.46:0/4154024529 >> 172.21.15.46:0/4154024529 conn(0x7f35fc0fb370 msgr2=0x7f35fc0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:58.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.643+0000 7f3601f77640 1 -- 172.21.15.46:0/4154024529 shutdown_connections 2024-02-19T19:13:58.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.643+0000 7f3601f77640 1 -- 172.21.15.46:0/4154024529 wait complete. 2024-02-19T19:13:58.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.643+0000 7f3601f77640 1 Processor -- start 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f3601f77640 1 -- start start 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f3601f77640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc0ff870 0x7f35fc19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f3601f77640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35fc105880 0x7f35fc19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f3601f77640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc197690 con 0x7f35fc105880 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f3601f77640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc1977d0 con 0x7f35fc0ff870 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f35faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35fc105880 0x7f35fc19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f35faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35fc105880 0x7f35fc19dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57016/0 (socket says 172.21.15.46:57016) 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f35faffd640 1 -- 172.21.15.46:0/2725020437 learned_addr learned my addr 172.21.15.46:0/2725020437 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f35fb7fe640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc0ff870 0x7f35fc19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f35faffd640 1 -- 172.21.15.46:0/2725020437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc0ff870 msgr2=0x7f35fc19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f35faffd640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc0ff870 0x7f35fc19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f35faffd640 1 -- 172.21.15.46:0/2725020437 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0009560 con 0x7f35fc105880 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f35fb7fe640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc0ff870 0x7f35fc19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:13:58.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.644+0000 7f35faffd640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35fc105880 0x7f35fc19dbf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009230 tx=0x7f35f0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:58.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.645+0000 7f35f8ff9640 1 -- 172.21.15.46:0/2725020437 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f00035f0 con 0x7f35fc105880 2024-02-19T19:13:58.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.645+0000 7f35f8ff9640 1 -- 172.21.15.46:0/2725020437 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35f0003c10 con 0x7f35fc105880 2024-02-19T19:13:58.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.645+0000 7f3601f77640 1 -- 172.21.15.46:0/2725020437 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc197a50 con 0x7f35fc105880 2024-02-19T19:13:58.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.645+0000 7f35f8ff9640 1 -- 172.21.15.46:0/2725020437 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f0034440 con 0x7f35fc105880 2024-02-19T19:13:58.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.645+0000 7f3601f77640 1 -- 172.21.15.46:0/2725020437 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc197fd0 con 0x7f35fc105880 2024-02-19T19:13:58.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.646+0000 7f3601f77640 1 -- 172.21.15.46:0/2725020437 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc04e000 con 0x7f35fc105880 2024-02-19T19:13:58.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.646+0000 7f35f8ff9640 1 -- 172.21.15.46:0/2725020437 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f35f0004fd0 con 0x7f35fc105880 2024-02-19T19:13:58.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.646+0000 7f35f8ff9640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f35e406d810 0x7f35e406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:58.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.647+0000 7f35f8ff9640 1 -- 172.21.15.46:0/2725020437 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f35f00afad0 con 0x7f35fc105880 2024-02-19T19:13:58.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.647+0000 7f35fb7fe640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f35e406d810 0x7f35e406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:58.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.647+0000 7f35fb7fe640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f35e406d810 0x7f35e406fcc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f35ec006fd0 tx=0x7f35ec008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:58.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.651+0000 7f35f8ff9640 1 -- 172.21.15.46:0/2725020437 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f35f0079170 con 0x7f35fc105880 2024-02-19T19:13:58.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:58.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:58 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3104654015' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-19T19:13:58.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:58 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3563194822' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-19T19:13:58.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.870+0000 7f3601f77640 1 -- 172.21.15.46:0/2725020437 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f35fc10cae0 con 0x7f35fc105880 2024-02-19T19:13:58.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.870+0000 7f35f8ff9640 1 -- 172.21.15.46:0/2725020437 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v37) v1 ==== 107+0+4143 (secure 0 0 0) 0x7f35f007c830 con 0x7f35fc105880 2024-02-19T19:13:58.894 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:58.894 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:10:34.708956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:58.894 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-02-19T19:13:58.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.872+0000 7f3601f77640 1 -- 172.21.15.46:0/2725020437 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f35e406d810 msgr2=0x7f35e406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:58.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.872+0000 7f3601f77640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f35e406d810 0x7f35e406fcc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f35ec006fd0 tx=0x7f35ec008040 comp rx=0 tx=0).stop 2024-02-19T19:13:58.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.872+0000 7f3601f77640 1 -- 172.21.15.46:0/2725020437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35fc105880 msgr2=0x7f35fc19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:58.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.872+0000 7f3601f77640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35fc105880 0x7f35fc19dbf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009230 tx=0x7f35f0004040 comp rx=0 tx=0).stop 2024-02-19T19:13:58.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.872+0000 7f3601f77640 1 -- 172.21.15.46:0/2725020437 shutdown_connections 2024-02-19T19:13:58.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.872+0000 7f3601f77640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f35e406d810 0x7f35e406fcc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.872+0000 7f3601f77640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35fc105880 0x7f35fc19dbf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.872+0000 7f3601f77640 1 --2- 172.21.15.46:0/2725020437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc0ff870 0x7f35fc19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:58.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.872+0000 7f3601f77640 1 -- 172.21.15.46:0/2725020437 >> 172.21.15.46:0/2725020437 conn(0x7f35fc0fb370 msgr2=0x7f35fc0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:58.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.873+0000 7f3601f77640 1 -- 172.21.15.46:0/2725020437 shutdown_connections 2024-02-19T19:13:58.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.873+0000 7f3601f77640 1 -- 172.21.15.46:0/2725020437 wait complete. 2024-02-19T19:13:58.907 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-19T19:13:58.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-19T19:13:58.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:58.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:58 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3104654015' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-19T19:13:58.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:58 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3563194822' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-19T19:13:59.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.986+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/1032391367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c0105690 msgr2=0x7fd2c0105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.986+0000 7fd2c4fe4640 1 --2- 172.21.15.46:0/1032391367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c0105690 0x7fd2c0105a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009880 tx=0x7fd2b002bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.986+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/1032391367 shutdown_connections 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 --2- 172.21.15.46:0/1032391367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2c0067350 0x7fd2c00677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 --2- 172.21.15.46:0/1032391367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c0105690 0x7fd2c0105a60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/1032391367 >> 172.21.15.46:0/1032391367 conn(0x7fd2c00743d0 msgr2=0x7fd2c00747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/1032391367 shutdown_connections 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/1032391367 wait complete. 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 Processor -- start 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 -- start start 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c0067350 0x7fd2c01952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2c0105690 0x7fd2c0195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0195e90 con 0x7fd2c0067350 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.987+0000 7fd2c4fe4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0199c60 con 0x7fd2c0105690 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c0067350 0x7fd2c01952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:59.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c0067350 0x7fd2c01952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57038/0 (socket says 172.21.15.46:57038) 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2be59c640 1 -- 172.21.15.46:0/4256731685 learned_addr learned my addr 172.21.15.46:0/4256731685 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2bdd9b640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2c0105690 0x7fd2c0195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2be59c640 1 -- 172.21.15.46:0/4256731685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2c0105690 msgr2=0x7fd2c0195800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2be59c640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2c0105690 0x7fd2c0195800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2be59c640 1 -- 172.21.15.46:0/4256731685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b0009560 con 0x7fd2c0067350 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2be59c640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c0067350 0x7fd2c01952c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0000c00 tx=0x7fd2b002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2af7fe640 1 -- 172.21.15.46:0/4256731685 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b0004520 con 0x7fd2c0067350 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2af7fe640 1 -- 172.21.15.46:0/4256731685 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2b0003ab0 con 0x7fd2c0067350 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/4256731685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c0199ee0 con 0x7fd2c0067350 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2af7fe640 1 -- 172.21.15.46:0/4256731685 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b0034440 con 0x7fd2c0067350 2024-02-19T19:13:59.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.988+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/4256731685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c019a460 con 0x7fd2c0067350 2024-02-19T19:13:59.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.989+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/4256731685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c004e000 con 0x7fd2c0067350 2024-02-19T19:13:59.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.990+0000 7fd2af7fe640 1 -- 172.21.15.46:0/4256731685 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd2b0003c20 con 0x7fd2c0067350 2024-02-19T19:13:59.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.990+0000 7fd2af7fe640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd2a806d810 0x7fd2a806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:59.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.990+0000 7fd2af7fe640 1 -- 172.21.15.46:0/4256731685 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fd2b00af950 con 0x7fd2c0067350 2024-02-19T19:13:59.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.990+0000 7fd2bdd9b640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd2a806d810 0x7fd2a806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:59.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.990+0000 7fd2bdd9b640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd2a806d810 0x7fd2a806fcc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd2c01968d0 tx=0x7fd2b400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:59.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:58.995+0000 7fd2af7fe640 1 -- 172.21.15.46:0/4256731685 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd2b00790a0 con 0x7fd2c0067350 2024-02-19T19:13:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.213+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/4256731685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fd2c0196610 con 0x7fd2c0067350 2024-02-19T19:13:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.214+0000 7fd2af7fe640 1 -- 172.21.15.46:0/4256731685 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v37) v1 ==== 107+0+4959 (secure 0 0 0) 0x7fd2b007c760 con 0x7fd2c0067350 2024-02-19T19:13:59.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:59.238 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44359,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2993903126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2993903126},{"type":"v1","addr":"172.21.15.142:6827","nonce":2993903126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:10:34.708956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:59.238 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2024-02-19T19:13:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/4256731685 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd2a806d810 msgr2=0x7fd2a806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd2a806d810 0x7fd2a806fcc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd2c01968d0 tx=0x7fd2b400b390 comp rx=0 tx=0).stop 2024-02-19T19:13:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/4256731685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c0067350 msgr2=0x7fd2c01952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c0067350 0x7fd2c01952c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0000c00 tx=0x7fd2b002c850 comp rx=0 tx=0).stop 2024-02-19T19:13:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/4256731685 shutdown_connections 2024-02-19T19:13:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd2a806d810 0x7fd2a806fcc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2c0105690 0x7fd2c0195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 --2- 172.21.15.46:0/4256731685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c0067350 0x7fd2c01952c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/4256731685 >> 172.21.15.46:0/4256731685 conn(0x7fd2c00743d0 msgr2=0x7fd2c00fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:59.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/4256731685 shutdown_connections 2024-02-19T19:13:59.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.216+0000 7fd2c4fe4640 1 -- 172.21.15.46:0/4256731685 wait complete. 2024-02-19T19:13:59.251 DEBUG:tasks.fs:max_mds not reduced in epoch 29 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-19T19:13:59.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-19T19:13:59.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.330+0000 7f964abd7640 1 -- 172.21.15.46:0/3534200683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96440ff870 msgr2=0x7f96440ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.330+0000 7f964abd7640 1 --2- 172.21.15.46:0/3534200683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96440ff870 0x7f96440ffce0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9630009880 tx=0x7f963002bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.330+0000 7f964abd7640 1 -- 172.21.15.46:0/3534200683 shutdown_connections 2024-02-19T19:13:59.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.330+0000 7f964abd7640 1 --2- 172.21.15.46:0/3534200683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96440ff870 0x7f96440ffce0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.330+0000 7f964abd7640 1 --2- 172.21.15.46:0/3534200683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9644105880 0x7f9644105c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.330+0000 7f964abd7640 1 -- 172.21.15.46:0/3534200683 >> 172.21.15.46:0/3534200683 conn(0x7f96440fb370 msgr2=0x7f96440fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.330+0000 7f964abd7640 1 -- 172.21.15.46:0/3534200683 shutdown_connections 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.330+0000 7f964abd7640 1 -- 172.21.15.46:0/3534200683 wait complete. 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.330+0000 7f964abd7640 1 Processor -- start 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f964abd7640 1 -- start start 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f964abd7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96440ff870 0x7f9644195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f964abd7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9644105880 0x7f9644195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f964abd7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96441962b0 con 0x7f9644105880 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f964abd7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9644198f80 con 0x7f96440ff870 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f9643fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9644105880 0x7f9644195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f9643fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9644105880 0x7f9644195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57054/0 (socket says 172.21.15.46:57054) 2024-02-19T19:13:59.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f9643fff640 1 -- 172.21.15.46:0/3105350824 learned_addr learned my addr 172.21.15.46:0/3105350824 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f9643fff640 1 -- 172.21.15.46:0/3105350824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96440ff870 msgr2=0x7f9644195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f9643fff640 1 --2- 172.21.15.46:0/3105350824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96440ff870 0x7f9644195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f9643fff640 1 -- 172.21.15.46:0/3105350824 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630009560 con 0x7f9644105880 2024-02-19T19:13:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f9643fff640 1 --2- 172.21.15.46:0/3105350824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9644105880 0x7f9644195bd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9630009230 tx=0x7f9630004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f9641ffb640 1 -- 172.21.15.46:0/3105350824 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96300035f0 con 0x7f9644105880 2024-02-19T19:13:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f964abd7640 1 -- 172.21.15.46:0/3105350824 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9644199200 con 0x7f9644105880 2024-02-19T19:13:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f9641ffb640 1 -- 172.21.15.46:0/3105350824 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9630003c10 con 0x7f9644105880 2024-02-19T19:13:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.331+0000 7f9641ffb640 1 -- 172.21.15.46:0/3105350824 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9630034440 con 0x7f9644105880 2024-02-19T19:13:59.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.332+0000 7f964abd7640 1 -- 172.21.15.46:0/3105350824 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9644199700 con 0x7f9644105880 2024-02-19T19:13:59.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.333+0000 7f964abd7640 1 -- 172.21.15.46:0/3105350824 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964404e000 con 0x7f9644105880 2024-02-19T19:13:59.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.333+0000 7f9641ffb640 1 -- 172.21.15.46:0/3105350824 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9630004fd0 con 0x7f9644105880 2024-02-19T19:13:59.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.333+0000 7f9641ffb640 1 --2- 172.21.15.46:0/3105350824 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f963406d810 0x7f963406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:59.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.334+0000 7f9648973640 1 --2- 172.21.15.46:0/3105350824 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f963406d810 0x7f963406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:59.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.334+0000 7f9641ffb640 1 -- 172.21.15.46:0/3105350824 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f96300afad0 con 0x7f9644105880 2024-02-19T19:13:59.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.334+0000 7f9648973640 1 --2- 172.21.15.46:0/3105350824 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f963406d810 0x7f963406fcc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f96441009b0 tx=0x7f9638006c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:59.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.338+0000 7f9641ffb640 1 -- 172.21.15.46:0/3105350824 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9630079170 con 0x7f9644105880 2024-02-19T19:13:59.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.561+0000 7f964abd7640 1 -- 172.21.15.46:0/3105350824 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f96441969e0 con 0x7f9644105880 2024-02-19T19:13:59.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.562+0000 7f9641ffb640 1 -- 172.21.15.46:0/3105350824 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v37) v1 ==== 107+0+4958 (secure 0 0 0) 0x7f963007c830 con 0x7f9644105880 2024-02-19T19:13:59.585 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:59.586 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44359,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2993903126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2993903126},{"type":"v1","addr":"172.21.15.142:6827","nonce":2993903126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:11:44.932561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:59.586 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 30 2024-02-19T19:13:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 -- 172.21.15.46:0/3105350824 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f963406d810 msgr2=0x7f963406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 --2- 172.21.15.46:0/3105350824 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f963406d810 0x7f963406fcc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f96441009b0 tx=0x7f9638006c90 comp rx=0 tx=0).stop 2024-02-19T19:13:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 -- 172.21.15.46:0/3105350824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9644105880 msgr2=0x7f9644195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 --2- 172.21.15.46:0/3105350824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9644105880 0x7f9644195bd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9630009230 tx=0x7f9630004040 comp rx=0 tx=0).stop 2024-02-19T19:13:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 -- 172.21.15.46:0/3105350824 shutdown_connections 2024-02-19T19:13:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 --2- 172.21.15.46:0/3105350824 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f963406d810 0x7f963406fcc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 --2- 172.21.15.46:0/3105350824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9644105880 0x7f9644195bd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 --2- 172.21.15.46:0/3105350824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96440ff870 0x7f9644195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 -- 172.21.15.46:0/3105350824 >> 172.21.15.46:0/3105350824 conn(0x7f96440fb370 msgr2=0x7f96440fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:59.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 -- 172.21.15.46:0/3105350824 shutdown_connections 2024-02-19T19:13:59.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.564+0000 7f964abd7640 1 -- 172.21.15.46:0/3105350824 wait complete. 2024-02-19T19:13:59.599 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.678+0000 7fb25fcfc640 1 -- 172.21.15.46:0/883029540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2580fe5b0 msgr2=0x7fb2580fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.678+0000 7fb25fcfc640 1 --2- 172.21.15.46:0/883029540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2580fe5b0 0x7fb2580fea20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb248009880 tx=0x7fb24802bce0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.678+0000 7fb25fcfc640 1 -- 172.21.15.46:0/883029540 shutdown_connections 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.678+0000 7fb25fcfc640 1 --2- 172.21.15.46:0/883029540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2580fe5b0 0x7fb2580fea20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.678+0000 7fb25fcfc640 1 --2- 172.21.15.46:0/883029540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb258104590 0x7fb258104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.678+0000 7fb25fcfc640 1 -- 172.21.15.46:0/883029540 >> 172.21.15.46:0/883029540 conn(0x7fb2580743d0 msgr2=0x7fb2580747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.678+0000 7fb25fcfc640 1 -- 172.21.15.46:0/883029540 shutdown_connections 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.678+0000 7fb25fcfc640 1 -- 172.21.15.46:0/883029540 wait complete. 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25fcfc640 1 Processor -- start 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25fcfc640 1 -- start start 2024-02-19T19:13:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25fcfc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2580fe5b0 0x7fb258194330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25fcfc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb258104590 0x7fb258194870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25fcfc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb258194f00 con 0x7fb2580fe5b0 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25fcfc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb258198cd0 con 0x7fb258104590 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25da98640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2580fe5b0 0x7fb258194330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25da98640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2580fe5b0 0x7fb258194330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57062/0 (socket says 172.21.15.46:57062) 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25da98640 1 -- 172.21.15.46:0/695412467 learned_addr learned my addr 172.21.15.46:0/695412467 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25da98640 1 -- 172.21.15.46:0/695412467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb258104590 msgr2=0x7fb258194870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25da98640 1 --2- 172.21.15.46:0/695412467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb258104590 0x7fb258194870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25da98640 1 -- 172.21.15.46:0/695412467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb248009560 con 0x7fb2580fe5b0 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.679+0000 7fb25da98640 1 --2- 172.21.15.46:0/695412467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2580fe5b0 0x7fb258194330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb25400b420 tx=0x7fb25400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.680+0000 7fb24effd640 1 -- 172.21.15.46:0/695412467 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb254011800 con 0x7fb2580fe5b0 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.680+0000 7fb24effd640 1 -- 172.21.15.46:0/695412467 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb254011e20 con 0x7fb2580fe5b0 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.680+0000 7fb25fcfc640 1 -- 172.21.15.46:0/695412467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb258198fb0 con 0x7fb2580fe5b0 2024-02-19T19:13:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.680+0000 7fb24effd640 1 -- 172.21.15.46:0/695412467 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb25400f2e0 con 0x7fb2580fe5b0 2024-02-19T19:13:59.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.680+0000 7fb25fcfc640 1 -- 172.21.15.46:0/695412467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb258199510 con 0x7fb2580fe5b0 2024-02-19T19:13:59.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:59 smithi142 ceph-mon[69118]: pgmap v328: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:59.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:59 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2010241434' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-19T19:13:59.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:59 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2725020437' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-19T19:13:59.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:13:59 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/4256731685' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-19T19:13:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.681+0000 7fb25fcfc640 1 -- 172.21.15.46:0/695412467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25804e000 con 0x7fb2580fe5b0 2024-02-19T19:13:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.681+0000 7fb24effd640 1 -- 172.21.15.46:0/695412467 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb254010380 con 0x7fb2580fe5b0 2024-02-19T19:13:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.681+0000 7fb24effd640 1 --2- 172.21.15.46:0/695412467 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb24406d810 0x7fb24406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.682+0000 7fb24effd640 1 -- 172.21.15.46:0/695412467 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fb25408cf80 con 0x7fb2580fe5b0 2024-02-19T19:13:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.682+0000 7fb25d297640 1 --2- 172.21.15.46:0/695412467 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb24406d810 0x7fb24406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.682+0000 7fb25d297640 1 --2- 172.21.15.46:0/695412467 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb24406d810 0x7fb24406fcc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb24802efd0 tx=0x7fb248000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:59.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.686+0000 7fb24effd640 1 -- 172.21.15.46:0/695412467 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb254056600 con 0x7fb2580fe5b0 2024-02-19T19:13:59.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:59 smithi046 ceph-mon[88928]: pgmap v328: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:13:59.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:59 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2010241434' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-19T19:13:59.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:59 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2725020437' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-19T19:13:59.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:13:59 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/4256731685' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-19T19:13:59.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.909+0000 7fb25fcfc640 1 -- 172.21.15.46:0/695412467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fb2581069a0 con 0x7fb2580fe5b0 2024-02-19T19:13:59.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.910+0000 7fb24effd640 1 -- 172.21.15.46:0/695412467 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v37) v1 ==== 107+0+5015 (secure 0 0 0) 0x7fb254059cc0 con 0x7fb2580fe5b0 2024-02-19T19:13:59.934 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:13:59.934 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44359,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2993903126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2993903126},{"type":"v1","addr":"172.21.15.142:6827","nonce":2993903126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:11:45.933512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34412,"mds_1":34444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":1,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:13:59.934 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-02-19T19:13:59.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 -- 172.21.15.46:0/695412467 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb24406d810 msgr2=0x7fb24406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 --2- 172.21.15.46:0/695412467 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb24406d810 0x7fb24406fcc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb24802efd0 tx=0x7fb248000bc0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 -- 172.21.15.46:0/695412467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2580fe5b0 msgr2=0x7fb258194330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:59.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 --2- 172.21.15.46:0/695412467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2580fe5b0 0x7fb258194330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb25400b420 tx=0x7fb25400b8e0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 -- 172.21.15.46:0/695412467 shutdown_connections 2024-02-19T19:13:59.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 --2- 172.21.15.46:0/695412467 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fb24406d810 0x7fb24406fcc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 --2- 172.21.15.46:0/695412467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb258104590 0x7fb258194870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 --2- 172.21.15.46:0/695412467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2580fe5b0 0x7fb258194330 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:59.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 -- 172.21.15.46:0/695412467 >> 172.21.15.46:0/695412467 conn(0x7fb2580743d0 msgr2=0x7fb2580fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:59.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 -- 172.21.15.46:0/695412467 shutdown_connections 2024-02-19T19:13:59.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:13:59.912+0000 7fb25fcfc640 1 -- 172.21.15.46:0/695412467 wait complete. 2024-02-19T19:13:59.947 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-19T19:14:00.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.027+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2656041651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd98101330 msgr2=0x7fdd98109820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.027+0000 7fdd9eed5640 1 --2- 172.21.15.46:0/2656041651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd98101330 0x7fdd98109820 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdd840098b0 tx=0x7fdd8402bcd0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.027+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2656041651 shutdown_connections 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.027+0000 7fdd9eed5640 1 --2- 172.21.15.46:0/2656041651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd98101330 0x7fdd98109820 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.027+0000 7fdd9eed5640 1 --2- 172.21.15.46:0/2656041651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd98100a20 0x7fdd98100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.027+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2656041651 >> 172.21.15.46:0/2656041651 conn(0x7fdd980fa270 msgr2=0x7fdd980fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.027+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2656041651 shutdown_connections 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.027+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2656041651 wait complete. 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.027+0000 7fdd9eed5640 1 Processor -- start 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.027+0000 7fdd9eed5640 1 -- start start 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd9eed5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd98100a20 0x7fdd98195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:00.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd9eed5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd98101330 0x7fdd98195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd9eed5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd98196220 con 0x7fdd98101330 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd9eed5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd98199ff0 con 0x7fdd98100a20 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd97fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd98101330 0x7fdd98195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd97fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd98101330 0x7fdd98195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57070/0 (socket says 172.21.15.46:57070) 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd97fff640 1 -- 172.21.15.46:0/2577983319 learned_addr learned my addr 172.21.15.46:0/2577983319 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd9cc71640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd98100a20 0x7fdd98195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd97fff640 1 -- 172.21.15.46:0/2577983319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd98100a20 msgr2=0x7fdd98195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd97fff640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd98100a20 0x7fdd98195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd97fff640 1 -- 172.21.15.46:0/2577983319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84009560 con 0x7fdd98101330 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd97fff640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd98101330 0x7fdd98195b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009880 tx=0x7fdd84004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd95ffb640 1 -- 172.21.15.46:0/2577983319 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd840037c0 con 0x7fdd98101330 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd95ffb640 1 -- 172.21.15.46:0/2577983319 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd84004ac0 con 0x7fdd98101330 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2577983319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9819a270 con 0x7fdd98101330 2024-02-19T19:14:00.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.028+0000 7fdd95ffb640 1 -- 172.21.15.46:0/2577983319 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8403e450 con 0x7fdd98101330 2024-02-19T19:14:00.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.029+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2577983319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9819a7d0 con 0x7fdd98101330 2024-02-19T19:14:00.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.030+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2577983319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9804e000 con 0x7fdd98101330 2024-02-19T19:14:00.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.030+0000 7fdd95ffb640 1 -- 172.21.15.46:0/2577983319 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fdd84004f60 con 0x7fdd98101330 2024-02-19T19:14:00.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.030+0000 7fdd95ffb640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdd8806d810 0x7fdd8806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:00.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.030+0000 7fdd95ffb640 1 -- 172.21.15.46:0/2577983319 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fdd840b0420 con 0x7fdd98101330 2024-02-19T19:14:00.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.030+0000 7fdd9cc71640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdd8806d810 0x7fdd8806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:00.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.031+0000 7fdd9cc71640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdd8806d810 0x7fdd8806fcc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00a810 tx=0x7fdd8c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.035+0000 7fdd95ffb640 1 -- 172.21.15.46:0/2577983319 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdd84079a20 con 0x7fdd98101330 2024-02-19T19:14:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.256+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2577983319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fdd98066860 con 0x7fdd98101330 2024-02-19T19:14:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.256+0000 7fdd95ffb640 1 -- 172.21.15.46:0/2577983319 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v37) v1 ==== 107+0+5017 (secure 0 0 0) 0x7fdd8409be60 con 0x7fdd98101330 2024-02-19T19:14:00.280 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:14:00.280 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44359,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2993903126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2993903126},{"type":"v1","addr":"172.21.15.142:6827","nonce":2993903126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:11:50.498523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34412,"mds_1":34444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":1,"incarnation":31,"state":"up:resolve","state_seq":14,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:14:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 32 2024-02-19T19:14:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.258+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2577983319 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdd8806d810 msgr2=0x7fdd8806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.258+0000 7fdd9eed5640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdd8806d810 0x7fdd8806fcc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00a810 tx=0x7fdd8c008040 comp rx=0 tx=0).stop 2024-02-19T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.258+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2577983319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd98101330 msgr2=0x7fdd98195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.258+0000 7fdd9eed5640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd98101330 0x7fdd98195b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009880 tx=0x7fdd84004270 comp rx=0 tx=0).stop 2024-02-19T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.258+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2577983319 shutdown_connections 2024-02-19T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.258+0000 7fdd9eed5640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fdd8806d810 0x7fdd8806fcc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.258+0000 7fdd9eed5640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd98101330 0x7fdd98195b90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.258+0000 7fdd9eed5640 1 --2- 172.21.15.46:0/2577983319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd98100a20 0x7fdd98195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.258+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2577983319 >> 172.21.15.46:0/2577983319 conn(0x7fdd980fa270 msgr2=0x7fdd98103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.259+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2577983319 shutdown_connections 2024-02-19T19:14:00.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.259+0000 7fdd9eed5640 1 -- 172.21.15.46:0/2577983319 wait complete. 2024-02-19T19:14:00.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-19T19:14:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.372+0000 7f303f62b640 1 -- 172.21.15.46:0/2330573310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30380fe6f0 msgr2=0x7f30380feac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.372+0000 7f303f62b640 1 --2- 172.21.15.46:0/2330573310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30380fe6f0 0x7f30380feac0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3034009880 tx=0x7f303402bce0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.372+0000 7f303f62b640 1 -- 172.21.15.46:0/2330573310 shutdown_connections 2024-02-19T19:14:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.372+0000 7f303f62b640 1 --2- 172.21.15.46:0/2330573310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30380ff000 0x7f3038109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.372+0000 7f303f62b640 1 --2- 172.21.15.46:0/2330573310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30380fe6f0 0x7f30380feac0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.372+0000 7f303f62b640 1 -- 172.21.15.46:0/2330573310 >> 172.21.15.46:0/2330573310 conn(0x7f3038073d20 msgr2=0x7f3038074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:00.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.372+0000 7f303f62b640 1 -- 172.21.15.46:0/2330573310 shutdown_connections 2024-02-19T19:14:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.372+0000 7f303f62b640 1 -- 172.21.15.46:0/2330573310 wait complete. 2024-02-19T19:14:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303f62b640 1 Processor -- start 2024-02-19T19:14:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303f62b640 1 -- start start 2024-02-19T19:14:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303f62b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30380fe6f0 0x7f3038195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303f62b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30380ff000 0x7f3038195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303f62b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3038195ee0 con 0x7f30380ff000 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303f62b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3038199cb0 con 0x7f30380fe6f0 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303cbc6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30380ff000 0x7f3038195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303cbc6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30380ff000 0x7f3038195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57086/0 (socket says 172.21.15.46:57086) 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303cbc6640 1 -- 172.21.15.46:0/623810528 learned_addr learned my addr 172.21.15.46:0/623810528 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303cbc6640 1 -- 172.21.15.46:0/623810528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30380fe6f0 msgr2=0x7f3038195310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303cbc6640 1 --2- 172.21.15.46:0/623810528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30380fe6f0 0x7f3038195310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303cbc6640 1 -- 172.21.15.46:0/623810528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3034009560 con 0x7f30380ff000 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f303cbc6640 1 --2- 172.21.15.46:0/623810528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30380ff000 0x7f3038195850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f302800d6f0 tx=0x7f302800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.373+0000 7f302e7fc640 1 -- 172.21.15.46:0/623810528 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3028009a30 con 0x7f30380ff000 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.374+0000 7f302e7fc640 1 -- 172.21.15.46:0/623810528 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30280054e0 con 0x7f30380ff000 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.374+0000 7f302e7fc640 1 -- 172.21.15.46:0/623810528 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3028010460 con 0x7f30380ff000 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.374+0000 7f303f62b640 1 -- 172.21.15.46:0/623810528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3038199f90 con 0x7f30380ff000 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.374+0000 7f303f62b640 1 -- 172.21.15.46:0/623810528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303819a4f0 con 0x7f30380ff000 2024-02-19T19:14:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.375+0000 7f303f62b640 1 -- 172.21.15.46:0/623810528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303804e000 con 0x7f30380ff000 2024-02-19T19:14:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.375+0000 7f302e7fc640 1 -- 172.21.15.46:0/623810528 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f3028009b90 con 0x7f30380ff000 2024-02-19T19:14:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.375+0000 7f302e7fc640 1 --2- 172.21.15.46:0/623810528 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f302406d810 0x7f302406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.376+0000 7f303d3c7640 1 --2- 172.21.15.46:0/623810528 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f302406d810 0x7f302406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.376+0000 7f302e7fc640 1 -- 172.21.15.46:0/623810528 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f302808d0e0 con 0x7f30380ff000 2024-02-19T19:14:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.376+0000 7f303d3c7640 1 --2- 172.21.15.46:0/623810528 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f302406d810 0x7f302406fcc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3034036040 tx=0x7f3034005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:00.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.380+0000 7f302e7fc640 1 -- 172.21.15.46:0/623810528 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3028056800 con 0x7f30380ff000 2024-02-19T19:14:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.601+0000 7f303f62b640 1 -- 172.21.15.46:0/623810528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f303810c800 con 0x7f30380ff000 2024-02-19T19:14:00.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.601+0000 7f302e7fc640 1 -- 172.21.15.46:0/623810528 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v37) v1 ==== 107+0+5019 (secure 0 0 0) 0x7f3028059ec0 con 0x7f30380ff000 2024-02-19T19:14:00.625 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:14:00.625 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44359,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2993903126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2993903126},{"type":"v1","addr":"172.21.15.142:6827","nonce":2993903126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:11:55.607263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34412,"mds_1":34444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":0,"incarnation":31,"state":"up:resolve","state_seq":19,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":1,"incarnation":31,"state":"up:resolve","state_seq":14,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:14:00.625 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 33 2024-02-19T19:14:00.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 -- 172.21.15.46:0/623810528 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f302406d810 msgr2=0x7f302406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 --2- 172.21.15.46:0/623810528 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f302406d810 0x7f302406fcc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3034036040 tx=0x7f3034005fd0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 -- 172.21.15.46:0/623810528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30380ff000 msgr2=0x7f3038195850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 --2- 172.21.15.46:0/623810528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30380ff000 0x7f3038195850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f302800d6f0 tx=0x7f302800dbb0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 -- 172.21.15.46:0/623810528 shutdown_connections 2024-02-19T19:14:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 --2- 172.21.15.46:0/623810528 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f302406d810 0x7f302406fcc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 --2- 172.21.15.46:0/623810528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30380ff000 0x7f3038195850 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 --2- 172.21.15.46:0/623810528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30380fe6f0 0x7f3038195310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 -- 172.21.15.46:0/623810528 >> 172.21.15.46:0/623810528 conn(0x7f3038073d20 msgr2=0x7f30381042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 -- 172.21.15.46:0/623810528 shutdown_connections 2024-02-19T19:14:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.603+0000 7f303f62b640 1 -- 172.21.15.46:0/623810528 wait complete. 2024-02-19T19:14:00.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-19T19:14:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.717+0000 7fad77cbd640 1 -- 172.21.15.46:0/167048100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad700fe5b0 msgr2=0x7fad700fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.717+0000 7fad77cbd640 1 --2- 172.21.15.46:0/167048100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad700fe5b0 0x7fad700fea20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad60009880 tx=0x7fad6002bce0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.717+0000 7fad77cbd640 1 -- 172.21.15.46:0/167048100 shutdown_connections 2024-02-19T19:14:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.717+0000 7fad77cbd640 1 --2- 172.21.15.46:0/167048100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad700fe5b0 0x7fad700fea20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.717+0000 7fad77cbd640 1 --2- 172.21.15.46:0/167048100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad70104590 0x7fad70104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.717+0000 7fad77cbd640 1 -- 172.21.15.46:0/167048100 >> 172.21.15.46:0/167048100 conn(0x7fad700743d0 msgr2=0x7fad700747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.717+0000 7fad77cbd640 1 -- 172.21.15.46:0/167048100 shutdown_connections 2024-02-19T19:14:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.717+0000 7fad77cbd640 1 -- 172.21.15.46:0/167048100 wait complete. 2024-02-19T19:14:00.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.718+0000 7fad77cbd640 1 Processor -- start 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.718+0000 7fad77cbd640 1 -- start start 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.718+0000 7fad77cbd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad700fe5b0 0x7fad70195450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.718+0000 7fad77cbd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad70104590 0x7fad70195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.718+0000 7fad77cbd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad70196020 con 0x7fad700fe5b0 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.718+0000 7fad77cbd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad70199df0 con 0x7fad70104590 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.718+0000 7fad75a59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad700fe5b0 0x7fad70195450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.718+0000 7fad75a59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad700fe5b0 0x7fad70195450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57098/0 (socket says 172.21.15.46:57098) 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.718+0000 7fad75a59640 1 -- 172.21.15.46:0/2336710464 learned_addr learned my addr 172.21.15.46:0/2336710464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.719+0000 7fad75a59640 1 -- 172.21.15.46:0/2336710464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad70104590 msgr2=0x7fad70195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.719+0000 7fad75a59640 1 --2- 172.21.15.46:0/2336710464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad70104590 0x7fad70195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.719+0000 7fad75a59640 1 -- 172.21.15.46:0/2336710464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60009560 con 0x7fad700fe5b0 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.719+0000 7fad75a59640 1 --2- 172.21.15.46:0/2336710464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad700fe5b0 0x7fad70195450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b420 tx=0x7fad6800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:00.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.719+0000 7fad66ffd640 1 -- 172.21.15.46:0/2336710464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad68011800 con 0x7fad700fe5b0 2024-02-19T19:14:00.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.719+0000 7fad66ffd640 1 -- 172.21.15.46:0/2336710464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad68011e20 con 0x7fad700fe5b0 2024-02-19T19:14:00.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.719+0000 7fad77cbd640 1 -- 172.21.15.46:0/2336710464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7019a0d0 con 0x7fad700fe5b0 2024-02-19T19:14:00.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.719+0000 7fad66ffd640 1 -- 172.21.15.46:0/2336710464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6800f2e0 con 0x7fad700fe5b0 2024-02-19T19:14:00.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.719+0000 7fad77cbd640 1 -- 172.21.15.46:0/2336710464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7019a630 con 0x7fad700fe5b0 2024-02-19T19:14:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.720+0000 7fad77cbd640 1 -- 172.21.15.46:0/2336710464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7004e000 con 0x7fad700fe5b0 2024-02-19T19:14:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.720+0000 7fad66ffd640 1 -- 172.21.15.46:0/2336710464 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fad68010380 con 0x7fad700fe5b0 2024-02-19T19:14:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.721+0000 7fad66ffd640 1 --2- 172.21.15.46:0/2336710464 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5c06d810 0x7fad5c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.721+0000 7fad66ffd640 1 -- 172.21.15.46:0/2336710464 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fad6808cee0 con 0x7fad700fe5b0 2024-02-19T19:14:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.721+0000 7fad75258640 1 --2- 172.21.15.46:0/2336710464 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5c06d810 0x7fad5c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:00.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.721+0000 7fad75258640 1 --2- 172.21.15.46:0/2336710464 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5c06d810 0x7fad5c06fcc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad60036040 tx=0x7fad60000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:00.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.725+0000 7fad66ffd640 1 -- 172.21.15.46:0/2336710464 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fad68056600 con 0x7fad700fe5b0 2024-02-19T19:14:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:00 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3105350824' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-19T19:14:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:00 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/695412467' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-19T19:14:00.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:00 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2577983319' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-19T19:14:00.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:00 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3105350824' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-19T19:14:00.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:00 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/695412467' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-19T19:14:00.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:00 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2577983319' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-19T19:14:00.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.943+0000 7fad77cbd640 1 -- 172.21.15.46:0/2336710464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fad701967a0 con 0x7fad700fe5b0 2024-02-19T19:14:00.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.943+0000 7fad66ffd640 1 -- 172.21.15.46:0/2336710464 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v37) v1 ==== 107+0+5023 (secure 0 0 0) 0x7fad68059cc0 con 0x7fad700fe5b0 2024-02-19T19:14:00.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:14:00.967 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44359,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2993903126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2993903126},{"type":"v1","addr":"172.21.15.142:6827","nonce":2993903126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:11:56.256807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34412,"mds_1":34444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":20,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":1,"incarnation":31,"state":"up:reconnect","state_seq":16,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:14:00.968 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 34 2024-02-19T19:14:00.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 -- 172.21.15.46:0/2336710464 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5c06d810 msgr2=0x7fad5c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 --2- 172.21.15.46:0/2336710464 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5c06d810 0x7fad5c06fcc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad60036040 tx=0x7fad60000bc0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 -- 172.21.15.46:0/2336710464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad700fe5b0 msgr2=0x7fad70195450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:00.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 --2- 172.21.15.46:0/2336710464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad700fe5b0 0x7fad70195450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b420 tx=0x7fad6800b8e0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 -- 172.21.15.46:0/2336710464 shutdown_connections 2024-02-19T19:14:00.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 --2- 172.21.15.46:0/2336710464 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fad5c06d810 0x7fad5c06fcc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 --2- 172.21.15.46:0/2336710464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad70104590 0x7fad70195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 --2- 172.21.15.46:0/2336710464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad700fe5b0 0x7fad70195450 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:00.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 -- 172.21.15.46:0/2336710464 >> 172.21.15.46:0/2336710464 conn(0x7fad700743d0 msgr2=0x7fad701027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:00.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 -- 172.21.15.46:0/2336710464 shutdown_connections 2024-02-19T19:14:00.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:00.945+0000 7fad77cbd640 1 -- 172.21.15.46:0/2336710464 wait complete. 2024-02-19T19:14:00.980 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.059+0000 7faf340d5640 1 -- 172.21.15.46:0/2151174382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf2c0fe7f0 msgr2=0x7faf2c0fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.059+0000 7faf340d5640 1 --2- 172.21.15.46:0/2151174382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf2c0fe7f0 0x7faf2c0fec60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009880 tx=0x7faf1c02bd10 comp rx=0 tx=0).stop 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.059+0000 7faf340d5640 1 -- 172.21.15.46:0/2151174382 shutdown_connections 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.059+0000 7faf340d5640 1 --2- 172.21.15.46:0/2151174382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf2c0fe7f0 0x7faf2c0fec60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.059+0000 7faf340d5640 1 --2- 172.21.15.46:0/2151174382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c104800 0x7faf2c104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.059+0000 7faf340d5640 1 -- 172.21.15.46:0/2151174382 >> 172.21.15.46:0/2151174382 conn(0x7faf2c0fa2f0 msgr2=0x7faf2c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.059+0000 7faf340d5640 1 -- 172.21.15.46:0/2151174382 shutdown_connections 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.059+0000 7faf340d5640 1 -- 172.21.15.46:0/2151174382 wait complete. 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.059+0000 7faf340d5640 1 Processor -- start 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.059+0000 7faf340d5640 1 -- start start 2024-02-19T19:14:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf340d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c0fe7f0 0x7faf2c194540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf340d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf2c104800 0x7faf2c194a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf340d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c195110 con 0x7faf2c104800 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf340d5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c198e90 con 0x7faf2c0fe7f0 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf31670640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf2c104800 0x7faf2c194a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf31670640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf2c104800 0x7faf2c194a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57104/0 (socket says 172.21.15.46:57104) 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf31670640 1 -- 172.21.15.46:0/1068589676 learned_addr learned my addr 172.21.15.46:0/1068589676 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf31670640 1 -- 172.21.15.46:0/1068589676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c0fe7f0 msgr2=0x7faf2c194540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf31e71640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c0fe7f0 0x7faf2c194540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf31670640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c0fe7f0 0x7faf2c194540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf31670640 1 -- 172.21.15.46:0/1068589676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c009560 con 0x7faf2c104800 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf31e71640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c0fe7f0 0x7faf2c194540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf31670640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf2c104800 0x7faf2c194a80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009230 tx=0x7faf1c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf22ffd640 1 -- 172.21.15.46:0/1068589676 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1c0035f0 con 0x7faf2c104800 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf22ffd640 1 -- 172.21.15.46:0/1068589676 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf1c003c10 con 0x7faf2c104800 2024-02-19T19:14:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf340d5640 1 -- 172.21.15.46:0/1068589676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c199110 con 0x7faf2c104800 2024-02-19T19:14:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf22ffd640 1 -- 172.21.15.46:0/1068589676 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1c0344e0 con 0x7faf2c104800 2024-02-19T19:14:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.060+0000 7faf340d5640 1 -- 172.21.15.46:0/1068589676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c1996f0 con 0x7faf2c104800 2024-02-19T19:14:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.061+0000 7faf340d5640 1 -- 172.21.15.46:0/1068589676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c04e000 con 0x7faf2c104800 2024-02-19T19:14:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.062+0000 7faf22ffd640 1 -- 172.21.15.46:0/1068589676 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7faf1c004f60 con 0x7faf2c104800 2024-02-19T19:14:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.062+0000 7faf22ffd640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7faf1806d810 0x7faf1806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.062+0000 7faf22ffd640 1 -- 172.21.15.46:0/1068589676 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7faf1c0b0420 con 0x7faf2c104800 2024-02-19T19:14:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.062+0000 7faf31e71640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7faf1806d810 0x7faf1806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.063+0000 7faf31e71640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7faf1806d810 0x7faf1806fcc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0ff930 tx=0x7faf28008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.067+0000 7faf22ffd640 1 -- 172.21.15.46:0/1068589676 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faf1c079c60 con 0x7faf2c104800 2024-02-19T19:14:01.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.289+0000 7faf340d5640 1 -- 172.21.15.46:0/1068589676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7faf2c066860 con 0x7faf2c104800 2024-02-19T19:14:01.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.290+0000 7faf22ffd640 1 -- 172.21.15.46:0/1068589676 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v37) v1 ==== 107+0+5017 (secure 0 0 0) 0x7faf1c07d320 con 0x7faf2c104800 2024-02-19T19:14:01.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:14:01.314 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44359,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2993903126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2993903126},{"type":"v1","addr":"172.21.15.142:6827","nonce":2993903126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:11:57.216736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34412,"mds_1":34444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":1,"incarnation":31,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:14:01.314 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 35 2024-02-19T19:14:01.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 -- 172.21.15.46:0/1068589676 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7faf1806d810 msgr2=0x7faf1806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:01.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7faf1806d810 0x7faf1806fcc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0ff930 tx=0x7faf28008040 comp rx=0 tx=0).stop 2024-02-19T19:14:01.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 -- 172.21.15.46:0/1068589676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf2c104800 msgr2=0x7faf2c194a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:01.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf2c104800 0x7faf2c194a80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009230 tx=0x7faf1c004040 comp rx=0 tx=0).stop 2024-02-19T19:14:01.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 -- 172.21.15.46:0/1068589676 shutdown_connections 2024-02-19T19:14:01.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7faf1806d810 0x7faf1806fcc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf2c104800 0x7faf2c194a80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 --2- 172.21.15.46:0/1068589676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf2c0fe7f0 0x7faf2c194540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 -- 172.21.15.46:0/1068589676 >> 172.21.15.46:0/1068589676 conn(0x7faf2c0fa2f0 msgr2=0x7faf2c0fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:01.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 -- 172.21.15.46:0/1068589676 shutdown_connections 2024-02-19T19:14:01.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.292+0000 7faf340d5640 1 -- 172.21.15.46:0/1068589676 wait complete. 2024-02-19T19:14:01.326 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-02-19T19:14:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.405+0000 7f38ff6d2640 1 -- 172.21.15.46:0/408292416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38f80feff0 msgr2=0x7f38f8109a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.405+0000 7f38ff6d2640 1 --2- 172.21.15.46:0/408292416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38f80feff0 0x7f38f8109a60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009880 tx=0x7f38ec02bd10 comp rx=0 tx=0).stop 2024-02-19T19:14:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.405+0000 7f38ff6d2640 1 -- 172.21.15.46:0/408292416 shutdown_connections 2024-02-19T19:14:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.405+0000 7f38ff6d2640 1 --2- 172.21.15.46:0/408292416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38f80feff0 0x7f38f8109a60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.405+0000 7f38ff6d2640 1 --2- 172.21.15.46:0/408292416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f80fe6e0 0x7f38f80feab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.405+0000 7f38ff6d2640 1 -- 172.21.15.46:0/408292416 >> 172.21.15.46:0/408292416 conn(0x7f38f8074cf0 msgr2=0x7f38f80750f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.405+0000 7f38ff6d2640 1 -- 172.21.15.46:0/408292416 shutdown_connections 2024-02-19T19:14:01.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.405+0000 7f38ff6d2640 1 -- 172.21.15.46:0/408292416 wait complete. 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.406+0000 7f38ff6d2640 1 Processor -- start 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.406+0000 7f38ff6d2640 1 -- start start 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.406+0000 7f38ff6d2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38f80fe6e0 0x7f38f8195460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.406+0000 7f38ff6d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f80feff0 0x7f38f81959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.406+0000 7f38ff6d2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8196030 con 0x7f38f80fe6e0 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.406+0000 7f38ff6d2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8199e00 con 0x7f38f80feff0 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.406+0000 7f38fd46e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38f80fe6e0 0x7f38f8195460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.406+0000 7f38fd46e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38f80fe6e0 0x7f38f8195460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57108/0 (socket says 172.21.15.46:57108) 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.406+0000 7f38fd46e640 1 -- 172.21.15.46:0/3738813356 learned_addr learned my addr 172.21.15.46:0/3738813356 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.407+0000 7f38fd46e640 1 -- 172.21.15.46:0/3738813356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f80feff0 msgr2=0x7f38f81959a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.407+0000 7f38fd46e640 1 --2- 172.21.15.46:0/3738813356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f80feff0 0x7f38f81959a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.407+0000 7f38fd46e640 1 -- 172.21.15.46:0/3738813356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec009560 con 0x7f38f80fe6e0 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.407+0000 7f38fd46e640 1 --2- 172.21.15.46:0/3738813356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38f80fe6e0 0x7f38f8195460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f38e800ba50 tx=0x7f38e800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:01.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.407+0000 7f38f67fc640 1 -- 172.21.15.46:0/3738813356 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38e800cb60 con 0x7f38f80fe6e0 2024-02-19T19:14:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.407+0000 7f38f67fc640 1 -- 172.21.15.46:0/3738813356 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38e800ccc0 con 0x7f38f80fe6e0 2024-02-19T19:14:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.407+0000 7f38ff6d2640 1 -- 172.21.15.46:0/3738813356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f819a0e0 con 0x7f38f80fe6e0 2024-02-19T19:14:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.407+0000 7f38f67fc640 1 -- 172.21.15.46:0/3738813356 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38e80077e0 con 0x7f38f80fe6e0 2024-02-19T19:14:01.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.407+0000 7f38ff6d2640 1 -- 172.21.15.46:0/3738813356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f819a640 con 0x7f38f80fe6e0 2024-02-19T19:14:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.408+0000 7f38ff6d2640 1 -- 172.21.15.46:0/3738813356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f804e000 con 0x7f38f80fe6e0 2024-02-19T19:14:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.408+0000 7f38f67fc640 1 -- 172.21.15.46:0/3738813356 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f38e8007940 con 0x7f38f80fe6e0 2024-02-19T19:14:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.409+0000 7f38f67fc640 1 --2- 172.21.15.46:0/3738813356 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f38e006d810 0x7f38e006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.409+0000 7f38f67fc640 1 -- 172.21.15.46:0/3738813356 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f38e808d030 con 0x7f38f80fe6e0 2024-02-19T19:14:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.409+0000 7f38fcc6d640 1 --2- 172.21.15.46:0/3738813356 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f38e006d810 0x7f38e006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:01.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.409+0000 7f38fcc6d640 1 --2- 172.21.15.46:0/3738813356 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f38e006d810 0x7f38e006fcc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38ec036040 tx=0x7f38ec005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:01.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.414+0000 7f38f67fc640 1 -- 172.21.15.46:0/3738813356 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f38e8056800 con 0x7f38f80fe6e0 2024-02-19T19:14:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:01 smithi046 ceph-mon[88928]: pgmap v329: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:01 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/623810528' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-19T19:14:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:01 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2336710464' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-19T19:14:01.583 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:01 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1068589676' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-19T19:14:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.636+0000 7f38ff6d2640 1 -- 172.21.15.46:0/3738813356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f38f81070d0 con 0x7f38f80fe6e0 2024-02-19T19:14:01.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.636+0000 7f38f67fc640 1 -- 172.21.15.46:0/3738813356 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v37) v1 ==== 107+0+5017 (secure 0 0 0) 0x7f38e8059ec0 con 0x7f38f80fe6e0 2024-02-19T19:14:01.661 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:14:01.661 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44355,"name":"cephfs.smithi142.maazlq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6825/315214117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":315214117},{"type":"v1","addr":"172.21.15.142:6825","nonce":315214117}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44359,"name":"cephfs.smithi142.eqnctx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2993903126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2993903126},{"type":"v1","addr":"172.21.15.142:6827","nonce":2993903126}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-19T18:59:19.247749+0000","modified":"2024-02-19T19:11:58.276905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34412,"mds_1":34444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi046.hrbbel","rank":0,"incarnation":31,"state":"up:active","state_seq":22,"addr":"172.21.15.46:6827/1638882103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1638882103},{"type":"v1","addr":"172.21.15.46:6827","nonce":1638882103}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi046.bwvkwa","rank":1,"incarnation":31,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6829/3321378222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3321378222},{"type":"v1","addr":"172.21.15.46:6829","nonce":3321378222}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:14:01.662 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 36 2024-02-19T19:14:01.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 -- 172.21.15.46:0/3738813356 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f38e006d810 msgr2=0x7f38e006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:01.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 --2- 172.21.15.46:0/3738813356 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f38e006d810 0x7f38e006fcc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38ec036040 tx=0x7f38ec005fd0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 -- 172.21.15.46:0/3738813356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38f80fe6e0 msgr2=0x7f38f8195460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 --2- 172.21.15.46:0/3738813356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38f80fe6e0 0x7f38f8195460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f38e800ba50 tx=0x7f38e800bf10 comp rx=0 tx=0).stop 2024-02-19T19:14:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 -- 172.21.15.46:0/3738813356 shutdown_connections 2024-02-19T19:14:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 --2- 172.21.15.46:0/3738813356 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f38e006d810 0x7f38e006fcc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 --2- 172.21.15.46:0/3738813356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f80feff0 0x7f38f81959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 --2- 172.21.15.46:0/3738813356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38f80fe6e0 0x7f38f8195460 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 -- 172.21.15.46:0/3738813356 >> 172.21.15.46:0/3738813356 conn(0x7f38f8074cf0 msgr2=0x7f38f81042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 -- 172.21.15.46:0/3738813356 shutdown_connections 2024-02-19T19:14:01.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.639+0000 7f38ff6d2640 1 -- 172.21.15.46:0/3738813356 wait complete. 2024-02-19T19:14:01.674 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-19T19:14:01.686 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-19T19:14:01.686 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T19:14:01.686 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T19:14:01.703 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-02-19T19:14:01.703 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T19:14:01.760 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T19:14:01.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.877+0000 7f8b27a21640 1 -- 172.21.15.46:0/3761148708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b200ff850 msgr2=0x7f8b200ffcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.877+0000 7f8b27a21640 1 --2- 172.21.15.46:0/3761148708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b200ff850 0x7f8b200ffcc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009880 tx=0x7f8b1c02bce0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.877+0000 7f8b27a21640 1 -- 172.21.15.46:0/3761148708 shutdown_connections 2024-02-19T19:14:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.877+0000 7f8b27a21640 1 --2- 172.21.15.46:0/3761148708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b200ff850 0x7f8b200ffcc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.877+0000 7f8b27a21640 1 --2- 172.21.15.46:0/3761148708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20105860 0x7f8b20105c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.877+0000 7f8b27a21640 1 -- 172.21.15.46:0/3761148708 >> 172.21.15.46:0/3761148708 conn(0x7f8b200fb350 msgr2=0x7f8b200fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.877+0000 7f8b27a21640 1 -- 172.21.15.46:0/3761148708 shutdown_connections 2024-02-19T19:14:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.877+0000 7f8b27a21640 1 -- 172.21.15.46:0/3761148708 wait complete. 2024-02-19T19:14:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.877+0000 7f8b27a21640 1 Processor -- start 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b27a21640 1 -- start start 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b27a21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b200ff850 0x7f8b20195420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b27a21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b20105860 0x7f8b20195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b27a21640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20195ff0 con 0x7f8b20105860 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b27a21640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b20199dc0 con 0x7f8b200ff850 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b24fbc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b20105860 0x7f8b20195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b24fbc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b20105860 0x7f8b20195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57128/0 (socket says 172.21.15.46:57128) 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b24fbc640 1 -- 172.21.15.46:0/568028926 learned_addr learned my addr 172.21.15.46:0/568028926 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b257bd640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b200ff850 0x7f8b20195420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b24fbc640 1 -- 172.21.15.46:0/568028926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b200ff850 msgr2=0x7f8b20195420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b24fbc640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b200ff850 0x7f8b20195420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b24fbc640 1 -- 172.21.15.46:0/568028926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c009560 con 0x7f8b20105860 2024-02-19T19:14:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b257bd640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b200ff850 0x7f8b20195420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:14:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b24fbc640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b20105860 0x7f8b20195960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009230 tx=0x7f8b1c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b167fc640 1 -- 172.21.15.46:0/568028926 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b1c0035f0 con 0x7f8b20105860 2024-02-19T19:14:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b167fc640 1 -- 172.21.15.46:0/568028926 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b1c003c10 con 0x7f8b20105860 2024-02-19T19:14:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b27a21640 1 -- 172.21.15.46:0/568028926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2019a040 con 0x7f8b20105860 2024-02-19T19:14:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b167fc640 1 -- 172.21.15.46:0/568028926 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b1c005670 con 0x7f8b20105860 2024-02-19T19:14:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.878+0000 7f8b27a21640 1 -- 172.21.15.46:0/568028926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2019a5c0 con 0x7f8b20105860 2024-02-19T19:14:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.879+0000 7f8b27a21640 1 -- 172.21.15.46:0/568028926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2004e000 con 0x7f8b20105860 2024-02-19T19:14:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.880+0000 7f8b167fc640 1 -- 172.21.15.46:0/568028926 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8b1c004dd0 con 0x7f8b20105860 2024-02-19T19:14:01.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.880+0000 7f8b167fc640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b0c06d8d0 0x7f8b0c06fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:01.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.880+0000 7f8b167fc640 1 -- 172.21.15.46:0/568028926 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f8b1c0af980 con 0x7f8b20105860 2024-02-19T19:14:01.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.880+0000 7f8b257bd640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b0c06d8d0 0x7f8b0c06fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:01.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.881+0000 7f8b257bd640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b0c06d8d0 0x7f8b0c06fd80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b20100990 tx=0x7f8b10005e70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:01.885+0000 7f8b167fc640 1 -- 172.21.15.46:0/568028926 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8b1c0790a0 con 0x7f8b20105860 2024-02-19T19:14:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:01 smithi142 ceph-mon[69118]: pgmap v329: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:01 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/623810528' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-19T19:14:01.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:01 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2336710464' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-19T19:14:01.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:01 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1068589676' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-19T19:14:02.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.069+0000 7f8b27a21640 1 -- 172.21.15.46:0/568028926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b20066860 con 0x7f8b20105860 2024-02-19T19:14:02.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.070+0000 7f8b167fc640 1 -- 172.21.15.46:0/568028926 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17233 (secure 0 0 0) 0x7f8b1c07c760 con 0x7f8b20105860 2024-02-19T19:14:02.094 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:14:02.094 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":119,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","created":"2024-02-19T18:51:43.710287+0000","modified":"2024-02-19T19:11:31.350224+0000","last_up_change":"2024-02-19T19:10:34.693287+0000","last_in_change":"2024-02-19T18:57:44.164228+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:56:48.450849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-19T18:59:17.631025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.059999942779541,"score_stable":2.059999942779541,"optimal_score":1,"raw_score_acting":2.059999942779541,"raw_score_stable":2.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-19T18:59:18.491487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ea35c0-be56-4830-9abc-c67aa3feed47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":113,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6803","nonce":389415197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6805","nonce":389415197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6809","nonce":389415197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6807","nonce":389415197}]},"public_addr":"172.21.15.46:6803/389415197","cluster_addr":"172.21.15.46:6805/389415197","heartbeat_back_addr":"172.21.15.46:6809/389415197","heartbeat_front_addr":"172.21.15.46:6807/389415197","state":["exists","up"]},{"osd":1,"uuid":"0dcb0202-8fa1-4a72-939d-dd8a5ced3a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":64,"up_thru":113,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6811","nonce":2409899830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6813","nonce":2409899830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6817","nonce":2409899830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6815","nonce":2409899830}]},"public_addr":"172.21.15.46:6811/2409899830","cluster_addr":"172.21.15.46:6813/2409899830","heartbeat_back_addr":"172.21.15.46:6817/2409899830","heartbeat_front_addr":"172.21.15.46:6815/2409899830","state":["exists","up"]},{"osd":2,"uuid":"a5ae09b3-9419-4fc7-8cd5-4a2553bca213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":73,"up_from":77,"up_thru":113,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6819","nonce":3010717446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6821","nonce":3010717446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6825","nonce":3010717446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6823","nonce":3010717446}]},"public_addr":"172.21.15.46:6819/3010717446","cluster_addr":"172.21.15.46:6821/3010717446","heartbeat_back_addr":"172.21.15.46:6825/3010717446","heartbeat_front_addr":"172.21.15.46:6823/3010717446","state":["exists","up"]},{"osd":3,"uuid":"3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":95,"up_from":99,"up_thru":113,"down_at":96,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6801","nonce":3729925777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6803","nonce":3729925777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6807","nonce":3729925777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6805","nonce":3729925777}]},"public_addr":"172.21.15.142:6801/3729925777","cluster_addr":"172.21.15.142:6803/3729925777","heartbeat_back_addr":"172.21.15.142:6807/3729925777","heartbeat_front_addr":"172.21.15.142:6805/3729925777","state":["exists","up"]},{"osd":4,"uuid":"0a0ce92a-f9ac-4f83-877f-93eff87a9f8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":104,"up_from":108,"up_thru":113,"down_at":105,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6809","nonce":1150732284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6811","nonce":1150732284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6815","nonce":1150732284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6813","nonce":1150732284}]},"public_addr":"172.21.15.142:6809/1150732284","cluster_addr":"172.21.15.142:6811/1150732284","heartbeat_back_addr":"172.21.15.142:6815/1150732284","heartbeat_front_addr":"172.21.15.142:6813/1150732284","state":["exists","up"]},{"osd":5,"uuid":"0eed1f5c-a999-43d8-95ae-1671ac54640b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":109,"up_from":113,"up_thru":113,"down_at":110,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6817","nonce":1673341131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6819","nonce":1673341131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6823","nonce":1673341131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6821","nonce":1673341131}]},"public_addr":"172.21.15.142:6817/1673341131","cluster_addr":"172.21.15.142:6819/1673341131","heartbeat_back_addr":"172.21.15.142:6823/1673341131","heartbeat_front_addr":"172.21.15.142:6821/1673341131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:55:49.856210+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:17.120054+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:46.102265+0000","dead_epoch":73},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:10.285252+0000","dead_epoch":95},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:35.715008+0000","dead_epoch":104},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:01.554947+0000","dead_epoch":109}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1","mappings":[{"from":0,"to":5}]},{"pgid":"2.7","mappings":[{"from":3,"to":1}]},{"pgid":"2.13","mappings":[{"from":0,"to":1}]},{"pgid":"2.1a","mappings":[{"from":3,"to":1}]},{"pgid":"2.1f","mappings":[{"from":0,"to":1},{"from":3,"to":2}]},{"pgid":"3.4","mappings":[{"from":3,"to":0}]},{"pgid":"3.9","mappings":[{"from":4,"to":1}]},{"pgid":"3.11","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6825/445093561":"2024-02-20T19:10:34.708948+0000","172.21.15.46:6829/2235495765":"2024-02-20T19:10:34.708919+0000","172.21.15.46:6801/1269498854":"2024-02-20T19:05:27.636848+0000","172.21.15.46:0/2954390908":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/1307799669":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6828/2235495765":"2024-02-20T19:10:34.708919+0000","172.21.15.46:6800/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6800/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/4057722486":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6801/1654096494":"2024-02-20T19:01:39.789970+0000","172.21.15.142:0/2865604743":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/3901080352":"2024-02-20T18:54:32.109212+0000","172.21.15.142:6829/3077186414":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/2407750441":"2024-02-20T18:52:11.766897+0000","172.21.15.142:6824/445093561":"2024-02-20T19:10:34.708948+0000","172.21.15.142:0/2657910934":"2024-02-20T19:02:24.351804+0000","172.21.15.46:6801/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/4120601315":"2024-02-20T19:05:27.636848+0000","172.21.15.142:6828/3077186414":"2024-02-20T19:02:24.351804+0000","172.21.15.142:0/4181796919":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/1304412033":"2024-02-20T19:01:39.789970+0000","172.21.15.142:0/2842979640":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/3708201410":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/3268130132":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/2139900052":"2024-02-20T19:01:39.789970+0000","172.21.15.142:0/3200406684":"2024-02-20T19:02:24.351804+0000","172.21.15.46:6800/1269498854":"2024-02-20T19:05:27.636848+0000","172.21.15.46:6800/1654096494":"2024-02-20T19:01:39.789970+0000","172.21.15.46:0/2827852709":"2024-02-20T19:01:39.789970+0000","172.21.15.46:6827/908936119":"2024-02-20T18:59:34.073482+0000","172.21.15.46:0/2538440870":"2024-02-20T19:01:39.789970+0000","172.21.15.46:6826/908936119":"2024-02-20T18:59:34.073482+0000","172.21.15.46:0/664839364":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6801/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/3870899516":"2024-02-20T19:05:27.636848+0000","172.21.15.142:0/1985647318":"2024-02-20T19:02:24.351804+0000","172.21.15.46:6800/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6801/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/1953665533":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/1046986291":"2024-02-20T19:05:27.636848+0000","172.21.15.46:0/2413107873":"2024-02-20T19:05:27.636848+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T19:14:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 -- 172.21.15.46:0/568028926 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b0c06d8d0 msgr2=0x7f8b0c06fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b0c06d8d0 0x7f8b0c06fd80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b20100990 tx=0x7f8b10005e70 comp rx=0 tx=0).stop 2024-02-19T19:14:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 -- 172.21.15.46:0/568028926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b20105860 msgr2=0x7f8b20195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b20105860 0x7f8b20195960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009230 tx=0x7f8b1c004040 comp rx=0 tx=0).stop 2024-02-19T19:14:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 -- 172.21.15.46:0/568028926 shutdown_connections 2024-02-19T19:14:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f8b0c06d8d0 0x7f8b0c06fd80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b20105860 0x7f8b20195960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 --2- 172.21.15.46:0/568028926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b200ff850 0x7f8b20195420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 -- 172.21.15.46:0/568028926 >> 172.21.15.46:0/568028926 conn(0x7f8b200fb350 msgr2=0x7f8b200fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 -- 172.21.15.46:0/568028926 shutdown_connections 2024-02-19T19:14:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.072+0000 7f8b27a21640 1 -- 172.21.15.46:0/568028926 wait complete. 2024-02-19T19:14:02.107 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T18:56:48.450849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-19T18:59:17.631025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 1, 'raw_score_acting': 2.059999942779541, 'raw_score_stable': 2.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-19T18:59:18.491487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T19:14:02.107 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T19:14:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 -- 172.21.15.46:0/2928987862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d40fe6f0 msgr2=0x7f50d40feac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 --2- 172.21.15.46:0/2928987862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d40fe6f0 0x7f50d40feac0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f50d00098b0 tx=0x7f50d002bd30 comp rx=0 tx=0).stop 2024-02-19T19:14:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 -- 172.21.15.46:0/2928987862 shutdown_connections 2024-02-19T19:14:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 --2- 172.21.15.46:0/2928987862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d40ff000 0x7f50d4109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 --2- 172.21.15.46:0/2928987862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d40fe6f0 0x7f50d40feac0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 -- 172.21.15.46:0/2928987862 >> 172.21.15.46:0/2928987862 conn(0x7f50d4073d20 msgr2=0x7f50d4074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 -- 172.21.15.46:0/2928987862 shutdown_connections 2024-02-19T19:14:02.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 -- 172.21.15.46:0/2928987862 wait complete. 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 Processor -- start 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 -- start start 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d40fe6f0 0x7f50d4197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d40ff000 0x7f50d4197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d41980e0 con 0x7f50d40fe6f0 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.189+0000 7f50dc615640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d419beb0 con 0x7f50d40ff000 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50da3b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d40fe6f0 0x7f50d4197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50da3b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d40fe6f0 0x7f50d4197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57148/0 (socket says 172.21.15.46:57148) 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50da3b1640 1 -- 172.21.15.46:0/3518049786 learned_addr learned my addr 172.21.15.46:0/3518049786 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50d9bb0640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d40ff000 0x7f50d4197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:02.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50da3b1640 1 -- 172.21.15.46:0/3518049786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d40ff000 msgr2=0x7f50d4197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50da3b1640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d40ff000 0x7f50d4197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50da3b1640 1 -- 172.21.15.46:0/3518049786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0009560 con 0x7f50d40fe6f0 2024-02-19T19:14:02.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50d9bb0640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d40ff000 0x7f50d4197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:14:02.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50da3b1640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d40fe6f0 0x7f50d4197510 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009880 tx=0x7f50d0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:02.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50cb7fe640 1 -- 172.21.15.46:0/3518049786 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50d00035f0 con 0x7f50d40fe6f0 2024-02-19T19:14:02.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50cb7fe640 1 -- 172.21.15.46:0/3518049786 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50d0003c10 con 0x7f50d40fe6f0 2024-02-19T19:14:02.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50dc615640 1 -- 172.21.15.46:0/3518049786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d419c130 con 0x7f50d40fe6f0 2024-02-19T19:14:02.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50cb7fe640 1 -- 172.21.15.46:0/3518049786 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50d0034440 con 0x7f50d40fe6f0 2024-02-19T19:14:02.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.190+0000 7f50dc615640 1 -- 172.21.15.46:0/3518049786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d419c710 con 0x7f50d40fe6f0 2024-02-19T19:14:02.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.191+0000 7f50dc615640 1 -- 172.21.15.46:0/3518049786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d404e000 con 0x7f50d40fe6f0 2024-02-19T19:14:02.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.192+0000 7f50cb7fe640 1 -- 172.21.15.46:0/3518049786 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f50d0004f60 con 0x7f50d40fe6f0 2024-02-19T19:14:02.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.192+0000 7f50cb7fe640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f50c006d810 0x7f50c006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:02.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.192+0000 7f50cb7fe640 1 -- 172.21.15.46:0/3518049786 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f50d00afb90 con 0x7f50d40fe6f0 2024-02-19T19:14:02.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.192+0000 7f50d9bb0640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f50c006d810 0x7f50c006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:02.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.192+0000 7f50d9bb0640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f50c006d810 0x7f50c006fcc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006fd0 tx=0x7f50c4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:02.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.197+0000 7f50cb7fe640 1 -- 172.21.15.46:0/3518049786 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f50d0079230 con 0x7f50d40fe6f0 2024-02-19T19:14:02.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.379+0000 7f50dc615640 1 -- 172.21.15.46:0/3518049786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50d410c810 con 0x7f50d40fe6f0 2024-02-19T19:14:02.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.379+0000 7f50cb7fe640 1 -- 172.21.15.46:0/3518049786 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50d007c8f0 con 0x7f50d40fe6f0 2024-02-19T19:14:02.403 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T19:14:02.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 -- 172.21.15.46:0/3518049786 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f50c006d810 msgr2=0x7f50c006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f50c006d810 0x7f50c006fcc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006fd0 tx=0x7f50c4008040 comp rx=0 tx=0).stop 2024-02-19T19:14:02.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 -- 172.21.15.46:0/3518049786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d40fe6f0 msgr2=0x7f50d4197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d40fe6f0 0x7f50d4197510 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009880 tx=0x7f50d0004040 comp rx=0 tx=0).stop 2024-02-19T19:14:02.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 -- 172.21.15.46:0/3518049786 shutdown_connections 2024-02-19T19:14:02.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f50c006d810 0x7f50c006fcc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50d40ff000 0x7f50d4197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 --2- 172.21.15.46:0/3518049786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d40fe6f0 0x7f50d4197510 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 -- 172.21.15.46:0/3518049786 >> 172.21.15.46:0/3518049786 conn(0x7f50d4073d20 msgr2=0x7f50d4100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:02.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 -- 172.21.15.46:0/3518049786 shutdown_connections 2024-02-19T19:14:02.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.382+0000 7f50dc615640 1 -- 172.21.15.46:0/3518049786 wait complete. 2024-02-19T19:14:02.416 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-19T19:14:02.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.497+0000 7fbf27711640 1 -- 172.21.15.46:0/3934002532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf201008a0 msgr2=0x7fbf20100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.497+0000 7fbf27711640 1 --2- 172.21.15.46:0/3934002532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf201008a0 0x7fbf20100c70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009880 tx=0x7fbf1c02bd70 comp rx=0 tx=0).stop 2024-02-19T19:14:02.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.497+0000 7fbf27711640 1 -- 172.21.15.46:0/3934002532 shutdown_connections 2024-02-19T19:14:02.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.497+0000 7fbf27711640 1 --2- 172.21.15.46:0/3934002532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf201011b0 0x7fbf201096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.497+0000 7fbf27711640 1 --2- 172.21.15.46:0/3934002532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf201008a0 0x7fbf20100c70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.497+0000 7fbf27711640 1 -- 172.21.15.46:0/3934002532 >> 172.21.15.46:0/3934002532 conn(0x7fbf200fa090 msgr2=0x7fbf200fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:02.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.497+0000 7fbf27711640 1 -- 172.21.15.46:0/3934002532 shutdown_connections 2024-02-19T19:14:02.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.497+0000 7fbf27711640 1 -- 172.21.15.46:0/3934002532 wait complete. 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf27711640 1 Processor -- start 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf27711640 1 -- start start 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf27711640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf201008a0 0x7fbf20195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf27711640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf201011b0 0x7fbf20195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf27711640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf20195ee0 con 0x7fbf201008a0 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf27711640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf20199cb0 con 0x7fbf201011b0 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf254ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf201008a0 0x7fbf20195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf254ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf201008a0 0x7fbf20195310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57172/0 (socket says 172.21.15.46:57172) 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf254ad640 1 -- 172.21.15.46:0/802851123 learned_addr learned my addr 172.21.15.46:0/802851123 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf24cac640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf201011b0 0x7fbf20195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf254ad640 1 -- 172.21.15.46:0/802851123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf201011b0 msgr2=0x7fbf20195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf254ad640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf201011b0 0x7fbf20195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf254ad640 1 -- 172.21.15.46:0/802851123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c009560 con 0x7fbf201008a0 2024-02-19T19:14:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf24cac640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf201011b0 0x7fbf20195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:14:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.498+0000 7fbf254ad640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf201008a0 0x7fbf20195310 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009230 tx=0x7fbf1c02c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.499+0000 7fbf167fc640 1 -- 172.21.15.46:0/802851123 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf1c0044a0 con 0x7fbf201008a0 2024-02-19T19:14:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.499+0000 7fbf167fc640 1 -- 172.21.15.46:0/802851123 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf1c003ab0 con 0x7fbf201008a0 2024-02-19T19:14:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.499+0000 7fbf27711640 1 -- 172.21.15.46:0/802851123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf20199f30 con 0x7fbf201008a0 2024-02-19T19:14:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.499+0000 7fbf167fc640 1 -- 172.21.15.46:0/802851123 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf1c005600 con 0x7fbf201008a0 2024-02-19T19:14:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.499+0000 7fbf27711640 1 -- 172.21.15.46:0/802851123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2019a490 con 0x7fbf201008a0 2024-02-19T19:14:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.500+0000 7fbf27711640 1 -- 172.21.15.46:0/802851123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2004e000 con 0x7fbf201008a0 2024-02-19T19:14:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.500+0000 7fbf167fc640 1 -- 172.21.15.46:0/802851123 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fbf1c004dd0 con 0x7fbf201008a0 2024-02-19T19:14:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.500+0000 7fbf167fc640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbf0c06d810 0x7fbf0c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.501+0000 7fbf24cac640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbf0c06d810 0x7fbf0c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.501+0000 7fbf167fc640 1 -- 172.21.15.46:0/802851123 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fbf1c0b0110 con 0x7fbf201008a0 2024-02-19T19:14:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.501+0000 7fbf24cac640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbf0c06d810 0x7fbf0c06fcc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf20196920 tx=0x7fbf10005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:02.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.505+0000 7fbf167fc640 1 -- 172.21.15.46:0/802851123 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbf1c0798d0 con 0x7fbf201008a0 2024-02-19T19:14:02.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.688+0000 7fbf27711640 1 -- 172.21.15.46:0/802851123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fbf20106c50 con 0x7fbf201008a0 2024-02-19T19:14:02.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.689+0000 7fbf167fc640 1 -- 172.21.15.46:0/802851123 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v119) v1 ==== 107+0+11 (secure 0 0 0) 0x7fbf1c07cf90 con 0x7fbf201008a0 2024-02-19T19:14:02.713 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T19:14:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 -- 172.21.15.46:0/802851123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbf0c06d810 msgr2=0x7fbf0c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbf0c06d810 0x7fbf0c06fcc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf20196920 tx=0x7fbf10005f90 comp rx=0 tx=0).stop 2024-02-19T19:14:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 -- 172.21.15.46:0/802851123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf201008a0 msgr2=0x7fbf20195310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf201008a0 0x7fbf20195310 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009230 tx=0x7fbf1c02c780 comp rx=0 tx=0).stop 2024-02-19T19:14:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 -- 172.21.15.46:0/802851123 shutdown_connections 2024-02-19T19:14:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fbf0c06d810 0x7fbf0c06fcc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf201011b0 0x7fbf20195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 --2- 172.21.15.46:0/802851123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf201008a0 0x7fbf20195310 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 -- 172.21.15.46:0/802851123 >> 172.21.15.46:0/802851123 conn(0x7fbf200fa090 msgr2=0x7fbf20103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 -- 172.21.15.46:0/802851123 shutdown_connections 2024-02-19T19:14:02.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.691+0000 7fbf27711640 1 -- 172.21.15.46:0/802851123 wait complete. 2024-02-19T19:14:02.724 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:02 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3738813356' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-19T19:14:02.724 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:02 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/568028926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:14:02.725 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:02 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3518049786' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:14:02.726 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-19T19:14:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.808+0000 7fd50b8d2640 1 -- 172.21.15.46:0/3127692415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504105690 msgr2=0x7fd504105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.808+0000 7fd50b8d2640 1 --2- 172.21.15.46:0/3127692415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504105690 0x7fd504105a60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009880 tx=0x7fd4fc02bce0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.808+0000 7fd50b8d2640 1 -- 172.21.15.46:0/3127692415 shutdown_connections 2024-02-19T19:14:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.808+0000 7fd50b8d2640 1 --2- 172.21.15.46:0/3127692415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd504067350 0x7fd5040677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.808+0000 7fd50b8d2640 1 --2- 172.21.15.46:0/3127692415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504105690 0x7fd504105a60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.808+0000 7fd50b8d2640 1 -- 172.21.15.46:0/3127692415 >> 172.21.15.46:0/3127692415 conn(0x7fd5040743d0 msgr2=0x7fd5040747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd50b8d2640 1 -- 172.21.15.46:0/3127692415 shutdown_connections 2024-02-19T19:14:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd50b8d2640 1 -- 172.21.15.46:0/3127692415 wait complete. 2024-02-19T19:14:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd50b8d2640 1 Processor -- start 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd50b8d2640 1 -- start start 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd50b8d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd504067350 0x7fd5041953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd50b8d2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504105690 0x7fd504195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd50b8d2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd504195fa0 con 0x7fd504105690 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd50b8d2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd504199d70 con 0x7fd504067350 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd508e6d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504105690 0x7fd504195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd508e6d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504105690 0x7fd504195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57196/0 (socket says 172.21.15.46:57196) 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.809+0000 7fd508e6d640 1 -- 172.21.15.46:0/1350674324 learned_addr learned my addr 172.21.15.46:0/1350674324 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.810+0000 7fd508e6d640 1 -- 172.21.15.46:0/1350674324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd504067350 msgr2=0x7fd5041953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.810+0000 7fd508e6d640 1 --2- 172.21.15.46:0/1350674324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd504067350 0x7fd5041953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.810+0000 7fd508e6d640 1 -- 172.21.15.46:0/1350674324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc009560 con 0x7fd504105690 2024-02-19T19:14:02.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.810+0000 7fd508e6d640 1 --2- 172.21.15.46:0/1350674324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504105690 0x7fd504195910 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400b420 tx=0x7fd4f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.810+0000 7fd4fa7fc640 1 -- 172.21.15.46:0/1350674324 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4f4011800 con 0x7fd504105690 2024-02-19T19:14:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.810+0000 7fd4fa7fc640 1 -- 172.21.15.46:0/1350674324 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4f4011e20 con 0x7fd504105690 2024-02-19T19:14:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.810+0000 7fd50b8d2640 1 -- 172.21.15.46:0/1350674324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50419a050 con 0x7fd504105690 2024-02-19T19:14:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.810+0000 7fd4fa7fc640 1 -- 172.21.15.46:0/1350674324 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4f400f2e0 con 0x7fd504105690 2024-02-19T19:14:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.810+0000 7fd50b8d2640 1 -- 172.21.15.46:0/1350674324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50419a630 con 0x7fd504105690 2024-02-19T19:14:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.811+0000 7fd50b8d2640 1 -- 172.21.15.46:0/1350674324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50404e000 con 0x7fd504105690 2024-02-19T19:14:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.811+0000 7fd4fa7fc640 1 -- 172.21.15.46:0/1350674324 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd4f4010380 con 0x7fd504105690 2024-02-19T19:14:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.812+0000 7fd4fa7fc640 1 --2- 172.21.15.46:0/1350674324 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd4f006d810 0x7fd4f006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.812+0000 7fd4fa7fc640 1 -- 172.21.15.46:0/1350674324 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fd4f408cfd0 con 0x7fd504105690 2024-02-19T19:14:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.812+0000 7fd50966e640 1 --2- 172.21.15.46:0/1350674324 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd4f006d810 0x7fd4f006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.812+0000 7fd50966e640 1 --2- 172.21.15.46:0/1350674324 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd4f006d810 0x7fd4f006fcc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc036040 tx=0x7fd4fc000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:02.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.816+0000 7fd4fa7fc640 1 -- 172.21.15.46:0/1350674324 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd4f4056670 con 0x7fd504105690 2024-02-19T19:14:02.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:02 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3738813356' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-19T19:14:02.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:02 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/568028926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:14:02.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:02 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3518049786' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:14:03.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.996+0000 7fd50b8d2640 1 -- 172.21.15.46:0/1350674324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd504107aa0 con 0x7fd504105690 2024-02-19T19:14:03.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.997+0000 7fd4fa7fc640 1 -- 172.21.15.46:0/1350674324 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v119) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd4f4059d30 con 0x7fd504105690 2024-02-19T19:14:03.020 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T19:14:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.998+0000 7fd50b8d2640 1 -- 172.21.15.46:0/1350674324 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd4f006d810 msgr2=0x7fd4f006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.998+0000 7fd50b8d2640 1 --2- 172.21.15.46:0/1350674324 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd4f006d810 0x7fd4f006fcc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc036040 tx=0x7fd4fc000bc0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.998+0000 7fd50b8d2640 1 -- 172.21.15.46:0/1350674324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504105690 msgr2=0x7fd504195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.998+0000 7fd50b8d2640 1 --2- 172.21.15.46:0/1350674324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504105690 0x7fd504195910 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400b420 tx=0x7fd4f400b8e0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.998+0000 7fd50b8d2640 1 -- 172.21.15.46:0/1350674324 shutdown_connections 2024-02-19T19:14:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.998+0000 7fd50b8d2640 1 --2- 172.21.15.46:0/1350674324 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fd4f006d810 0x7fd4f006fcc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.998+0000 7fd50b8d2640 1 --2- 172.21.15.46:0/1350674324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504105690 0x7fd504195910 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.998+0000 7fd50b8d2640 1 --2- 172.21.15.46:0/1350674324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd504067350 0x7fd5041953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.998+0000 7fd50b8d2640 1 -- 172.21.15.46:0/1350674324 >> 172.21.15.46:0/1350674324 conn(0x7fd5040743d0 msgr2=0x7fd5040fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:03.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.999+0000 7fd50b8d2640 1 -- 172.21.15.46:0/1350674324 shutdown_connections 2024-02-19T19:14:03.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:02.999+0000 7fd50b8d2640 1 -- 172.21.15.46:0/1350674324 wait complete. 2024-02-19T19:14:03.032 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T19:14:03.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 -- 172.21.15.46:0/2634143780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7000fe5a0 msgr2=0x7ff7000fea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 --2- 172.21.15.46:0/2634143780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7000fe5a0 0x7ff7000fea10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009880 tx=0x7ff6f402bce0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 -- 172.21.15.46:0/2634143780 shutdown_connections 2024-02-19T19:14:03.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 --2- 172.21.15.46:0/2634143780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7000fe5a0 0x7ff7000fea10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 --2- 172.21.15.46:0/2634143780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7001045d0 0x7ff7001049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 -- 172.21.15.46:0/2634143780 >> 172.21.15.46:0/2634143780 conn(0x7ff700075270 msgr2=0x7ff700075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:03.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 -- 172.21.15.46:0/2634143780 shutdown_connections 2024-02-19T19:14:03.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 -- 172.21.15.46:0/2634143780 wait complete. 2024-02-19T19:14:03.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 Processor -- start 2024-02-19T19:14:03.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 -- start start 2024-02-19T19:14:03.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7000fe5a0 0x7ff700195170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:03.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7001045d0 0x7ff7001956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:03.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff700195cb0 con 0x7ff7001045d0 2024-02-19T19:14:03.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.113+0000 7ff70781a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff700195e20 con 0x7ff7000fe5a0 2024-02-19T19:14:03.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff704db5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7001045d0 0x7ff7001956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:03.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff704db5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7001045d0 0x7ff7001956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57206/0 (socket says 172.21.15.46:57206) 2024-02-19T19:14:03.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff704db5640 1 -- 172.21.15.46:0/560198803 learned_addr learned my addr 172.21.15.46:0/560198803 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:03.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff7055b6640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7000fe5a0 0x7ff700195170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff704db5640 1 -- 172.21.15.46:0/560198803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7000fe5a0 msgr2=0x7ff700195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff704db5640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7000fe5a0 0x7ff700195170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff704db5640 1 -- 172.21.15.46:0/560198803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4009560 con 0x7ff7001045d0 2024-02-19T19:14:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff7055b6640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7000fe5a0 0x7ff700195170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:14:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff704db5640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7001045d0 0x7ff7001956b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009230 tx=0x7ff6f4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff6fe7fc640 1 -- 172.21.15.46:0/560198803 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f40035f0 con 0x7ff7001045d0 2024-02-19T19:14:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff6fe7fc640 1 -- 172.21.15.46:0/560198803 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6f4003c10 con 0x7ff7001045d0 2024-02-19T19:14:03.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff70781a640 1 -- 172.21.15.46:0/560198803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff700199c50 con 0x7ff7001045d0 2024-02-19T19:14:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff6fe7fc640 1 -- 172.21.15.46:0/560198803 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f4034440 con 0x7ff7001045d0 2024-02-19T19:14:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.114+0000 7ff70781a640 1 -- 172.21.15.46:0/560198803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70019a1d0 con 0x7ff7001045d0 2024-02-19T19:14:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.115+0000 7ff70781a640 1 -- 172.21.15.46:0/560198803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70004e000 con 0x7ff7001045d0 2024-02-19T19:14:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.116+0000 7ff6fe7fc640 1 -- 172.21.15.46:0/560198803 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff6f4004fd0 con 0x7ff7001045d0 2024-02-19T19:14:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.116+0000 7ff6fe7fc640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff6e806d8d0 0x7ff6e806fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.116+0000 7ff7055b6640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff6e806d8d0 0x7ff6e806fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.116+0000 7ff6fe7fc640 1 -- 172.21.15.46:0/560198803 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7ff6f40afad0 con 0x7ff7001045d0 2024-02-19T19:14:03.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.117+0000 7ff7055b6640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff6e806d8d0 0x7ff6e806fd80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800abe0 tx=0x7ff6f800a5c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:03.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.121+0000 7ff6fe7fc640 1 -- 172.21.15.46:0/560198803 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff6f4079170 con 0x7ff7001045d0 2024-02-19T19:14:03.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.314+0000 7ff70781a640 1 -- 172.21.15.46:0/560198803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff70010b9b0 con 0x7ff7001045d0 2024-02-19T19:14:03.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.314+0000 7ff6fe7fc640 1 -- 172.21.15.46:0/560198803 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v119) v1 ==== 81+0+2437 (secure 0 0 0) 0x7ff6f407c830 con 0x7ff7001045d0 2024-02-19T19:14:03.337 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:6825/445093561 2024-02-20T19:10:34.708948+0000 2024-02-19T19:14:03.337 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6829/2235495765 2024-02-20T19:10:34.708919+0000 2024-02-19T19:14:03.338 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1269498854 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:03.338 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2954390908 2024-02-20T18:52:11.766897+0000 2024-02-19T19:14:03.338 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1307799669 2024-02-20T18:54:32.109212+0000 2024-02-19T19:14:03.338 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6828/2235495765 2024-02-20T19:10:34.708919+0000 2024-02-19T19:14:03.338 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1408120197 2024-02-20T18:52:44.819852+0000 2024-02-19T19:14:03.338 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/3840592341 2024-02-20T18:52:11.766897+0000 2024-02-19T19:14:03.338 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4057722486 2024-02-20T18:52:44.819852+0000 2024-02-19T19:14:03.338 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1654096494 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:03.338 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/2865604743 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3901080352 2024-02-20T18:54:32.109212+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:6829/3077186414 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2407750441 2024-02-20T18:52:11.766897+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:6824/445093561 2024-02-20T19:10:34.708948+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/2657910934 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1408120197 2024-02-20T18:52:44.819852+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4120601315 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:6828/3077186414 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/4181796919 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1304412033 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:03.339 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/2842979640 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3708201410 2024-02-20T18:52:44.819852+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3268130132 2024-02-20T18:52:44.819852+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2139900052 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/3200406684 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1269498854 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1654096494 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2827852709 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6827/908936119 2024-02-20T18:59:34.073482+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2538440870 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6826/908936119 2024-02-20T18:59:34.073482+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/664839364 2024-02-20T18:54:32.109212+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/3840592341 2024-02-20T18:52:11.766897+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3870899516 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:03.340 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/1985647318 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:03.341 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/3727775990 2024-02-20T18:54:32.109212+0000 2024-02-19T19:14:03.341 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/3727775990 2024-02-20T18:54:32.109212+0000 2024-02-19T19:14:03.341 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1953665533 2024-02-20T18:52:11.766897+0000 2024-02-19T19:14:03.341 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1046986291 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:03.341 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2413107873 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:listed 41 entries 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 -- 172.21.15.46:0/560198803 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff6e806d8d0 msgr2=0x7ff6e806fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff6e806d8d0 0x7ff6e806fd80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800abe0 tx=0x7ff6f800a5c0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 -- 172.21.15.46:0/560198803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7001045d0 msgr2=0x7ff7001956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7001045d0 0x7ff7001956b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009230 tx=0x7ff6f4004040 comp rx=0 tx=0).stop 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 -- 172.21.15.46:0/560198803 shutdown_connections 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7ff6e806d8d0 0x7ff6e806fd80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff7001045d0 0x7ff7001956b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 --2- 172.21.15.46:0/560198803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7000fe5a0 0x7ff700195170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 -- 172.21.15.46:0/560198803 >> 172.21.15.46:0/560198803 conn(0x7ff700075270 msgr2=0x7ff7000fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:03.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 -- 172.21.15.46:0/560198803 shutdown_connections 2024-02-19T19:14:03.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.316+0000 7ff70781a640 1 -- 172.21.15.46:0/560198803 wait complete. 2024-02-19T19:14:03.350 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-19T19:14:03.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:14:03.350 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-19T19:14:03.377 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T19:14:03.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:14:03.378 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-19T19:14:03.447 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T19:14:03.447 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T19:14:03.468 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-02-19T19:14:03.468 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T19:14:03.528 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T19:14:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.609+0000 7f9cf444a640 1 -- 172.21.15.46:0/1463356888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cec1045e0 msgr2=0x7f9cec1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.609+0000 7f9cf444a640 1 --2- 172.21.15.46:0/1463356888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cec1045e0 0x7f9cec1049b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009880 tx=0x7f9ce402bce0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.609+0000 7f9cf444a640 1 -- 172.21.15.46:0/1463356888 shutdown_connections 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.609+0000 7f9cf444a640 1 --2- 172.21.15.46:0/1463356888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cec0fe5b0 0x7f9cec0fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.609+0000 7f9cf444a640 1 --2- 172.21.15.46:0/1463356888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cec1045e0 0x7f9cec1049b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.609+0000 7f9cf444a640 1 -- 172.21.15.46:0/1463356888 >> 172.21.15.46:0/1463356888 conn(0x7f9cec0fa070 msgr2=0x7f9cec0fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.609+0000 7f9cf444a640 1 -- 172.21.15.46:0/1463356888 shutdown_connections 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.609+0000 7f9cf444a640 1 -- 172.21.15.46:0/1463356888 wait complete. 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.609+0000 7f9cf444a640 1 Processor -- start 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf444a640 1 -- start start 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf444a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cec0fe5b0 0x7f9cec197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf444a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cec1045e0 0x7f9cec197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf444a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec198160 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf444a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec19bf30 con 0x7f9cec1045e0 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf21e6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cec0fe5b0 0x7f9cec197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf21e6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cec0fe5b0 0x7f9cec197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57238/0 (socket says 172.21.15.46:57238) 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf21e6640 1 -- 172.21.15.46:0/2944684773 learned_addr learned my addr 172.21.15.46:0/2944684773 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf19e5640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cec1045e0 0x7f9cec197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf21e6640 1 -- 172.21.15.46:0/2944684773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cec1045e0 msgr2=0x7f9cec197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf21e6640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cec1045e0 0x7f9cec197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf21e6640 1 -- 172.21.15.46:0/2944684773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4009560 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf19e5640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cec1045e0 0x7f9cec197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf21e6640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cec0fe5b0 0x7f9cec197590 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009230 tx=0x7f9ce4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9ceb7fe640 1 -- 172.21.15.46:0/2944684773 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce40035f0 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9ceb7fe640 1 -- 172.21.15.46:0/2944684773 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ce4003c10 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf444a640 1 -- 172.21.15.46:0/2944684773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec19c1b0 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9ceb7fe640 1 -- 172.21.15.46:0/2944684773 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce4034440 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.610+0000 7f9cf444a640 1 -- 172.21.15.46:0/2944684773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec19c6b0 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.611+0000 7f9cf444a640 1 -- 172.21.15.46:0/2944684773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec04e000 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.612+0000 7f9ceb7fe640 1 -- 172.21.15.46:0/2944684773 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9ce4004fd0 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.612+0000 7f9ceb7fe640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9cd406d8d0 0x7f9cd406fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:03.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.612+0000 7f9cf19e5640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9cd406d8d0 0x7f9cd406fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:03.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.612+0000 7f9ceb7fe640 1 -- 172.21.15.46:0/2944684773 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f9ce40afad0 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.613+0000 7f9cf19e5640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9cd406d8d0 0x7f9cd406fd80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0006fd0 tx=0x7f9ce0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:03.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.617+0000 7f9ceb7fe640 1 -- 172.21.15.46:0/2944684773 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ce4079170 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.799+0000 7f9cf444a640 1 -- 172.21.15.46:0/2944684773 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cec1069f0 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.801+0000 7f9ceb7fe640 1 -- 172.21.15.46:0/2944684773 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17233 (secure 0 0 0) 0x7f9ce407c830 con 0x7f9cec0fe5b0 2024-02-19T19:14:03.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-02-19T19:14:03.824 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":119,"fsid":"c412ec66-cf57-11ee-95bb-87774f69a715","created":"2024-02-19T18:51:43.710287+0000","modified":"2024-02-19T19:11:31.350224+0000","last_up_change":"2024-02-19T19:10:34.693287+0000","last_in_change":"2024-02-19T18:57:44.164228+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:56:48.450849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-19T18:59:17.631025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.059999942779541,"score_stable":2.059999942779541,"optimal_score":1,"raw_score_acting":2.059999942779541,"raw_score_stable":2.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-19T18:59:18.491487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1ea35c0-be56-4830-9abc-c67aa3feed47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":113,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6803","nonce":389415197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6805","nonce":389415197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6809","nonce":389415197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":389415197},{"type":"v1","addr":"172.21.15.46:6807","nonce":389415197}]},"public_addr":"172.21.15.46:6803/389415197","cluster_addr":"172.21.15.46:6805/389415197","heartbeat_back_addr":"172.21.15.46:6809/389415197","heartbeat_front_addr":"172.21.15.46:6807/389415197","state":["exists","up"]},{"osd":1,"uuid":"0dcb0202-8fa1-4a72-939d-dd8a5ced3a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":64,"up_thru":113,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6811","nonce":2409899830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6813","nonce":2409899830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6817","nonce":2409899830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2409899830},{"type":"v1","addr":"172.21.15.46:6815","nonce":2409899830}]},"public_addr":"172.21.15.46:6811/2409899830","cluster_addr":"172.21.15.46:6813/2409899830","heartbeat_back_addr":"172.21.15.46:6817/2409899830","heartbeat_front_addr":"172.21.15.46:6815/2409899830","state":["exists","up"]},{"osd":2,"uuid":"a5ae09b3-9419-4fc7-8cd5-4a2553bca213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":73,"up_from":77,"up_thru":113,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6819","nonce":3010717446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6821","nonce":3010717446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6825","nonce":3010717446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3010717446},{"type":"v1","addr":"172.21.15.46:6823","nonce":3010717446}]},"public_addr":"172.21.15.46:6819/3010717446","cluster_addr":"172.21.15.46:6821/3010717446","heartbeat_back_addr":"172.21.15.46:6825/3010717446","heartbeat_front_addr":"172.21.15.46:6823/3010717446","state":["exists","up"]},{"osd":3,"uuid":"3d76f2b6-a8f8-4ce3-92f4-8eb2f6fac4c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":95,"up_from":99,"up_thru":113,"down_at":96,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6801","nonce":3729925777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6803","nonce":3729925777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6807","nonce":3729925777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3729925777},{"type":"v1","addr":"172.21.15.142:6805","nonce":3729925777}]},"public_addr":"172.21.15.142:6801/3729925777","cluster_addr":"172.21.15.142:6803/3729925777","heartbeat_back_addr":"172.21.15.142:6807/3729925777","heartbeat_front_addr":"172.21.15.142:6805/3729925777","state":["exists","up"]},{"osd":4,"uuid":"0a0ce92a-f9ac-4f83-877f-93eff87a9f8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":104,"up_from":108,"up_thru":113,"down_at":105,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6809","nonce":1150732284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6811","nonce":1150732284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6815","nonce":1150732284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":1150732284},{"type":"v1","addr":"172.21.15.142:6813","nonce":1150732284}]},"public_addr":"172.21.15.142:6809/1150732284","cluster_addr":"172.21.15.142:6811/1150732284","heartbeat_back_addr":"172.21.15.142:6815/1150732284","heartbeat_front_addr":"172.21.15.142:6813/1150732284","state":["exists","up"]},{"osd":5,"uuid":"0eed1f5c-a999-43d8-95ae-1671ac54640b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":109,"up_from":113,"up_thru":113,"down_at":110,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6817","nonce":1673341131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6819","nonce":1673341131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6823","nonce":1673341131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1673341131},{"type":"v1","addr":"172.21.15.142:6821","nonce":1673341131}]},"public_addr":"172.21.15.142:6817/1673341131","cluster_addr":"172.21.15.142:6819/1673341131","heartbeat_back_addr":"172.21.15.142:6823/1673341131","heartbeat_front_addr":"172.21.15.142:6821/1673341131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:55:49.856210+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:17.120054+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:56:46.102265+0000","dead_epoch":73},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:10.285252+0000","dead_epoch":95},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:57:35.715008+0000","dead_epoch":104},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:01.554947+0000","dead_epoch":109}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1","mappings":[{"from":0,"to":5}]},{"pgid":"2.7","mappings":[{"from":3,"to":1}]},{"pgid":"2.13","mappings":[{"from":0,"to":1}]},{"pgid":"2.1a","mappings":[{"from":3,"to":1}]},{"pgid":"2.1f","mappings":[{"from":0,"to":1},{"from":3,"to":2}]},{"pgid":"3.4","mappings":[{"from":3,"to":0}]},{"pgid":"3.9","mappings":[{"from":4,"to":1}]},{"pgid":"3.11","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6825/445093561":"2024-02-20T19:10:34.708948+0000","172.21.15.46:6829/2235495765":"2024-02-20T19:10:34.708919+0000","172.21.15.46:6801/1269498854":"2024-02-20T19:05:27.636848+0000","172.21.15.46:0/2954390908":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/1307799669":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6828/2235495765":"2024-02-20T19:10:34.708919+0000","172.21.15.46:6800/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6800/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/4057722486":"2024-02-20T18:52:44.819852+0000","172.21.15.46:6801/1654096494":"2024-02-20T19:01:39.789970+0000","172.21.15.142:0/2865604743":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/3901080352":"2024-02-20T18:54:32.109212+0000","172.21.15.142:6829/3077186414":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/2407750441":"2024-02-20T18:52:11.766897+0000","172.21.15.142:6824/445093561":"2024-02-20T19:10:34.708948+0000","172.21.15.142:0/2657910934":"2024-02-20T19:02:24.351804+0000","172.21.15.46:6801/1408120197":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/4120601315":"2024-02-20T19:05:27.636848+0000","172.21.15.142:6828/3077186414":"2024-02-20T19:02:24.351804+0000","172.21.15.142:0/4181796919":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/1304412033":"2024-02-20T19:01:39.789970+0000","172.21.15.142:0/2842979640":"2024-02-20T19:02:24.351804+0000","172.21.15.46:0/3708201410":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/3268130132":"2024-02-20T18:52:44.819852+0000","172.21.15.46:0/2139900052":"2024-02-20T19:01:39.789970+0000","172.21.15.142:0/3200406684":"2024-02-20T19:02:24.351804+0000","172.21.15.46:6800/1269498854":"2024-02-20T19:05:27.636848+0000","172.21.15.46:6800/1654096494":"2024-02-20T19:01:39.789970+0000","172.21.15.46:0/2827852709":"2024-02-20T19:01:39.789970+0000","172.21.15.46:6827/908936119":"2024-02-20T18:59:34.073482+0000","172.21.15.46:0/2538440870":"2024-02-20T19:01:39.789970+0000","172.21.15.46:6826/908936119":"2024-02-20T18:59:34.073482+0000","172.21.15.46:0/664839364":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6801/3840592341":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/3870899516":"2024-02-20T19:05:27.636848+0000","172.21.15.142:0/1985647318":"2024-02-20T19:02:24.351804+0000","172.21.15.46:6800/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:6801/3727775990":"2024-02-20T18:54:32.109212+0000","172.21.15.46:0/1953665533":"2024-02-20T18:52:11.766897+0000","172.21.15.46:0/1046986291":"2024-02-20T19:05:27.636848+0000","172.21.15.46:0/2413107873":"2024-02-20T19:05:27.636848+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T19:14:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 -- 172.21.15.46:0/2944684773 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9cd406d8d0 msgr2=0x7f9cd406fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9cd406d8d0 0x7f9cd406fd80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0006fd0 tx=0x7f9ce0008040 comp rx=0 tx=0).stop 2024-02-19T19:14:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 -- 172.21.15.46:0/2944684773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cec0fe5b0 msgr2=0x7f9cec197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cec0fe5b0 0x7f9cec197590 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009230 tx=0x7f9ce4004040 comp rx=0 tx=0).stop 2024-02-19T19:14:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 -- 172.21.15.46:0/2944684773 shutdown_connections 2024-02-19T19:14:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9cd406d8d0 0x7f9cd406fd80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cec1045e0 0x7f9cec197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 --2- 172.21.15.46:0/2944684773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9cec0fe5b0 0x7f9cec197590 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 -- 172.21.15.46:0/2944684773 >> 172.21.15.46:0/2944684773 conn(0x7f9cec0fa070 msgr2=0x7f9cec0fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 -- 172.21.15.46:0/2944684773 shutdown_connections 2024-02-19T19:14:03.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.803+0000 7f9cf444a640 1 -- 172.21.15.46:0/2944684773 wait complete. 2024-02-19T19:14:03.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:03 smithi046 ceph-mon[88928]: pgmap v330: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:03.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:03 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/802851123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:14:03.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:03 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1350674324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:14:03.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:03 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/560198803' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T19:14:03.837 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T18:56:48.450849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-19T18:59:17.631025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 1, 'raw_score_acting': 2.059999942779541, 'raw_score_stable': 2.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-19T18:59:18.491487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T19:14:03.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T19:14:03.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.919+0000 7f9aac4bc640 1 -- 172.21.15.46:0/2302649928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9aa40fe580 msgr2=0x7f9aa40fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:03.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.919+0000 7f9aac4bc640 1 --2- 172.21.15.46:0/2302649928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9aa40fe580 0x7f9aa40fe9f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009880 tx=0x7f9a9402bce0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.919+0000 7f9aac4bc640 1 -- 172.21.15.46:0/2302649928 shutdown_connections 2024-02-19T19:14:03.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.919+0000 7f9aac4bc640 1 --2- 172.21.15.46:0/2302649928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9aa40fe580 0x7f9aa40fe9f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.919+0000 7f9aac4bc640 1 --2- 172.21.15.46:0/2302649928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa41045b0 0x7f9aa4104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.919+0000 7f9aac4bc640 1 -- 172.21.15.46:0/2302649928 >> 172.21.15.46:0/2302649928 conn(0x7f9aa40fa060 msgr2=0x7f9aa40fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:03.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.919+0000 7f9aac4bc640 1 -- 172.21.15.46:0/2302649928 shutdown_connections 2024-02-19T19:14:03.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.919+0000 7f9aac4bc640 1 -- 172.21.15.46:0/2302649928 wait complete. 2024-02-19T19:14:03.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aac4bc640 1 Processor -- start 2024-02-19T19:14:03.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aac4bc640 1 -- start start 2024-02-19T19:14:03.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aac4bc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9aa40fe580 0x7f9aa41953a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:03.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aac4bc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa41045b0 0x7f9aa41958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:03.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aac4bc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa4195f70 con 0x7f9aa40fe580 2024-02-19T19:14:03.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aac4bc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa4199d40 con 0x7f9aa41045b0 2024-02-19T19:14:03.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aaa258640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9aa40fe580 0x7f9aa41953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aaa258640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9aa40fe580 0x7f9aa41953a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57264/0 (socket says 172.21.15.46:57264) 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aaa258640 1 -- 172.21.15.46:0/3589061376 learned_addr learned my addr 172.21.15.46:0/3589061376 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aaa258640 1 -- 172.21.15.46:0/3589061376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa41045b0 msgr2=0x7f9aa41958e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aaa258640 1 --2- 172.21.15.46:0/3589061376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa41045b0 0x7f9aa41958e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aaa258640 1 -- 172.21.15.46:0/3589061376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94009560 con 0x7f9aa40fe580 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.920+0000 7f9aaa258640 1 --2- 172.21.15.46:0/3589061376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9aa40fe580 0x7f9aa41953a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000b420 tx=0x7f9aa000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.921+0000 7f9a9b7fe640 1 -- 172.21.15.46:0/3589061376 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa0011800 con 0x7f9aa40fe580 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.921+0000 7f9a9b7fe640 1 -- 172.21.15.46:0/3589061376 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9aa0011e20 con 0x7f9aa40fe580 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.921+0000 7f9aac4bc640 1 -- 172.21.15.46:0/3589061376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa419a020 con 0x7f9aa40fe580 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.921+0000 7f9a9b7fe640 1 -- 172.21.15.46:0/3589061376 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa000f2e0 con 0x7f9aa40fe580 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.921+0000 7f9aac4bc640 1 -- 172.21.15.46:0/3589061376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa419a600 con 0x7f9aa40fe580 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.922+0000 7f9aac4bc640 1 -- 172.21.15.46:0/3589061376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa404e000 con 0x7f9aa40fe580 2024-02-19T19:14:03.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.922+0000 7f9a9b7fe640 1 -- 172.21.15.46:0/3589061376 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9aa0010380 con 0x7f9aa40fe580 2024-02-19T19:14:03.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.922+0000 7f9a9b7fe640 1 --2- 172.21.15.46:0/3589061376 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9a9006d810 0x7f9a9006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:03.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.922+0000 7f9a9b7fe640 1 -- 172.21.15.46:0/3589061376 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f9aa008cee0 con 0x7f9aa40fe580 2024-02-19T19:14:03.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.922+0000 7f9aa9a57640 1 --2- 172.21.15.46:0/3589061376 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9a9006d810 0x7f9a9006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:03.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.923+0000 7f9aa9a57640 1 --2- 172.21.15.46:0/3589061376 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9a9006d810 0x7f9a9006fcc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a94036040 tx=0x7f9a94005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:03.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:03.927+0000 7f9a9b7fe640 1 -- 172.21.15.46:0/3589061376 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9aa0056600 con 0x7f9aa40fe580 2024-02-19T19:14:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:03 smithi142 ceph-mon[69118]: pgmap v330: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:03 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/802851123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:14:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:03 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1350674324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:14:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:03 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/560198803' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T19:14:04.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.110+0000 7f9aac4bc640 1 -- 172.21.15.46:0/3589061376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9aa40008d0 con 0x7f9aa40fe580 2024-02-19T19:14:04.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.110+0000 7f9a9b7fe640 1 -- 172.21.15.46:0/3589061376 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9aa0059cc0 con 0x7f9aa40fe580 2024-02-19T19:14:04.133 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-02-19T19:14:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 -- 172.21.15.46:0/3589061376 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9a9006d810 msgr2=0x7f9a9006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 --2- 172.21.15.46:0/3589061376 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9a9006d810 0x7f9a9006fcc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a94036040 tx=0x7f9a94005fd0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 -- 172.21.15.46:0/3589061376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9aa40fe580 msgr2=0x7f9aa41953a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 --2- 172.21.15.46:0/3589061376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9aa40fe580 0x7f9aa41953a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000b420 tx=0x7f9aa000b8e0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 -- 172.21.15.46:0/3589061376 shutdown_connections 2024-02-19T19:14:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 --2- 172.21.15.46:0/3589061376 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f9a9006d810 0x7f9a9006fcc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 --2- 172.21.15.46:0/3589061376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa41045b0 0x7f9aa41958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 --2- 172.21.15.46:0/3589061376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9aa40fe580 0x7f9aa41953a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 -- 172.21.15.46:0/3589061376 >> 172.21.15.46:0/3589061376 conn(0x7f9aa40fa060 msgr2=0x7f9aa40fba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 -- 172.21.15.46:0/3589061376 shutdown_connections 2024-02-19T19:14:04.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.112+0000 7f9aac4bc640 1 -- 172.21.15.46:0/3589061376 wait complete. 2024-02-19T19:14:04.146 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-19T19:14:04.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.228+0000 7f3b53700640 1 -- 172.21.15.46:0/1339124798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c0fe580 msgr2=0x7f3b4c0fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.228+0000 7f3b53700640 1 --2- 172.21.15.46:0/1339124798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c0fe580 0x7f3b4c0fe9f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009880 tx=0x7f3b3c02bd10 comp rx=0 tx=0).stop 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.228+0000 7f3b53700640 1 -- 172.21.15.46:0/1339124798 shutdown_connections 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.228+0000 7f3b53700640 1 --2- 172.21.15.46:0/1339124798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c0fe580 0x7f3b4c0fe9f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.228+0000 7f3b53700640 1 --2- 172.21.15.46:0/1339124798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b4c1045b0 0x7f3b4c104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.228+0000 7f3b53700640 1 -- 172.21.15.46:0/1339124798 >> 172.21.15.46:0/1339124798 conn(0x7f3b4c0fa060 msgr2=0x7f3b4c0fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.228+0000 7f3b53700640 1 -- 172.21.15.46:0/1339124798 shutdown_connections 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.228+0000 7f3b53700640 1 -- 172.21.15.46:0/1339124798 wait complete. 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.228+0000 7f3b53700640 1 Processor -- start 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.228+0000 7f3b53700640 1 -- start start 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b53700640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b4c0fe580 0x7f3b4c1942c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:04.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b53700640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c1045b0 0x7f3b4c194800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b53700640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c194e90 con 0x7f3b4c1045b0 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b53700640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c198c60 con 0x7f3b4c0fe580 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b50c9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c1045b0 0x7f3b4c194800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b50c9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c1045b0 0x7f3b4c194800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57292/0 (socket says 172.21.15.46:57292) 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b50c9b640 1 -- 172.21.15.46:0/1972499937 learned_addr learned my addr 172.21.15.46:0/1972499937 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b50c9b640 1 -- 172.21.15.46:0/1972499937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b4c0fe580 msgr2=0x7f3b4c1942c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b50c9b640 1 --2- 172.21.15.46:0/1972499937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b4c0fe580 0x7f3b4c1942c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b50c9b640 1 -- 172.21.15.46:0/1972499937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c009560 con 0x7f3b4c1045b0 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b50c9b640 1 --2- 172.21.15.46:0/1972499937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c1045b0 0x7f3b4c194800 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009230 tx=0x7f3b3c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b427fc640 1 -- 172.21.15.46:0/1972499937 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b3c0035f0 con 0x7f3b4c1045b0 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b427fc640 1 -- 172.21.15.46:0/1972499937 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b3c003c10 con 0x7f3b4c1045b0 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b53700640 1 -- 172.21.15.46:0/1972499937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4c198ee0 con 0x7f3b4c1045b0 2024-02-19T19:14:04.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b427fc640 1 -- 172.21.15.46:0/1972499937 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b3c0344e0 con 0x7f3b4c1045b0 2024-02-19T19:14:04.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.229+0000 7f3b53700640 1 -- 172.21.15.46:0/1972499937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4c1994c0 con 0x7f3b4c1045b0 2024-02-19T19:14:04.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.230+0000 7f3b53700640 1 -- 172.21.15.46:0/1972499937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4c04e000 con 0x7f3b4c1045b0 2024-02-19T19:14:04.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.231+0000 7f3b427fc640 1 -- 172.21.15.46:0/1972499937 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f3b3c004f60 con 0x7f3b4c1045b0 2024-02-19T19:14:04.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.231+0000 7f3b427fc640 1 --2- 172.21.15.46:0/1972499937 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3b3806d810 0x7f3b3806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:04.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.231+0000 7f3b427fc640 1 -- 172.21.15.46:0/1972499937 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f3b3c0b0470 con 0x7f3b4c1045b0 2024-02-19T19:14:04.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.231+0000 7f3b5149c640 1 --2- 172.21.15.46:0/1972499937 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3b3806d810 0x7f3b3806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:04.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.232+0000 7f3b5149c640 1 --2- 172.21.15.46:0/1972499937 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3b3806d810 0x7f3b3806fcc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3b480096f0 tx=0x7f3b48006c40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:04.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.236+0000 7f3b427fc640 1 -- 172.21.15.46:0/1972499937 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3b3c079b90 con 0x7f3b4c1045b0 2024-02-19T19:14:04.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.419+0000 7f3b53700640 1 -- 172.21.15.46:0/1972499937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f3b4c1069c0 con 0x7f3b4c1045b0 2024-02-19T19:14:04.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.420+0000 7f3b427fc640 1 -- 172.21.15.46:0/1972499937 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v119) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3b4c1069c0 con 0x7f3b4c1045b0 2024-02-19T19:14:04.443 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T19:14:04.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 -- 172.21.15.46:0/1972499937 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3b3806d810 msgr2=0x7f3b3806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 --2- 172.21.15.46:0/1972499937 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3b3806d810 0x7f3b3806fcc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3b480096f0 tx=0x7f3b48006c40 comp rx=0 tx=0).stop 2024-02-19T19:14:04.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 -- 172.21.15.46:0/1972499937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c1045b0 msgr2=0x7f3b4c194800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 --2- 172.21.15.46:0/1972499937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c1045b0 0x7f3b4c194800 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009230 tx=0x7f3b3c004040 comp rx=0 tx=0).stop 2024-02-19T19:14:04.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 -- 172.21.15.46:0/1972499937 shutdown_connections 2024-02-19T19:14:04.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 --2- 172.21.15.46:0/1972499937 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f3b3806d810 0x7f3b3806fcc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 --2- 172.21.15.46:0/1972499937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b4c1045b0 0x7f3b4c194800 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 --2- 172.21.15.46:0/1972499937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b4c0fe580 0x7f3b4c1942c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 -- 172.21.15.46:0/1972499937 >> 172.21.15.46:0/1972499937 conn(0x7f3b4c0fa060 msgr2=0x7f3b4c0fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:04.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 -- 172.21.15.46:0/1972499937 shutdown_connections 2024-02-19T19:14:04.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.422+0000 7f3b53700640 1 -- 172.21.15.46:0/1972499937 wait complete. 2024-02-19T19:14:04.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-19T19:14:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.540+0000 7f7961939640 1 -- 172.21.15.46:0/3573213157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795c100830 msgr2=0x7f795c100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.540+0000 7f7961939640 1 --2- 172.21.15.46:0/3573213157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795c100830 0x7f795c100c00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f794c0098b0 tx=0x7f794c02bd60 comp rx=0 tx=0).stop 2024-02-19T19:14:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.540+0000 7f7961939640 1 -- 172.21.15.46:0/3573213157 shutdown_connections 2024-02-19T19:14:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.540+0000 7f7961939640 1 --2- 172.21.15.46:0/3573213157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f795c101140 0x7f795c109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.540+0000 7f7961939640 1 --2- 172.21.15.46:0/3573213157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795c100830 0x7f795c100c00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.540+0000 7f7961939640 1 -- 172.21.15.46:0/3573213157 >> 172.21.15.46:0/3573213157 conn(0x7f795c0fa040 msgr2=0x7f795c0fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.540+0000 7f7961939640 1 -- 172.21.15.46:0/3573213157 shutdown_connections 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.540+0000 7f7961939640 1 -- 172.21.15.46:0/3573213157 wait complete. 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f7961939640 1 Processor -- start 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f7961939640 1 -- start start 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f7961939640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795c100830 0x7f795c0fe480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f7961939640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f795c101140 0x7f795c0fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f7961939640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0fef00 con 0x7f795c100830 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f7961939640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0ff070 con 0x7f795c101140 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f795affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795c100830 0x7f795c0fe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f795affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795c100830 0x7f795c0fe480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57318/0 (socket says 172.21.15.46:57318) 2024-02-19T19:14:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f795affd640 1 -- 172.21.15.46:0/3172433777 learned_addr learned my addr 172.21.15.46:0/3172433777 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f795affd640 1 -- 172.21.15.46:0/3172433777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f795c101140 msgr2=0x7f795c0fe9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f795affd640 1 --2- 172.21.15.46:0/3172433777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f795c101140 0x7f795c0fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.541+0000 7f795affd640 1 -- 172.21.15.46:0/3172433777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c009560 con 0x7f795c100830 2024-02-19T19:14:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.542+0000 7f795affd640 1 --2- 172.21.15.46:0/3172433777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795c100830 0x7f795c0fe480 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f794c009880 tx=0x7f794c02c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.542+0000 7f7960937640 1 -- 172.21.15.46:0/3172433777 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794c0035f0 con 0x7f795c100830 2024-02-19T19:14:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.542+0000 7f7960937640 1 -- 172.21.15.46:0/3172433777 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f794c003c10 con 0x7f795c100830 2024-02-19T19:14:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.542+0000 7f7961939640 1 -- 172.21.15.46:0/3172433777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c0ff290 con 0x7f795c100830 2024-02-19T19:14:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.542+0000 7f7960937640 1 -- 172.21.15.46:0/3172433777 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794c005690 con 0x7f795c100830 2024-02-19T19:14:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.542+0000 7f7961939640 1 -- 172.21.15.46:0/3172433777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c1a1890 con 0x7f795c100830 2024-02-19T19:14:04.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.543+0000 7f7961939640 1 -- 172.21.15.46:0/3172433777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c04e000 con 0x7f795c100830 2024-02-19T19:14:04.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.543+0000 7f7960937640 1 -- 172.21.15.46:0/3172433777 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f794c004ed0 con 0x7f795c100830 2024-02-19T19:14:04.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.544+0000 7f7960937640 1 --2- 172.21.15.46:0/3172433777 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f794806d7c0 0x7f794806fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:04.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.544+0000 7f795a7fc640 1 --2- 172.21.15.46:0/3172433777 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f794806d7c0 0x7f794806fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:04.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.544+0000 7f7960937640 1 -- 172.21.15.46:0/3172433777 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7f794c0b0170 con 0x7f795c100830 2024-02-19T19:14:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.544+0000 7f795a7fc640 1 --2- 172.21.15.46:0/3172433777 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f794806d7c0 0x7f794806fc70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7944005fd0 tx=0x7f7944005c70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:04.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.549+0000 7f7960937640 1 -- 172.21.15.46:0/3172433777 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f794c079930 con 0x7f795c100830 2024-02-19T19:14:04.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.734+0000 7f7961939640 1 -- 172.21.15.46:0/3172433777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f795c106ca0 con 0x7f795c100830 2024-02-19T19:14:04.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.734+0000 7f7960937640 1 -- 172.21.15.46:0/3172433777 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v119) v1 ==== 107+0+11 (secure 0 0 0) 0x7f794c07cff0 con 0x7f795c100830 2024-02-19T19:14:04.757 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-02-19T19:14:04.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 -- 172.21.15.46:0/3172433777 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f794806d7c0 msgr2=0x7f794806fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 --2- 172.21.15.46:0/3172433777 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f794806d7c0 0x7f794806fc70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7944005fd0 tx=0x7f7944005c70 comp rx=0 tx=0).stop 2024-02-19T19:14:04.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 -- 172.21.15.46:0/3172433777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795c100830 msgr2=0x7f795c0fe480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 --2- 172.21.15.46:0/3172433777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795c100830 0x7f795c0fe480 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f794c009880 tx=0x7f794c02c8d0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 -- 172.21.15.46:0/3172433777 shutdown_connections 2024-02-19T19:14:04.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 --2- 172.21.15.46:0/3172433777 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7f794806d7c0 0x7f794806fc70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 --2- 172.21.15.46:0/3172433777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f795c101140 0x7f795c0fe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 --2- 172.21.15.46:0/3172433777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795c100830 0x7f795c0fe480 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 -- 172.21.15.46:0/3172433777 >> 172.21.15.46:0/3172433777 conn(0x7f795c0fa040 msgr2=0x7f795c103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:04.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 -- 172.21.15.46:0/3172433777 shutdown_connections 2024-02-19T19:14:04.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.736+0000 7f7961939640 1 -- 172.21.15.46:0/3172433777 wait complete. 2024-02-19T19:14:04.769 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:04 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2944684773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:14:04.769 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:04 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3589061376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:14:04.769 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:04 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/1972499937' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:14:04.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T19:14:04.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.849+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/467454764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6cc1011c0 msgr2=0x7fc6cc1096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:04.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.849+0000 7fc6d3ef7640 1 --2- 172.21.15.46:0/467454764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6cc1011c0 0x7fc6cc1096b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009880 tx=0x7fc6c002bd70 comp rx=0 tx=0).stop 2024-02-19T19:14:04.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.849+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/467454764 shutdown_connections 2024-02-19T19:14:04.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.849+0000 7fc6d3ef7640 1 --2- 172.21.15.46:0/467454764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6cc1011c0 0x7fc6cc1096b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.849+0000 7fc6d3ef7640 1 --2- 172.21.15.46:0/467454764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc1008b0 0x7fc6cc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.849+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/467454764 >> 172.21.15.46:0/467454764 conn(0x7fc6cc075270 msgr2=0x7fc6cc075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/467454764 shutdown_connections 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/467454764 wait complete. 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d3ef7640 1 Processor -- start 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d3ef7640 1 -- start start 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d3ef7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6cc1008b0 0x7fc6cc195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d3ef7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc1011c0 0x7fc6cc195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d3ef7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc195ee0 con 0x7fc6cc1008b0 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d3ef7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc199cb0 con 0x7fc6cc1011c0 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d1c93640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6cc1008b0 0x7fc6cc195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d1c93640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6cc1008b0 0x7fc6cc195310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57328/0 (socket says 172.21.15.46:57328) 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.850+0000 7fc6d1c93640 1 -- 172.21.15.46:0/2260468294 learned_addr learned my addr 172.21.15.46:0/2260468294 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.851+0000 7fc6d1c93640 1 -- 172.21.15.46:0/2260468294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc1011c0 msgr2=0x7fc6cc195850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.851+0000 7fc6d1c93640 1 --2- 172.21.15.46:0/2260468294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc1011c0 0x7fc6cc195850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.851+0000 7fc6d1c93640 1 -- 172.21.15.46:0/2260468294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0009560 con 0x7fc6cc1008b0 2024-02-19T19:14:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.851+0000 7fc6d1c93640 1 --2- 172.21.15.46:0/2260468294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6cc1008b0 0x7fc6cc195310 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400ba50 tx=0x7fc6c400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.851+0000 7fc6caffd640 1 -- 172.21.15.46:0/2260468294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6c400cb30 con 0x7fc6cc1008b0 2024-02-19T19:14:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.851+0000 7fc6caffd640 1 -- 172.21.15.46:0/2260468294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6c400cc90 con 0x7fc6cc1008b0 2024-02-19T19:14:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.851+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/2260468294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc199f90 con 0x7fc6cc1008b0 2024-02-19T19:14:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.851+0000 7fc6caffd640 1 -- 172.21.15.46:0/2260468294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6c4007740 con 0x7fc6cc1008b0 2024-02-19T19:14:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.851+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/2260468294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc19a4f0 con 0x7fc6cc1008b0 2024-02-19T19:14:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.852+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/2260468294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc04e000 con 0x7fc6cc1008b0 2024-02-19T19:14:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.853+0000 7fc6caffd640 1 -- 172.21.15.46:0/2260468294 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 39) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc6c4014b90 con 0x7fc6cc1008b0 2024-02-19T19:14:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.853+0000 7fc6caffd640 1 --2- 172.21.15.46:0/2260468294 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc6b406d8d0 0x7fc6b406fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.853+0000 7fc6caffd640 1 -- 172.21.15.46:0/2260468294 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6855+0+0 (secure 0 0 0) 0x7fc6c408cff0 con 0x7fc6cc1008b0 2024-02-19T19:14:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.853+0000 7fc6d1492640 1 --2- 172.21.15.46:0/2260468294 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc6b406d8d0 0x7fc6b406fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.853+0000 7fc6d1492640 1 --2- 172.21.15.46:0/2260468294 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc6b406d8d0 0x7fc6b406fd80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0036040 tx=0x7fc6c0005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:04.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:04.857+0000 7fc6caffd640 1 -- 172.21.15.46:0/2260468294 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc6c405a270 con 0x7fc6cc1008b0 2024-02-19T19:14:04.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:04 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2944684773' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:14:04.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:04 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3589061376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:14:04.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:04 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/1972499937' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:14:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.052+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/2260468294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc6cc106c80 con 0x7fc6cc1008b0 2024-02-19T19:14:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.052+0000 7fc6caffd640 1 -- 172.21.15.46:0/2260468294 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v119) v1 ==== 81+0+2437 (secure 0 0 0) 0x7fc6cc106c80 con 0x7fc6cc1008b0 2024-02-19T19:14:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:6825/445093561 2024-02-20T19:10:34.708948+0000 2024-02-19T19:14:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6829/2235495765 2024-02-20T19:10:34.708919+0000 2024-02-19T19:14:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1269498854 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2954390908 2024-02-20T18:52:11.766897+0000 2024-02-19T19:14:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1307799669 2024-02-20T18:54:32.109212+0000 2024-02-19T19:14:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6828/2235495765 2024-02-20T19:10:34.708919+0000 2024-02-19T19:14:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1408120197 2024-02-20T18:52:44.819852+0000 2024-02-19T19:14:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/3840592341 2024-02-20T18:52:11.766897+0000 2024-02-19T19:14:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4057722486 2024-02-20T18:52:44.819852+0000 2024-02-19T19:14:05.076 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1654096494 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/2865604743 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3901080352 2024-02-20T18:54:32.109212+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:6829/3077186414 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2407750441 2024-02-20T18:52:11.766897+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:6824/445093561 2024-02-20T19:10:34.708948+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/2657910934 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/1408120197 2024-02-20T18:52:44.819852+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4120601315 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:6828/3077186414 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/4181796919 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1304412033 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/2842979640 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3708201410 2024-02-20T18:52:44.819852+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3268130132 2024-02-20T18:52:44.819852+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2139900052 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/3200406684 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1269498854 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/1654096494 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2827852709 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6827/908936119 2024-02-20T18:59:34.073482+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2538440870 2024-02-20T19:01:39.789970+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6826/908936119 2024-02-20T18:59:34.073482+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/664839364 2024-02-20T18:54:32.109212+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/3840592341 2024-02-20T18:52:11.766897+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3870899516 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.142:0/1985647318 2024-02-20T19:02:24.351804+0000 2024-02-19T19:14:05.078 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/3727775990 2024-02-20T18:54:32.109212+0000 2024-02-19T19:14:05.079 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/3727775990 2024-02-20T18:54:32.109212+0000 2024-02-19T19:14:05.079 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1953665533 2024-02-20T18:52:11.766897+0000 2024-02-19T19:14:05.079 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1046986291 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:05.079 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2413107873 2024-02-20T19:05:27.636848+0000 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:listed 41 entries 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/2260468294 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc6b406d8d0 msgr2=0x7fc6b406fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 --2- 172.21.15.46:0/2260468294 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc6b406d8d0 0x7fc6b406fd80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0036040 tx=0x7fc6c0005fd0 comp rx=0 tx=0).stop 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/2260468294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6cc1008b0 msgr2=0x7fc6cc195310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 --2- 172.21.15.46:0/2260468294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6cc1008b0 0x7fc6cc195310 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400ba50 tx=0x7fc6c400bf10 comp rx=0 tx=0).stop 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/2260468294 shutdown_connections 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 --2- 172.21.15.46:0/2260468294 >> [v2:172.21.15.46:6800/305588353,v1:172.21.15.46:6801/305588353] conn(0x7fc6b406d8d0 0x7fc6b406fd80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 --2- 172.21.15.46:0/2260468294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc1011c0 0x7fc6cc195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 --2- 172.21.15.46:0/2260468294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6cc1008b0 0x7fc6cc195310 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/2260468294 >> 172.21.15.46:0/2260468294 conn(0x7fc6cc075270 msgr2=0x7fc6cc103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:05.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/2260468294 shutdown_connections 2024-02-19T19:14:05.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-02-19T19:14:05.055+0000 7fc6d3ef7640 1 -- 172.21.15.46:0/2260468294 wait complete. 2024-02-19T19:14:05.088 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-19T19:14:05.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:14:05.089 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-19T19:14:05.125 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T19:14:05.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:14:05.125 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-19T19:14:05.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:14:05.189 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-02-19T19:14:05.204 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-19T19:14:05.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:14:05.205 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T19:14:05.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:14:05.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-02-19T19:14:05.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:14:05.369 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-02-19T19:14:05.388 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-19T19:14:05.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:14:05.388 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T19:14:05.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:14:05.462 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-02-19T19:14:05.574 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-02-19T19:14:05.586 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task sleep... 2024-02-19T19:14:05.587 INFO:teuthology.task.sleep:Sleeping for 3600 seconds 2024-02-19T19:14:05.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:05 smithi046 ceph-mon[88928]: pgmap v331: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:05.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:05 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/3172433777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:14:05.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:05 smithi046 ceph-mon[88928]: from='client.? 172.21.15.46:0/2260468294' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T19:14:05.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:05 smithi142 ceph-mon[69118]: pgmap v331: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:05.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:05 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/3172433777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:14:05.955 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:05 smithi142 ceph-mon[69118]: from='client.? 172.21.15.46:0/2260468294' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T19:14:07.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:07 smithi046 ceph-mon[88928]: pgmap v332: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-19T19:14:07.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:07 smithi142 ceph-mon[69118]: pgmap v332: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-19T19:14:09.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:09 smithi046 ceph-mon[88928]: pgmap v333: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-19T19:14:09.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:09 smithi142 ceph-mon[69118]: pgmap v333: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-19T19:14:11.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:11 smithi046 ceph-mon[88928]: pgmap v334: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-19T19:14:11.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:11 smithi142 ceph-mon[69118]: pgmap v334: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-19T19:14:13.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:13 smithi046 ceph-mon[88928]: pgmap v335: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:14:13.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:13.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:13.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:13 smithi142 ceph-mon[69118]: pgmap v335: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:14:13.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:13.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:14.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:14.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:14:14.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:14:14.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:14.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:14:14.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:14:15.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:15 smithi046 ceph-mon[88928]: pgmap v336: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:14:15.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:15 smithi142 ceph-mon[69118]: pgmap v336: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:14:17.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:17 smithi046 ceph-mon[88928]: pgmap v337: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:14:17.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:17 smithi142 ceph-mon[69118]: pgmap v337: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-19T19:14:19.833 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:19 smithi046 ceph-mon[88928]: pgmap v338: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-19T19:14:19.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:19 smithi142 ceph-mon[69118]: pgmap v338: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-19T19:14:21.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:21 smithi142 ceph-mon[69118]: pgmap v339: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-19T19:14:22.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:21 smithi046 ceph-mon[88928]: pgmap v339: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-19T19:14:23.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:23 smithi142 ceph-mon[69118]: pgmap v340: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-19T19:14:24.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:23 smithi046 ceph-mon[88928]: pgmap v340: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-19T19:14:25.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:25 smithi142 ceph-mon[69118]: pgmap v341: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:26.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:25 smithi046 ceph-mon[88928]: pgmap v341: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:27.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:27 smithi046 ceph-mon[88928]: pgmap v342: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:27.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:27 smithi142 ceph-mon[69118]: pgmap v342: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:28.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:29.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:29.855 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:29 smithi142 ceph-mon[69118]: pgmap v343: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:30.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:29 smithi046 ceph-mon[88928]: pgmap v343: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:31.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:31 smithi142 ceph-mon[69118]: pgmap v344: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:32.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:31 smithi046 ceph-mon[88928]: pgmap v344: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:33.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:33 smithi142 ceph-mon[69118]: pgmap v345: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:34.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:33 smithi046 ceph-mon[88928]: pgmap v345: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:35.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:35 smithi142 ceph-mon[69118]: pgmap v346: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:36.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:35 smithi046 ceph-mon[88928]: pgmap v346: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:37.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:37 smithi142 ceph-mon[69118]: pgmap v347: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:38.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:37 smithi046 ceph-mon[88928]: pgmap v347: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:39.947 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:39 smithi046 ceph-mon[88928]: pgmap v348: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:39.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:39 smithi142 ceph-mon[69118]: pgmap v348: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:41.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:41 smithi142 ceph-mon[69118]: pgmap v349: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:42.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:41 smithi046 ceph-mon[88928]: pgmap v349: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:43.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:43 smithi142 ceph-mon[69118]: pgmap v350: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:43.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:44.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:43 smithi046 ceph-mon[88928]: pgmap v350: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:44.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:45.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:45 smithi142 ceph-mon[69118]: pgmap v351: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:46.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:45 smithi046 ceph-mon[88928]: pgmap v351: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:47.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:47 smithi142 ceph-mon[69118]: pgmap v352: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:48.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:47 smithi046 ceph-mon[88928]: pgmap v352: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:49.939 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:49 smithi142 ceph-mon[69118]: pgmap v353: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:50.059 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:49 smithi046 ceph-mon[88928]: pgmap v353: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:51.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:51 smithi142 ceph-mon[69118]: pgmap v354: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:52.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:51 smithi046 ceph-mon[88928]: pgmap v354: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:53.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:53 smithi142 ceph-mon[69118]: pgmap v355: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:54.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:53 smithi046 ceph-mon[88928]: pgmap v355: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:55.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:55 smithi142 ceph-mon[69118]: pgmap v356: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:56.083 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:55 smithi046 ceph-mon[88928]: pgmap v356: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:57.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:57 smithi142 ceph-mon[69118]: pgmap v357: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:58.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:57 smithi046 ceph-mon[88928]: pgmap v357: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:14:58.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:59.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:59.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:14:59 smithi142 ceph-mon[69118]: pgmap v358: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:00.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:14:59 smithi046 ceph-mon[88928]: pgmap v358: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:01.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:01 smithi142 ceph-mon[69118]: pgmap v359: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:02.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:01 smithi046 ceph-mon[88928]: pgmap v359: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:03 smithi142 ceph-mon[69118]: pgmap v360: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:04.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:03 smithi046 ceph-mon[88928]: pgmap v360: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:05.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:05 smithi142 ceph-mon[69118]: pgmap v361: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:06.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:05 smithi046 ceph-mon[88928]: pgmap v361: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:07.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:07 smithi142 ceph-mon[69118]: pgmap v362: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:08.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:07 smithi046 ceph-mon[88928]: pgmap v362: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:09.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:09 smithi142 ceph-mon[69118]: pgmap v363: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:10.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:09 smithi046 ceph-mon[88928]: pgmap v363: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:11.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:11 smithi142 ceph-mon[69118]: pgmap v364: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:12.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:11 smithi046 ceph-mon[88928]: pgmap v364: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:13.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:13 smithi142 ceph-mon[69118]: pgmap v365: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:13.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:13 smithi046 ceph-mon[88928]: pgmap v365: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:14.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:14.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:15:15.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:15:15.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:15 smithi142 ceph-mon[69118]: pgmap v366: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:15.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:15:15.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:15:15.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:15:15.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:15:15.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:15 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:15:16.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:15 smithi046 ceph-mon[88928]: pgmap v366: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:16.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:15:16.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:15:16.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:15:16.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:15:16.082 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:15 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:15:17.081 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:16 smithi046 ceph-mon[88928]: pgmap v367: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:17.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:16 smithi142 ceph-mon[69118]: pgmap v367: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:19.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:18 smithi142 ceph-mon[69118]: pgmap v368: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:19.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:18 smithi046 ceph-mon[88928]: pgmap v368: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:21.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:20 smithi142 ceph-mon[69118]: pgmap v369: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:21.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:20 smithi046 ceph-mon[88928]: pgmap v369: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:23.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:22 smithi142 ceph-mon[69118]: pgmap v370: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:23.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:22 smithi046 ceph-mon[88928]: pgmap v370: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:25.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:24 smithi142 ceph-mon[69118]: pgmap v371: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:25.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:24 smithi046 ceph-mon[88928]: pgmap v371: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:27.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:26 smithi142 ceph-mon[69118]: pgmap v372: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:27.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:26 smithi046 ceph-mon[88928]: pgmap v372: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:28.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:28.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:29.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:28 smithi142 ceph-mon[69118]: pgmap v373: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:29.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:28 smithi046 ceph-mon[88928]: pgmap v373: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:31.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:30 smithi142 ceph-mon[69118]: pgmap v374: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:31.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:30 smithi046 ceph-mon[88928]: pgmap v374: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:33.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:32 smithi142 ceph-mon[69118]: pgmap v375: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:33.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:32 smithi046 ceph-mon[88928]: pgmap v375: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:35.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:34 smithi142 ceph-mon[69118]: pgmap v376: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:35.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:34 smithi046 ceph-mon[88928]: pgmap v376: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:37.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:36 smithi142 ceph-mon[69118]: pgmap v377: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:37.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:36 smithi046 ceph-mon[88928]: pgmap v377: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:39.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:38 smithi142 ceph-mon[69118]: pgmap v378: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:39.331 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:38 smithi046 ceph-mon[88928]: pgmap v378: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:41.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:40 smithi142 ceph-mon[69118]: pgmap v379: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:41.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:40 smithi046 ceph-mon[88928]: pgmap v379: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:43.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:42 smithi142 ceph-mon[69118]: pgmap v380: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:43.201 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:43.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:42 smithi046 ceph-mon[88928]: pgmap v380: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:43.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:45.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:44 smithi142 ceph-mon[69118]: pgmap v381: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:45.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:44 smithi046 ceph-mon[88928]: pgmap v381: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:47.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:46 smithi142 ceph-mon[69118]: pgmap v382: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:47.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:46 smithi046 ceph-mon[88928]: pgmap v382: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:49.200 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:48 smithi142 ceph-mon[69118]: pgmap v383: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:49.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:48 smithi046 ceph-mon[88928]: pgmap v383: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:51.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:51 smithi142 ceph-mon[69118]: pgmap v384: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:51.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:51 smithi046 ceph-mon[88928]: pgmap v384: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:53.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:53 smithi142 ceph-mon[69118]: pgmap v385: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:53.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:53 smithi046 ceph-mon[88928]: pgmap v385: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:55.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:55 smithi142 ceph-mon[69118]: pgmap v386: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:55.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:55 smithi046 ceph-mon[88928]: pgmap v386: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:57.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:57 smithi142 ceph-mon[69118]: pgmap v387: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:57.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:57 smithi046 ceph-mon[88928]: pgmap v387: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:58.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:58.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:59.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:15:59 smithi142 ceph-mon[69118]: pgmap v388: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:15:59.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:15:59 smithi046 ceph-mon[88928]: pgmap v388: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:01.450 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:01 smithi142 ceph-mon[69118]: pgmap v389: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:01.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:01 smithi046 ceph-mon[88928]: pgmap v389: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:03.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:03 smithi046 ceph-mon[88928]: pgmap v390: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:03.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:03 smithi142 ceph-mon[69118]: pgmap v390: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:05.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:05 smithi046 ceph-mon[88928]: pgmap v391: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:05.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:05 smithi142 ceph-mon[69118]: pgmap v391: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:07.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:07 smithi046 ceph-mon[88928]: pgmap v392: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:07.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:07 smithi142 ceph-mon[69118]: pgmap v392: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:09.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:09 smithi046 ceph-mon[88928]: pgmap v393: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:09.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:09 smithi142 ceph-mon[69118]: pgmap v393: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:11.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:11 smithi046 ceph-mon[88928]: pgmap v394: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:11.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:11 smithi142 ceph-mon[69118]: pgmap v394: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:13.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:13 smithi046 ceph-mon[88928]: pgmap v395: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:13.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:13.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:13 smithi142 ceph-mon[69118]: pgmap v395: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:13.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:15.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:15 smithi046 ceph-mon[88928]: pgmap v396: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:15.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:15 smithi142 ceph-mon[69118]: pgmap v396: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:16.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:16:16.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:16:16.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:16:16.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:16:16.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:16:16.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:16:17.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:17 smithi046 ceph-mon[88928]: pgmap v397: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:17.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:16:17.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:17 smithi142 ceph-mon[69118]: pgmap v397: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:17.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:16:19.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:19 smithi046 ceph-mon[88928]: pgmap v398: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:19.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:19 smithi142 ceph-mon[69118]: pgmap v398: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:21.329 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:21 smithi046 ceph-mon[88928]: pgmap v399: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:21.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:21 smithi142 ceph-mon[69118]: pgmap v399: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:23.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:23 smithi046 ceph-mon[88928]: pgmap v400: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:23.700 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:23 smithi142 ceph-mon[69118]: pgmap v400: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:25.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:25 smithi046 ceph-mon[88928]: pgmap v401: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:25.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:25 smithi142 ceph-mon[69118]: pgmap v401: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:27.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:27 smithi046 ceph-mon[88928]: pgmap v402: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:27.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:27 smithi142 ceph-mon[69118]: pgmap v402: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:28.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:28.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:29.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:29 smithi046 ceph-mon[88928]: pgmap v403: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:29.600 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:29 smithi142 ceph-mon[69118]: pgmap v403: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:31.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:31 smithi046 ceph-mon[88928]: pgmap v404: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:31.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:31 smithi142 ceph-mon[69118]: pgmap v404: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:33.579 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:33 smithi046 ceph-mon[88928]: pgmap v405: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:33.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:33 smithi142 ceph-mon[69118]: pgmap v405: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:35.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:35 smithi046 ceph-mon[88928]: pgmap v406: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:35.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:35 smithi142 ceph-mon[69118]: pgmap v406: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:37.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:37 smithi046 ceph-mon[88928]: pgmap v407: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:37.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:37 smithi142 ceph-mon[69118]: pgmap v407: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:39.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:39 smithi046 ceph-mon[88928]: pgmap v408: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:39.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:39 smithi142 ceph-mon[69118]: pgmap v408: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:41.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:41 smithi142 ceph-mon[69118]: pgmap v409: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:41.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:41 smithi046 ceph-mon[88928]: pgmap v409: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:43.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:43 smithi046 ceph-mon[88928]: pgmap v410: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:43.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:43.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:43 smithi142 ceph-mon[69118]: pgmap v410: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:43.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:45.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:45 smithi046 ceph-mon[88928]: pgmap v411: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:45.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:45 smithi142 ceph-mon[69118]: pgmap v411: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:47.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:47 smithi046 ceph-mon[88928]: pgmap v412: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:47.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:47 smithi142 ceph-mon[69118]: pgmap v412: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:49.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:49 smithi046 ceph-mon[88928]: pgmap v413: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:49.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:49 smithi142 ceph-mon[69118]: pgmap v413: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:51.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:51 smithi142 ceph-mon[69118]: pgmap v414: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:51.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:51 smithi046 ceph-mon[88928]: pgmap v414: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:53.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:53 smithi046 ceph-mon[88928]: pgmap v415: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:53.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:53 smithi142 ceph-mon[69118]: pgmap v415: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:55.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:55 smithi046 ceph-mon[88928]: pgmap v416: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:55.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:55 smithi142 ceph-mon[69118]: pgmap v416: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:57.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:57 smithi046 ceph-mon[88928]: pgmap v417: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:57.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:57 smithi142 ceph-mon[69118]: pgmap v417: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:58.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:59.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:16:59 smithi046 ceph-mon[88928]: pgmap v418: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:16:59.599 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:16:59 smithi142 ceph-mon[69118]: pgmap v418: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:01.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:01 smithi046 ceph-mon[88928]: pgmap v419: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:01 smithi142 ceph-mon[69118]: pgmap v419: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:03.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:03 smithi046 ceph-mon[88928]: pgmap v420: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:03.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:03 smithi142 ceph-mon[69118]: pgmap v420: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:05.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:05 smithi046 ceph-mon[88928]: pgmap v421: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:05.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:05 smithi142 ceph-mon[69118]: pgmap v421: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:07.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:07 smithi046 ceph-mon[88928]: pgmap v422: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:07.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:07 smithi142 ceph-mon[69118]: pgmap v422: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:09.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:09 smithi046 ceph-mon[88928]: pgmap v423: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:09.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:09 smithi142 ceph-mon[69118]: pgmap v423: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:11.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:11 smithi046 ceph-mon[88928]: pgmap v424: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:11.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:11 smithi142 ceph-mon[69118]: pgmap v424: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:13.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:13 smithi046 ceph-mon[88928]: pgmap v425: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:13.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:13.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:13 smithi142 ceph-mon[69118]: pgmap v425: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:13.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:15.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:15 smithi046 ceph-mon[88928]: pgmap v426: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:15.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:15 smithi142 ceph-mon[69118]: pgmap v426: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:16.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:16 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:17:16.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:16 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:17:17.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:17 smithi046 ceph-mon[88928]: pgmap v427: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:17.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:17:17.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:17:17.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:17:17.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:17 smithi142 ceph-mon[69118]: pgmap v427: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:17.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:17:17.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:17:17.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:17:19.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:19 smithi142 ceph-mon[69118]: pgmap v428: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:19.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:19 smithi046 ceph-mon[88928]: pgmap v428: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:21.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:21 smithi142 ceph-mon[69118]: pgmap v429: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:21.761 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:21 smithi046 ceph-mon[88928]: pgmap v429: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:23.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:23 smithi142 ceph-mon[69118]: pgmap v430: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:23.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:23 smithi046 ceph-mon[88928]: pgmap v430: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:25.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:25 smithi142 ceph-mon[69118]: pgmap v431: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:25.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:25 smithi046 ceph-mon[88928]: pgmap v431: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:27.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:27 smithi142 ceph-mon[69118]: pgmap v432: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:27.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:27 smithi046 ceph-mon[88928]: pgmap v432: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:28.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:28.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:29.598 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:29 smithi142 ceph-mon[69118]: pgmap v433: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:29.827 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:29 smithi046 ceph-mon[88928]: pgmap v433: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:31.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:31 smithi142 ceph-mon[69118]: pgmap v434: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:31.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:31 smithi046 ceph-mon[88928]: pgmap v434: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:33.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:33 smithi142 ceph-mon[69118]: pgmap v435: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:33.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:33 smithi046 ceph-mon[88928]: pgmap v435: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:35.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:35 smithi142 ceph-mon[69118]: pgmap v436: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:35.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:35 smithi046 ceph-mon[88928]: pgmap v436: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:37.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:37 smithi142 ceph-mon[69118]: pgmap v437: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:37.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:37 smithi046 ceph-mon[88928]: pgmap v437: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:39 smithi142 ceph-mon[69118]: pgmap v438: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:39.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:39 smithi046 ceph-mon[88928]: pgmap v438: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:41.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:41 smithi142 ceph-mon[69118]: pgmap v439: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:41.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:41 smithi046 ceph-mon[88928]: pgmap v439: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:43.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:43 smithi142 ceph-mon[69118]: pgmap v440: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:43.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:43.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:43 smithi046 ceph-mon[88928]: pgmap v440: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:43.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:45.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:45 smithi142 ceph-mon[69118]: pgmap v441: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:45.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:45 smithi046 ceph-mon[88928]: pgmap v441: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:47.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:47 smithi142 ceph-mon[69118]: pgmap v442: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:47.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:47 smithi046 ceph-mon[88928]: pgmap v442: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:49.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:49 smithi142 ceph-mon[69118]: pgmap v443: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:49.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:49 smithi046 ceph-mon[88928]: pgmap v443: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:51.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:51 smithi142 ceph-mon[69118]: pgmap v444: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:51.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:51 smithi046 ceph-mon[88928]: pgmap v444: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:53.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:53 smithi142 ceph-mon[69118]: pgmap v445: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:53.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:53 smithi046 ceph-mon[88928]: pgmap v445: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:55 smithi142 ceph-mon[69118]: pgmap v446: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:55.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:55 smithi046 ceph-mon[88928]: pgmap v446: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:57.576 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:57 smithi046 ceph-mon[88928]: pgmap v447: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:57.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:57 smithi142 ceph-mon[69118]: pgmap v447: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:58.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:59.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:17:59 smithi142 ceph-mon[69118]: pgmap v448: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:17:59.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:17:59 smithi046 ceph-mon[88928]: pgmap v448: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:01 smithi142 ceph-mon[69118]: pgmap v449: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:01.826 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:01 smithi046 ceph-mon[88928]: pgmap v449: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:03.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:03 smithi142 ceph-mon[69118]: pgmap v450: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:03.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:03 smithi046 ceph-mon[88928]: pgmap v450: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:05.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:05 smithi142 ceph-mon[69118]: pgmap v451: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:05.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:05 smithi046 ceph-mon[88928]: pgmap v451: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:07.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:07 smithi046 ceph-mon[88928]: pgmap v452: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:07.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:07 smithi142 ceph-mon[69118]: pgmap v452: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:09.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:09 smithi142 ceph-mon[69118]: pgmap v453: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:09.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:09 smithi046 ceph-mon[88928]: pgmap v453: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:11.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:11 smithi142 ceph-mon[69118]: pgmap v454: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:11.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:11 smithi046 ceph-mon[88928]: pgmap v454: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:13.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:13 smithi142 ceph-mon[69118]: pgmap v455: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:13.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:13.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:13 smithi046 ceph-mon[88928]: pgmap v455: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:13.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:15.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:15 smithi142 ceph-mon[69118]: pgmap v456: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:15.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:15 smithi046 ceph-mon[88928]: pgmap v456: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:17.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:17 smithi142 ceph-mon[69118]: pgmap v457: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:17.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:18:17.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:17 smithi046 ceph-mon[88928]: pgmap v457: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:17.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:18:18.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:18 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:18:18.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:18 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:18:18.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:18 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:18:18.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:18 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:18:18.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:18 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:18:18.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:18 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:18:19.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:19 smithi142 ceph-mon[69118]: pgmap v458: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:20.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:19 smithi046 ceph-mon[88928]: pgmap v458: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:21.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:21 smithi142 ceph-mon[69118]: pgmap v459: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:22.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:21 smithi046 ceph-mon[88928]: pgmap v459: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:23.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:23 smithi142 ceph-mon[69118]: pgmap v460: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:24.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:23 smithi046 ceph-mon[88928]: pgmap v460: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:25.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:25 smithi142 ceph-mon[69118]: pgmap v461: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:26.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:25 smithi046 ceph-mon[88928]: pgmap v461: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:27.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:27 smithi046 ceph-mon[88928]: pgmap v462: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:27.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:27 smithi142 ceph-mon[69118]: pgmap v462: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:28.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:29.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:29.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:29 smithi142 ceph-mon[69118]: pgmap v463: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:30.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:29 smithi046 ceph-mon[88928]: pgmap v463: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:31.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:31 smithi142 ceph-mon[69118]: pgmap v464: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:32.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:31 smithi046 ceph-mon[88928]: pgmap v464: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:34.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:33 smithi046 ceph-mon[88928]: pgmap v465: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:34.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:33 smithi142 ceph-mon[69118]: pgmap v465: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:36.075 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:35 smithi046 ceph-mon[88928]: pgmap v466: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:36.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:35 smithi142 ceph-mon[69118]: pgmap v466: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:37.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:36 smithi046 ceph-mon[88928]: pgmap v467: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:37.154 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:36 smithi142 ceph-mon[69118]: pgmap v467: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:39.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:38 smithi142 ceph-mon[69118]: pgmap v468: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:39.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:38 smithi046 ceph-mon[88928]: pgmap v468: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:41.194 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:40 smithi142 ceph-mon[69118]: pgmap v469: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:41.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:40 smithi046 ceph-mon[88928]: pgmap v469: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:43.194 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:42 smithi142 ceph-mon[69118]: pgmap v470: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:43.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:43.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:42 smithi046 ceph-mon[88928]: pgmap v470: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:43.325 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:45.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:45 smithi046 ceph-mon[88928]: pgmap v471: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:45.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:45 smithi142 ceph-mon[69118]: pgmap v471: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:47.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:47 smithi046 ceph-mon[88928]: pgmap v472: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:47.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:47 smithi142 ceph-mon[69118]: pgmap v472: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:49.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:49 smithi046 ceph-mon[88928]: pgmap v473: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:49.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:49 smithi142 ceph-mon[69118]: pgmap v473: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:51.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:51 smithi046 ceph-mon[88928]: pgmap v474: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:51.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:51 smithi142 ceph-mon[69118]: pgmap v474: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:53.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:53 smithi046 ceph-mon[88928]: pgmap v475: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:53.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:53 smithi142 ceph-mon[69118]: pgmap v475: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:55.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:55 smithi046 ceph-mon[88928]: pgmap v476: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:55.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:55 smithi142 ceph-mon[69118]: pgmap v476: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:57.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:57 smithi046 ceph-mon[88928]: pgmap v477: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:57.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:57 smithi142 ceph-mon[69118]: pgmap v477: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:58.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:58.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:59.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:18:59 smithi046 ceph-mon[88928]: pgmap v478: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:18:59.595 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:18:59 smithi142 ceph-mon[69118]: pgmap v478: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:01.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:01 smithi046 ceph-mon[88928]: pgmap v479: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:01.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:01 smithi142 ceph-mon[69118]: pgmap v479: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:03.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:03 smithi046 ceph-mon[88928]: pgmap v480: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:03.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:03 smithi142 ceph-mon[69118]: pgmap v480: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:05.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:05 smithi046 ceph-mon[88928]: pgmap v481: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:05.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:05 smithi142 ceph-mon[69118]: pgmap v481: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:07.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:07 smithi046 ceph-mon[88928]: pgmap v482: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:07.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:07 smithi142 ceph-mon[69118]: pgmap v482: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:09.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:09 smithi046 ceph-mon[88928]: pgmap v483: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:09.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:09 smithi142 ceph-mon[69118]: pgmap v483: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:11.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:11 smithi046 ceph-mon[88928]: pgmap v484: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:11.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:11 smithi142 ceph-mon[69118]: pgmap v484: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:13.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:13 smithi046 ceph-mon[88928]: pgmap v485: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:13.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:13.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:13 smithi142 ceph-mon[69118]: pgmap v485: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:13.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:15.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:15 smithi046 ceph-mon[88928]: pgmap v486: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:15.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:15 smithi142 ceph-mon[69118]: pgmap v486: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:17.550 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:17 smithi142 ceph-mon[69118]: pgmap v487: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:17.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:17 smithi046 ceph-mon[88928]: pgmap v487: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:18.324 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:18 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:19:18.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:18 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:19:19.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:19 smithi046 ceph-mon[88928]: pgmap v488: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:19.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:19:19.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:19:19.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:19:19.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:19 smithi142 ceph-mon[69118]: pgmap v488: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:19.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:19:19.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:19:19.694 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:19:21.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:21 smithi046 ceph-mon[88928]: pgmap v489: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:21.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:21 smithi142 ceph-mon[69118]: pgmap v489: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:23.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:23 smithi046 ceph-mon[88928]: pgmap v490: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:23.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:23 smithi142 ceph-mon[69118]: pgmap v490: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:25.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:25 smithi046 ceph-mon[88928]: pgmap v491: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:25.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:25 smithi142 ceph-mon[69118]: pgmap v491: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:27.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:27 smithi046 ceph-mon[88928]: pgmap v492: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:27.649 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:27 smithi142 ceph-mon[69118]: pgmap v492: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:28.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:28.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:29.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:29 smithi046 ceph-mon[88928]: pgmap v493: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:29.594 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:29 smithi142 ceph-mon[69118]: pgmap v493: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:31.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:31 smithi046 ceph-mon[88928]: pgmap v494: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:31.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:31 smithi142 ceph-mon[69118]: pgmap v494: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:33.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:33 smithi046 ceph-mon[88928]: pgmap v495: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:33.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:33 smithi142 ceph-mon[69118]: pgmap v495: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:35.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:35 smithi046 ceph-mon[88928]: pgmap v496: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:35.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:35 smithi142 ceph-mon[69118]: pgmap v496: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:37.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:37 smithi046 ceph-mon[88928]: pgmap v497: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:37.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:37 smithi142 ceph-mon[69118]: pgmap v497: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:39.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:39 smithi046 ceph-mon[88928]: pgmap v498: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:39.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:39 smithi142 ceph-mon[69118]: pgmap v498: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:41.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:41 smithi046 ceph-mon[88928]: pgmap v499: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:41.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:41 smithi142 ceph-mon[69118]: pgmap v499: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:43.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:43 smithi046 ceph-mon[88928]: pgmap v500: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:43.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:43.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:43 smithi142 ceph-mon[69118]: pgmap v500: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:43.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:45.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:45 smithi046 ceph-mon[88928]: pgmap v501: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:45.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:45 smithi142 ceph-mon[69118]: pgmap v501: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:47.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:47 smithi046 ceph-mon[88928]: pgmap v502: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:47.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:47 smithi142 ceph-mon[69118]: pgmap v502: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:49.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:49 smithi046 ceph-mon[88928]: pgmap v503: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:49.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:49 smithi142 ceph-mon[69118]: pgmap v503: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:51.572 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:51 smithi046 ceph-mon[88928]: pgmap v504: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:51.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:51 smithi142 ceph-mon[69118]: pgmap v504: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:53.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:53 smithi046 ceph-mon[88928]: pgmap v505: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:53.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:53 smithi142 ceph-mon[69118]: pgmap v505: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:55.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:55 smithi046 ceph-mon[88928]: pgmap v506: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:55.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:55 smithi142 ceph-mon[69118]: pgmap v506: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:57.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:57 smithi046 ceph-mon[88928]: pgmap v507: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:57.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:57 smithi142 ceph-mon[69118]: pgmap v507: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:58.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:58.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:59.594 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:19:59 smithi142 ceph-mon[69118]: pgmap v508: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:19:59.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:19:59 smithi046 ceph-mon[88928]: pgmap v508: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:00.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:00 smithi142 ceph-mon[69118]: overall HEALTH_OK 2024-02-19T19:20:00.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:00 smithi046 ceph-mon[88928]: overall HEALTH_OK 2024-02-19T19:20:01.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:01 smithi142 ceph-mon[69118]: pgmap v509: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:01.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:01 smithi046 ceph-mon[88928]: pgmap v509: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:03.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:03 smithi142 ceph-mon[69118]: pgmap v510: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:03.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:03 smithi046 ceph-mon[88928]: pgmap v510: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:05.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:05 smithi142 ceph-mon[69118]: pgmap v511: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:05.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:05 smithi046 ceph-mon[88928]: pgmap v511: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:07.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:07 smithi142 ceph-mon[69118]: pgmap v512: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:07.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:07 smithi046 ceph-mon[88928]: pgmap v512: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:09.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:09 smithi142 ceph-mon[69118]: pgmap v513: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:09.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:09 smithi046 ceph-mon[88928]: pgmap v513: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:11.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:11 smithi142 ceph-mon[69118]: pgmap v514: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:11.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:11 smithi046 ceph-mon[88928]: pgmap v514: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:13.681 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:13 smithi046 ceph-mon[88928]: pgmap v515: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:13.681 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:13.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:13 smithi142 ceph-mon[69118]: pgmap v515: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:13.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:15.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:15 smithi142 ceph-mon[69118]: pgmap v516: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:15.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:15 smithi046 ceph-mon[88928]: pgmap v516: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:17.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:17 smithi142 ceph-mon[69118]: pgmap v517: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:17.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:17 smithi046 ceph-mon[88928]: pgmap v517: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:19.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:19 smithi142 ceph-mon[69118]: pgmap v518: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:19.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:20:19.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:20:19.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:20:19.693 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:20:19.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:19 smithi046 ceph-mon[88928]: pgmap v518: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:19.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:20:19.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:20:19.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:20:19.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:20:21.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:21 smithi142 ceph-mon[69118]: pgmap v519: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:21.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:21 smithi046 ceph-mon[88928]: pgmap v519: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:23.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:23 smithi142 ceph-mon[69118]: pgmap v520: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:23.794 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:23 smithi046 ceph-mon[88928]: pgmap v520: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:25.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:25 smithi142 ceph-mon[69118]: pgmap v521: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:25.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:25 smithi046 ceph-mon[88928]: pgmap v521: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:27.624 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:27 smithi046 ceph-mon[88928]: pgmap v522: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:27.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:27 smithi142 ceph-mon[69118]: pgmap v522: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:28.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:28.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:29.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:29 smithi142 ceph-mon[69118]: pgmap v523: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:29.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:29 smithi046 ceph-mon[88928]: pgmap v523: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:31.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:31 smithi142 ceph-mon[69118]: pgmap v524: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:31.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:31 smithi046 ceph-mon[88928]: pgmap v524: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:33.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:33 smithi142 ceph-mon[69118]: pgmap v525: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:33.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:33 smithi046 ceph-mon[88928]: pgmap v525: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:35.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:35 smithi142 ceph-mon[69118]: pgmap v526: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:35.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:35 smithi046 ceph-mon[88928]: pgmap v526: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:37.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:37 smithi142 ceph-mon[69118]: pgmap v527: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:37.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:37 smithi046 ceph-mon[88928]: pgmap v527: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:39.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:39 smithi142 ceph-mon[69118]: pgmap v528: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:39.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:39 smithi046 ceph-mon[88928]: pgmap v528: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:41.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:41 smithi142 ceph-mon[69118]: pgmap v529: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:41.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:41 smithi046 ceph-mon[88928]: pgmap v529: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:43.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:43 smithi142 ceph-mon[69118]: pgmap v530: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:43.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:43.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:43 smithi046 ceph-mon[88928]: pgmap v530: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:43.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:45.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:45 smithi142 ceph-mon[69118]: pgmap v531: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:45.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:45 smithi046 ceph-mon[88928]: pgmap v531: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:47.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:47 smithi142 ceph-mon[69118]: pgmap v532: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:47.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:47 smithi046 ceph-mon[88928]: pgmap v532: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:49.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:49 smithi142 ceph-mon[69118]: pgmap v533: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:49.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:49 smithi046 ceph-mon[88928]: pgmap v533: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:51.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:51 smithi142 ceph-mon[69118]: pgmap v534: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:51.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:51 smithi046 ceph-mon[88928]: pgmap v534: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:53.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:53 smithi142 ceph-mon[69118]: pgmap v535: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:53.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:53 smithi046 ceph-mon[88928]: pgmap v535: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:55.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:55 smithi142 ceph-mon[69118]: pgmap v536: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:55.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:55 smithi046 ceph-mon[88928]: pgmap v536: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:57.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:57 smithi142 ceph-mon[69118]: pgmap v537: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:57.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:57 smithi046 ceph-mon[88928]: pgmap v537: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:58.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:58.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:59.571 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:20:59 smithi046 ceph-mon[88928]: pgmap v538: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:20:59.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:20:59 smithi142 ceph-mon[69118]: pgmap v538: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:01.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:01 smithi142 ceph-mon[69118]: pgmap v539: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:01.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:01 smithi046 ceph-mon[88928]: pgmap v539: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:03.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:03 smithi142 ceph-mon[69118]: pgmap v540: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:03.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:03 smithi046 ceph-mon[88928]: pgmap v540: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:05.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:05 smithi142 ceph-mon[69118]: pgmap v541: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:05.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:05 smithi046 ceph-mon[88928]: pgmap v541: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:07.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:07 smithi046 ceph-mon[88928]: pgmap v542: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:07.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:07 smithi142 ceph-mon[69118]: pgmap v542: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:09.571 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:09 smithi046 ceph-mon[88928]: pgmap v543: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:09.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:09 smithi142 ceph-mon[69118]: pgmap v543: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:11.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:11 smithi046 ceph-mon[88928]: pgmap v544: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:11.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:11 smithi142 ceph-mon[69118]: pgmap v544: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:13.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:13 smithi046 ceph-mon[88928]: pgmap v545: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:13.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:13.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:13 smithi142 ceph-mon[69118]: pgmap v545: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:13.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:15.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:15 smithi046 ceph-mon[88928]: pgmap v546: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:15.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:15 smithi142 ceph-mon[69118]: pgmap v546: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:17.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:17 smithi046 ceph-mon[88928]: pgmap v547: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:17.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:17 smithi142 ceph-mon[69118]: pgmap v547: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:19.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:19 smithi046 ceph-mon[88928]: pgmap v548: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:19.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:19 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:21:19.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:19 smithi142 ceph-mon[69118]: pgmap v548: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:19.971 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:19 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:21:20.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:21:20.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:21:20.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:21:20.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:21:20.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:21:20.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:21:21.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:21 smithi046 ceph-mon[88928]: pgmap v549: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:21.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:21 smithi142 ceph-mon[69118]: pgmap v549: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:23.789 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:23 smithi142 ceph-mon[69118]: pgmap v550: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:23.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:23 smithi046 ceph-mon[88928]: pgmap v550: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:25.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:25 smithi046 ceph-mon[88928]: pgmap v551: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:25.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:25 smithi142 ceph-mon[69118]: pgmap v551: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:27.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:27 smithi046 ceph-mon[88928]: pgmap v552: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:27.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:27 smithi142 ceph-mon[69118]: pgmap v552: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:28.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:28.838 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:29.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:29 smithi046 ceph-mon[88928]: pgmap v553: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:29.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:29 smithi142 ceph-mon[69118]: pgmap v553: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:31.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:31 smithi046 ceph-mon[88928]: pgmap v554: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:31.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:31 smithi142 ceph-mon[69118]: pgmap v554: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:33.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:33 smithi046 ceph-mon[88928]: pgmap v555: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:33.887 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:33 smithi142 ceph-mon[69118]: pgmap v555: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:35.821 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:35 smithi046 ceph-mon[88928]: pgmap v556: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:35.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:35 smithi142 ceph-mon[69118]: pgmap v556: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:37.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:37 smithi046 ceph-mon[88928]: pgmap v557: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:37.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:37 smithi142 ceph-mon[69118]: pgmap v557: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:39.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:39 smithi046 ceph-mon[88928]: pgmap v558: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:39.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:39 smithi142 ceph-mon[69118]: pgmap v558: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:41.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:41 smithi046 ceph-mon[88928]: pgmap v559: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:41.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:41 smithi142 ceph-mon[69118]: pgmap v559: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:43.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:43 smithi046 ceph-mon[88928]: pgmap v560: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:43.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:43.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:43 smithi142 ceph-mon[69118]: pgmap v560: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:43.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:45.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:45 smithi046 ceph-mon[88928]: pgmap v561: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:45.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:45 smithi142 ceph-mon[69118]: pgmap v561: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:47.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:47 smithi046 ceph-mon[88928]: pgmap v562: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:47.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:47 smithi142 ceph-mon[69118]: pgmap v562: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:49.760 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:49 smithi046 ceph-mon[88928]: pgmap v563: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:49.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:49 smithi142 ceph-mon[69118]: pgmap v563: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:51.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:51 smithi046 ceph-mon[88928]: pgmap v564: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:51.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:51 smithi142 ceph-mon[69118]: pgmap v564: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:53.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:53 smithi046 ceph-mon[88928]: pgmap v565: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:53.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:53 smithi142 ceph-mon[69118]: pgmap v565: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:55.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:55 smithi046 ceph-mon[88928]: pgmap v566: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:55.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:55 smithi142 ceph-mon[69118]: pgmap v566: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:57.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:57 smithi046 ceph-mon[88928]: pgmap v567: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:57.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:57 smithi142 ceph-mon[69118]: pgmap v567: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:58.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:58.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:59.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:21:59 smithi046 ceph-mon[88928]: pgmap v568: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:21:59.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:21:59 smithi142 ceph-mon[69118]: pgmap v568: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:01.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:01 smithi046 ceph-mon[88928]: pgmap v569: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:01.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:01 smithi142 ceph-mon[69118]: pgmap v569: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:03.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:03 smithi046 ceph-mon[88928]: pgmap v570: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:03.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:03 smithi142 ceph-mon[69118]: pgmap v570: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:05.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:05 smithi046 ceph-mon[88928]: pgmap v571: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:05.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:05 smithi142 ceph-mon[69118]: pgmap v571: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:07.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:07 smithi046 ceph-mon[88928]: pgmap v572: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:07.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:07 smithi142 ceph-mon[69118]: pgmap v572: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:09.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:09 smithi046 ceph-mon[88928]: pgmap v573: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:09.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:09 smithi142 ceph-mon[69118]: pgmap v573: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:11.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:11 smithi046 ceph-mon[88928]: pgmap v574: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:11.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:11 smithi142 ceph-mon[69118]: pgmap v574: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:13.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:13 smithi046 ceph-mon[88928]: pgmap v575: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:13.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:13.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:13 smithi142 ceph-mon[69118]: pgmap v575: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:13.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:15.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:15 smithi046 ceph-mon[88928]: pgmap v576: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:15.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:15 smithi142 ceph-mon[69118]: pgmap v576: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:17.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:17 smithi046 ceph-mon[88928]: pgmap v577: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:17.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:17 smithi142 ceph-mon[69118]: pgmap v577: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:19.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:19 smithi142 ceph-mon[69118]: pgmap v578: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:19.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:19 smithi046 ceph-mon[88928]: pgmap v578: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:20.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:22:20.857 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:22:21.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:21 smithi142 ceph-mon[69118]: pgmap v579: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:21.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:21 smithi046 ceph-mon[88928]: pgmap v579: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:23.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:23 smithi046 ceph-mon[88928]: pgmap v580: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:23.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:22:23.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:22:23.440 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:23 smithi142 ceph-mon[69118]: pgmap v580: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:23.440 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:22:23.440 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:22:25.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:25 smithi046 ceph-mon[88928]: pgmap v581: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:25.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:22:25.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:22:25.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:22:25.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:22:25.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:22:25.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:25 smithi142 ceph-mon[69118]: pgmap v581: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:25.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:22:25.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:22:25.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:22:25.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:22:25.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:22:27.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:27 smithi046 ceph-mon[88928]: pgmap v582: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:27.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:27 smithi142 ceph-mon[69118]: pgmap v582: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:28.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:28.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:29.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:29 smithi046 ceph-mon[88928]: pgmap v583: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:29.591 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:29 smithi142 ceph-mon[69118]: pgmap v583: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:31.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:31 smithi046 ceph-mon[88928]: pgmap v584: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:31.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:31 smithi142 ceph-mon[69118]: pgmap v584: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:33.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:33 smithi046 ceph-mon[88928]: pgmap v585: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:33.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:33 smithi142 ceph-mon[69118]: pgmap v585: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:35.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:35 smithi046 ceph-mon[88928]: pgmap v586: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:35 smithi142 ceph-mon[69118]: pgmap v586: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:37.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:37 smithi046 ceph-mon[88928]: pgmap v587: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:37.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:37 smithi142 ceph-mon[69118]: pgmap v587: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:39.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:39 smithi046 ceph-mon[88928]: pgmap v588: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:39.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:39 smithi142 ceph-mon[69118]: pgmap v588: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:41.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:41 smithi046 ceph-mon[88928]: pgmap v589: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:41.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:41 smithi142 ceph-mon[69118]: pgmap v589: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:43.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:43 smithi046 ceph-mon[88928]: pgmap v590: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:43.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:43.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:43 smithi142 ceph-mon[69118]: pgmap v590: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:43.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:45.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:45 smithi046 ceph-mon[88928]: pgmap v591: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:45.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:45 smithi142 ceph-mon[69118]: pgmap v591: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:47.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:47 smithi046 ceph-mon[88928]: pgmap v592: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:47.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:47 smithi142 ceph-mon[69118]: pgmap v592: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:49.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:49 smithi046 ceph-mon[88928]: pgmap v593: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:49.631 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:49 smithi142 ceph-mon[69118]: pgmap v593: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:51.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:51 smithi046 ceph-mon[88928]: pgmap v594: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:51.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:51 smithi142 ceph-mon[69118]: pgmap v594: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:53.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:53 smithi046 ceph-mon[88928]: pgmap v595: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:53.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:53 smithi142 ceph-mon[69118]: pgmap v595: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:55.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:55 smithi046 ceph-mon[88928]: pgmap v596: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:55.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:55 smithi142 ceph-mon[69118]: pgmap v596: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:57.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:57 smithi142 ceph-mon[69118]: pgmap v597: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:57.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:57 smithi046 ceph-mon[88928]: pgmap v597: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:58.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:58.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:59.590 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:22:59 smithi142 ceph-mon[69118]: pgmap v598: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:22:59.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:22:59 smithi046 ceph-mon[88928]: pgmap v598: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:01.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:01 smithi142 ceph-mon[69118]: pgmap v599: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:01.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:01 smithi046 ceph-mon[88928]: pgmap v599: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:03.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:03 smithi142 ceph-mon[69118]: pgmap v600: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:03.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:03 smithi046 ceph-mon[88928]: pgmap v600: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:05.608 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:05 smithi046 ceph-mon[88928]: pgmap v601: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:05.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:05 smithi142 ceph-mon[69118]: pgmap v601: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:07.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:07 smithi142 ceph-mon[69118]: pgmap v602: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:07.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:07 smithi046 ceph-mon[88928]: pgmap v602: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:09.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:09 smithi142 ceph-mon[69118]: pgmap v603: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:09.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:09 smithi046 ceph-mon[88928]: pgmap v603: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:11.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:11 smithi142 ceph-mon[69118]: pgmap v604: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:11.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:11 smithi046 ceph-mon[88928]: pgmap v604: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:13.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:13 smithi142 ceph-mon[69118]: pgmap v605: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:13.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:13.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:13 smithi046 ceph-mon[88928]: pgmap v605: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:13.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:15.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:15 smithi142 ceph-mon[69118]: pgmap v606: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:15.720 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:15 smithi046 ceph-mon[88928]: pgmap v606: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:17.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:17 smithi142 ceph-mon[69118]: pgmap v607: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:17.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:17 smithi046 ceph-mon[88928]: pgmap v607: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:19.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:19 smithi142 ceph-mon[69118]: pgmap v608: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:19.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:19 smithi046 ceph-mon[88928]: pgmap v608: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:21.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:21 smithi142 ceph-mon[69118]: pgmap v609: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:21.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:21 smithi046 ceph-mon[88928]: pgmap v609: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:23.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:23 smithi142 ceph-mon[69118]: pgmap v610: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:23.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:23 smithi046 ceph-mon[88928]: pgmap v610: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:25.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:25 smithi142 ceph-mon[69118]: pgmap v611: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:25.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:23:25.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:25 smithi046 ceph-mon[88928]: pgmap v611: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:25.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:23:26.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:23:26.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:23:26.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:23:26.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:23:26.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:23:26.939 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:23:26.939 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:23:26.939 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:23:26.939 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:23:26.939 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:23:27.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:27 smithi046 ceph-mon[88928]: pgmap v612: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:27.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:27 smithi142 ceph-mon[69118]: pgmap v612: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:28.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:28.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:29.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:29 smithi046 ceph-mon[88928]: pgmap v613: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:29.840 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:29 smithi142 ceph-mon[69118]: pgmap v613: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:31.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:31 smithi046 ceph-mon[88928]: pgmap v614: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:31.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:31 smithi142 ceph-mon[69118]: pgmap v614: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:33.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:33 smithi046 ceph-mon[88928]: pgmap v615: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:33.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:33 smithi142 ceph-mon[69118]: pgmap v615: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:35.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:35 smithi046 ceph-mon[88928]: pgmap v616: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:35.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:35 smithi142 ceph-mon[69118]: pgmap v616: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:37.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:37 smithi046 ceph-mon[88928]: pgmap v617: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:37.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:37 smithi142 ceph-mon[69118]: pgmap v617: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:39.819 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:39 smithi046 ceph-mon[88928]: pgmap v618: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:39.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:39 smithi142 ceph-mon[69118]: pgmap v618: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:41.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:41 smithi046 ceph-mon[88928]: pgmap v619: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:41.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:41 smithi142 ceph-mon[69118]: pgmap v619: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:43.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:43 smithi046 ceph-mon[88928]: pgmap v620: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:43.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:43.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:43 smithi142 ceph-mon[69118]: pgmap v620: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:43.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:45.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:45 smithi046 ceph-mon[88928]: pgmap v621: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:45.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:45 smithi142 ceph-mon[69118]: pgmap v621: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:47.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:47 smithi046 ceph-mon[88928]: pgmap v622: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:47.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:47 smithi142 ceph-mon[69118]: pgmap v622: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:49.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:49 smithi046 ceph-mon[88928]: pgmap v623: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:49.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:49 smithi142 ceph-mon[69118]: pgmap v623: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:51.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:51 smithi142 ceph-mon[69118]: pgmap v624: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:52.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:51 smithi046 ceph-mon[88928]: pgmap v624: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:53.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:53 smithi142 ceph-mon[69118]: pgmap v625: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:54.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:53 smithi046 ceph-mon[88928]: pgmap v625: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:55.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:55 smithi142 ceph-mon[69118]: pgmap v626: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:56.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:55 smithi046 ceph-mon[88928]: pgmap v626: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:57.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:57 smithi142 ceph-mon[69118]: pgmap v627: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:58.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:57 smithi046 ceph-mon[88928]: pgmap v627: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:23:58.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:59.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:59.839 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:23:59 smithi142 ceph-mon[69118]: pgmap v628: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:00.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:23:59 smithi046 ceph-mon[88928]: pgmap v628: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:01.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:01 smithi046 ceph-mon[88928]: pgmap v629: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:01.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:01 smithi142 ceph-mon[69118]: pgmap v629: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:03.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:03 smithi142 ceph-mon[69118]: pgmap v630: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:04.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:03 smithi046 ceph-mon[88928]: pgmap v630: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:05.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:05 smithi142 ceph-mon[69118]: pgmap v631: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:06.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:05 smithi046 ceph-mon[88928]: pgmap v631: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:07.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:07 smithi142 ceph-mon[69118]: pgmap v632: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:08.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:07 smithi046 ceph-mon[88928]: pgmap v632: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:09.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:09 smithi142 ceph-mon[69118]: pgmap v633: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:10.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:09 smithi046 ceph-mon[88928]: pgmap v633: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:11.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:11 smithi142 ceph-mon[69118]: pgmap v634: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:12.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:11 smithi046 ceph-mon[88928]: pgmap v634: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:13.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:13 smithi142 ceph-mon[69118]: pgmap v635: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:13.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:14.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:13 smithi046 ceph-mon[88928]: pgmap v635: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:14.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:15.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:15 smithi142 ceph-mon[69118]: pgmap v636: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:16.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:15 smithi046 ceph-mon[88928]: pgmap v636: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:17.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:17 smithi142 ceph-mon[69118]: pgmap v637: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:18.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:17 smithi046 ceph-mon[88928]: pgmap v637: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:19.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:19 smithi142 ceph-mon[69118]: pgmap v638: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:20.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:19 smithi046 ceph-mon[88928]: pgmap v638: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:21.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:21 smithi046 ceph-mon[88928]: pgmap v639: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:21.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:21 smithi142 ceph-mon[69118]: pgmap v639: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:23.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:23 smithi142 ceph-mon[69118]: pgmap v640: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:24.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:23 smithi046 ceph-mon[88928]: pgmap v640: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:25.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:25 smithi142 ceph-mon[69118]: pgmap v641: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:26.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:25 smithi046 ceph-mon[88928]: pgmap v641: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:26.817 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:24:26.937 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:24:27.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:27 smithi142 ceph-mon[69118]: pgmap v642: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:27.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:24:27.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:24:27.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:24:28.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:27 smithi046 ceph-mon[88928]: pgmap v642: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:28.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:24:28.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:24:28.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:24:28.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:28.969 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:29.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:29 smithi142 ceph-mon[69118]: pgmap v643: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:30.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:29 smithi046 ceph-mon[88928]: pgmap v643: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:31.818 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:31 smithi046 ceph-mon[88928]: pgmap v644: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:31.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:31 smithi142 ceph-mon[69118]: pgmap v644: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:33.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:33 smithi142 ceph-mon[69118]: pgmap v645: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:34.068 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:33 smithi046 ceph-mon[88928]: pgmap v645: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:35.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:35 smithi142 ceph-mon[69118]: pgmap v646: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:36.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:35 smithi046 ceph-mon[88928]: pgmap v646: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:37.937 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:37 smithi142 ceph-mon[69118]: pgmap v647: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:38.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:37 smithi046 ceph-mon[88928]: pgmap v647: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:39.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:39 smithi142 ceph-mon[69118]: pgmap v648: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:40.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:39 smithi046 ceph-mon[88928]: pgmap v648: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:41.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:41 smithi142 ceph-mon[69118]: pgmap v649: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:42.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:41 smithi046 ceph-mon[88928]: pgmap v649: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:43.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:43 smithi142 ceph-mon[69118]: pgmap v650: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:43.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:44.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:43 smithi046 ceph-mon[88928]: pgmap v650: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:44.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:45.937 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:45 smithi142 ceph-mon[69118]: pgmap v651: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:46.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:45 smithi046 ceph-mon[88928]: pgmap v651: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:47.937 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:47 smithi142 ceph-mon[69118]: pgmap v652: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:48.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:47 smithi046 ceph-mon[88928]: pgmap v652: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:49.937 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:49 smithi142 ceph-mon[69118]: pgmap v653: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:50.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:49 smithi046 ceph-mon[88928]: pgmap v653: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:51.937 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:51 smithi142 ceph-mon[69118]: pgmap v654: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:52.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:51 smithi046 ceph-mon[88928]: pgmap v654: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:53.937 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:53 smithi142 ceph-mon[69118]: pgmap v655: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:54.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:53 smithi046 ceph-mon[88928]: pgmap v655: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:55.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:55 smithi142 ceph-mon[69118]: pgmap v656: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:56.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:55 smithi046 ceph-mon[88928]: pgmap v656: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:57.937 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:57 smithi142 ceph-mon[69118]: pgmap v657: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:58.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:57 smithi046 ceph-mon[88928]: pgmap v657: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:24:58.937 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:59.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:00.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:24:59 smithi046 ceph-mon[88928]: pgmap v658: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:00.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:24:59 smithi142 ceph-mon[69118]: pgmap v658: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:02.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:01 smithi046 ceph-mon[88928]: pgmap v659: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:02.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:01 smithi142 ceph-mon[69118]: pgmap v659: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:04.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:03 smithi046 ceph-mon[88928]: pgmap v660: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:04.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:03 smithi142 ceph-mon[69118]: pgmap v660: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:05.970 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:05 smithi142 ceph-mon[69118]: pgmap v661: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:06.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:05 smithi046 ceph-mon[88928]: pgmap v661: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:08.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:07 smithi046 ceph-mon[88928]: pgmap v662: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:08.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:07 smithi142 ceph-mon[69118]: pgmap v662: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:10.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:09 smithi046 ceph-mon[88928]: pgmap v663: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:10.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:09 smithi142 ceph-mon[69118]: pgmap v663: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:12.016 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:11 smithi046 ceph-mon[88928]: pgmap v664: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:12.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:11 smithi142 ceph-mon[69118]: pgmap v664: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:14.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:13 smithi046 ceph-mon[88928]: pgmap v665: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:14.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:14.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:13 smithi142 ceph-mon[69118]: pgmap v665: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:14.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:16.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:15 smithi046 ceph-mon[88928]: pgmap v666: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:16.069 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:15 smithi142 ceph-mon[69118]: pgmap v666: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:18.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:17 smithi046 ceph-mon[88928]: pgmap v667: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:18.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:17 smithi142 ceph-mon[69118]: pgmap v667: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:20.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:19 smithi046 ceph-mon[88928]: pgmap v668: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:20.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:19 smithi142 ceph-mon[69118]: pgmap v668: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:22.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:21 smithi046 ceph-mon[88928]: pgmap v669: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:22.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:21 smithi142 ceph-mon[69118]: pgmap v669: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:24.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:23 smithi046 ceph-mon[88928]: pgmap v670: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:24.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:23 smithi142 ceph-mon[69118]: pgmap v670: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:26.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:25 smithi046 ceph-mon[88928]: pgmap v671: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:26.167 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:25 smithi142 ceph-mon[69118]: pgmap v671: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:28.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:27 smithi046 ceph-mon[88928]: pgmap v672: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:28.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:25:28.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:25:28.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:25:28.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:27 smithi142 ceph-mon[69118]: pgmap v672: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:28.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:25:28.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:25:28.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:25:29.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:29.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:25:29.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:25:29.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:25:29.088 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:29.089 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:25:29.089 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:25:29.089 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:25:30.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:29 smithi046 ceph-mon[88928]: pgmap v673: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:30.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:29 smithi142 ceph-mon[69118]: pgmap v673: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:32.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:31 smithi046 ceph-mon[88928]: pgmap v674: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:32.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:31 smithi142 ceph-mon[69118]: pgmap v674: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:34.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:33 smithi046 ceph-mon[88928]: pgmap v675: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:34.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:33 smithi142 ceph-mon[69118]: pgmap v675: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:36.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:35 smithi046 ceph-mon[88928]: pgmap v676: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:36.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:35 smithi142 ceph-mon[69118]: pgmap v676: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:38.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:37 smithi046 ceph-mon[88928]: pgmap v677: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:38.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:37 smithi142 ceph-mon[69118]: pgmap v677: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:40.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:39 smithi046 ceph-mon[88928]: pgmap v678: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:40.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:39 smithi142 ceph-mon[69118]: pgmap v678: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:42.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:41 smithi046 ceph-mon[88928]: pgmap v679: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:42.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:41 smithi142 ceph-mon[69118]: pgmap v679: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:44.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:43 smithi046 ceph-mon[88928]: pgmap v680: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:44.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:44.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:43 smithi142 ceph-mon[69118]: pgmap v680: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:44.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:46.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:45 smithi046 ceph-mon[88928]: pgmap v681: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:46.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:45 smithi142 ceph-mon[69118]: pgmap v681: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:48.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:47 smithi046 ceph-mon[88928]: pgmap v682: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:48.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:47 smithi142 ceph-mon[69118]: pgmap v682: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:50.067 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:49 smithi046 ceph-mon[88928]: pgmap v683: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:50.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:49 smithi142 ceph-mon[69118]: pgmap v683: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:51.066 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:50 smithi046 ceph-mon[88928]: pgmap v684: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:51.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:50 smithi142 ceph-mon[69118]: pgmap v684: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:53.317 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:53 smithi046 ceph-mon[88928]: pgmap v685: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:53.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:53 smithi142 ceph-mon[69118]: pgmap v685: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:55.317 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:55 smithi046 ceph-mon[88928]: pgmap v686: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:55.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:55 smithi142 ceph-mon[69118]: pgmap v686: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:57.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:57 smithi046 ceph-mon[88928]: pgmap v687: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:57.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:57 smithi142 ceph-mon[69118]: pgmap v687: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:58.317 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:58.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:59.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:25:59 smithi046 ceph-mon[88928]: pgmap v688: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:25:59.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:25:59 smithi142 ceph-mon[69118]: pgmap v688: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:01.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:01 smithi046 ceph-mon[88928]: pgmap v689: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:01.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:01 smithi142 ceph-mon[69118]: pgmap v689: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:03.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:03 smithi046 ceph-mon[88928]: pgmap v690: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:03.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:03 smithi142 ceph-mon[69118]: pgmap v690: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:05.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:05 smithi046 ceph-mon[88928]: pgmap v691: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:05.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:05 smithi142 ceph-mon[69118]: pgmap v691: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:07.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:07 smithi046 ceph-mon[88928]: pgmap v692: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:07.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:07 smithi142 ceph-mon[69118]: pgmap v692: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:09.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:09 smithi046 ceph-mon[88928]: pgmap v693: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:09.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:09 smithi142 ceph-mon[69118]: pgmap v693: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:11.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:11 smithi046 ceph-mon[88928]: pgmap v694: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:11.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:11 smithi142 ceph-mon[69118]: pgmap v694: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:13.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:13 smithi046 ceph-mon[88928]: pgmap v695: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:13.317 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:13.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:13 smithi142 ceph-mon[69118]: pgmap v695: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:13.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:15.317 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:15 smithi046 ceph-mon[88928]: pgmap v696: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:15.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:15 smithi142 ceph-mon[69118]: pgmap v696: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:17.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:17 smithi046 ceph-mon[88928]: pgmap v697: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:17.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:17 smithi142 ceph-mon[69118]: pgmap v697: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:19.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:19 smithi046 ceph-mon[88928]: pgmap v698: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:19.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:19 smithi142 ceph-mon[69118]: pgmap v698: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:21.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:21 smithi046 ceph-mon[88928]: pgmap v699: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:21.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:21 smithi142 ceph-mon[69118]: pgmap v699: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:23.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:23 smithi046 ceph-mon[88928]: pgmap v700: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:23.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:23 smithi142 ceph-mon[69118]: pgmap v700: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:25.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:25 smithi142 ceph-mon[69118]: pgmap v701: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:25.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:25 smithi046 ceph-mon[88928]: pgmap v701: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:27.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:27 smithi142 ceph-mon[69118]: pgmap v702: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:27.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:27 smithi046 ceph-mon[88928]: pgmap v702: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:28.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:28.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:29.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:29 smithi142 ceph-mon[69118]: pgmap v703: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:29.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:26:29.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:26:29.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:26:29.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:26:29.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:29 smithi046 ceph-mon[88928]: pgmap v703: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:29.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:26:29.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:26:29.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:26:29.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:26:31.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:31 smithi142 ceph-mon[69118]: pgmap v704: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:31.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:31 smithi046 ceph-mon[88928]: pgmap v704: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:33.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:33 smithi046 ceph-mon[88928]: pgmap v705: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:33.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:33 smithi142 ceph-mon[69118]: pgmap v705: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:35.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:35 smithi142 ceph-mon[69118]: pgmap v706: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:35.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:35 smithi046 ceph-mon[88928]: pgmap v706: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:37.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:37 smithi142 ceph-mon[69118]: pgmap v707: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:37.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:37 smithi046 ceph-mon[88928]: pgmap v707: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:39.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:39 smithi142 ceph-mon[69118]: pgmap v708: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:39.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:39 smithi046 ceph-mon[88928]: pgmap v708: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:41.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:41 smithi142 ceph-mon[69118]: pgmap v709: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:41.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:41 smithi046 ceph-mon[88928]: pgmap v709: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:43.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:43 smithi046 ceph-mon[88928]: pgmap v710: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:43.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:43.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:43 smithi142 ceph-mon[69118]: pgmap v710: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:43.437 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:45.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:45 smithi142 ceph-mon[69118]: pgmap v711: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:45.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:45 smithi046 ceph-mon[88928]: pgmap v711: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:47.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:47 smithi142 ceph-mon[69118]: pgmap v712: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:47.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:47 smithi046 ceph-mon[88928]: pgmap v712: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:49.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:49 smithi142 ceph-mon[69118]: pgmap v713: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:49.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:49 smithi046 ceph-mon[88928]: pgmap v713: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:51.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:51 smithi142 ceph-mon[69118]: pgmap v714: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:51.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:51 smithi046 ceph-mon[88928]: pgmap v714: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:53.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:53 smithi142 ceph-mon[69118]: pgmap v715: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:53.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:53 smithi046 ceph-mon[88928]: pgmap v715: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:55.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:55 smithi142 ceph-mon[69118]: pgmap v716: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:55.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:55 smithi046 ceph-mon[88928]: pgmap v716: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:57.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:57 smithi142 ceph-mon[69118]: pgmap v717: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:57.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:57 smithi046 ceph-mon[88928]: pgmap v717: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:58.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:58.467 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:59.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:26:59 smithi142 ceph-mon[69118]: pgmap v718: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:26:59.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:26:59 smithi046 ceph-mon[88928]: pgmap v718: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:01.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:01 smithi142 ceph-mon[69118]: pgmap v719: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:01.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:01 smithi046 ceph-mon[88928]: pgmap v719: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:03.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:03 smithi142 ceph-mon[69118]: pgmap v720: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:03.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:03 smithi046 ceph-mon[88928]: pgmap v720: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:05.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:05 smithi046 ceph-mon[88928]: pgmap v721: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:05.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:05 smithi142 ceph-mon[69118]: pgmap v721: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:07.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:07 smithi142 ceph-mon[69118]: pgmap v722: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:07.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:07 smithi046 ceph-mon[88928]: pgmap v722: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:09.565 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:09 smithi046 ceph-mon[88928]: pgmap v723: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:09.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:09 smithi142 ceph-mon[69118]: pgmap v723: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:11.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:11 smithi046 ceph-mon[88928]: pgmap v724: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:11.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:11 smithi142 ceph-mon[69118]: pgmap v724: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:13.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:13 smithi046 ceph-mon[88928]: pgmap v725: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:13.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:13.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:13 smithi142 ceph-mon[69118]: pgmap v725: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:13.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:15.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:15 smithi046 ceph-mon[88928]: pgmap v726: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:15.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:15 smithi142 ceph-mon[69118]: pgmap v726: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:17.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:17 smithi046 ceph-mon[88928]: pgmap v727: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:17.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:17 smithi142 ceph-mon[69118]: pgmap v727: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:19.565 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:19 smithi046 ceph-mon[88928]: pgmap v728: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:19.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:19 smithi142 ceph-mon[69118]: pgmap v728: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:21.565 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:21 smithi046 ceph-mon[88928]: pgmap v729: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:21.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:21 smithi142 ceph-mon[69118]: pgmap v729: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:23.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:23 smithi046 ceph-mon[88928]: pgmap v730: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:23.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:23 smithi142 ceph-mon[69118]: pgmap v730: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:25.566 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:25 smithi046 ceph-mon[88928]: pgmap v731: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:25.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:25 smithi142 ceph-mon[69118]: pgmap v731: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:27.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:27 smithi142 ceph-mon[69118]: pgmap v732: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:27.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:27 smithi046 ceph-mon[88928]: pgmap v732: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:28.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:28.717 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:29.586 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:29 smithi142 ceph-mon[69118]: pgmap v733: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:29.586 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:27:29.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:29 smithi046 ceph-mon[88928]: pgmap v733: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:29.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:27:30.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:30 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:27:30.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:30 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:27:30.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:30 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:27:30.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:30 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:27:30.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:30 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:27:30.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:30 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:27:31.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:31 smithi046 ceph-mon[88928]: pgmap v734: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:31.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:31 smithi142 ceph-mon[69118]: pgmap v734: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:33.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:33 smithi046 ceph-mon[88928]: pgmap v735: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:33.936 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:33 smithi142 ceph-mon[69118]: pgmap v735: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:35.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:35 smithi046 ceph-mon[88928]: pgmap v736: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:35.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:35 smithi142 ceph-mon[69118]: pgmap v736: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:37.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:37 smithi046 ceph-mon[88928]: pgmap v737: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:37.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:37 smithi142 ceph-mon[69118]: pgmap v737: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:39.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:39 smithi046 ceph-mon[88928]: pgmap v738: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:39.936 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:39 smithi142 ceph-mon[69118]: pgmap v738: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:41.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:41 smithi046 ceph-mon[88928]: pgmap v739: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:41.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:41 smithi142 ceph-mon[69118]: pgmap v739: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:43.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:43 smithi046 ceph-mon[88928]: pgmap v740: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:43.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:43.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:43 smithi142 ceph-mon[69118]: pgmap v740: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:43.936 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:45.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:45 smithi046 ceph-mon[88928]: pgmap v741: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:45.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:45 smithi142 ceph-mon[69118]: pgmap v741: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:47.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:47 smithi046 ceph-mon[88928]: pgmap v742: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:47.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:47 smithi142 ceph-mon[69118]: pgmap v742: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:49.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:49 smithi046 ceph-mon[88928]: pgmap v743: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:49.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:49 smithi142 ceph-mon[69118]: pgmap v743: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:51.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:51 smithi142 ceph-mon[69118]: pgmap v744: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:52.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:51 smithi046 ceph-mon[88928]: pgmap v744: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:53.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:53 smithi142 ceph-mon[69118]: pgmap v745: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:54.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:53 smithi046 ceph-mon[88928]: pgmap v745: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:55.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:55 smithi142 ceph-mon[69118]: pgmap v746: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:56.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:55 smithi046 ceph-mon[88928]: pgmap v746: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:57.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:57 smithi142 ceph-mon[69118]: pgmap v747: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:58.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:57 smithi046 ceph-mon[88928]: pgmap v747: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:27:58.876 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:58.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:59.837 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:27:59 smithi142 ceph-mon[69118]: pgmap v748: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:00.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:27:59 smithi046 ceph-mon[88928]: pgmap v748: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:01.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:01 smithi142 ceph-mon[69118]: pgmap v749: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:02.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:01 smithi046 ceph-mon[88928]: pgmap v749: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:03.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:03 smithi046 ceph-mon[88928]: pgmap v750: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:03.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:03 smithi142 ceph-mon[69118]: pgmap v750: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:05.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:05 smithi142 ceph-mon[69118]: pgmap v751: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:06.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:05 smithi046 ceph-mon[88928]: pgmap v751: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:07.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:07 smithi142 ceph-mon[69118]: pgmap v752: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:08.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:07 smithi046 ceph-mon[88928]: pgmap v752: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:09.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:09 smithi142 ceph-mon[69118]: pgmap v753: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:10.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:09 smithi046 ceph-mon[88928]: pgmap v753: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:11.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:11 smithi142 ceph-mon[69118]: pgmap v754: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:12.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:11 smithi046 ceph-mon[88928]: pgmap v754: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:13.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:13 smithi142 ceph-mon[69118]: pgmap v755: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:13.936 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:14.045 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:13 smithi046 ceph-mon[88928]: pgmap v755: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:14.045 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:15.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:15 smithi142 ceph-mon[69118]: pgmap v756: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:16.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:15 smithi046 ceph-mon[88928]: pgmap v756: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:17.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:17 smithi142 ceph-mon[69118]: pgmap v757: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:18.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:17 smithi046 ceph-mon[88928]: pgmap v757: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:19.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:19 smithi142 ceph-mon[69118]: pgmap v758: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:20.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:19 smithi046 ceph-mon[88928]: pgmap v758: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:21.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:21 smithi142 ceph-mon[69118]: pgmap v759: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:22.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:21 smithi046 ceph-mon[88928]: pgmap v759: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:23.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:23 smithi142 ceph-mon[69118]: pgmap v760: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:24.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:23 smithi046 ceph-mon[88928]: pgmap v760: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:25.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:25 smithi142 ceph-mon[69118]: pgmap v761: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:26.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:25 smithi046 ceph-mon[88928]: pgmap v761: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:27.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:27 smithi142 ceph-mon[69118]: pgmap v762: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:28.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:27 smithi046 ceph-mon[88928]: pgmap v762: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:28.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:28.965 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:29.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:29 smithi142 ceph-mon[69118]: pgmap v763: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:29.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:28:30.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:29 smithi046 ceph-mon[88928]: pgmap v763: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:30.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:28:30.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:30 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:28:30.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:30 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:28:30.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:30 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:28:31.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:30 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:28:31.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:30 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:28:31.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:30 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:28:31.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:31 smithi142 ceph-mon[69118]: pgmap v764: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:32.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:31 smithi046 ceph-mon[88928]: pgmap v764: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:33.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:33 smithi142 ceph-mon[69118]: pgmap v765: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:34.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:33 smithi046 ceph-mon[88928]: pgmap v765: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:35.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:35 smithi142 ceph-mon[69118]: pgmap v766: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:36.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:35 smithi046 ceph-mon[88928]: pgmap v766: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:37.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:37 smithi142 ceph-mon[69118]: pgmap v767: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:38.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:37 smithi046 ceph-mon[88928]: pgmap v767: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:39.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:39 smithi142 ceph-mon[69118]: pgmap v768: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:40.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:39 smithi046 ceph-mon[88928]: pgmap v768: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:41.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:41 smithi142 ceph-mon[69118]: pgmap v769: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:42.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:41 smithi046 ceph-mon[88928]: pgmap v769: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:43.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:43 smithi142 ceph-mon[69118]: pgmap v770: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:43.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:44.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:43 smithi046 ceph-mon[88928]: pgmap v770: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:44.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:45.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:45 smithi142 ceph-mon[69118]: pgmap v771: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:46.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:45 smithi046 ceph-mon[88928]: pgmap v771: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:47.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:47 smithi142 ceph-mon[69118]: pgmap v772: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:48.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:47 smithi046 ceph-mon[88928]: pgmap v772: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:49.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:49 smithi046 ceph-mon[88928]: pgmap v773: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:49.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:49 smithi142 ceph-mon[69118]: pgmap v773: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:51.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:51 smithi142 ceph-mon[69118]: pgmap v774: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:52.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:51 smithi046 ceph-mon[88928]: pgmap v774: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:53.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:53 smithi142 ceph-mon[69118]: pgmap v775: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:54.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:53 smithi046 ceph-mon[88928]: pgmap v775: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:55.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:55 smithi142 ceph-mon[69118]: pgmap v776: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:56.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:55 smithi046 ceph-mon[88928]: pgmap v776: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:57.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:57 smithi142 ceph-mon[69118]: pgmap v777: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:58.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:57 smithi046 ceph-mon[88928]: pgmap v777: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:58.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:58.966 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:59.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:28:59 smithi046 ceph-mon[88928]: pgmap v778: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:28:59.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:28:59 smithi142 ceph-mon[69118]: pgmap v778: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:02.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:01 smithi046 ceph-mon[88928]: pgmap v779: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:02.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:01 smithi142 ceph-mon[69118]: pgmap v779: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:04.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:03 smithi046 ceph-mon[88928]: pgmap v780: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:04.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:03 smithi142 ceph-mon[69118]: pgmap v780: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:06.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:05 smithi046 ceph-mon[88928]: pgmap v781: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:06.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:05 smithi142 ceph-mon[69118]: pgmap v781: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:08.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:07 smithi046 ceph-mon[88928]: pgmap v782: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:08.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:07 smithi142 ceph-mon[69118]: pgmap v782: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:10.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:09 smithi046 ceph-mon[88928]: pgmap v783: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:10.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:09 smithi142 ceph-mon[69118]: pgmap v783: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:12.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:11 smithi046 ceph-mon[88928]: pgmap v784: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:12.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:11 smithi142 ceph-mon[69118]: pgmap v784: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:14.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:13 smithi046 ceph-mon[88928]: pgmap v785: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:14.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:14.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:13 smithi142 ceph-mon[69118]: pgmap v785: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:14.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:16.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:15 smithi046 ceph-mon[88928]: pgmap v786: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:16.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:15 smithi142 ceph-mon[69118]: pgmap v786: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:18.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:17 smithi046 ceph-mon[88928]: pgmap v787: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:18.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:17 smithi142 ceph-mon[69118]: pgmap v787: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:20.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:19 smithi046 ceph-mon[88928]: pgmap v788: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:20.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:19 smithi142 ceph-mon[69118]: pgmap v788: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:22.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:21 smithi046 ceph-mon[88928]: pgmap v789: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:22.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:21 smithi142 ceph-mon[69118]: pgmap v789: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:23.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:23 smithi142 ceph-mon[69118]: pgmap v790: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:24.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:23 smithi046 ceph-mon[88928]: pgmap v790: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:26.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:25 smithi046 ceph-mon[88928]: pgmap v791: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:26.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:25 smithi142 ceph-mon[69118]: pgmap v791: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:28.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:27 smithi046 ceph-mon[88928]: pgmap v792: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:28.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:27 smithi142 ceph-mon[69118]: pgmap v792: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:28.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:29.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:30.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:29 smithi046 ceph-mon[88928]: pgmap v793: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:30.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:29 smithi142 ceph-mon[69118]: pgmap v793: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:31.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:30 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:29:31.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:30 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:29:32.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:31 smithi046 ceph-mon[88928]: pgmap v794: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:32.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:29:32.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:29:32.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:29:32.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:31 smithi142 ceph-mon[69118]: pgmap v794: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:32.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:29:32.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:29:32.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:29:33.935 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:33 smithi142 ceph-mon[69118]: pgmap v795: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:34.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:33 smithi046 ceph-mon[88928]: pgmap v795: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:36.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:35 smithi046 ceph-mon[88928]: pgmap v796: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:36.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:35 smithi142 ceph-mon[69118]: pgmap v796: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:38.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:37 smithi046 ceph-mon[88928]: pgmap v797: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:38.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:37 smithi142 ceph-mon[69118]: pgmap v797: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:40.004 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:39 smithi046 ceph-mon[88928]: pgmap v798: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:40.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:39 smithi142 ceph-mon[69118]: pgmap v798: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:42.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:41 smithi046 ceph-mon[88928]: pgmap v799: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:42.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:41 smithi142 ceph-mon[69118]: pgmap v799: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:44.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:43 smithi046 ceph-mon[88928]: pgmap v800: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:44.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:44.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:43 smithi142 ceph-mon[69118]: pgmap v800: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:44.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:46.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:45 smithi046 ceph-mon[88928]: pgmap v801: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:46.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:45 smithi142 ceph-mon[69118]: pgmap v801: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:48.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:47 smithi046 ceph-mon[88928]: pgmap v802: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:48.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:47 smithi142 ceph-mon[69118]: pgmap v802: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:50.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:49 smithi046 ceph-mon[88928]: pgmap v803: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:50.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:49 smithi142 ceph-mon[69118]: pgmap v803: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:52.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:51 smithi046 ceph-mon[88928]: pgmap v804: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:52.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:51 smithi142 ceph-mon[69118]: pgmap v804: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:54.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:53 smithi046 ceph-mon[88928]: pgmap v805: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:54.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:53 smithi142 ceph-mon[69118]: pgmap v805: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:56.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:55 smithi046 ceph-mon[88928]: pgmap v806: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:56.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:55 smithi142 ceph-mon[69118]: pgmap v806: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:58.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:57 smithi046 ceph-mon[88928]: pgmap v807: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:58.065 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:58.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:57 smithi142 ceph-mon[69118]: pgmap v807: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:29:58.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:00.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:29:59 smithi046 ceph-mon[88928]: pgmap v808: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:00.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:29:59 smithi142 ceph-mon[69118]: pgmap v808: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:01.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:00 smithi046 ceph-mon[88928]: overall HEALTH_OK 2024-02-19T19:30:01.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:00 smithi142 ceph-mon[69118]: overall HEALTH_OK 2024-02-19T19:30:02.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:01 smithi046 ceph-mon[88928]: pgmap v809: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:02.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:01 smithi142 ceph-mon[69118]: pgmap v809: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:04.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:03 smithi046 ceph-mon[88928]: pgmap v810: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:04.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:03 smithi142 ceph-mon[69118]: pgmap v810: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:06.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:05 smithi046 ceph-mon[88928]: pgmap v811: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:06.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:05 smithi142 ceph-mon[69118]: pgmap v811: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:08.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:07 smithi046 ceph-mon[88928]: pgmap v812: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:08.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:07 smithi142 ceph-mon[69118]: pgmap v812: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:10.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:09 smithi046 ceph-mon[88928]: pgmap v813: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:10.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:09 smithi142 ceph-mon[69118]: pgmap v813: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:12.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:11 smithi046 ceph-mon[88928]: pgmap v814: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:12.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:11 smithi142 ceph-mon[69118]: pgmap v814: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:13.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:13.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:14.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:13 smithi046 ceph-mon[88928]: pgmap v815: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:14.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:13 smithi142 ceph-mon[69118]: pgmap v815: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:15.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:14 smithi142 ceph-mon[69118]: pgmap v816: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:15.314 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:14 smithi046 ceph-mon[88928]: pgmap v816: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:17.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:17 smithi142 ceph-mon[69118]: pgmap v817: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:17.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:17 smithi046 ceph-mon[88928]: pgmap v817: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:19.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:19 smithi142 ceph-mon[69118]: pgmap v818: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:19.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:19 smithi046 ceph-mon[88928]: pgmap v818: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:21.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:21 smithi142 ceph-mon[69118]: pgmap v819: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:21.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:21 smithi046 ceph-mon[88928]: pgmap v819: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:23.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:23 smithi142 ceph-mon[69118]: pgmap v820: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:23.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:23 smithi046 ceph-mon[88928]: pgmap v820: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:25.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:25 smithi142 ceph-mon[69118]: pgmap v821: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:25.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:25 smithi046 ceph-mon[88928]: pgmap v821: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:27.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:27 smithi142 ceph-mon[69118]: pgmap v822: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:27.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:27 smithi046 ceph-mon[88928]: pgmap v822: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:28.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:28.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:29.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:29 smithi142 ceph-mon[69118]: pgmap v823: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:29.465 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:29 smithi046 ceph-mon[88928]: pgmap v823: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:31.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:31 smithi142 ceph-mon[69118]: pgmap v824: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:31.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:30:31.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:31 smithi046 ceph-mon[88928]: pgmap v824: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:31.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:30:32.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:32 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:30:32.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:32 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:30:32.434 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:32 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:30:32.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:32 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:30:32.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:32 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:30:32.564 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:32 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:30:33.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:33 smithi142 ceph-mon[69118]: pgmap v825: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:34.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:33 smithi046 ceph-mon[88928]: pgmap v825: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:35.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:35 smithi142 ceph-mon[69118]: pgmap v826: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:36.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:35 smithi046 ceph-mon[88928]: pgmap v826: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:37.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:37 smithi142 ceph-mon[69118]: pgmap v827: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:38.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:37 smithi046 ceph-mon[88928]: pgmap v827: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:39.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:39 smithi142 ceph-mon[69118]: pgmap v828: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:40.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:39 smithi046 ceph-mon[88928]: pgmap v828: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:41.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:41 smithi142 ceph-mon[69118]: pgmap v829: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:42.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:41 smithi046 ceph-mon[88928]: pgmap v829: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:43.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:43 smithi142 ceph-mon[69118]: pgmap v830: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:43.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:44.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:43 smithi046 ceph-mon[88928]: pgmap v830: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:44.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:45.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:45 smithi142 ceph-mon[69118]: pgmap v831: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:46.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:45 smithi046 ceph-mon[88928]: pgmap v831: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:47.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:47 smithi142 ceph-mon[69118]: pgmap v832: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:48.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:47 smithi046 ceph-mon[88928]: pgmap v832: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:49.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:49 smithi142 ceph-mon[69118]: pgmap v833: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:50.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:49 smithi046 ceph-mon[88928]: pgmap v833: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:51.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:51 smithi142 ceph-mon[69118]: pgmap v834: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:52.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:51 smithi046 ceph-mon[88928]: pgmap v834: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:53.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:53 smithi142 ceph-mon[69118]: pgmap v835: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:54.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:53 smithi046 ceph-mon[88928]: pgmap v835: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:55.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:55 smithi142 ceph-mon[69118]: pgmap v836: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:56.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:55 smithi046 ceph-mon[88928]: pgmap v836: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:57.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:57 smithi142 ceph-mon[69118]: pgmap v837: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:58.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:57 smithi046 ceph-mon[88928]: pgmap v837: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:58.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:59.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:59.684 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:30:59 smithi142 ceph-mon[69118]: pgmap v838: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:30:59.965 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:30:59 smithi046 ceph-mon[88928]: pgmap v838: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:01.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:01 smithi142 ceph-mon[69118]: pgmap v839: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:02.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:01 smithi046 ceph-mon[88928]: pgmap v839: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:03.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:03 smithi142 ceph-mon[69118]: pgmap v840: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:04.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:03 smithi046 ceph-mon[88928]: pgmap v840: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:05.964 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:05 smithi046 ceph-mon[88928]: pgmap v841: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:06.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:05 smithi142 ceph-mon[69118]: pgmap v841: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:08.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:07 smithi046 ceph-mon[88928]: pgmap v842: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:08.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:07 smithi142 ceph-mon[69118]: pgmap v842: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:09.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:09 smithi142 ceph-mon[69118]: pgmap v843: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:10.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:09 smithi046 ceph-mon[88928]: pgmap v843: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:12.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:11 smithi046 ceph-mon[88928]: pgmap v844: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:12.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:11 smithi142 ceph-mon[69118]: pgmap v844: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:14.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:13 smithi046 ceph-mon[88928]: pgmap v845: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:14.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:14.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:13 smithi142 ceph-mon[69118]: pgmap v845: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:14.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:16.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:15 smithi046 ceph-mon[88928]: pgmap v846: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:16.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:15 smithi142 ceph-mon[69118]: pgmap v846: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:18.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:17 smithi046 ceph-mon[88928]: pgmap v847: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:18.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:17 smithi142 ceph-mon[69118]: pgmap v847: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:19.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:19 smithi142 ceph-mon[69118]: pgmap v848: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:20.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:19 smithi046 ceph-mon[88928]: pgmap v848: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:22.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:21 smithi046 ceph-mon[88928]: pgmap v849: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:22.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:21 smithi142 ceph-mon[69118]: pgmap v849: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:24.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:23 smithi046 ceph-mon[88928]: pgmap v850: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:24.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:23 smithi142 ceph-mon[69118]: pgmap v850: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:26.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:25 smithi046 ceph-mon[88928]: pgmap v851: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:26.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:25 smithi142 ceph-mon[69118]: pgmap v851: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:28.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:27 smithi046 ceph-mon[88928]: pgmap v852: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:28.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:27 smithi142 ceph-mon[69118]: pgmap v852: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:29.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:29.085 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:30.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:29 smithi046 ceph-mon[88928]: pgmap v853: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:30.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:29 smithi142 ceph-mon[69118]: pgmap v853: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:32.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:31 smithi046 ceph-mon[88928]: pgmap v854: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:32.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:31:32.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:31 smithi142 ceph-mon[69118]: pgmap v854: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:32.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:31:33.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:32 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:31:33.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:32 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:31:33.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:32 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:31:33.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:32 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:31:33.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:32 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:31:33.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:32 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:31:34.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:33 smithi046 ceph-mon[88928]: pgmap v855: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:34.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:33 smithi142 ceph-mon[69118]: pgmap v855: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:36.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:35 smithi046 ceph-mon[88928]: pgmap v856: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:36.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:35 smithi142 ceph-mon[69118]: pgmap v856: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:38.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:37 smithi046 ceph-mon[88928]: pgmap v857: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:38.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:37 smithi142 ceph-mon[69118]: pgmap v857: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:40.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:39 smithi046 ceph-mon[88928]: pgmap v858: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:40.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:39 smithi142 ceph-mon[69118]: pgmap v858: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:42.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:41 smithi046 ceph-mon[88928]: pgmap v859: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:42.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:41 smithi142 ceph-mon[69118]: pgmap v859: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:44.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:43 smithi046 ceph-mon[88928]: pgmap v860: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:44.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:44.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:43 smithi142 ceph-mon[69118]: pgmap v860: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:44.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:46.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:45 smithi046 ceph-mon[88928]: pgmap v861: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:46.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:45 smithi142 ceph-mon[69118]: pgmap v861: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:48.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:47 smithi046 ceph-mon[88928]: pgmap v862: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:48.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:47 smithi142 ceph-mon[69118]: pgmap v862: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:50.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:49 smithi046 ceph-mon[88928]: pgmap v863: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:50.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:49 smithi142 ceph-mon[69118]: pgmap v863: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:52.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:51 smithi046 ceph-mon[88928]: pgmap v864: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:52.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:51 smithi142 ceph-mon[69118]: pgmap v864: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:54.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:53 smithi046 ceph-mon[88928]: pgmap v865: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:54.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:53 smithi142 ceph-mon[69118]: pgmap v865: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:56.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:55 smithi046 ceph-mon[88928]: pgmap v866: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:56.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:55 smithi142 ceph-mon[69118]: pgmap v866: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:58.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:57 smithi046 ceph-mon[88928]: pgmap v867: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:58.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:58.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:57 smithi142 ceph-mon[69118]: pgmap v867: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:31:58.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:00.028 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:31:59 smithi142 ceph-mon[69118]: pgmap v868: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:00.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:31:59 smithi046 ceph-mon[88928]: pgmap v868: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:02.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:01 smithi046 ceph-mon[88928]: pgmap v869: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:02.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:01 smithi142 ceph-mon[69118]: pgmap v869: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:04.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:03 smithi046 ceph-mon[88928]: pgmap v870: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:04.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:03 smithi142 ceph-mon[69118]: pgmap v870: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:06.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:05 smithi046 ceph-mon[88928]: pgmap v871: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:06.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:05 smithi142 ceph-mon[69118]: pgmap v871: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:08.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:07 smithi046 ceph-mon[88928]: pgmap v872: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:08.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:07 smithi142 ceph-mon[69118]: pgmap v872: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:10.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:09 smithi046 ceph-mon[88928]: pgmap v873: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:10.127 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:09 smithi142 ceph-mon[69118]: pgmap v873: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:12.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:11 smithi046 ceph-mon[88928]: pgmap v874: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:12.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:11 smithi142 ceph-mon[69118]: pgmap v874: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:13.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:13.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:14.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:13 smithi046 ceph-mon[88928]: pgmap v875: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:14.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:13 smithi142 ceph-mon[69118]: pgmap v875: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:16.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:15 smithi046 ceph-mon[88928]: pgmap v876: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:16.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:15 smithi142 ceph-mon[69118]: pgmap v876: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:18.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:17 smithi046 ceph-mon[88928]: pgmap v877: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:18.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:17 smithi142 ceph-mon[69118]: pgmap v877: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:20.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:19 smithi046 ceph-mon[88928]: pgmap v878: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:20.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:19 smithi142 ceph-mon[69118]: pgmap v878: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:22.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:21 smithi046 ceph-mon[88928]: pgmap v879: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:22.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:21 smithi142 ceph-mon[69118]: pgmap v879: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:24.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:23 smithi046 ceph-mon[88928]: pgmap v880: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:24.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:23 smithi142 ceph-mon[69118]: pgmap v880: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:26.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:25 smithi046 ceph-mon[88928]: pgmap v881: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:26.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:25 smithi142 ceph-mon[69118]: pgmap v881: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:28.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:27 smithi142 ceph-mon[69118]: pgmap v882: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:28.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:28.313 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:27 smithi046 ceph-mon[88928]: pgmap v882: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:28.313 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:30.116 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:29 smithi046 ceph-mon[88928]: pgmap v883: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:30.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:29 smithi142 ceph-mon[69118]: pgmap v883: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:32.115 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:31 smithi046 ceph-mon[88928]: pgmap v884: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:32.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:31 smithi142 ceph-mon[69118]: pgmap v884: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:33.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:32 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:32:33.230 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:32 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:32:34.098 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:33 smithi046 ceph-mon[88928]: pgmap v885: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:34.136 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:33 smithi142 ceph-mon[69118]: pgmap v885: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:35.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:35 smithi046 ceph-mon[88928]: pgmap v886: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:35.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:32:35.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:35 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:32:35.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:35 smithi142 ceph-mon[69118]: pgmap v886: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:35.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:32:35.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:35 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:32:37.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:37 smithi142 ceph-mon[69118]: pgmap v887: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:37.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:32:37.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:32:37.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:32:37.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:32:37.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:32:38.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:37 smithi046 ceph-mon[88928]: pgmap v887: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:38.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:32:38.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:32:38.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:32:38.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:32:38.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:32:40.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:39 smithi046 ceph-mon[88928]: pgmap v888: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:40.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:39 smithi142 ceph-mon[69118]: pgmap v888: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:42.038 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:41 smithi046 ceph-mon[88928]: pgmap v889: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:42.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:41 smithi142 ceph-mon[69118]: pgmap v889: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:44.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:43 smithi046 ceph-mon[88928]: pgmap v890: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:44.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:44.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:43 smithi142 ceph-mon[69118]: pgmap v890: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:44.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:45.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:45 smithi142 ceph-mon[69118]: pgmap v891: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:46.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:45 smithi046 ceph-mon[88928]: pgmap v891: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:48.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:47 smithi046 ceph-mon[88928]: pgmap v892: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:48.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:47 smithi142 ceph-mon[69118]: pgmap v892: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:50.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:49 smithi046 ceph-mon[88928]: pgmap v893: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:50.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:49 smithi142 ceph-mon[69118]: pgmap v893: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:52.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:51 smithi046 ceph-mon[88928]: pgmap v894: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:52.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:51 smithi142 ceph-mon[69118]: pgmap v894: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:54.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:53 smithi046 ceph-mon[88928]: pgmap v895: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:54.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:53 smithi142 ceph-mon[69118]: pgmap v895: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:55.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:55 smithi142 ceph-mon[69118]: pgmap v896: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:56.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:55 smithi046 ceph-mon[88928]: pgmap v896: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:58.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:57 smithi046 ceph-mon[88928]: pgmap v897: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:58.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:57 smithi142 ceph-mon[69118]: pgmap v897: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:32:59.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:59.084 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:00.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:32:59 smithi046 ceph-mon[88928]: pgmap v898: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:00.097 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:32:59 smithi142 ceph-mon[69118]: pgmap v898: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:02.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:01 smithi046 ceph-mon[88928]: pgmap v899: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:02.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:01 smithi142 ceph-mon[69118]: pgmap v899: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:04.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:03 smithi046 ceph-mon[88928]: pgmap v900: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:04.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:03 smithi142 ceph-mon[69118]: pgmap v900: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:05.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:05 smithi142 ceph-mon[69118]: pgmap v901: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:06.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:05 smithi046 ceph-mon[88928]: pgmap v901: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:08.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:07 smithi046 ceph-mon[88928]: pgmap v902: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:08.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:07 smithi142 ceph-mon[69118]: pgmap v902: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:10.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:09 smithi046 ceph-mon[88928]: pgmap v903: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:10.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:09 smithi142 ceph-mon[69118]: pgmap v903: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:12.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:11 smithi046 ceph-mon[88928]: pgmap v904: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:12.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:11 smithi142 ceph-mon[69118]: pgmap v904: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:14.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:13 smithi046 ceph-mon[88928]: pgmap v905: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:14.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:14.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:13 smithi142 ceph-mon[69118]: pgmap v905: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:14.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:16.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:15 smithi046 ceph-mon[88928]: pgmap v906: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:16.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:15 smithi142 ceph-mon[69118]: pgmap v906: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:18.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:17 smithi046 ceph-mon[88928]: pgmap v907: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:18.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:17 smithi142 ceph-mon[69118]: pgmap v907: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:20.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:19 smithi046 ceph-mon[88928]: pgmap v908: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:20.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:19 smithi142 ceph-mon[69118]: pgmap v908: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:22.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:21 smithi046 ceph-mon[88928]: pgmap v909: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:22.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:21 smithi142 ceph-mon[69118]: pgmap v909: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:24.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:23 smithi046 ceph-mon[88928]: pgmap v910: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:24.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:23 smithi142 ceph-mon[69118]: pgmap v910: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:26.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:25 smithi046 ceph-mon[88928]: pgmap v911: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:26.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:25 smithi142 ceph-mon[69118]: pgmap v911: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:27.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:27 smithi046 ceph-mon[88928]: pgmap v912: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:28.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:27 smithi142 ceph-mon[69118]: pgmap v912: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:29.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:29.083 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:30.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:29 smithi046 ceph-mon[88928]: pgmap v913: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:30.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:29 smithi142 ceph-mon[69118]: pgmap v913: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:32.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:31 smithi046 ceph-mon[88928]: pgmap v914: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:32.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:31 smithi142 ceph-mon[69118]: pgmap v914: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:34.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:33 smithi046 ceph-mon[88928]: pgmap v915: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:34.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:33 smithi142 ceph-mon[69118]: pgmap v915: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:36.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:35 smithi046 ceph-mon[88928]: pgmap v916: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:36.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:35 smithi142 ceph-mon[69118]: pgmap v916: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:38.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:37 smithi046 ceph-mon[88928]: pgmap v917: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:38.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:33:38.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:37 smithi142 ceph-mon[69118]: pgmap v917: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:38.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:33:39.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:39 smithi142 ceph-mon[69118]: pgmap v918: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:39.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:39 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:33:39.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:39 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:33:39.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:39 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:33:39.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:39 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:33:39.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:39 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:33:39.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:39 smithi046 ceph-mon[88928]: pgmap v918: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:39.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:33:39.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:33:39.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:33:39.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:33:39.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:33:41.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:41 smithi142 ceph-mon[69118]: pgmap v919: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:41.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:41 smithi046 ceph-mon[88928]: pgmap v919: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:43.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:43 smithi142 ceph-mon[69118]: pgmap v920: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:43.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:43.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:43 smithi046 ceph-mon[88928]: pgmap v920: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:43.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:45.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:45 smithi142 ceph-mon[69118]: pgmap v921: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:45.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:45 smithi046 ceph-mon[88928]: pgmap v921: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:47.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:47 smithi142 ceph-mon[69118]: pgmap v922: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:47.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:47 smithi046 ceph-mon[88928]: pgmap v922: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:49.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:49 smithi142 ceph-mon[69118]: pgmap v923: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:49.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:49 smithi046 ceph-mon[88928]: pgmap v923: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:51.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:51 smithi142 ceph-mon[69118]: pgmap v924: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:51.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:51 smithi046 ceph-mon[88928]: pgmap v924: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:53.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:53 smithi142 ceph-mon[69118]: pgmap v925: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:53.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:53 smithi046 ceph-mon[88928]: pgmap v925: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:55.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:55 smithi142 ceph-mon[69118]: pgmap v926: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:55.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:55 smithi046 ceph-mon[88928]: pgmap v926: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:57.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:57 smithi142 ceph-mon[69118]: pgmap v927: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:57.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:57 smithi046 ceph-mon[88928]: pgmap v927: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:58.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:58.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:59.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:33:59 smithi142 ceph-mon[69118]: pgmap v928: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:33:59.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:33:59 smithi046 ceph-mon[88928]: pgmap v928: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:01.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:01 smithi142 ceph-mon[69118]: pgmap v929: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:01.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:01 smithi046 ceph-mon[88928]: pgmap v929: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:03.313 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:03 smithi046 ceph-mon[88928]: pgmap v930: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:03.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:03 smithi142 ceph-mon[69118]: pgmap v930: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:05.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:05 smithi142 ceph-mon[69118]: pgmap v931: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:05.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:05 smithi046 ceph-mon[88928]: pgmap v931: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:07.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:07 smithi046 ceph-mon[88928]: pgmap v932: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:07.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:07 smithi142 ceph-mon[69118]: pgmap v932: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:09.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:09 smithi046 ceph-mon[88928]: pgmap v933: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:09.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:09 smithi142 ceph-mon[69118]: pgmap v933: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:11.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:11 smithi046 ceph-mon[88928]: pgmap v934: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:11.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:11 smithi142 ceph-mon[69118]: pgmap v934: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:13.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:13 smithi046 ceph-mon[88928]: pgmap v935: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:13.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:13.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:13 smithi142 ceph-mon[69118]: pgmap v935: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:13.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:15.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:15 smithi046 ceph-mon[88928]: pgmap v936: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:15.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:15 smithi142 ceph-mon[69118]: pgmap v936: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:17.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:17 smithi046 ceph-mon[88928]: pgmap v937: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:17.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:17 smithi142 ceph-mon[69118]: pgmap v937: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:19.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:19 smithi046 ceph-mon[88928]: pgmap v938: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:19.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:19 smithi142 ceph-mon[69118]: pgmap v938: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:21.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:21 smithi046 ceph-mon[88928]: pgmap v939: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:21.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:21 smithi142 ceph-mon[69118]: pgmap v939: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:23.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:23 smithi046 ceph-mon[88928]: pgmap v940: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:23.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:23 smithi142 ceph-mon[69118]: pgmap v940: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:25.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:25 smithi046 ceph-mon[88928]: pgmap v941: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:25.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:25 smithi142 ceph-mon[69118]: pgmap v941: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:27.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:27 smithi046 ceph-mon[88928]: pgmap v942: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:27.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:27 smithi142 ceph-mon[69118]: pgmap v942: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:28.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:28.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:29.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:29 smithi046 ceph-mon[88928]: pgmap v943: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:29.584 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:29 smithi142 ceph-mon[69118]: pgmap v943: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:31.510 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:31 smithi142 ceph-mon[69118]: pgmap v944: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:31.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:31 smithi046 ceph-mon[88928]: pgmap v944: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:33.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:33 smithi046 ceph-mon[88928]: pgmap v945: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:33.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:33 smithi142 ceph-mon[69118]: pgmap v945: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:35.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:35 smithi046 ceph-mon[88928]: pgmap v946: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:35 smithi142 ceph-mon[69118]: pgmap v946: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:37.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:37 smithi046 ceph-mon[88928]: pgmap v947: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:37.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:37 smithi142 ceph-mon[69118]: pgmap v947: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:39.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:39 smithi046 ceph-mon[88928]: pgmap v948: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:39.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:34:39.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:39 smithi142 ceph-mon[69118]: pgmap v948: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:39.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:39 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:34:40.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:40 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:34:40.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:40 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:34:40.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:40 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:34:40.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:40 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:34:40.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:40 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:34:40.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:40 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:34:41.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:41 smithi046 ceph-mon[88928]: pgmap v949: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:41.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:41 smithi142 ceph-mon[69118]: pgmap v949: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:43.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:43 smithi046 ceph-mon[88928]: pgmap v950: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:43.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:43.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:43 smithi142 ceph-mon[69118]: pgmap v950: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:43.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:45.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:45 smithi046 ceph-mon[88928]: pgmap v951: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:45.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:45 smithi142 ceph-mon[69118]: pgmap v951: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:47.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:47 smithi046 ceph-mon[88928]: pgmap v952: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:47.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:47 smithi142 ceph-mon[69118]: pgmap v952: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:49.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:49 smithi046 ceph-mon[88928]: pgmap v953: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:49.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:49 smithi142 ceph-mon[69118]: pgmap v953: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:51.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:51 smithi046 ceph-mon[88928]: pgmap v954: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:51.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:51 smithi142 ceph-mon[69118]: pgmap v954: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:53.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:53 smithi046 ceph-mon[88928]: pgmap v955: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:53.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:53 smithi142 ceph-mon[69118]: pgmap v955: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:55.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:55 smithi046 ceph-mon[88928]: pgmap v956: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:55.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:55 smithi142 ceph-mon[69118]: pgmap v956: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:57.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:57 smithi046 ceph-mon[88928]: pgmap v957: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:57.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:57 smithi142 ceph-mon[69118]: pgmap v957: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:58.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:58.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:59.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:34:59 smithi046 ceph-mon[88928]: pgmap v958: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:34:59.834 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:34:59 smithi142 ceph-mon[69118]: pgmap v958: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:01.806 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:01 smithi142 ceph-mon[69118]: pgmap v959: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:01.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:01 smithi046 ceph-mon[88928]: pgmap v959: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:03.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:03 smithi046 ceph-mon[88928]: pgmap v960: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:03.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:03 smithi142 ceph-mon[69118]: pgmap v960: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:05.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:05 smithi046 ceph-mon[88928]: pgmap v961: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:05.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:05 smithi142 ceph-mon[69118]: pgmap v961: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:07.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:07 smithi046 ceph-mon[88928]: pgmap v962: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:07.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:07 smithi142 ceph-mon[69118]: pgmap v962: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:09.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:09 smithi046 ceph-mon[88928]: pgmap v963: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:09.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:09 smithi142 ceph-mon[69118]: pgmap v963: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:11.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:11 smithi046 ceph-mon[88928]: pgmap v964: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:11.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:11 smithi142 ceph-mon[69118]: pgmap v964: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:13.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:13 smithi046 ceph-mon[88928]: pgmap v965: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:13.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:13.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:13 smithi142 ceph-mon[69118]: pgmap v965: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:13.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:15.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:15 smithi046 ceph-mon[88928]: pgmap v966: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:15.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:15 smithi142 ceph-mon[69118]: pgmap v966: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:17.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:17 smithi046 ceph-mon[88928]: pgmap v967: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:17.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:17 smithi142 ceph-mon[69118]: pgmap v967: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:19.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:19 smithi046 ceph-mon[88928]: pgmap v968: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:19.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:19 smithi142 ceph-mon[69118]: pgmap v968: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:21.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:21 smithi142 ceph-mon[69118]: pgmap v969: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:21 smithi046 ceph-mon[88928]: pgmap v969: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:23.859 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:23 smithi046 ceph-mon[88928]: pgmap v970: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:23.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:23 smithi142 ceph-mon[69118]: pgmap v970: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:25.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:25 smithi142 ceph-mon[69118]: pgmap v971: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:26.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:25 smithi046 ceph-mon[88928]: pgmap v971: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:27.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:27 smithi142 ceph-mon[69118]: pgmap v972: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:28.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:27 smithi046 ceph-mon[88928]: pgmap v972: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:28.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:28.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:29.834 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:29 smithi142 ceph-mon[69118]: pgmap v973: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:30.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:29 smithi046 ceph-mon[88928]: pgmap v973: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:31.865 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:31 smithi046 ceph-mon[88928]: pgmap v974: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:31.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:31 smithi142 ceph-mon[69118]: pgmap v974: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:33.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:33 smithi142 ceph-mon[69118]: pgmap v975: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:33.972 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:33 smithi046 ceph-mon[88928]: pgmap v975: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:35.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:35 smithi142 ceph-mon[69118]: pgmap v976: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:36.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:35 smithi046 ceph-mon[88928]: pgmap v976: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:37.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:37 smithi142 ceph-mon[69118]: pgmap v977: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:38.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:37 smithi046 ceph-mon[88928]: pgmap v977: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:39.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:39 smithi142 ceph-mon[69118]: pgmap v978: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:39.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:39 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:35:40.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:39 smithi046 ceph-mon[88928]: pgmap v978: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:40.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:39 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:35:41.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:41 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:35:41.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:41 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:35:41.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:41 smithi142 ceph-mon[69118]: pgmap v979: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:41.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:41 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:35:41.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:41 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:35:41.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:41 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:35:41.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:35:41.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:35:41.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:41 smithi046 ceph-mon[88928]: pgmap v979: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:41.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:35:41.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:35:41.563 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:35:43.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:43 smithi142 ceph-mon[69118]: pgmap v980: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:43.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:43.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:43 smithi046 ceph-mon[88928]: pgmap v980: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:43.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:45.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:45 smithi142 ceph-mon[69118]: pgmap v981: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:45.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:45 smithi046 ceph-mon[88928]: pgmap v981: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:47.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:47 smithi142 ceph-mon[69118]: pgmap v982: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:47.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:47 smithi046 ceph-mon[88928]: pgmap v982: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:49.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:49 smithi046 ceph-mon[88928]: pgmap v983: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:49.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:49 smithi142 ceph-mon[69118]: pgmap v983: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:51.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:51 smithi142 ceph-mon[69118]: pgmap v984: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:51.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:51 smithi046 ceph-mon[88928]: pgmap v984: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:53.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:53 smithi142 ceph-mon[69118]: pgmap v985: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:53.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:53 smithi046 ceph-mon[88928]: pgmap v985: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:55.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:55 smithi142 ceph-mon[69118]: pgmap v986: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:55.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:55 smithi046 ceph-mon[88928]: pgmap v986: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:57.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:57 smithi142 ceph-mon[69118]: pgmap v987: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:57.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:57 smithi046 ceph-mon[88928]: pgmap v987: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:58.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:58.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:59.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:35:59 smithi046 ceph-mon[88928]: pgmap v988: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:35:59.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:35:59 smithi142 ceph-mon[69118]: pgmap v988: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:01.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:01 smithi142 ceph-mon[69118]: pgmap v989: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:01.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:01 smithi046 ceph-mon[88928]: pgmap v989: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:03.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:03 smithi142 ceph-mon[69118]: pgmap v990: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:03.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:03 smithi046 ceph-mon[88928]: pgmap v990: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:05.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:05 smithi142 ceph-mon[69118]: pgmap v991: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:05.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:05 smithi046 ceph-mon[88928]: pgmap v991: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:07.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:07 smithi142 ceph-mon[69118]: pgmap v992: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:07.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:07 smithi046 ceph-mon[88928]: pgmap v992: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:09.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:09 smithi142 ceph-mon[69118]: pgmap v993: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:09.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:09 smithi046 ceph-mon[88928]: pgmap v993: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:11.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:11 smithi142 ceph-mon[69118]: pgmap v994: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:11.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:11 smithi046 ceph-mon[88928]: pgmap v994: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:13.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:13 smithi142 ceph-mon[69118]: pgmap v995: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:13.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:13.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:13 smithi046 ceph-mon[88928]: pgmap v995: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:13.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:15.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:15 smithi142 ceph-mon[69118]: pgmap v996: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:15.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:15 smithi046 ceph-mon[88928]: pgmap v996: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:17.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:17 smithi142 ceph-mon[69118]: pgmap v997: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:17.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:17 smithi046 ceph-mon[88928]: pgmap v997: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:19.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:19 smithi142 ceph-mon[69118]: pgmap v998: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:19.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:19 smithi046 ceph-mon[88928]: pgmap v998: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:21.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:21 smithi142 ceph-mon[69118]: pgmap v999: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:21.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:21 smithi046 ceph-mon[88928]: pgmap v999: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:23.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:23 smithi142 ceph-mon[69118]: pgmap v1000: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:23.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:23 smithi046 ceph-mon[88928]: pgmap v1000: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:25.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:25 smithi046 ceph-mon[88928]: pgmap v1001: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:25.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:25 smithi142 ceph-mon[69118]: pgmap v1001: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:27.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:27 smithi046 ceph-mon[88928]: pgmap v1002: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:27.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:27 smithi142 ceph-mon[69118]: pgmap v1002: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:28.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:28.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:29.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:29 smithi046 ceph-mon[88928]: pgmap v1003: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:29.833 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:29 smithi142 ceph-mon[69118]: pgmap v1003: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:31.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:31 smithi046 ceph-mon[88928]: pgmap v1004: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:31.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:31 smithi142 ceph-mon[69118]: pgmap v1004: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:33.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:33 smithi046 ceph-mon[88928]: pgmap v1005: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:33.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:33 smithi142 ceph-mon[69118]: pgmap v1005: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:35.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:35 smithi046 ceph-mon[88928]: pgmap v1006: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:35.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:35 smithi142 ceph-mon[69118]: pgmap v1006: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:37.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:37 smithi142 ceph-mon[69118]: pgmap v1007: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:37.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:37 smithi046 ceph-mon[88928]: pgmap v1007: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:39.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:39 smithi046 ceph-mon[88928]: pgmap v1008: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:39.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:39 smithi142 ceph-mon[69118]: pgmap v1008: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:41.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:41 smithi046 ceph-mon[88928]: pgmap v1009: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:41.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:36:41.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:41 smithi142 ceph-mon[69118]: pgmap v1009: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:41.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:41 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:36:42.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:36:42.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:36:42.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:36:42.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:36:42.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:36:42.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:36:43.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:43 smithi046 ceph-mon[88928]: pgmap v1010: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:43.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:43.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:43 smithi142 ceph-mon[69118]: pgmap v1010: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:43.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:45.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:45 smithi046 ceph-mon[88928]: pgmap v1011: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:45.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:45 smithi142 ceph-mon[69118]: pgmap v1011: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:47.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:47 smithi046 ceph-mon[88928]: pgmap v1012: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:47.848 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:47 smithi142 ceph-mon[69118]: pgmap v1012: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:49.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:49 smithi046 ceph-mon[88928]: pgmap v1013: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:49.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:49 smithi142 ceph-mon[69118]: pgmap v1013: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:51.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:51 smithi046 ceph-mon[88928]: pgmap v1014: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:51.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:51 smithi142 ceph-mon[69118]: pgmap v1014: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:53.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:53 smithi046 ceph-mon[88928]: pgmap v1015: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:53.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:53 smithi142 ceph-mon[69118]: pgmap v1015: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:55.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:55 smithi046 ceph-mon[88928]: pgmap v1016: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:55.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:55 smithi142 ceph-mon[69118]: pgmap v1016: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:57.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:57 smithi046 ceph-mon[88928]: pgmap v1017: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:57.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:57 smithi142 ceph-mon[69118]: pgmap v1017: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:58.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:58.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:59.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:36:59 smithi046 ceph-mon[88928]: pgmap v1018: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:36:59.833 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:36:59 smithi142 ceph-mon[69118]: pgmap v1018: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:01.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:01 smithi046 ceph-mon[88928]: pgmap v1019: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:01.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:01 smithi142 ceph-mon[69118]: pgmap v1019: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:03.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:03 smithi046 ceph-mon[88928]: pgmap v1020: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:03.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:03 smithi142 ceph-mon[69118]: pgmap v1020: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:05.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:05 smithi046 ceph-mon[88928]: pgmap v1021: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:05.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:05 smithi142 ceph-mon[69118]: pgmap v1021: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:07.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:07 smithi046 ceph-mon[88928]: pgmap v1022: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:07.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:07 smithi142 ceph-mon[69118]: pgmap v1022: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:09.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:09 smithi046 ceph-mon[88928]: pgmap v1023: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:09.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:09 smithi142 ceph-mon[69118]: pgmap v1023: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:11.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:11 smithi046 ceph-mon[88928]: pgmap v1024: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:11.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:11 smithi142 ceph-mon[69118]: pgmap v1024: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:13.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:13 smithi046 ceph-mon[88928]: pgmap v1025: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:13.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:13.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:13 smithi142 ceph-mon[69118]: pgmap v1025: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:13.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:15.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:15 smithi046 ceph-mon[88928]: pgmap v1026: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:15.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:15 smithi142 ceph-mon[69118]: pgmap v1026: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:17.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:17 smithi046 ceph-mon[88928]: pgmap v1027: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:17.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:17 smithi142 ceph-mon[69118]: pgmap v1027: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:19.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:19 smithi046 ceph-mon[88928]: pgmap v1028: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:19.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:19 smithi142 ceph-mon[69118]: pgmap v1028: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:21.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:21 smithi046 ceph-mon[88928]: pgmap v1029: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:21.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:21 smithi142 ceph-mon[69118]: pgmap v1029: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:23.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:23 smithi046 ceph-mon[88928]: pgmap v1030: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:23.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:23 smithi142 ceph-mon[69118]: pgmap v1030: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:25.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:25 smithi046 ceph-mon[88928]: pgmap v1031: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:25.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:25 smithi142 ceph-mon[69118]: pgmap v1031: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:27.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:27 smithi046 ceph-mon[88928]: pgmap v1032: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:27.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:27 smithi142 ceph-mon[69118]: pgmap v1032: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:28.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:28.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:29.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:29 smithi046 ceph-mon[88928]: pgmap v1033: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:29.833 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:29 smithi142 ceph-mon[69118]: pgmap v1033: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:31.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:31 smithi046 ceph-mon[88928]: pgmap v1034: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:31.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:31 smithi142 ceph-mon[69118]: pgmap v1034: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:33.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:33 smithi046 ceph-mon[88928]: pgmap v1035: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:33.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:33 smithi142 ceph-mon[69118]: pgmap v1035: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:35.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:35 smithi046 ceph-mon[88928]: pgmap v1036: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:35.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:35 smithi142 ceph-mon[69118]: pgmap v1036: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:37.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:37 smithi046 ceph-mon[88928]: pgmap v1037: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:37.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:37 smithi142 ceph-mon[69118]: pgmap v1037: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:39.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:39 smithi046 ceph-mon[88928]: pgmap v1038: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:39.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:39 smithi142 ceph-mon[69118]: pgmap v1038: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:41.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:41 smithi046 ceph-mon[88928]: pgmap v1039: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:41.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:41 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:37:41.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:41 smithi142 ceph-mon[69118]: pgmap v1039: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:41.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:41 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:37:42.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:37:42.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:37:42.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:37:43.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:37:43.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:37:43.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:37:43.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:43 smithi142 ceph-mon[69118]: pgmap v1040: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:43.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:43 smithi046 ceph-mon[88928]: pgmap v1040: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:45.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:45 smithi046 ceph-mon[88928]: pgmap v1041: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:45.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:45 smithi142 ceph-mon[69118]: pgmap v1041: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:47.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:47 smithi142 ceph-mon[69118]: pgmap v1042: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:48.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:47 smithi046 ceph-mon[88928]: pgmap v1042: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:49.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:49 smithi142 ceph-mon[69118]: pgmap v1043: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:50.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:49 smithi046 ceph-mon[88928]: pgmap v1043: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:51.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:51 smithi142 ceph-mon[69118]: pgmap v1044: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:52.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:51 smithi046 ceph-mon[88928]: pgmap v1044: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:53.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:53 smithi142 ceph-mon[69118]: pgmap v1045: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:54.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:53 smithi046 ceph-mon[88928]: pgmap v1045: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:55.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:55 smithi046 ceph-mon[88928]: pgmap v1046: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:55.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:55 smithi142 ceph-mon[69118]: pgmap v1046: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:57.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:57 smithi142 ceph-mon[69118]: pgmap v1047: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:58.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:57 smithi046 ceph-mon[88928]: pgmap v1047: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:37:58.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:59.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:59.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:37:59 smithi142 ceph-mon[69118]: pgmap v1048: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:00.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:37:59 smithi046 ceph-mon[88928]: pgmap v1048: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:01.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:01 smithi142 ceph-mon[69118]: pgmap v1049: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:01.963 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:01 smithi046 ceph-mon[88928]: pgmap v1049: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:03.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:03 smithi142 ceph-mon[69118]: pgmap v1050: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:04.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:03 smithi046 ceph-mon[88928]: pgmap v1050: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:05.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:05 smithi142 ceph-mon[69118]: pgmap v1051: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:06.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:05 smithi046 ceph-mon[88928]: pgmap v1051: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:07.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:07 smithi142 ceph-mon[69118]: pgmap v1052: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:08.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:07 smithi046 ceph-mon[88928]: pgmap v1052: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:09.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:09 smithi142 ceph-mon[69118]: pgmap v1053: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:09 smithi046 ceph-mon[88928]: pgmap v1053: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:11.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:11 smithi142 ceph-mon[69118]: pgmap v1054: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:12.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:11 smithi046 ceph-mon[88928]: pgmap v1054: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:13.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:13 smithi142 ceph-mon[69118]: pgmap v1055: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:13.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:13 smithi046 ceph-mon[88928]: pgmap v1055: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:14.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:15.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:15 smithi142 ceph-mon[69118]: pgmap v1056: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:16.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:15 smithi046 ceph-mon[88928]: pgmap v1056: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:17.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:17 smithi142 ceph-mon[69118]: pgmap v1057: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:18.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:17 smithi046 ceph-mon[88928]: pgmap v1057: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:19.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:19 smithi142 ceph-mon[69118]: pgmap v1058: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:20.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:19 smithi046 ceph-mon[88928]: pgmap v1058: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:21.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:21 smithi142 ceph-mon[69118]: pgmap v1059: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:21 smithi046 ceph-mon[88928]: pgmap v1059: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:23.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:23 smithi142 ceph-mon[69118]: pgmap v1060: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:24.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:23 smithi046 ceph-mon[88928]: pgmap v1060: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:25.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:25 smithi046 ceph-mon[88928]: pgmap v1061: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:25.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:25 smithi142 ceph-mon[69118]: pgmap v1061: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:27.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:27 smithi142 ceph-mon[69118]: pgmap v1062: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:28.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:27 smithi046 ceph-mon[88928]: pgmap v1062: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:28.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:29.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:29 smithi142 ceph-mon[69118]: pgmap v1063: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:30.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:29 smithi046 ceph-mon[88928]: pgmap v1063: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:31.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:31 smithi142 ceph-mon[69118]: pgmap v1064: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:32.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:31 smithi046 ceph-mon[88928]: pgmap v1064: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:33.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:33 smithi142 ceph-mon[69118]: pgmap v1065: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:34.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:33 smithi046 ceph-mon[88928]: pgmap v1065: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:35.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:35 smithi142 ceph-mon[69118]: pgmap v1066: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:36.001 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:35 smithi046 ceph-mon[88928]: pgmap v1066: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:37.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:37 smithi142 ceph-mon[69118]: pgmap v1067: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:38.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:37 smithi046 ceph-mon[88928]: pgmap v1067: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:39.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:39 smithi142 ceph-mon[69118]: pgmap v1068: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:40.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:39 smithi046 ceph-mon[88928]: pgmap v1068: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:41.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:41 smithi142 ceph-mon[69118]: pgmap v1069: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:42.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:41 smithi046 ceph-mon[88928]: pgmap v1069: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:42.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:38:43.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:38:43.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:43 smithi142 ceph-mon[69118]: pgmap v1070: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:43.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:43.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:38:43.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:38:43.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:38:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:43 smithi046 ceph-mon[88928]: pgmap v1070: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:38:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:38:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:38:45.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:45 smithi142 ceph-mon[69118]: pgmap v1071: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:46.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:45 smithi046 ceph-mon[88928]: pgmap v1071: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:47.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:47 smithi142 ceph-mon[69118]: pgmap v1072: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:48.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:47 smithi046 ceph-mon[88928]: pgmap v1072: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:49.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:49 smithi142 ceph-mon[69118]: pgmap v1073: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:50.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:49 smithi046 ceph-mon[88928]: pgmap v1073: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:51.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:51 smithi142 ceph-mon[69118]: pgmap v1074: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:52.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:51 smithi046 ceph-mon[88928]: pgmap v1074: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:53.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:53 smithi142 ceph-mon[69118]: pgmap v1075: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:54.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:53 smithi046 ceph-mon[88928]: pgmap v1075: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:55 smithi046 ceph-mon[88928]: pgmap v1076: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:55 smithi142 ceph-mon[69118]: pgmap v1076: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:58.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:57 smithi046 ceph-mon[88928]: pgmap v1077: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:57 smithi142 ceph-mon[69118]: pgmap v1077: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:38:59.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:59.083 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:00.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:38:59 smithi046 ceph-mon[88928]: pgmap v1078: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:00.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:38:59 smithi142 ceph-mon[69118]: pgmap v1078: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:02.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:01 smithi046 ceph-mon[88928]: pgmap v1079: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:01 smithi142 ceph-mon[69118]: pgmap v1079: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:03 smithi046 ceph-mon[88928]: pgmap v1080: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:04.174 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:03 smithi142 ceph-mon[69118]: pgmap v1080: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:06.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:05 smithi046 ceph-mon[88928]: pgmap v1081: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:05 smithi142 ceph-mon[69118]: pgmap v1081: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:08.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:07 smithi046 ceph-mon[88928]: pgmap v1082: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:08.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:07 smithi142 ceph-mon[69118]: pgmap v1082: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:10.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:09 smithi046 ceph-mon[88928]: pgmap v1083: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:09 smithi142 ceph-mon[69118]: pgmap v1083: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:12.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:11 smithi046 ceph-mon[88928]: pgmap v1084: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:11 smithi142 ceph-mon[69118]: pgmap v1084: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:13 smithi046 ceph-mon[88928]: pgmap v1085: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:13 smithi142 ceph-mon[69118]: pgmap v1085: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:16.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:15 smithi046 ceph-mon[88928]: pgmap v1086: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:16.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:15 smithi142 ceph-mon[69118]: pgmap v1086: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:18.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:17 smithi046 ceph-mon[88928]: pgmap v1087: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:18.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:17 smithi142 ceph-mon[69118]: pgmap v1087: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:20.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:19 smithi046 ceph-mon[88928]: pgmap v1088: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:20.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:19 smithi142 ceph-mon[69118]: pgmap v1088: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:21.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:21 smithi046 ceph-mon[88928]: pgmap v1089: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:22.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:21 smithi142 ceph-mon[69118]: pgmap v1089: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:24.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:23 smithi046 ceph-mon[88928]: pgmap v1090: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:24.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:23 smithi142 ceph-mon[69118]: pgmap v1090: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:26.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:25 smithi046 ceph-mon[88928]: pgmap v1091: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:26.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:25 smithi142 ceph-mon[69118]: pgmap v1091: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:28.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:27 smithi046 ceph-mon[88928]: pgmap v1092: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:27 smithi142 ceph-mon[69118]: pgmap v1092: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:29.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:29.083 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:30.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:29 smithi046 ceph-mon[88928]: pgmap v1093: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:30.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:29 smithi142 ceph-mon[69118]: pgmap v1093: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:32.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:31 smithi046 ceph-mon[88928]: pgmap v1094: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:32.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:31 smithi142 ceph-mon[69118]: pgmap v1094: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:34.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:33 smithi046 ceph-mon[88928]: pgmap v1095: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:34.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:33 smithi142 ceph-mon[69118]: pgmap v1095: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:36.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:35 smithi046 ceph-mon[88928]: pgmap v1096: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:36.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:35 smithi142 ceph-mon[69118]: pgmap v1096: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:38.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:37 smithi046 ceph-mon[88928]: pgmap v1097: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:38.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:37 smithi142 ceph-mon[69118]: pgmap v1097: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:39.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:39 smithi142 ceph-mon[69118]: pgmap v1098: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:40.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:39 smithi046 ceph-mon[88928]: pgmap v1098: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:42.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:41 smithi046 ceph-mon[88928]: pgmap v1099: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:41 smithi142 ceph-mon[69118]: pgmap v1099: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:44.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:43 smithi046 ceph-mon[88928]: pgmap v1100: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:39:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:39:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:39:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:39:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:43 smithi142 ceph-mon[69118]: pgmap v1100: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:39:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:39:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:39:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:39:46.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:45 smithi046 ceph-mon[88928]: pgmap v1101: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:46.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:45 smithi142 ceph-mon[69118]: pgmap v1101: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:48.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:47 smithi046 ceph-mon[88928]: pgmap v1102: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:48.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:47 smithi142 ceph-mon[69118]: pgmap v1102: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:49.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:49 smithi142 ceph-mon[69118]: pgmap v1103: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:50.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:49 smithi046 ceph-mon[88928]: pgmap v1103: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:52.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:51 smithi046 ceph-mon[88928]: pgmap v1104: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:52.183 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:51 smithi142 ceph-mon[69118]: pgmap v1104: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:54.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:53 smithi046 ceph-mon[88928]: pgmap v1105: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:53 smithi142 ceph-mon[69118]: pgmap v1105: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:55 smithi046 ceph-mon[88928]: pgmap v1106: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:55 smithi142 ceph-mon[69118]: pgmap v1106: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:58.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:57 smithi046 ceph-mon[88928]: pgmap v1107: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:58.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:57 smithi142 ceph-mon[69118]: pgmap v1107: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:39:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:59.983 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:39:59 smithi142 ceph-mon[69118]: pgmap v1108: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:00.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:39:59 smithi046 ceph-mon[88928]: pgmap v1108: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:01.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:00 smithi046 ceph-mon[88928]: overall HEALTH_OK 2024-02-19T19:40:01.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:00 smithi142 ceph-mon[69118]: overall HEALTH_OK 2024-02-19T19:40:02.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:01 smithi046 ceph-mon[88928]: pgmap v1109: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:01 smithi142 ceph-mon[69118]: pgmap v1109: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:03 smithi046 ceph-mon[88928]: pgmap v1110: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:04.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:03 smithi142 ceph-mon[69118]: pgmap v1110: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:06.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:05 smithi046 ceph-mon[88928]: pgmap v1111: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:05 smithi142 ceph-mon[69118]: pgmap v1111: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:08.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:07 smithi046 ceph-mon[88928]: pgmap v1112: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:08.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:07 smithi142 ceph-mon[69118]: pgmap v1112: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:10.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:09 smithi046 ceph-mon[88928]: pgmap v1113: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:09 smithi142 ceph-mon[69118]: pgmap v1113: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:12.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:11 smithi046 ceph-mon[88928]: pgmap v1114: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:11 smithi142 ceph-mon[69118]: pgmap v1114: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:13.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:13.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:13 smithi142 ceph-mon[69118]: pgmap v1115: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:14.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:13 smithi046 ceph-mon[88928]: pgmap v1115: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:16.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:15 smithi142 ceph-mon[69118]: pgmap v1116: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:16.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:15 smithi046 ceph-mon[88928]: pgmap v1116: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:18.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:17 smithi142 ceph-mon[69118]: pgmap v1117: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:18.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:17 smithi046 ceph-mon[88928]: pgmap v1117: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:20.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:19 smithi142 ceph-mon[69118]: pgmap v1118: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:20.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:19 smithi046 ceph-mon[88928]: pgmap v1118: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:22.112 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:21 smithi046 ceph-mon[88928]: pgmap v1119: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:22.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:21 smithi142 ceph-mon[69118]: pgmap v1119: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:24.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:23 smithi142 ceph-mon[69118]: pgmap v1120: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:24.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:23 smithi046 ceph-mon[88928]: pgmap v1120: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:26.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:25 smithi142 ceph-mon[69118]: pgmap v1121: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:26.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:25 smithi046 ceph-mon[88928]: pgmap v1121: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:27 smithi142 ceph-mon[69118]: pgmap v1122: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:28.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:27 smithi046 ceph-mon[88928]: pgmap v1122: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:28.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:30.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:29 smithi142 ceph-mon[69118]: pgmap v1123: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:30.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:29 smithi046 ceph-mon[88928]: pgmap v1123: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:32.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:31 smithi046 ceph-mon[88928]: pgmap v1124: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:32.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:31 smithi142 ceph-mon[69118]: pgmap v1124: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:34.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:33 smithi142 ceph-mon[69118]: pgmap v1125: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:34.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:33 smithi046 ceph-mon[88928]: pgmap v1125: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:36.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:35 smithi142 ceph-mon[69118]: pgmap v1126: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:36.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:35 smithi046 ceph-mon[88928]: pgmap v1126: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:38.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:37 smithi142 ceph-mon[69118]: pgmap v1127: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:38.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:37 smithi046 ceph-mon[88928]: pgmap v1127: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:40.109 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:39 smithi142 ceph-mon[69118]: pgmap v1128: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:40.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:39 smithi046 ceph-mon[88928]: pgmap v1128: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:42.112 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:41 smithi046 ceph-mon[88928]: pgmap v1129: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:41 smithi142 ceph-mon[69118]: pgmap v1129: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:43.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:43.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:43 smithi142 ceph-mon[69118]: pgmap v1130: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:40:44.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:43 smithi046 ceph-mon[88928]: pgmap v1130: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:44.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:40:45.159 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:44 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:40:45.159 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:44 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:40:45.159 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:44 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:40:45.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:44 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:40:45.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:44 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:40:45.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:44 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:40:46.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:45 smithi142 ceph-mon[69118]: pgmap v1131: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:46.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:45 smithi046 ceph-mon[88928]: pgmap v1131: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:48.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:47 smithi142 ceph-mon[69118]: pgmap v1132: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:48.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:47 smithi046 ceph-mon[88928]: pgmap v1132: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:50.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:49 smithi142 ceph-mon[69118]: pgmap v1133: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:50.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:49 smithi046 ceph-mon[88928]: pgmap v1133: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:52.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:51 smithi142 ceph-mon[69118]: pgmap v1134: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:52.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:51 smithi046 ceph-mon[88928]: pgmap v1134: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:53 smithi142 ceph-mon[69118]: pgmap v1135: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:54.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:53 smithi046 ceph-mon[88928]: pgmap v1135: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:55 smithi142 ceph-mon[69118]: pgmap v1136: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:56.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:55 smithi046 ceph-mon[88928]: pgmap v1136: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:57 smithi142 ceph-mon[69118]: pgmap v1137: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:57 smithi046 ceph-mon[88928]: pgmap v1137: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:40:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:00.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:40:59 smithi142 ceph-mon[69118]: pgmap v1138: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:00.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:40:59 smithi046 ceph-mon[88928]: pgmap v1138: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:01 smithi142 ceph-mon[69118]: pgmap v1139: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:02.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:01 smithi046 ceph-mon[88928]: pgmap v1139: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:04.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:03 smithi142 ceph-mon[69118]: pgmap v1140: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:04.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:03 smithi046 ceph-mon[88928]: pgmap v1140: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:05 smithi142 ceph-mon[69118]: pgmap v1141: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:05 smithi046 ceph-mon[88928]: pgmap v1141: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:07.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:06 smithi046 ceph-mon[88928]: pgmap v1142: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:07.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:06 smithi142 ceph-mon[69118]: pgmap v1142: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:09.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:09 smithi046 ceph-mon[88928]: pgmap v1143: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:09.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:09 smithi142 ceph-mon[69118]: pgmap v1143: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:11.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:11 smithi046 ceph-mon[88928]: pgmap v1144: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:11.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:11 smithi142 ceph-mon[69118]: pgmap v1144: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:13.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:13 smithi046 ceph-mon[88928]: pgmap v1145: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:13.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:13.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:13 smithi142 ceph-mon[69118]: pgmap v1145: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:13.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:15.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:15 smithi046 ceph-mon[88928]: pgmap v1146: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:15.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:15 smithi142 ceph-mon[69118]: pgmap v1146: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:17.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:17 smithi046 ceph-mon[88928]: pgmap v1147: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:17.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:17 smithi142 ceph-mon[69118]: pgmap v1147: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:19.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:19 smithi046 ceph-mon[88928]: pgmap v1148: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:19.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:19 smithi142 ceph-mon[69118]: pgmap v1148: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:21.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:21 smithi046 ceph-mon[88928]: pgmap v1149: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:21.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:21 smithi142 ceph-mon[69118]: pgmap v1149: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:23.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:23 smithi046 ceph-mon[88928]: pgmap v1150: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:23.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:23 smithi142 ceph-mon[69118]: pgmap v1150: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:25.552 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:25 smithi142 ceph-mon[69118]: pgmap v1151: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:25.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:25 smithi046 ceph-mon[88928]: pgmap v1151: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:27.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:27 smithi046 ceph-mon[88928]: pgmap v1152: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:27.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:27 smithi142 ceph-mon[69118]: pgmap v1152: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:28.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:28.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:29.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:29 smithi046 ceph-mon[88928]: pgmap v1153: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:29.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:29 smithi142 ceph-mon[69118]: pgmap v1153: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:31.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:31 smithi046 ceph-mon[88928]: pgmap v1154: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:31.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:31 smithi142 ceph-mon[69118]: pgmap v1154: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:33.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:33 smithi046 ceph-mon[88928]: pgmap v1155: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:33.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:33 smithi142 ceph-mon[69118]: pgmap v1155: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:35.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:35 smithi046 ceph-mon[88928]: pgmap v1156: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:35.650 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:35 smithi142 ceph-mon[69118]: pgmap v1156: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:37.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:37 smithi046 ceph-mon[88928]: pgmap v1157: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:37.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:37 smithi142 ceph-mon[69118]: pgmap v1157: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:39.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:39 smithi046 ceph-mon[88928]: pgmap v1158: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:39.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:39 smithi142 ceph-mon[69118]: pgmap v1158: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:41.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:41 smithi046 ceph-mon[88928]: pgmap v1159: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:41.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:41 smithi142 ceph-mon[69118]: pgmap v1159: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:43.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:43 smithi046 ceph-mon[88928]: pgmap v1160: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:43.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:43.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:43 smithi142 ceph-mon[69118]: pgmap v1160: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:43.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:45.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:45 smithi046 ceph-mon[88928]: pgmap v1161: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:45.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:41:45.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:41:45.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:41:45.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:41:45.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:45 smithi142 ceph-mon[69118]: pgmap v1161: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:45.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:41:45.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:41:45.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:41:45.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:41:47.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:47 smithi046 ceph-mon[88928]: pgmap v1162: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:47.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:47 smithi142 ceph-mon[69118]: pgmap v1162: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:49.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:49 smithi142 ceph-mon[69118]: pgmap v1163: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:49.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:49 smithi046 ceph-mon[88928]: pgmap v1163: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:51.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:51 smithi142 ceph-mon[69118]: pgmap v1164: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:51.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:51 smithi046 ceph-mon[88928]: pgmap v1164: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:53.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:53 smithi046 ceph-mon[88928]: pgmap v1165: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:53.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:53 smithi142 ceph-mon[69118]: pgmap v1165: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:55.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:55 smithi142 ceph-mon[69118]: pgmap v1166: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:55.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:55 smithi046 ceph-mon[88928]: pgmap v1166: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:57.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:57 smithi142 ceph-mon[69118]: pgmap v1167: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:57.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:57 smithi046 ceph-mon[88928]: pgmap v1167: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:58.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:58.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:59.582 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:41:59 smithi142 ceph-mon[69118]: pgmap v1168: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:41:59.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:41:59 smithi046 ceph-mon[88928]: pgmap v1168: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:01.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:01 smithi142 ceph-mon[69118]: pgmap v1169: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:01.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:01 smithi046 ceph-mon[88928]: pgmap v1169: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:03.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:03 smithi142 ceph-mon[69118]: pgmap v1170: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:03.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:03 smithi046 ceph-mon[88928]: pgmap v1170: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:05.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:05 smithi142 ceph-mon[69118]: pgmap v1171: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:05.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:05 smithi046 ceph-mon[88928]: pgmap v1171: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:07.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:07 smithi142 ceph-mon[69118]: pgmap v1172: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:07.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:07 smithi046 ceph-mon[88928]: pgmap v1172: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:09.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:09 smithi142 ceph-mon[69118]: pgmap v1173: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:09.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:09 smithi046 ceph-mon[88928]: pgmap v1173: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:11.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:11 smithi142 ceph-mon[69118]: pgmap v1174: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:11.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:11 smithi046 ceph-mon[88928]: pgmap v1174: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:13.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:13 smithi142 ceph-mon[69118]: pgmap v1175: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:13.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:13.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:13 smithi046 ceph-mon[88928]: pgmap v1175: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:13.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:15.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:15 smithi142 ceph-mon[69118]: pgmap v1176: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:15.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:15 smithi046 ceph-mon[88928]: pgmap v1176: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:17.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:17 smithi142 ceph-mon[69118]: pgmap v1177: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:17.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:17 smithi046 ceph-mon[88928]: pgmap v1177: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:19.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:19 smithi142 ceph-mon[69118]: pgmap v1178: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:19.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:19 smithi046 ceph-mon[88928]: pgmap v1178: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:21.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:21 smithi142 ceph-mon[69118]: pgmap v1179: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:21.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:21 smithi046 ceph-mon[88928]: pgmap v1179: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:23.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:23 smithi142 ceph-mon[69118]: pgmap v1180: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:23.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:23 smithi046 ceph-mon[88928]: pgmap v1180: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:25.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:25 smithi142 ceph-mon[69118]: pgmap v1181: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:25.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:25 smithi046 ceph-mon[88928]: pgmap v1181: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:27.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:27 smithi142 ceph-mon[69118]: pgmap v1182: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:27.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:27 smithi046 ceph-mon[88928]: pgmap v1182: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:28.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:28.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:29.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:29 smithi142 ceph-mon[69118]: pgmap v1183: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:29.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:29 smithi046 ceph-mon[88928]: pgmap v1183: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:31.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:31 smithi142 ceph-mon[69118]: pgmap v1184: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:31.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:31 smithi046 ceph-mon[88928]: pgmap v1184: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:33.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:33 smithi046 ceph-mon[88928]: pgmap v1185: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:33.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:33 smithi142 ceph-mon[69118]: pgmap v1185: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:35 smithi142 ceph-mon[69118]: pgmap v1186: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:35.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:35 smithi046 ceph-mon[88928]: pgmap v1186: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:37.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:37 smithi142 ceph-mon[69118]: pgmap v1187: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:37.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:37 smithi046 ceph-mon[88928]: pgmap v1187: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:39.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:39 smithi142 ceph-mon[69118]: pgmap v1188: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:39.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:39 smithi046 ceph-mon[88928]: pgmap v1188: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:41.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:41 smithi142 ceph-mon[69118]: pgmap v1189: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:41.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:41 smithi046 ceph-mon[88928]: pgmap v1189: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:43.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:43 smithi142 ceph-mon[69118]: pgmap v1190: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:43.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:43.768 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:43 smithi046 ceph-mon[88928]: pgmap v1190: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:43.768 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:45.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:45 smithi142 ceph-mon[69118]: pgmap v1191: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:45.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:45 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:42:45.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:45 smithi046 ceph-mon[88928]: pgmap v1191: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:45.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:45 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:42:47.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:47 smithi046 ceph-mon[88928]: pgmap v1192: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:47.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:47.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:47 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:47.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:47 smithi142 ceph-mon[69118]: pgmap v1192: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:47.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:47.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:47 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:49.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:49 smithi046 ceph-mon[88928]: pgmap v1193: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:49.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:49.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:49 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:49.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:49 smithi142 ceph-mon[69118]: pgmap v1193: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:49.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:49.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:49 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:50.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:50 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:50.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:50 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:50.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:50 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:50.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:50 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:51.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:51 smithi142 ceph-mon[69118]: pgmap v1194: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:51.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:51 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:51.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:51 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:51.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:51 smithi046 ceph-mon[88928]: pgmap v1194: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:51.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:51 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:51.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:51 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:53.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:52 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:53.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:52 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:53.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:52 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:53.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:52 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:53.990 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:53 smithi046 ceph-mon[88928]: pgmap v1195: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:53 smithi142 ceph-mon[69118]: pgmap v1195: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:55.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:55.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:55.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:42:55.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:42:55.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:55.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:55 smithi046 ceph-mon[88928]: pgmap v1196: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:55.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:55.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:55.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:42:55.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:42:55.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:42:55.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:55 smithi142 ceph-mon[69118]: pgmap v1196: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:57.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:57 smithi046 ceph-mon[88928]: pgmap v1197: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:57.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:57 smithi142 ceph-mon[69118]: pgmap v1197: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:58.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:58.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:59.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:42:59 smithi046 ceph-mon[88928]: pgmap v1198: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:42:59.582 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:42:59 smithi142 ceph-mon[69118]: pgmap v1198: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:01.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:01 smithi046 ceph-mon[88928]: pgmap v1199: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:01.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:01 smithi142 ceph-mon[69118]: pgmap v1199: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:03.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:03 smithi046 ceph-mon[88928]: pgmap v1200: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:03.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:03 smithi142 ceph-mon[69118]: pgmap v1200: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:05.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:05 smithi046 ceph-mon[88928]: pgmap v1201: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:05.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:05 smithi142 ceph-mon[69118]: pgmap v1201: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:07.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:07 smithi046 ceph-mon[88928]: pgmap v1202: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:07.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:07 smithi142 ceph-mon[69118]: pgmap v1202: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:09.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:09 smithi046 ceph-mon[88928]: pgmap v1203: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:09.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:09 smithi142 ceph-mon[69118]: pgmap v1203: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:11.560 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:11 smithi046 ceph-mon[88928]: pgmap v1204: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:11.585 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:11 smithi142 ceph-mon[69118]: pgmap v1204: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:13.560 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:13 smithi046 ceph-mon[88928]: pgmap v1205: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:13.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:13.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:13 smithi142 ceph-mon[69118]: pgmap v1205: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:13.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:15.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:15 smithi046 ceph-mon[88928]: pgmap v1206: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:15.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:15 smithi142 ceph-mon[69118]: pgmap v1206: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:17.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:17 smithi046 ceph-mon[88928]: pgmap v1207: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:17.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:17 smithi142 ceph-mon[69118]: pgmap v1207: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:19.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:19 smithi046 ceph-mon[88928]: pgmap v1208: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:19.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:19 smithi142 ceph-mon[69118]: pgmap v1208: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:21.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:21 smithi142 ceph-mon[69118]: pgmap v1209: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:21.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:21 smithi046 ceph-mon[88928]: pgmap v1209: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:23.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:23 smithi142 ceph-mon[69118]: pgmap v1210: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:23.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:23 smithi046 ceph-mon[88928]: pgmap v1210: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:25.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:25 smithi142 ceph-mon[69118]: pgmap v1211: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:25.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:25 smithi046 ceph-mon[88928]: pgmap v1211: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:27.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:27 smithi142 ceph-mon[69118]: pgmap v1212: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:27.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:27 smithi046 ceph-mon[88928]: pgmap v1212: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:28.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:28.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:29.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:29 smithi046 ceph-mon[88928]: pgmap v1213: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:29.582 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:29 smithi142 ceph-mon[69118]: pgmap v1213: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:31.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:31 smithi142 ceph-mon[69118]: pgmap v1214: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:31.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:31 smithi046 ceph-mon[88928]: pgmap v1214: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:33.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:33 smithi142 ceph-mon[69118]: pgmap v1215: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:33.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:33 smithi046 ceph-mon[88928]: pgmap v1215: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:35 smithi142 ceph-mon[69118]: pgmap v1216: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:35.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:35 smithi046 ceph-mon[88928]: pgmap v1216: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:37.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:37 smithi142 ceph-mon[69118]: pgmap v1217: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:37.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:37 smithi046 ceph-mon[88928]: pgmap v1217: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:39.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:39 smithi142 ceph-mon[69118]: pgmap v1218: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:39.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:39 smithi046 ceph-mon[88928]: pgmap v1218: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:41.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:41 smithi142 ceph-mon[69118]: pgmap v1219: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:41.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:41 smithi046 ceph-mon[88928]: pgmap v1219: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:43.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:43 smithi142 ceph-mon[69118]: pgmap v1220: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:43.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:43.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:43 smithi046 ceph-mon[88928]: pgmap v1220: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:43.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:45.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:45 smithi142 ceph-mon[69118]: pgmap v1221: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:45.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:45 smithi046 ceph-mon[88928]: pgmap v1221: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:47.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:47 smithi142 ceph-mon[69118]: pgmap v1222: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:47.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:47 smithi046 ceph-mon[88928]: pgmap v1222: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:49.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:49 smithi142 ceph-mon[69118]: pgmap v1223: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:49.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:49 smithi046 ceph-mon[88928]: pgmap v1223: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:51.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:51 smithi046 ceph-mon[88928]: pgmap v1224: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:51.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:51 smithi142 ceph-mon[69118]: pgmap v1224: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:53.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:53 smithi046 ceph-mon[88928]: pgmap v1225: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:53.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:53 smithi142 ceph-mon[69118]: pgmap v1225: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:54.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:54 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:43:54.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:54 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:43:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:55 smithi046 ceph-mon[88928]: pgmap v1226: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:43:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:43:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:43:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:43:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:43:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:55 smithi142 ceph-mon[69118]: pgmap v1226: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:43:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:43:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:43:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:43:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:43:58.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:57 smithi046 ceph-mon[88928]: pgmap v1227: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:58.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:57 smithi142 ceph-mon[69118]: pgmap v1227: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:43:59.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:59.082 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:00.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:43:59 smithi046 ceph-mon[88928]: pgmap v1228: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:00.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:43:59 smithi142 ceph-mon[69118]: pgmap v1228: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:02.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:01 smithi046 ceph-mon[88928]: pgmap v1229: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:02.080 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:01 smithi142 ceph-mon[69118]: pgmap v1229: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:03 smithi046 ceph-mon[88928]: pgmap v1230: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:04.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:03 smithi142 ceph-mon[69118]: pgmap v1230: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:06.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:05 smithi046 ceph-mon[88928]: pgmap v1231: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:06.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:05 smithi142 ceph-mon[69118]: pgmap v1231: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:08.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:07 smithi046 ceph-mon[88928]: pgmap v1232: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:08.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:07 smithi142 ceph-mon[69118]: pgmap v1232: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:10.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:09 smithi046 ceph-mon[88928]: pgmap v1233: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:10.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:09 smithi142 ceph-mon[69118]: pgmap v1233: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:12.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:11 smithi046 ceph-mon[88928]: pgmap v1234: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:12.178 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:11 smithi142 ceph-mon[69118]: pgmap v1234: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:14.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:13 smithi046 ceph-mon[88928]: pgmap v1235: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:14.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:14.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:13 smithi142 ceph-mon[69118]: pgmap v1235: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:16.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:15 smithi046 ceph-mon[88928]: pgmap v1236: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:16.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:15 smithi142 ceph-mon[69118]: pgmap v1236: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:18.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:17 smithi046 ceph-mon[88928]: pgmap v1237: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:18.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:17 smithi142 ceph-mon[69118]: pgmap v1237: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:20.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:19 smithi046 ceph-mon[88928]: pgmap v1238: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:20.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:19 smithi142 ceph-mon[69118]: pgmap v1238: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:22.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:21 smithi046 ceph-mon[88928]: pgmap v1239: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:22.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:21 smithi142 ceph-mon[69118]: pgmap v1239: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:24.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:23 smithi046 ceph-mon[88928]: pgmap v1240: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:24.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:23 smithi142 ceph-mon[69118]: pgmap v1240: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:26.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:25 smithi046 ceph-mon[88928]: pgmap v1241: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:26.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:25 smithi142 ceph-mon[69118]: pgmap v1241: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:28.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:27 smithi046 ceph-mon[88928]: pgmap v1242: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:28.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:27 smithi142 ceph-mon[69118]: pgmap v1242: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:29.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:29.083 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:30.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:29 smithi046 ceph-mon[88928]: pgmap v1243: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:30.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:29 smithi142 ceph-mon[69118]: pgmap v1243: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:32.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:31 smithi046 ceph-mon[88928]: pgmap v1244: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:32.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:31 smithi142 ceph-mon[69118]: pgmap v1244: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:34.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:33 smithi046 ceph-mon[88928]: pgmap v1245: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:34.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:33 smithi142 ceph-mon[69118]: pgmap v1245: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:36.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:35 smithi046 ceph-mon[88928]: pgmap v1246: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:36.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:35 smithi142 ceph-mon[69118]: pgmap v1246: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:38.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:37 smithi046 ceph-mon[88928]: pgmap v1247: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:38.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:37 smithi142 ceph-mon[69118]: pgmap v1247: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:40.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:39 smithi046 ceph-mon[88928]: pgmap v1248: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:40.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:39 smithi142 ceph-mon[69118]: pgmap v1248: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:42.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:41 smithi046 ceph-mon[88928]: pgmap v1249: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:42.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:41 smithi142 ceph-mon[69118]: pgmap v1249: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:43.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:43.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:44.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:43 smithi046 ceph-mon[88928]: pgmap v1250: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:44.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:43 smithi142 ceph-mon[69118]: pgmap v1250: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:46.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:45 smithi046 ceph-mon[88928]: pgmap v1251: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:46.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:45 smithi142 ceph-mon[69118]: pgmap v1251: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:48.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:47 smithi046 ceph-mon[88928]: pgmap v1252: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:48.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:47 smithi142 ceph-mon[69118]: pgmap v1252: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:50.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:49 smithi046 ceph-mon[88928]: pgmap v1253: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:50.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:49 smithi142 ceph-mon[69118]: pgmap v1253: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:52.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:51 smithi046 ceph-mon[88928]: pgmap v1254: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:52.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:51 smithi142 ceph-mon[69118]: pgmap v1254: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:54.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:53 smithi046 ceph-mon[88928]: pgmap v1255: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:54.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:53 smithi142 ceph-mon[69118]: pgmap v1255: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:56.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:55 smithi046 ceph-mon[88928]: pgmap v1256: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:56.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:55 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:44:56.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:55 smithi142 ceph-mon[69118]: pgmap v1256: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:56.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:55 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:44:57.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:56 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:44:57.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:56 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:44:57.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:56 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:44:57.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:56 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:44:57.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:56 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:44:57.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:56 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:44:57.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:57 smithi142 ceph-mon[69118]: pgmap v1257: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:57.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:58.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:57 smithi046 ceph-mon[88928]: pgmap v1257: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:44:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:00.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:44:59 smithi142 ceph-mon[69118]: pgmap v1258: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:00.294 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:44:59 smithi046 ceph-mon[88928]: pgmap v1258: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:02.112 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:01 smithi046 ceph-mon[88928]: pgmap v1259: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:02.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:01 smithi142 ceph-mon[69118]: pgmap v1259: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:04.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:03 smithi142 ceph-mon[69118]: pgmap v1260: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:04.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:03 smithi046 ceph-mon[88928]: pgmap v1260: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:06.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:05 smithi142 ceph-mon[69118]: pgmap v1261: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:05 smithi046 ceph-mon[88928]: pgmap v1261: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:08.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:07 smithi142 ceph-mon[69118]: pgmap v1262: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:08.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:07 smithi046 ceph-mon[88928]: pgmap v1262: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:10.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:09 smithi142 ceph-mon[69118]: pgmap v1263: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:10.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:09 smithi046 ceph-mon[88928]: pgmap v1263: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:12.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:11 smithi046 ceph-mon[88928]: pgmap v1264: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:12.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:11 smithi142 ceph-mon[69118]: pgmap v1264: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:13.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:13.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:14.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:13 smithi142 ceph-mon[69118]: pgmap v1265: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:14.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:13 smithi046 ceph-mon[88928]: pgmap v1265: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:16.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:15 smithi142 ceph-mon[69118]: pgmap v1266: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:16.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:15 smithi046 ceph-mon[88928]: pgmap v1266: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:18.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:17 smithi142 ceph-mon[69118]: pgmap v1267: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:18.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:17 smithi046 ceph-mon[88928]: pgmap v1267: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:20.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:19 smithi142 ceph-mon[69118]: pgmap v1268: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:20.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:19 smithi046 ceph-mon[88928]: pgmap v1268: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:22.112 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:21 smithi046 ceph-mon[88928]: pgmap v1269: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:22.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:21 smithi142 ceph-mon[69118]: pgmap v1269: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:24.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:23 smithi142 ceph-mon[69118]: pgmap v1270: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:24.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:23 smithi046 ceph-mon[88928]: pgmap v1270: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:26.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:25 smithi142 ceph-mon[69118]: pgmap v1271: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:26.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:25 smithi046 ceph-mon[88928]: pgmap v1271: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:28.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:27 smithi142 ceph-mon[69118]: pgmap v1272: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:28.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:28.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:27 smithi046 ceph-mon[88928]: pgmap v1272: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:28.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:30.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:29 smithi142 ceph-mon[69118]: pgmap v1273: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:30.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:29 smithi046 ceph-mon[88928]: pgmap v1273: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:32.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:31 smithi142 ceph-mon[69118]: pgmap v1274: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:32.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:31 smithi046 ceph-mon[88928]: pgmap v1274: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:34.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:33 smithi142 ceph-mon[69118]: pgmap v1275: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:34.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:33 smithi046 ceph-mon[88928]: pgmap v1275: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:36.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:35 smithi046 ceph-mon[88928]: pgmap v1276: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:36.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:35 smithi142 ceph-mon[69118]: pgmap v1276: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:38.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:37 smithi142 ceph-mon[69118]: pgmap v1277: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:38.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:37 smithi046 ceph-mon[88928]: pgmap v1277: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:40.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:39 smithi142 ceph-mon[69118]: pgmap v1278: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:40.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:39 smithi046 ceph-mon[88928]: pgmap v1278: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:42.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:41 smithi142 ceph-mon[69118]: pgmap v1279: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:42.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:41 smithi046 ceph-mon[88928]: pgmap v1279: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:43.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:43.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:44.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:43 smithi142 ceph-mon[69118]: pgmap v1280: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:44.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:43 smithi046 ceph-mon[88928]: pgmap v1280: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:46.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:45 smithi046 ceph-mon[88928]: pgmap v1281: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:46.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:45 smithi142 ceph-mon[69118]: pgmap v1281: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:48.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:47 smithi142 ceph-mon[69118]: pgmap v1282: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:48.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:47 smithi046 ceph-mon[88928]: pgmap v1282: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:50.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:49 smithi142 ceph-mon[69118]: pgmap v1283: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:50.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:49 smithi046 ceph-mon[88928]: pgmap v1283: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:52.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:51 smithi142 ceph-mon[69118]: pgmap v1284: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:52.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:51 smithi046 ceph-mon[88928]: pgmap v1284: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:54.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:53 smithi142 ceph-mon[69118]: pgmap v1285: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:54.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:53 smithi046 ceph-mon[88928]: pgmap v1285: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:56.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:55 smithi142 ceph-mon[69118]: pgmap v1286: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:56.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:55 smithi046 ceph-mon[88928]: pgmap v1286: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:57.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:56 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:45:57.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:56 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:45:57.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:56 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:45:57.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:56 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:45:57.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:56 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:45:57.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:56 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:45:58.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:57 smithi142 ceph-mon[69118]: pgmap v1287: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:58.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:45:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:45:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:45:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:58.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:57 smithi046 ceph-mon[88928]: pgmap v1287: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:45:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:45:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:45:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:45:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:00.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:45:59 smithi142 ceph-mon[69118]: pgmap v1288: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:00.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:45:59 smithi046 ceph-mon[88928]: pgmap v1288: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:02.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:01 smithi142 ceph-mon[69118]: pgmap v1289: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:02.211 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:01 smithi046 ceph-mon[88928]: pgmap v1289: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:04.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:03 smithi142 ceph-mon[69118]: pgmap v1290: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:04.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:03 smithi046 ceph-mon[88928]: pgmap v1290: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:06.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:05 smithi142 ceph-mon[69118]: pgmap v1291: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:06.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:05 smithi046 ceph-mon[88928]: pgmap v1291: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:08.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:07 smithi142 ceph-mon[69118]: pgmap v1292: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:08.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:07 smithi046 ceph-mon[88928]: pgmap v1292: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:10.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:09 smithi142 ceph-mon[69118]: pgmap v1293: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:10.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:09 smithi046 ceph-mon[88928]: pgmap v1293: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:12.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:11 smithi046 ceph-mon[88928]: pgmap v1294: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:12.430 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:11 smithi142 ceph-mon[69118]: pgmap v1294: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:13.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:13.365 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:14.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:13 smithi046 ceph-mon[88928]: pgmap v1295: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:14.430 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:13 smithi142 ceph-mon[69118]: pgmap v1295: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:16.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:15 smithi046 ceph-mon[88928]: pgmap v1296: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:16.430 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:15 smithi142 ceph-mon[69118]: pgmap v1296: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:17.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:16 smithi046 ceph-mon[88928]: pgmap v1297: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:17.430 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:16 smithi142 ceph-mon[69118]: pgmap v1297: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:19.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:19 smithi142 ceph-mon[69118]: pgmap v1298: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:19.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:19 smithi046 ceph-mon[88928]: pgmap v1298: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:21.560 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:21 smithi046 ceph-mon[88928]: pgmap v1299: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:21.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:21 smithi142 ceph-mon[69118]: pgmap v1299: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:23.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:23 smithi142 ceph-mon[69118]: pgmap v1300: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:23.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:23 smithi046 ceph-mon[88928]: pgmap v1300: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:25.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:25 smithi142 ceph-mon[69118]: pgmap v1301: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:25.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:25 smithi046 ceph-mon[88928]: pgmap v1301: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:27.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:27 smithi142 ceph-mon[69118]: pgmap v1302: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:27.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:27 smithi046 ceph-mon[88928]: pgmap v1302: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:28.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:28.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:29.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:29 smithi142 ceph-mon[69118]: pgmap v1303: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:29.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:29 smithi046 ceph-mon[88928]: pgmap v1303: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:31.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:31 smithi142 ceph-mon[69118]: pgmap v1304: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:31.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:31 smithi046 ceph-mon[88928]: pgmap v1304: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:33.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:33 smithi142 ceph-mon[69118]: pgmap v1305: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:33.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:33 smithi046 ceph-mon[88928]: pgmap v1305: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:35 smithi142 ceph-mon[69118]: pgmap v1306: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:35.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:35 smithi046 ceph-mon[88928]: pgmap v1306: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:37.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:37 smithi142 ceph-mon[69118]: pgmap v1307: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:37.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:37 smithi046 ceph-mon[88928]: pgmap v1307: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:39.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:39 smithi142 ceph-mon[69118]: pgmap v1308: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:39.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:39 smithi046 ceph-mon[88928]: pgmap v1308: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:41.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:41 smithi142 ceph-mon[69118]: pgmap v1309: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:41.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:41 smithi046 ceph-mon[88928]: pgmap v1309: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:43.661 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:43 smithi142 ceph-mon[69118]: pgmap v1310: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:43.662 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:43.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:43 smithi046 ceph-mon[88928]: pgmap v1310: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:43.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:45.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:45 smithi046 ceph-mon[88928]: pgmap v1311: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:45.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:45 smithi142 ceph-mon[69118]: pgmap v1311: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:47.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:47 smithi046 ceph-mon[88928]: pgmap v1312: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:47.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:47 smithi142 ceph-mon[69118]: pgmap v1312: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:49.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:49 smithi046 ceph-mon[88928]: pgmap v1313: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:49.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:49 smithi142 ceph-mon[69118]: pgmap v1313: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:51.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:51 smithi046 ceph-mon[88928]: pgmap v1314: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:51.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:51 smithi142 ceph-mon[69118]: pgmap v1314: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:53.760 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:53 smithi142 ceph-mon[69118]: pgmap v1315: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:53.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:53 smithi046 ceph-mon[88928]: pgmap v1315: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:55.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:55 smithi046 ceph-mon[88928]: pgmap v1316: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:55.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:55 smithi142 ceph-mon[69118]: pgmap v1316: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:57.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:57 smithi046 ceph-mon[88928]: pgmap v1317: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:57.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:46:57.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:57 smithi142 ceph-mon[69118]: pgmap v1317: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:57.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:46:58.810 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:58.810 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:46:58.810 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:46:58.810 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:46:58.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:58.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:46:58.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:46:58.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:46:59.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:46:59 smithi046 ceph-mon[88928]: pgmap v1318: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:46:59.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:46:59 smithi142 ceph-mon[69118]: pgmap v1318: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:01.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:01 smithi046 ceph-mon[88928]: pgmap v1319: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:01.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:01 smithi142 ceph-mon[69118]: pgmap v1319: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:03.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:03 smithi046 ceph-mon[88928]: pgmap v1320: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:03.858 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:03 smithi142 ceph-mon[69118]: pgmap v1320: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:05.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:05 smithi046 ceph-mon[88928]: pgmap v1321: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:05.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:05 smithi142 ceph-mon[69118]: pgmap v1321: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:07.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:07 smithi046 ceph-mon[88928]: pgmap v1322: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:07.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:07 smithi142 ceph-mon[69118]: pgmap v1322: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:09.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:09 smithi046 ceph-mon[88928]: pgmap v1323: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:09.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:09 smithi142 ceph-mon[69118]: pgmap v1323: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:11.765 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:11 smithi046 ceph-mon[88928]: pgmap v1324: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:11.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:11 smithi142 ceph-mon[69118]: pgmap v1324: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:13.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:13 smithi046 ceph-mon[88928]: pgmap v1325: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:13.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:13.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:13 smithi142 ceph-mon[69118]: pgmap v1325: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:13.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:15.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:15 smithi046 ceph-mon[88928]: pgmap v1326: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:15.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:15 smithi142 ceph-mon[69118]: pgmap v1326: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:17.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:17 smithi046 ceph-mon[88928]: pgmap v1327: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:17.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:17 smithi142 ceph-mon[69118]: pgmap v1327: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:19.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:19 smithi046 ceph-mon[88928]: pgmap v1328: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:19.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:19 smithi142 ceph-mon[69118]: pgmap v1328: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:21.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:21 smithi046 ceph-mon[88928]: pgmap v1329: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:21.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:21 smithi142 ceph-mon[69118]: pgmap v1329: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:23.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:23 smithi046 ceph-mon[88928]: pgmap v1330: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:23.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:23 smithi142 ceph-mon[69118]: pgmap v1330: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:25.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:25 smithi046 ceph-mon[88928]: pgmap v1331: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:25.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:25 smithi142 ceph-mon[69118]: pgmap v1331: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:27.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:27 smithi046 ceph-mon[88928]: pgmap v1332: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:27.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:27 smithi142 ceph-mon[69118]: pgmap v1332: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:28.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:28.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:29.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:29 smithi046 ceph-mon[88928]: pgmap v1333: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:29.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:29 smithi142 ceph-mon[69118]: pgmap v1333: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:31.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:31 smithi046 ceph-mon[88928]: pgmap v1334: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:31.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:31 smithi142 ceph-mon[69118]: pgmap v1334: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:33.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:33 smithi046 ceph-mon[88928]: pgmap v1335: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:33.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:33 smithi142 ceph-mon[69118]: pgmap v1335: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:35.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:35 smithi046 ceph-mon[88928]: pgmap v1336: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:35.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:35 smithi142 ceph-mon[69118]: pgmap v1336: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:37.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:37 smithi046 ceph-mon[88928]: pgmap v1337: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:37.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:37 smithi142 ceph-mon[69118]: pgmap v1337: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:39.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:39 smithi046 ceph-mon[88928]: pgmap v1338: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:39.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:39 smithi142 ceph-mon[69118]: pgmap v1338: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:41.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:41 smithi046 ceph-mon[88928]: pgmap v1339: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:41.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:41 smithi142 ceph-mon[69118]: pgmap v1339: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:43.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:43 smithi142 ceph-mon[69118]: pgmap v1340: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:43.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:44.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:43 smithi046 ceph-mon[88928]: pgmap v1340: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:44.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:45.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:45 smithi142 ceph-mon[69118]: pgmap v1341: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:46.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:45 smithi046 ceph-mon[88928]: pgmap v1341: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:47.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:47 smithi142 ceph-mon[69118]: pgmap v1342: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:48.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:47 smithi046 ceph-mon[88928]: pgmap v1342: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:49.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:49 smithi142 ceph-mon[69118]: pgmap v1343: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:50.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:49 smithi046 ceph-mon[88928]: pgmap v1343: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:51.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:51 smithi142 ceph-mon[69118]: pgmap v1344: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:52.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:51 smithi046 ceph-mon[88928]: pgmap v1344: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:53.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:53 smithi142 ceph-mon[69118]: pgmap v1345: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:54.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:53 smithi046 ceph-mon[88928]: pgmap v1345: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:55.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:55 smithi142 ceph-mon[69118]: pgmap v1346: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:56.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:55 smithi046 ceph-mon[88928]: pgmap v1346: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:57.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:57 smithi142 ceph-mon[69118]: pgmap v1347: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:58.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:57 smithi046 ceph-mon[88928]: pgmap v1347: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:58.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:58.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:47:59.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:59.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:47:59.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:59 smithi142 ceph-mon[69118]: pgmap v1348: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:47:59.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:47:59.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:47:59.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:47:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:48:00.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:59 smithi046 ceph-mon[88928]: pgmap v1348: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:00.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:48:00.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:48:00.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:47:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:48:01.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:01 smithi142 ceph-mon[69118]: pgmap v1349: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:02.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:01 smithi046 ceph-mon[88928]: pgmap v1349: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:03.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:03 smithi142 ceph-mon[69118]: pgmap v1350: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:04.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:03 smithi046 ceph-mon[88928]: pgmap v1350: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:05.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:05 smithi142 ceph-mon[69118]: pgmap v1351: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:06.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:05 smithi046 ceph-mon[88928]: pgmap v1351: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:07.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:07 smithi046 ceph-mon[88928]: pgmap v1352: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:07.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:07 smithi142 ceph-mon[69118]: pgmap v1352: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:09.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:09 smithi142 ceph-mon[69118]: pgmap v1353: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:10.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:09 smithi046 ceph-mon[88928]: pgmap v1353: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:11.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:11 smithi142 ceph-mon[69118]: pgmap v1354: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:12.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:11 smithi046 ceph-mon[88928]: pgmap v1354: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:13.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:13 smithi142 ceph-mon[69118]: pgmap v1355: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:13.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:14.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:13 smithi046 ceph-mon[88928]: pgmap v1355: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:14.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:15.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:15 smithi142 ceph-mon[69118]: pgmap v1356: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:16.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:15 smithi046 ceph-mon[88928]: pgmap v1356: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:17.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:17 smithi046 ceph-mon[88928]: pgmap v1357: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:17.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:17 smithi142 ceph-mon[69118]: pgmap v1357: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:19.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:19 smithi142 ceph-mon[69118]: pgmap v1358: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:20.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:19 smithi046 ceph-mon[88928]: pgmap v1358: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:21.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:21 smithi142 ceph-mon[69118]: pgmap v1359: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:22.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:21 smithi046 ceph-mon[88928]: pgmap v1359: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:23.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:23 smithi142 ceph-mon[69118]: pgmap v1360: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:24.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:23 smithi046 ceph-mon[88928]: pgmap v1360: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:25.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:25 smithi142 ceph-mon[69118]: pgmap v1361: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:26.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:25 smithi046 ceph-mon[88928]: pgmap v1361: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:27.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:27 smithi142 ceph-mon[69118]: pgmap v1362: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:28.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:27 smithi046 ceph-mon[88928]: pgmap v1362: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:28.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:29.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:29.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:29 smithi142 ceph-mon[69118]: pgmap v1363: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:30.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:29 smithi046 ceph-mon[88928]: pgmap v1363: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:31.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:31 smithi142 ceph-mon[69118]: pgmap v1364: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:32.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:31 smithi046 ceph-mon[88928]: pgmap v1364: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:33.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:33 smithi142 ceph-mon[69118]: pgmap v1365: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:34.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:33 smithi046 ceph-mon[88928]: pgmap v1365: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:35.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:35 smithi142 ceph-mon[69118]: pgmap v1366: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:36.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:35 smithi046 ceph-mon[88928]: pgmap v1366: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:37.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:37 smithi142 ceph-mon[69118]: pgmap v1367: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:38.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:37 smithi046 ceph-mon[88928]: pgmap v1367: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:39.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:39 smithi142 ceph-mon[69118]: pgmap v1368: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:40.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:39 smithi046 ceph-mon[88928]: pgmap v1368: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:41.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:41 smithi142 ceph-mon[69118]: pgmap v1369: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:42.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:41 smithi046 ceph-mon[88928]: pgmap v1369: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:43.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:43 smithi142 ceph-mon[69118]: pgmap v1370: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:43.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:44.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:43 smithi046 ceph-mon[88928]: pgmap v1370: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:44.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:45.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:45 smithi142 ceph-mon[69118]: pgmap v1371: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:46.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:45 smithi046 ceph-mon[88928]: pgmap v1371: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:47.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:47 smithi142 ceph-mon[69118]: pgmap v1372: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:48.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:47 smithi046 ceph-mon[88928]: pgmap v1372: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:49.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:49 smithi142 ceph-mon[69118]: pgmap v1373: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:50.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:49 smithi046 ceph-mon[88928]: pgmap v1373: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:51.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:51 smithi142 ceph-mon[69118]: pgmap v1374: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:52.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:51 smithi046 ceph-mon[88928]: pgmap v1374: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:53.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:53 smithi142 ceph-mon[69118]: pgmap v1375: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:54.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:53 smithi046 ceph-mon[88928]: pgmap v1375: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:55.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:55 smithi142 ceph-mon[69118]: pgmap v1376: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:56.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:55 smithi046 ceph-mon[88928]: pgmap v1376: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:57.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:57 smithi142 ceph-mon[69118]: pgmap v1377: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:57.952 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:57 smithi046 ceph-mon[88928]: pgmap v1377: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:59.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:59.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:59.992 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:59 smithi142 ceph-mon[69118]: pgmap v1378: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:48:59.992 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:48:59.992 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:48:59.992 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:48:59.993 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:48:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:49:00.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:59 smithi046 ceph-mon[88928]: pgmap v1378: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:00.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:49:00.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:49:00.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:49:00.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:48:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:49:02.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:01 smithi046 ceph-mon[88928]: pgmap v1379: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:02.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:01 smithi142 ceph-mon[69118]: pgmap v1379: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:04.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:03 smithi046 ceph-mon[88928]: pgmap v1380: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:04.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:03 smithi142 ceph-mon[69118]: pgmap v1380: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:06.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:05 smithi046 ceph-mon[88928]: pgmap v1381: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:06.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:05 smithi142 ceph-mon[69118]: pgmap v1381: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:08.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:07 smithi046 ceph-mon[88928]: pgmap v1382: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:08.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:07 smithi142 ceph-mon[69118]: pgmap v1382: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:10.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:09 smithi046 ceph-mon[88928]: pgmap v1383: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:10.088 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:09 smithi142 ceph-mon[69118]: pgmap v1383: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:12.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:11 smithi046 ceph-mon[88928]: pgmap v1384: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:12.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:11 smithi142 ceph-mon[69118]: pgmap v1384: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:14.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:13 smithi046 ceph-mon[88928]: pgmap v1385: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:14.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:14.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:13 smithi142 ceph-mon[69118]: pgmap v1385: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:14.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:16.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:15 smithi046 ceph-mon[88928]: pgmap v1386: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:16.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:15 smithi142 ceph-mon[69118]: pgmap v1386: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:18.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:17 smithi046 ceph-mon[88928]: pgmap v1387: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:18.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:17 smithi142 ceph-mon[69118]: pgmap v1387: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:20.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:19 smithi046 ceph-mon[88928]: pgmap v1388: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:20.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:19 smithi142 ceph-mon[69118]: pgmap v1388: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:22.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:21 smithi046 ceph-mon[88928]: pgmap v1389: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:22.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:21 smithi142 ceph-mon[69118]: pgmap v1389: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:24.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:23 smithi046 ceph-mon[88928]: pgmap v1390: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:24.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:23 smithi142 ceph-mon[69118]: pgmap v1390: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:26.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:25 smithi046 ceph-mon[88928]: pgmap v1391: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:26.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:25 smithi142 ceph-mon[69118]: pgmap v1391: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:28.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:27 smithi046 ceph-mon[88928]: pgmap v1392: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:28.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:27 smithi142 ceph-mon[69118]: pgmap v1392: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:29.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:29.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:30.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:29 smithi046 ceph-mon[88928]: pgmap v1393: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:30.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:29 smithi142 ceph-mon[69118]: pgmap v1393: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:32.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:31 smithi046 ceph-mon[88928]: pgmap v1394: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:32.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:31 smithi142 ceph-mon[69118]: pgmap v1394: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:34.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:33 smithi046 ceph-mon[88928]: pgmap v1395: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:34.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:33 smithi142 ceph-mon[69118]: pgmap v1395: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:36.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:35 smithi046 ceph-mon[88928]: pgmap v1396: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:36.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:35 smithi142 ceph-mon[69118]: pgmap v1396: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:38.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:37 smithi046 ceph-mon[88928]: pgmap v1397: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:38.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:37 smithi142 ceph-mon[69118]: pgmap v1397: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:40.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:39 smithi046 ceph-mon[88928]: pgmap v1398: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:40.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:39 smithi142 ceph-mon[69118]: pgmap v1398: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:42.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:41 smithi046 ceph-mon[88928]: pgmap v1399: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:42.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:41 smithi142 ceph-mon[69118]: pgmap v1399: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:44.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:43 smithi046 ceph-mon[88928]: pgmap v1400: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:44.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:44.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:43 smithi142 ceph-mon[69118]: pgmap v1400: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:44.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:46.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:45 smithi046 ceph-mon[88928]: pgmap v1401: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:46.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:45 smithi142 ceph-mon[69118]: pgmap v1401: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:48.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:47 smithi046 ceph-mon[88928]: pgmap v1402: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:48.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:47 smithi142 ceph-mon[69118]: pgmap v1402: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:50.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:49 smithi046 ceph-mon[88928]: pgmap v1403: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:50.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:49 smithi142 ceph-mon[69118]: pgmap v1403: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:52.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:51 smithi046 ceph-mon[88928]: pgmap v1404: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:52.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:51 smithi142 ceph-mon[69118]: pgmap v1404: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:54.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:53 smithi046 ceph-mon[88928]: pgmap v1405: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:54.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:53 smithi142 ceph-mon[69118]: pgmap v1405: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:55.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:55 smithi142 ceph-mon[69118]: pgmap v1406: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:56.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:55 smithi046 ceph-mon[88928]: pgmap v1406: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:58.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:57 smithi046 ceph-mon[88928]: pgmap v1407: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:58.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:57 smithi142 ceph-mon[69118]: pgmap v1407: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:49:59.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:59.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:00.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:59 smithi046 ceph-mon[88928]: pgmap v1408: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:00.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:49:59 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:50:00.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:59 smithi142 ceph-mon[69118]: pgmap v1408: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:00.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:49:59 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:50:00.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:00 smithi142 ceph-mon[69118]: overall HEALTH_OK 2024-02-19T19:50:00.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:50:00.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:50:00.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:50:01.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:00 smithi046 ceph-mon[88928]: overall HEALTH_OK 2024-02-19T19:50:01.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:50:01.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:50:01.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:50:02.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:01 smithi046 ceph-mon[88928]: pgmap v1409: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:02.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:01 smithi142 ceph-mon[69118]: pgmap v1409: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:03 smithi046 ceph-mon[88928]: pgmap v1410: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:04.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:03 smithi142 ceph-mon[69118]: pgmap v1410: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:05.930 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:05 smithi142 ceph-mon[69118]: pgmap v1411: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:06.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:05 smithi046 ceph-mon[88928]: pgmap v1411: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:08.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:07 smithi046 ceph-mon[88928]: pgmap v1412: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:08.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:07 smithi142 ceph-mon[69118]: pgmap v1412: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:10.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:09 smithi046 ceph-mon[88928]: pgmap v1413: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:10.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:09 smithi142 ceph-mon[69118]: pgmap v1413: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:12.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:11 smithi046 ceph-mon[88928]: pgmap v1414: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:12.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:11 smithi142 ceph-mon[69118]: pgmap v1414: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:13.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:13.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:14.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:13 smithi046 ceph-mon[88928]: pgmap v1415: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:13 smithi142 ceph-mon[69118]: pgmap v1415: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:16.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:15 smithi046 ceph-mon[88928]: pgmap v1416: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:16.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:15 smithi142 ceph-mon[69118]: pgmap v1416: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:18.060 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:17 smithi046 ceph-mon[88928]: pgmap v1417: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:18.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:17 smithi142 ceph-mon[69118]: pgmap v1417: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:20.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:19 smithi142 ceph-mon[69118]: pgmap v1418: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:20.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:19 smithi046 ceph-mon[88928]: pgmap v1418: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:22.112 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:21 smithi046 ceph-mon[88928]: pgmap v1419: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:22.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:21 smithi142 ceph-mon[69118]: pgmap v1419: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:24.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:23 smithi142 ceph-mon[69118]: pgmap v1420: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:24.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:23 smithi046 ceph-mon[88928]: pgmap v1420: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:26.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:25 smithi142 ceph-mon[69118]: pgmap v1421: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:26.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:25 smithi046 ceph-mon[88928]: pgmap v1421: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:27 smithi142 ceph-mon[69118]: pgmap v1422: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:28.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:27 smithi046 ceph-mon[88928]: pgmap v1422: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:28.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:30.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:29 smithi142 ceph-mon[69118]: pgmap v1423: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:30.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:29 smithi046 ceph-mon[88928]: pgmap v1423: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:32.112 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:31 smithi046 ceph-mon[88928]: pgmap v1424: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:32.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:31 smithi142 ceph-mon[69118]: pgmap v1424: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:34.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:33 smithi142 ceph-mon[69118]: pgmap v1425: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:34.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:33 smithi046 ceph-mon[88928]: pgmap v1425: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:36.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:35 smithi142 ceph-mon[69118]: pgmap v1426: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:36.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:35 smithi046 ceph-mon[88928]: pgmap v1426: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:38.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:37 smithi142 ceph-mon[69118]: pgmap v1427: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:38.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:37 smithi046 ceph-mon[88928]: pgmap v1427: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:40.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:39 smithi142 ceph-mon[69118]: pgmap v1428: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:40.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:39 smithi046 ceph-mon[88928]: pgmap v1428: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:42.112 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:41 smithi046 ceph-mon[88928]: pgmap v1429: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:42.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:41 smithi142 ceph-mon[69118]: pgmap v1429: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:43.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:43.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:44.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:43 smithi046 ceph-mon[88928]: pgmap v1430: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:44.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:43 smithi142 ceph-mon[69118]: pgmap v1430: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:46.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:45 smithi142 ceph-mon[69118]: pgmap v1431: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:46.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:45 smithi046 ceph-mon[88928]: pgmap v1431: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:48.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:47 smithi142 ceph-mon[69118]: pgmap v1432: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:48.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:47 smithi046 ceph-mon[88928]: pgmap v1432: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:50.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:49 smithi142 ceph-mon[69118]: pgmap v1433: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:50.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:49 smithi046 ceph-mon[88928]: pgmap v1433: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:52.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:51 smithi046 ceph-mon[88928]: pgmap v1434: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:52.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:51 smithi142 ceph-mon[69118]: pgmap v1434: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:53 smithi142 ceph-mon[69118]: pgmap v1435: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:54.256 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:53 smithi046 ceph-mon[88928]: pgmap v1435: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:56.125 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:55 smithi142 ceph-mon[69118]: pgmap v1436: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:56.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:55 smithi046 ceph-mon[88928]: pgmap v1436: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:57 smithi142 ceph-mon[69118]: pgmap v1437: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:57 smithi046 ceph-mon[88928]: pgmap v1437: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:50:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:00.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:50:59 smithi142 ceph-mon[69118]: pgmap v1438: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:00.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:50:59 smithi046 ceph-mon[88928]: pgmap v1438: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:01.175 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:51:01.175 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:51:01.175 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:51:01.175 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:51:01.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:51:01.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:51:01.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:51:01.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:51:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:01 smithi142 ceph-mon[69118]: pgmap v1439: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:02.212 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:01 smithi046 ceph-mon[88928]: pgmap v1439: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:04.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:03 smithi142 ceph-mon[69118]: pgmap v1440: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:04.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:03 smithi046 ceph-mon[88928]: pgmap v1440: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:05 smithi142 ceph-mon[69118]: pgmap v1441: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:05 smithi046 ceph-mon[88928]: pgmap v1441: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:08.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:07 smithi142 ceph-mon[69118]: pgmap v1442: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:08.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:07 smithi046 ceph-mon[88928]: pgmap v1442: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:09 smithi142 ceph-mon[69118]: pgmap v1443: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:10.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:09 smithi046 ceph-mon[88928]: pgmap v1443: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:11 smithi142 ceph-mon[69118]: pgmap v1444: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:12.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:11 smithi046 ceph-mon[88928]: pgmap v1444: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:13.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:13.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:13 smithi142 ceph-mon[69118]: pgmap v1445: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:14.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:13 smithi046 ceph-mon[88928]: pgmap v1445: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:16.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:15 smithi142 ceph-mon[69118]: pgmap v1446: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:16.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:15 smithi046 ceph-mon[88928]: pgmap v1446: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:18.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:17 smithi142 ceph-mon[69118]: pgmap v1447: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:18.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:17 smithi046 ceph-mon[88928]: pgmap v1447: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:20.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:19 smithi142 ceph-mon[69118]: pgmap v1448: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:20.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:19 smithi046 ceph-mon[88928]: pgmap v1448: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:22.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:21 smithi142 ceph-mon[69118]: pgmap v1449: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:22.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:21 smithi046 ceph-mon[88928]: pgmap v1449: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:24.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:23 smithi142 ceph-mon[69118]: pgmap v1450: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:24.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:23 smithi046 ceph-mon[88928]: pgmap v1450: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:26.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:25 smithi142 ceph-mon[69118]: pgmap v1451: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:26.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:25 smithi046 ceph-mon[88928]: pgmap v1451: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:27 smithi142 ceph-mon[69118]: pgmap v1452: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:28.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:27 smithi046 ceph-mon[88928]: pgmap v1452: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:28.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:30.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:29 smithi142 ceph-mon[69118]: pgmap v1453: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:30.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:29 smithi046 ceph-mon[88928]: pgmap v1453: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:32.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:31 smithi142 ceph-mon[69118]: pgmap v1454: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:32.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:31 smithi046 ceph-mon[88928]: pgmap v1454: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:34.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:33 smithi046 ceph-mon[88928]: pgmap v1455: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:34.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:33 smithi142 ceph-mon[69118]: pgmap v1455: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:36.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:35 smithi046 ceph-mon[88928]: pgmap v1456: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:36.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:35 smithi142 ceph-mon[69118]: pgmap v1456: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:38.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:37 smithi046 ceph-mon[88928]: pgmap v1457: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:38.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:37 smithi142 ceph-mon[69118]: pgmap v1457: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:40.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:39 smithi046 ceph-mon[88928]: pgmap v1458: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:40.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:39 smithi142 ceph-mon[69118]: pgmap v1458: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:42.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:41 smithi046 ceph-mon[88928]: pgmap v1459: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:42.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:41 smithi142 ceph-mon[69118]: pgmap v1459: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:43.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:43.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:44.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:43 smithi046 ceph-mon[88928]: pgmap v1460: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:44.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:43 smithi142 ceph-mon[69118]: pgmap v1460: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:46.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:45 smithi046 ceph-mon[88928]: pgmap v1461: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:46.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:45 smithi142 ceph-mon[69118]: pgmap v1461: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:48.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:47 smithi046 ceph-mon[88928]: pgmap v1462: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:48.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:47 smithi142 ceph-mon[69118]: pgmap v1462: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:50.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:49 smithi046 ceph-mon[88928]: pgmap v1463: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:50.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:49 smithi142 ceph-mon[69118]: pgmap v1463: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:52.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:51 smithi046 ceph-mon[88928]: pgmap v1464: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:52.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:51 smithi142 ceph-mon[69118]: pgmap v1464: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:54.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:53 smithi046 ceph-mon[88928]: pgmap v1465: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:54.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:53 smithi142 ceph-mon[69118]: pgmap v1465: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:56.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:55 smithi046 ceph-mon[88928]: pgmap v1466: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:56.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:55 smithi142 ceph-mon[69118]: pgmap v1466: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:57 smithi046 ceph-mon[88928]: pgmap v1467: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:58.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:57 smithi142 ceph-mon[69118]: pgmap v1467: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:51:58.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:00.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:51:59 smithi046 ceph-mon[88928]: pgmap v1468: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:00.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:51:59 smithi142 ceph-mon[69118]: pgmap v1468: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:01.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:00 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:52:01.430 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:00 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:52:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:01 smithi142 ceph-mon[69118]: pgmap v1469: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:52:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:52:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:01 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:52:02.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:01 smithi046 ceph-mon[88928]: pgmap v1469: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:02.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:52:02.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:52:02.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:01 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:52:04.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:03 smithi046 ceph-mon[88928]: pgmap v1470: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:04.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:03 smithi142 ceph-mon[69118]: pgmap v1470: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:05 smithi046 ceph-mon[88928]: pgmap v1471: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:06.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:05 smithi142 ceph-mon[69118]: pgmap v1471: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:08.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:07 smithi046 ceph-mon[88928]: pgmap v1472: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:08.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:07 smithi142 ceph-mon[69118]: pgmap v1472: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:10.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:09 smithi046 ceph-mon[88928]: pgmap v1473: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:10.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:09 smithi142 ceph-mon[69118]: pgmap v1473: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:11.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:11 smithi046 ceph-mon[88928]: pgmap v1474: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:11.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:11 smithi142 ceph-mon[69118]: pgmap v1474: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:13.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:13 smithi142 ceph-mon[69118]: pgmap v1475: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:13.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:13.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:13 smithi046 ceph-mon[88928]: pgmap v1475: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:13.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:15.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:15 smithi142 ceph-mon[69118]: pgmap v1476: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:15.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:15 smithi046 ceph-mon[88928]: pgmap v1476: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:17.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:17 smithi142 ceph-mon[69118]: pgmap v1477: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:17.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:17 smithi046 ceph-mon[88928]: pgmap v1477: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:19.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:19 smithi046 ceph-mon[88928]: pgmap v1478: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:19.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:19 smithi142 ceph-mon[69118]: pgmap v1478: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:21.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:21 smithi046 ceph-mon[88928]: pgmap v1479: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:21.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:21 smithi142 ceph-mon[69118]: pgmap v1479: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:23.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:23 smithi046 ceph-mon[88928]: pgmap v1480: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:23.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:23 smithi142 ceph-mon[69118]: pgmap v1480: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:25.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:25 smithi046 ceph-mon[88928]: pgmap v1481: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:25.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:25 smithi142 ceph-mon[69118]: pgmap v1481: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:27.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:27 smithi046 ceph-mon[88928]: pgmap v1482: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:27.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:27 smithi142 ceph-mon[69118]: pgmap v1482: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:28.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:28.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:29.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:29 smithi046 ceph-mon[88928]: pgmap v1483: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:29 smithi142 ceph-mon[69118]: pgmap v1483: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:31.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:31 smithi046 ceph-mon[88928]: pgmap v1484: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:31.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:31 smithi142 ceph-mon[69118]: pgmap v1484: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:33.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:33 smithi046 ceph-mon[88928]: pgmap v1485: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:33.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:33 smithi142 ceph-mon[69118]: pgmap v1485: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:35.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:35 smithi046 ceph-mon[88928]: pgmap v1486: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:35.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:35 smithi142 ceph-mon[69118]: pgmap v1486: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:37.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:37 smithi046 ceph-mon[88928]: pgmap v1487: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:37.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:37 smithi142 ceph-mon[69118]: pgmap v1487: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:39.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:39 smithi046 ceph-mon[88928]: pgmap v1488: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:39.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:39 smithi142 ceph-mon[69118]: pgmap v1488: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:41.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:41 smithi046 ceph-mon[88928]: pgmap v1489: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:41.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:41 smithi142 ceph-mon[69118]: pgmap v1489: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:43.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:43 smithi046 ceph-mon[88928]: pgmap v1490: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:43.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:43.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:43 smithi142 ceph-mon[69118]: pgmap v1490: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:43.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:45.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:45 smithi046 ceph-mon[88928]: pgmap v1491: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:45.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:45 smithi142 ceph-mon[69118]: pgmap v1491: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:47.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:47 smithi046 ceph-mon[88928]: pgmap v1492: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:47.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:47 smithi142 ceph-mon[69118]: pgmap v1492: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:49.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:49 smithi046 ceph-mon[88928]: pgmap v1493: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:49.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:49 smithi142 ceph-mon[69118]: pgmap v1493: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:51.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:51 smithi046 ceph-mon[88928]: pgmap v1494: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:51.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:51 smithi142 ceph-mon[69118]: pgmap v1494: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:53.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:53 smithi046 ceph-mon[88928]: pgmap v1495: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:53.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:53 smithi142 ceph-mon[69118]: pgmap v1495: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:55.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:55 smithi046 ceph-mon[88928]: pgmap v1496: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:55.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:55 smithi142 ceph-mon[69118]: pgmap v1496: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:57.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:57 smithi142 ceph-mon[69118]: pgmap v1497: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:57.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:57 smithi046 ceph-mon[88928]: pgmap v1497: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:58.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:58.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:59.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:52:59 smithi046 ceph-mon[88928]: pgmap v1498: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:52:59.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:52:59 smithi142 ceph-mon[69118]: pgmap v1498: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:01.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:01 smithi046 ceph-mon[88928]: pgmap v1499: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:01.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:01 smithi142 ceph-mon[69118]: pgmap v1499: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:02.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:02 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:53:02.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:02 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:53:03.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:03 smithi142 ceph-mon[69118]: pgmap v1500: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:03.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:03 smithi046 ceph-mon[88928]: pgmap v1500: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:04.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:04 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:53:04.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:04 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:53:05.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:04 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:53:05.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:04 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:53:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:05 smithi142 ceph-mon[69118]: pgmap v1501: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:05 smithi046 ceph-mon[88928]: pgmap v1501: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:07.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:53:07.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:53:07.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:07 smithi142 ceph-mon[69118]: pgmap v1502: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:07.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:53:07.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:53:07.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:53:07.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:53:07.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:53:07.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:07 smithi046 ceph-mon[88928]: pgmap v1502: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:07.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:53:07.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:53:07.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:53:09.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:09 smithi046 ceph-mon[88928]: pgmap v1503: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:09.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:09 smithi142 ceph-mon[69118]: pgmap v1503: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:11.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:11 smithi046 ceph-mon[88928]: pgmap v1504: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:11.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:11 smithi142 ceph-mon[69118]: pgmap v1504: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:13.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:13 smithi046 ceph-mon[88928]: pgmap v1505: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:13.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:13.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:13 smithi142 ceph-mon[69118]: pgmap v1505: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:13.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:15.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:15 smithi046 ceph-mon[88928]: pgmap v1506: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:15.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:15 smithi142 ceph-mon[69118]: pgmap v1506: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:17.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:17 smithi046 ceph-mon[88928]: pgmap v1507: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:17.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:17 smithi142 ceph-mon[69118]: pgmap v1507: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:19.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:19 smithi046 ceph-mon[88928]: pgmap v1508: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:19.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:19 smithi142 ceph-mon[69118]: pgmap v1508: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:21.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:21 smithi046 ceph-mon[88928]: pgmap v1509: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:21.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:21 smithi142 ceph-mon[69118]: pgmap v1509: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:23.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:23 smithi046 ceph-mon[88928]: pgmap v1510: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:23.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:23 smithi142 ceph-mon[69118]: pgmap v1510: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:25.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:25 smithi046 ceph-mon[88928]: pgmap v1511: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:25.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:25 smithi142 ceph-mon[69118]: pgmap v1511: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:27.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:27 smithi046 ceph-mon[88928]: pgmap v1512: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:27.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:27 smithi142 ceph-mon[69118]: pgmap v1512: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:28.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:28.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:29.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:29 smithi046 ceph-mon[88928]: pgmap v1513: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:29 smithi142 ceph-mon[69118]: pgmap v1513: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:31.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:31 smithi046 ceph-mon[88928]: pgmap v1514: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:31.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:31 smithi142 ceph-mon[69118]: pgmap v1514: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:33.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:33 smithi046 ceph-mon[88928]: pgmap v1515: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:33.832 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:33 smithi142 ceph-mon[69118]: pgmap v1515: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:35.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:35 smithi046 ceph-mon[88928]: pgmap v1516: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:35.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:35 smithi142 ceph-mon[69118]: pgmap v1516: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:37.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:37 smithi046 ceph-mon[88928]: pgmap v1517: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:37.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:37 smithi142 ceph-mon[69118]: pgmap v1517: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:39.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:39 smithi046 ceph-mon[88928]: pgmap v1518: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:39.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:39 smithi142 ceph-mon[69118]: pgmap v1518: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:41.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:41 smithi046 ceph-mon[88928]: pgmap v1519: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:41.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:41 smithi142 ceph-mon[69118]: pgmap v1519: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:43.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:43 smithi046 ceph-mon[88928]: pgmap v1520: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:43.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:43.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:43 smithi142 ceph-mon[69118]: pgmap v1520: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:43.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:45.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:45 smithi046 ceph-mon[88928]: pgmap v1521: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:45.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:45 smithi142 ceph-mon[69118]: pgmap v1521: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:47.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:47 smithi142 ceph-mon[69118]: pgmap v1522: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:47.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:47 smithi046 ceph-mon[88928]: pgmap v1522: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:49.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:49 smithi046 ceph-mon[88928]: pgmap v1523: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:49.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:49 smithi142 ceph-mon[69118]: pgmap v1523: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:51.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:51 smithi046 ceph-mon[88928]: pgmap v1524: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:51.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:51 smithi142 ceph-mon[69118]: pgmap v1524: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:53.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:53 smithi046 ceph-mon[88928]: pgmap v1525: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:53.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:53 smithi142 ceph-mon[69118]: pgmap v1525: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:55.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:55 smithi046 ceph-mon[88928]: pgmap v1526: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:55.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:55 smithi142 ceph-mon[69118]: pgmap v1526: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:57.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:57 smithi046 ceph-mon[88928]: pgmap v1527: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:57.896 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:57 smithi142 ceph-mon[69118]: pgmap v1527: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:58.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:58.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:59.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:53:59 smithi046 ceph-mon[88928]: pgmap v1528: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:53:59.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:53:59 smithi142 ceph-mon[69118]: pgmap v1528: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:01.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:01 smithi046 ceph-mon[88928]: pgmap v1529: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:01.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:01 smithi142 ceph-mon[69118]: pgmap v1529: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:03.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:03 smithi046 ceph-mon[88928]: pgmap v1530: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:03.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:03 smithi142 ceph-mon[69118]: pgmap v1530: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:05.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:05 smithi046 ceph-mon[88928]: pgmap v1531: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:05.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:05 smithi142 ceph-mon[69118]: pgmap v1531: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:07.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:07 smithi046 ceph-mon[88928]: pgmap v1532: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:07.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:54:07.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:07 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:54:07.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:07 smithi142 ceph-mon[69118]: pgmap v1532: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:07.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:54:07.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:07 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:54:08.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:54:08.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:54:08.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:54:08.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:54:08.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:54:08.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:54:08.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:54:08.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:54:09.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:09 smithi046 ceph-mon[88928]: pgmap v1533: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:09.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:09 smithi142 ceph-mon[69118]: pgmap v1533: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:11.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:11 smithi046 ceph-mon[88928]: pgmap v1534: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:11.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:11 smithi142 ceph-mon[69118]: pgmap v1534: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:13.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:13 smithi046 ceph-mon[88928]: pgmap v1535: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:13.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:13.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:13 smithi142 ceph-mon[69118]: pgmap v1535: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:13.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:15.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:15 smithi046 ceph-mon[88928]: pgmap v1536: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:15.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:15 smithi142 ceph-mon[69118]: pgmap v1536: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:17.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:17 smithi046 ceph-mon[88928]: pgmap v1537: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:17.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:17 smithi142 ceph-mon[69118]: pgmap v1537: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:19.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:19 smithi046 ceph-mon[88928]: pgmap v1538: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:19.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:19 smithi142 ceph-mon[69118]: pgmap v1538: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:21.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:21 smithi046 ceph-mon[88928]: pgmap v1539: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:21.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:21 smithi142 ceph-mon[69118]: pgmap v1539: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:23.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:23 smithi046 ceph-mon[88928]: pgmap v1540: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:23.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:23 smithi142 ceph-mon[69118]: pgmap v1540: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:25.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:25 smithi046 ceph-mon[88928]: pgmap v1541: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:25.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:25 smithi142 ceph-mon[69118]: pgmap v1541: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:27.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:27 smithi142 ceph-mon[69118]: pgmap v1542: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:28.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:27 smithi046 ceph-mon[88928]: pgmap v1542: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:28.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:29.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:29 smithi142 ceph-mon[69118]: pgmap v1543: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:30.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:29 smithi046 ceph-mon[88928]: pgmap v1543: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:31.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:31 smithi142 ceph-mon[69118]: pgmap v1544: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:32.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:31 smithi046 ceph-mon[88928]: pgmap v1544: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:33.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:33 smithi142 ceph-mon[69118]: pgmap v1545: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:34.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:33 smithi046 ceph-mon[88928]: pgmap v1545: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:35.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:35 smithi142 ceph-mon[69118]: pgmap v1546: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:36.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:35 smithi046 ceph-mon[88928]: pgmap v1546: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:37.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:37 smithi142 ceph-mon[69118]: pgmap v1547: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:38.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:37 smithi046 ceph-mon[88928]: pgmap v1547: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:39.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:39 smithi142 ceph-mon[69118]: pgmap v1548: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:40.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:39 smithi046 ceph-mon[88928]: pgmap v1548: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:41.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:41 smithi142 ceph-mon[69118]: pgmap v1549: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:42.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:41 smithi046 ceph-mon[88928]: pgmap v1549: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:43.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:43 smithi142 ceph-mon[69118]: pgmap v1550: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:43.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:44.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:43 smithi046 ceph-mon[88928]: pgmap v1550: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:44.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:45.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:45 smithi142 ceph-mon[69118]: pgmap v1551: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:46.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:45 smithi046 ceph-mon[88928]: pgmap v1551: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:47.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:47 smithi142 ceph-mon[69118]: pgmap v1552: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:48.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:47 smithi046 ceph-mon[88928]: pgmap v1552: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:49.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:49 smithi142 ceph-mon[69118]: pgmap v1553: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:50.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:49 smithi046 ceph-mon[88928]: pgmap v1553: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:51.903 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:51 smithi046 ceph-mon[88928]: pgmap v1554: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:51.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:51 smithi142 ceph-mon[69118]: pgmap v1554: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:53.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:53 smithi142 ceph-mon[69118]: pgmap v1555: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:54.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:53 smithi046 ceph-mon[88928]: pgmap v1555: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:55.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:55 smithi142 ceph-mon[69118]: pgmap v1556: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:55 smithi046 ceph-mon[88928]: pgmap v1556: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:57.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:57 smithi142 ceph-mon[69118]: pgmap v1557: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:58.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:57 smithi046 ceph-mon[88928]: pgmap v1557: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:54:58.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:59.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:59.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:54:59 smithi142 ceph-mon[69118]: pgmap v1558: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:00.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:54:59 smithi046 ceph-mon[88928]: pgmap v1558: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:01.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:01 smithi142 ceph-mon[69118]: pgmap v1559: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:02.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:01 smithi046 ceph-mon[88928]: pgmap v1559: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:03.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:03 smithi142 ceph-mon[69118]: pgmap v1560: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:03 smithi046 ceph-mon[88928]: pgmap v1560: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:05.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:05 smithi142 ceph-mon[69118]: pgmap v1561: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:06.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:05 smithi046 ceph-mon[88928]: pgmap v1561: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:07.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:07 smithi142 ceph-mon[69118]: pgmap v1562: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:08.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:07 smithi046 ceph-mon[88928]: pgmap v1562: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:08.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:08 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:55:09.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:08 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:55:09.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:09 smithi142 ceph-mon[69118]: pgmap v1563: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:09.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:09 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:55:09.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:09 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:55:09.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:09 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:55:10.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:09 smithi046 ceph-mon[88928]: pgmap v1563: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:10.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:09 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:55:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:09 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:55:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:09 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:55:11.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:11 smithi142 ceph-mon[69118]: pgmap v1564: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:12.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:11 smithi046 ceph-mon[88928]: pgmap v1564: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:13.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:13 smithi142 ceph-mon[69118]: pgmap v1565: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:13.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:14.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:13 smithi046 ceph-mon[88928]: pgmap v1565: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:14.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:15.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:15 smithi142 ceph-mon[69118]: pgmap v1566: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:16.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:15 smithi046 ceph-mon[88928]: pgmap v1566: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:17.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:17 smithi142 ceph-mon[69118]: pgmap v1567: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:18.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:17 smithi046 ceph-mon[88928]: pgmap v1567: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:19.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:19 smithi142 ceph-mon[69118]: pgmap v1568: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:20.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:19 smithi046 ceph-mon[88928]: pgmap v1568: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:21.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:21 smithi142 ceph-mon[69118]: pgmap v1569: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:22.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:21 smithi046 ceph-mon[88928]: pgmap v1569: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:23.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:23 smithi142 ceph-mon[69118]: pgmap v1570: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:24.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:23 smithi046 ceph-mon[88928]: pgmap v1570: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:25.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:25 smithi142 ceph-mon[69118]: pgmap v1571: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:26.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:25 smithi046 ceph-mon[88928]: pgmap v1571: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:27.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:27 smithi142 ceph-mon[69118]: pgmap v1572: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:28.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:27 smithi046 ceph-mon[88928]: pgmap v1572: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:28.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:29.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:29.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:29 smithi142 ceph-mon[69118]: pgmap v1573: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:30.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:29 smithi046 ceph-mon[88928]: pgmap v1573: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:31.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:31 smithi142 ceph-mon[69118]: pgmap v1574: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:32.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:31 smithi046 ceph-mon[88928]: pgmap v1574: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:34.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:33 smithi046 ceph-mon[88928]: pgmap v1575: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:34.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:33 smithi142 ceph-mon[69118]: pgmap v1575: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:36.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:35 smithi046 ceph-mon[88928]: pgmap v1576: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:36.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:35 smithi142 ceph-mon[69118]: pgmap v1576: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:38.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:37 smithi046 ceph-mon[88928]: pgmap v1577: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:38.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:37 smithi142 ceph-mon[69118]: pgmap v1577: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:40.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:39 smithi046 ceph-mon[88928]: pgmap v1578: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:40.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:39 smithi142 ceph-mon[69118]: pgmap v1578: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:42.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:41 smithi046 ceph-mon[88928]: pgmap v1579: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:41 smithi142 ceph-mon[69118]: pgmap v1579: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:44.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:43 smithi046 ceph-mon[88928]: pgmap v1580: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:44.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:43 smithi142 ceph-mon[69118]: pgmap v1580: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:45.993 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:45 smithi142 ceph-mon[69118]: pgmap v1581: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:46.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:45 smithi046 ceph-mon[88928]: pgmap v1581: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:47.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:47 smithi046 ceph-mon[88928]: pgmap v1582: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:48.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:47 smithi142 ceph-mon[69118]: pgmap v1582: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:50.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:49 smithi046 ceph-mon[88928]: pgmap v1583: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:50.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:49 smithi142 ceph-mon[69118]: pgmap v1583: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:52.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:51 smithi046 ceph-mon[88928]: pgmap v1584: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:52.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:51 smithi142 ceph-mon[69118]: pgmap v1584: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:54.026 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:53 smithi142 ceph-mon[69118]: pgmap v1585: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:54.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:53 smithi046 ceph-mon[88928]: pgmap v1585: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:55 smithi046 ceph-mon[88928]: pgmap v1586: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:55 smithi142 ceph-mon[69118]: pgmap v1586: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:58.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:57 smithi046 ceph-mon[88928]: pgmap v1587: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:57 smithi142 ceph-mon[69118]: pgmap v1587: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:55:59.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:59.075 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:00.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:55:59 smithi046 ceph-mon[88928]: pgmap v1588: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:00.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:55:59 smithi142 ceph-mon[69118]: pgmap v1588: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:02.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:01 smithi046 ceph-mon[88928]: pgmap v1589: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:01 smithi142 ceph-mon[69118]: pgmap v1589: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:03.984 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:03 smithi142 ceph-mon[69118]: pgmap v1590: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:03 smithi046 ceph-mon[88928]: pgmap v1590: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:06.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:05 smithi046 ceph-mon[88928]: pgmap v1591: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:05 smithi142 ceph-mon[69118]: pgmap v1591: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:08.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:07 smithi046 ceph-mon[88928]: pgmap v1592: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:08.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:07 smithi142 ceph-mon[69118]: pgmap v1592: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:09 smithi046 ceph-mon[88928]: pgmap v1593: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:09 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:56:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:09 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:56:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:09 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:56:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:09 smithi142 ceph-mon[69118]: pgmap v1593: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:10.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:09 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:56:10.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:09 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:56:10.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:09 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:56:11.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:56:11.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:56:11.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:56:11.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:56:11.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:56:11.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:56:12.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:11 smithi046 ceph-mon[88928]: pgmap v1594: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:11 smithi142 ceph-mon[69118]: pgmap v1594: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:13 smithi046 ceph-mon[88928]: pgmap v1595: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:13 smithi142 ceph-mon[69118]: pgmap v1595: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:16.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:15 smithi046 ceph-mon[88928]: pgmap v1596: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:16.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:15 smithi142 ceph-mon[69118]: pgmap v1596: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:18.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:17 smithi046 ceph-mon[88928]: pgmap v1597: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:18.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:17 smithi142 ceph-mon[69118]: pgmap v1597: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:20.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:19 smithi046 ceph-mon[88928]: pgmap v1598: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:20.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:19 smithi142 ceph-mon[69118]: pgmap v1598: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:22.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:21 smithi046 ceph-mon[88928]: pgmap v1599: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:22.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:21 smithi142 ceph-mon[69118]: pgmap v1599: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:24.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:23 smithi046 ceph-mon[88928]: pgmap v1600: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:24.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:23 smithi142 ceph-mon[69118]: pgmap v1600: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:26.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:25 smithi046 ceph-mon[88928]: pgmap v1601: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:26.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:25 smithi142 ceph-mon[69118]: pgmap v1601: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:28.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:27 smithi046 ceph-mon[88928]: pgmap v1602: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:27 smithi142 ceph-mon[69118]: pgmap v1602: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:29.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:29.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:30.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:29 smithi046 ceph-mon[88928]: pgmap v1603: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:30.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:29 smithi142 ceph-mon[69118]: pgmap v1603: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:32.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:31 smithi046 ceph-mon[88928]: pgmap v1604: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:32.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:31 smithi142 ceph-mon[69118]: pgmap v1604: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:34.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:33 smithi046 ceph-mon[88928]: pgmap v1605: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:34.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:33 smithi142 ceph-mon[69118]: pgmap v1605: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:36.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:35 smithi046 ceph-mon[88928]: pgmap v1606: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:36.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:35 smithi142 ceph-mon[69118]: pgmap v1606: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:38.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:37 smithi046 ceph-mon[88928]: pgmap v1607: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:38.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:37 smithi142 ceph-mon[69118]: pgmap v1607: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:40.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:39 smithi046 ceph-mon[88928]: pgmap v1608: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:40.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:39 smithi142 ceph-mon[69118]: pgmap v1608: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:42.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:41 smithi046 ceph-mon[88928]: pgmap v1609: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:41 smithi142 ceph-mon[69118]: pgmap v1609: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:44.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:43 smithi046 ceph-mon[88928]: pgmap v1610: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:43 smithi142 ceph-mon[69118]: pgmap v1610: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:46.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:45 smithi046 ceph-mon[88928]: pgmap v1611: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:46.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:45 smithi142 ceph-mon[69118]: pgmap v1611: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:48.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:47 smithi046 ceph-mon[88928]: pgmap v1612: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:48.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:47 smithi142 ceph-mon[69118]: pgmap v1612: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:49.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:49 smithi142 ceph-mon[69118]: pgmap v1613: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:50.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:49 smithi046 ceph-mon[88928]: pgmap v1613: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:52.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:51 smithi046 ceph-mon[88928]: pgmap v1614: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:52.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:51 smithi142 ceph-mon[69118]: pgmap v1614: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:54.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:53 smithi046 ceph-mon[88928]: pgmap v1615: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:53 smithi142 ceph-mon[69118]: pgmap v1615: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:55 smithi046 ceph-mon[88928]: pgmap v1616: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:55 smithi142 ceph-mon[69118]: pgmap v1616: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:58.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:57 smithi046 ceph-mon[88928]: pgmap v1617: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:58.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:57 smithi142 ceph-mon[69118]: pgmap v1617: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:56:58.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:59.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:56:59 smithi142 ceph-mon[69118]: pgmap v1618: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:00.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:56:59 smithi046 ceph-mon[88928]: pgmap v1618: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:02.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:01 smithi046 ceph-mon[88928]: pgmap v1619: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:02.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:01 smithi142 ceph-mon[69118]: pgmap v1619: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:04.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:03 smithi142 ceph-mon[69118]: pgmap v1620: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:04.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:03 smithi046 ceph-mon[88928]: pgmap v1620: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:05 smithi142 ceph-mon[69118]: pgmap v1621: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:05 smithi046 ceph-mon[88928]: pgmap v1621: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:08.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:07 smithi142 ceph-mon[69118]: pgmap v1622: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:08.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:07 smithi046 ceph-mon[88928]: pgmap v1622: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:09 smithi142 ceph-mon[69118]: pgmap v1623: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:10.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:09 smithi046 ceph-mon[88928]: pgmap v1623: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:11.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:57:11.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:57:11.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:57:11.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:57:11.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:57:11.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:57:11.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:57:11.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:57:12.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:11 smithi046 ceph-mon[88928]: pgmap v1624: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:11 smithi142 ceph-mon[69118]: pgmap v1624: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:13.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:13.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:13 smithi142 ceph-mon[69118]: pgmap v1625: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:14.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:13 smithi046 ceph-mon[88928]: pgmap v1625: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:16.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:15 smithi142 ceph-mon[69118]: pgmap v1626: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:16.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:15 smithi046 ceph-mon[88928]: pgmap v1626: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:17 smithi142 ceph-mon[69118]: pgmap v1627: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:18.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:17 smithi046 ceph-mon[88928]: pgmap v1627: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:20.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:19 smithi142 ceph-mon[69118]: pgmap v1628: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:19 smithi046 ceph-mon[88928]: pgmap v1628: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:22.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:21 smithi046 ceph-mon[88928]: pgmap v1629: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:21 smithi142 ceph-mon[69118]: pgmap v1629: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:24.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:23 smithi142 ceph-mon[69118]: pgmap v1630: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:24.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:23 smithi046 ceph-mon[88928]: pgmap v1630: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:26.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:25 smithi142 ceph-mon[69118]: pgmap v1631: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:25 smithi046 ceph-mon[88928]: pgmap v1631: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:27 smithi142 ceph-mon[69118]: pgmap v1632: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:28.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:27 smithi046 ceph-mon[88928]: pgmap v1632: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:30.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:29 smithi142 ceph-mon[69118]: pgmap v1633: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:30.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:29 smithi046 ceph-mon[88928]: pgmap v1633: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:32.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:31 smithi046 ceph-mon[88928]: pgmap v1634: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:32.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:31 smithi142 ceph-mon[69118]: pgmap v1634: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:34.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:33 smithi046 ceph-mon[88928]: pgmap v1635: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:34.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:33 smithi142 ceph-mon[69118]: pgmap v1635: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:36.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:35 smithi142 ceph-mon[69118]: pgmap v1636: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:36.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:35 smithi046 ceph-mon[88928]: pgmap v1636: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:38.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:37 smithi142 ceph-mon[69118]: pgmap v1637: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:38.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:37 smithi046 ceph-mon[88928]: pgmap v1637: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:40.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:39 smithi142 ceph-mon[69118]: pgmap v1638: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:40.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:39 smithi046 ceph-mon[88928]: pgmap v1638: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:42.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:41 smithi142 ceph-mon[69118]: pgmap v1639: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:42.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:41 smithi046 ceph-mon[88928]: pgmap v1639: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:43.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:43.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:43 smithi142 ceph-mon[69118]: pgmap v1640: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:44.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:43 smithi046 ceph-mon[88928]: pgmap v1640: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:46.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:45 smithi142 ceph-mon[69118]: pgmap v1641: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:46.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:45 smithi046 ceph-mon[88928]: pgmap v1641: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:48.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:47 smithi142 ceph-mon[69118]: pgmap v1642: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:48.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:47 smithi046 ceph-mon[88928]: pgmap v1642: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:50.167 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:49 smithi142 ceph-mon[69118]: pgmap v1643: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:50.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:49 smithi046 ceph-mon[88928]: pgmap v1643: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:52.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:51 smithi142 ceph-mon[69118]: pgmap v1644: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:52.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:51 smithi046 ceph-mon[88928]: pgmap v1644: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:53 smithi142 ceph-mon[69118]: pgmap v1645: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:54.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:53 smithi046 ceph-mon[88928]: pgmap v1645: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:55 smithi142 ceph-mon[69118]: pgmap v1646: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:56.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:55 smithi046 ceph-mon[88928]: pgmap v1646: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:57 smithi142 ceph-mon[69118]: pgmap v1647: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:58.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:57 smithi046 ceph-mon[88928]: pgmap v1647: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:57:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:00.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:57:59 smithi142 ceph-mon[69118]: pgmap v1648: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:00.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:57:59 smithi046 ceph-mon[88928]: pgmap v1648: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:02.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:01 smithi142 ceph-mon[69118]: pgmap v1649: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:02.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:01 smithi046 ceph-mon[88928]: pgmap v1649: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:04.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:03 smithi142 ceph-mon[69118]: pgmap v1650: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:04.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:03 smithi046 ceph-mon[88928]: pgmap v1650: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:06.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:05 smithi142 ceph-mon[69118]: pgmap v1651: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:05 smithi046 ceph-mon[88928]: pgmap v1651: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:08.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:07 smithi142 ceph-mon[69118]: pgmap v1652: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:08.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:07 smithi046 ceph-mon[88928]: pgmap v1652: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:09 smithi142 ceph-mon[69118]: pgmap v1653: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:10.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:09 smithi046 ceph-mon[88928]: pgmap v1653: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:11.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:10 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:58:11.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:10 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:58:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:11 smithi142 ceph-mon[69118]: pgmap v1654: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:12.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:58:12.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:58:12.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:11 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:58:12.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:11 smithi046 ceph-mon[88928]: pgmap v1654: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:12.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:58:12.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:58:12.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:11 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:58:13.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:13.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:14.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:13 smithi046 ceph-mon[88928]: pgmap v1655: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:14.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:13 smithi142 ceph-mon[69118]: pgmap v1655: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:16.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:15 smithi046 ceph-mon[88928]: pgmap v1656: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:16.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:15 smithi142 ceph-mon[69118]: pgmap v1656: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:18.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:17 smithi046 ceph-mon[88928]: pgmap v1657: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:18.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:17 smithi142 ceph-mon[69118]: pgmap v1657: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:19 smithi046 ceph-mon[88928]: pgmap v1658: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:20.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:19 smithi142 ceph-mon[69118]: pgmap v1658: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:22.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:21 smithi046 ceph-mon[88928]: pgmap v1659: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:22.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:21 smithi142 ceph-mon[69118]: pgmap v1659: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:24.271 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:23 smithi046 ceph-mon[88928]: pgmap v1660: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:24.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:23 smithi142 ceph-mon[69118]: pgmap v1660: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:25 smithi046 ceph-mon[88928]: pgmap v1661: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:26.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:25 smithi142 ceph-mon[69118]: pgmap v1661: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:27 smithi046 ceph-mon[88928]: pgmap v1662: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:28.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:27 smithi142 ceph-mon[69118]: pgmap v1662: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:28.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:30.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:29 smithi046 ceph-mon[88928]: pgmap v1663: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:30.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:29 smithi142 ceph-mon[69118]: pgmap v1663: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:32.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:31 smithi046 ceph-mon[88928]: pgmap v1664: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:32.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:31 smithi142 ceph-mon[69118]: pgmap v1664: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:34.234 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:33 smithi142 ceph-mon[69118]: pgmap v1665: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:34.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:33 smithi046 ceph-mon[88928]: pgmap v1665: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:36.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:35 smithi046 ceph-mon[88928]: pgmap v1666: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:36.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:35 smithi142 ceph-mon[69118]: pgmap v1666: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:38.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:37 smithi046 ceph-mon[88928]: pgmap v1667: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:38.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:37 smithi142 ceph-mon[69118]: pgmap v1667: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:40.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:39 smithi046 ceph-mon[88928]: pgmap v1668: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:40.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:39 smithi142 ceph-mon[69118]: pgmap v1668: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:42.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:41 smithi046 ceph-mon[88928]: pgmap v1669: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:42.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:41 smithi142 ceph-mon[69118]: pgmap v1669: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:43.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:43.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:44.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:43 smithi046 ceph-mon[88928]: pgmap v1670: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:44.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:43 smithi142 ceph-mon[69118]: pgmap v1670: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:46.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:45 smithi046 ceph-mon[88928]: pgmap v1671: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:46.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:45 smithi142 ceph-mon[69118]: pgmap v1671: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:48.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:47 smithi046 ceph-mon[88928]: pgmap v1672: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:48.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:47 smithi142 ceph-mon[69118]: pgmap v1672: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:50.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:49 smithi046 ceph-mon[88928]: pgmap v1673: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:50.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:49 smithi142 ceph-mon[69118]: pgmap v1673: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:52.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:51 smithi046 ceph-mon[88928]: pgmap v1674: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:52.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:51 smithi142 ceph-mon[69118]: pgmap v1674: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:54.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:53 smithi046 ceph-mon[88928]: pgmap v1675: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:54.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:53 smithi142 ceph-mon[69118]: pgmap v1675: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:56.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:55 smithi142 ceph-mon[69118]: pgmap v1676: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:56.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:55 smithi046 ceph-mon[88928]: pgmap v1676: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:57 smithi046 ceph-mon[88928]: pgmap v1677: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:58:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:58.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:58 smithi142 ceph-mon[69118]: pgmap v1677: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:58:58.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:58:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:00.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:00 smithi046 ceph-mon[88928]: pgmap v1678: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:00.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:00 smithi142 ceph-mon[69118]: pgmap v1678: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:02.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:02 smithi046 ceph-mon[88928]: pgmap v1679: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:02.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:02 smithi142 ceph-mon[69118]: pgmap v1679: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:04.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:04 smithi046 ceph-mon[88928]: pgmap v1680: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:04.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:04 smithi142 ceph-mon[69118]: pgmap v1680: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:06.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:06 smithi142 ceph-mon[69118]: pgmap v1681: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:06.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:06 smithi046 ceph-mon[88928]: pgmap v1681: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:08.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:08 smithi046 ceph-mon[88928]: pgmap v1682: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:08.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:08 smithi142 ceph-mon[69118]: pgmap v1682: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:10 smithi046 ceph-mon[88928]: pgmap v1683: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:10.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:10 smithi142 ceph-mon[69118]: pgmap v1683: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:12.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:12 smithi046 ceph-mon[88928]: pgmap v1684: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:12.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:59:12.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:12 smithi142 ceph-mon[69118]: pgmap v1684: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:12.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:59:13.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:59:13.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:59:13.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:59:13.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:13.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:59:13.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:59:13.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T19:59:13.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:14.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:14 smithi046 ceph-mon[88928]: pgmap v1685: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:14.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:14 smithi142 ceph-mon[69118]: pgmap v1685: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:16.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:16 smithi046 ceph-mon[88928]: pgmap v1686: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:16.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:16 smithi142 ceph-mon[69118]: pgmap v1686: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:18.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:18 smithi046 ceph-mon[88928]: pgmap v1687: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:18.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:18 smithi142 ceph-mon[69118]: pgmap v1687: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:20.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:20 smithi046 ceph-mon[88928]: pgmap v1688: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:20.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:20 smithi142 ceph-mon[69118]: pgmap v1688: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:22.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:22 smithi046 ceph-mon[88928]: pgmap v1689: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:22.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:22 smithi142 ceph-mon[69118]: pgmap v1689: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:24.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:24 smithi046 ceph-mon[88928]: pgmap v1690: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:24.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:24 smithi142 ceph-mon[69118]: pgmap v1690: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:26.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:26 smithi046 ceph-mon[88928]: pgmap v1691: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:26.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:26 smithi142 ceph-mon[69118]: pgmap v1691: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:28 smithi046 ceph-mon[88928]: pgmap v1692: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:28.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:28 smithi142 ceph-mon[69118]: pgmap v1692: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:28.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:30.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:30 smithi046 ceph-mon[88928]: pgmap v1693: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:30.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:30 smithi142 ceph-mon[69118]: pgmap v1693: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:32.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:32 smithi046 ceph-mon[88928]: pgmap v1694: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:32.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:32 smithi142 ceph-mon[69118]: pgmap v1694: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:34.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:34 smithi046 ceph-mon[88928]: pgmap v1695: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:34.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:34 smithi142 ceph-mon[69118]: pgmap v1695: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:35.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:35 smithi046 ceph-mon[88928]: pgmap v1696: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:35.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:35 smithi142 ceph-mon[69118]: pgmap v1696: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:37.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:37 smithi046 ceph-mon[88928]: pgmap v1697: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:37.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:37 smithi142 ceph-mon[69118]: pgmap v1697: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:39.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:39 smithi046 ceph-mon[88928]: pgmap v1698: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:39.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:39 smithi142 ceph-mon[69118]: pgmap v1698: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:41.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:41 smithi046 ceph-mon[88928]: pgmap v1699: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:41.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:41 smithi142 ceph-mon[69118]: pgmap v1699: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:43.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:43 smithi046 ceph-mon[88928]: pgmap v1700: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:43.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:43.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:43 smithi142 ceph-mon[69118]: pgmap v1700: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:43.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:45.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:45 smithi046 ceph-mon[88928]: pgmap v1701: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:45.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:45 smithi142 ceph-mon[69118]: pgmap v1701: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:47.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:47 smithi046 ceph-mon[88928]: pgmap v1702: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:47.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:47 smithi142 ceph-mon[69118]: pgmap v1702: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:49.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:49 smithi046 ceph-mon[88928]: pgmap v1703: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:49.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:49 smithi142 ceph-mon[69118]: pgmap v1703: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:51.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:51 smithi142 ceph-mon[69118]: pgmap v1704: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:52.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:51 smithi046 ceph-mon[88928]: pgmap v1704: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:53.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:53 smithi142 ceph-mon[69118]: pgmap v1705: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:54.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:53 smithi046 ceph-mon[88928]: pgmap v1705: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:55.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:55 smithi142 ceph-mon[69118]: pgmap v1706: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:56.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:55 smithi046 ceph-mon[88928]: pgmap v1706: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:57.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:57 smithi142 ceph-mon[69118]: pgmap v1707: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:58.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:57 smithi046 ceph-mon[88928]: pgmap v1707: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T19:59:58.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:59.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:59.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 19:59:59 smithi142 ceph-mon[69118]: pgmap v1708: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:00.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 19:59:59 smithi046 ceph-mon[88928]: pgmap v1708: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:00.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:00 smithi142 ceph-mon[69118]: overall HEALTH_OK 2024-02-19T20:00:01.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:00 smithi046 ceph-mon[88928]: overall HEALTH_OK 2024-02-19T20:00:01.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:01 smithi142 ceph-mon[69118]: pgmap v1709: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:02.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:01 smithi046 ceph-mon[88928]: pgmap v1709: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:03.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:03 smithi142 ceph-mon[69118]: pgmap v1710: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:04.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:03 smithi046 ceph-mon[88928]: pgmap v1710: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:05.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:05 smithi046 ceph-mon[88928]: pgmap v1711: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:05.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:05 smithi142 ceph-mon[69118]: pgmap v1711: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:07.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:07 smithi142 ceph-mon[69118]: pgmap v1712: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:08.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:07 smithi046 ceph-mon[88928]: pgmap v1712: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:09.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:09 smithi142 ceph-mon[69118]: pgmap v1713: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:10.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:09 smithi046 ceph-mon[88928]: pgmap v1713: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:11.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:11 smithi142 ceph-mon[69118]: pgmap v1714: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:12.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:11 smithi046 ceph-mon[88928]: pgmap v1714: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:12.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:00:13.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:00:13.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:13 smithi142 ceph-mon[69118]: pgmap v1715: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:13.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:13.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:00:13.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:00:13.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:00:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:13 smithi046 ceph-mon[88928]: pgmap v1715: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:00:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:00:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:00:15.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:15 smithi046 ceph-mon[88928]: pgmap v1716: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:15.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:15 smithi142 ceph-mon[69118]: pgmap v1716: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:17.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:17 smithi142 ceph-mon[69118]: pgmap v1717: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:18.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:17 smithi046 ceph-mon[88928]: pgmap v1717: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:19.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:19 smithi142 ceph-mon[69118]: pgmap v1718: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:20.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:19 smithi046 ceph-mon[88928]: pgmap v1718: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:21.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:21 smithi142 ceph-mon[69118]: pgmap v1719: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:21 smithi046 ceph-mon[88928]: pgmap v1719: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:23.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:23 smithi142 ceph-mon[69118]: pgmap v1720: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:24.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:23 smithi046 ceph-mon[88928]: pgmap v1720: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:25.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:25 smithi142 ceph-mon[69118]: pgmap v1721: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:26.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:25 smithi046 ceph-mon[88928]: pgmap v1721: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:27.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:27 smithi142 ceph-mon[69118]: pgmap v1722: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:28.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:27 smithi046 ceph-mon[88928]: pgmap v1722: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:28.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:29.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:29 smithi142 ceph-mon[69118]: pgmap v1723: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:30.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:29 smithi046 ceph-mon[88928]: pgmap v1723: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:32.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:31 smithi046 ceph-mon[88928]: pgmap v1724: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:32.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:31 smithi142 ceph-mon[69118]: pgmap v1724: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:34.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:33 smithi046 ceph-mon[88928]: pgmap v1725: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:34.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:33 smithi142 ceph-mon[69118]: pgmap v1725: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:35.984 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:35 smithi142 ceph-mon[69118]: pgmap v1726: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:36.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:35 smithi046 ceph-mon[88928]: pgmap v1726: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:38.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:37 smithi046 ceph-mon[88928]: pgmap v1727: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:38.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:37 smithi142 ceph-mon[69118]: pgmap v1727: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:40.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:39 smithi046 ceph-mon[88928]: pgmap v1728: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:40.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:39 smithi142 ceph-mon[69118]: pgmap v1728: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:42.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:41 smithi046 ceph-mon[88928]: pgmap v1729: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:42.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:41 smithi142 ceph-mon[69118]: pgmap v1729: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:43 smithi046 ceph-mon[88928]: pgmap v1730: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:43 smithi142 ceph-mon[69118]: pgmap v1730: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:46.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:45 smithi046 ceph-mon[88928]: pgmap v1731: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:46.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:45 smithi142 ceph-mon[69118]: pgmap v1731: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:48.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:47 smithi046 ceph-mon[88928]: pgmap v1732: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:48.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:47 smithi142 ceph-mon[69118]: pgmap v1732: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:50.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:49 smithi046 ceph-mon[88928]: pgmap v1733: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:50.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:49 smithi142 ceph-mon[69118]: pgmap v1733: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:52.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:51 smithi046 ceph-mon[88928]: pgmap v1734: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:52.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:51 smithi142 ceph-mon[69118]: pgmap v1734: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:54.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:53 smithi046 ceph-mon[88928]: pgmap v1735: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:54.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:53 smithi142 ceph-mon[69118]: pgmap v1735: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:55.970 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:55 smithi046 ceph-mon[88928]: pgmap v1736: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:56.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:55 smithi142 ceph-mon[69118]: pgmap v1736: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:58.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:57 smithi046 ceph-mon[88928]: pgmap v1737: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:58.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:57 smithi142 ceph-mon[69118]: pgmap v1737: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:00:59.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:59.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:00.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:00:59 smithi046 ceph-mon[88928]: pgmap v1738: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:00.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:00:59 smithi142 ceph-mon[69118]: pgmap v1738: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:01.988 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:01 smithi142 ceph-mon[69118]: pgmap v1739: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:02.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:01 smithi046 ceph-mon[88928]: pgmap v1739: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:04.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:03 smithi046 ceph-mon[88928]: pgmap v1740: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:04.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:03 smithi142 ceph-mon[69118]: pgmap v1740: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:06.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:05 smithi046 ceph-mon[88928]: pgmap v1741: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:06.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:05 smithi142 ceph-mon[69118]: pgmap v1741: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:08.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:07 smithi046 ceph-mon[88928]: pgmap v1742: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:08.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:07 smithi142 ceph-mon[69118]: pgmap v1742: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:09 smithi046 ceph-mon[88928]: pgmap v1743: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:10.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:09 smithi142 ceph-mon[69118]: pgmap v1743: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:12.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:11 smithi046 ceph-mon[88928]: pgmap v1744: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:12.139 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:11 smithi142 ceph-mon[69118]: pgmap v1744: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:13 smithi046 ceph-mon[88928]: pgmap v1745: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:01:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:01:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:01:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:01:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:13 smithi142 ceph-mon[69118]: pgmap v1745: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:01:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:01:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:01:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:01:16.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:15 smithi046 ceph-mon[88928]: pgmap v1746: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:16.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:15 smithi142 ceph-mon[69118]: pgmap v1746: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:18.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:17 smithi046 ceph-mon[88928]: pgmap v1747: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:17 smithi142 ceph-mon[69118]: pgmap v1747: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:20.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:19 smithi046 ceph-mon[88928]: pgmap v1748: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:20.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:19 smithi142 ceph-mon[69118]: pgmap v1748: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:21 smithi046 ceph-mon[88928]: pgmap v1749: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:21 smithi142 ceph-mon[69118]: pgmap v1749: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:24.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:23 smithi046 ceph-mon[88928]: pgmap v1750: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:24.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:23 smithi142 ceph-mon[69118]: pgmap v1750: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:26.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:25 smithi046 ceph-mon[88928]: pgmap v1751: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:26.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:25 smithi142 ceph-mon[69118]: pgmap v1751: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:28.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:27 smithi046 ceph-mon[88928]: pgmap v1752: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:27 smithi142 ceph-mon[69118]: pgmap v1752: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:29.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:29.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:30.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:29 smithi046 ceph-mon[88928]: pgmap v1753: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:30.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:29 smithi142 ceph-mon[69118]: pgmap v1753: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:32.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:31 smithi046 ceph-mon[88928]: pgmap v1754: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:32.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:31 smithi142 ceph-mon[69118]: pgmap v1754: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:34.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:33 smithi046 ceph-mon[88928]: pgmap v1755: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:34.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:33 smithi142 ceph-mon[69118]: pgmap v1755: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:36.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:35 smithi046 ceph-mon[88928]: pgmap v1756: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:36.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:35 smithi142 ceph-mon[69118]: pgmap v1756: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:38.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:37 smithi046 ceph-mon[88928]: pgmap v1757: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:38.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:37 smithi142 ceph-mon[69118]: pgmap v1757: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:40.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:39 smithi046 ceph-mon[88928]: pgmap v1758: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:40.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:39 smithi142 ceph-mon[69118]: pgmap v1758: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:42.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:41 smithi046 ceph-mon[88928]: pgmap v1759: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:42.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:41 smithi142 ceph-mon[69118]: pgmap v1759: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:43 smithi046 ceph-mon[88928]: pgmap v1760: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:43 smithi142 ceph-mon[69118]: pgmap v1760: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:46.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:45 smithi046 ceph-mon[88928]: pgmap v1761: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:46.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:45 smithi142 ceph-mon[69118]: pgmap v1761: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:48.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:47 smithi046 ceph-mon[88928]: pgmap v1762: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:48.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:47 smithi142 ceph-mon[69118]: pgmap v1762: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:50.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:49 smithi046 ceph-mon[88928]: pgmap v1763: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:50.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:49 smithi142 ceph-mon[69118]: pgmap v1763: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:52.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:51 smithi046 ceph-mon[88928]: pgmap v1764: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:52.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:51 smithi142 ceph-mon[69118]: pgmap v1764: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:54.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:53 smithi142 ceph-mon[69118]: pgmap v1765: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:54.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:53 smithi046 ceph-mon[88928]: pgmap v1765: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:56.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:55 smithi142 ceph-mon[69118]: pgmap v1766: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:56.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:55 smithi046 ceph-mon[88928]: pgmap v1766: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:57.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:57 smithi142 ceph-mon[69118]: pgmap v1767: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:57.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:57 smithi046 ceph-mon[88928]: pgmap v1767: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:01:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:00.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:01:59 smithi142 ceph-mon[69118]: pgmap v1768: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:00.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:01:59 smithi046 ceph-mon[88928]: pgmap v1768: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:02.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:01 smithi046 ceph-mon[88928]: pgmap v1769: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:02.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:01 smithi142 ceph-mon[69118]: pgmap v1769: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:04.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:03 smithi142 ceph-mon[69118]: pgmap v1770: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:04.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:03 smithi046 ceph-mon[88928]: pgmap v1770: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:06.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:05 smithi142 ceph-mon[69118]: pgmap v1771: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:05 smithi046 ceph-mon[88928]: pgmap v1771: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:08.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:07 smithi142 ceph-mon[69118]: pgmap v1772: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:08.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:07 smithi046 ceph-mon[88928]: pgmap v1772: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:10.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:09 smithi142 ceph-mon[69118]: pgmap v1773: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:10.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:09 smithi046 ceph-mon[88928]: pgmap v1773: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:12.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:11 smithi046 ceph-mon[88928]: pgmap v1774: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:11 smithi142 ceph-mon[69118]: pgmap v1774: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:13.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:13.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:13 smithi142 ceph-mon[69118]: pgmap v1775: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:02:14.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:13 smithi046 ceph-mon[88928]: pgmap v1775: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:14.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:02:15.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:02:15.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:02:15.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:02:15.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:02:15.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:02:15.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:02:16.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:15 smithi142 ceph-mon[69118]: pgmap v1776: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:16.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:15 smithi046 ceph-mon[88928]: pgmap v1776: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:17 smithi142 ceph-mon[69118]: pgmap v1777: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:18.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:17 smithi046 ceph-mon[88928]: pgmap v1777: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:20.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:19 smithi142 ceph-mon[69118]: pgmap v1778: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:19 smithi046 ceph-mon[88928]: pgmap v1778: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:22.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:21 smithi046 ceph-mon[88928]: pgmap v1779: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:21 smithi142 ceph-mon[69118]: pgmap v1779: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:24.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:23 smithi142 ceph-mon[69118]: pgmap v1780: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:24.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:23 smithi046 ceph-mon[88928]: pgmap v1780: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:26.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:25 smithi142 ceph-mon[69118]: pgmap v1781: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:25 smithi046 ceph-mon[88928]: pgmap v1781: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:27 smithi142 ceph-mon[69118]: pgmap v1782: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:27 smithi046 ceph-mon[88928]: pgmap v1782: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:30.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:29 smithi142 ceph-mon[69118]: pgmap v1783: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:30.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:29 smithi046 ceph-mon[88928]: pgmap v1783: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:32.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:31 smithi142 ceph-mon[69118]: pgmap v1784: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:32.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:31 smithi046 ceph-mon[88928]: pgmap v1784: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:34.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:33 smithi142 ceph-mon[69118]: pgmap v1785: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:34.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:33 smithi046 ceph-mon[88928]: pgmap v1785: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:36.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:35 smithi142 ceph-mon[69118]: pgmap v1786: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:36.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:35 smithi046 ceph-mon[88928]: pgmap v1786: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:38.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:37 smithi142 ceph-mon[69118]: pgmap v1787: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:38.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:37 smithi046 ceph-mon[88928]: pgmap v1787: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:40.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:39 smithi142 ceph-mon[69118]: pgmap v1788: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:40.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:39 smithi046 ceph-mon[88928]: pgmap v1788: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:42.154 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:41 smithi046 ceph-mon[88928]: pgmap v1789: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:41 smithi142 ceph-mon[69118]: pgmap v1789: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:43.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:43.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:43 smithi142 ceph-mon[69118]: pgmap v1790: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:44.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:43 smithi046 ceph-mon[88928]: pgmap v1790: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:46.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:45 smithi142 ceph-mon[69118]: pgmap v1791: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:46.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:45 smithi046 ceph-mon[88928]: pgmap v1791: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:48.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:47 smithi142 ceph-mon[69118]: pgmap v1792: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:48.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:47 smithi046 ceph-mon[88928]: pgmap v1792: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:50.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:49 smithi142 ceph-mon[69118]: pgmap v1793: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:50.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:49 smithi046 ceph-mon[88928]: pgmap v1793: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:52.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:51 smithi142 ceph-mon[69118]: pgmap v1794: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:52.266 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:51 smithi046 ceph-mon[88928]: pgmap v1794: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:54.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:53 smithi142 ceph-mon[69118]: pgmap v1795: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:54.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:53 smithi046 ceph-mon[88928]: pgmap v1795: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:56.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:55 smithi142 ceph-mon[69118]: pgmap v1796: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:56.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:55 smithi046 ceph-mon[88928]: pgmap v1796: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:58.176 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:57 smithi142 ceph-mon[69118]: pgmap v1797: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:58.176 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:57 smithi046 ceph-mon[88928]: pgmap v1797: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:02:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:00.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:02:59 smithi142 ceph-mon[69118]: pgmap v1798: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:00.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:02:59 smithi046 ceph-mon[88928]: pgmap v1798: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:02.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:01 smithi142 ceph-mon[69118]: pgmap v1799: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:02.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:01 smithi046 ceph-mon[88928]: pgmap v1799: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:04.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:03 smithi142 ceph-mon[69118]: pgmap v1800: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:04.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:03 smithi046 ceph-mon[88928]: pgmap v1800: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:06.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:05 smithi142 ceph-mon[69118]: pgmap v1801: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:06.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:05 smithi046 ceph-mon[88928]: pgmap v1801: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:08.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:07 smithi142 ceph-mon[69118]: pgmap v1802: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:08.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:07 smithi046 ceph-mon[88928]: pgmap v1802: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:10.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:09 smithi142 ceph-mon[69118]: pgmap v1803: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:10.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:09 smithi046 ceph-mon[88928]: pgmap v1803: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:12.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:11 smithi046 ceph-mon[88928]: pgmap v1804: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:12.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:11 smithi142 ceph-mon[69118]: pgmap v1804: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:13.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:13.325 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:14.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:13 smithi046 ceph-mon[88928]: pgmap v1805: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:14.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:13 smithi142 ceph-mon[69118]: pgmap v1805: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:15.208 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:14 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:03:15.222 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:14 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:03:16.231 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:15 smithi142 ceph-mon[69118]: pgmap v1806: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:16.272 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:15 smithi046 ceph-mon[88928]: pgmap v1806: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:17.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:17 smithi046 ceph-mon[88928]: pgmap v1807: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:17.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:03:17.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:17 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:03:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:17 smithi142 ceph-mon[69118]: pgmap v1807: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:03:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:17 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:03:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:20 smithi046 ceph-mon[88928]: pgmap v1808: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:03:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:03:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:03:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:03:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:03:20.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:20 smithi142 ceph-mon[69118]: pgmap v1808: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:20.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:03:20.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:03:20.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:03:20.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:03:20.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:03:22.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:22 smithi046 ceph-mon[88928]: pgmap v1809: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:22.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:22 smithi142 ceph-mon[69118]: pgmap v1809: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:24.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:24 smithi046 ceph-mon[88928]: pgmap v1810: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:24.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:24 smithi142 ceph-mon[69118]: pgmap v1810: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:26.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:26 smithi142 ceph-mon[69118]: pgmap v1811: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:26.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:26 smithi046 ceph-mon[88928]: pgmap v1811: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:28.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:28 smithi142 ceph-mon[69118]: pgmap v1812: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:28.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:28.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:28 smithi046 ceph-mon[88928]: pgmap v1812: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:28.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:30.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:30 smithi142 ceph-mon[69118]: pgmap v1813: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:30.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:30 smithi046 ceph-mon[88928]: pgmap v1813: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:32.363 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:32 smithi046 ceph-mon[88928]: pgmap v1814: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:32.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:32 smithi142 ceph-mon[69118]: pgmap v1814: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:34.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:34 smithi142 ceph-mon[69118]: pgmap v1815: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:34.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:34 smithi046 ceph-mon[88928]: pgmap v1815: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:36.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:36 smithi142 ceph-mon[69118]: pgmap v1816: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:36.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:36 smithi046 ceph-mon[88928]: pgmap v1816: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:38.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:38 smithi142 ceph-mon[69118]: pgmap v1817: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:38.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:38 smithi046 ceph-mon[88928]: pgmap v1817: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:40.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:40 smithi142 ceph-mon[69118]: pgmap v1818: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:40.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:40 smithi046 ceph-mon[88928]: pgmap v1818: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:42.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:42 smithi142 ceph-mon[69118]: pgmap v1819: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:42.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:42 smithi046 ceph-mon[88928]: pgmap v1819: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:43.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:43.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:44.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:44 smithi142 ceph-mon[69118]: pgmap v1820: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:44.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:44 smithi046 ceph-mon[88928]: pgmap v1820: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:45.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:45 smithi142 ceph-mon[69118]: pgmap v1821: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:45.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:45 smithi046 ceph-mon[88928]: pgmap v1821: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:47.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:47 smithi046 ceph-mon[88928]: pgmap v1822: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:47.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:47 smithi142 ceph-mon[69118]: pgmap v1822: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:49.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:49 smithi142 ceph-mon[69118]: pgmap v1823: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:50.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:49 smithi046 ceph-mon[88928]: pgmap v1823: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:51.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:51 smithi142 ceph-mon[69118]: pgmap v1824: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:52.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:51 smithi046 ceph-mon[88928]: pgmap v1824: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:53.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:53 smithi142 ceph-mon[69118]: pgmap v1825: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:54.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:53 smithi046 ceph-mon[88928]: pgmap v1825: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:55.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:55 smithi142 ceph-mon[69118]: pgmap v1826: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:55 smithi046 ceph-mon[88928]: pgmap v1826: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:57.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:57 smithi142 ceph-mon[69118]: pgmap v1827: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:57.995 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:57 smithi046 ceph-mon[88928]: pgmap v1827: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:03:58.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:59.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:59.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:03:59 smithi142 ceph-mon[69118]: pgmap v1828: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:00.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:03:59 smithi046 ceph-mon[88928]: pgmap v1828: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:01.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:01 smithi046 ceph-mon[88928]: pgmap v1829: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:01.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:01 smithi142 ceph-mon[69118]: pgmap v1829: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:03.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:03 smithi142 ceph-mon[69118]: pgmap v1830: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:04.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:03 smithi046 ceph-mon[88928]: pgmap v1830: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:05.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:05 smithi142 ceph-mon[69118]: pgmap v1831: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:06.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:05 smithi046 ceph-mon[88928]: pgmap v1831: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:07.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:07 smithi142 ceph-mon[69118]: pgmap v1832: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:08.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:07 smithi046 ceph-mon[88928]: pgmap v1832: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:09 smithi046 ceph-mon[88928]: pgmap v1833: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:09 smithi142 ceph-mon[69118]: pgmap v1833: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:12.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:11 smithi046 ceph-mon[88928]: pgmap v1834: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:11 smithi142 ceph-mon[69118]: pgmap v1834: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:13 smithi046 ceph-mon[88928]: pgmap v1835: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:13 smithi142 ceph-mon[69118]: pgmap v1835: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:16.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:15 smithi046 ceph-mon[88928]: pgmap v1836: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:16.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:15 smithi142 ceph-mon[69118]: pgmap v1836: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:18.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:17 smithi046 ceph-mon[88928]: pgmap v1837: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:17 smithi142 ceph-mon[69118]: pgmap v1837: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:20.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:19 smithi046 ceph-mon[88928]: pgmap v1838: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:20.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:19 smithi142 ceph-mon[69118]: pgmap v1838: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:21.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:04:21.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:04:21.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:20 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:04:21.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:04:21.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:04:21.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:20 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:04:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:21 smithi046 ceph-mon[88928]: pgmap v1839: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:21 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:04:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:21 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:04:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:21 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:04:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:21 smithi142 ceph-mon[69118]: pgmap v1839: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:21 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:04:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:21 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:04:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:21 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:04:24.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:23 smithi142 ceph-mon[69118]: pgmap v1840: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:24.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:23 smithi046 ceph-mon[88928]: pgmap v1840: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:26.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:25 smithi046 ceph-mon[88928]: pgmap v1841: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:26.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:25 smithi142 ceph-mon[69118]: pgmap v1841: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:28.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:27 smithi046 ceph-mon[88928]: pgmap v1842: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:27 smithi142 ceph-mon[69118]: pgmap v1842: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:29.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:29.070 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:30.064 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:29 smithi046 ceph-mon[88928]: pgmap v1843: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:30.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:29 smithi142 ceph-mon[69118]: pgmap v1843: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:32.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:31 smithi046 ceph-mon[88928]: pgmap v1844: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:32.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:31 smithi142 ceph-mon[69118]: pgmap v1844: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:34.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:33 smithi046 ceph-mon[88928]: pgmap v1845: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:34.119 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:33 smithi142 ceph-mon[69118]: pgmap v1845: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:36.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:35 smithi046 ceph-mon[88928]: pgmap v1846: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:36.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:35 smithi142 ceph-mon[69118]: pgmap v1846: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:37.984 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:37 smithi142 ceph-mon[69118]: pgmap v1847: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:38.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:37 smithi046 ceph-mon[88928]: pgmap v1847: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:40.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:39 smithi046 ceph-mon[88928]: pgmap v1848: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:40.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:39 smithi142 ceph-mon[69118]: pgmap v1848: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:42.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:41 smithi046 ceph-mon[88928]: pgmap v1849: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:41 smithi142 ceph-mon[69118]: pgmap v1849: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:43 smithi046 ceph-mon[88928]: pgmap v1850: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:43 smithi142 ceph-mon[69118]: pgmap v1850: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:46.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:45 smithi046 ceph-mon[88928]: pgmap v1851: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:46.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:45 smithi142 ceph-mon[69118]: pgmap v1851: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:48.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:47 smithi046 ceph-mon[88928]: pgmap v1852: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:48.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:47 smithi142 ceph-mon[69118]: pgmap v1852: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:50.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:49 smithi046 ceph-mon[88928]: pgmap v1853: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:50.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:49 smithi142 ceph-mon[69118]: pgmap v1853: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:52.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:51 smithi046 ceph-mon[88928]: pgmap v1854: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:52.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:51 smithi142 ceph-mon[69118]: pgmap v1854: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:54.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:53 smithi046 ceph-mon[88928]: pgmap v1855: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:54.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:53 smithi142 ceph-mon[69118]: pgmap v1855: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:56.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:55 smithi046 ceph-mon[88928]: pgmap v1856: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:55 smithi142 ceph-mon[69118]: pgmap v1856: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:58.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:57 smithi046 ceph-mon[88928]: pgmap v1857: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:57 smithi142 ceph-mon[69118]: pgmap v1857: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:04:59.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:59.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:00.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:04:59 smithi046 ceph-mon[88928]: pgmap v1858: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:00.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:04:59 smithi142 ceph-mon[69118]: pgmap v1858: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:02.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:01 smithi046 ceph-mon[88928]: pgmap v1859: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:02.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:01 smithi142 ceph-mon[69118]: pgmap v1859: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:03 smithi046 ceph-mon[88928]: pgmap v1860: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:04.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:03 smithi142 ceph-mon[69118]: pgmap v1860: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:06.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:05 smithi046 ceph-mon[88928]: pgmap v1861: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:06.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:05 smithi142 ceph-mon[69118]: pgmap v1861: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:08.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:07 smithi046 ceph-mon[88928]: pgmap v1862: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:08.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:07 smithi142 ceph-mon[69118]: pgmap v1862: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:10.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:09 smithi046 ceph-mon[88928]: pgmap v1863: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:09 smithi142 ceph-mon[69118]: pgmap v1863: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:12.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:11 smithi046 ceph-mon[88928]: pgmap v1864: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:11 smithi142 ceph-mon[69118]: pgmap v1864: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:13 smithi046 ceph-mon[88928]: pgmap v1865: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:13 smithi142 ceph-mon[69118]: pgmap v1865: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:16.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:15 smithi046 ceph-mon[88928]: pgmap v1866: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:16.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:15 smithi142 ceph-mon[69118]: pgmap v1866: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:18.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:17 smithi046 ceph-mon[88928]: pgmap v1867: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:17 smithi142 ceph-mon[69118]: pgmap v1867: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:19.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:19 smithi142 ceph-mon[69118]: pgmap v1868: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:20.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:19 smithi046 ceph-mon[88928]: pgmap v1868: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:21 smithi046 ceph-mon[88928]: pgmap v1869: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:21 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:05:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:21 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:05:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:21 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:05:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:21 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:05:22.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:21 smithi142 ceph-mon[69118]: pgmap v1869: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:21 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:05:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:21 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:05:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:21 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:05:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:21 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:05:24.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:23 smithi046 ceph-mon[88928]: pgmap v1870: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:24.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:23 smithi142 ceph-mon[69118]: pgmap v1870: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:26.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:25 smithi046 ceph-mon[88928]: pgmap v1871: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:26.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:25 smithi142 ceph-mon[69118]: pgmap v1871: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:28.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:27 smithi046 ceph-mon[88928]: pgmap v1872: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:28.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:27 smithi142 ceph-mon[69118]: pgmap v1872: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:29 smithi142 ceph-mon[69118]: pgmap v1873: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:30.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:29 smithi046 ceph-mon[88928]: pgmap v1873: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:32.114 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:31 smithi046 ceph-mon[88928]: pgmap v1874: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:32.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:31 smithi142 ceph-mon[69118]: pgmap v1874: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:34.070 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:33 smithi046 ceph-mon[88928]: pgmap v1875: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:34.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:33 smithi142 ceph-mon[69118]: pgmap v1875: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:36.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:35 smithi142 ceph-mon[69118]: pgmap v1876: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:36.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:35 smithi046 ceph-mon[88928]: pgmap v1876: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:38.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:37 smithi142 ceph-mon[69118]: pgmap v1877: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:38.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:37 smithi046 ceph-mon[88928]: pgmap v1877: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:40.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:39 smithi142 ceph-mon[69118]: pgmap v1878: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:40.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:39 smithi046 ceph-mon[88928]: pgmap v1878: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:42.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:41 smithi046 ceph-mon[88928]: pgmap v1879: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:41 smithi142 ceph-mon[69118]: pgmap v1879: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:43.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:43.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:43 smithi142 ceph-mon[69118]: pgmap v1880: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:44.182 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:43 smithi046 ceph-mon[88928]: pgmap v1880: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:46.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:45 smithi142 ceph-mon[69118]: pgmap v1881: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:46.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:45 smithi046 ceph-mon[88928]: pgmap v1881: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:48.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:47 smithi142 ceph-mon[69118]: pgmap v1882: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:48.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:47 smithi046 ceph-mon[88928]: pgmap v1882: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:50.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:49 smithi142 ceph-mon[69118]: pgmap v1883: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:50.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:49 smithi046 ceph-mon[88928]: pgmap v1883: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:52.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:51 smithi046 ceph-mon[88928]: pgmap v1884: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:52.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:51 smithi142 ceph-mon[69118]: pgmap v1884: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:53 smithi142 ceph-mon[69118]: pgmap v1885: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:54.295 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:53 smithi046 ceph-mon[88928]: pgmap v1885: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:56.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:55 smithi142 ceph-mon[69118]: pgmap v1886: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:56.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:55 smithi046 ceph-mon[88928]: pgmap v1886: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:58.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:57 smithi142 ceph-mon[69118]: pgmap v1887: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:58.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:57 smithi046 ceph-mon[88928]: pgmap v1887: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:05:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:00.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:05:59 smithi142 ceph-mon[69118]: pgmap v1888: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:00.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:05:59 smithi046 ceph-mon[88928]: pgmap v1888: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:02.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:01 smithi046 ceph-mon[88928]: pgmap v1889: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:02.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:01 smithi142 ceph-mon[69118]: pgmap v1889: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:04.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:03 smithi142 ceph-mon[69118]: pgmap v1890: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:04.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:03 smithi046 ceph-mon[88928]: pgmap v1890: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:05 smithi142 ceph-mon[69118]: pgmap v1891: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:05 smithi046 ceph-mon[88928]: pgmap v1891: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:08.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:07 smithi142 ceph-mon[69118]: pgmap v1892: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:08.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:07 smithi046 ceph-mon[88928]: pgmap v1892: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:10.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:09 smithi142 ceph-mon[69118]: pgmap v1893: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:10.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:09 smithi046 ceph-mon[88928]: pgmap v1893: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:12.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:11 smithi142 ceph-mon[69118]: pgmap v1894: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:12.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:11 smithi046 ceph-mon[88928]: pgmap v1894: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:13.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:13.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:14.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:13 smithi142 ceph-mon[69118]: pgmap v1895: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:14.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:13 smithi046 ceph-mon[88928]: pgmap v1895: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:16.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:15 smithi142 ceph-mon[69118]: pgmap v1896: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:16.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:15 smithi046 ceph-mon[88928]: pgmap v1896: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:17 smithi142 ceph-mon[69118]: pgmap v1897: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:18.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:17 smithi046 ceph-mon[88928]: pgmap v1897: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:20.165 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:19 smithi142 ceph-mon[69118]: pgmap v1898: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:19 smithi046 ceph-mon[88928]: pgmap v1898: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:22.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:21 smithi142 ceph-mon[69118]: pgmap v1899: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:22.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:21 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:06:22.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:21 smithi046 ceph-mon[88928]: pgmap v1899: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:22.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:21 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:06:23.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:06:23.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:06:23.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:23 smithi046 ceph-mon[88928]: pgmap v1900: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:23.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:06:23.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:06:23.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:06:23.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:06:23.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:06:23.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:23 smithi142 ceph-mon[69118]: pgmap v1900: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:23.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:06:23.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:06:23.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:06:25.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:25 smithi142 ceph-mon[69118]: pgmap v1901: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:26.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:25 smithi046 ceph-mon[88928]: pgmap v1901: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:27.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:27 smithi142 ceph-mon[69118]: pgmap v1902: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:28.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:27 smithi046 ceph-mon[88928]: pgmap v1902: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:28.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:29.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:29.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:29 smithi142 ceph-mon[69118]: pgmap v1903: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:30.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:29 smithi046 ceph-mon[88928]: pgmap v1903: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:31.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:31 smithi142 ceph-mon[69118]: pgmap v1904: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:32.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:31 smithi046 ceph-mon[88928]: pgmap v1904: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:33.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:33 smithi142 ceph-mon[69118]: pgmap v1905: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:34.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:33 smithi046 ceph-mon[88928]: pgmap v1905: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:35.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:35 smithi142 ceph-mon[69118]: pgmap v1906: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:36.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:35 smithi046 ceph-mon[88928]: pgmap v1906: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:37.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:37 smithi142 ceph-mon[69118]: pgmap v1907: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:38.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:37 smithi046 ceph-mon[88928]: pgmap v1907: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:39.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:39 smithi142 ceph-mon[69118]: pgmap v1908: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:40.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:39 smithi046 ceph-mon[88928]: pgmap v1908: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:41.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:41 smithi142 ceph-mon[69118]: pgmap v1909: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:42.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:41 smithi046 ceph-mon[88928]: pgmap v1909: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:43.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:43 smithi142 ceph-mon[69118]: pgmap v1910: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:43.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:43 smithi046 ceph-mon[88928]: pgmap v1910: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:46.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:45 smithi046 ceph-mon[88928]: pgmap v1911: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:46.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:45 smithi142 ceph-mon[69118]: pgmap v1911: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:48.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:47 smithi046 ceph-mon[88928]: pgmap v1912: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:48.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:47 smithi142 ceph-mon[69118]: pgmap v1912: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:50.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:49 smithi046 ceph-mon[88928]: pgmap v1913: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:50.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:49 smithi142 ceph-mon[69118]: pgmap v1913: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:52.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:51 smithi046 ceph-mon[88928]: pgmap v1914: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:52.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:51 smithi142 ceph-mon[69118]: pgmap v1914: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:54.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:53 smithi046 ceph-mon[88928]: pgmap v1915: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:53 smithi142 ceph-mon[69118]: pgmap v1915: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:55.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:55 smithi142 ceph-mon[69118]: pgmap v1916: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:56.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:55 smithi046 ceph-mon[88928]: pgmap v1916: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:58.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:57 smithi046 ceph-mon[88928]: pgmap v1917: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:57 smithi142 ceph-mon[69118]: pgmap v1917: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:06:59.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:59.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:00.031 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:06:59 smithi046 ceph-mon[88928]: pgmap v1918: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:00.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:06:59 smithi142 ceph-mon[69118]: pgmap v1918: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:02.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:01 smithi046 ceph-mon[88928]: pgmap v1919: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:02.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:01 smithi142 ceph-mon[69118]: pgmap v1919: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:04.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:03 smithi046 ceph-mon[88928]: pgmap v1920: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:04.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:03 smithi142 ceph-mon[69118]: pgmap v1920: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:05.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:05 smithi142 ceph-mon[69118]: pgmap v1921: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:06.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:05 smithi046 ceph-mon[88928]: pgmap v1921: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:08.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:07 smithi046 ceph-mon[88928]: pgmap v1922: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:08.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:07 smithi142 ceph-mon[69118]: pgmap v1922: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:10.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:09 smithi046 ceph-mon[88928]: pgmap v1923: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:09 smithi142 ceph-mon[69118]: pgmap v1923: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:12.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:11 smithi046 ceph-mon[88928]: pgmap v1924: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:11 smithi142 ceph-mon[69118]: pgmap v1924: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:13 smithi046 ceph-mon[88928]: pgmap v1925: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:13 smithi142 ceph-mon[69118]: pgmap v1925: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:16.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:15 smithi046 ceph-mon[88928]: pgmap v1926: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:16.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:15 smithi142 ceph-mon[69118]: pgmap v1926: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:18.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:17 smithi046 ceph-mon[88928]: pgmap v1927: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:18.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:17 smithi142 ceph-mon[69118]: pgmap v1927: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:20.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:19 smithi046 ceph-mon[88928]: pgmap v1928: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:20.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:19 smithi142 ceph-mon[69118]: pgmap v1928: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:21 smithi046 ceph-mon[88928]: pgmap v1929: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:22.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:21 smithi142 ceph-mon[69118]: pgmap v1929: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:24.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:23 smithi046 ceph-mon[88928]: pgmap v1930: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:24.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:07:24.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:07:24.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:07:24.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:07:24.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:23 smithi142 ceph-mon[69118]: pgmap v1930: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:24.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:07:24.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:07:24.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:07:24.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:07:26.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:25 smithi046 ceph-mon[88928]: pgmap v1931: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:26.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:25 smithi142 ceph-mon[69118]: pgmap v1931: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:28.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:27 smithi046 ceph-mon[88928]: pgmap v1932: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:27 smithi142 ceph-mon[69118]: pgmap v1932: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:29.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:29.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:30.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:29 smithi046 ceph-mon[88928]: pgmap v1933: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:30.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:29 smithi142 ceph-mon[69118]: pgmap v1933: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:32.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:31 smithi046 ceph-mon[88928]: pgmap v1934: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:32.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:31 smithi142 ceph-mon[69118]: pgmap v1934: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:34.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:33 smithi046 ceph-mon[88928]: pgmap v1935: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:34.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:33 smithi142 ceph-mon[69118]: pgmap v1935: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:36.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:35 smithi046 ceph-mon[88928]: pgmap v1936: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:36.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:35 smithi142 ceph-mon[69118]: pgmap v1936: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:38.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:37 smithi046 ceph-mon[88928]: pgmap v1937: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:38.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:37 smithi142 ceph-mon[69118]: pgmap v1937: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:40.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:39 smithi046 ceph-mon[88928]: pgmap v1938: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:40.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:39 smithi142 ceph-mon[69118]: pgmap v1938: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:42.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:41 smithi046 ceph-mon[88928]: pgmap v1939: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:42.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:41 smithi142 ceph-mon[69118]: pgmap v1939: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:43 smithi046 ceph-mon[88928]: pgmap v1940: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:44.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:43 smithi142 ceph-mon[69118]: pgmap v1940: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:45.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:45 smithi046 ceph-mon[88928]: pgmap v1941: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:46.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:45 smithi142 ceph-mon[69118]: pgmap v1941: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:48.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:47 smithi046 ceph-mon[88928]: pgmap v1942: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:48.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:47 smithi142 ceph-mon[69118]: pgmap v1942: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:50.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:49 smithi046 ceph-mon[88928]: pgmap v1943: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:50.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:49 smithi142 ceph-mon[69118]: pgmap v1943: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:52.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:51 smithi046 ceph-mon[88928]: pgmap v1944: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:52.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:51 smithi142 ceph-mon[69118]: pgmap v1944: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:54.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:53 smithi046 ceph-mon[88928]: pgmap v1945: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:54.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:53 smithi142 ceph-mon[69118]: pgmap v1945: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:55 smithi046 ceph-mon[88928]: pgmap v1946: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:56.106 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:55 smithi142 ceph-mon[69118]: pgmap v1946: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:58.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:57 smithi046 ceph-mon[88928]: pgmap v1947: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:57 smithi142 ceph-mon[69118]: pgmap v1947: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:07:59.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:59.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:00.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:07:59 smithi046 ceph-mon[88928]: pgmap v1948: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:00.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:07:59 smithi142 ceph-mon[69118]: pgmap v1948: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:02.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:01 smithi046 ceph-mon[88928]: pgmap v1949: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:01 smithi142 ceph-mon[69118]: pgmap v1949: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:04.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:03 smithi142 ceph-mon[69118]: pgmap v1950: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:04.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:03 smithi046 ceph-mon[88928]: pgmap v1950: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:06.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:05 smithi046 ceph-mon[88928]: pgmap v1951: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:05 smithi142 ceph-mon[69118]: pgmap v1951: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:08.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:07 smithi142 ceph-mon[69118]: pgmap v1952: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:08.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:07 smithi046 ceph-mon[88928]: pgmap v1952: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:10.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:09 smithi142 ceph-mon[69118]: pgmap v1953: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:10.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:09 smithi046 ceph-mon[88928]: pgmap v1953: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:12.114 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:11 smithi046 ceph-mon[88928]: pgmap v1954: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:12.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:11 smithi142 ceph-mon[69118]: pgmap v1954: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:13.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:13.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:13 smithi142 ceph-mon[69118]: pgmap v1955: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:14.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:13 smithi046 ceph-mon[88928]: pgmap v1955: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:16.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:15 smithi142 ceph-mon[69118]: pgmap v1956: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:16.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:15 smithi046 ceph-mon[88928]: pgmap v1956: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:18.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:17 smithi142 ceph-mon[69118]: pgmap v1957: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:18.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:17 smithi046 ceph-mon[88928]: pgmap v1957: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:20.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:19 smithi142 ceph-mon[69118]: pgmap v1958: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:19 smithi046 ceph-mon[88928]: pgmap v1958: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:22.114 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:21 smithi046 ceph-mon[88928]: pgmap v1959: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:22.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:21 smithi142 ceph-mon[69118]: pgmap v1959: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:24.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:23 smithi142 ceph-mon[69118]: pgmap v1960: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:24.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:23 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:08:24.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:23 smithi046 ceph-mon[88928]: pgmap v1960: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:24.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:23 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:08:25.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:24 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:08:25.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:24 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:08:25.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:24 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:08:25.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:24 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:08:25.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:24 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:08:25.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:24 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:08:26.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:25 smithi142 ceph-mon[69118]: pgmap v1961: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:26.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:25 smithi046 ceph-mon[88928]: pgmap v1961: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:27 smithi142 ceph-mon[69118]: pgmap v1962: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:27 smithi046 ceph-mon[88928]: pgmap v1962: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:30.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:29 smithi142 ceph-mon[69118]: pgmap v1963: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:30.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:29 smithi046 ceph-mon[88928]: pgmap v1963: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:32.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:31 smithi046 ceph-mon[88928]: pgmap v1964: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:32.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:31 smithi142 ceph-mon[69118]: pgmap v1964: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:34.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:33 smithi142 ceph-mon[69118]: pgmap v1965: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:34.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:33 smithi046 ceph-mon[88928]: pgmap v1965: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:36.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:35 smithi142 ceph-mon[69118]: pgmap v1966: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:36.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:35 smithi046 ceph-mon[88928]: pgmap v1966: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:38.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:37 smithi142 ceph-mon[69118]: pgmap v1967: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:38.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:37 smithi046 ceph-mon[88928]: pgmap v1967: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:40.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:39 smithi142 ceph-mon[69118]: pgmap v1968: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:40.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:39 smithi046 ceph-mon[88928]: pgmap v1968: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:41 smithi142 ceph-mon[69118]: pgmap v1969: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:42.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:41 smithi046 ceph-mon[88928]: pgmap v1969: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:43.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:43.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:43 smithi142 ceph-mon[69118]: pgmap v1970: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:44.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:43 smithi046 ceph-mon[88928]: pgmap v1970: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:46.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:45 smithi142 ceph-mon[69118]: pgmap v1971: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:46.213 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:45 smithi046 ceph-mon[88928]: pgmap v1971: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:48.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:47 smithi142 ceph-mon[69118]: pgmap v1972: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:48.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:47 smithi046 ceph-mon[88928]: pgmap v1972: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:50.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:49 smithi142 ceph-mon[69118]: pgmap v1973: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:50.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:49 smithi046 ceph-mon[88928]: pgmap v1973: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:51.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:51 smithi142 ceph-mon[69118]: pgmap v1974: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:52.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:51 smithi046 ceph-mon[88928]: pgmap v1974: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:53 smithi142 ceph-mon[69118]: pgmap v1975: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:54.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:53 smithi046 ceph-mon[88928]: pgmap v1975: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:56.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:55 smithi142 ceph-mon[69118]: pgmap v1976: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:56.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:55 smithi046 ceph-mon[88928]: pgmap v1976: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:58.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:57 smithi142 ceph-mon[69118]: pgmap v1977: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:58.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:57 smithi046 ceph-mon[88928]: pgmap v1977: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:08:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:00.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:08:59 smithi142 ceph-mon[69118]: pgmap v1978: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:00.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:08:59 smithi046 ceph-mon[88928]: pgmap v1978: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:01 smithi142 ceph-mon[69118]: pgmap v1979: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:02.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:01 smithi046 ceph-mon[88928]: pgmap v1979: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:04.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:03 smithi142 ceph-mon[69118]: pgmap v1980: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:04.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:03 smithi046 ceph-mon[88928]: pgmap v1980: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:05 smithi142 ceph-mon[69118]: pgmap v1981: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:05 smithi046 ceph-mon[88928]: pgmap v1981: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:08.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:07 smithi142 ceph-mon[69118]: pgmap v1982: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:08.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:07 smithi046 ceph-mon[88928]: pgmap v1982: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:09 smithi142 ceph-mon[69118]: pgmap v1983: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:10.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:09 smithi046 ceph-mon[88928]: pgmap v1983: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:11 smithi142 ceph-mon[69118]: pgmap v1984: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:12.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:11 smithi046 ceph-mon[88928]: pgmap v1984: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:13.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:13.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:13 smithi142 ceph-mon[69118]: pgmap v1985: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:14.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:13 smithi046 ceph-mon[88928]: pgmap v1985: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:16.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:15 smithi142 ceph-mon[69118]: pgmap v1986: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:16.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:15 smithi046 ceph-mon[88928]: pgmap v1986: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:18.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:17 smithi046 ceph-mon[88928]: pgmap v1987: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:18.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:17 smithi142 ceph-mon[69118]: pgmap v1987: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:20.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:19 smithi046 ceph-mon[88928]: pgmap v1988: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:20.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:19 smithi142 ceph-mon[69118]: pgmap v1988: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:22.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:21 smithi046 ceph-mon[88928]: pgmap v1989: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:22.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:21 smithi142 ceph-mon[69118]: pgmap v1989: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:24.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:23 smithi046 ceph-mon[88928]: pgmap v1990: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:24.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:23 smithi142 ceph-mon[69118]: pgmap v1990: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:25.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:24 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:09:25.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:24 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:09:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:25 smithi046 ceph-mon[88928]: pgmap v1991: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:09:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:09:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:25 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:09:26.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:25 smithi142 ceph-mon[69118]: pgmap v1991: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:26.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:09:26.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:09:26.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:25 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:09:28.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:27 smithi046 ceph-mon[88928]: pgmap v1992: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:28.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:27 smithi142 ceph-mon[69118]: pgmap v1992: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:28.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:30.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:29 smithi046 ceph-mon[88928]: pgmap v1993: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:30.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:29 smithi142 ceph-mon[69118]: pgmap v1993: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:32.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:31 smithi046 ceph-mon[88928]: pgmap v1994: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:32.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:31 smithi142 ceph-mon[69118]: pgmap v1994: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:34.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:33 smithi046 ceph-mon[88928]: pgmap v1995: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:34.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:33 smithi142 ceph-mon[69118]: pgmap v1995: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:36.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:35 smithi046 ceph-mon[88928]: pgmap v1996: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:36.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:35 smithi142 ceph-mon[69118]: pgmap v1996: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:38.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:37 smithi046 ceph-mon[88928]: pgmap v1997: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:38.333 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:37 smithi142 ceph-mon[69118]: pgmap v1997: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:40.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:39 smithi046 ceph-mon[88928]: pgmap v1998: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:40.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:39 smithi142 ceph-mon[69118]: pgmap v1998: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:42.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:41 smithi046 ceph-mon[88928]: pgmap v1999: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:42.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:41 smithi142 ceph-mon[69118]: pgmap v1999: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:43.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:43.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:44.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:43 smithi046 ceph-mon[88928]: pgmap v2000: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:44.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:43 smithi142 ceph-mon[69118]: pgmap v2000: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:46.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:45 smithi046 ceph-mon[88928]: pgmap v2001: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:46.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:45 smithi142 ceph-mon[69118]: pgmap v2001: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:48.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:47 smithi046 ceph-mon[88928]: pgmap v2002: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:48.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:47 smithi142 ceph-mon[69118]: pgmap v2002: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:50.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:49 smithi046 ceph-mon[88928]: pgmap v2003: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:50.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:49 smithi142 ceph-mon[69118]: pgmap v2003: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:52.246 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:51 smithi142 ceph-mon[69118]: pgmap v2004: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:52.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:51 smithi046 ceph-mon[88928]: pgmap v2004: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:54.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:53 smithi046 ceph-mon[88928]: pgmap v2005: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:54.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:53 smithi142 ceph-mon[69118]: pgmap v2005: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:56.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:55 smithi046 ceph-mon[88928]: pgmap v2006: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:56.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:55 smithi142 ceph-mon[69118]: pgmap v2006: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:57 smithi046 ceph-mon[88928]: pgmap v2007: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:09:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:58.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:57 smithi142 ceph-mon[69118]: pgmap v2007: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:09:58.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:09:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:00.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:00 smithi046 ceph-mon[88928]: pgmap v2008: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:00.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:00 smithi142 ceph-mon[69118]: pgmap v2008: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:01.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:01 smithi046 ceph-mon[88928]: overall HEALTH_OK 2024-02-19T20:10:01.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:01 smithi142 ceph-mon[69118]: overall HEALTH_OK 2024-02-19T20:10:02.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:02 smithi046 ceph-mon[88928]: pgmap v2009: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:02.345 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:02 smithi142 ceph-mon[69118]: pgmap v2009: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:04.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:04 smithi046 ceph-mon[88928]: pgmap v2010: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:04.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:04 smithi142 ceph-mon[69118]: pgmap v2010: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:06 smithi046 ceph-mon[88928]: pgmap v2011: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:06.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:06 smithi142 ceph-mon[69118]: pgmap v2011: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:08.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:08 smithi046 ceph-mon[88928]: pgmap v2012: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:08.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:08 smithi142 ceph-mon[69118]: pgmap v2012: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:10.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:10 smithi046 ceph-mon[88928]: pgmap v2013: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:10.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:10 smithi142 ceph-mon[69118]: pgmap v2013: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:12.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:12 smithi046 ceph-mon[88928]: pgmap v2014: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:12.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:12 smithi142 ceph-mon[69118]: pgmap v2014: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:13.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:13.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:14.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:14 smithi046 ceph-mon[88928]: pgmap v2015: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:14.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:14 smithi142 ceph-mon[69118]: pgmap v2015: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:16.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:16 smithi046 ceph-mon[88928]: pgmap v2016: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:16.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:16 smithi142 ceph-mon[69118]: pgmap v2016: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:18.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:18 smithi046 ceph-mon[88928]: pgmap v2017: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:18.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:18 smithi142 ceph-mon[69118]: pgmap v2017: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:20.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:20 smithi046 ceph-mon[88928]: pgmap v2018: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:20.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:20 smithi142 ceph-mon[69118]: pgmap v2018: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:22.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:22 smithi046 ceph-mon[88928]: pgmap v2019: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:22.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:22 smithi142 ceph-mon[69118]: pgmap v2019: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:24.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:24 smithi046 ceph-mon[88928]: pgmap v2020: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:24.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:24 smithi142 ceph-mon[69118]: pgmap v2020: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:26 smithi046 ceph-mon[88928]: pgmap v2021: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:10:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:10:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:10:26.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:10:26.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:26 smithi142 ceph-mon[69118]: pgmap v2021: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:26.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:10:26.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:10:26.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:10:26.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:10:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:28 smithi046 ceph-mon[88928]: pgmap v2022: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:28.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:28 smithi142 ceph-mon[69118]: pgmap v2022: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:28.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:30.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:30 smithi046 ceph-mon[88928]: pgmap v2023: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:30.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:30 smithi142 ceph-mon[69118]: pgmap v2023: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:32.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:32 smithi046 ceph-mon[88928]: pgmap v2024: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:32.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:32 smithi142 ceph-mon[69118]: pgmap v2024: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:34.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:34 smithi046 ceph-mon[88928]: pgmap v2025: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:34.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:34 smithi142 ceph-mon[69118]: pgmap v2025: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:36.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:36 smithi046 ceph-mon[88928]: pgmap v2026: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:36.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:36 smithi142 ceph-mon[69118]: pgmap v2026: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:38.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:38 smithi142 ceph-mon[69118]: pgmap v2027: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:38.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:38 smithi046 ceph-mon[88928]: pgmap v2027: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:40.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:40 smithi142 ceph-mon[69118]: pgmap v2028: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:40.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:40 smithi046 ceph-mon[88928]: pgmap v2028: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:42.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:42 smithi142 ceph-mon[69118]: pgmap v2029: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:42.513 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:42 smithi046 ceph-mon[88928]: pgmap v2029: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:43.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:43.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:44.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:44 smithi142 ceph-mon[69118]: pgmap v2030: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:44.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:44 smithi046 ceph-mon[88928]: pgmap v2030: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:46.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:46 smithi142 ceph-mon[69118]: pgmap v2031: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:46.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:46 smithi046 ceph-mon[88928]: pgmap v2031: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:48.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:48 smithi142 ceph-mon[69118]: pgmap v2032: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:48.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:48 smithi046 ceph-mon[88928]: pgmap v2032: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:50.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:50 smithi142 ceph-mon[69118]: pgmap v2033: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:50.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:50 smithi046 ceph-mon[88928]: pgmap v2033: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:52.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:52 smithi142 ceph-mon[69118]: pgmap v2034: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:52.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:52 smithi046 ceph-mon[88928]: pgmap v2034: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:54.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:54 smithi142 ceph-mon[69118]: pgmap v2035: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:54.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:54 smithi046 ceph-mon[88928]: pgmap v2035: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:56.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:56 smithi142 ceph-mon[69118]: pgmap v2036: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:56.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:56 smithi046 ceph-mon[88928]: pgmap v2036: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:58 smithi142 ceph-mon[69118]: pgmap v2037: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:58.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:10:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:58.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:58 smithi046 ceph-mon[88928]: pgmap v2037: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:10:58.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:10:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:11:00.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:00 smithi142 ceph-mon[69118]: pgmap v2038: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:00.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:00 smithi046 ceph-mon[88928]: pgmap v2038: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:02.364 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:02 smithi046 ceph-mon[88928]: pgmap v2039: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:02.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:02 smithi142 ceph-mon[69118]: pgmap v2039: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:04.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:04 smithi142 ceph-mon[69118]: pgmap v2040: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:04.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:04 smithi046 ceph-mon[88928]: pgmap v2040: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:06.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:06 smithi142 ceph-mon[69118]: pgmap v2041: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:06.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:06 smithi046 ceph-mon[88928]: pgmap v2041: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:08.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:08 smithi142 ceph-mon[69118]: pgmap v2042: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:08.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:08 smithi046 ceph-mon[88928]: pgmap v2042: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:10.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:10 smithi142 ceph-mon[69118]: pgmap v2043: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:10.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:10 smithi046 ceph-mon[88928]: pgmap v2043: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:12.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:12 smithi142 ceph-mon[69118]: pgmap v2044: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:12.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:12 smithi046 ceph-mon[88928]: pgmap v2044: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:13.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:11:13.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:11:14.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:14 smithi142 ceph-mon[69118]: pgmap v2045: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:14.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:14 smithi046 ceph-mon[88928]: pgmap v2045: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:16.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:16 smithi142 ceph-mon[69118]: pgmap v2046: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:16.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:16 smithi046 ceph-mon[88928]: pgmap v2046: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:18.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:18 smithi046 ceph-mon[88928]: pgmap v2047: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:18.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:18 smithi142 ceph-mon[69118]: pgmap v2047: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:20.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:20 smithi142 ceph-mon[69118]: pgmap v2048: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:20.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:20 smithi046 ceph-mon[88928]: pgmap v2048: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:22.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:22 smithi142 ceph-mon[69118]: pgmap v2049: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:22.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:22 smithi046 ceph-mon[88928]: pgmap v2049: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:24.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:24 smithi142 ceph-mon[69118]: pgmap v2050: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:24.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:24 smithi046 ceph-mon[88928]: pgmap v2050: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:26.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:26 smithi142 ceph-mon[69118]: pgmap v2051: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:26.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:11:26.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:26 smithi046 ceph-mon[88928]: pgmap v2051: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:26.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:11:27.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:11:27.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:11:27.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:11:27.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:11:27.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:11:27.562 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:11:28.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:28 smithi046 ceph-mon[88928]: pgmap v2052: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:11:28.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:28 smithi142 ceph-mon[69118]: pgmap v2052: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:28.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:11:30.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:30 smithi142 ceph-mon[69118]: pgmap v2053: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:30.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:30 smithi046 ceph-mon[88928]: pgmap v2053: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:32.364 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:32 smithi046 ceph-mon[88928]: pgmap v2054: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:32.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:32 smithi142 ceph-mon[69118]: pgmap v2054: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:34.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:34 smithi142 ceph-mon[69118]: pgmap v2055: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:34.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:34 smithi046 ceph-mon[88928]: pgmap v2055: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:36.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:36 smithi142 ceph-mon[69118]: pgmap v2056: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:36.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:36 smithi046 ceph-mon[88928]: pgmap v2056: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:37.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:37 smithi142 ceph-mon[69118]: pgmap v2057: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:37.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:37 smithi046 ceph-mon[88928]: pgmap v2057: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:40.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:39 smithi046 ceph-mon[88928]: pgmap v2058: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:40.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:39 smithi142 ceph-mon[69118]: pgmap v2058: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:42.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:41 smithi046 ceph-mon[88928]: pgmap v2059: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:41 smithi142 ceph-mon[69118]: pgmap v2059: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:43 smithi046 ceph-mon[88928]: pgmap v2060: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:11:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:43 smithi142 ceph-mon[69118]: pgmap v2060: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:44.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:11:46.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:45 smithi046 ceph-mon[88928]: pgmap v2061: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:46.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:45 smithi142 ceph-mon[69118]: pgmap v2061: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:48.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:47 smithi046 ceph-mon[88928]: pgmap v2062: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:48.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:47 smithi142 ceph-mon[69118]: pgmap v2062: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:50.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:49 smithi046 ceph-mon[88928]: pgmap v2063: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:50.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:49 smithi142 ceph-mon[69118]: pgmap v2063: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:52.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:51 smithi046 ceph-mon[88928]: pgmap v2064: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:52.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:51 smithi142 ceph-mon[69118]: pgmap v2064: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:54.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:53 smithi046 ceph-mon[88928]: pgmap v2065: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:53 smithi142 ceph-mon[69118]: pgmap v2065: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:55 smithi046 ceph-mon[88928]: pgmap v2066: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:56.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:55 smithi142 ceph-mon[69118]: pgmap v2066: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:58.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:57 smithi046 ceph-mon[88928]: pgmap v2067: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:57 smithi142 ceph-mon[69118]: pgmap v2067: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:11:59.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:11:59.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:12:00.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:11:59 smithi046 ceph-mon[88928]: pgmap v2068: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:00.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:11:59 smithi142 ceph-mon[69118]: pgmap v2068: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:02.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:01 smithi046 ceph-mon[88928]: pgmap v2069: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:01 smithi142 ceph-mon[69118]: pgmap v2069: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:03.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:03 smithi142 ceph-mon[69118]: pgmap v2070: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:03 smithi046 ceph-mon[88928]: pgmap v2070: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:06.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:05 smithi046 ceph-mon[88928]: pgmap v2071: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:05 smithi142 ceph-mon[69118]: pgmap v2071: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:08.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:07 smithi046 ceph-mon[88928]: pgmap v2072: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:08.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:07 smithi142 ceph-mon[69118]: pgmap v2072: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:10.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:09 smithi046 ceph-mon[88928]: pgmap v2073: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:09 smithi142 ceph-mon[69118]: pgmap v2073: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:12.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:11 smithi046 ceph-mon[88928]: pgmap v2074: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:11 smithi142 ceph-mon[69118]: pgmap v2074: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:13.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:13 smithi142 ceph-mon[69118]: pgmap v2075: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:13.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:13 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:12:14.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:13 smithi046 ceph-mon[88928]: pgmap v2075: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:14.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:13 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:12:16.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:15 smithi046 ceph-mon[88928]: pgmap v2076: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:16.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:15 smithi142 ceph-mon[69118]: pgmap v2076: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:18.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:17 smithi046 ceph-mon[88928]: pgmap v2077: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:17 smithi142 ceph-mon[69118]: pgmap v2077: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:20.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:19 smithi046 ceph-mon[88928]: pgmap v2078: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:20.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:19 smithi142 ceph-mon[69118]: pgmap v2078: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:22.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:21 smithi046 ceph-mon[88928]: pgmap v2079: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:22.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:21 smithi142 ceph-mon[69118]: pgmap v2079: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:24.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:23 smithi046 ceph-mon[88928]: pgmap v2080: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:24.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:23 smithi142 ceph-mon[69118]: pgmap v2080: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:26.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:25 smithi046 ceph-mon[88928]: pgmap v2081: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:26.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:25 smithi142 ceph-mon[69118]: pgmap v2081: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:27.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:26 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:12:27.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:26 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:12:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:27 smithi142 ceph-mon[69118]: pgmap v2082: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:12:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:12:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:12:28.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:27 smithi046 ceph-mon[88928]: pgmap v2082: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:12:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:12:28.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:12:29.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:28 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:12:29.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:28 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:12:30.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:29 smithi142 ceph-mon[69118]: pgmap v2083: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:30.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:29 smithi046 ceph-mon[88928]: pgmap v2083: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:32.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:31 smithi046 ceph-mon[88928]: pgmap v2084: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:32.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:31 smithi142 ceph-mon[69118]: pgmap v2084: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:34.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:33 smithi046 ceph-mon[88928]: pgmap v2085: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:34.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:33 smithi142 ceph-mon[69118]: pgmap v2085: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:36.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:35 smithi142 ceph-mon[69118]: pgmap v2086: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:36.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:35 smithi046 ceph-mon[88928]: pgmap v2086: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:38.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:37 smithi142 ceph-mon[69118]: pgmap v2087: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:38.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:37 smithi046 ceph-mon[88928]: pgmap v2087: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:40.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:39 smithi142 ceph-mon[69118]: pgmap v2088: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:40.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:39 smithi046 ceph-mon[88928]: pgmap v2088: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:42.114 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:41 smithi046 ceph-mon[88928]: pgmap v2089: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:41 smithi142 ceph-mon[69118]: pgmap v2089: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:43.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:42 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:12:43.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:42 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:12:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:43 smithi142 ceph-mon[69118]: pgmap v2090: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:44.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:43 smithi046 ceph-mon[88928]: pgmap v2090: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:46.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:45 smithi142 ceph-mon[69118]: pgmap v2091: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:46.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:45 smithi046 ceph-mon[88928]: pgmap v2091: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:48.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:47 smithi142 ceph-mon[69118]: pgmap v2092: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:48.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:47 smithi046 ceph-mon[88928]: pgmap v2092: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:50.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:49 smithi142 ceph-mon[69118]: pgmap v2093: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:50.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:49 smithi046 ceph-mon[88928]: pgmap v2093: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:52.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:51 smithi046 ceph-mon[88928]: pgmap v2094: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:52.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:51 smithi142 ceph-mon[69118]: pgmap v2094: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:54.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:53 smithi142 ceph-mon[69118]: pgmap v2095: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:54.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:53 smithi046 ceph-mon[88928]: pgmap v2095: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:56.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:55 smithi142 ceph-mon[69118]: pgmap v2096: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:56.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:55 smithi046 ceph-mon[88928]: pgmap v2096: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:58.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:57 smithi142 ceph-mon[69118]: pgmap v2097: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:58.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:57 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:12:58.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:57 smithi046 ceph-mon[88928]: pgmap v2097: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:12:58.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:57 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:13:00.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:12:59 smithi142 ceph-mon[69118]: pgmap v2098: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:00.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:12:59 smithi046 ceph-mon[88928]: pgmap v2098: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:01 smithi142 ceph-mon[69118]: pgmap v2099: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:02.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:01 smithi046 ceph-mon[88928]: pgmap v2099: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:04.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:03 smithi142 ceph-mon[69118]: pgmap v2100: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:04.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:03 smithi046 ceph-mon[88928]: pgmap v2100: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:06.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:05 smithi142 ceph-mon[69118]: pgmap v2101: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:06.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:05 smithi046 ceph-mon[88928]: pgmap v2101: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:08.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:07 smithi142 ceph-mon[69118]: pgmap v2102: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:08.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:07 smithi046 ceph-mon[88928]: pgmap v2102: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:10.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:09 smithi142 ceph-mon[69118]: pgmap v2103: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:10.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:09 smithi046 ceph-mon[88928]: pgmap v2103: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:12.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:11 smithi142 ceph-mon[69118]: pgmap v2104: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:12.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:11 smithi046 ceph-mon[88928]: pgmap v2104: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:13.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:12 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:13:13.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:12 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:13:14.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:13 smithi142 ceph-mon[69118]: pgmap v2105: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:14.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:13 smithi046 ceph-mon[88928]: pgmap v2105: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:16.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:15 smithi142 ceph-mon[69118]: pgmap v2106: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:16.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:15 smithi046 ceph-mon[88928]: pgmap v2106: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:18.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:17 smithi142 ceph-mon[69118]: pgmap v2107: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:18.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:17 smithi046 ceph-mon[88928]: pgmap v2107: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:20.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:19 smithi142 ceph-mon[69118]: pgmap v2108: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:20.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:19 smithi046 ceph-mon[88928]: pgmap v2108: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:22.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:21 smithi142 ceph-mon[69118]: pgmap v2109: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:22.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:21 smithi046 ceph-mon[88928]: pgmap v2109: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:24.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:23 smithi142 ceph-mon[69118]: pgmap v2110: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:24.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:23 smithi046 ceph-mon[88928]: pgmap v2110: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:26.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:25 smithi142 ceph-mon[69118]: pgmap v2111: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:26.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:25 smithi046 ceph-mon[88928]: pgmap v2111: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:28.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:27 smithi142 ceph-mon[69118]: pgmap v2112: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:13:28.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:27 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:13:28.298 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:27 smithi046 ceph-mon[88928]: pgmap v2112: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:28.299 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:13:28.299 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:27 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:13:30.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:29 smithi046 ceph-mon[88928]: pgmap v2113: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:30.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:30.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:29 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:30.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:29 smithi142 ceph-mon[69118]: pgmap v2113: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:30.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:30.182 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:29 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:31.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:31.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:31 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:31.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:31 smithi142 ceph-mon[69118]: pgmap v2114: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:31.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:31.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:31 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:31.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:31 smithi046 ceph-mon[88928]: pgmap v2114: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:33.060 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:32 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:33.060 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:32 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:33.252 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:32 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:33.252 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:32 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:34.236 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:33 smithi046 ceph-mon[88928]: pgmap v2115: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:34.236 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:33 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:34.236 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:33 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:34.236 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:33 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:34.236 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:33 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:34.265 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:33 smithi142 ceph-mon[69118]: pgmap v2115: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:34.265 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:33 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:34.265 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:33 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:34.265 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:33 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:34.265 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:33 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:36.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:35 smithi046 ceph-mon[88928]: pgmap v2116: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:36.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:35 smithi142 ceph-mon[69118]: pgmap v2116: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:37.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:37.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:37.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:13:37.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:13:37.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:37 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:37.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:37 smithi142 ceph-mon[69118]: pgmap v2117: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:37.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:37.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:37.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:13:37.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:13:37.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:37 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' 2024-02-19T20:13:37.812 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:37 smithi046 ceph-mon[88928]: pgmap v2117: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:40.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:39 smithi046 ceph-mon[88928]: pgmap v2118: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:40.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:39 smithi142 ceph-mon[69118]: pgmap v2118: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:42.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:41 smithi046 ceph-mon[88928]: pgmap v2119: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:42.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:41 smithi142 ceph-mon[69118]: pgmap v2119: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:44.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:43 smithi046 ceph-mon[88928]: pgmap v2120: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:44.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:43 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:13:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:43 smithi142 ceph-mon[69118]: pgmap v2120: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:44.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:43 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:13:46.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:45 smithi046 ceph-mon[88928]: pgmap v2121: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:46.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:45 smithi142 ceph-mon[69118]: pgmap v2121: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:48.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:47 smithi046 ceph-mon[88928]: pgmap v2122: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:48.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:47 smithi142 ceph-mon[69118]: pgmap v2122: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:49.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:49 smithi142 ceph-mon[69118]: pgmap v2123: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:50.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:49 smithi046 ceph-mon[88928]: pgmap v2123: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:52.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:51 smithi046 ceph-mon[88928]: pgmap v2124: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:52.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:51 smithi142 ceph-mon[69118]: pgmap v2124: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:54.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:53 smithi046 ceph-mon[88928]: pgmap v2125: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:54.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:53 smithi142 ceph-mon[69118]: pgmap v2125: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:56.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:55 smithi046 ceph-mon[88928]: pgmap v2126: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:56.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:55 smithi142 ceph-mon[69118]: pgmap v2126: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:58.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:57 smithi046 ceph-mon[88928]: pgmap v2127: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:58.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:57 smithi142 ceph-mon[69118]: pgmap v2127: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:13:59.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:58 smithi046 ceph-mon[88928]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:13:59.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:58 smithi142 ceph-mon[69118]: from='mgr.34104 172.21.15.46:0/495999659' entity='mgr.smithi046.qtceex' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:13:59.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:13:59 smithi142 ceph-mon[69118]: pgmap v2128: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:14:00.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:13:59 smithi046 ceph-mon[88928]: pgmap v2128: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:14:02.062 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:01 smithi046 ceph-mon[88928]: pgmap v2129: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:14:02.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:14:01 smithi142 ceph-mon[69118]: pgmap v2129: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:14:04.061 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:03 smithi046 ceph-mon[88928]: pgmap v2130: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:14:04.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:14:03 smithi142 ceph-mon[69118]: pgmap v2130: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:14:05.588 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-19T20:14:05.601 INFO:tasks.cephadm:Teardown begin 2024-02-19T20:14:05.601 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T20:14:05.636 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T20:14:05.672 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-19T20:14:05.672 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-19T20:14:05.693 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-19T20:14:05.730 INFO:tasks.cephadm:Stopping all daemons... 2024-02-19T20:14:05.730 INFO:tasks.cephadm.mon.smithi046:Stopping mon.smithi046... 2024-02-19T20:14:05.730 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046 2024-02-19T20:14:05.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:14:05 smithi142 ceph-mon[69118]: pgmap v2131: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:14:06.048 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:05 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T20:14:06.048 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:05 smithi046 ceph-mon[88928]: pgmap v2131: 65 pgs: 65 active+clean; 297 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-19T20:14:06.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:06 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046[88924]: 2024-02-19T20:14:06.047+0000 7ff551f7f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:14:06.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:06 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046[88924]: 2024-02-19T20:14:06.047+0000 7ff551f7f700 -1 mon.smithi046@0(leader) e3 *** Got Signal Terminated *** 2024-02-19T20:14:06.312 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:06 smithi046 podman[152362]: 2024-02-19 20:14:06.098515396 +0000 UTC m=+0.167817135 container died ef2d7130eaeee122a8d81b50306aaf05ebeae8d124fb6d7a761da4df7fd601f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-02-19T20:14:06.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:06 smithi046 podman[152362]: 2024-02-19 20:14:06.439481419 +0000 UTC m=+0.508783154 container cleanup ef2d7130eaeee122a8d81b50306aaf05ebeae8d124fb6d7a761da4df7fd601f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-19T20:14:06.658 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:06 smithi046 bash[152362]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046 2024-02-19T20:14:06.891 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046.service' 2024-02-19T20:14:06.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:06 smithi046 podman[152387]: 2024-02-19 20:14:06.657345701 +0000 UTC m=+0.556386213 container remove ef2d7130eaeee122a8d81b50306aaf05ebeae8d124fb6d7a761da4df7fd601f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi046, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True) 2024-02-19T20:14:06.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:06 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046.service: Deactivated successfully. 2024-02-19T20:14:06.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:06 smithi046 systemd[1]: Stopped Ceph mon.smithi046 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T20:14:06.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Feb 19 20:14:06 smithi046 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi046.service: Consumed 39.121s CPU time. 2024-02-19T20:14:06.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:14:06.942 INFO:tasks.cephadm.mon.smithi046:Stopped mon.smithi046 2024-02-19T20:14:06.942 INFO:tasks.cephadm.mon.smithi142:Stopping mon.smithi142... 2024-02-19T20:14:06.942 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi142 2024-02-19T20:14:07.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:14:06 smithi142 systemd[1]: Stopping Ceph mon.smithi142 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T20:14:07.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:14:07 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142[69114]: 2024-02-19T20:14:07.255+0000 7f846832a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi142 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:14:07.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:14:07 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142[69114]: 2024-02-19T20:14:07.255+0000 7f846832a700 -1 mon.smithi142@1(peon) e3 *** Got Signal Terminated *** 2024-02-19T20:14:07.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:14:07 smithi142 podman[122127]: 2024-02-19 20:14:07.480604033 +0000 UTC m=+0.341801569 container died 013f41b4fcd9504daa7dcdb74ad5eebbf5bcc7c46ad6ef96e4be42cd5ff42bf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-19T20:14:07.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:14:07 smithi142 podman[122127]: 2024-02-19 20:14:07.771744162 +0000 UTC m=+0.632941689 container cleanup 013f41b4fcd9504daa7dcdb74ad5eebbf5bcc7c46ad6ef96e4be42cd5ff42bf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T20:14:07.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Feb 19 20:14:07 smithi142 bash[122127]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-mon-smithi142 2024-02-19T20:14:08.105 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@mon.smithi142.service' 2024-02-19T20:14:08.157 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:14:08.157 INFO:tasks.cephadm.mon.smithi142:Stopped mon.smithi142 2024-02-19T20:14:08.157 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-19T20:14:08.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.0 2024-02-19T20:14:08.561 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:08 smithi046 systemd[1]: Stopping Ceph osd.0 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T20:14:09.061 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:08 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[100989]: 2024-02-19T20:14:08.567+0000 7f5d6ad3f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:14:09.062 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:08 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[100989]: 2024-02-19T20:14:08.567+0000 7f5d6ad3f700 -1 osd.0 119 *** Got signal Terminated *** 2024-02-19T20:14:09.062 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:08 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0[100989]: 2024-02-19T20:14:08.567+0000 7f5d6ad3f700 -1 osd.0 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:14:14.270 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:13 smithi046 podman[152495]: 2024-02-19 20:14:13.992907466 +0000 UTC m=+5.632064380 container died 9a17e8a3661e995f0f197e67f408517b7e771f8022c6772e0757cc0f24b26aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-19T20:14:14.561 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:14 smithi046 podman[152495]: 2024-02-19 20:14:14.368694768 +0000 UTC m=+6.007851721 container cleanup 9a17e8a3661e995f0f197e67f408517b7e771f8022c6772e0757cc0f24b26aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-19T20:14:14.562 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:14 smithi046 bash[152495]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0 2024-02-19T20:14:15.041 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:14 smithi046 podman[152512]: 2024-02-19 20:14:14.686907431 +0000 UTC m=+0.695908762 container remove 9a17e8a3661e995f0f197e67f408517b7e771f8022c6772e0757cc0f24b26aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-19T20:14:15.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:15 smithi046 podman[152603]: 2024-02-19 20:14:14.943920839 +0000 UTC m=+0.017761775 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:14:15.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:15 smithi046 podman[152603]: 2024-02-19 20:14:15.062908551 +0000 UTC m=+0.136749473 container create cc3e45839e2de3ffa00757d61b72cdc450e11264c421555f3d9c3060d8b2199d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-19T20:14:15.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:15 smithi046 podman[152603]: 2024-02-19 20:14:15.291214781 +0000 UTC m=+0.365055702 container init cc3e45839e2de3ffa00757d61b72cdc450e11264c421555f3d9c3060d8b2199d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-19T20:14:15.562 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:15 smithi046 podman[152603]: 2024-02-19 20:14:15.294576334 +0000 UTC m=+0.368417254 container start cc3e45839e2de3ffa00757d61b72cdc450e11264c421555f3d9c3060d8b2199d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-19T20:14:15.562 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:15 smithi046 podman[152603]: 2024-02-19 20:14:15.399044088 +0000 UTC m=+0.472885008 container attach cc3e45839e2de3ffa00757d61b72cdc450e11264c421555f3d9c3060d8b2199d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-19T20:14:15.887 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:15 smithi046 podman[152603]: 2024-02-19 20:14:15.59997742 +0000 UTC m=+0.673818340 container died cc3e45839e2de3ffa00757d61b72cdc450e11264c421555f3d9c3060d8b2199d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=) 2024-02-19T20:14:16.139 INFO:journalctl@ceph.osd.0.smithi046.stdout:Feb 19 20:14:16 smithi046 podman[152629]: 2024-02-19 20:14:16.136100909 +0000 UTC m=+0.527309841 container remove cc3e45839e2de3ffa00757d61b72cdc450e11264c421555f3d9c3060d8b2199d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T20:14:16.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.0.service' 2024-02-19T20:14:16.204 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:14:16.205 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-19T20:14:16.205 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-19T20:14:16.205 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.1 2024-02-19T20:14:16.439 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:16 smithi046 systemd[1]: Stopping Ceph osd.1 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T20:14:16.811 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:16 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[106707]: 2024-02-19T20:14:16.538+0000 7ff91db20700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:14:16.811 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:16 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[106707]: 2024-02-19T20:14:16.538+0000 7ff91db20700 -1 osd.1 119 *** Got signal Terminated *** 2024-02-19T20:14:16.812 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:16 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1[106707]: 2024-02-19T20:14:16.538+0000 7ff91db20700 -1 osd.1 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:14:22.312 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:22 smithi046 podman[152712]: 2024-02-19 20:14:22.053004561 +0000 UTC m=+5.647507514 container died 974e56511c367ec8a3410f5b60756a7532527a2d63f1702708ab70b8612032f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T20:14:22.682 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:22 smithi046 podman[152712]: 2024-02-19 20:14:22.464284309 +0000 UTC m=+6.058787262 container cleanup 974e56511c367ec8a3410f5b60756a7532527a2d63f1702708ab70b8612032f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T20:14:22.683 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:22 smithi046 bash[152712]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1 2024-02-19T20:14:22.977 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:22 smithi046 podman[152740]: 2024-02-19 20:14:22.682192061 +0000 UTC m=+0.617333884 container remove 974e56511c367ec8a3410f5b60756a7532527a2d63f1702708ab70b8612032f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-02-19T20:14:23.262 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:22 smithi046 podman[152834]: 2024-02-19 20:14:22.87946963 +0000 UTC m=+0.018990198 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:14:23.262 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:22 smithi046 podman[152834]: 2024-02-19 20:14:22.983268708 +0000 UTC m=+0.122789324 container create ceffee4532b46a4b96da915d7e35ebf9fc44c9e9d73bf631dbf59f6ee6908a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-19T20:14:23.262 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:23 smithi046 podman[152834]: 2024-02-19 20:14:23.185626208 +0000 UTC m=+0.325146769 container init ceffee4532b46a4b96da915d7e35ebf9fc44c9e9d73bf631dbf59f6ee6908a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214) 2024-02-19T20:14:23.262 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:23 smithi046 podman[152834]: 2024-02-19 20:14:23.188873691 +0000 UTC m=+0.328394254 container start ceffee4532b46a4b96da915d7e35ebf9fc44c9e9d73bf631dbf59f6ee6908a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_CLEAN=True) 2024-02-19T20:14:23.262 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:23 smithi046 podman[152834]: 2024-02-19 20:14:23.260483813 +0000 UTC m=+0.400004388 container attach ceffee4532b46a4b96da915d7e35ebf9fc44c9e9d73bf631dbf59f6ee6908a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0) 2024-02-19T20:14:23.561 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:23 smithi046 podman[152834]: 2024-02-19 20:14:23.486909537 +0000 UTC m=+0.626430098 container died ceffee4532b46a4b96da915d7e35ebf9fc44c9e9d73bf631dbf59f6ee6908a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-19T20:14:24.054 INFO:journalctl@ceph.osd.1.smithi046.stdout:Feb 19 20:14:24 smithi046 podman[152860]: 2024-02-19 20:14:24.039173667 +0000 UTC m=+0.547369458 container remove ceffee4532b46a4b96da915d7e35ebf9fc44c9e9d73bf631dbf59f6ee6908a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-02-19T20:14:24.060 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.1.service' 2024-02-19T20:14:24.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:14:24.103 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-19T20:14:24.103 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-19T20:14:24.103 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.2 2024-02-19T20:14:24.311 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:24 smithi046 systemd[1]: Stopping Ceph osd.2 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T20:14:24.811 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:24 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[112579]: 2024-02-19T20:14:24.433+0000 7fd84102b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:14:24.812 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:24 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[112579]: 2024-02-19T20:14:24.433+0000 7fd84102b700 -1 osd.2 119 *** Got signal Terminated *** 2024-02-19T20:14:24.812 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:24 smithi046 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2[112579]: 2024-02-19T20:14:24.433+0000 7fd84102b700 -1 osd.2 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:14:30.237 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:29 smithi046 podman[152939]: 2024-02-19 20:14:29.944032842 +0000 UTC m=+5.621818707 container died a31225ea4dec5652e7294f5f748038ddd30c3c69cb8db11b07039884e06ddebf (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.schema-version=1.0) 2024-02-19T20:14:30.561 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:30 smithi046 podman[152939]: 2024-02-19 20:14:30.335824388 +0000 UTC m=+6.013610255 container cleanup a31225ea4dec5652e7294f5f748038ddd30c3c69cb8db11b07039884e06ddebf (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T20:14:30.562 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:30 smithi046 bash[152939]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2 2024-02-19T20:14:30.961 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:30 smithi046 podman[152958]: 2024-02-19 20:14:30.612258736 +0000 UTC m=+0.663015608 container remove a31225ea4dec5652e7294f5f748038ddd30c3c69cb8db11b07039884e06ddebf (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-02-19T20:14:31.233 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:30 smithi046 podman[153049]: 2024-02-19 20:14:30.864054626 +0000 UTC m=+0.017643952 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:14:31.233 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:30 smithi046 podman[153049]: 2024-02-19 20:14:30.971401647 +0000 UTC m=+0.124990963 container create 126d5b74b0f601811c20ce3282bd817e26ea2303a7b6020e09762e769b41c3f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-19T20:14:31.233 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:31 smithi046 podman[153049]: 2024-02-19 20:14:31.165633458 +0000 UTC m=+0.319222775 container init 126d5b74b0f601811c20ce3282bd817e26ea2303a7b6020e09762e769b41c3f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-19T20:14:31.233 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:31 smithi046 podman[153049]: 2024-02-19 20:14:31.168664013 +0000 UTC m=+0.322253334 container start 126d5b74b0f601811c20ce3282bd817e26ea2303a7b6020e09762e769b41c3f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-02-19T20:14:31.233 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:31 smithi046 podman[153049]: 2024-02-19 20:14:31.232119751 +0000 UTC m=+0.385709075 container attach 126d5b74b0f601811c20ce3282bd817e26ea2303a7b6020e09762e769b41c3f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T20:14:31.561 INFO:journalctl@ceph.osd.2.smithi046.stdout:Feb 19 20:14:31 smithi046 podman[153049]: 2024-02-19 20:14:31.46748209 +0000 UTC m=+0.621071406 container died 126d5b74b0f601811c20ce3282bd817e26ea2303a7b6020e09762e769b41c3f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T20:14:32.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.2.service' 2024-02-19T20:14:32.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:14:32.063 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-19T20:14:32.063 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-19T20:14:32.063 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.3 2024-02-19T20:14:32.374 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:32 smithi142 systemd[1]: Stopping Ceph osd.3 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T20:14:32.681 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:32 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[79103]: 2024-02-19T20:14:32.373+0000 7fd5e6153700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:14:32.681 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:32 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[79103]: 2024-02-19T20:14:32.373+0000 7fd5e6153700 -1 osd.3 119 *** Got signal Terminated *** 2024-02-19T20:14:32.681 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:32 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[79103]: 2024-02-19T20:14:32.373+0000 7fd5e6153700 -1 osd.3 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:14:35.932 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:35 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:35.635+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.375182+0000 front 2024-02-19T20:14:11.374995+0000 (oldest deadline 2024-02-19T20:14:34.874882+0000) 2024-02-19T20:14:36.887 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:36 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:36.631+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.375182+0000 front 2024-02-19T20:14:11.374995+0000 (oldest deadline 2024-02-19T20:14:34.874882+0000) 2024-02-19T20:14:37.181 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:36 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3[79103]: 2024-02-19T20:14:36.886+0000 7fd5def40700 -1 osd.3 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.552164+0000 front 2024-02-19T20:14:11.552177+0000 (oldest deadline 2024-02-19T20:14:36.152455+0000) 2024-02-19T20:14:37.932 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:37 smithi142 podman[122249]: 2024-02-19 20:14:37.843608275 +0000 UTC m=+5.585737931 container died b46795b87c3eb6bba5e40a9765f783d9da6a0fe7f8ebafaee6c5a570f2f79b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-19T20:14:37.932 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:37 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:37.663+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.375182+0000 front 2024-02-19T20:14:11.374995+0000 (oldest deadline 2024-02-19T20:14:34.874882+0000) 2024-02-19T20:14:38.358 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:38 smithi142 podman[122249]: 2024-02-19 20:14:38.140525688 +0000 UTC m=+5.882655334 container cleanup b46795b87c3eb6bba5e40a9765f783d9da6a0fe7f8ebafaee6c5a570f2f79b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-19T20:14:38.358 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:38 smithi142 bash[122249]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3 2024-02-19T20:14:38.657 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:38 smithi142 podman[122266]: 2024-02-19 20:14:38.358252661 +0000 UTC m=+0.509502601 container remove b46795b87c3eb6bba5e40a9765f783d9da6a0fe7f8ebafaee6c5a570f2f79b14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T20:14:38.928 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:38 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:38.657+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.375182+0000 front 2024-02-19T20:14:11.374995+0000 (oldest deadline 2024-02-19T20:14:34.874882+0000) 2024-02-19T20:14:38.929 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:38 smithi142 podman[122357]: 2024-02-19 20:14:38.675862347 +0000 UTC m=+0.111943090 container create f2081e0540bc771adce9904cad57cca90337a99672ba35e2b9e379f724eb7fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True) 2024-02-19T20:14:38.929 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:38 smithi142 podman[122357]: 2024-02-19 20:14:38.582611279 +0000 UTC m=+0.018692020 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:14:38.929 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:38 smithi142 podman[122357]: 2024-02-19 20:14:38.86991539 +0000 UTC m=+0.305996131 container init f2081e0540bc771adce9904cad57cca90337a99672ba35e2b9e379f724eb7fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-02-19T20:14:38.929 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:38 smithi142 podman[122357]: 2024-02-19 20:14:38.872956942 +0000 UTC m=+0.309037684 container start f2081e0540bc771adce9904cad57cca90337a99672ba35e2b9e379f724eb7fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T20:14:38.929 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:38 smithi142 podman[122357]: 2024-02-19 20:14:38.928149728 +0000 UTC m=+0.364230482 container attach f2081e0540bc771adce9904cad57cca90337a99672ba35e2b9e379f724eb7fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-02-19T20:14:39.182 INFO:journalctl@ceph.osd.3.smithi142.stdout:Feb 19 20:14:39 smithi142 podman[122357]: 2024-02-19 20:14:39.163594028 +0000 UTC m=+0.599674773 container died f2081e0540bc771adce9904cad57cca90337a99672ba35e2b9e379f724eb7fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-3-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T20:14:39.636 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:39 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:39.314+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:39.831 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.3.service' 2024-02-19T20:14:39.872 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:14:39.872 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-19T20:14:39.872 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-19T20:14:39.872 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.4 2024-02-19T20:14:39.931 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:39 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:39.636+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.375182+0000 front 2024-02-19T20:14:11.374995+0000 (oldest deadline 2024-02-19T20:14:34.874882+0000) 2024-02-19T20:14:40.227 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:39 smithi142 systemd[1]: Stopping Ceph osd.4 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T20:14:40.493 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:40 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:40.324+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:40.494 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:40 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:40.226+0000 7f05ff93f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:14:40.494 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:40 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:40.226+0000 7f05ff93f700 -1 osd.4 119 *** Got signal Terminated *** 2024-02-19T20:14:40.494 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:40 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:40.226+0000 7f05ff93f700 -1 osd.4 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:14:40.931 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:40 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:40.655+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.375182+0000 front 2024-02-19T20:14:11.374995+0000 (oldest deadline 2024-02-19T20:14:34.874882+0000) 2024-02-19T20:14:41.675 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:41 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:41.367+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:41.932 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:41 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:41.703+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.375182+0000 front 2024-02-19T20:14:11.374995+0000 (oldest deadline 2024-02-19T20:14:34.874882+0000) 2024-02-19T20:14:42.681 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:42 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:42.346+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:43.181 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:42 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:42.741+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.375182+0000 front 2024-02-19T20:14:11.374995+0000 (oldest deadline 2024-02-19T20:14:34.874882+0000) 2024-02-19T20:14:43.182 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:42 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:42.742+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:18.276294+0000 front 2024-02-19T20:14:18.276363+0000 (oldest deadline 2024-02-19T20:14:42.376176+0000) 2024-02-19T20:14:43.681 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:43 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:43.315+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:44.181 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:43 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:43.698+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.375182+0000 front 2024-02-19T20:14:11.374995+0000 (oldest deadline 2024-02-19T20:14:34.874882+0000) 2024-02-19T20:14:44.182 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:43 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:43.698+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:18.276294+0000 front 2024-02-19T20:14:18.276363+0000 (oldest deadline 2024-02-19T20:14:42.376176+0000) 2024-02-19T20:14:44.683 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:44 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:44.321+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:44.683 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:44 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:44.321+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:20.620515+0000 front 2024-02-19T20:14:20.620473+0000 (oldest deadline 2024-02-19T20:14:43.520411+0000) 2024-02-19T20:14:45.067 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:44 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:44.684+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:11.375182+0000 front 2024-02-19T20:14:11.374995+0000 (oldest deadline 2024-02-19T20:14:34.874882+0000) 2024-02-19T20:14:45.068 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:44 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4[84043]: 2024-02-19T20:14:44.684+0000 7f05fc734700 -1 osd.4 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:18.276294+0000 front 2024-02-19T20:14:18.276363+0000 (oldest deadline 2024-02-19T20:14:42.376176+0000) 2024-02-19T20:14:45.431 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:45 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:45.278+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:45.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:45 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:45.278+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:20.620515+0000 front 2024-02-19T20:14:20.620473+0000 (oldest deadline 2024-02-19T20:14:43.520411+0000) 2024-02-19T20:14:45.903 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:45 smithi142 podman[122465]: 2024-02-19 20:14:45.64985828 +0000 UTC m=+5.552284195 container died 645517de8ff6ccacde27285d26fc0325ed81482732713e904e05911efdbbdad6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240214, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T20:14:46.181 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:45 smithi142 podman[122465]: 2024-02-19 20:14:45.993461593 +0000 UTC m=+5.895887506 container cleanup 645517de8ff6ccacde27285d26fc0325ed81482732713e904e05911efdbbdad6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-02-19T20:14:46.182 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:45 smithi142 bash[122465]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4 2024-02-19T20:14:46.618 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:46 smithi142 podman[122494]: 2024-02-19 20:14:46.202848853 +0000 UTC m=+0.548155142 container remove 645517de8ff6ccacde27285d26fc0325ed81482732713e904e05911efdbbdad6 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T20:14:46.618 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:46 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:46.288+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:46.618 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:46 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:46.288+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:20.620515+0000 front 2024-02-19T20:14:20.620473+0000 (oldest deadline 2024-02-19T20:14:43.520411+0000) 2024-02-19T20:14:46.882 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:46 smithi142 podman[122585]: 2024-02-19 20:14:46.520488558 +0000 UTC m=+0.017575824 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:14:46.882 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:46 smithi142 podman[122585]: 2024-02-19 20:14:46.687485464 +0000 UTC m=+0.184572723 container create 06104c0f34f195490ec2d309883c7b5918c564f51c9092c97b2b1cdbcddfde34 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-19T20:14:47.169 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:46 smithi142 podman[122585]: 2024-02-19 20:14:46.881840002 +0000 UTC m=+0.378927260 container init 06104c0f34f195490ec2d309883c7b5918c564f51c9092c97b2b1cdbcddfde34 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214) 2024-02-19T20:14:47.170 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:46 smithi142 podman[122585]: 2024-02-19 20:14:46.885439466 +0000 UTC m=+0.382526722 container start 06104c0f34f195490ec2d309883c7b5918c564f51c9092c97b2b1cdbcddfde34 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2) 2024-02-19T20:14:47.170 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:46 smithi142 podman[122585]: 2024-02-19 20:14:46.95656255 +0000 UTC m=+0.453649835 container attach 06104c0f34f195490ec2d309883c7b5918c564f51c9092c97b2b1cdbcddfde34 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-19T20:14:47.431 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:47 smithi142 podman[122585]: 2024-02-19 20:14:47.169938366 +0000 UTC m=+0.667025625 container died 06104c0f34f195490ec2d309883c7b5918c564f51c9092c97b2b1cdbcddfde34 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-19T20:14:47.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:47 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:47.281+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:47.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:47 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:47.281+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:20.620515+0000 front 2024-02-19T20:14:20.620473+0000 (oldest deadline 2024-02-19T20:14:43.520411+0000) 2024-02-19T20:14:47.674 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.4.service' 2024-02-19T20:14:47.741 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:47 smithi142 podman[122611]: 2024-02-19 20:14:47.659922749 +0000 UTC m=+0.484464109 container remove 06104c0f34f195490ec2d309883c7b5918c564f51c9092c97b2b1cdbcddfde34 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-19T20:14:47.741 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:47 smithi142 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-19T20:14:47.741 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:47 smithi142 systemd[1]: Stopped Ceph osd.4 for c412ec66-cf57-11ee-95bb-87774f69a715. 2024-02-19T20:14:47.741 INFO:journalctl@ceph.osd.4.smithi142.stdout:Feb 19 20:14:47 smithi142 systemd[1]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.4.service: Consumed 26.548s CPU time. 2024-02-19T20:14:47.756 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:14:47.756 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-19T20:14:47.757 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-19T20:14:47.757 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.5 2024-02-19T20:14:48.072 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:47 smithi142 systemd[1]: Stopping Ceph osd.5 for c412ec66-cf57-11ee-95bb-87774f69a715... 2024-02-19T20:14:48.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:48 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:48.070+0000 7f4d9c05d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:14:48.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:48 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:48.070+0000 7f4d9c05d700 -1 osd.5 119 *** Got signal Terminated *** 2024-02-19T20:14:48.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:48 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:48.070+0000 7f4d9c05d700 -1 osd.5 119 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:14:48.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:48 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:48.232+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:48.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:48 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:48.232+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:20.620515+0000 front 2024-02-19T20:14:20.620473+0000 (oldest deadline 2024-02-19T20:14:43.520411+0000) 2024-02-19T20:14:49.681 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:49 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:49.239+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:49.681 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:49 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:49.239+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:20.620515+0000 front 2024-02-19T20:14:20.620473+0000 (oldest deadline 2024-02-19T20:14:43.520411+0000) 2024-02-19T20:14:50.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:50 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:50.232+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:50.432 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:50 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:50.232+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:20.620515+0000 front 2024-02-19T20:14:20.620473+0000 (oldest deadline 2024-02-19T20:14:43.520411+0000) 2024-02-19T20:14:51.681 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:51 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:51.192+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:51.682 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:51 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:51.192+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:20.620515+0000 front 2024-02-19T20:14:20.620473+0000 (oldest deadline 2024-02-19T20:14:43.520411+0000) 2024-02-19T20:14:52.682 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:52 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:52.213+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-02-19T20:14:13.119287+0000 front 2024-02-19T20:14:13.119352+0000 (oldest deadline 2024-02-19T20:14:39.019152+0000) 2024-02-19T20:14:52.682 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:52 smithi142 ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5[89417]: 2024-02-19T20:14:52.213+0000 7f4d94e4a700 -1 osd.5 119 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-02-19T20:14:20.620515+0000 front 2024-02-19T20:14:20.620473+0000 (oldest deadline 2024-02-19T20:14:43.520411+0000) 2024-02-19T20:14:53.714 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:53 smithi142 podman[122689]: 2024-02-19 20:14:53.456295617 +0000 UTC m=+5.486095997 container died 510ea3b4a23b3ffadd54a39f34f0e81ee0d6f87b1ee36e6cd8314a2b296c3d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-19T20:14:54.047 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:53 smithi142 podman[122689]: 2024-02-19 20:14:53.812172742 +0000 UTC m=+5.841973121 container cleanup 510ea3b4a23b3ffadd54a39f34f0e81ee0d6f87b1ee36e6cd8314a2b296c3d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-19T20:14:54.047 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:53 smithi142 bash[122689]: ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5 2024-02-19T20:14:54.371 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:54 smithi142 podman[122707]: 2024-02-19 20:14:54.047236615 +0000 UTC m=+0.585216213 container remove 510ea3b4a23b3ffadd54a39f34f0e81ee0d6f87b1ee36e6cd8314a2b296c3d39 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-19T20:14:54.659 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:54 smithi142 podman[122795]: 2024-02-19 20:14:54.274698068 +0000 UTC m=+0.018260400 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:14:54.659 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:54 smithi142 podman[122795]: 2024-02-19 20:14:54.37302982 +0000 UTC m=+0.116592193 container create cdb2b29b9c14c2b7417387b503bc2073fbd9a91448dc3ec6dd286bb45348e0e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214) 2024-02-19T20:14:54.659 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:54 smithi142 podman[122795]: 2024-02-19 20:14:54.575294191 +0000 UTC m=+0.318856520 container init cdb2b29b9c14c2b7417387b503bc2073fbd9a91448dc3ec6dd286bb45348e0e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-19T20:14:54.659 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:54 smithi142 podman[122795]: 2024-02-19 20:14:54.578311706 +0000 UTC m=+0.321874034 container start cdb2b29b9c14c2b7417387b503bc2073fbd9a91448dc3ec6dd286bb45348e0e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T20:14:54.659 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:54 smithi142 podman[122795]: 2024-02-19 20:14:54.658614316 +0000 UTC m=+0.402176659 container attach cdb2b29b9c14c2b7417387b503bc2073fbd9a91448dc3ec6dd286bb45348e0e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-19T20:14:54.932 INFO:journalctl@ceph.osd.5.smithi142.stdout:Feb 19 20:14:54 smithi142 podman[122795]: 2024-02-19 20:14:54.867888612 +0000 UTC m=+0.611450935 container died cdb2b29b9c14c2b7417387b503bc2073fbd9a91448dc3ec6dd286bb45348e0e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-c412ec66-cf57-11ee-95bb-87774f69a715-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-19T20:14:55.480 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c412ec66-cf57-11ee-95bb-87774f69a715@osd.5.service' 2024-02-19T20:14:55.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:14:55.524 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-19T20:14:55.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c412ec66-cf57-11ee-95bb-87774f69a715 --force --keep-logs 2024-02-19T20:14:55.686 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T20:15:16.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c412ec66-cf57-11ee-95bb-87774f69a715 --force --keep-logs 2024-02-19T20:15:17.116 INFO:teuthology.orchestra.run.smithi142.stdout:Deleting cluster with fsid: c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T20:15:30.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T20:15:30.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T20:15:30.823 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-19T20:15:30.825 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654/remote/smithi046/crash 2024-02-19T20:15:30.826 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/crash -- . 2024-02-19T20:15:30.863 INFO:teuthology.orchestra.run.smithi046.stderr:tar: /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/crash: Cannot open: No such file or directory 2024-02-19T20:15:30.863 INFO:teuthology.orchestra.run.smithi046.stderr:tar: Error is not recoverable: exiting now 2024-02-19T20:15:30.865 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654/remote/smithi142/crash 2024-02-19T20:15:30.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/crash -- . 2024-02-19T20:15:30.892 INFO:teuthology.orchestra.run.smithi142.stderr:tar: /var/lib/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/crash: Cannot open: No such file or directory 2024-02-19T20:15:30.892 INFO:teuthology.orchestra.run.smithi142.stderr:tar: Error is not recoverable: exiting now 2024-02-19T20:15:30.893 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-19T20:15:30.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-19T20:15:30.942 INFO:teuthology.orchestra.run.smithi046.stdout:2024-02-19T19:10:00.000154+0000 mon.smithi046 (mon.0) 525 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 58/351 objects degraded (16.524%), 16 pgs degraded 2024-02-19T20:15:30.943 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-19T20:15:30.943 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[SEC\]' /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-19T20:15:31.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]' /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-19T20:15:31.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[WRN\]' /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-19T20:15:31.164 INFO:teuthology.orchestra.run.smithi046.stdout:2024-02-19T19:10:00.000154+0000 mon.smithi046 (mon.0) 525 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 58/351 objects degraded (16.524%), 16 pgs degraded 2024-02-19T20:15:31.165 INFO:tasks.cephadm:Compressing logs... 2024-02-19T20:15:31.165 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-19T20:15:31.207 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-19T20:15:31.234 INFO:teuthology.orchestra.run.smithi046.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-19T20:15:31.234 INFO:teuthology.orchestra.run.smithi046.stderr:: No such file or directory 2024-02-19T20:15:31.234 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.audit.log 2024-02-19T20:15:31.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mon.smithi046.log 2024-02-19T20:15:31.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.1.log 2024-02-19T20:15:31.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mon.smithi046.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi046.bwvkwa.log 2024-02-19T20:15:31.234 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi046.log 2024-02-19T20:15:31.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.1.log: /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi046.bwvkwa.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.0.log 2024-02-19T20:15:31.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi046.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mgr.smithi046.qtceex.log 2024-02-19T20:15:31.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.cephadm.log 2024-02-19T20:15:31.236 INFO:teuthology.orchestra.run.smithi142.stderr:find: ‘/var/log/rbd-target-api’gzip -5: No such file or directory --verbose 2024-02-19T20:15:31.236 INFO:teuthology.orchestra.run.smithi142.stderr: -- /var/log/ceph/cephadm.log 2024-02-19T20:15:31.236 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi142.maazlq.log 2024-02-19T20:15:31.236 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi142.eqnctx.log 2024-02-19T20:15:31.236 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi142.maazlq.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.audit.log 2024-02-19T20:15:31.240 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi142.eqnctx.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.4.log 2024-02-19T20:15:31.240 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mgr.smithi142.fwekwv.log 2024-02-19T20:15:31.240 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.5.log 2024-02-19T20:15:31.240 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mgr.smithi142.fwekwv.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.3.log 2024-02-19T20:15:31.241 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.5.log: 92.7%gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.cephadm.log 2024-02-19T20:15:31.241 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-19T20:15:31.241 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi142.log 2024-02-19T20:15:31.241 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.3.log: /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.cephadm.log: 85.9% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.cephadm.log.gz 2024-02-19T20:15:31.243 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.log 2024-02-19T20:15:31.243 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi142.log: 92.0% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.audit.log.gz 2024-02-19T20:15:31.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mgr.smithi046.qtceex.log: 91.9% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.audit.log.gz 2024-02-19T20:15:31.243 INFO:teuthology.orchestra.run.smithi046.stderr: 94.6% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi046.log.gz 2024-02-19T20:15:31.246 INFO:teuthology.orchestra.run.smithi142.stderr: 94.7% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi142.log.gz 2024-02-19T20:15:31.252 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mon.smithi142.log 2024-02-19T20:15:31.252 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-volume.log 2024-02-19T20:15:31.252 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-19T20:15:31.253 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi046.hrbbel.log 2024-02-19T20:15:31.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.log 2024-02-19T20:15:31.253 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi046.hrbbel.log: gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.2.log 2024-02-19T20:15:31.253 INFO:teuthology.orchestra.run.smithi046.stderr: 86.0% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.cephadm.log.gz 2024-02-19T20:15:31.254 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mon.smithi142.log: 94.6% 90.3% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.log.gz 2024-02-19T20:15:31.254 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi142.eqnctx.log.gz 2024-02-19T20:15:31.255 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.log: 90.3% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph.log.gz 2024-02-19T20:15:31.256 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-volume.log 2024-02-19T20:15:31.271 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-volume.log: 91.5% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-volume.log.gz 2024-02-19T20:15:31.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.2.log: /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-volume.log: 91.7% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-volume.log.gz 2024-02-19T20:15:31.288 INFO:teuthology.orchestra.run.smithi142.stderr: 90.5% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mgr.smithi142.fwekwv.log.gz 2024-02-19T20:15:32.013 INFO:teuthology.orchestra.run.smithi142.stderr: 92.5% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mon.smithi142.log.gz 2024-02-19T20:15:32.089 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mgr.smithi046.qtceex.log.gz 2024-02-19T20:15:34.374 INFO:teuthology.orchestra.run.smithi046.stderr: 89.9% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mon.smithi046.log.gz 2024-02-19T20:15:36.543 INFO:teuthology.orchestra.run.smithi142.stderr: 93.2% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.4.log.gz 2024-02-19T20:15:36.799 INFO:teuthology.orchestra.run.smithi046.stderr: 95.2% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi046.hrbbel.log.gz 2024-02-19T20:15:37.892 INFO:teuthology.orchestra.run.smithi142.stderr: 93.3% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.3.log.gz 2024-02-19T20:15:38.283 INFO:teuthology.orchestra.run.smithi142.stderr: 93.4% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.5.log.gz 2024-02-19T20:15:38.516 INFO:teuthology.orchestra.run.smithi046.stderr: 93.5% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.2.log.gz 2024-02-19T20:15:39.522 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.0.log.gz 2024-02-19T20:15:42.719 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-osd.1.log.gz 2024-02-19T20:15:55.725 INFO:teuthology.orchestra.run.smithi142.stderr: 93.1% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi142.maazlq.log.gz 2024-02-19T20:15:55.727 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-02-19T20:15:55.727 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m24.505s 2024-02-19T20:15:55.727 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m42.807s 2024-02-19T20:15:55.727 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m1.521s 2024-02-19T20:16:41.267 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/c412ec66-cf57-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi046.bwvkwa.log.gz 2024-02-19T20:16:41.269 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-02-19T20:16:41.269 INFO:teuthology.orchestra.run.smithi046.stderr:real 1m10.049s 2024-02-19T20:16:41.269 INFO:teuthology.orchestra.run.smithi046.stderr:user 1m43.522s 2024-02-19T20:16:41.269 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m2.993s 2024-02-19T20:16:41.269 INFO:tasks.cephadm:Archiving logs... 2024-02-19T20:16:41.270 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654/remote/smithi046/log 2024-02-19T20:16:41.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-19T20:16:55.712 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654/remote/smithi142/log 2024-02-19T20:16:55.713 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-19T20:17:02.546 INFO:tasks.cephadm:Removing cluster... 2024-02-19T20:17:02.546 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c412ec66-cf57-11ee-95bb-87774f69a715 --force 2024-02-19T20:17:02.708 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T20:17:03.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c412ec66-cf57-11ee-95bb-87774f69a715 --force 2024-02-19T20:17:03.249 INFO:teuthology.orchestra.run.smithi142.stdout:Deleting cluster with fsid: c412ec66-cf57-11ee-95bb-87774f69a715 2024-02-19T20:17:03.564 INFO:tasks.cephadm:Removing cephadm ... 2024-02-19T20:17:03.565 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-19T20:17:03.580 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-19T20:17:03.596 INFO:tasks.cephadm:Teardown complete 2024-02-19T20:17:03.596 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-19T20:17:03.619 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-19T20:17:03.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-19T20:17:03.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-19T20:17:03.715 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-19T20:17:03.727 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-19T20:17:03.728 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T20:17:03.731 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T20:17:03.743 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-02-19T20:17:03.744 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-02-19T20:17:03.747 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T20:17:03.747 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-02-19T20:17:03.747 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 0 +720us[ +720us] +/- 88ms 2024-02-19T20:17:03.747 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -1294us[-1350us] +/- 65ms 2024-02-19T20:17:03.747 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +780us[ +739us] +/- 71ms 2024-02-19T20:17:03.747 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T20:17:03.748 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T20:17:03.748 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-02-19T20:17:03.749 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 +825us[ +825us] +/- 88ms 2024-02-19T20:17:03.749 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 8 377 70 -1168us[-1283us] +/- 64ms 2024-02-19T20:17:03.749 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +827us[ +827us] +/- 72ms 2024-02-19T20:17:03.749 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T20:17:03.750 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-19T20:17:03.761 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-19T20:17:03.762 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-19T20:17:03.774 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-19T20:17:03.882 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-19T20:17:03.965 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T20:17:03.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T20:17:03.996 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T20:17:04.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T20:17:04.027 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-19T20:17:04.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-19T20:17:04.052 INFO:teuthology.task.internal:Duration was 5734.678632 seconds 2024-02-19T20:17:04.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-19T20:17:04.064 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-19T20:17:04.064 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-19T20:17:04.067 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-19T20:17:04.108 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T20:17:04.109 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T20:17:04.352 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-19T20:17:04.352 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-02-19T20:17:04.353 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-19T20:17:04.412 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-02-19T20:17:04.413 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-19T20:17:04.436 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-19T20:17:04.436 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-19T20:17:04.455 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-19T20:17:04.505 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-19T20:17:04.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-19T20:17:04.523 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-19T20:17:05.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-19T20:17:05.249 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-19T20:17:05.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-19T20:17:05.276 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-19T20:17:05.304 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-19T20:17:05.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-19T20:17:05.319 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-19T20:17:05.342 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-02-19T20:17:05.370 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-02-19T20:17:05.386 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-19T20:17:05.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T20:17:05.412 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-19T20:17:05.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T20:17:05.440 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-19T20:17:05.452 INFO:teuthology.task.internal:Transferring archived files... 2024-02-19T20:17:05.454 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654/remote/smithi046 2024-02-19T20:17:05.454 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-19T20:17:05.505 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654/remote/smithi142 2024-02-19T20:17:05.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-19T20:17:05.546 INFO:teuthology.task.internal:Removing archive directory... 2024-02-19T20:17:05.546 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-19T20:17:05.548 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-19T20:17:05.594 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-19T20:17:05.608 INFO:teuthology.task.internal:Not uploading archives. 2024-02-19T20:17:05.608 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-19T20:17:05.620 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-19T20:17:05.621 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-19T20:17:05.623 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-19T20:17:05.634 INFO:teuthology.orchestra.run.smithi046.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 20:17 /home/ubuntu/cephtest 2024-02-19T20:17:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: 266023 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 20:17 /home/ubuntu/cephtest 2024-02-19T20:17:05.650 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-19T20:17:05.664 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-19T20:17:05.689 INFO:teuthology.nuke:Checking targets against current locks 2024-02-19T20:17:05.716 DEBUG:teuthology.nuke:shortname: smithi046 2024-02-19T20:17:05.717 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T20:17:05.742 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 18:30:52.930817', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMyQ1DUzSu+1epuFRwlF2GjDRcc1OURWZl+Vc5PGCBdr2ZyYjwyH/K+BKh2p5gMac4mmqsymU+PQmpfX8zIM6TA='} 2024-02-19T20:17:05.745 DEBUG:teuthology.nuke:shortname: smithi142 2024-02-19T20:17:05.746 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T20:17:05.766 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566654', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 18:30:52.929240', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfApKqs0C76XrvwplQnsZ6Z0p7tZbRFtt7m/NFr6OhqBAy7MNBNiZ8U+FE8dQNlIjU4TCEM0gyTC9raPop5R8k='} 2024-02-19T20:17:05.794 INFO:teuthology.orchestra.console.smithi046:Power off 2024-02-19T20:17:05.794 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T20:17:05.816 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-02-19T20:17:05.816 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:17:05.832 INFO:teuthology.orchestra.console.smithi142:Power off 2024-02-19T20:17:05.832 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T20:17:05.842 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-02-19T20:17:05.854 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-02-19T20:17:05.854 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:17:05.875 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-19T20:17:09.842 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:17:09.876 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:17:09.952 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-02-19T20:17:09.985 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-19T20:17:13.957 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:17:13.986 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:17:14.068 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-02-19T20:17:14.095 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-02-19T20:17:14.169 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-02-19T20:17:18.096 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:17:18.206 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-02-19T20:17:18.307 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-02-19T20:17:18.411 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 5734.678631782532 failure_reason: '"2024-02-19T19:10:00.000154+0000 mon.smithi046 (mon.0) 525 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 58/351 objects degraded (16.524%), 16 pgs degraded" in cluster log' flavor: default owner: scheduled_pdonnell@teuthology success: false 2024-02-19T20:17:18.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:17:18.494 INFO:teuthology.run:FAIL